JP2016009995A - Image processing apparatus, image processing system, information processing method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To suitably determine an image processing sequence.SOLUTION: An image processing apparatus comprises: receiving means for receiving image processing information of a connected extension device from the extension device; acquisition means for acquiring image processing information of the image processing apparatus; and determination means for determining an image processing sequence including the processing order of plural image processing modules for processing jobs, on the basis of the received image processing information of the extension device, the acquired image processing information of the image processing apparatus, and job information of a job relating to an extension function.

Description

  The present invention relates to an image processing apparatus, an image processing system, an information processing method, and a program.

In recent years, for example, when copying an original on an image forming apparatus, the user selects a copy mode, reads the image data of the original from the original table using the scanner function, and inputs various instructions from the operation panel to copy the original. Set the basic functions in the mode. The image forming apparatus performs image processing (aggregation, scaling, etc.) based on the set setting information and the like, and then prints using the printer function. Such an image forming apparatus has many standard functions and an optional function (extended function) to be introduced in response to a user's request.
Examples of extended functions include "scan data transmission by FAX", "perform scan data OCR (Optical Character Reader)", and "extract and transfer only necessary parts from scan data to the user's backbone system". is there.
As a method for realizing the extended function in the image forming apparatus, a program is prepared in an information processing apparatus (for example, a server computer) connected to the network (external as viewed from the image forming apparatus). There is a method realized by communicating data from an image forming apparatus via a network and executing data processing in a server. Alternatively, there is a method that is realized by downloading a program to the image forming apparatus itself and executing data processing in the image forming apparatus.

As described above, a system is disclosed that provides a service for processing in cooperation between an image forming apparatus and an external device of the image forming apparatus via a network (see, for example, Patent Document 1).
In Patent Document 1 described above, an extended function related to the standard function is displayed along with a standard function that the image forming apparatus has as a standard. Therefore, the user can easily execute an extended function related to a user who uses the image forming apparatus (related to a standard function that is highly likely to be selected by the user).

JP 2011-101142 A

However, when displaying and using an extended function related to the standard function together with the standard function, the user needs to process the extended function over the network, limit the documents that can be processed, and use the extended function. The document format must also be taken into account.
In recent years, small computers (hereinafter referred to as dongles) that can be connected to computers and televisions have become available at low cost.
Therefore, in addition to the extended function for processing data on the server via the network, the dongle is directly connected via a high-speed interface such as a USB provided in the image forming apparatus, and an extended function for larger data. An environment that can also be realized.
As image processing hardware, a field-programmable gate array (FPGA) or the like that can perform a circuit configuration even after market shipment by replacing a configuration file on the user side is beginning to be applied. Therefore, it is possible to configure hardware for extended functions on the image forming apparatus side.
In such an environment, not only an extended function via a network, but also an image processing function using a dongle and an image processing function of a device such as a configurable FPGA in the image forming apparatus can be used. .
However, when image processing is executed by combining various devices, each device and a communication interface to be connected are arbitrary. For this reason, there is a problem that the throughput of the job is lowered or the processing cannot be performed depending on circumstances unless the image processing sequence for executing the extended function is appropriately set.

  Therefore, the present invention is an image processing apparatus connectable to an expansion device, receiving means for receiving image processing information of the expansion device from the connected expansion device, and acquiring image processing information of the image processing apparatus The job is processed based on acquisition means, the received image processing information of the extended device, the acquired image processing information of the image processing apparatus, and job information of a job related to an extended function. Determining means for determining an image processing sequence including a processing order of the plurality of image processing modules.

  According to the present invention, it is possible to appropriately determine an image processing sequence.

2 is a diagram illustrating an example of a hardware configuration of an image forming apparatus. FIG. 3 is a diagram illustrating an example of a software configuration of the image forming apparatus according to the first embodiment. FIG. It is a figure which shows an example of the hardware constitutions of an expansion device. It is a figure which shows an example of the screen after the tag of "use of a preservation | save file" is selected. It is a figure which shows an example of the screen after the other function execution button was pressed down. It is a figure which shows an example of a screen when an expansion device is inserted in expansion I / F. 3 is a flowchart illustrating an example of information processing according to the first exemplary embodiment. 3 is a diagram illustrating an example of an image processing information table of the image forming apparatus. FIG. It is a figure which shows an example of the image processing information table of an extended device. FIG. 3 is a diagram illustrating an example of an image processing sequence according to the first embodiment. 10 is a flowchart illustrating an example of information processing according to the second exemplary embodiment. FIG. 10 is a diagram illustrating an example of an image processing sequence according to a second embodiment. FIG. 10 is a diagram illustrating an example of a software configuration of an image forming apparatus according to a third embodiment. 10 is a flowchart illustrating an example of information processing according to a third exemplary embodiment. It is a figure which shows an example of the screen which concerns on the authentication when an extended function is added. It is a figure which shows an example of the screen which displays that the extended function is being used. It is a figure which shows an example of the screen which cancels | releases the authority of an extended function.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

<Embodiment 1>
FIG. 1 is a diagram illustrating an example of a hardware configuration of the image forming apparatus 100. The image forming apparatus 100 is connected to a scanner 101 that is an image input device via a scanner image processing unit 118. The image forming apparatus 100 is connected to a printer engine 102 that is an image output device via a printer image processing unit 119.
The image forming apparatus 100 performs control for reading image data and printing. Further, the image forming apparatus 100 is connected to the LAN 10 or the public line 104 to perform control for inputting / outputting image information and device information via the LAN 10.
The CPU 105 is a central processing unit for controlling the image forming apparatus 100. The RAM 106 is a system work memory used when the CPU 105 executes processing based on a program, and is also an image memory for temporarily storing input image data. A ROM 107 is a boot ROM, and stores a system boot program. An HDD 108 is a hard disk drive, and stores system software programs for various processes, input image data, and the like. The operation unit I / F 109 is an interface unit for the operation unit 110 that displays a display screen capable of displaying image data and the like, and outputs screen data and the like to the operation unit 110. The operation unit I / F 109 serves to transmit information input by the operator from the operation unit 110 to the CPU 105. The network I / F 111 is realized by a LAN card, for example, and is connected to the LAN 10 to input / output information to / from an external device. The modem 112 is connected to the public line 104 and inputs / outputs information to / from an external device. The GPU 132 is a graphics processing unit, and various image processing can be performed by operating an image processing program on the GPU 132. The above units are arranged on the system bus 113.

The image bus I / F 114 is an interface for connecting the system bus 113 and an image bus 115 that transfers image data at high speed, and is a bus bridge that converts a data structure. On the image bus 115, a raster image processor (RIP) unit 116, a device I / F 117, an image editing image processing unit 120, an image compression unit 103, an image expansion unit 121, an expansion device communication I / F 130, an option An image processing unit 150 is connected.
The RIP unit 116 expands a page description language (PDL) code into image data. The device I / F 117 connects the scanner 101 and the printer engine 102 via the scanner image processing unit 118 and the printer image processing unit 119, and performs synchronous / asynchronous conversion of image data.
The scanner image processing unit 118 performs various processes such as image area separation on the image data input from the scanner 101 in addition to correction and processing. The image editing image processing unit 120 performs various image processing such as rotation of image data, scaling, and binarization processing. The image compression unit 103 encodes the image data processed by the RIP unit 116, the scanner image processing unit 118, and the image editing image processing unit 120 by a predetermined compression method when the HDD 108 stores the image data once. The image decompression unit 121 performs image processing on the image data compressed by the HDD 108 as necessary, by the image editing image processing unit 120 or the printer image processing unit 119, and when the image data is output by the printer engine 102, the image data is compressed and encoded. Decrypt and decompress the data that has been converted. The printer image processing unit 119 performs image processing correction or the like corresponding to the printer engine on the image data to be printed out. The expansion device communication I / F 130 is an interface unit for connecting to an expansion device 140, which will be described later, via the expansion I / F 131, and is used to input and output image data to and from an image processing module in the expansion device. is there. The option image processing unit 150 is configured by, for example, a field-programmable gate array (FPGA), and is a programmable logic device that can configure necessary circuits on the user side. The user can add an image processing function by configuring an image processing circuit necessary for the option image processing unit 150.
When the CPU 105 executes processing based on a program stored in the ROM 107 or the HDD 108, the function of the image forming apparatus 100 and the processing of the flowchart of the image forming apparatus 100 in the following embodiment are realized. The image forming apparatus 100 is an example of an image processing apparatus that can be connected to an expansion device.

FIG. 2 is a diagram illustrating an example of a software configuration of the image forming apparatus 100 according to the first embodiment.
The job control processing unit 201 controls and controls each software module, and controls all jobs generated in the image forming apparatus 100 such as copying, printing, scanning, FAX transmission / reception, and UI processing.
The network processing unit 202 is a module that controls communication with the outside, which is mainly performed via the network I / F 111, and performs communication control with each device on the LAN 10. When receiving a control command or data from each device of the LAN 10, the network processing unit 202 notifies the job control processing unit 201 of the contents. The network processing unit 202 transmits a control command and data to each device of the LAN 10 based on an instruction from the job control processing unit 201.
The UI processing unit 203 mainly performs control related to the operation unit 110 and the operation unit I / F 109. The UI processing unit 203 notifies the job control processing unit 201 of the details of the operation of the operation unit 110 by the operator. Further, the UI processing unit 203 controls the display content of the display screen on the operation unit 110 based on an instruction from the job control processing unit 201. The UI processing unit 203 also controls editing of drawing data to be displayed on the operation unit 110.

The FAX processing unit 204 controls the FAX function. The FAX processing unit 204 performs FAX reception via the modem 112, performs image processing specific to the FAX image, and notifies the job control processing unit 201 of the received image. Further, the FAX processing unit 204 transmits the image designated from the job control processing unit 201 to the designation notification destination.
The print processing unit 207 controls the image editing image processing unit 120, the printer image processing unit 119, and the printer engine 102 based on an instruction from the job control processing unit 201, and performs a specified image printing process. The print processing unit 207 receives image data, image information (image data size, color mode, resolution, etc.), layout information (offset, enlargement / reduction, imposition, etc.) and output paper information (size, size, etc.) from the job control processing unit 201. (Print direction, etc.) information is received. The print processing unit 207 controls the image compression unit 103, the image expansion unit 121, the image editing image processing unit 120, the option image processing unit 150, and the printer image processing unit 119, and performs appropriate processing on the image data. Control to perform image processing. Also, the print processing unit 207 controls the printer engine 102 to print on the designated paper.
The scan processing unit 210 controls the scanner 101 and the scanner image processing unit 118 based on an instruction from the job control processing unit 201 to read a document on the scanner 101.

The color conversion processing unit 209 performs color conversion processing on the instruction image based on an instruction from the job control processing unit 201 and notifies the job control processing unit 201 of the image after the color conversion processing.
The RIP processing unit 211 interprets (interprets) a PDL (page description language) based on an instruction from the job control processing unit 201, and controls the RIP unit 116 to perform rendering, thereby developing the bitmap image. I do.
The extended I / F control unit 205 is a part that performs control of the extended I / F 131 and control of data exchange with an extended device that communicates via the extended I / F 131, and controls job status of image data transmission / reception. Notify the processing unit 201.
The image processing sequence determination processing unit 206 calls and collates image processing information tables 700 and 800 describing image processing information of the image forming apparatus 100 and the connected expansion device 140. In this way, the image processing sequence determination processing unit 206 determines an optimal image processing sequence for a job executed in accordance with a user instruction.

FIG. 3 is a diagram illustrating an example of a hardware configuration of the expansion device 140.
A CPU 301, RAM 302, GPU 303, network I / F 304, ROM 305, nonvolatile memory 306, and communication bus I / F 307 are connected to the system bus 308. The CPU 301 is a central processing unit that controls the expansion device 140. A RAM 302 is a system work memory for operating the CPU 301 and the GPU 303, and is also an image memory for temporarily storing input image data. A ROM 305 is a boot ROM and stores a system boot program. The nonvolatile memory 306 is a memory that expands an image processing program that can be added as an extended function. The communication bus I / F 307 is an interface circuit of the communication bus 309 through the external communication I / F 310. The external communication I / F 310 is an interface unit that is connected to the image forming apparatus 100 via the expansion I / F 131 to control communication and input / output image data.

A control in which the user connects the expansion device 140 to the image forming apparatus 100 with the above-described configuration and performs OCR processing on document data in the HDD 108 using the expansion function in the expansion device 140 will be described.
Here, FIG. 4 is a diagram illustrating an example of a screen after the tag “use saved file” is selected from the mode selection screen displayed on the operation unit 110. The user selects data of a file to be used from the file list screen 401 and presses another function execution button 404, for example.
FIG. 5 is a diagram illustrating an example of a screen after the other function execution button 404 is pressed.
As shown in FIG. 5, a list of buttons for selecting various types of processing for a file saved by the PDF conversion button 501 and the resize button 502 for the file is displayed. Here, in the present embodiment, the extended function area 510 is provided in the menu area so that the user can use the extended function when the extended device 140 is connected. When nothing is connected to the extension I / F 131 of the image forming apparatus 100 and the extension function cannot be acquired, the extension function area 510 is grayed out as shown in FIG.
Hereinafter, a case where the expansion device 140 is connected will be described.

Here, a screen display of the operation unit 110 when the user inserts the expansion device 140 into the insertion port of the expansion I / F 131 of the image forming apparatus 100 will be described.
FIG. 6 is a diagram illustrating an example of a screen when the user inserts the expansion device 140 into the expansion I / F. As shown in FIG. 6, in the extended function area 510 that was grayed out earlier, the extended function is displayed.

Hereinafter, processing when the expansion device 140 is connected will be described.
FIG. 7 is a flowchart illustrating an example of information processing of the image processing system.
The CPU 105 determines whether or not the expansion device 140 is inserted (or connected) to the insertion port of the expansion I / F 131 (S1401). If the connection of the expansion device 140 is detected, the CPU 105 proceeds to S1404.
On the other hand, the CPU 301 determines whether or not it has been inserted (or connected) into the insertion port of the expansion I / F 131 of the image forming apparatus 100 (S1402). If the connection to the image forming apparatus 100 is detected, the CPU 301 advances to S1403.

In step S <b> 1403, the CPU 301 transmits the image processing information table 800 stored in the nonvolatile memory 306 in the expansion device 140 to the image forming apparatus 100 via the external communication I / F 310 and the expansion I / F 131.
In step S <b> 1404, the CPU 105 stores the received image processing information table 800 in the RAM 106 from the expansion I / F 131 via the expansion device communication I / F 130. Thereafter, the CPU 105 extracts extended functions that can be used by the image forming apparatus 100 in accordance with the contents of the image processing information table 800 and displays them in the extended function area 510.

Here, FIG. 8 is a diagram illustrating an image processing information table 700 in which the image forming apparatus 100 lists resource information of processing related to image processing.
The image processing information table 700 includes two sub tables 701 and 702. One is a resource table 701 in which details of an arithmetic unit in the image forming apparatus 100, a memory capacity usable for image processing, and an extended communication I / F are described.
The resource table 701 is composed of an extended communication I / F information column 703, used calculator information columns 704 to 706, a memory capacity information column 707 usable for image processing, and the like.
The other sub-table is a processing module table 702 showing each image processing module.
The processing module table 702 includes types of image processing modules that can be used in the image forming apparatus 100, data formats that can be processed by each module, processing speed, usage status, and the like.
Note that the processing modules described in the processing module table 702 may be executed by software or executed by hardware.

FIG. 9 is a view for explaining an image processing information table 800 in which the expansion device 140 lists resource information of processing related to image processing.
The configuration of the expansion device 140 is the same as that of the image processing information table 700.
The image processing information tables 700 and 800 are updated if there is a configuration of the image forming apparatus 100 or expansion device, addition / deletion of software, or the like, and always indicates the latest information related to image processing.
In addition, when the image processing module is software, the processing speed is also updated when there is a change in the arithmetic unit to be operated, clock-up, etc. Will be updated. Each table is updated by the CPU of each device.
Further, the CPU 105 and the CPU 301 may update the communication speed of the extended communication I / F in each image processing information table based on the communication speed when communication between the image forming apparatus and the extended device is established.
As described above, in the extended function area 510 of FIG. 6 described above, the extended function reflecting the information in the image processing information table 800 of the extended device 140 is displayed.

Hereinafter, the user selects a JPEG file in FIG. 4 earlier, connects the expansion device 140 to the image forming apparatus 100, and performs OCR processing, which is an expansion function using the expansion device 140 on the screen in FIG. A case where the button 601 is pressed for execution will be described.
When the user presses the OCR button 601 in FIG. 6, the CPU 105 detects that an extended function job has been selected (S1405). Then, the CPU 105 extracts image processing modules from the selected JPEG file until the extended device 140 performs OCR (S1406). Information for identifying the selected extended function is an example of job information.
In this example, the CPU 105 determines that the selected file is a JPEG file, and the OCR processable data format in the column 808 on the image processing information table 800 side on the expansion device 140 side stored in the RAM 106 is the Raw format. Judge that there is. Then, the CPU 105 changes the JPEG file to Raw data and determines that an image processing sequence for performing OCR processing is necessary.
The CPU 105 (image processing sequence determination processing unit 206) collates both image processing information tables 700 and 800 and determines an image processing sequence that can be processed at the highest speed.
FIG. 10A is a diagram illustrating an example of an image processing sequence determined by the image processing sequence determination processing unit 206 based on information in the image processing information tables 700 and 800.
FIG. 10A shows a sequence from when the OCR process is executed on the expansion device 140 from the module for calling the document file (in this case, the HDD 108), and the result is stored in the RAM 302 on the expansion device 140. Note that a transfer sequence of output data after OCR stored in the RAM 302 is omitted.
The communication sequence includes a processing order of a plurality of image processing modules.

The CPU 105 first collates the image processing information tables 700 and 800, and checks whether there is a module necessary for executing the selected job on the selected document file (S1407).
Here, in the present embodiment, as described later, an example in which processing of a JPEG decoder is implemented in both the image forming apparatus 100 and the expansion device 140 is described.
However, in the job selection, if the selected document is, for example, a JBIG file and the JBIG decoding process is not implemented in both the image forming apparatus 100 and the expansion device 140, the CPU 105 performs the following processing. Execute. That is, the CPU 105 performs display control such as notifying the operation unit 110 that processing is impossible, or not allowing the user to select a document that cannot be processed on the file selection screen, for example, by graying out (S1408). Here, JBIG is an abbreviation for Joint Bi-level Image Experts Group.
Next, the CPU 105 checks whether a similar processing module exists in both the image processing information tables 700 and 800 among the modules necessary for executing the selected job (S1409).
In the present embodiment, the CPU 105 detects that both devices have JPEG decoders as shown in columns 709 and 809 in FIG.

Here, the CPU 105 determines the image processing sequence based on the processing speeds in the fields 709 and 809 and the usage status (S1410).
In this case, the processing speed of the JPEG decoder on the image forming apparatus 100 side is 200 MB / s and the usage status is No, the processing speed of the JPEG decoder on the expansion device 140 side is 70 MB / s, and the usage status is No. Therefore, the CPU 105 generates an image processing sequence to be processed by the JPEG decoder on the image forming apparatus 100 side having a high processing speed as shown in FIG. 10A (S1411). On the other hand, if the processing speed of the JPEG decoder on the expansion device 140 side is faster than the processing speed of the JPEG decoder on the image forming apparatus 100 side, or the usage status of the JPEG decoder on the image forming apparatus 100 side is YES, the CPU 105 The process proceeds to S1413. In step S1413, the CPU 105 generates an image processing sequence to be processed by the JPEG decoder on the expansion device 140 side.
For example, when determining each processing 901 to 908, the CPU 105 determines the processing (transfer) speed, the input data format in each processing, and the data capacity of the input data for the resources used as shown in FIG. To decide.
Accordingly, as shown in FIG. 10A, the CPU 105 controls the document data of the JPEG file read from the HDD 108 so as to perform JPEG decoding on the image forming apparatus 100 side (S1412). The CPU 105 transmits the decoded raw document data to the expansion device 140 via the expansion I / F 131 (in this case, using USB 3.0) (S1414). On the expansion device 140 side, the CPU 301 once stores the decoded data in the RAM 302 (S1415). Then, the CPU 301 controls to perform the OCR process (S1416). Then, the CPU 301 stores the output data after the OCR in the RAM 302 again. Thereafter, the CPU 301 transmits the output data stored in the RAM 302 to the image forming apparatus 100 via the expansion I / F 131 (S1417), and the processing on the expansion device 140 side illustrated in FIG. The CPU 105 receives the data transmitted from the expansion device 140 (S1418), and ends the processing on the image forming apparatus 100 side shown in FIG.

In this example, the expansion I / F 131 is, for example, USB 3.0, and the image processing sequence is performed when the image forming apparatus 100 and the expansion device 140 are connected through an interface whose communication speed is faster than the threshold. Hereinafter, a case of an interface whose communication speed is slower than a threshold, such as USB 2.0, will be described. The extended I / F is an example of a communication interface.
FIG. 10B shows the case where “USB 2.0: 60 MB / s” is described in the extended communication I / F information fields 703 and 803 of the image processing information tables 700 and 800, and the CPU 105 generates them in S1413. It is an example of an image processing sequence.
As shown in FIG. 10B, the document data of the JPEG file called from the HDD 108 in the image forming apparatus 100 is transferred to the expansion device 140 via the RAM 106 and the expansion I / F 131 (in this case, USB 2.0). Then, JPEG decoding processing and OCR processing are performed in the expansion device 140.
This is because when the extended I / F 131 in FIG. 10A is USB 3.0, the transfer speed is 625 MB / s as described in the middle section of the process 905 and the transfer speed column, and the output data in the lower section. Since the data capacity in the format is 134 MB, the processing time is about 0.21 sec. The bottleneck of processing is OCR processing (processing 907) on the expansion device 140 side, and the processing time is about 1.11 sec.
On the other hand, in the case of FIG. 10B, the process bottleneck is the JPEG decoding process of the process 913 on the expansion device 140 side, and the processing time is about 1.91 sec.
For example, when the expansion I / F 131 is USB 2.0, the image processing sequence shown in FIG. 10A using the JPEG decoder in the image forming apparatus 100 is obtained only by comparing the processing speed of the JPEG decoder. . Then, the raw data 134 MB after JPEG decoding is actually communicated to the USB 2.0 extended I / F 131, and the communication time here is about 2.23 sec, which becomes a bottleneck of the image processing sequence. This is a processing time slower than the processing time of about 1.91 sec of the JPEG decoding processing of the processing 913 in FIG. 10B, and the throughput is lowered as a whole.
Therefore, the CPU 105 calculates the processing (communication time) of each processing, determines the image processing sequence by comparing the bottlenecks of the respective image processing sequences, and generates an image processing sequence with the fastest throughput.

Here, the method of the image processing sequence determined when the extended I / F is different has been described. However, the CPU 105 should consider the determination of the image processing sequence in any part related to the path of the image processing sequence, not limited to the extended I /.
In the usage status column of the processing module tables 702 and 802, if the usage status of the image processing module to be used is Yes, the CPU 105 determines whether an alternative module can be selected in the process of determining the image processing sequence. . Then, when an alternative module can be selected in the process of determining the image processing sequence, the CPU 105 may take a method such as generating an image processing sequence so as to select the alternative module.

  As described above, in the present exemplary embodiment, when the image processing forming apparatus and the expansion device are connected and the use of the expansion function is selected, the CPU 105 receives information on each other's image processing module and communication I / F. Are collated to generate an image processing sequence. At that time, the CPU 105 generates an image processing sequence based on the processing speed of the image processing module, the format of the selected document, and the data format and data capacity of each path in executing the image processing sequence. Thus, an optimal image path is generated in executing the selected extended function, and the job end time can be shortened.

<Embodiment 2>
In the first exemplary embodiment, when the expansion device 140 is connected and a job is selected as the expansion function, the CPU 105 determines, based on the processing speed of the image processing module, the format of the selected document, and the data format and data capacity of each path. An image processing sequence was generated.
On the other hand, in the present embodiment, the CPU 105 is based on the memory capacity used by the selected extension function and the selected document and the memory capacity usable by the image forming apparatus 100 and the extension device 140. An image processing sequence is generated.
The hardware configuration of the image forming apparatus 100, the software configuration, the hardware configuration of the expansion device 140, and the like in the present embodiment are the same as those in FIGS. 1, 2, and 3 described in the first embodiment, and thus description thereof is omitted.
Further, the image processing information tables included in the image forming apparatus 100 and the expansion device 140 are also the same as those in FIGS.

In the above configuration, in the present embodiment, a case where the OCR button 601 is pressed on the operation unit screen of FIG. 6 and the OCR process that is the extended function of the expansion device 140 is executed is described as an example. . In the present embodiment, an example of image processing sequence generation when the file selected in FIG. 4 is a JPEG file but the data amount per page is large (for example, 1200 dpi) will be described based on the flowchart of FIG. .
The CPU 105 determines whether or not the expansion device 140 is inserted (or connected) into the insertion port of the expansion I / F 131 (S1501). If the connection of the expansion device 140 is detected, the CPU 105 proceeds to S1504.
On the other hand, the CPU 301 determines whether or not it has been inserted (or connected) into the insertion port of the expansion I / F 131 of the image forming apparatus 100 (S1502). If the connection to the image forming apparatus 100 is detected, the CPU 301 advances to S1503.

In step S <b> 1503, the CPU 301 transmits the image processing information table 800 stored in the nonvolatile memory 306 in the expansion device 140 to the image forming apparatus 100 via the external communication I / F 310 and the expansion I / F 131.
In step S <b> 1504, the CPU 105 stores the received image processing information table 800 from the expansion I / F 131 via the expansion device communication I / F 130 in the RAM 106. Thereafter, the CPU 105 extracts extended functions that can be used by the image forming apparatus 100 in accordance with the contents of the image processing information table 800 and displays them in the extended function area 510.
When the user presses the OCR button 601 in FIG. 6, the CPU 105 detects that an extended function job has been selected (S1505). The CPU 105 extracts image processing modules from the selected JPEG file until OCR is performed by the expansion device 140 (S1506). Here, since the selected file is a JPEG file and the data format that can be processed by the OCR processing on the expansion device 140 side is the Raw format, the JPEG file is changed to Raw data, and an image processing sequence for performing OCR processing is obtained. Necessary. Here, the CPU 105 collates both the image processing information tables 700 and 800, and determines an image processing sequence that can be processed at the highest speed (S1507).

FIG. 12 is a diagram illustrating an example of an image processing sequence when the data amount of a JPEG file is large (for example, Raw data 533 MB). FIG. 12A shows an example incapable of processing, and FIG. 12B shows an image processing sequence corrected by the CPU 105 so that processing is possible.
In FIG. 12A, the image processing sequence is generated so as to be the fastest processing as in FIG. 10A of the first embodiment.
Here, the processing on the image forming apparatus 100 side can be processed without any problem, but the expansion device 140 cannot perform the processing. Processing 1006, that is, an image processing sequence in which Raw format document data JPEG-decoded in the image forming apparatus 100 is received once by the RAM 302, and output data after the OCR processing of the processing 1007 in FIG. It is.
In this image processing sequence, the memory capacity used particularly on the expansion device 140 side is 583 MB as the sum of the memory capacities in the used resource column in the processing 1006 and processing 1007 portions.
However, when the usable memory capacity in the 807 column of the image processing information table 800 stored in the RAM 106 in the image forming apparatus 100 is confirmed, it is 512 MB.
Therefore, the CPU 105 compares the total memory capacity used in the image processing sequence generated in S1507 (in this case, 583 MB) with the usable memory capacity (in this case, 512 MB) based on the image processing information table ( S1508). Then, as a result of the comparison, the CPU 105 determines whether the image processing sequence has insufficient memory capacity in the processing of the image forming apparatus or the expansion device, and changes the image processing sequence according to the determination result.

FIG. 12B shows an image processing sequence changed by the CPU 105.
Compared to FIG. 12A, in FIG. 12B, the CPU 105 divides the size called from the memory in the processing 1012 into every ¼ page from all the pages of Raw data (S 1509), and the expansion device 140 side Has been changed to send to. As a result, the CPU 105 transmits data from the RAM 106 in the image forming apparatus 100 to the expansion device 140 every ¼ page (S1510).
In step 1014, the CPU 301 stores data in the RAM 302 for each 1/4 page (S1511). Then, the CPU 301 sequentially performs OCR processing (S1512) in processing 1015. In step 1016, the CPU 301 stores output data for ¼ page in the RAM 302 (S1513), and then transmits a data transmission request interrupt 1017 to the image forming apparatus 100 again (S1514).
The CPU 105 receives the data transmission request interrupt 1017 from the expansion device 140 (S1515). Then, the CPU 105 confirms whether all the target document data has been transmitted (S1516). When there is remaining document data, the CPU 105 transmits the data every 1/4 page again. When all the document data has been transmitted, the CPU 105 transmits a transmission end signal indicating that all the document data has been transmitted to the CPU 301 on the expansion device side via the expansion I / F 131 (S1517).
Upon receiving the transmission end signal (Yes in S1518), the CPU 301 performs all OCR processing and transmits the output data stored in the RAM 302 to the image forming apparatus 100 side via the expansion device I / F 131 (S1519). Then, the CPU 301 ends the process shown in FIG.
On the other hand, the CPU 105 receives the output data transmitted from the expansion device (S1520). Then, the CPU 105 ends the process shown in FIG.

  As described above, in this embodiment, when the image processing forming apparatus and the expansion device are connected and the use of the expansion function is selected, the CPU 105 executes the following processing. That is, the CPU 105 generates an image processing sequence based on the selected expansion function, the memory capacity used by the selected document, and the memory capacity usable by both the image forming apparatus 100 and the expansion device 140. To do. Thus, for example, even when the data capacity of the selected document is large, it is possible to cope with the extended function so that the job restriction in the extended function can be reduced.

<Embodiment 3>
In the present embodiment, when a plurality of users use the image forming apparatus 100, it is easy to insert and remove the expansion device 140 by giving the use authority when using the expansion function of the expansion device 140.
The hardware configuration of the image forming apparatus 100 and the hardware configuration of the expansion device 140 in the present embodiment are the same as those in FIGS. 1 and 3 described in the first embodiment.
FIG. 13 is a diagram illustrating an example of a software configuration of the image forming apparatus 100 according to the third embodiment. In the present embodiment, an extended function management processing unit 212 is added to the configurations of the first and second embodiments. When the extended function is used by the extended function management processing unit 212, the right to use can be given, and when the user acquires the right to use and uses the extended function, it is managed so that another user cannot use it. can do.

Although the present embodiment will be described based on the flowchart of FIG. 14, only the operations unique to the present embodiment will be described, omitting portions overlapping with the first embodiment.
As in the first embodiment, the expansion device 140 is connected to the image forming apparatus 100. At this time, the CPU 105 (extended function management processing unit 212) executes processing related to management of extended functions as shown in FIGS. 15 and 16, for example. As shown in FIG. 15, the CPU 105 combines a user ID input field 1101 and a password input field 1102 for prompting acquisition of a user authority for using the extended function together with a notification that the extended function is added on the operation unit 110. Are displayed (S1603).
The CPU 105 executes processing related to user authentication based on the input user ID and password. When the user authentication is successful and the use authority to use the extended function is given to the logged-in user, as shown in FIG. Display a simple screen.
As shown in FIG. 16, when the login user is given authority, a description indicating “in use” is displayed in the column of the extended function area 510, and the user of the user using the extended function is displayed on the lower part 1201 of the screen. An ID is displayed. This indicates that the extended function authority is acquired and used by the user identified by the user ID. In addition, a button 1202 for canceling the authority of the extended function is displayed. When the user selects the button 1202, for example, a screen shown in FIG. 17 to be described later is displayed. A button 1202 is an example of an object for canceling the right to use the extended function. The user ID is an example of user information.
In this embodiment, a screen prompting acquisition of user authority is displayed when the expansion device 140 is connected. However, the CPU 105 displays a screen prompting acquisition of user authority when a job for an extended function is selected. You may make it display.
Since the processing until the extended function is added and the CPU 105 generates an image processing sequence including the selection of the extended function and the extended function module is the same as that in the first embodiment, the description is omitted (S1604 to S1610).

Next, an operation when another user tries to use the extended function when the image processing sequence is determined and the extended function is executed will be described.
When the first user is executing the extended function (S1610 and after), even if another second user wants to use the extended function job, the first user uses the extended function as shown in FIG. Can be identified. However, even when the use request is executed by mistake (S1613), the CPU 105 notifies the operation unit 110 that the extended function is being used and is currently unusable (S1614). In this manner, the CPU 105 prevents another user from using the extended function when a certain user is using the extended function.
When the extended function job executed by the user having the authority to use the extended function is completed (S1615 and subsequent steps), the CPU 105 displays a screen that prompts the user having the use authority to release the authority. As described above, when the button 1202 is selected on the screen of FIG. 16, the CPU 105 may display a screen that prompts the authority to be released. FIG. 17 is a diagram illustrating an example of a screen for canceling the title. When the “Yes” button 1301 is pressed on the screen of FIG. 17, the CPU 105 turns off the in-use description of the extended function area 510 and displays “No User” as the user ID at the bottom of the screen (S1616). ). As a result, it can be seen that the right to use the extended function has not been acquired by any user.
As a result, the user who acquires the use authority and executes the job of the extended function can confirm that the use right of the extended function has been released after the job is completed, and can disconnect the connected expansion device 140 without any problem. .

  As described above, in this embodiment, when using an extended function by connecting an image forming apparatus and an extended device, the CPU 105 is used when the extended device is connected or when the extended function is used. Acquires the right to use the extension. After that, the CPU 105 performs control so that the user who has acquired the use authority executes the extended function. Thus, for example, during the execution of the extended function job of the first user, the second user executes the extended function, and after the first user finishes the extended function job, the extended device is used by another user. There will be no loss of convenience such as the inability to remove.

<Other embodiments>
The present invention supplies a program that realizes one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and one or more processors in a computer of the system or apparatus read and execute the program This process can be realized. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

  As mentioned above, according to each embodiment mentioned above, an image processing sequence can be determined appropriately.

100 image forming apparatus, 105 CPU, 140 expansion device

Claims (14)

An image processing apparatus connectable to an expansion device,
Receiving means for receiving image processing information of the expansion device from the connected expansion device;
Obtaining means for obtaining image processing information of the image processing apparatus;
A plurality of image processes that process the job based on the received image processing information of the extended device, the acquired image processing information of the image processing apparatus, and job information of a job related to an extended function Determining means for determining an image processing sequence including a processing order of modules;
An image processing apparatus. When the image processing information of the expansion device is received by the receiving unit, the display unit further includes a display control unit that displays an extended function usable in the image processing apparatus on the operation unit based on the image processing information of the expansion device. ,
When one of the extended functions displayed via the operation unit is selected, the determination unit includes the received image processing information of the extended device, the acquired image processing information of the image processing apparatus, and The image processing apparatus according to claim 1, wherein the image processing sequence is determined based on job information of a job related to the selected extended function.   The determination means, when one of the plurality of image processing modules is in the expansion device and the image processing apparatus, the processing speed of the image processing module included in the image processing information of the expansion device And determining which image processing module to use based on the processing speed of the image processing module included in the image processing information of the image processing apparatus, and determining the image processing sequence. The image processing apparatus described.   The determining means further determines which image processing module to use based on the communication speed of the communication interface included in the image processing information of the expansion device and the image processing information of the image processing apparatus, The image processing apparatus according to claim 3, wherein the image processing sequence is determined.   Update means for updating the communication speed of the communication interface included in the image processing information of the expansion device and the image processing information of the image processing apparatus based on the communication speed when communication with the expansion device is established. The image processing apparatus according to claim 4, further comprising:   The determination means is further based on the usage status of the image processing module included in the image processing information of the expansion device and the usage status of the image processing module included in the image processing information of the image processing apparatus. 6. The image processing apparatus according to claim 3, wherein which image processing module is used is determined. The determining unit determines an image processing sequence including a processing order of the plurality of image processing modules and a data amount of input data of each image processing module;
Based on the determined image processing sequence, the memory capacity of the expansion device included in the image processing information of the expansion device, and the memory capacity of the image processing apparatus included in the image processing information of the image processing apparatus The image processing apparatus according to claim 1, further comprising a changing unit that changes the image processing sequence when it is determined that a memory capacity of the expansion device or the image processing apparatus is insufficient.   The changing means performs one image processing included in the image processing sequence in the expansion device based on the image processing sequence, the memory capacity of the expansion device, and the memory capacity of the image processing apparatus. The image processing apparatus according to claim 7, wherein the image processing sequence is changed so as to divide the amount of data transferred to the expansion device when it is determined that the memory capacity is insufficient. When the expansion device is connected, it further has an authentication means for performing user authentication,
The image processing apparatus according to claim 2, wherein the display control unit further displays, on the operation unit, user information that is authenticated by the authentication unit as a user who uses the extended function.   The image processing apparatus according to claim 2, wherein the display control unit further displays an object for canceling the right to use the extended function on the operation unit. An image processing system having an image processing apparatus and an expansion device,
The image processing apparatus includes:
Receiving means for receiving image processing information of the expansion device from the connected expansion device;
Obtaining means for obtaining image processing information of the image processing apparatus;
A plurality of image processes that process the job based on the received image processing information of the extended device, the acquired image processing information of the image processing apparatus, and job information of a job related to an extended function Determining means for determining an image processing sequence including a processing order of modules;
An image processing system. An information processing method executed by an image processing apparatus connectable to an expansion device,
A receiving step of receiving image processing information of the expansion device from the connected expansion device;
An acquisition step of acquiring image processing information of the image processing device;
A plurality of image processes that process the job based on the received image processing information of the extended device, the acquired image processing information of the image processing apparatus, and job information of a job related to an extended function A determination step for determining an image processing sequence including a processing order of modules;
An information processing method including: An information processing method in an image processing system having an image processing apparatus and an expansion device,
A receiving step in which the image processing apparatus receives image processing information of the expansion device from the connected expansion device;
An acquisition step in which the image processing apparatus acquires image processing information of the image processing apparatus;
The image processing apparatus executes the job based on the received image processing information of the extended device, the acquired image processing information of the image processing apparatus, and job information of a job related to an extended function. A determining step for determining an image processing sequence including a processing order of a plurality of image processing modules to be processed;
An information processing method including: To a computer that can be connected to an expansion device,
A receiving step of receiving image processing information of the expansion device from the connected expansion device;
An acquisition step of acquiring image processing information of the computer;
A plurality of image processing modules that process the job based on the received image processing information of the extended device, the acquired image processing information of the computer, and job information of a job related to an extended function; A determining step for determining an image processing sequence including a processing order;
A program for running

Images