JP7080061B2 - Image processing equipment - Google Patents

Description

The present invention relates to an image processing apparatus .

In the image forming apparatus and the information processing apparatus, a function can be added later by adding a plug-in application (hereinafter, the application is abbreviated as an application) to the software framework in the apparatus. By adopting such a method, it is possible to add functions to the device without modifying the existing source code in the device as much as possible. When using the added function, the function requesting module notifies the software framework of the execution request after specifying the plug-in application corresponding to the function. The software framework executes the specified plug-in application according to the request.

Patent Document 1 displays a web page on the UI of an image processing device to which a plug-in application is added, and when a user selects a corresponding part of the web page, a script associated with the part is executed and the corresponding part is dealt with. We are proposing a technology to call a plug-in application.

Japanese Unexamined Patent Publication No. 2012-162044

However, the above-mentioned prior art has the following problems. When using the added function, the function requesting module needs to select an appropriate plug-in application. In the above-mentioned prior art, for example, after asking another information processing device which plug-in application should be used, the selection is made according to the answer. At this time, if the information processing device to be inquired does not exist, the function requesting module itself needs to determine which plug-in application should be used and make a selection. Here, if the wrong plug-in is selected, there is a risk that unintended processing will be executed. In addition, registering a plug-in application, etc. in association with a selectable (operable) location such as a screen displayed on a Web page on the UI has some restrictions on the screen configuration and specifications during product design and development. In addition, the degree of freedom in design may be significantly reduced.

The present invention has been made in view of the above-mentioned problems, and when a function added later to the device is used, a mechanism for the requesting module of the function to appropriately select an appropriate plug-in application is provided. The purpose is to provide.

The present invention is an image processing device that provides one or more functions and can add the provided functions by installing a plug-in application.
An acquisition means for acquiring a receiving means for receiving a request for executing a predetermined process, identification information of the predetermined process from the request received by the receiving means , and parameters used when executing the predetermined process. By notifying each of the one or more plug-in applications installed in the image processing apparatus of the identification information, whether or not the predetermined process can be executed is specified by the inquiry means for inquiring and the result of the inquiry. The plug-in application capable of executing the predetermined process is provided with an instruction means for instructing the predetermined process using the parameter .

According to the present invention, when a function added later to the device is used, the requesting module of the function can suitably select an appropriate plug-in application.

The figure which shows the structural example of the image formation system which concerns on one Embodiment. The figure which shows the structural example of the image forming apparatus which concerns on one Embodiment. A hierarchical diagram showing an example of a software configuration in an image forming apparatus according to an embodiment. The figure which shows the configuration example of the server which concerns on one Embodiment. A hierarchical diagram showing an example of a software configuration in a server according to an embodiment. The flowchart which shows the call process of the image processing plug-in application 303 which concerns on one Embodiment. The flowchart which shows the call process of the image processing plug-in application 303 which concerns on one Embodiment. The figure which shows the outline of the image processing system mounted on the image forming apparatus which concerns on one Embodiment. The flowchart which shows the call process of the image processing plug-in application 303 which concerns on one Embodiment. A flowchart showing an executionability determination process according to an embodiment.

An embodiment of the present invention is shown below. The individual embodiments described below will help to understand various concepts such as superordinate, intermediate and subordinate concepts of the present invention. Further, the technical scope of the present invention is established by the scope of claims, and is not limited by the following individual embodiments.

<First Embodiment>
<Structure of image formation system>
Hereinafter, the first embodiment of the present invention will be described. First, a configuration example of the image forming system according to the present embodiment will be described with reference to FIG. FIG. 1 is a diagram showing an example of the configuration of an image forming system. The image forming system includes image forming devices 101, 102, information processing terminals 103, 104, and a server 105, which are examples of image processing devices. The image forming apparatus 101, 102, the information processing terminals 103, 104, and the server 105 are connected to each other by the network 106 and can communicate with each other. The network 106 is a network in which devices in the image forming system, such as a LAN (local area network) and the Internet, can communicate with each other.

Although FIG. 1 shows an example in which two image forming devices 101 and 102 are provided, an arbitrary number (one or more) of image forming devices can be provided in the image forming system. In the present embodiment, the image forming apparatus 101, 102 is a multifunction device (MFP: Multifunction Peripheral), but may be, for example, any of an MFP, a printing apparatus, a copying machine, and a facsimile apparatus. In the following, it is assumed that the image forming devices 101 and 102 have the same configuration, and detailed description of the image forming device 102 will be omitted.

The image forming apparatus 101 includes a printer and a scanner, for example, receiving a print request (print data) from the information processing terminals 103 and 104 and printing by the printer, and reading the image of the original by the scanner to obtain image data. It is possible to generate. Further, the image forming apparatus 101 can print by a printer based on the image data generated by the scanner and can store the print data received from the information processing terminals 103 and 104. The image forming apparatus 101 can further transmit image data generated by the scanner to the information processing terminals 103 and 104, perform image processing using the server 105, and print a document stored in the server 105. Is. Further, the image forming apparatus 101 provides various services by using a printer, a scanner, or the like, but is configured so that new services (functions) can be added. Specifically, it is possible to add a new service by installing an additional plug-in application on the image forming apparatus 101.

<Hardware configuration of image forming device>
Next, an example of the hardware configuration of the image forming apparatus 101 will be described with reference to FIG. The image forming apparatus 101 includes a controller 201, a printer 202, a scanner 203, and an operation unit 204. The controller 201 includes a CPU 211, a RAM 212, an HDD 213, a network interface (I / F) 214, a printer I / F 215, a scanner I / F 216, an operation unit I / F 217, and an extended I / F 218. The CPU 211 can exchange data with the RAM 212, HDD 213, network I / F 214, printer I / F 215, scanner I / F 216, operation unit I / F 217, and extended I / F 218. Further, the CPU 211 expands the program (instruction) read from the HDD 213 into the RAM 212, and executes the program expanded in the RAM 212.

The HDD 213 may store a program that can be executed by the CPU 211, a set value used by the image forming apparatus 101, data related to the processing requested by the user, and the like. The RAM 212 is used to temporarily store the program read from the HDD 213 by the CPU 211. Further, the RAM 212 is used to store various data necessary for executing the program. The network I / F 214 is an interface for communicating with other devices in the image forming system via the network 106. The network I / F 214 can notify the CPU 211 of the reception of the data and can transmit the data on the RAM 212 to the network 106.

The printer I / F 215 can transmit the print data received from the CPU 211 to the printer 202, and can notify the CPU 211 of the status of the printer notified by the printer 202. The scanner I / F 216 can transmit the image reading instruction received from the CPU 211 to the scanner 203, and can transmit the image data received from the scanner 203 to the CPU 211. Further, the scanner I / F 216 can notify the CPU 211 of the state of the scanner notified by the scanner 203.

The operation unit I / F 217 can notify the CPU 211 of the instruction input by the user in the operation unit 204, and can transmit the screen information of the operation screen for accepting the user's operation to the operation unit 204. The extended I / F 218 is an interface that enables an external device to be connected to the image forming apparatus 101. The extended I / F 218 is, for example, a USB (Universal Serial Bus) type interface. When an external storage device such as a USB memory is connected to the expansion I / F 218, the image forming apparatus 101 can read data stored in the external storage device and write data to the external storage device. Is.

The printer 202 can print an image corresponding to the image data received from the printer I / F 215 on the sheet, and can notify the printer I / F 215 of the status of the printer. The scanner 203 can read the image of the original and generate image data according to the image reading instruction received from the scanner I / F 216, and transmit the generated image data to the scanner I / F 216. Further, the scanner 203 can notify the scanner I / F 216 of the state of the scanner. The operation unit 204 is an interface for causing the user to perform an operation for giving various instructions to the image forming apparatus 101. For example, the operation unit 204 includes a display unit having a touch panel function, provides an operation screen to the user, and receives an operation from the user via the operation screen.

<Image processing system of image forming device>
Next, with reference to FIG. 8, an outline of the image processing (information processing) system mounted on the image forming apparatus 101 according to the present embodiment will be described. In the present embodiment, the image processing system is composed of a platform unit 800, a Native application 801 and an extended application 802, a Native module 803, an image processing execution client 804, an image processing execution server 805, and extended processing plug-ins 1 to 3. ..

The Native application 801 or the extended application 802 (Java application) may request the platform unit 800 to execute desired image processing (information processing) according to an instruction from the user. The Native application 801 is an application that is described in a programming language such as C language and is originally provided (pre-installed) in the image forming apparatus 101. The Native application 801 is, for example, a print application, a copy application, a scan application, a transmission application, and the like. In order to update the Native application 801 it is necessary to update the firmware of the image forming apparatus 101. The extended application 802 is an application described by a programming language such as Java language. The expansion application 802 is later installed in the image forming apparatus 101 in order to extend the function of the image forming apparatus 101. The extended application 802 is, for example, a login application that manages a user's login to the image forming apparatus 101.

In the image forming apparatus 101, it is possible to operate one or more expansion processing plug-ins on the platform unit 800. In this embodiment, three extended processing plug-ins 1 to 3 are operating on the platform unit 800. Similar to the expansion application 702, the expansion processing plug-ins 1 to 3 are later installed in the image forming apparatus 101 in order to expand the functions of the image forming apparatus 101. When updating the function of the extended processing plug-in, it is sufficient to update only the plug-in, and it is not necessary to update the firmware of the image forming apparatus 101.

In the present embodiment, the extended processing plug-in 1 is an extended processing plug-in that connects to a library described in Java language in the image forming apparatus 101 and executes processing. The extended processing plug-in 2 is an extended processing plug-in that connects to an external server such as a cloud and executes processing. The extended processing plug-in 3 is an extended processing plug-in that connects to the Native module 703 written in C language and executes processing.

The extended processing plug-in 3 connects to the Native module 803 via the image processing execution client 804 and the image processing execution server 805. The Native module 803 is pre-installed in the image forming apparatus 101 like the Native application 801. Further, in order to update the Native module 803, it is necessary to update the firmware of the image forming apparatus 101 as in the Native application 801. In this embodiment, the Native module 803 is a module that provides OCR processing. The extended processing plug-ins 1 to 3 are merely examples, and the connection destination and processing content of the extended processing plug-in are not limited to the above-mentioned connection destination and processing content.

The platform unit 800 can receive an image processing execution request from the Native application 701 or the extension application 802. For example, the platform unit 800 receives an OCR process execution request for extracting a character image from a scanned image from a scan application. Upon receiving the image processing execution request, the platform unit 800 selects an extended processing plug-in that executes image processing according to the execution request from the extended processing plug-ins 1 to 3, and performs image processing on the selected extended processing plug-in. Instruct to execute. For example, the platform unit 800 determines an extended processing plug-in to be used based on the type and content of the image processing requested to be executed (whether immediacy is required, the degree of processing load, etc.). The platform unit 800 acquires the requested image processing execution result from the extended processing plug-in used. The platform unit 800 outputs the acquired execution result to the application that is the source of the execution request as a response to the execution request.

Each element shown in FIG. 8 has the following correspondence with each element shown in FIG. 3 described below. The platform unit 800 corresponds to the connection library 332. The Native app 801 corresponds to the device control library 309. The extension application 802 corresponds to the single function plug-in application 302. The extended processing plug-ins 1 to 3 correspond to the image processing plug-in application 303. The Native module 803 corresponds to the Native module 316. The image processing execution client 804 corresponds to the Native client 331. The image processing execution server 805 corresponds to the Native server 315.

<Software configuration of image forming device>
Next, an example of the software configuration of the image forming apparatus 101 will be described with reference to FIG. The software configuration of the image forming apparatus 101 is realized by using, for example, a program stored in the HDD 213. The software configuration shown in FIG. 3 has a hierarchical structure including a lowest layer including an operating system 317, a highest layer corresponding to the Java® language execution environment 330, and an intermediate layer between them. This hierarchical structure has a relationship in which the service provided by the lower hierarchy is used by the upper hierarchy, with some exceptions. The exception to this is that, as will be described later, the device control library 309 can use the image processing plug-in application 303 included in the uppermost layer via the image processing control unit 340.

The lowest layer includes the operating system 317, and is a layer that manages program execution, memory management, and the like. The operating system 317 incorporates a printer control driver 318, a scanner control driver 319, and a network I / F control driver 320. The printer control driver 318, the scanner control driver 319, and the network I / F control driver 320 can function in cooperation with each other. The printer control driver 318 is software for controlling the printer 202 via the printer I / F 215. The scanner control driver 319 is software for controlling the scanner 203 via the scanner I / F 216. The network I / F control driver 320 is software for controlling the network I / F 214.

The intermediate layer above the lowest layer includes the device control library 309 and the image processing control unit 340. In the present embodiment, the programs of the device control library 309 and the image processing control unit 340 are described in a compiled language such as C language or C ++ language, and can be stored in the HDD 213 in the form of an object file that can be directly executed by the CPU 211.

The uppermost layer is an application layer including an application running in the Java language execution environment 330. The top layer includes the plug-in application 301 and the device control application 304, and further includes a Native client 331, a connection library 332, and an external client 333. Each upper layer application provides various functions by operating while using the API provided by the device control library 309 or the connection library 332. The function of the device control application 304 can be expanded by updating the firmware of the image forming apparatus 101.

In the present embodiment, the programs of the plug-in application 301 and the device control application 304 are written in Java language and can be stored in the HDD 213 in a Java byte code format that can be interpreted by the Java virtual machine. Therefore, the CPU 211 executes the program of the Java virtual machine, reads the program in the Java byte code format from the HDD 213, and causes the Java virtual machine to execute the program, thereby realizing the processing by each application in the uppermost layer.

As described above, one of the reasons for using a programming language such as Java language is the simplicity of program description. Since the memory area is automatically managed in Java, the developer does not need to manage the memory area. Therefore, it is expected that the time and effort required for the developer to write the program will be reduced and the development efficiency will be improved.

(Device control library 309)
Next, the device control library 309 will be described more specifically. The device control library 309 is statically or dynamically linked with the single function plug-in application 302 or the device control application 304 described later. The device control library 309 uses the operating system 317 of the lowest layer based on the instruction by each application of the upper layer. The device control library 309 can also request the Native connection library 314 to execute image processing. As an example, the device control library 309 is composed of a print library 310, a copy library 311, a scan storage library 312, and a scan transmission library 313.

The print library 310 provides an API (Application Programming Interface) for controlling a print job by using the function of the printer control driver 318. The print job refers to a series of processes in which the printer 202 prints based on the print data stored in the HDD 213 or the print data received from the external device (information processing terminals 103, 104, etc.) through the network I / F 214. .. The copy library 311 provides an API for controlling a copy job by utilizing the functions of the scanner control driver 319 and the printer control driver 318. The copy job is a series of processes in which the scanner 203 scans the original image and the printer 202 prints based on the obtained image data.

The scan save library 312 provides an API for controlling a scan save job by utilizing the function of the scanner control driver 319. The scan save job scans the original image with the scanner 203, converts the obtained image data into print data or general-purpose format data, and stores it in an external storage device such as a USB connected to the HDD 213 or the extended I / F 218. Refers to a series of processes to save. The general-purpose format is, for example, a data format such as PDF (Portable Document Format) or JPEG (Joint Photographic Experts Group).

The scan transmission library 313 provides an API for controlling a scan transmission job by utilizing the functions of the scanner control driver 319 and the network I / F control driver 320. The scan transmission job refers to a series of processes in which a scanner 203 scans an original image, converts the obtained image data into general-purpose format data, and transmits the obtained image data to the outside through a network I / F 214. In the scan transmission job, data is transmitted through the network I / F 214 to, for example, a file server such as a server 105, or data is transmitted by e-mail to an external device such as an information processing terminal 103 or 104.

(Image processing control unit 340)
Next, the image processing control unit 340 will be described more specifically. The image processing control unit 340 includes a Native connection library 314, a Native server 315, and a Native module 316. When the Native connection library 314 receives an image processing execution request from the device control library 309, the Native connection library 314 transfers the request contents to the connection library 332. The Native server 315 provides a function of executing the Native module 316 in response to a request from an application running in the Java language execution environment 330 described later. Native module 316 is software capable of performing various types of image processing.

The Native server 315 and the Native module 316 are executed on the Native control process 350, as shown in FIG. The Native control process 350 is a program execution unit having a logical memory space separated from the logical memory space of software other than the Native server 315 and the Native module 316. It should be noted that such separation of the memory space can also be realized by another method such as a method using a process mechanism provided in a general OS (operating system).

In the present embodiment, as described above, the logical memory space of the Native control process 350 is independent of the logical memory space of other software. Therefore, even if a memory operation defect occurs on the Native control process 350, it is possible to prevent such a defect from affecting the logical memory space of the application on the side that requests the Native server 315 to execute image processing. can. That is, it is possible to prevent a problem in the operation of the application on the side that requests the Native server 315 to execute the image processing.

(Device control application 304)
Next, the device control application 304 will be described more specifically. The device control application 304 includes, as an example, a print application 305, a copy application 306, a scan save application 307, and a scan transmission application 308. These device control apps 304 are resident apps in the image forming apparatus 101.

The print application 305, the copy application 306, the scan save application 307, and the scan transmission application 308 have screen information 321, 322, 323, and 324, respectively. The CPU 211 can display the corresponding operation screen on the operation unit 204 through the operation unit I / F 217 based on each of the screen information 321, 322, 323, 324. Further, the CPU 211 can receive an instruction from the user via the displayed operation screen.

When the CPU 211 detects that the user has operated the operation unit 204 to change the setting of the device control application 304, the CPU 211 writes the content of the change to the HDD 213. When the CPU 211 (device control application 304) detects that the user has operated the operation unit 204 to request the execution of the job, the CPU 211 (device control application 304) starts the job execution by calling the API of the device control library 309. Further, the CPU 211 (device control application 304) can also request the connection library 332 to execute image processing.

For example, the print application 305 executes a print job by calling the API of the print library 310. The copy application 306 executes the copy job by calling the API of the copy library 311. The scan save application 307 executes the scan save job by calling the API of the scan save library 312. The scan transmission application 308 executes the scan transmission job by calling the API of the scan transmission library 313.

(Plug-in application 301)
Next, the plug-in application 301 will be described more specifically. The plug-in application 301 is an application that can be installed and uninstalled as a plug-in for the image forming apparatus 101, separately from the device control application 304, which is a resident application. The plug-in application 301 is installed in the image forming apparatus 101 by using a remote UI (user interface) or the like. The remote UI accesses the image forming apparatus 101 from a Web browser on an external device such as the information processing terminals 103 and 104, and enables confirmation of the status of the image forming apparatus 101, operation of a print job, various settings, and the like. It is a mechanism.

The plug-in application 301 includes a single function plug-in application 302 and an image processing plug-in application 303. Each plug-in application 301 (single function plug-in application 302 and image processing plug-in application 303) is packaged with a program necessary for operation. In addition, each plug-in application 301 can be started and stopped individually.

The flow from the installation of the plug-in application 301 to the start, stop, and uninstallation is as follows, for example. First, when the CPU 211 detects the installation of the plug-in application 301 using the remote UI or the like, the CPU 211 saves the information of the plug-in application in the HDD 213. Next, when the CPU 211 detects a start instruction for the plug-in application 301, the CPU 211 gives a start instruction to the plug-in application. The plug-in application 301 can provide the function of the plug-in application while it is running.

After that, when the CPU 211 detects the stop instruction to the plug-in application 301, the CPU 211 gives the stop instruction to the plug-in application 301. Further, when the CPU 211 detects an uninstall instruction for the plug-in application 301, the CPU 211 uninstalls the plug-in application by deleting the information of the plug-in application 301 from the HDD 213. The above-mentioned instructions detected by the CPU 211 may be given from, for example, the remote UI or the operation unit 204, but the instructions may be given by other methods.

(Independent function plug-in application 302)
Next, the single function plug-in application 302 will be described more specifically. The single function plug-in application 302 has screen information 325. The CPU 211 can display the corresponding operation screen on the operation unit 204 through the operation unit I / F 217 based on the screen information 325. Further, the CPU 211 can receive an instruction from the user via the displayed operation screen.

The single function plug-in application 302 can provide a function or screen different from the device control application 304 to the user by calling the API provided by the device control library 309. The single function plug-in application 302 can provide a combination of a plurality of functions by the device control library 309. For example, the stand-alone function plug-in application 302 provides a function of copying a certain image and transmitting the image data obtained by scanning to a specific destination in the destination database held by the plug-in application itself. It is possible.

The single function plug-in application 302 does not have to have an image processing function, and in that case, the image processing is not set. When the device control library 309 receives the print data or the image data converted into the general-purpose format from the single function plug-in application 302, the device control library 309 causes the operating system 317 to execute the job by instructing the operating system 317 to control the necessary processing. ..

(Image processing plug-in application 303)
Next, the image processing plug-in application 303 will be described more specifically. The image processing plug-in application 303 is an application that provides specific image processing. The image processing plug-in application 303 may be composed of a plurality of applications that execute different image processing. For example, a plurality of applications capable of performing image format conversion, skew correction, form recognition, OCR processing, and the like on the input image may be installed in the image forming apparatus 101 as the image processing plug-in application 303. The image processing plug-in application 303 may retain the name of the image processing (image processing name) as image processing information indicating the image processing that can be executed in the application when it is additionally installed. desirable. Thereby, it is possible to suitably determine whether or not the image processing corresponding to the image processing name inquired in S603 of FIG. 6 described later can be executed.

The image processing plug-in application 303 can receive an image processing request (image processing execution request) from the independent function plug-in application 302 or the device control application 304 via the connection library 332. Further, the image processing plug-in application 303 can also receive an image processing request from the device control library 309 via the Native connection library 314 and the connection library 332.

The image processing plug-in application 303 executes image processing according to the received image processing request. The image processing request may include image data to be processed and processing parameters. The processing parameters include, for example, an image processing name described later and parameters related to image processing. Further, the image processing plug-in application 303 can use the image processing function of the Native client 331 as needed based on the image processing request. The image processing plug-in application 303 itself does not have to have an image processing function. The image processing plug-in application 303 can use the image processing function of the Native module 316 by using the Native client 331 even if it does not have the image processing function.

As described above, one of the reasons why the image processing plug-in application 303 uses the Native module 316 is to increase the processing speed when performing image processing. Specifically, when performing image processing, a large amount of complicated numerical operations may be required to be executed, or a large amount of memory may be required in the process of processing. In such a case, the processing speed is high by using a processing system using a compile language that generates an object file that can be directly executed by the CPU, instead of a processing system using a programming language that processes via a virtual machine like Java. Can be expected to change.

Further, the image processing plug-in application 303 uses the external client 333 to transmit an input image and an image processing request to an external device such as a server (external device) 105, and the image by the external image processing client. It is also possible to request the execution of processing. By doing so, it becomes possible to execute image processing that cannot be executed by the image forming apparatus 101, or to execute high-speed processing using a large amount of memory.

<Server hardware configuration>
Next, a configuration example of the server according to the present embodiment will be described with reference to FIG. The server 105 has a CPU 401, a RAM 402, an HDD 403, and a network I / F 404. The CPU 211 can exchange data with the RAM 402, the HDD 403, and the network I / F 404. Further, the CPU 401 expands the program (instruction) read from the HDD 403 into the RAM 402, and executes the program expanded in the RAM 402.

The HDD 403 may store a program that can be executed by the CPU 401, a setting value used by the server 105, data related to processing requested by the user, and the like. The RAM 402 is used to temporarily store the program read from the HDD 403 by the CPU 401. The RAM 402 can store various data necessary for executing the program. The network I / F 404 is an interface for performing network communication with other devices existing on the network. The network I / F 404 can notify the CPU 401 of the reception of data and transmit the data on the RAM 402 to the network 106.

<Server software configuration>
Next, an example of the structure of the software processed by the CPU 401 will be described with reference to FIG. The software having the structure shown in FIG. 5 is realized by using, for example, a program stored in the HDD 403 of the server 105. The server 105 includes a module 501 and a communication library 502 as a software configuration. It should be noted that the software configuration of the server in the present invention is not intended to be limited to only the above two components, and other modules and the like may be included.

Module 501 receives the input image and the image processing request sent from the communication library 502, and executes image processing on the input image according to the request. Then, the processed image data is notified via the communication library 502. The communication library 502 is a library that provides an API for executing communication processing with other devices existing on the network 106, such as the image forming apparatus 101. The communication library 502 receives the input image sent from the image forming apparatus 101 and the image processing request, and transfers them to the module 501. Further, the communication library 502 transmits the processed image data generated by the module 501 to the image forming apparatus 101.

<Processing procedure>
Next, with reference to FIG. 6, a processing procedure when the connection library 332 calls the image processing plug-in application 303 will be described. The process described below is realized, for example, by the CPU 211 expanding the program stored in the HDD 213 into the RAM 212 and executing the program.

First, in S601, the connection library 332 functions as a receiving means and receives an image processing execution request from the independent function plug-in application 302 or the device control application 304. Here, the connection library 332 receives the image processing name and the parameter designation as the image processing information corresponding to the image processing requested to be executed. For example, the image processing name (ImagingName) may be a character string such as "OCR". Further, as the parameter, a parameter related to the image processing such as "language: Japanese" is specified.

Next, in S602, the connection library 332 acquires the image processing name specified in S601 from the received request. Subsequently, in S603, the connection library 332 specifies an image processing name for all the installed image processing plug-in applications 303, and inquires whether or not the corresponding image processing can be executed. Here, each image processing plug-in application 303 determines whether or not the image processing corresponding to the designated image processing name can be executed by itself, and responds the result to the connection library 332. As described above, according to the present embodiment, the image processing name can be used as a search key, and a plug-in application suitable for the requested image processing can be suitably selected from the installed plug-in applications. That is, the connection library 332 does not need to know the plug-ins corresponding to various image processings, and by extracting the image processing name from the request and inquiring to each plug-in application, an appropriate plug-in is installed. You can select an app. As a result, for example, registration processing such as linking the installed plug-in application to each image processing button on the menu screen is not required, the degree of freedom in development design of the product can be improved, and extra processing can be reduced. can.

Next, in S604, the connection library 332 determines whether or not there is an image processing plug-in application 303 that can execute image processing corresponding to the image processing name that is the image processing information, based on each response. If it exists, the process proceeds to S605, and if it does not exist, the process proceeds to S606. For example, in the above example, if the image processing plug-in application 303 corresponding to the image processing name “OCR” exists, the process proceeds to S605. In S605, the connection library 332 notifies the image processing plug-in application 303 of the parameters specified in S601, and then notifies the image processing execution instruction. On the other hand, in S606, the connection library 332 notifies the device control application 304 or the device control library 309 that the executable image processing plug-in application 303 has not been found, and ends the processing. do. Specifically, the connection library 332 notifies the requester that there is no plug-in application capable of executing the predetermined image processing.

As described above, the image processing apparatus (image forming apparatus) according to the present embodiment receives a request for executing a predetermined image processing, and acquires an image processing name indicating the name of the predetermined image processing from the request. .. Further, the image processing apparatus selects a plug-in application capable of executing the received predetermined image processing by using the acquired image processing name, and instructs the execution thereof. As a result, according to the present embodiment, the requesting module that uses the added image processing function does not need to directly select the plug-in, and the appropriate plug-in can be used only by specifying the image processing name. And the risk of misselection of plug-ins can be reduced.

The present invention is not limited to the above embodiment and can be modified in various ways. For example, in S603, the connection library 332 uses the image processing name to inquire of each image processing plug-in application 303 whether or not the image processing corresponding to the image processing name can be executed. Instead of this configuration, when each image processing plug-in application 303 is installed, the image processing name of the image processing that can be executed by itself is registered in the connection library 332 in association with the plug-in application. You may. As a result, the connection library 332 can select an appropriate plug-in based on the information held by the connection library 332 without inquiring about each image processing plug-in application by using the image processing name.

<Second embodiment>
Hereinafter, a second embodiment of the present invention will be described. In the first embodiment, the connection library 332 selects an image processing plug-in application 303 by designating an image processing name and inquiring whether or not the corresponding image processing can be executed. gone.

However, it may not be possible to correctly select the image processing plug-in application 303 only from the image processing name. Here, consider a case where "OCR" is specified as the image processing name. As the plug-in that performs OCR processing, there are a plug-in that requests processing from the Native module 316 in the device and a plug-in that requests processing from the server 105 via the network 106. The former is a plug-in for processing languages such as English that have a dictionary for OCR in the device, and the latter is a plug-in for processing languages that do not have a dictionary in the device. be. In such a case, since there are a plurality of plug-ins corresponding to the image processing name "OCR", it is not possible to correctly select the image processing plug-in application 303 only from the information of the image processing name.

Therefore, in the present embodiment, when selecting the image processing plug-in application 303, parameter information related to image processing is used in addition to the image processing name. The parameter consists of a key / value pair, and may be specified more than once for one image processing. In the above example, when the parameter is expressed in the form of "key: value", the word "language: English" is specified. Based on the information of the image processing name, "OCR" and the parameter, "Language: English", the connection library 332 can select the image processing plug-in application 303 that executes the OCR processing by using the Native module 316. It will be possible.

Further, as another example, it is conceivable to switch the plug-in to be used according to the "input image resolution" specified as a parameter. First, when "input image resolution: 300 DPI" is specified as a parameter, a plug-in that requests processing from the Native module 316 in the device is used. On the other hand, when "input image resolution: 600 DPI" is specified as a parameter, a plug-in that requests processing from the server 105 is used. This is because the capacity of the RAM 212 required for processing increases as the input resolution increases, so that there is a certain limit to the input image resolution that can be processed in the image forming apparatus 101, and if the input resolution exceeds a predetermined input resolution, This is because it is necessary to request processing from the server 105.

<Processing procedure>
With reference to FIG. 7, a processing procedure when the connection library 332 calls the image processing plug-in application 303 in the present embodiment will be described. The process described below is realized, for example, by the CPU 211 expanding the program stored in the HDD 213 into the RAM 212 and executing the program. Since the system configuration and the processing procedure of the present embodiment are the same as those described in the first embodiment, the description thereof will be omitted and only the different parts will be described. Specifically, since S701, S704, S705, and S706 are the same as S601, S604, S605, and S606, the description thereof will be omitted.

In S702, the connection library 332 refers to the image processing name and parameters specified in S701. Further, in S703, the connection library 332 specifies an image processing name and parameters for all the installed image processing plug-in applications 303, and inquires whether or not the corresponding image processing can be executed.

As described above, according to the present embodiment, it is possible to select the image processing plug-in application 303 under more detailed conditions based on the two pieces of information of the image processing name and the parameter. Further, as described above, in the above S703, the connection library 332 uses the image processing name and the parameter to inquire of each image processing plug-in application 303 whether or not the image processing corresponding to the image processing name and the parameter can be executed. ing. Instead of this configuration, when each image processing plug-in application 303 is installed, the image processing name and parameters corresponding to the image processing that can be executed by the connection library 332 are associated with the plug-in application. You may try to register. As a result, the connection library 332 can select an appropriate plug-in based on the information held by itself without inquiring about each image processing plug-in application by using the image processing name and parameters. can.

<Third embodiment>
Hereinafter, a third embodiment of the present invention will be described. In the second embodiment, the connection library 332 is a plug-in by designating an image processing name and parameters to the image processing plug-in application 303 and inquiring whether or not the corresponding image processing can be executed. Made the selection.

However, for all the image processing plug-in applications 303, if it is attempted to determine whether or not the image processing can be executed after specifying the image processing name and the parameters, the processing may take time. For example, there are a large number of image processing plug-in applications 303, or there are many complicated determination logics for whether or not they can be executed.

In the method of the second embodiment, it is necessary to execute the inquiry as to whether or not the image processing can be executed as many times as the number of the image processing plug-in application 303. In such a method, even for an image processing plug-in application that does not have a function to perform a designated image processing, an inquiry process regarding the ability of the plug-in is performed. For example, even for an image processing plug-in application that does not have the function to execute the specified image processing, call the function indicating the ability of the image processing plug-in application and check whether the image processing can be executed with the specified parameters. Confirmation processing will occur. If the determination logic for executing this confirmation process is complicated, a process that does not originally need to be executed will be executed. In addition, depending on the application, even if it does not have the function to perform the specified image processing, there is a possibility that the judgment processing for determining whether the image processing can be performed with the specified parameters may be executed. be. By executing these processes that do not originally need to be executed, there are problems that the search time becomes long and the processing load of the CPU 211 increases.

Therefore, in the present embodiment, the processing speed and flexibility are both achieved by operating the two-stage filter and selecting the image processing plug-in application 303. First, the first-stage filter is applied to narrow down the candidates for the image processing plug-in application 303 only from the specified image processing name. This is simply a process of finding an image processing plug-in application 303 that holds an image processing name that matches the designated image processing name. Then, by applying the second-stage filter, specifying the parameters for the candidates narrowed down by the first-stage filter, and inquiring whether processing is possible, the appropriate image processing plug-in application 303 can be obtained. select.

The first-stage filter processing is the first selection processing for selecting a plug-in application capable of executing the specified image processing using the acquired image processing name. Further, the second-stage filter processing is a second selection process of selecting a plug-in application capable of performing image processing according to a parameter from the plug-in applications selected by the first selection process. By doing so, even if the logic for determining whether or not the processing is feasible is complicated, the processing needs to be applied only to the candidates narrowed down in advance, so that the two-step filter is not operated. As compared with, the increase in processing time can be suppressed.

<Processing procedure>
Here, with reference to the flowchart shown in FIG. 8, the details of the process in which the connection library 332 calls the image processing plug-in application 303 in the present embodiment will be described. The process described below is realized, for example, by the CPU 211 expanding the program stored in the HDD 213 into the RAM 212 and executing the program. Since the system configuration and the processing procedure of the present embodiment are the same as those described in the first embodiment, the description thereof will be omitted and only the different parts will be described. Specifically, S901, S902, S908, and S909 are the same as S601, S602, S605, and S606.

In S903, the connection library 332 specifies an image processing name for all the installed image processing plug-in applications 303, and inquires whether or not the plug-in corresponds to the image processing name. This is a process corresponding to the above-mentioned first-stage filter. In S904, the connection library 332 determines whether or not the image processing plug-in application 303 corresponding to the specified image processing name exists. If it exists, the process proceeds to S905, and if it does not exist, the process proceeds to S909. For example, if the image processing name "OCR" is specified in S901 and the image processing plug-in application 303 holding the same image processing name exists, the process proceeds to S905. In S905, the connection library 332 refers to the parameter specified in S901. In S906, the connection library 332 specifies a parameter to the image processing plug-in application 303 detected in S904, and inquires whether the corresponding image processing can be executed. In the above example, the image processing name and the image processing plug-in application 303 of "OCR" are inquired about whether or not the image processing can be executed by designating the parameter and "language: English". At this time, as in the second embodiment, inside the image processing plug-in application 303, it is determined whether or not it can be executed depending on whether or not a dictionary for OCR corresponding to English exists under a predetermined directory. do.

Further, as the image processing plug-in application 303 corresponding to the same image processing name, there may be both a plug-in that performs processing inside the image forming apparatus 101 and a plug-in that requests processing from the server 105.

When the image processing is performed inside the designated image forming apparatus 101, the communication time with the server 105 is not required as compared with the case where the processing is requested to the server 105, so that the processing can be executed in a short time. On the other hand, since the memory is shared with other functions in the image forming apparatus 101, the memory may be insufficient in some cases, which may affect the operation of the other functions. When requesting image processing to the server 105, the memory of the image forming apparatus 101 is not used, so that the operation of other functions of the image forming apparatus 101 does not have to be affected.

That is, when the memory shortage does not occur in the image forming apparatus 101, it is better to execute the processing by the image processing plug-in application 303 that performs image processing inside the image forming apparatus 101 than to request the server 105 to perform the processing. There is a high possibility that the processing time can be shortened. On the other hand, when there is a possibility that the image forming apparatus 101 may run out of memory, it is preferable to execute the processing by the image processing plug-in application 303 that requests the server 105 to perform the image processing.

Therefore, the image processing plug-in application may determine whether the image processing plug-in application can execute the specified image processing according to the memory usage amount when performing the image processing satisfying the specified parameter. ..

For example, the image processing plug-in application 303 that performs image processing inside the image forming apparatus 101 determines whether or not it can be executed based on a parameter related to the input resolution such as "input image resolution: 600 DPI". In order to execute the image processing corresponding to the "input image resolution: 600 DPI", the amount of RAM 212 used at the time of execution is large, which may affect the execution of other functions. Therefore, the image processing plug-in application 303 that performs processing inside the image forming apparatus 101 determines that the image processing cannot be executed.

Further, since the image processing plug-in application 303 that requests the server 105 to perform the processing can secure a sufficient memory capacity in the server 105, it is determined that the image processing can be executed.

On the other hand, when the parameter is "input image resolution: 300 DPI", the amount of RAM 212 used at the time of execution is smaller than that in the case of 600 DPI, and it is unlikely to affect the execution of other functions. Therefore, the image processing plug-in application 303 that performs processing inside the image forming apparatus 101 determines that the image processing can be executed.

In S907, the connection library 332 determines whether or not there is an image processing plug-in application 303 that can execute processing based on the specified parameter. If it exists, the process proceeds to S908, and if it does not exist, the process proceeds to S909.

According to the method shown in the present embodiment, by operating the two-step filter and selecting the image processing plug-in application 303, it is possible to achieve both processing speed and flexibility.

<Modification example>
The present invention is not limited to the above embodiment and can be modified in various ways. For example, the image processing plug-in application 303 that performs image processing inside the image forming apparatus 101 dynamically determines whether or not the image processing can be executed according to not only the specified parameters but also the usage status of the RAM 212 of the image forming apparatus 101. You may make a judgment.

For example, the image processing plug-in application 303 that performs processing inside the image forming apparatus 101 is concerned when the free capacity of the RAM 212 is equal to or larger than a predetermined capacity even when "input image resolution: 600 DPI" is input as a parameter. Judge that image processing is feasible. On the other hand, the image processing plug-in application 303 that performs processing inside the image forming apparatus 101 processes the image when "input image resolution: 600 DPI" is input as a parameter when the free capacity of the RAM 212 is less than a predetermined capacity. Judge that it cannot be executed.

The above processing will be described with reference to the flowchart of FIG. The processing according to this flowchart is realized by the CPU 211 executing the image processing plug-in application 303. The process described below is realized, for example, by the CPU 211 expanding the program stored in the HDD 213 into the RAM 212 and executing the program.

In S1001, the image processing plug-in application 303 acquires the threshold value of the free memory capacity required to execute the image processing according to the specified parameter. For example, the image processing plug-in application 303 manages information in which an image processing parameter and a threshold value related to a memory capacity are associated with each other, and obtains a threshold value corresponding to a specified parameter by referring to the information. do. The correspondence information is stored, for example, in a storage unit such as HDD 213 of the image forming apparatus 101 when the image processing plug-in application 303 is installed.

Next, in S1002, the image processing plug-in application 303 acquires the free space of the RAM 212. S1002 is a capacity acquisition process for acquiring the usage status of the memory of the image forming apparatus 101. Subsequently, in S1003, the image processing plug-in application 303 determines whether or not the free space acquired in S1002 is equal to or greater than the threshold value acquired in S1001.

If the free space acquired in S1002 is equal to or greater than the threshold value acquired in S1001, the image processing plug-in application 303 proceeds to S1004 and responds to the connection library 332 that the specified image processing can be executed. End the process. On the other hand, the image processing plug-in application 303 proceeds to S1005 when the free space acquired in S1002 is less than the threshold value acquired in S1001, and the connection library 332 states that the specified image processing cannot be executed. Ends the process in response to.

As described above, whether or not the image processing plug-in application 303 can execute image processing according to the parameters based on the memory usage status and the threshold value regarding the memory usage status. judge. In this way, it is possible to dynamically respond whether or not the designated image processing can be executed according to the memory usage status of the image forming apparatus 101. Further, the connection library 332 can select a plug-in application that can execute image processing according to a specified parameter based on the returned content (determination result).

In this modification, an example in which the image processing plug-in application 303 determines whether or not the specified image processing can be executed has been described, but the present invention is not limited to this, and the connection library 332 may perform the determination. For example, the connection library 332 manages the identification information of the image processing plug-in application 303 in association with the image processing parameters and the threshold value related to the memory capacity. Then, the same processing as that shown in FIG. 10 may be executed based on the parameters and the threshold values associated with the identification information of the image processing plug-in application 303 to be determined. In this case, the process shown in FIG. 10 is realized by expanding the program code stored in the HDD 213 to the RAM 212 and executing the program code by the CPU 211.

In S1004, the connection library 332 determines that the image processing plug-in application 303 to be determined can execute the specified process. Further, in S1005, the connection library 332 determines that the image processing plug-in application 303 to be determined cannot execute the specified process.

Even in the above manner, it is possible to dynamically determine whether or not the designated image processing can be executed according to the memory usage status of the image forming apparatus 101.

<Other embodiments>
The present invention supplies a program that realizes one or more functions of the above-described embodiment to a system or device via a network or storage medium, and one or more processors in the computer of the system or device reads and executes the program. It can also be realized by the processing to be performed. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

101, 102: Image forming device, 103, 104: Information processing terminal, 105: Server, 201: Controller, 202: Printer, 203: Scanner, 204: Operation unit, 211: CPU, 212: RAM, 213: HDD, 214 : Network I / F, 215: Printer I / F, 216: Scanner I / F, 217: Operation unit I / F, 218: Extended I / F

Claims (5)

An image processing device that provides one or more functions and can add the provided functions by installing a plug-in application.
A reception means that accepts requests to execute predetermined processing,
An acquisition means for acquiring the identification information of the predetermined process and the parameters used when executing the predetermined process from the request received by the reception means.
An inquiry means for inquiring whether or not the predetermined process can be executed by notifying each of the one or more plug-in applications installed in the image processing device of the identification information.
An instruction means for instructing the plug-in application that can execute the predetermined process specified by the result of the inquiry to perform the predetermined process using the parameter, and
An image processing device characterized by comprising. The inquiry means further inquires whether or not the predetermined process using the parameter can be executed for the plug-in application specified by the result of the inquiry using the identification information .
The instruction means is characterized in that it instructs a plug-in application that is specified to be able to execute the predetermined process using the parameter as a result of the further inquiry to the predetermined process using the parameter. The image processing apparatus according to claim 1 . When the predetermined process is an OCR process,
The identification information includes an OCR character string.
The image processing apparatus according to claim 1 or 2 , wherein the parameter indicates the language of OCR. The image processing apparatus according to claim 1 or 2, wherein the parameter indicates a resolution of an input image to which the predetermined processing is performed. When the image processing client provided by the external device is specified as a plug-in application capable of executing the predetermined process as a result of the inquiry by the inquiry means, the instruction means causes the parameter to the image processing client. The image processing apparatus according to any one of claims 1 to 4 , wherein the predetermined processing is instructed using the image processing apparatus.

Images