JP2007042098A - Content display method, content transmission method, image processing device, remote computing device - Google Patents

Abstract

An image processing apparatus is provided that takes out content in response to a display request from the outside and displays the content appropriately on a display unit.
In the content display method of the present invention, a display request including a resource identifier is received by a built-in application 133 of an image processing apparatus 139, and the resource identifier is transferred to a web browser 131 of the image processing apparatus 139. Connect to the resource identified by the resource identifier, retrieve the content from the resource, and display the retrieved content on the display unit 130 of the image processing apparatus 139 using the web browser 131.
[Selection] Figure 14

Description

The present invention relates to a method and apparatus for operating an image processing apparatus, and more particularly, to a method and apparatus for transmitting content to a client browser in the image processing apparatus.

  Image processing devices such as printers, copiers, scanners and fax machines have a variety of functions and capabilities to suit a particular application or combination of applications. Image processing apparatuses often take the form of multifunction peripherals (MFPs) that combine two or more functions of image processing apparatuses that have been separate. The MFP may be combined with any number of image processing apparatuses, but generally includes a printer, an image reader, a copier, and a fax function.

  Some image processing devices include computing resources (eg, processors, hard disk drives, memory, and other devices) for data storage and processing. If a more characteristic configuration or function is added to the image processing apparatus, it becomes more expensive and more complicated.

  More complex image processing devices and MFPs, for example, having network connection performance that enables communication with other arithmetic devices (for example, personal computers, other image processing devices, network servers, and other devices) There is. This connection performance enables the image processing apparatus to use external resources (other arithmetic devices) that can be used on the connected network.

  An image processing apparatus generally includes a user input panel having a plurality of buttons, knobs, and other user input mechanisms. There is also an image processing apparatus provided with a display panel. Some of these display panels are used only for display, and others are touch panel displays that a user can directly input on the display.

  A device with a touch panel display or a device having buttons arranged with the display can display menu data selected by user input. This menu data is normally driven by a server module mounted on the image processing apparatus.

Here, for example, in Patent Document 1, an advertisement determined using the user information acquired from the image forming apparatus is distributed to the image forming apparatus, and print information related to the advertisement selected by the user among the distributed advertisements is provided. An image distribution method for distributing to an image forming apparatus is described.
JP 2004-240752 (released August 26, 2004)

  However, in the conventional image processing apparatus, there is no method for extracting content from the outside and displaying the content on the display unit in response to a display request from the outside.

  The present invention has been made in view of the above-described problems, and an object thereof is to provide a content display method or the like that takes out content in response to a display request from the outside and displays the content on a display unit. It is in.

  In order to solve the above problems, the content display method according to the present invention is a content display method for displaying content on a display unit of an image processing device, wherein the display includes a resource identifier in a built-in application of the image processing device. Receiving the request; transferring the resource identifier to the browser of the image processing device; connecting to connecting to the resource identified by the resource identifier; extracting the content from the resource; And a display step of displaying the extracted content on a display unit of the image processing apparatus using a browser of the image processing apparatus.

  According to the above method, the image processing apparatus can take out the content in response to a display request from the outside and display the content on the display unit. Therefore, a request for display on the image processing apparatus can be made from the outside.

  Even if the browser of the image processing apparatus performs other processing, when the resource identifier is transferred from the built-in application of the image processing apparatus, the browser connects to the resource to retrieve the content, and displays it on the display unit of the image processing apparatus. Can be displayed. Therefore, for example, a warning or the like can be displayed on the display unit of the image processing apparatus from the outside in an emergency situation or the like.

  In the content display method of the present invention, the built-in application may be a web service. Also, other software may be used.

  In the content display method of the present invention, the resource identifier may be any resource identifier as long as it can identify the resource storing the content. For example, the resource identifier is a URL ( Uniform Resource Locator).

  In the content display method of the present invention of the present invention, the display request may be for calling a web service method. The display request may be for calling a display screen web service method.

  In the content display method of the present invention of the present invention, the display request may be for calling a display screen web service method including a URL.

  Further, in the content display method of the present invention according to the present invention, the device that transmits the display request and the device in which the resource exists are arranged apart from the image processing device. The content display method described.

  In the content display method of the present invention, the device that transmits the display request may be different from the device in which the resource exists.

  In order to solve the above problems, a content display method according to the present invention is a content display method for displaying content on a display unit of an image processing apparatus, and transmits a status notification from the image processing apparatus to a remote application. Identified by the transmission identifier, a reception step of receiving a display request including a resource identifier in the built-in application of the image processing device, a transfer step of transferring the resource identifier to the browser of the image processing device, and the resource identifier A connection step for connecting to the resource; a step for extracting the content from the resource; and a display step for displaying the content on the display unit using a browser of the image processing apparatus. .

  According to the above method, when a status notification is transmitted from the image processing apparatus to the remote application, the image processing apparatus can retrieve the content and display the content on the display unit in response to a display request from the remote application. it can. Therefore, a request for display on the image processing apparatus can be made from a remote application in response to a status notification from the image processing apparatus.

  Even if the browser of the image processing apparatus performs other processing, when the resource identifier is transferred from the built-in application of the image processing apparatus, the browser connects to the resource to retrieve the content, and displays it on the display unit of the image processing apparatus. Can be displayed. Therefore, for example, a warning or the like can be displayed on the display unit of the image processing apparatus from a remote application in response to a status notification from the image processing apparatus such as an emergency situation.

  The status notification may be an error notification. Further, the state notification may be an emergency alarm. Of course, the status notification may be other than this as long as it is information indicating the status of the image processing apparatus.

  In order to solve the above problems, the content display method according to the present invention is a content display method for displaying content on a display unit of an image processing device, wherein a display request including browser content is included in an internal application of the image processing device. Receiving step, transferring the browser content to the browser of the image processing device, and displaying the content on the display unit using the browser of the image processing device. It is characterized by being.

  According to the above method, the browser content can be displayed on the display unit in response to an external display request in the image processing apparatus. Therefore, a request for display on the image processing apparatus can be made from the outside.

  Further, even if the browser of the image processing apparatus performs other processing, when the browser content is transferred from the built-in application of the image processing apparatus, the browser content can be displayed on the display unit of the image processing apparatus. .

  In the content display method according to the present invention, the transfer step may be performed by interrupting an arbitrary process being executed by the browser.

  In order to solve the above problems, a content display method according to the present invention is a method for displaying content on a display unit of an image processing device, and transmitting a status notification of the image processing device from the image processing device to a remote application A reception step of receiving a display request including browser content in a built-in application of the image processing device, a transfer step of transferring the browser content to the browser of the image processing device, and a browser of the image processing device. And a display step of displaying the browser content on the display unit.

  According to the above method, when a status notification of the image processing apparatus is transmitted from the image processing apparatus to the remote application, the content can be displayed on the display unit in response to the display request from the remote application. Therefore, it is possible to make a request for display on the image processing apparatus from the remote application that has received the status notification from the image processing apparatus.

  Further, even if the browser of the image processing apparatus performs other processing, it can be displayed on the display unit of the image processing apparatus when browser content is transferred from the built-in application of the image processing apparatus. Therefore, for example, when a status notification is transmitted from the image processing apparatus to the remote application in an emergency situation, the warning or the like can be displayed on the display unit of the image processing apparatus based on a request from the remote application.

  In order to solve the above problems, a content transmission method according to the present invention is a content transmission method for transmitting content to an image processing apparatus, and transmits a display request including a resource identifier to a built-in application of the image processing apparatus. Receiving a request for the resource identified by the resource identifier from the browser of the image processing apparatus; and a content transmission step of transmitting content from the resource to the browser of the image processing apparatus. It is characterized by including.

  According to the above method, a display request including a resource identifier is transmitted to a built-in application of the image processing apparatus, a request for the resource identified by the resource identifier is received from the browser of the image processing apparatus, and the resource of the image processing apparatus is received from the resource. Transmit content to the browser. Therefore, when it is desired to display some content on the display unit of the image processing apparatus, it is possible to interrupt and display the display currently being performed by the image processing apparatus.

  In order to solve the above problems, a content transmission method according to the present invention is a content transmission method for transmitting content to an image processing device, and a status notification receiving step for receiving a status notification from the image processing device in a remote application. A display request transmission step of transmitting a display request including a resource identifier to the built-in application of the image processing device, and a browser request for receiving a browser request for the resource identified by the resource identifier from the browser of the image processing device A content transmission method comprising: a reception step; and a resource-related data transmission step of transmitting data related to the resource identified by the resource identifier to a browser of the image processing apparatus.

  According to the above method, the remote application receives a status notification that is information indicating the status of the image processing apparatus from the image processing apparatus. Then, a display request including the resource identifier is transmitted to the built-in application of the image processing apparatus. Further, the browser request for the resource identified by the resource identifier is received from the browser of the image processing apparatus, and the content is transmitted from the resource to the browser of the image processing apparatus. Therefore, when a status notification is received from the image processing apparatus and it is desired to display some content on the display unit of the image processing apparatus, it is possible to interrupt and display the display currently being performed by the image processing apparatus.

  In order to solve the above problems, an image processing apparatus according to the present invention is an image processing apparatus including a built-in application, a browser, and a display unit, and the built-in application issues a display request including a resource identifier. , Receiving the resource identifier data from the remote application, and transferring the resource identifier data to the browser. The browser connects to the resource identified by the resource identifier, retrieves the content from the resource, and retrieves the retrieved content. It is characterized by being configured to display on the display unit.

  According to the above configuration, content can be taken out and displayed on the display unit in response to a display request from the outside. Therefore, it is possible to receive a display request from the outside.

  Even if the browser of the image processing apparatus performs other processing, when the resource identifier is transferred from the built-in application of the image processing apparatus, the browser connects to the resource to retrieve the content, and displays it on the display unit of the image processing apparatus. Can be displayed.

  In the image processing apparatus according to the present invention, in addition to the above configuration, the built-in application is configured to further transmit a status notification to the remote application, and the status notification transmits the display request. The remote application may be instructed.

  According to the above configuration, it is possible to transmit a status notification, which is information on the status of the image processing apparatus, to instruct the remote application to transmit a display request to the remote application.

  An image processing apparatus according to the present invention is an image processing apparatus including a built-in application, a browser, and a display unit in order to solve the above-described problem, and the built-in application includes browser content. A display request is received from a remote application, the browser content is transferred to the browser, and the browser is configured to display the browser content on the display unit.

  According to the above configuration, when a display request including browser content from a remote application is received, the browser content can be displayed on the display unit. Therefore, a request for display from a remote application can be received.

  Further, even if the browser of the image processing apparatus performs other processing, when the browser content is transferred from the built-in application of the image processing apparatus, it can be displayed on the display unit of the browser content image processing apparatus.

  In addition to the above configuration, the image processing apparatus according to the present invention is configured such that the built-in application further transmits a status notification to the remote application, and the status notification transmits the display request. The remote application may be instructed.

  According to the above configuration, it is possible to transmit a status notification, which is information on the status of the image processing apparatus, to instruct the remote application to transmit a display request to the remote application.

  In order to solve the above problems, a remote calculation device (remote calculation device) according to the present invention is a remote calculation device for transmitting content to a claim image processing device, and displays a display request including a resource identifier. A first transmission unit for transmitting to a built-in application of the image processing apparatus; a first reception unit for receiving a request for the resource identified by the resource identifier from a browser of the image processing apparatus; and And a second transmission unit for transmitting content to the browser of the processing device.

  According to the above configuration, the remote calculation device can transmit a display request including the resource identifier to the built-in application of the image processing device. In addition, a request for the resource identified by the resource identifier can be received from the browser of the image processing apparatus, and the content can be transmitted from the resource to the browser of the image processing apparatus.

  In addition to the above configuration, the remote calculation device according to the present invention further includes a second receiving unit for receiving a status notification from the image processing device, and the status notification transmits the display request. You may instruct | indicate to the said 1st transmission part.

  According to the above configuration, when receiving a status notification that is information on the status of the image processing apparatus from the image processing apparatus, the remote calculation apparatus can transmit a display request to the image processing apparatus.

  Note that the present invention includes a method and apparatus for transmitting content to a client browser in an image processing apparatus (IDev). In some forms this is accomplished using the presence of built-in software. In addition, depending on the form, this function is enabled by transmitting the URL of the web page to the IDev client browser, and the IDev client browser accesses the URL to retrieve the web page.

  As described above, the content display method according to the present invention includes a step of receiving a display request including a resource identifier by a built-in application of the image processing device, and a transfer step of transferring the resource identifier to the browser of the image processing device. A connection step for connecting to the resource identified by the resource identifier, a retrieval step for retrieving content from the resource, and a browser of the image processing device, and the above-mentioned retrieved portion on the display unit of the image processing device. A display step for displaying the content.

  According to the above method, the image processing apparatus can take out the content in response to a display request from the outside and display the content on the display unit. Therefore, a request for display on the image processing apparatus can be made from the outside.

  Even if the browser of the image processing apparatus performs other processing, when the resource identifier is transferred from the built-in application of the image processing apparatus, the browser connects to the resource to retrieve the content, and displays it on the display unit of the image processing apparatus. Can be displayed. Therefore, for example, a warning or the like can be displayed on the display unit of the image processing apparatus from the outside in an emergency situation or the like.

  An embodiment of the present invention will be described with reference to the drawings. In all the drawings, the same reference numerals are given to the same members. Also, each of these figures is expressly incorporated as part of the detailed description.

  Although the components of the present invention are depicted and described generally in the drawings shown herein, they can be modified and designed in a wide variety of forms. Accordingly, the following detailed description of the method and system embodiments of the present invention is not intended to limit the scope of the invention, but merely to illustrate one example of a presently preferred embodiment of the invention.

  The components of the embodiments of the present invention may be incorporated into hardware, firmware and / or software. While the exemplary embodiments described herein describe just one example of these forms, those skilled in the art will recognize these components as any of these within the scope of the invention. It will be understood that it can be implemented in the form.

  Embodiments of the present invention include an interface and configuration (architecture) that integrates an image processing device with an application of a remote computing device (remote computing device), and an environment that provides a solution that is not possible with an image processing device alone. . An application on the network may include basic equipment (infrastructure) and an interface that can program-control the functions of the image processing apparatus and can communicate with the user via the input panel of the image processing apparatus. Software functions that are not practical in the image processing apparatus can be executed on a server accessible from the image processing apparatus.

  In the present specification and claims, the image processing apparatus (IDev) will be described as an apparatus having an image processing function. The image processing functions here include functions such as image reading, printing, copying, image transmission (transmission and reception), and image conversion. Typical image processing apparatuses include a printer, a copier, a fax machine, an image reader, and an arithmetic unit that transmits, converts, or processes an image. The image processing apparatus (IDev) may have a plurality of image processing functions. For example, but not limited to, a multifunction peripheral (generally having multiple functions of a printer, image reader, copier and / or fax, or image transmitter / receiver ( MFP) is one type of image processing apparatus. Note that another image processing apparatus as the MFP may have a combination of functions other than those described above.

  In the present description and claims, a remote computing device (RCD) is a device capable of data processing and having the ability to communicate with other devices over a communication link. A remote computing device (RCD) needs to have a communication line such as a network, telephone line, serial cable, or other wired or wireless line to communicate with other devices such as image processing devices. Device. A typical remote computing device (RCD) includes a network server with a communication link, a network computer, other processing devices, and other storage devices.

  Several embodiments of the present invention will be described with reference to FIGS. These embodiments include an image processing apparatus (IDev) 4. The image processing apparatus 4 may be a multifunction peripheral device (MFP) or a single function apparatus. The image processing apparatus 4 further includes a user interface (UI) panel 2. The user interface panel 2 includes an input button 14 and a display device 16. Alternatively, the user interface panel 2 may include a touch panel system. The touch panel system may or may not include the button 14. Further, user input and display may be executed via a separate UI device 8. The UI device 8 is connected to the image processing device 4 via, for example, a communication line 12 such as a USB, a network cable, and wireless. The UI device 8 may include not only a display device but also an input device such as a keyboard or a button. The display device provided in the UI device 8 may be a touch screen panel. Such a type of UI device 8 may further include an interface for transmitting a command input from the remote input device to the UI device 8. Further, the UI device 8 may include a storage device (for example, a memory stick, a USB memory card, etc.) configured to store input data to be transmitted to the image processing device 4.

  These embodiments further include a remote computing device (RCD) 6 linked to the image processing device 4 via a communication line such as the network 10. The network 10 may be a general wired line or a wireless line.

  In the embodiment of the present invention, menu data may be provided from the remote computing device 6 to the UI panel 2 or the UI device 8 of the image processing device 4 via the network 10. When this menu data is sent to the image processing device 4, information can be exchanged with an application operating on the remote computing device 6 using the UI panel 2 or the UI device 8 of the image processing device 4. The user input received by the UI panel 2 or the UI device 8 may be returned directly to the remote computing device 6.

  A web service is a software application identified by a Uniform Resource Identifier (URI). URI interfaces and bindings have functions that are defined, described, and discovered by XML (Extensible Markup Language) artifacts, and can be used for other purposes via XML-based messages via Internet-based protocols. Supports direct information exchange with software applications.

  The application on the remote computing device 6 uses various functions of the image processing device 4 (a function that enables use, a function that disables use, a function that sets the usefulness of the device, and a device function) using one or more web services. Control functions, etc.).

  In the embodiment of the present invention, a network application operating on the remote computing device 6 can exchange information with the user of the image processing device 4 via the I / O panel (UI panel 2) of the image processing device 4. In the above embodiment, the user interface (UI) (that is, the touch panel, button, or display) of the image processing apparatus 4 can be controlled by the network application. There is also a form in which a custom display screen or a custom display menu is integrated with a user interface unique to the image processing apparatus 4. In the above embodiment, the control of the function of the image processing device 4 is executed in the standard operation mode executed in the image processing device 4 in response to the user input to the user interface of the image processing device 4, the application on the remote calculation device 6, etc. The network resource can be handed off to an open system mode that is executed via user input at the user interface of the image processing device 4.

  In the above embodiment, an application operating on the network completely controls the UI of the image processing apparatus 4 so as to display text and graphics in an arbitrary format. In the above embodiment, the application can program display buttons, text boxes, graphics, and the like in a desired layout.

  The user interface arrangement may be easily programmed using a standard language such as a markup language. These languages include Hypertext Markup Language (HTML), Extensible Markup Language (XML), Wireless Markup Language (WML), and Extensible Hypertext Markup Language. A language (Extensible Hypertext Markup Language: XHTML) or the like can be used.

  An application of the remote calculation device 6 or a server application may be able to request that the keyboard UI be displayed on the UI panel 2 and the UI device 8 of the image processing device 4. This function can also be used in the image processing apparatus 4 and need not be recreated by the application of the remote calculation device 6. The remote computing device 6 may define a keyboard prompt or default value. In these embodiments, the remote calculation device 6 can change the name of each button in the user interface of the image processing device 4 such as an OK button or a cancel button, and can define other buttons.

  The image processing device 4 itself or the remote calculation device 6 may supply the menu template to the user interface of the image processing device 4.

(External authentication application)
Some embodiments of the present invention include an application of the remote computing device 6 registered as an external authentication server. The external authentication application controls access to the image processing apparatus 4 and controls the user interface of the image processing apparatus 4 at the top level (top-level control). The control of the user interface by the application may be the same method as the control by the internal auditor.

  In the above embodiment, the control unit of the image processing apparatus 4 checks whether an external authentication application is registered at the time of activation. If registered, the image processing apparatus 4 is in an unusable mode, and the application is connected to control the user interface. If the external authentication server cannot be used, an error message is displayed and the image processing apparatus 4 remains unusable. In this case, the image processing apparatus 4 tries to periodically connect to the external authentication server until it can be used. Table 1 below shows what controls the user interface when the image processing device 4 is in a disabled mode in a typical embodiment.

(Remote processing unit application)
In the embodiment of the present invention, the method for accessing the custom UI panel 2 of the image processing apparatus 4 may differ depending on the application. Some solutions, such as document management integration, preferably use a unique image transmission screen, while others display a UI panel that aggregates additional information about the image reading job. Other solutions, such as custom printing applications, may be accessed from individual modes other than specific functions.

  In order to meet the diversifying needs of these solution applications, the above embodiment supports multiple integration points for user interface control. These integration points are based on an operation (“trigger”) for registering an application by the user. In some embodiments, in order for the image processing apparatus 4 to grasp when the “trigger A” is generated when a connection command for the “remote processing apparatus B” is issued to the UI panel 2, the application executes the target apparatus (image processing apparatus 4). In an exemplary embodiment, the application is integrated with the image processing device 4 at multiple “trigger” points.

  The remote calculation device 6 is registered in a specific function, and is connected when a hardware key of the above function (for example, image transmission) is pressed on the user interface of the image processing device 4. The user interface information supplied by the remote calculation device 6 is displayed in place of the standard function screen originally provided in the image processing device 4. This trigger can also be used for applications that replace existing functionality with full custom UI functionality. Examples of such applications include a selected image reading solution (alternative scan solution) and a special display. The special display is, for example, a screen corresponding to “Section 508” or an interface corresponding to other special needs. These special displays may be equipped with large buttons or other accommodations.

  There is also a form in which the menu of each function in the image processing apparatus 4 may be displayed on the touch screen. Further, this menu may be registered by a remote calculation device 6 such as a server. This allows the solution application to supply custom content and continue to use some of the standard functions provided by the image processing device 4. When a button assigned to a custom application is selected, a menu is displayed with the solution registered for that function. The user can select the desired solution and the remote computing device 6 is connected to receive instructions.

  There is also a form in which the stand-alone RCD mode for supplying the application of the remote computing device 6 can be accessed from the job queue portion of the user interface displayed on the full screen. This trigger point can be used for applications that are not included in one of the standard device functions of the image processing device 4, such as a custom printing solution in the image processing device 4, for example. When the RCD menu is selected, the menu is displayed together with the solution application registered in the general RCD mode. The user selects the desired solution and the remote computing device 6 is connected to receive instructions.

(Hardware key interaction)
In some embodiments of the present invention, when the image processing device 4 is available, an additional hardware key is used to manage the device. Table 2 shows the hardware key assignments in an exemplary embodiment.

  In addition to logout by pressing down the * key, logout by timeout may be executed. Alternatively, it may be set to automatically delete (or set to disable use) when a predetermined time (for example, 10 seconds to 240 seconds) elapses. In these embodiments, if no action is taken within the time of the automatic erasure setting, the device automatically returns to the disabled mode and attempts to connect to the remote computing device 6 to re-control the user interface.

(Error & jam notification)
Depending on the particular solution, a remote computing device application (RCU application) may completely or partially control the user interface of the image processing device 4 and a particular image job. In the case of partial control, the remote computing device 6 may be able to respond to information exchange of the user interface in the native mode while monitoring the click, and may control the job. Further, as a partial control, the remote computing device application may be integrated with the unique mode (user interface trigger = function custom menu). The image processing device 4 may send all error and jam notifications to the associated remote computing device application.

  In the case where the remote computing device application completely controls the user interface and job of the image processing device 4, there may be a form in which errors and jam notifications are processed in different ways depending on the type of error. In the case of a recoverable error, a notification is transmitted to the remote computing device application, and the application performs a process of displaying a message on the UI panel 2 or the UI device 8 and resolving the notified error. In the case of an error that cannot be repaired, information is exchanged between the image processing apparatus mode and the RCD mode, and the error state is appropriately processed (for example, a command to erase the jam is given to the user).

(Handoff control)
The image processing apparatus may be controlled by a plurality of applications at various points in the image processing job. These applications are not particularly limited, but include, for example, an external authentication application, a standard RCD application, and a unique mode of the image processing apparatus 4. In the following description, the main body that performs control in each process and what kind of control is possible for various processes of the typical job in the typical embodiment will be described.

  Step 1: The user presents proof data for accessing the image processing apparatus in the user interface of the image processing apparatus. This process is controlled by a remote calculation device 6 such as an external authentication application or an internal accounting (inherent mode) built in the image processing device 4 itself. At the end of this step, the image processing device is ready for use. The above external authentication application may also specify default parameters or disable certain job parameters (eg, the default file format is PDF, but the user can change it) Also, the color mode may be set to black and white so that the user cannot change it.)

  Step 2: The user sets job parameters using one of the eigenmode farms of the image processing device or a standard RCD application. At the end of this process, the user makes an input to start the job. When this input is made, an optional notification is sent to the standard RCD application. This standard RCD application then changes the job parameters as needed. An example of an application that requests notification when a user performs input is an e-mail application. The user uses a unique image transmission screen or other input means to select an image reading option and to select an email recipient. The user then selects a custom application button and selects a scan-to-e-mail option from the menu. Next, the e-mail application displays a custom screen for setting permission for the user's file. When the user places a document on the image reader and starts processing, the e-mail application takes in the destination parameters set by the user and changes the target destination to the FTP server of the e-mail application. The e-mail application then receives the file, grants the appropriate permissions, and sends the e-mail selected by the user to the recipient. As in some embodiments, when the application creates and displays a thumbnail of the scanned image and allows the user to confirm, at this point, the application of the remote computing device re-controls the user interface. You may request.

  Step 3: When the job is started, the image processing apparatus executes image reading or RIPing of the job and spools it to the HDD. If the image processing apparatus is configured to authenticate a job using an external authentication application, it sends a click report to the application and waits for a command. The external authentication application can send / print jobs, cancel jobs, or change job parameters (change job parameters to make them usable). For example, the rule-based printing application requests a job parameter change after receiving a click report. Some rule-based printing applications support rule-based printing and rule-based image reading, which limits the actions each user can perform based on time, destination, and many other parameters. For example, it can be set so that only users in the marketing group can read a high-quality color image. For example, when another group of users selects color, 600 dpi, the rule-based application changes the parameter to color, 200 dpi. At the end of this step, the job is allowed or canceled.

  Step 4: When the standard RCD application in Step 2 designates a destination as a temporary storage destination in the HDD, this step may be omitted. In addition, this process may be executed by a Java (registered trademark) application operating on the image processing apparatus 4 in some embodiments. For example, a government agency may have a custom encryption application that runs on the image processing device 4. The custom encryption application takes the image-read document, encrypts it, and then requests the image processing device 4 to send the document to the target destination selected by the user in step 2. Note that in some forms it may be beneficial to send a notification to the external authentication application after this step and after the send / print step. After this step is beneficial because the image processing device does not know how long the file is stored on the hard disk or what the application does with it. It is.

  Step 5: In the final step, the file is actually output. In typical embodiments, the file is transmitted over a network or printed at a terminal. At the end of this step, a notification that the job has been completed successfully is sent to the external authentication application. It may be transmitted to the standard RCD application.

(Device control and management API)
The API allows a remote computing device application to control access to an image processing device that executes vend applications and manage the image processing device 4 from a remote location.

(Device Control and Vend API)
In some embodiments of the present invention, device control and sales APIs may allow applications to enable or disable access to the image processing device 4 and track clicks. The device control and sales API causes the remote calculation device 6 to perform the following control.

  Enabling / disabling the functions of the image processing device 4: This enables or disables the remote computing device 6 to access the entire image processing device 4 or to specific functions of the image processing device 4. It is possible to exercise the rights of individual users. In some exemplary embodiments, for example, the functions described in Table 3 are optionally enabled or disabled depending on the application.

  Report used clicks: At the end of a normal job, the used clicks are reported back to the remote computing device RCD.

  Debit Mode: In these embodiments, the application specifies whether the current job requires authentication when enabling the image processing device 4. In this case, the job is spooled in the memory, and click information (for example, information defined in Table 4) is transmitted to the remote computing device 6. The remote calculation device 6 notifies the image processing device 4 whether the job should be deleted or output / transmitted. At this time, the application can select whether to change the job parameter. If the application does not require authentication, the job continues normally and a click report is sent at the end of the job.

  Print Job Billing: In these embodiments, the remote computing device 6 performs a walk-up function and print job monitoring. When charging a print job, the image processing apparatus 4 monitors all the print jobs that are sent, and sends the charge data in the PJL header to the remote computing device 6 for verification before printing the job. The remote calculation device 6 verifies this billing data (or its shortage) and gives the image processing device 4 information indicating whether the job should be continued or canceled.

  Reports on unconfirmed jobs: In these embodiments, the remote computing device RCD requests monitoring of print jobs that the remote computing device RCD cannot associate with a particular user, such as device reports and incoming fax jobs. The remote computing device RCD can register to receive the number of clicks for all unconfirmed jobs and charge these jobs to a general account.

(Device management API)
In some embodiments of the present invention, a device management API may allow a network application to remotely set and manage an image processing device. In a typical embodiment, the device management API can cause the remote computing device 6 to perform the following control.
Device status—The remote computing device 6 requests the current status of the image processing device 4. This is the same state information that is reported on embedded web pages.
Device configuration—The remote computing device 6 retrieves a list of installed options supported by the image processing device 4.
Web page setting—The remote computing device 6 retrieves and sets any configurable value on the embedded web page.
Key operation program—The remote operation device 6 searches and sets an arbitrary value configurable in a key operation program including software keys.
Custom settings—The remote computing device 6 searches and sets any configurable value in the custom settings.
Job status—The job status remote computing device RCD searches the current job queue and history information to change the priority of jobs in the queue or delete the job.
Number of clicks—The remote calculation device 6 searches for the total number of clicks in the image processing device 4 and the number of clicks of each function based on the account code.
Data security setting-The remote computing device 6 searches for status information (eg, final deletion) on the DSK and starts a data erasure function.
-Red data (RED DATA)-The remote computing device 6 searches for all data normally transmitted with a red message (RED message) or the like.
Remote reboot—The remote computing device 6 initiates a reboot of the image processing device 4.

  The above classifications are only described as exemplary embodiments detailing which settings should be included. In some embodiments, the actual API is classified for each functional area. This is because the key operation setting and the web page setting may overlap.

(INTERNAL ACCOUNTING API)
The internal billing API allows a remote computing device application to configure an internal billing system and report the number of clicks. In some exemplary embodiments, the internal billing API includes the following:
Set audit options—The remote computing device 6 sets audit options including what modes of auditing are possible. The above modes include, for example, “account number security”, “invalid account job cancellation”, and the like.
Account code management—The remote computing device 6 adds, edits, or deletes account codes.
Account restriction—The remote computing device application specifies an upper limit on the number of clicks for each account code or for all account codes.
Account reset—The remote computing device application resets the number of clicks for an individual account or for all accounts.
-Click search-The remote calculation device 6 searches the number of clicks of each account code by function.

(Font and Form Management API)
Some of the above embodiments may include font and format management APIs. The font and format management API allows RCD applications to remotely download and manage fonts and formats to mass storage. In some embodiments, the font and format management API may allow the remote calculation device 6 to perform the following control.
Mass storage device control—The remote computing device 6 application retrieves mass storage device state information, including storage capacity, available space, and write inhibit mode, and changes the write inhibit state.
Resource List—The remote computing device application searches a list of stored fonts and formats (eg, font or macro ID, font number, font / format name, escape sequence, file size, etc.).
Resource download—The remote computing device application downloads PCL fonts, PCL macros, PS fonts, and formats. Any special processing that is performed when a resource is downloaded via a web page is also performed when the resource is downloaded via an open system.
Delete resource-The remote computing device application deletes all resources stored in the mass storage device.
Upload resource-The remote computing device application uploads individual or all resources. In the case of an image processing device 4 that cannot perform efficient memory management, the server application can “defragment” mass storage using this function.
Font / Macro ID—The remote computing device application assigns or changes the ID assigned to the PCL font and macro.

(Firmware Management API (Firmware Management API))
In some of the above embodiments, a remote management device or network application may remotely download and manage image processing device firmware by means of a firmware management API. In a typical embodiment, the firmware management API can cause the remote computing device 6 (for example, a server) to perform the following control.
Firmware version—The remote computing device application retrieves the current firmware version number.
Service mode—The remote computing device application puts the MFP in service mode and locks out other jobs that would hinder firmware upgrades. When the service mode request is received, the image processing apparatus 4 stops receiving the transmitted job, ends all jobs in the queue, and notifies the server that the image processing apparatus 4 is in the service mode. .
Firmware update—The remote computing device 6 downloads the latest firmware version to the image processing device 4. If restart is necessary, the image processing apparatus 4 is automatically restarted after the download is completed.
Download status—The image forming apparatus 4 transmits a status notification (normal / error) to the remote computing device 6 after downloading the firmware.
Revert to old version—If the firmware is not updated normally, request the image processing device 4 to revert to the old firmware version.

(Device function API)
In some of the above embodiments, the device function API allows remote computing device applications to provide new custom solutions using the functionality of existing image processing devices.

(Image transmission API)
In some of the above-described embodiments, the remote control device can be controlled by the image transmission API as follows.
Image transmission parameters—The remote computing device RCD application obtains and sets the following image reading and fax parameter values:
-Color or black and white-Image mode-text, text / photo, photo; exposure level-resolution-File format-file type, compression, number of file pages-Original-document size, single-sided / duplex, rotation, job build (job build)
・ File name ・ Subject ・ Message ・ Sender ・ Scheduled transmission time ・ Page division
・ Cover ・ Transmission message (confidential, emergency, etc.)
-Thin paper image reading-Destination-Document filing-Image reading start-The application of the remote computing device RCD starts the image reading function (the same as when the user presses the start button).

  In some embodiments, the remote computing device 6 can change the default value of the image processing device 4 or the value of the current job. Further, the remote calculation device 6 may specify whether or not the user can change the image reading parameter for the current job. If one remote computing device application (eg, access control application) specifies that the parameter cannot be changed and a second application (eg, document management application) attempts to set the parameter, a notification is sent to the second application. The setting is not changed.

(Print API)
In some embodiments, the remote computing device may present the print job via a standard print channel. In some embodiments, the print API may cause the remote computing device to perform the following control.
PJL searching (sniffing) —The application of the remote computing device RCD registers with the image processing device to contact for instructions when a specific PJL command is found in the print job. The remote processing device can instruct the image processing device IDev to replace the command, cancel the job, or continue printing. This interface can be used for applications such as billing and is compatible with other types of applications.

(Copy API)
In the above embodiment, a copy API (Copy API) may cause the remote computing device to perform the following control.
Copy parameters—The remote computing device RCD application obtains and sets the following copy parameter values:

Color or black and white Exposure-Text, text / photo, photo, super photo; exposure level Paper selection (per tray)
・ Copy rate ・ Double-sided copy: 1-to-1, 1-to-2, 2-to-2, 2-to-1; edge binding ・ Eject / eject tray, sort, staple, group, offset ・ Original size ・ Special functions-margin change, Erasing, pamphlet, etc.-Document filing / copy start-The application of the remote computing device RCD starts the copy function (starts in the same way as when the user presses the start button).

  In some embodiments, the remote computing device can change the default value of the image processing device or the value of the current job. Further, the remote calculation device may specify whether or not the user can change the copy parameter for the current job.

(Document Filing API)
In the above embodiment, there is a document filing API that may cause the remote calculation device to perform the following control.
Backup / Restore-Remote Computing Device RCD application imports and exports batch files along with all document filing data. In some embodiments, this package may be in a proprietary format. Because this package contains documents that are not accessible to password protected individuals. This package is generally used for restoration when a failure occurs or when copying to another device.
File / Folder List—The application of the remote calculation device 6 searches, changes, and creates new files and folders for storage in the image processing device 4 (or for management of the image processing device 4).
File download-The remote computing device 6 downloads a new file to the document filing system and designates a folder, a file name, a user name, and a password.
User list—The remote computing device application searches, modifies, and registers new users for storage in the image processing device 4 (or for management of the image processing device 4).
HDD status—The remote computing device application searches the current HDD status, such as% (ratio of capacity) assigned to the main folder, quick folder, custom folder, and remaining%.
Document filing parameters—The remote computing device application obtains and sets various values (eg, the values shown below) when saving a file to document filing:
・ Exposure ・ Resolution ・ Original-Size, Single-sided / Double-side ・ File information-User name, File name, Folder, Confidential, Password ・ Special mode-Erase, bag binding copy, 2IN1, job build, card shot
Start printing—The remote computing device application selects one of the stored files and starts printing, eg reflecting the following parameters:
・ Paper size / source ・ Discharge-sort / grouping, discharge tray, staple, punch, offset ・ Single-sided / double-sided (tablet / booklet)
・ Tandem printing ・ Number of copies ・ Deleting or saving after printing ・ Transmission start-The application of the remote computing device selects one of the stored files, for example, reflecting the following parameters Start:
・ Resolution ・ File format ・ Destination ・ Timer ・ Sender ・ File name ・ Subject ・ Message.

(security)
By enabling the image processing apparatus 4 to be controlled by an external application, the image processing apparatus 4 is exposed to a new security vulnerability. In the embodiment of the present invention that provides security measures, the following typical items are security concerns, which are addressed by the interface of the remote computing device 6.

  Access to the interface of the remote computing device 6 is limited to legitimate applications. The embodiment provides extensive access and control of the image processing device 4, which poses a significant security risk. While the interface in these embodiments is protected from access by attackers, setting up and using an effective solution remains easy.

  Confidential data (user certification data and job data) is protected during network transmission. The reason why the user certification data and the job data are protected during network transmission is to ensure theft prevention, prevention of device operation monitoring by an intruder, and prevention of message alteration due to man-in-the-middle attacks. The image processing device 4 establishes a secure socket layer (SSL) and other connections so as to ensure data safety while communicating between the image processing device 4 and the remote computing device application. Supported.

  The administrator can restrict access to the image processing apparatus 4. For users who require strict security, the administrator can disable access from the remote computing device 6 or restrict access to specific applications. The administrator can arbitrarily register only a limited number of applications that can access the interface of the image processing apparatus 4.

  The remote computing device application can be prevented from being “spoofed” by the image processing device 4. The remote calculation device 6 can authenticate the image processing device 4 connected to the remote calculation device 6. This is because an intruder pretends to be the image processing device 4 to collect network configuration and password information, monitor the file / folder configuration of the document management system, and check the security settings and DSK status of the image processing device 4. This is so that it cannot be distracted.

  The remote computing device 6 can be prevented from being “spoofed” by the server. The image processing device 4 must be able to authenticate all remote computing devices 6 connected to the image processing device 4. This is to prevent an intruder from impersonating the IP address of the remote computing device 6. By pretending to be a remote computing device 6, an intruder steals user proof data, transfers scanned documents, modifies device configuration or firmware (to give access to unauthorized users or The access control system can be stopped (to initiate a denial of service attack on the user).

  The access control / sales application is not at risk when the remote computing device 6 is in an unusable state. When the remote calculation device 6 is not usable, it is not permitted to give the image processing device 4 open access. If the remote computing device 6 is activated but cannot be used or cannot be used at any time (for example, when someone disconnects the network cable), the image processing device 4 is immediately disabled and an error occurs. A message is displayed.

  Administrators can adjust the security level based on the needs of the enterprise and / or application. Security requirements have a significant impact on the time spent developing remote computing device applications and the resources required to run the solution. Users utilizing some embodiments have one image processing device 4, no IT staff, and access control and all devices from small businesses using simple image reading or printing applications. May extend to government agencies with audit trails that record their actions. The security measures taken to protect the interface of the image processing apparatus 4 can be adjusted by the administrator so as to match the target environment.

  The image processing device 4 and the remote computing device application can communicate user certification data with each other. The user may be prompted to log in at multiple points during the job. For example, the access control application or billing application controls all device access, the image processing device 4 performs user authentication that enables image transmission, and the document management application prompts the user before displaying the folder list. Request to log in. In many environments, all these applications use a common user database. For this reason, in some embodiments, it may be desirable for the application to communicate user certification data with each other so that the user does not need to repeat the authentication process.

  Some embodiments of the present invention will be described with reference to FIG. These embodiments include an image processing device configured to communicate with a remote computing device such as a server connected via a communication line, for example. The image processing apparatus 30 includes a user interface 32 and a display 36. The user interface 32 is a user input device 34, such as a keyboard, one or more buttons, knobs or switches, or a touch screen panel. The display 36 may be a user input device in the form of a touch screen panel.

  The image processing device 30 is generally capable of performing one or more image processing functions. Examples of the image processing function here include, but are not limited to, image reading, printing, copying, fax communication (transmission and reception), and the like.

  In this embodiment, a communication line 38 is further provided. The communication line 38 may be wired (as shown in FIG. 3). As the cable, for example, a network cable, a universal serial bus (USB) cable, a serial cable, a parallel cable, for example, a power communication line such as a home plug connection line, or other cables can be used. . Alternatively, the communication line 38 may be wireless. As the wireless connection, for example, IEEE 802.11 (b) standard connection, Bluetooth connection, Infrared Data Association (IrDA) connection, or other wireless connection can be used.

  An example of the operation of the image processing apparatus 30 will be described with reference to FIG. In these embodiments, first, the image processing device 30 receives menu data from a remote computing device (not shown in FIG. 3) (step 40). This remote computing device is connected to the image processing device 30 via a wired or wireless communication link 38. Next, the menu data is displayed on the display 36 of the user interface 32 of the image processing apparatus 30 (step 42). The purpose of displaying the remote menu data in this way is to speed up input by the user on the user input device 34 of the user interface 32.

  The image processing apparatus 30 of the above embodiment is configured to receive an input by the user after the remote menu data is displayed and to transmit the user input data to the remote computing device (step 44). In some embodiments, this user input data is processed by a remote computing device. The process includes, for example, execution of an application in the remote computing device, access to data stored in the remote computing device, communication of the data, and the like.

  The image processing apparatus 30 according to the embodiment is configured to receive data generated by the processing of the user input data (step 46). The received data may include data generated by an application executed on the remote computing device after user input. The image processing device 30 may also receive data stored in a remote computing device such as a file server after processing of user input.

  When the image processing apparatus 30 receives the processing data (step 46), the image processing apparatus 30 executes a specific function in accordance with the data or by using the data (step 48). For example, but not limited to this, the image processing device 30 prints a document stored in the remote computing device and modified on the remote computing device in response to a user input. As another example, but not limited to this, when the image processing apparatus 30 receives the processing data in step 46, the function of the image processing apparatus 30 (for example, image reading, copying, printing, fax communication). May be made active or usable.

  Several more specific embodiments of the image processing apparatus 30 will be described with reference to FIG. In the above-described embodiment, the image processing device 30 is configured to receive menu data formatted in the markup language from the remote computing device (step 50). The communication link through which the menu data is communicated may be constructed and maintained using a hypertext transfer protocol (HTTP). Examples of the markup language include hypertext markup language (HTML), extensible markup language (XML), wireless markup language (WML), extensible hypertext markup language (XHTML), and / or others. Can be used.

  Upon receiving the menu data (step 50), the image processing device 30 displays the received menu data on the user interface display 36 of the image processing device 30 (step 52). Similar to the above-described embodiment, the menu data is generally for prompt input by the user on the user interface 32 of the image processing apparatus 30. Display of the remotely stored menu data (step 52) may be accomplished using a browser application provided with the image processing device 30.

  In the above embodiment, the image processing device 30 is further configured to transmit user input received via the user interface 32 to the remote computing device (step 54). Upon receiving the user input, the remote calculation device executes the application or processes the received user input and returns the processing result to the image processing device 30. The image processing device 30 is further configured to receive processing data from the remote computing device (step 56). In some embodiments, the image processing device 30 may perform one or more functions after receiving processing data (step 56).

  Still another embodiment of the present invention will be described with reference to FIG. This embodiment includes a remote computing device (RCD) 60 with a communication line 64. As the communication line 64, use a network cable (as shown in FIG. 6), a universal serial bus (USB) cable, a serial cable, a parallel cable, for example, a power communication line such as a home plug connection, or other wired lines. Can do. Alternatively, the connection via the communication line 64 may be, for example, an IEEE 802.11 (b) standard connection, a Bluetooth connection, an infrared connection as defined by the Infrared Communication Association (IrDA) standard, or other wireless connection. . In some embodiments, the remote computing device 60 may further include a data storage device 62. The data storage device 62 is typically a hard drive, but may be an optical drive device such as a compact disk drive, flash memory, or other storage device.

  An embodiment of the remote computing device 60 will be described in more detail with reference to FIG. In these embodiments, the remote computing device 60 includes a processor 72. The processor 72 processes data and executes programs such as an operating system and applications. The remote computing device 60 further includes a memory 74. The memory 74 may be a random access memory (RAM) or a read only memory (ROM). In general, any application processed by processor 72 is loaded into memory 74. The remote computing device 60 further includes a network interface 78. This network interface 78 allows the remote computing device 60 to communicate with another device such as the image processing device 30. In some embodiments, the remote computing device 60 further includes a user interface (UI) 80, but this is not necessary in many embodiments. The remote calculation device 60 also includes a storage device 62 that stores applications and data accessed by the image processing device 30 according to the embodiment of the present invention. The processor 72, memory 74, storage device 62, network interface 78, and optional user interface 80 are generally connected by a system bus 76. This enables data transmission between the members. The communication line 64 connects the remote computing device 60 to another device via the network interface 78.

  In some embodiments described with respect to FIG. 8, remote computing device 60 has menu data stored in storage device 62 or memory 74. The menu data may be displayed on the user interface 32 of the image processing apparatus 30. The menu data may be stored in various formats and configurations. In some embodiments, the menu data may be in the form of terms expressed in a markup language. Markup languages include hypertext markup language (HTML), extensible markup language (XML), wireless markup language (WML), extensible hypertext markup language (XHTML), and / or other languages. Can be used. In the present embodiment, the menu data is transmitted to the image processing device 30 via the communication link 64 in step 82. Accordingly, the menu data configured to be displayed on the image processing device 30 is stored in the remote calculation device 60.

  Next, the remote computing device 60 of some embodiments is configured to receive user input (step 84). This user input is input via the user interface 32 of the image processing device 30 and transmitted to the remote computing device 60 via the communication links 38 and 64. When receiving this input data, the remote calculation device 60 processes the input data (step 86). This processing step 86 may be a step of converting this data into a new format, a step of executing a command in this data, or another processing step. The remote calculation device 60 processes the input data (step 86), and then returns the processing result to the image processing device 30. The image processing device 30 uses the received processing result for processing in the image processing device 30 or a function executed in the image processing device 30.

  Another embodiment will be described with reference to FIG. In this embodiment, the remote computing device 60 transmits menu data configured for the display 36 of the image processing device 30 using a markup language (step 90). The markup language menu data is received by the image processing apparatus 30 and displayed to the user. Thus, normally, the user can quickly input on the user interface 32 of the image processing apparatus 30. This user input is transmitted to the remote computing device RCD 60 by the image processing device 30, and the remote computing device RCD 60 receives input data for quickly displaying menu data on the image processing device 30 (step 92). Further, the remote computing device RCD 60 processes the received input data (step 94). This processing step may be, for example, a step of selecting, recording, changing, etc. the format, document, or other data stored in the remote computing device RCD 60, and authenticates the user identified by the user input. May be a step, may be a step of translating a document input by the user, may be a step of generating a map or other instruction related to the user input, or other processing or function It may be.

  Still another embodiment of the present invention will be described with reference to FIGS. The above-described embodiment includes at least one remote calculation device RCD60 and a plurality of image processing devices 30a to 30d. In the above embodiment, at least one of the image processing apparatuses 30 a to 30 d includes the user interface 32 having the display 36 and the user input panel 34. The user input panel 34 may be integrated with the display (ie, a touch screen) or may be an input device that is separate from the display. The remote computing device RCD 60 is connected to the image processing devices 30 a to 30 d via a communication link and the network 100. Thereby, data transmission between the remote calculation device RCD60 and the image processing devices 30a to 30d is possible.

  In the above embodiment, the menu data is stored in the remote computing device RCD 60 and is transmitted to at least one of the image processing devices 30a to 30d. This menu data is displayed on the user interface. Each of the image processing devices 30a to 30d is configured to receive the menu data, accept a user input (step 112), and transmit the accepted user input to the remote computing device 60 (step 114). When receiving the user input data, the remote computing device 60 processes this data in the same manner as in the previous embodiment (step 116). Then, the result of the process (step 116) is returned to the arbitrarily combined image processing apparatuses 30a to 30d (step 118).

  In the above-described embodiment, processing capability, resources, and functionality are supplied to the plurality of image processing devices 30a to 30d using a single remote calculation device RCD60. At this time, these resources are not reproduced in each image processing apparatus. In some embodiments, processing data generated in response to an input to an image processing device 30a may be transmitted to another image processing device 30d for output or final processing of the processing data. There is also.

  Still another embodiment of the present invention will be described with reference to FIG. In the present embodiment, the image processing apparatus (IDev) 120 includes a user interface 124. The user interface 124 can accept user input and can display data to the user. The user interface 124 generally includes a display. This display is often in the form of a touch panel. This display is used to display data to the user. This data is, for example, menu data for quick user selection such as user ID and password, data input, format selection, and other input. The image processing apparatus 120 includes a communication link 122. The communication link 122 may be a general computer network connection, a serial cable, or a wired or wireless communication link described in another embodiment. The communication link 122 connects the image processing apparatus 120 to remote computing devices (RCD) 126a and 126b such as servers. The remote computing devices 126a, 126b may be for storing documents such as formats and other data, and may be used to make the data accessible from the image processing device 120. . The remote computing devices RCD 126a and 126b may also execute applications that exchange information with the image processing device 120 and its user interface 124, and applications that receive input to the image processing device 120 and its user interface 124. . In some embodiments, the database 125 may be linked to the image processing device 120 and / or the remote computing devices 126a and 126b. In some embodiments, the remote calculation device 126b or the database 125 may be connected to the image processing device 120 via a wide area network such as the Internet 128.

(Embodiment for Displaying Content on Image Processing Device)
Some embodiments of the present invention include a method and system for sending content to a client browser in an image processing device (IDev) using presence such as embedded software. In a typical peripheral device system, a web browser client application interacts (communications) with a server. The nature of these interactions is a request (the browser requests a URL from the server) followed by a response (the server responds by sending content to the browser). The entire dialog is composed of these request / response combinations. In general, it is not possible to "interrupt" this conversation or to start such a conversation from an external entity. However, there may be situations where either client or server requires either of the above parties to interrupt the current conversation or to start a new conversation and display a completely different URL. In this new URL, for example, a state requiring an interrupt is described. This interrupt function does not exist in the prior art.

  Embodiments of the present invention include a method and system having the capability of interrupting a communication session between a server and a web browser client. These methods are sometimes referred to as interrupt methods. The first step when a new interaction is initiated may be referred to as “pushing” the content to the browser. By using these systems and methods in the image forming apparatus system, the image forming apparatus web browser can notify the server when an error condition occurs. The group can operate more effectively and advantageously by the function of interrupting the server application when a predetermined error condition occurs and the function of accessing the content from the server.

  Some embodiments of the invention provide for transferring content to a client browser on an image processing device. In some embodiments, it is transferred using the presence of software called a “web service”. This “web service” operates in the MFP.

  A web service is a software application identified by a uniform resource identifier (URI). URI interfaces and bindings have functions that are defined, described, and detected by Extensible Markup Language (XML) artifacts, and use Internet-based protocols using XML-based messages. To exchange information directly with other software applications.

  The web services of these embodiments use a web method that can occupy a browser by displaying new content. This method is sometimes referred to as the “ShowScreen” method because new browser content is transferred to the browser. The display screen method can instruct the browser to display a specific URL, or it can be passed to display text (html, xml, etc.) content (ie a string) or another content to the browser Can do. The display screen method can be invoked according to the state brought about by the MFP. This state can be sent to the server via a web service. After receiving this notification, the server can transfer the content to the browser by calling the display screen method. The browser then displays this new and unrequested content.

  Some embodiments of the present invention include an image processing device in communication with one or more additional image processing devices (IDev) or one or more remote computing devices (RCD, remote computing devices).

  Some embodiments of the present invention will be described with reference to FIG. In this embodiment, the image forming apparatus (IDev) 139 includes a display (display unit) 130, a web browser (browser) 131, and a built-in application 133. Further, although not shown, a control unit that controls various operations in the image forming apparatus 139, a web browser 131 and the outside, and a web interface 133 and a communication interface that communicates with the outside are provided.

  The display 130 has a function of displaying content and web pages from the web browser 131. This content is transferred to the web browser 131 by a built-in application 133 such as a web service or another software built in the image processing apparatus 139, for example. The embedded application 133 can be invoked by the local server 135 (ie, on the LAN) or a remote server 138 accessed via a WAN 136 such as the Internet. The built-in application 133 can also be called by an external software application that functions as a server. In some embodiments, the built-in application 133 can transfer the URL of the web page to the web browser 131 of the image processing device 139. The web browser 131 connects to the URL and takes out a web page. This URL indicates a resource on the local server 135 and the remote server 138 that calls the built-in application 133, or a resource on a different server 134 and the remote server 137. Server 134 is on a local network and remote server 137 is at a remote location via a WAN, such as the Internet 136, for example.

  In these embodiments, the local server 135 can communicate with the built-in application 133 of the image processing device 139. This communication may include transfer of content including the resource URL to the built-in application 133 and reception of communication from the built-in application 133. The remote server 138 can also communicate bidirectionally with the built-in application 133. In this two-way communication, web contents, URLs, and other data are transmitted and received by the remote server 138 and the built-in application 133.

  In this embodiment, each of the servers 134, 135, 137, and 138 functions as a remote computing device according to the present invention. In the present embodiment, the local server 135 and the remote server 138 receive a first transmission unit for transmitting a display request including a resource identifier to the built-in application 133 of the image processing apparatus 139 and a status notification described below. A second receiving unit is provided. In addition, the server 134 and the remote server 138 receive a request for the resource identified by the resource identifier from the web browser 131 of the image processing device 139, and the content from the resource to the web browser 131 of the image processing device 139. It is assumed that a second transmission unit that transmits These servers may have the same configuration as the remote computing devices 6, 60, 126a, and 126b described above for the servers 134, 135, 137, and 138, respectively.

  When the web browser 131 of the image processing device 139 receives a URL, or another instruction requesting displayable content or other data, on the server 134 of the local network or via a remote connection to a remote resource. Connect to the URL or similar resource.

  In some embodiments, a remote resource, ie remote server 138, or a local resource, ie local server 135, can initiate the process. As a result, the content or the instruction for requesting the content is transferred to the web browser 131 of the image processing apparatus 139 via the built-in application 133 such as a web service (132). This occurs while the image processing device 139 is in a standby state or while the image processing device 139 is performing another process.

  In some exemplary embodiments shown in FIG. 14, the local server 135 and the remote server 138 transfer content to the web service 133 (built-in application 133) of the image processing device 139 (step 140). Then, the web service 133 transfers the content 132 to the browser 131 of the image processing apparatus 139 (Step 142). Next, the browser 131 of the image processing apparatus 139 displays the content on the display 130 of the image processing apparatus 139 (Step 144). Then, the user can exchange information with the content via the user interface of the image processing apparatus 139 to end the process being executed in the image processing apparatus 139 or start another process.

  Some embodiments of the present invention will be described with reference to FIG. This embodiment includes a remote application. The remote application is on the remote server 138 and calls the web service 133 built in the image processing apparatus 139 (step 150). This web service 133 call may include a URL, browser content, or other instructions or data. When web service 133 receives a URL or other indication, it responds by obtaining content or other data from a local or remote location. The remote location may or may not be the remote server 138 that originally made the web service call. Next, the web service 133 transfers the newly obtained content or data to the web browser 131 (step 152). Thereafter, the web browser 133 connects to the acquired URL and retrieves the web page (step 154). Then, the web browser 131 displays the web page (step 156).

  Some embodiments of the present invention will be described with reference to FIG. This embodiment includes an external application or a remote application. This external or remote application may be on the local server 135 or the remote server 138. The external application calls the built-in software 133 (built-in application 133) of the image processing apparatus 139 (step 160), and transmits an instruction or content to the built-in software 133. The external application transmits a URL or other type of resource identifier to the internal software 133 (step 161). The built-in software 133 transfers the URL or resource identifier to the web browser 131 of the MFP (step 162). Next, the web browser 131 of the image processing apparatus 139 connects to the URL transmitted by the built-in software 133 (164), and takes out the content identified by the URL or the identifier. Then, the web browser 131 of the image processing apparatus 139 displays the extracted content (166).

  Some embodiments of the present invention will be described with reference to FIG. This embodiment may include external applications on servers “A” 135, 138. This external application has a function of calling the image processing device 139 built-in software 133 (built-in application 133) (step 170). The external application transfers the resource identifier or URL to the built-in application 133 (step 171). Then, the built-in application 133 transfers the resource identifier or URL to the web browser 131 (step 172). Next, the web browser 131 connects to the URL on the server “B”, which is a separate device (step 174), and retrieves the content identified by the URL or resource identifier. Then, the web browser of the MFP displays the web page (step 176).

  Some embodiments of the present invention will be described with reference to FIG. These exemplary embodiments include a web service or built-in application 133 of the image processing device 139. The web service or built-in application 133 notifies a predetermined state to a remote computing device such as servers (applications) 135 and 138, for example (182). This predetermined state may include an error state, a job status state, an alarm state, or other states. Next, the servers (applications) 135 and 138 call the web service method “display screen” of the web service 133 (built-in application 133) of the image processing apparatus 139 (step 184). Then, the servers (applications) 135 and 138 further transmit the URL or resource identifier to the built-in web service 133 (step 185). Then, the web service 133 transfers the URL or other resource identifier to the web browser 131 (step 186). Web browser 131 connects to the identified resource or URL (step 187) and retrieves the web page or other content. Then, the web browser 131 displays the identified content (step 188).

  In some exemplary embodiments related to the embodiment shown in FIG. 19, the servers 135, 138 are notified by the web service 133 when an error condition of the image processing device 139 occurs (step 192). Error conditions may include medium shortage, toner shortage, ink shortage, paper jam, mechanical failure, unresolved billing restrictions, or other conditions. Next, the servers (applications) 135 and 138 call an internal application such as the internal web service 133 of the image processing apparatus 139 (step 194). The server applications (applications) 135, 138 also send resource identifiers, such as URLs, to the web service 133 (step 195) to identify specific content displayed on the display 130. Next, the built-in application 133 transfers the URL to the web browser 131 of the image processing apparatus 139 (step 196). The web browser 131 connects to the URL and retrieves a web page (step 197). The web browser 197 displays a web page on the MFP web service (step 198).

  Some embodiments of the present invention shown in FIG. 20 include a web service 133 (built-in application). The web service 133 notifies an alarm state such as a fire alarm to the servers 135 and 138 which are remote computing devices (step 202). The servers 135 and 138 which are remote computing devices respond by calling the web service method display screen of the built-in web service 133 (step 204). This call may be accompanied by browser content transmitted to the web service 133. Then, the web service 133 transfers the content to the web browser 131 (step 206). Then, the web browser 131 displays the content (step 208). In an exemplary embodiment where the alarm condition is a fire alarm or other emergency alert, the content transmitted to the web service 133 and the content forwarded to the web browser 131 (step 206) may be an evacuation map or emergency exit. Instructions may be included. When the content is displayed (step 208), an alarm sound or visually noticeable display indicates the user an emergency condition and informs the user of the appropriate response procedure. In some embodiments, content relating to emergency evacuation maps or emergency exit instructions may be printed for the user. In some embodiments, the image processing device may be adapted to respond to receipt of emergency response content by sending a fax message to any recipient.

  In the embodiment of the present invention shown in FIG. 21, the built-in software 133 (built-in application 133) of the image processing device 139 notifies the server of the state of the image processing device 139 (step 212). The server then invokes the embedded web page content (step 214). Thereafter, the built-in software 133 transfers the content to the web browser 131 (step 216). Here, step 216 is performed by interrupting an arbitrary process being executed by the web browser 131. Then, the web browser 131 displays the content (step 218).

  22 includes a web service 133 (built-in application 133) of an MFP (image processing apparatus 139). The web service 133 notifies the servers “A” 135 and 138 of a predetermined state (step 222). For example, the server “A” transmits a resource identifier such as a URL to the web service 133 and calls the web service method display screen of the web service 133 (step 224). Next, the web service 133 transfers the resource identifier or URL to the web browser 131 (step 226). Web browser 131 then connects to the identified resource on a separate device, such as, for example, servers “B” 134, 137 (step 227) and retrieves the identified content. Then, the web browser 131 displays the identified content (step 228).

  The terms and expressions used in this specification are for explaining the contents and do not limit the technical scope of the present invention. Moreover, these terms and expressions are not intended to make any difference with respect to the features or parts of the invention shown and described. That is, the present invention is not limited to the above-described embodiments, and various modifications can be made within the scope of the claims, and the technical means disclosed in the above-described embodiments can be appropriately combined. Such embodiments are also included in the technical scope of the present invention.

  The present invention can be applied to, for example, an apparatus or system including a printer, a copier, a scanner, a fax machine, and the like having a communication function.

1 is a diagram of one embodiment of the present invention including an image processing device connected to a remote computing device. 1 is a diagram illustrating a typical user interface for an image processing apparatus. It is a figure which shows an example of an image processing apparatus. It is a flowchart which shows the flow of a process with an image processing apparatus. It is a flowchart which shows the flow of the process using the markup language in an image processing apparatus. It is a figure which shows an example of a remote computing device. It is a block diagram which shows the component of a remote computing device. It is a flowchart which shows the flow of a process in a remote computing device. It is a flowchart which shows the flow of the process using the markup language in a remote computing device. It is a figure which shows the system provided with the several image processing apparatus connected to a remote arithmetic unit. It is a flowchart which shows the flow of a process in the system shown by FIG. FIG. 2 illustrates components of an embodiment of the present invention that includes multiple remote computing devices and linked resources. 1 is a diagram illustrating a system for operating an image processing apparatus, particularly a system for transmitting content to a client browser in a multifunction peripheral device (MFP). FIG. 6 illustrates method steps according to some embodiments including a step of calling embedded web content, a step of transferring the web content to a browser of the MFP, and a step of displaying the web content on the browser of the MFP. . FIG. 6 illustrates method steps according to some embodiments, including calling a web page URL using a web service. FIG. 6 illustrates method steps according to some embodiments, including calling a URL for a web page using embedded software. FIG. 6 illustrates method steps according to some embodiments, including calling a web page URL. FIG. 6 illustrates method steps according to some embodiments, including a step of notifying a server by an MFP web service when a predetermined condition occurs. FIG. 7 illustrates method steps according to some embodiments, including notifying a server by an MFP web service when an error condition occurs. FIG. 6 illustrates steps of a method according to another embodiment including the step of notifying a server by a web service of the MFP when a predetermined state of the MFP occurs, and calling a URL of a web page using the web service. FIG. FIG. 6 is a diagram illustrating method steps according to some embodiments, including a step of notifying a server by MFP built-in software when a predetermined state of the MFP occurs. A part including a step of notifying the server “A” by the web service of the MFP when a predetermined state of the MFP occurs and a step of connecting to the URL via the server “B” and retrieving the web page It is a figure which shows the process of the method by embodiment of this.

Explanation of symbols

2 UI panel 4, 30 (30a-30d), 120, 139 Image forming apparatus (IDev)
6, 60, 126a, 126b Remote computing device (RCD)
8 UI device 130 Display (display unit)
131 Web browser (browser)
133 Built-in application (Web server)
134 server (remote computing device)
135 Local server (remote computing device)
137,138 Remote server (remote computing device)

Claims (20)

A content display method for displaying content on a display unit of an image processing apparatus,
Receiving a display request including a resource identifier in a built-in application of the image processing apparatus;
A transfer step of transferring the resource identifier to a browser of the image processing apparatus;
A connection step for connecting to the resource identified by the resource identifier;
An extraction step of retrieving content from the resource;
A display step of causing the display unit of the image processing apparatus to display the extracted content using a browser of the image processing apparatus;
The content display method characterized by including.   The content display method according to claim 1, wherein the built-in application is a web service.   The content display method according to claim 1, wherein the resource identifier is a URL (Uniform Resource Locator).   The content display method according to claim 1, wherein the display request is for calling a web service method.   The content display method according to claim 1, wherein the display request is for calling a display screen web service method.   The content display method according to claim 1, wherein the display request is for calling a display screen web service method including a URL.   The content display method according to claim 1, wherein the device that transmits the display request and the device in which the resource exists are arranged apart from the image processing device.   The content display method according to claim 1, wherein a device that transmits the display request is different from a device in which the resource exists. A content display method for displaying content on a display unit of an image processing apparatus,
A transmission step of transmitting a status notification from the image processing apparatus to the remote application;
In the built-in application of the image processing apparatus, a receiving step of receiving a display request including a resource identifier;
A transfer step of transferring the resource identifier to a browser of the image processing apparatus;
A connection step for connecting to the resource identified by the resource identifier;
An extraction step of retrieving content from the resource;
A display step of displaying the content on the display unit using a browser of the image processing apparatus;
The content display method characterized by including.   The content display method according to claim 9, wherein the status notification is an error notification or an emergency warning. A content display method for displaying content on a display unit of an image processing apparatus,
In the built-in application of the image processing apparatus, a receiving step of receiving a display request including browser content;
A transfer step of transferring the browser content to a browser of the image processing apparatus;
Using the browser of the image processing device to display the content on the display unit,
A content display method, wherein the transfer step is performed by interrupting an arbitrary process being executed in the browser. A method for displaying content on a display unit of an image processing apparatus,
A transmission step of transmitting a status notification of the image processing device from the image processing device to the remote application;
In the built-in application of the image processing apparatus, a receiving step of receiving a display request including browser content;
A transfer step of transferring the browser content to a browser of the image processing apparatus;
A display step of displaying the browser content on the display unit using a browser of the image processing apparatus;
The content display method characterized by including. A content transmission method for transmitting content to an image processing apparatus,
A transmission step of transmitting a display request including a resource identifier to a built-in application of the image processing apparatus;
A receiving step of receiving a request for the resource identified by the resource identifier from a browser of the image processing apparatus;
A content transmission step of transmitting content from the resource to the browser of the image processing apparatus;
The content transmission method characterized by including. A content transmission method for transmitting content to an image processing apparatus,
In a remote application, a status notification receiving step for receiving a status notification from the image processing device;
A display request transmission step of transmitting a display request including a resource identifier to the built-in application of the image processing apparatus;
A browser request receiving step for receiving a browser request for the resource identified by the resource identifier from the browser of the image processing apparatus;
A resource-related data transmission step of transmitting data related to the resource identified by the resource identifier to a browser of the image processing apparatus;
The content transmission method characterized by including. An image processing apparatus including a built-in application, a browser, and a display unit,
The built-in application receives a display request including a resource identifier from a remote application, further transfers the resource identifier data to the browser,
The browser connects to the resource identified by the resource identifier, retrieves content from the resource, and displays the retrieved content on the display unit.
An image processing apparatus characterized by being configured. The built-in application is further configured to send a status notification to the remote application,
The image processing apparatus according to claim 15, wherein the status notification instructs the remote application to transmit the display request. An image processing apparatus including a built-in application, a browser, and a display unit,
The built-in application receives a display request including browser content from a remote application, transfers the browser content to the browser,
The browser displays the browser content on the display unit.
Configured,
The image processing apparatus, wherein the built-in application performs the transfer by interrupting an arbitrary process being executed by the browser. The built-in application is further configured to send a status notification to the remote application,
The image processing apparatus according to claim 17, wherein the status notification instructs the remote application to transmit the display request. A remote computing device for transmitting content to an image processing device,
A first transmission unit for transmitting a display request including a resource identifier to a built-in application of the image processing apparatus;
A first receiver that receives a request for the resource identified by the resource identifier from a browser of the image processing apparatus;
A second transmitter for transmitting content from the resource to the browser of the image processing apparatus;
A remote computing device comprising: A second receiving unit for receiving a status notification from the image processing apparatus;
The remote calculation device according to claim 19, wherein the status notification instructs the first transmission unit to transmit the display request.