JP2015061259A - Image processing device, image processing system, and screen display method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image processing device, an image processing system, and a screen display method in which operability is not reduced when document information stored in another image processing device is displayed on an operation screen, and the document information can be displayed without converting a file format even when the file format is not the one which can be processed by the own machine.SOLUTION: When an operation for designating a document box "BOX2" present in an image processing device 2b is performed by a log-in user (P6), a display controller requests document information on the document box "BOX2" to the image processing device 2b. The display controller of the image processing device 2b generates a display image which is to be sent to an image processing device 2a on the basis of a document file stored in the document box "BOX2" (P7). When receiving this display image from the image processing device 2b, the display controller of the image processing device 2a inserts the display image into an insertion region R of an operation screen G3, and displays an operation screen G4 on a display part 231 (P8).

Description

  The present invention relates to an image processing apparatus, an image processing system, and a screen display method, and more particularly to a technique for displaying information related to a document stored in another image processing apparatus in one image processing apparatus.

  In recent years, an image processing apparatus such as an MFP (Multifunction Peripherals) is connected to a network, and can acquire a document data held in another image processing apparatus via the network and execute a job. ing. In such an image processing apparatus, in order to allow a user to specify document data stored in another image processing apparatus as a job execution target, what kind of document data is stored in the other image processing apparatus. Display on the operation panel. Therefore, conventionally, when a user inputs an instruction to display a list of document boxes to one image processing apparatus, the one image processing apparatus requests the box information from another image processing apparatus and acquires it A technique for creating and displaying a list of document boxes based on box information has been proposed (for example, Patent Document 1).

JP 2011-211302 A

  However, when one image processing device displays a list display screen based on information acquired from another image processing device, if the list display screen is displayed by switching the entire screen, it has been displayed so far Operation buttons are not displayed. Therefore, when the user wants to perform an operation on these operation buttons, it is necessary to perform a screen switching operation to redisplay the operation screen before the screen switching. When the operation is performed while alternately referring to the list display screen and the operation screen, there is a problem that the frequency of the screen switching operation increases and the operability is poor.

  The same problem also occurs when the user has performed a job setting operation or the like before the list display screen is displayed. That is, when one image processing device displays a list display screen based on information acquired from another image processing device, if the entire screen is switched to display the list display screen, the list display screen is displayed so far. The setting screen will be hidden. Therefore, in order for the user to confirm the setting contents again, it is necessary to perform a screen switching operation in order to redisplay the setting screen before the screen switching, resulting in poor operability.

  Further, when one image processing apparatus acquires document data stored in a document box of another image processing apparatus and displays a list of documents, the one image processing apparatus is stored in another image processing apparatus. It must be capable of processing all existing document data. For example, when one image processing apparatus does not support the data format (file format) of document data stored in another image processing apparatus, a list display of document data acquired from the other image processing apparatus, etc. There is also a problem that it is not possible to properly perform. In order to prevent this, it is conceivable that either one of the two image processing apparatuses is equipped with a function for converting into a file format that can be processed by one image processing apparatus. Each time a new format is added to the format, the conversion function must be updated, which reduces the convenience.

  The present invention has been made to solve the above-mentioned problems, and does not deteriorate operability when displaying document information stored in another image processing apparatus on an operation screen. An object of the present invention is to provide an image processing apparatus, an image processing system, and a screen display method capable of displaying document information without converting the file format even when the file format is not processable.

  In order to achieve the above object, the invention described in claim 1 is an image processing apparatus capable of communicating with another image processing apparatus via a network, a display means for displaying an operation screen related to a document, An operation detecting means for detecting an operation, and a document information stored in the other image processing apparatus based on an operation detected by the operation detecting means when the document information is displayed on the operation screen. Display control means for requesting a display image related to information and displaying the display image received from the other image processing device by being fitted in a part of the display area of the operation screen. .

  A second aspect of the present invention is the image processing apparatus according to the first aspect, further comprising communication means capable of communicating with an external terminal, wherein the display control means displays on the display means via the communication means. The operation screen is displayed on the external terminal by transmitting the operation screen to the external terminal.

  According to a third aspect of the present invention, in the image processing apparatus according to the first or second aspect, the display control unit is configured such that the operation detected by the operation detection unit is an operation on the partial display area. Operation information based on the operation is transmitted to the other image processing apparatus, a display image updated in the other image processing apparatus is acquired based on the operation information, and the display image is inserted into the display area and displayed. It is characterized by doing.

  According to a fourth aspect of the present invention, in the image processing apparatus according to the third aspect, the display control unit applies the operation detected by the operation detection unit to the display image in which the part of the display area is inserted. When the operation is to specify the included document file image, the operation information based on the operation is transmitted to the other image processing device, and the display screen updated to the state in which the document file image is specified is acquired. It is a feature.

  According to a fifth aspect of the present invention, in the image processing device according to any one of the first to fourth aspects, the display control unit is configured to operate the operation detected by the operation detection unit in a periphery other than the partial display area. When the operation is for the display area, the entire operation screen is updated based on the operation.

  According to a sixth aspect of the present invention, in the image processing apparatus according to the fifth aspect, the display control means is an operation for instructing a preview display of a document file image included in the display image when the operation on the peripheral display area is performed. If it is, it is determined whether or not the document corresponding to the document file image is in a predetermined file format. If the document file is not in the predetermined file format, the other image processing apparatus is made to preview the document corresponding to the document file image. An image is requested, and a preview image received from the other image processing apparatus is displayed by being fitted in a part of the display area of the operation screen.

  According to a seventh aspect of the present invention, in the image processing apparatus according to the sixth aspect, when the document is in the predetermined file format, the display control means adds the document file image to the other image processing apparatus. A corresponding document is requested, a preview image is generated based on the document received from the other image processing apparatus, and is displayed in a partial display area of the operation screen.

  According to an eighth aspect of the present invention, in the image processing apparatus according to the seventh aspect, the display control means adds at least one of a ground pattern and a stamp to the document when the document is in the predetermined file format. A preview image of the document is requested from the other image processing apparatus, and the preview image received from the other image processing apparatus is displayed in a part of the display area of the operation screen. It is what.

  A ninth aspect of the present invention is the image processing apparatus according to any one of the fifth to eighth aspects, further comprising job control means for controlling execution of a job relating to a document, wherein the display control means is the peripheral display. When the operation on the area is an operation for instructing a preview display of a document file image included in the display image, it is determined whether or not the job is being executed by the job control unit, and the job control unit If it is being executed, the other image processing device is requested to request a preview image of the document corresponding to the document file image, and the preview image received from the other image processing device is displayed in a part of the display area of the operation screen. It is characterized by being inserted and displayed.

  According to a tenth aspect of the present invention, in the image processing apparatus according to any one of the first to ninth aspects, the display control means displays document information stored in the other image processing apparatus on the operation screen. In this case, function information relating to document processing that can be executed in the other image processing apparatus is acquired, and an operation image is displayed in a peripheral display area other than the partial display area based on the function information, and the operation detection unit When the operation detected by the operation is an operation on the operation image, the operation information based on the operation is transmitted to the other image processing apparatus to cause the other image processing apparatus to execute the document processing, and In the image processing apparatus, an updated display image is acquired, and is inserted into the partial display area and displayed.

  According to an eleventh aspect of the present invention, in the image processing apparatus according to any one of the first to tenth aspects, when the display control means is requested by the other image processing apparatus to display a document image related to document information, A display image according to a request is generated and transmitted to the other image processing apparatus.

  The invention according to claim 12 is an image processing system in which the first and second image processing apparatuses can communicate with each other via a network, and the first image processing apparatus displays an operation screen related to a document. Means for detecting an operation on the operation screen, and displaying document information stored in the other image processing device on the operation screen based on an operation detected by the operation detection unit. First display control means for requesting a display image related to document information from another image processing device, wherein the second image processing device generates a display image in response to the request and performs the first image processing. Second display control means for transmitting to the apparatus, wherein the first display control means receives the display image transmitted by the second display control means, and displays the display image. It is characterized in that the display is fitted the image on a part of the display area of the operation window.

  The invention according to claim 13 is a screen display method for updating a display screen on a predetermined display means by communicating with another image processing apparatus via a network, and displays an operation screen related to a document on the display means. A step of detecting an operation on the operation screen; and displaying document information stored in the other image processing device based on the detected operation on the operation screen. A step of requesting a display image relating to document information, and displaying a display image received from the other image processing device by being fitted in a part of a display area of the operation screen.

  According to the present invention, when document information stored in another image processing device is displayed on the operation screen, a display image generated by the other image processing device is acquired, and the display image is a part of the operation screen. Because it is displayed in the display area, it is possible to display the setting contents set by the user before that, so there is no need to perform screen switching operation etc. Usability can be improved. In addition, since the display image that is displayed by being inserted into a part of the operation screen is generated by another image processing device, the document stored in the other image processing device is not in a file format that can be processed by the own device. Even if it exists, information about the document can be displayed.

1 is a diagram illustrating an example of the overall configuration of an image processing system according to an embodiment of the present invention. It is a figure which shows the structural example of the image processing apparatus in an image processing system. FIG. 11 is a process diagram illustrating a processing procedure of the own apparatus and another image processing apparatus when a document box of the other image processing apparatus is accessed from the own apparatus. It is a figure which shows an example of an operation screen. It is a figure which shows an example of an operation screen. (A) is a format example of request information, (b) is a diagram showing a format example of reply information. (A) is an example of an operation screen, (b) is a figure which shows an example of a display image. It is a figure which shows an example of an operation screen. It is a flowchart of a magnification adjustment process. It is a figure which shows the example of a format of operation information. It is a flowchart which shows a coordinate transformation process. It is a figure which shows an example of an operation screen. It is a flowchart which shows a display process when a preview button is operated by the login user. (A) is an example of the format of request information, (b) is a figure which shows an example of the format of reply information. (A) is an example of an operation screen, (b) is a figure which shows an example of the display image containing a preview image. It is a figure which shows an example of an operation screen. It is a flowchart which shows another display process when a preview button is operated by the login user. It is a figure which shows an example of the format of operation information. It is a figure which shows an example of an operation screen.

  Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the drawings. In addition, in embodiment described below, the same code | symbol is attached | subjected to the member which is mutually common, and the overlapping description about them is abbreviate | omitted.

  FIG. 1 is a diagram showing an example of the overall configuration of an image processing system 1 according to an embodiment of the present invention. As shown in FIG. 1, the image processing system 1 is configured such that a plurality of image processing apparatuses 2 (2 a to 2 c) can communicate with each other via a communication network 3. The communication network 3 is, for example, a LAN (Local Area Network) constructed in a general office. However, the communication network 3 is not limited to this, and may be a complex communication network including a wide area communication network such as a WAN (Wide Area Network). Further, it is sufficient that at least two image processing apparatuses 2 are prepared, and the number is not limited to the number illustrated.

  The image processing apparatus 2 is configured by an apparatus having a plurality of document processing functions such as an MFP. Examples of such document processing functions include a scan function, a print function, a facsimile function, and a box function. The scan function is a function for reading a document and generating a document file. The print function is a function for performing print output based on a document file designated by the user. The facsimile function is a function for transmitting a document file by facsimile or acquiring a document file by facsimile reception. Further, the box function is a function for storing a document file. The image processing apparatus 2 executes a job designated by the user, such as a scan job or a print job, by operating each of the above functions alone or in combination.

  The file formats (data formats) of the document files that can be processed by each of the plurality of image processing apparatuses 2a, 2b, and 2c may be different from each other. The document processing functions installed in each of the plurality of image processing apparatuses 2a, 2b, and 2c may be different from each other.

  Each image processing apparatus 2 includes a storage unit 25 (see FIG. 2) that stores a document file. The storage unit 25 is provided with a document box that is a storage area for storing a document file. The document box is provided for each user, for example, and identification information (user ID and password) of each user is set. Therefore, when each user logs in to each image processing apparatus 2 by inputting his / her identification information, the user can access his / her own document box provided in each image processing apparatus 2. You can also access stored document files.

  Each image processing apparatus 2 can acquire information on document files in a document box in another image processing apparatus 2 through communication via the communication network 3 and display a list of document files, for example. It has become.

  Further, as shown in FIG. 1, the image processing apparatuses 2 can communicate with an external terminal 9 such as a smartphone or a tablet terminal by short-range wireless communication or the like. Each image processing apparatus 2 can display the operation screen on the display unit 9 a of the external terminal 9 by transmitting the operation screen to be displayed on the own apparatus to the external terminal 9.

  FIG. 2 is a diagram illustrating a configuration example of the image processing apparatus 2. As shown in FIG. 2, the image processing apparatus 2 includes an image reading unit 21, an image forming unit 22, and an operation panel 23. Further, the image processing device 2 communicates with other image processing devices via the communication network 3 or communicates with the external terminal 9 by short-range wireless communication or the like. 24, a storage unit 25 composed of nonvolatile storage means such as a hard disk drive (HDD) or a solid state drive (SSD), and a control unit 26 having a CPU and a memory. The image processing apparatus 2 is configured such that these components 21 to 26 can input / output data to / from each other via the data bus DB.

  The operation panel 23 includes a display unit 231 and an operation unit 232. The display unit 231 is configured by a color liquid crystal display, for example, and displays various types of information to the user who operates the operation panel 23. The operation unit 232 includes various push button keys arranged adjacent to the display unit 231, a touch panel sensor arranged on the display screen of the display unit 231, and the like, and receives operation input from the user of the image processing apparatus 2. With this configuration, the operation panel 23 can display various operation screens such as an operation screen related to a document file on the display unit 231 and accept various operation inputs from the user.

  The control part 26 controls operation | movement of each part, when CPU runs the program memorize | stored in memory. In this embodiment, the control unit 26 functions as a job control unit 261, an operation detection unit 262, and a display control unit 263 when the CPU executes a program.

  The job control unit 261 controls execution of a job designated by the user. For example, in the case of a print job, the job control unit 261 controls the execution of the print job by controlling the operation of the image forming unit 22 based on a document file designated by the user. The operation detection unit 262 detects an operation on the operation screen of the display unit 231 based on the operation signal output from the operation unit 232.

  The display control unit 263 performs display control of various operation screens displayed on the display unit 231. For example, the display control unit 263 displays on the display unit 231 an operation screen for a user to perform a job setting operation, an operation screen for a document file for the user to specify a document file, and the like. In addition, when the operation detection unit 262 detects a user operation on the operation screen while displaying the operation screen, the display control unit 263 displays the operation screen displayed on the display unit 231 based on the operation. Update.

  In addition, the display control unit 263 transmits various operation screens generated to be displayed on the display unit 231 of the operation panel 23 to the external terminal 9 via the communication interface unit 24, so that those operation screens are displayed on the external terminal 9. Can be displayed on the display unit 9a. When an operation by the user is performed on the external terminal 9 while those operation screens are displayed on the external terminal 9, the display control unit 263 acquires the operation information from the external terminal 9, and based on the operation information The operation screen displayed on the external terminal 9 is updated. Therefore, the user can use the image processing apparatus 2 by performing an operation on the operation panel 23 and can operate the image processing apparatus at a position relatively distant from the image processing apparatus 2 by operating the external terminal 9. It is also possible to use 2.

  In particular, the display control unit 263 of the present embodiment is in a state where a user is logged in to the image processing apparatus 2 and displays an operation screen related to a document such as a document box or a document file accessible by the user via the communication network 3. By communicating with another image processing apparatus, a document box, a document file, and the like accessible by the user in the other image processing apparatus can be displayed on the operation screen.

  Further, when the operation detecting unit 262 detects an operation for designating one document box from the document boxes displayed on such an operation screen, the display control unit 263 is stored in the designated document box. Updates to the operation screen that displays information about the document file. At this time, if the document box of another image processing apparatus 2 is designated by the user, the display control unit 263 updates the operation screen by communicating with another image processing apparatus via the communication network 3. Information is acquired from another image processing apparatus.

  The display control unit 263 displays information about the document file on a part of the operation screen when displaying information about the document file stored in the one document box designated by the user on the operation screen. A display area is provided. Such a display area is set as a part of the center of the operation screen, for example, and is used as an area for displaying various display images related to document information such as thumbnail images (document file images) and preview images of document files. . For example, when the document box designated by the user exists in another image processing apparatus 2 and the document file stored in the document box is not in a file format that can be processed by the own device, The other image processing apparatus 2 having the document box is requested to create a display image to be displayed in the display area. When the display control unit 263 receives a display image from another image processing apparatus 2, the display control unit 263 fits and displays the received display image in a part of the display area of the operation screen displayed on the display unit 231. Hereinafter, a specific operation in the image processing system 1 will be described. In the following, the screen control of the operation screen displayed on the display unit 231 of the operation panel 23 will be mainly described as an example, but the image processing apparatus 2 is used by the user operating the external terminal 9. In this case, an operation screen similar to the operation screen described below is displayed on the display unit 9a of the external terminal 9.

  FIG. 3 is a process diagram showing an example of the processing procedure of the image processing apparatuses 2a and 2b when accessing the document box of the other image processing apparatus 2b from one image processing apparatus 2a. 3 and the subsequent drawings, the document box is represented as “BOX”.

  As shown in FIG. 3, when the user logs in using his / her identification information in the image processing apparatus 2a (process P1), the display control unit 263 displays an operation screen G1 corresponding to the login user as shown in FIG. It is displayed on the display unit 231. The operation screen G1 is provided with a “BOX” button B1. When the logged-in user operates the “BOX” button B1 (process P2), the display control unit 263 is connected via the communication network 3. The information about the document box accessible by the login user is requested to the other image processing apparatus 2b. At this time, the display control unit 263 may request information regarding a document box accessible to the login user from another image processing apparatus 2c.

  The other image processing apparatus 2b, which requests information related to the document box accessible to the login user from the image processing apparatus 2a, searches whether or not the document box accessible to the login user is stored in the own apparatus (process P3). ). In parallel with this, the document box accessible by the login user is also searched for in the one image processing apparatus 2a (process P4). Here, it is assumed that the document box “BOX1” corresponding to the login user exists in the image processing apparatus 2a and the document box “BOX2” exists in the image processing apparatus 2b.

  When the image processing apparatus 2b detects that the document box “BOX2” accessible to the login user is present in the image processing apparatus 2b, the image processing apparatus 2b transmits information regarding the document box “BOX2” to the image processing apparatus 2a. As a result, the image processing apparatus 2a receives information related to the document box “BOX2” from the image processing apparatus 2b. Further, the image processing apparatus 2a detects that the document box “BOX1” accessible to the login user exists in the image processing apparatus 2a.

  Thereafter, the image processing apparatus 2a and the image processing apparatus 2b exchange function information. By exchanging the function information, the image processing apparatus 2b notifies the image processing apparatus 2a of the function information related to the document processing function installed in the image processing apparatus 2b. It is possible to grasp the document processing functions that can be executed at the same time.

  The display control unit 263 of the image processing apparatus 2a displays information on the document box “BOX2” accessible to the login user existing in the image processing apparatus 2b on the display unit 231 after exchanging the function information with the image processing apparatus 2b. At the same time, the operation screen is updated by displaying on the display unit 231 information related to the document box “BOX1” accessible to the login user existing in the own device (process P5). An example of the operation screen G2 displayed on the display unit 231 at this time is shown in FIG.

  As shown in FIG. 5, the operation screen G2 displays an icon indicating the document box “BOX1” present in the own apparatus and an icon indicating the document box “BOX2” present in the image processing apparatus 2b. The operation screen G2 has a screen configuration in which operation buttons B2 to B4 corresponding to document processing functions that can be executed in the image processing apparatus 2b are newly provided with respect to the operation screen G1 shown in FIG. These operation buttons B2 to B4 are buttons that are additionally displayed when a function that can be executed in the image processing apparatus 2b is specified by exchanging the function information described above. When the operation buttons B2 to B4 corresponding to the document processing functions that can be executed in the image processing apparatus 2b are added and displayed on the operation screen G2, the document processing functions that can be executed in the image processing apparatus 2a are excluded, and the image processing is performed. Only operation buttons corresponding to document processing functions that can be executed only in the apparatus 2b may be displayed.

  In the operation screen G2 shown in FIG. 5, the display state of the “BOX” button B1 displayed on the previous operation screen G1 is continued. Therefore, even when the user operates the “BOX” button B1 again after the operation screen G1 is updated to the operation screen G2, there is no need to return the operation screen G2 to the previous operation screen G1, and the operability is improved. .

  In such an operation screen G2, when an operation for designating the document box “BOX2” existing in the image processing apparatus 2b is performed by the login user as indicated by an arrow A (process P6), the display control unit 263 A display image related to the document file of the designated document box “BOX2” is requested to the image processing apparatus 2b. A format example of the request information is shown in FIG.

  As shown in FIG. 6A, the request information includes information such as the name of the document box in order to specify the document box that is a request target of the display image related to the document file. The request information includes information for designating the image width and the image height in order to designate the image size of the display image relating to the document file. In the example shown in FIG. 6A, a display image for displaying information related to the document file stored in the document box “BOX2” is an image having a display size of width 500 (pixel) and height 200 (pixel). The request information is requested to the processing device 2b.

  When the display control unit 263 of the image processing device 2b is requested to display the document file in the document box “BOX2”, the display control unit 263 generates a thumbnail image based on the document file stored in the document box “BOX2”. By generating a bitmap image in which the thumbnail images are arranged, a display image to be returned to the image processing apparatus 2a is created (process P7). At this time, the display control unit 263 of the image processing device 2b generates a display image having a size specified by the image processing device 2a. However, depending on the display image generation function implemented in the display control unit 263 of the image processing device 2b, there may be a case where a display image having a size specified by the image processing device 2a cannot be generated. In such a case, the display control unit 263 of the image processing device 2b generates a display image having a size that does not match the size specified by the image processing device 2a. An example of the display image GH1 generated in this way is shown in FIG. The display image GH1 illustrated in FIG. 7B is an image indicating that two document files exist in the document box “BOX2”, and includes thumbnail images L1 and L2 corresponding to the two document files, respectively. . In other words, the display control unit 263 of the image processing apparatus 2b reads the two document files stored in the document box “BOX2”, generates respective thumbnail images, and converts them into bitmaps. A display image GH1 as shown in FIG. Then, the display control unit 263 of the image processing device 2b transmits the display image GH1 generated as described above to the image processing device 2a. At this time, the display control unit 263 of the image processing device 2b transmits, together with the display image GH1, reply information regarding the display image GH1 to the image processing device 2a. A format example of the reply information is shown in FIG.

  As shown in FIG. 6B, the reply information includes the name of the document box corresponding to the display image GH1, the width and height of the display image GH1, the data amount of the display image GH1, and the document existing in the document box “BOX2”. This is information composed of items of the number of files, the file format of each document file, and information (additional information) added to each document file. In the example shown in FIG. 6B, the display image GH1 related to the document file of the document box “BOX2” is created with an image size of width 500 (pixel) and height 200 (pixel), and the display image GH1. This indicates that the amount of data is “1024 (Kbyte)”. The number of document files stored in the document box “BOX2” is two, one is a PDF document file with a tint block and a stamp added, and the other is a JPEG format without additional information. Indicates that this is a document file. By transmitting such reply information together with the display image GH1, the image processing apparatus 2a can grasp the file format of the document file stored in the document box designated by the login user. .

  When receiving the display image GH1 related to the document file and the reply information related to the display image GH1 from the image processing apparatus 2b, the image processing apparatus 2a temporarily stores the reply information in a memory or the like. Then, the image processing device 2a displays the display image GH1 received from the image processing device 2b by fitting it into a part of the display area of the operation screen. FIG. 7A shows the display area R of the display image GH1 set in a part of the operation screen G3. The display area R is configured with a size of, for example, a width of 500 (pixels) and a height of 200 (pixels). In the following, a part of the display area R shown in FIG.

  The display control unit 263 of the image processing device 2a inserts the display image GH1 of FIG. 7B generated by the other image processing device 2b into the insertion region R shown in FIG. 8 is generated, and the operation screen G4 is displayed on the display unit 231 (process P8). As a result, the operation screen displayed on the operation panel 23 of the image processing apparatus 2a is updated from the operation screen G2 in FIG. 5 to the operation screen G4 in FIG.

  As described above, in the present embodiment, when a user operating one image processing apparatus 2a specifies a document box provided in another image processing apparatus 2b, the document stored in the document box is stored. Since the display screen GH1 relating to the file is created by the other image processing device 2b, it is not necessary to generate the display image GH1 in the one image processing device 2a. Even if the document file stored in the document box of the other image processing apparatus 2b is not in a file format that can be processed by the one image processing apparatus 2a, the document file is stored in the one image processing apparatus 2a. The corresponding thumbnail image can be displayed normally.

  Further, the display image GH1 created by the other image processing device 2b is not displayed on the entire operation screen G4 displayed on the display unit 231 but is displayed on a part of the fitting region R of the operation screen G4. The As a result, in the area other than the insertion area R in the operation screen G4 shown in FIG. 8, the “BOX” button B1 displayed on the previous operation screen G2 or the document processing function that can be executed in the image processing apparatus 2b. The display state of the corresponding operation buttons B2 to B4 can be continued. Therefore, even when the user operates the buttons B1 to B4 after the operation screen G2 is updated to the operation screen G4, it is not necessary to return the operation screen G4 to the previous operation screen G2, and the operation is performed as it is. This improves operability.

  If the user has performed a job setting operation or the like before that, the job set by the user before that in the peripheral display area excluding the insertion area R in which the display image GH1 is inserted is displayed. It is also possible to display the setting contents. This eliminates the need for the user to perform a screen switching operation or the like in order to confirm the setting contents, and the operability is improved in this respect as well.

  Here, the image size of the display image GH1 received by the image processing device 2a from the image processing device 2b may not necessarily match the size of the fitting region R. In such a case, the display control unit 263 of the image processing apparatus 2a is configured to perform the following magnification adjustment processing. FIG. 9 is a flowchart of the magnification adjustment process.

  As shown in FIG. 9, the display control unit 263 first acquires the image size (area) from the width and height of the display image GH1 received from the image processing device 2b (step S21). For example, the display control unit 263 may acquire the image size by extracting the image width and the image height from the return information received together with the display image GH1. However, the present invention is not limited to this, and the image size may be acquired by analyzing the display image GH1. Then, the display control unit 263 calculates a size ratio, that is, a magnification, between the size of the fitting region R and the image size of the display image GH1 received from the image processing device 2b (step S22). For example, the magnification is calculated by dividing the image size of the display image GH1 by the size of the fitting region R.

  Next, the display control unit 263 determines whether or not the calculated magnification is 100 (%) (step S23). If the calculated magnification is not 100 (%) (NO in step S23), the display control unit 263 determines whether or not the calculated magnification is greater than 100 (%) (step S24). When the calculated magnification is larger than 100 (%) (YES in step S24), the display control unit 263 calculates the magnification in the width direction and the magnification in the height direction so as not to protrude from the fitting region R. The display image GH1 is reduced so that the larger one of these magnifications becomes 100 (%) (step S25). On the other hand, when the calculated magnification is smaller than 100 (%) (NO in step S24), the display control unit 263 does not protrude from the fitting region R, and the larger one of the magnifications in the width direction and the height direction is used. The display image GH1 is enlarged so that the magnification is 100 (%) (step S26). After the process of step S25 or S26, the display control unit 263 fits the display image GH1 whose magnification has been adjusted into the fitting region R (step S27).

  When the calculated magnification is 100 (%) (YES in step S23), the display control unit 263 skips steps S24 to S26 and performs step S27.

  When the operation screen G4 generated in this way is displayed, when the user performs an operation on the inside of the fitting region R (process P9), the display control unit 263 displays the operation information as the image processing device 2b. Send to. A format example of the operation information is shown in FIG.

  As illustrated in FIG. 10, the operation information includes notification contents and information regarding the X coordinate and the Y coordinate indicating the operation position. The notification content is information indicating the operation content performed by the user. The X coordinate and the Y coordinate are information indicating the operation position performed by the user with respect to the display image GH1 displayed in the fitting region R. For example, XY2 defined with the upper left corner of the display image GH1 as the origin. Coordinates expressed in a dimensional coordinate system. The coordinates are calculated by performing a coordinate conversion process as shown in FIG. FIG. 11 is a flowchart showing the coordinate conversion process.

  As illustrated in FIG. 11, when the display control unit 263 acquires the coordinates touched by the user from the operation detection unit 262 (step S31), the display control unit 263 determines whether or not the touch position is within the fitting region R ( Step S32). When the display control unit 263 determines that the touch position is in the fitting region R (YES in step S32), the display control unit 263 converts the touch position to a coordinate value based on the XY two-dimensional coordinate system defined in the fitting region R. Conversion is performed (step S33).

  Next, the display control unit 263 determines whether or not the magnification adjustment (enlargement / reduction) of the display image GH1 has been performed when the display image GH1 is fitted into the fitting region R as described above (step S34). When the magnification adjustment is performed (YES in step S34), the display control unit 263 uses the adjustment magnification to convert the coordinate value calculated in step S33 into a display image (image processing before the magnification adjustment). The coordinates in the display image received from the device 2b are converted (step S35). The coordinates are coordinates indicating the position touched by the user in the display image transmitted from the image processing apparatus 2b to the image processing apparatus 2a. In the example of FIG. 10, the coordinates obtained by such coordinate conversion processing are (X, Y) = (50, 40). Then, the display control unit 263 transmits operation information including the coordinates to the image processing device 2a (step S36).

  Returning to FIG. 3, the image processing apparatus 2 b that has received the operation information specifies the document file designated by the user in the display image GH 1 based on the coordinates of the operation information. Then, the display control unit 263 of the image processing device 2b creates a new display image GH2 that can visually distinguish the designated document file from the other document files, and uses the new display image GH2 as the image processing device 2a. (Process P10).

  Then, the display control unit 263 of the image processing device 2a updates the operation screen by inserting and displaying the new display image GH2 received from the image processing device 2b in the fitting region R while appropriately adjusting the magnification (process). P11). FIG. 12 shows an example of the operation screen G5 at this time. In the operation screen G5 shown in FIG. 12, a display image GH2 in which a thumbnail image L1 corresponding to a document file designated by the user is colored in a predetermined color, for example, is displayed in the fitting region R. Thereby, the login user can confirm that the document file designated by himself / herself is designated.

  In addition, the display image GH2 created by the other image processing device 2b is not displayed on the entire operation screen G5 displayed on the display unit 231, but a part of the operation screen G5, as with the display image GH1 described above. Is displayed in a state of being fitted in the fitting region R. As a result, in a region other than the insertion region R of the operation screen G5 shown in FIG. 12, the “BOX” button B1 displayed on the previous operation screen G4 and the document processing function that can be executed in the image processing device 2b are added. The display state of the corresponding operation buttons B2 to B4 can be continued. Therefore, even when the user operates the buttons B1 to B4 after the operation screen G4 is updated to the operation screen G5, it is not necessary to return the operation screen G5 to the previous operation screen G4, and the operation is performed as it is. This improves operability.

  Also in this operation screen G5, if the user has performed a job setting operation or the like before that, with respect to the surrounding display areas excluding the fitting area R into which the display image GH2 has been fitted, It is also possible to display job settings set by the user. This eliminates the need for the user to perform a screen switching operation or the like in order to check the setting contents, thereby improving operability.

  Next, display processing when an operation is performed on the peripheral display area other than the fitting area R in the operation screen G5 displayed in the process P11 will be described. Here, a preview button B2 (see FIG. 12) for instructing to display a preview image of the document file is displayed in the peripheral display area, and the case where the preview button B2 is operated by the login user is exemplified. FIG. 13 is a flowchart showing display processing when this operation is performed.

  As shown in FIG. 13, when the peripheral display area is operated by the logged-in user (process P41), the display control unit 263 of the image processing apparatus 2a determines whether or not the image processing apparatus 2b should be requested to create a preview image. Processing for determination is performed (process P42). For example, when the preview function designated by the user is not installed in the image processing apparatus 2a and is a function that can be executed only in the image processing apparatus 2b, or the preview function is installed in the image processing apparatus 2a. When the document file specified by the user is a document file in a file format that cannot generate a preview image in the image processing apparatus 2a, the display control unit 263 requests the image processing apparatus 2b to create a preview image. Judge that it should be. In addition, for example, when at least one of a tint block and a stamp is added to a document file designated by the user, or when the image processing apparatus 2a is in a job execution state, the display control unit 263 Determines that the image processing apparatus 2b should be requested to create a preview image.

  Here, when at least one of a background pattern and a stamp is added to the document file, the image processing apparatus 2b should be requested to create a preview image. This is because the image processing apparatus 2a cannot create a preview image in which a copy-forgery-inhibited pattern or a stamp is added to the document because it is not transferred to the processing apparatus 2a but is held only in the image processing apparatus 2b. Therefore, even if the document file designated by the user is a document file in a file format that can generate a preview image in the image processing apparatus 2a, the display control unit 263 includes at least a copy-forgery-inhibited pattern and a stamp in the document file. If one of them is added, it is determined that the image processing apparatus 2b should be requested to create a preview image.

  In addition, when the image processing apparatus 2a is in a job execution state, the image processing apparatus 2b should be requested to create a preview image because the processing capability of the job being executed decreases due to the creation of the preview image. This is to avoid the problem.

  When the display control unit 263 determines that the image processing apparatus 2b should be requested to create a preview image, the display control unit 263 transmits operation information for the peripheral display area to the image processing apparatus 2b as illustrated in FIG. That is, the display control unit 263 transmits operation information indicating that the preview button B2 has been operated to the image processing apparatus 2b, so that a preview for fitting in the fitting region R provided in a part of the operation screen is displayed. A display image including the image is requested to the image processing apparatus 2b. An example of the format of the operation information transmitted at this time is shown in FIG.

  As shown in FIG. 14A, the operation information includes information regarding notification contents and instruction contents. The operation information illustrated in FIG. 14A is information indicating that a “touch operation” is requested to create a display image including a preview image.

  Based on this operation information, the display control unit 263 of the image processing device 2b generates a preview image based on the document file designated by the login user, and further generates a display image including the preview image. Then, the display control unit 263 of the image processing device 2b generates a display image GH3 that can be displayed by the image processing device 2a by converting the display image including the preview image into a bitmap. Then, the display control unit 263 of the image processing device 2b transmits the display image GH3 including the preview image that can be displayed by the image processing device 2a to the image processing device 2a (process P43). At this time, the display control unit 263 of the image processing apparatus 2b transmits the return information regarding the display image GH3 together with the display image GH3 to the image processing apparatus 2a. An example of the format of this reply information is shown in FIG.

  As shown in FIG. 14B, the reply information includes information regarding the update type, the image type, the width and height of the display area, and the data amount of the display image. The update type indicates whether the update is for only the insertion region R (image update) or the entire operation screen (screen update). When an operation is performed on the peripheral display region Then, the entire operation screen is updated (screen update). The image type indicates the type of image to be displayed in the insertion region R. The display area width, height, and data amount are the same as those shown in FIG.

  In the reply information shown in FIG. 14B, the preview image of the currently specified document file and the display image GH3 including the preview image have a width of 600 (pixels), a height of 400 (pixels), and a data amount of 1024. (Kbyte). An example of the display image GH3 including the preview image is shown in FIG. In this display image GH3, a preview image of the document file is included in the left part of the entire image. In the right part of the display image GH3, for example, attached information such as the file name, file format, creation date, creator, total number of pages, and previewed page of the document file to be previewed is displayed. become.

  On the other hand, the display control unit 263 of the image processing apparatus 2a updates the entire operation screen in parallel with the process of creating the display image GH3 in the image processing apparatus 2b (process P44). FIG. 15A shows an example of the updated operation screen G6. The operation screen G6 shown in FIG. 15A has a screen configuration in which a fitting area R for fitting a display image GH3 including a preview image created in the image processing device 2b is provided in a part of the display area. It becomes.

  Further, the operation screen G6 continuously displays the “BOX” button B1 displayed on the previous operation screen G5 and the operation buttons B2 to B4 corresponding to the document processing functions that can be executed in the image processing apparatus 2b. In addition, operation buttons B5 to B7 relating to the display of the preview image are newly added. For example, the operation button B5 is a button for instructing enlargement display of the preview image displayed in the insertion region R, the operation button B6 is a button for instructing reduction display of the preview image, and the operation button B7 is page switching of the preview image. It is a button for instructing. However, buttons other than those described above may be added and displayed.

  When the image processing device 2a receives the display image GH3 and the reply information related to the display image GH3, the display control unit 263 displays the display image GH3 on the operation screen G6 after the update as shown in FIG. The operation screen in which the display image GH3 is inserted is displayed on the display unit 231 (process P46). FIG. 16 shows an operation screen G7 in which the display image GH3 received from the image processing device 2b is fitted in the fitting region R. Thus, since the preview image generated by the image processing device 2b is displayed on the operation screen G7, even if the document file selected by the logged-in user is a file for which a preview image cannot be created by the image processing device 2a. A preview image corresponding to the file can be displayed. In addition, the display image GH3 created by the other image processing device 2b is not displayed on the entire operation screen G7 displayed on the display unit 231 like the above-described display images GH1 and GH2, but on the operation screen G7. Since it is displayed in a part of the insertion region R, the buttons displayed from before are continuously displayed on the surrounding display region excluding the insertion region R, or the user can The settings of the set job can be displayed, improving operability.

  On the other hand, if the display control unit 263 determines that the image processing apparatus 2a creates a preview image, the display control unit 263 performs the following display processing. FIG. 17 is a flowchart showing display processing in this case.

  As shown in FIG. 17, when the peripheral display area is operated by the login user (process P51) and the display control unit 263 determines that it is not necessary to request the image processing device 2b to create a preview image (process P52), Operation information based on an operation performed on the peripheral display area is transmitted to the image processing apparatus 2b, and a document file is requested from the other image processing apparatus 2b. An example of the format of this operation information is shown in FIG. The operation information shown in FIG. 18 includes information on the request type and the document name. The request type includes information requesting acquisition of the document file, and the document name includes the file name of the document to be acquired. The request information shown in FIG. 18 indicates that a document file “document 2” is requested.

  Upon receiving this operation information, the image processing device 2b reads out the document file of the document 2 from the document box in the storage unit 25 based on the operation information and transmits it to the image processing device 2a (process P53).

  On the other hand, the display control unit 263 of the image processing apparatus 2a updates the entire operation screen in parallel with the request for the document file (process P54). The updated operation screen is the same as the operation screen (see FIG. 15A) when a preview image creation request is sent to the image processing apparatus 2b. However, the fitting region R may not be set in particular.

  Further, when receiving the document file from the image processing apparatus 2b, the display control unit 263 of the image processing apparatus 2a creates a preview image based on the received document file (process P55). For example, as shown in FIG. 19, the display control unit 263 displays an operation screen G8 obtained by combining the preview image PV with the operation screen G6 on the display unit 231 (step S56). In the example of FIG. 19, the preview image PV is not inserted into the insertion region R, but the preview image PV is arranged at a relatively large size in the center of the operation screen G8. It is not limited to. For example, the preview image PV generated by the image processing device 2a may be fitted into the fitting region R to have the same screen configuration as that in FIG.

  As described above, when the image processing apparatus 2a according to the present embodiment displays the document information of the document stored in the other image processing apparatus 2b on the operation screen, the image processing apparatus 2a relates to the document information on the other image processing apparatus 2b. It has a function of requesting a display image and displaying a display image received from another image processing device 2b by fitting it in the fitting region R of the operation screen. On the other hand, when a display image related to document information is requested from another image processing device 2a, the image processing device 2b has a function of generating a display image corresponding to the request and transmitting it to the other image processing device 2a. ing. According to such a configuration, when one image processing apparatus 2a displays the document information stored in the other image processing apparatus 2b on the operation screen, the operation button displayed on the operation screen until then is displayed. Since the setting contents of the job and the job can be arranged and displayed in an area other than the fitting area R, the number of times the user performs the screen switching operation can be reduced. Even if the file format of the document stored in the other image processing device 2b is not a file format that can be processed by the image processing device 2a, the image processing device 2a displays the document information of the document on the operation screen. And there is no need to convert the file format. Therefore, it is possible to improve convenience when displaying on the operation screen related to the document information stored in the other image processing apparatus 2b.

  Further, when the user performs an operation on the fitting region R in which the display image generated by the other image processing device 2b is displayed, the image processing device 2a transmits the operation information based on the operation to the other By transmitting the image to the image processing device 2b, the display image updated in the other image processing device 2 is further acquired, and is inserted into the fitting region R and displayed. Therefore, the image processing device 2a can insert the insertion area based on the operation by the user even when the file format of the document stored in the other image processing device 2b is not a file format that can be processed by the image processing device 2a. It is possible to sequentially update the display image that is inserted into R and displayed.

  In addition, when an operation for designating a document file included in a display image inserted in the insertion region R is performed, the image processing device 2a transmits operation information based on the operation to the other image processing device 2b. Thus, a display screen showing a state in which the document file is designated is acquired from the other image processing apparatus 2b, and the display image is inserted into the insertion region R and displayed. As a result, the user can visually recognize a display screen indicating a state in which the document file is designated.

  Further, when the user performs an operation on the peripheral display region other than the fitting region R, the image processing device 2a updates the entire operation screen based on the operation. As a result, an operation screen corresponding to the function designated by the user can be displayed while displaying the display image in the fitting region R.

  Further, the image processing apparatus 2a may create a preview image in a situation or environment where the preview image can be created by itself. In this case, it is possible to make the user visually recognize the preview image earlier than requesting the other image processing apparatus 2b to create a preview image.

  Further, when displaying the document information stored in the other image processing apparatus 2b on the operation screen, the image processing apparatus 2a acquires function information related to document processing that can be executed in the other image processing apparatus 2, and the function Based on the information, an image such as an operation button is displayed in a peripheral display area other than the insertion area R. When an operation on the image such as the operation button is performed, the image processing device 2a transmits operation information based on the operation to the other image processing device 2b, and causes the other image processing device 2b to execute document processing. At the same time, the display image updated in the other image processing device 2b is acquired and is inserted into the insertion region R and displayed. With respect to such a configuration, in the above-described embodiment, the case where the image processing apparatus 2a causes the other image processing apparatus 2b to execute the preview image generation process is illustrated, but the present invention is not limited thereto. For example, the image processing apparatus 2a may cause the other image processing apparatus 2b to perform character recognition processing such as OCR (Optical Character Reader) and acquire and display a display screen related to the recognition result. Alternatively, the image processing device 2a may cause the other image processing device 2b to execute automatic translation processing to acquire and display a display screen related to the processing result. According to such a configuration, even if the image processing apparatus 2a has a function that the image processing apparatus 2a does not have, the image processing apparatus 2a can process the other image processing apparatus 2b as long as the function is included in the other image processing apparatus 2b. The processing result can be displayed on the operation image.

  As mentioned above, although one Embodiment regarding this invention was described, this invention is not limited to the content of one Embodiment mentioned above.

  For example, in the above embodiment, when displaying a list of document boxes accessible to the login user in the image processing apparatus 2a, the image processing apparatus 2a uses FIG. 5 based on information about the document boxes acquired from the other image processing apparatus 2b. The example in which the entire operation screen G2 shown is created and displayed on the display unit 231 has been described. However, it is not limited to this. Since the document box is for storing a document file, information about the document box is also one of the document information. Therefore, when the image processing apparatus 2a displays a list of document boxes provided in the other image processing apparatus 2b, it requests the other image processing apparatus 2b to create a display image, and the other image processing apparatus 2b sends a document. You may make it acquire the display image regarding the list display of a box. In this case, the display control unit 263 of the image processing apparatus 2a inserts the display image related to the list display of the document box acquired from the other image processing apparatus 2b into a partial display area (insertion area) R of the operation screen. Can be displayed.

  In the above embodiment, the case where the image processing apparatus 2 is configured by an apparatus having a plurality of document processing functions such as an MFP is illustrated. However, the image processing apparatus of the present invention is not limited to such an apparatus. For example, a printer having only a print function may be used. The image processing apparatus of the present invention may be configured by a general personal computer (PC).

DESCRIPTION OF SYMBOLS 1 Image processing system 2 (2a, 2b, 2c) Image processing apparatus 24 Communication interface part (communication means)
231 display unit (display means)
261 Job control unit (job control means)
262 Operation detection unit (operation detection means)
263 Display control unit (display control means, first display control means, second display control means)
R Insertion area (partial display area)

Claims (13)

An image processing apparatus capable of communicating with another image processing apparatus via a network,
Display means for displaying an operation screen related to a document;
Operation detecting means for detecting an operation on the operation screen;
When displaying the document information stored in the other image processing device on the operation screen based on the operation detected by the operation detection means, the display image related to the document information is requested to the other image processing device, Display control means for fitting and displaying a display image received from another image processing device in a part of the display area of the operation screen;
An image processing apparatus comprising: A communication means capable of communicating with an external terminal;
The display control means causes the external terminal to display the operation screen by transmitting the operation screen to be displayed on the display means to the external terminal via the communication means. An image processing apparatus according to 1.   When the operation detected by the operation detection unit is an operation for the partial display area, the display control unit transmits operation information based on the operation to the other image processing device, and based on the operation information The image processing apparatus according to claim 1, wherein the display image updated in the other image processing apparatus is acquired, and is displayed by being fitted in the partial display area.   When the operation detected by the operation detection unit is an operation for designating a document file image included in the display image inserted in the partial display area, the display control unit displays operation information based on the operation. The image processing apparatus according to claim 3, wherein the image processing apparatus transmits to the other image processing apparatus and acquires a display screen updated to a state in which the document file image is designated.   The display control means updates the entire operation screen based on the operation when the operation detected by the operation detection means is an operation for a peripheral display area other than the partial display area. The image processing apparatus according to claim 1.   The display control means determines whether the document corresponding to the document file image has a predetermined file format when the operation on the peripheral display area is an operation to instruct a preview display of the document file image included in the display image. If it is not a predetermined file format, the other image processing device is requested to receive a preview image of the document corresponding to the document file image, and the preview image received from the other image processing device is displayed on the operation screen. The image processing apparatus according to claim 5, wherein the image processing apparatus is displayed by being fitted in a part of the display area.   When the document is in the predetermined file format, the display control unit requests the document corresponding to the document file image from the other image processing apparatus, and based on the document received from the other image processing apparatus The image processing apparatus according to claim 6, wherein a preview image is generated and displayed in a partial display area of the operation screen.   The display control unit requests a preview image of the document from the other image processing device when at least one of a tint block and a stamp is added to the document when the document is in the predetermined file format. The image processing apparatus according to claim 7, wherein a preview image received from the other image processing apparatus is displayed by being fitted in a part of a display area of the operation screen. Job control means for controlling the execution of a job relating to a document;
Further comprising
The display control unit determines whether or not a job is being executed by the job control unit when the operation on the peripheral display area is an operation to instruct a preview display of a document file image included in the display image. When the job is being executed by the job control means, the other image processing apparatus is requested to request a preview image of the document corresponding to the document file image, and the preview image received from the other image processing apparatus is The image processing apparatus according to claim 5, wherein the image processing apparatus is displayed by being fitted in a part of a display area of the operation screen.   The display control means acquires function information related to document processing that can be executed in the other image processing apparatus when displaying the document information stored in the other image processing apparatus on the operation screen, and the function information When an operation image is displayed in a peripheral display area other than the part of the display area and the operation detected by the operation detection means is an operation on the operation image, the operation information based on the operation is Transmit to an image processing apparatus to cause the other image processing apparatus to execute the document processing, acquire an updated display image in the other image processing apparatus, and display the image by fitting into the partial display area The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus.   The display control means, when a display image related to document information is requested from the other image processing apparatus, generates a display image corresponding to the request and transmits the display image to the other image processing apparatus. Item 11. The image processing apparatus according to any one of Items 1 to 10. An image processing system in which the first and second image processing apparatuses can communicate with each other via a network,
The first image processing apparatus includes:
Display means for displaying an operation screen related to a document;
Operation detecting means for detecting an operation on the operation screen;
When displaying the document information stored in the other image processing apparatus on the operation screen based on the operation detected by the operation detecting means, a first request for a display image related to the document information is made to the other image processing apparatus. Display control means,
The second image processing apparatus includes:
A second display control means for generating a display image in response to the request and transmitting the generated display image to the first image processing apparatus;
The first display control means includes
An image processing system that receives a display image transmitted by the second display control means, and displays the display image by fitting it into a partial display area of the operation screen. A screen display method for updating a display screen in a predetermined display means by communicating with another image processing apparatus via a network,
Displaying an operation screen related to the document on the display means;
Detecting an operation on the operation screen;
When displaying the document information stored in the other image processing device on the operation screen based on the detected operation, the display image related to the document information is requested from the other image processing device, and the other image processing device is requested. And a step of inserting a display image received from the display screen into a part of a display area of the operation screen and displaying the display image.

Images