JP2015028733A - Operation device and image processing apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an operation device that can maintain the convenience of operation to regular operation buttons while preventing incorrect operation to important operation buttons, and an image processing apparatus including the operation device.SOLUTION: The operation device includes a sight line detection unit that detects the sight lines of an operator operating an operation unit 20. When an operation button having received the operation from the operator is an operation button set to require sight lines (for example, start button 32), a determination unit enables the operation to the operation button only when there are sight lines of the operator on the operation button when the operation to the operation button is received, and when an operation button having received the operation from the operator is an operation button set to require no sight lines (for example, numeric key), the determination unit enables the operation to the operation button regardless of whether or not there are the sight lines of the operator on the operation button when the operation to the operation button is received.

Description

  The present invention relates to an operating device and an image processing device that detect the validity / invalidity of an operation by detecting an operator's line of sight.

  In recent years, various techniques for detecting the line of sight of a user and controlling the availability of operations have been proposed.

  For example, in a mobile terminal, there is a technique for determining whether or not the user's line of sight is within the display screen, and enabling the key operation unit when the user's line of sight is within the display screen (see Patent Document 1). .

  Further, in the car navigation device, there is a technique for detecting the driver's line of sight and hiding the operation key or hiding the entire screen when the driver is looking at the monitor of the navigation device. (See Patent Document 2).

  Further, in Patent Document 3, when a predetermined determination operation is performed by aligning a line of sight with a character desired to be input from a character list, a point in time when the determination operation is performed in the line-of-sight input device in which the character with the line of sight is input Thus, even if the line of sight is slightly deviated from the character, a technique is disclosed in which a character desired by the user is input by determining the line-of-sight shift based on a time-series change in the position of the line of sight.

JP 2012-142878 A JP 2007-45169 A JP 2010-267071 A

  There are cases where key input is mistakenly input (recovery is less affected), and is not reversible (effects are greater if incorrect). For example, in a facsimile machine, when characters and numbers are entered for destination and various settings, the wrong input is displayed if the input contents are displayed even if the wrong character or number input button is pressed. You will notice that you can correct it and re-enter it. In this case, even if there is an incorrect input, it can be recovered.

  On the other hand, job execution start operations, reset operations, data deletion operations from memory, etc. are greatly affected by erroneous input and cannot be recovered. For example, when a familiar operator operates without looking at the operation button, if the transmission button is pressed by mistake, the transmission process is started. Then, when it is noticed for the first time that the transmission has been executed by looking at the transmission completion display, it cannot be recovered.

  In the technology that uses whether or not the display screen is viewed as in Patent Documents 1 and 2 as a criterion for determining whether the key operation is valid / invalid, distinguishing between an operation button that can be recovered even if it is erroneously operated and an operation button that cannot be recovered Therefore, the user must operate the operation buttons that can be recovered even if the operation is erroneous while viewing the display screen. For this reason, for those who are used to the operation, it is impossible to look a little, which is inconvenient.

  The technique of Patent Document 3 is a technique for automatically determining the position of the original line of sight even if the line of sight is slightly shifted, and does not contribute to the solution of the above problem.

  The present invention is intended to solve the above-described problem, and includes an operation device capable of maintaining the convenience of operation with respect to a normal operation button while preventing an erroneous operation with respect to a specific operation button, and the operation device. An object of the present invention is to provide an image processing apparatus.

  The gist of the present invention for achieving the object lies in the inventions of the following items.

[1] An operation unit having a first type operation button and a second type operation button;
A line-of-sight detection unit that detects the line of sight of an operator who operates the operation unit;
A determination unit that determines validity / invalidity of an operation on the operation button of the operation unit,
In the case where the operation button that has been operated by the operator is the first type of operation button, the determination unit, when receiving an operation on the operation button, if there is no operator's line of sight with respect to the operation button, In the case where the operation button is invalidated and the operation button that has been operated by the operator is the second type operation button, whether or not there is an operator's line of sight to the operation button when the operation button is operated The operating device is characterized in that it is not included in the condition for determining whether the operation for the operation button is valid or invalid.

  In the above invention, the operation on the first type operation button is invalid when the operator is not looking at the operation button, and the presence / absence of the line of sight on the second type operation button invalidates the operation on the operation button. It does not affect. For example, it is enabled regardless of the presence or absence of the line of sight.

[2] The operation button of the first type is an operation button for receiving an instruction to start processing, confirm input, stop processing, or reset an input value.
The operation device according to [1], wherein the second type operation button is an operation button that receives an instruction other than the start of processing execution, input confirmation, processing suspension, and input value resetting. .

  In the above invention, the operation button that receives an instruction to start execution of the process, confirm the input, stop the process, etc. is changed to the first type of operation button because the erroneous operation is an irreversible operation error. The buttons are operation buttons other than those described above.

[3] A setting switching unit that switches between setting the first type operation button and setting the second type operation button for each operation button of the operation unit. [1] Alternatively, the operating device according to [2].

  In the above invention, for each operation button, it can be switched between setting to the first type operation button or the second type operation button.

[4] For a plurality of types of jobs, it has a function of accepting job setting input operations,
The setting switching unit determines whether to set a predetermined operation button as the first type operation button or the second type operation button according to the type of job that receives a setting input operation at the operation unit. The operating device according to [3], wherein the operating device is changed.

  In the above invention, whether one operation button is set as the first type operation button or the second type operation button is automatically changed according to the type of job that receives the setting input operation at the operation unit. Is done.

[5] A display unit for displaying various screens is provided.
The setting switching unit changes whether to set a predetermined operation button as the first type operation button or the second type operation button according to a screen displayed on the display unit. The operating device according to [3], which is characterized.

  In the above invention, whether the predetermined operation button is set to the first type operation button or the second type operation button is automatically changed according to the screen displayed on the display unit.

[6] The operator's line of sight is determined to be present with respect to the operation button when the line of sight of the operator is within an existing range of the operated operation button or a predetermined range in the center of the operation button. The operation device according to any one of [1] to [5].

  In the above invention, the operation on the first type operation button is invalidated when the operator does not look at the range of the operation button or the central portion of the operation button.

[7] An image processing unit;
An image processing apparatus comprising: the operation device according to any one of [1] to [6] that receives a job input operation performed by the image processing unit.

  According to the operation device and the image processing device according to the present invention, it is possible to maintain the convenience of operation with respect to a normal operation button while preventing erroneous operation with respect to a specific operation button.

1 is a diagram illustrating an image processing apparatus according to an embodiment of the present invention and an operation display apparatus that remotely operates the image processing apparatus. It is a block diagram which shows schematic structure of an image processing apparatus. It is a block diagram which shows schematic structure of an operation display apparatus. It is a front view which shows an operation panel. It is a figure which shows a mode that the operator operated the start button, looking at the start button. It is a figure which shows a mode that the operator operated the start button, without looking at the start button. It is a figure which shows a mode that the operator operated the numeric keypad without looking at the numeric keypad. It is a figure which shows an example of a management table. It is a figure which shows the operation panel in the state by which the destination operation screen was displayed on the display part. It is a figure which shows the operation panel in the state by which the destination input screen was displayed on the display part. It is a figure which shows an example of a management table (each screen classified by operation button). It is a figure which shows an example of a management table (by operation button function mode). 3 is a flowchart illustrating processing performed by an image processing apparatus that receives an operation of an operation button. It is a block diagram which shows the operating device of the structure which removed the display part from the operating display device.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 shows an image processing apparatus 10 according to an embodiment of the present invention and an operation display apparatus 40 for remotely operating the image processing apparatus 10. The operation display device 40 is communicably connected to the image processing device 10 via a network such as a LAN (Local Area Network). The connection between the image processing apparatus 10 and the operation display apparatus 40 may be wireless communication or wired communication, but wireless communication is preferable.

  The image processing apparatus 10 includes a copy function that optically reads a document and prints a duplicate image on a recording sheet, a scan function that stores image data of the read document as a file, and transmits the file to an external terminal via a network, This is a so-called MFP (MFP) having a printer function for forming an image related to print data received via a network from a PC or the like on a recording sheet and printing it out, and a facsimile function for transmitting and receiving image data according to a facsimile procedure.

  Each of the image processing device 10 and the operation display device 40 detects the line of sight of the operator. The first type of operation button (referred to as a line-of-sight button) has a function of invalidating the operation unless the operator has a line of sight with respect to the operation button. Regarding the second type of operation button (not to be a line-of-sight button), whether or not there is an operator's line of sight with respect to the operation button when the operation is received is not included in the determination of validity / invalidity of the operation.

  Here, the first type of operation button is valid if the operator has a line of sight to the operation button when an operation is received, and is invalid if there is no line of sight. The operation of the second type operation button is valid regardless of whether the operator's line of sight is present or not when the operation button is received.

  FIG. 2 is a block diagram illustrating a schematic configuration of the image processing apparatus 10. The image processing apparatus 10 includes a CPU (Central Processing Unit) 11 as a control unit that comprehensively controls the operation of the image processing apparatus 10. The CPU 11 includes a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a nonvolatile memory 14, a hard disk device 15, an automatic document feeder (ADF) 18, an image reading unit 19, and an operation unit 21 through a bus. A display unit 22, an image processing unit 23, a printer unit 24, an authentication unit 25, a network communication unit 26, a facsimile communication unit 27, a line-of-sight detection unit 28, and the like are connected.

  The CPU 11 is based on an OS (Operating System) program, and executes middleware, application programs, and the like. Various programs are stored in the ROM 12, and each function of the image processing apparatus 10 is realized by the CPU 11 executing various processes according to these programs.

  The RAM 13 is used as a work memory for temporarily storing various data when the CPU 11 executes processing based on a program, an image memory for storing image data, and the like.

  The nonvolatile memory 14 is a memory (flash memory) whose stored contents are not destroyed even when the power is turned off, and is used for storing various setting information.

  The hard disk device 15 is a large-capacity nonvolatile storage device, and stores various programs and data in addition to print data and display screen data. The hard disk device 15 stores a management table 17 in which valid / invalid information indicating whether each operation button is set as a gaze-required button or a gaze-required button is registered.

  The image reading unit 19 performs a function of optically reading a document and acquiring image data. The image reading unit 19 sequentially, for example, a light source that irradiates light on a document, a line image sensor that receives the reflected light and reads the document for one line in the width direction, and sequentially reads the reading position in units of lines in the length direction of the document. An optical path composed of a moving unit for moving, a lens, a mirror, and the like for guiding reflected light from the document to the line image sensor to form an image, and a conversion unit for converting an analog image signal output from the line image sensor into digital image data And so on.

  The automatic document feeder 18 feeds a document set on the platen one by one from the top one by one in order, passes the reading position of the image reading unit 19 and discharges it to a predetermined discharge position. Fulfill. The image reading unit 19 has a function of reading a document placed on the platen glass and a function of sequentially reading the document conveyed by the automatic document conveyance unit 18.

  The operation panel 20 includes an operation unit 21 and a display unit 22 and functions to display various operation screens and setting screens, and to receive various operations such as job input from the user. The display unit 22 includes a liquid crystal display (LCD ... Liquid Crystal Display) and its driver. The operation unit 21 includes various hard keys such as a start button and a numeric keypad, and a touch panel provided on the display surface of the display unit 22. The touch panel detects a coordinate position where the display surface of the display unit 22 is touched with a touch pen or a finger. The operation unit 21 receives a flick operation and a drag operation through the touch panel.

  The image processing unit 23 performs rasterization processing for converting print data into image data, image data compression and expansion processing, in addition to processing such as image enlargement / reduction and rotation.

  The printer unit 24 has a function of forming an image corresponding to the image data on a recording sheet. Here, it has a recording paper transport device, a photosensitive drum, a charging device, a laser unit, a developing device, a transfer separation device, a cleaning device, and a fixing device, and forms an image by an electrophotographic process. It is configured as a so-called laser printer. Other methods may be used for image formation.

  The authentication unit 25 authenticates a user who uses the image processing apparatus 10. The authentication method may be any password, fingerprint, vein, or the like.

  The network communication unit 26 has a function of communicating with the operation display device 40, an external PC, a server, and the like. The network communication unit 26 is configured to be capable of both wired communication and wireless communication. Note that only one of wired communication and wireless communication may be configured.

  The facsimile communication unit 27 performs a function of transmitting / receiving image data to / from an external device having a facsimile function through a telephone line.

  The line-of-sight detection unit 28 detects the line of sight of an operator (user) who is looking at the operation panel 20 of the image processing apparatus 10. The line-of-sight detection method may be arbitrary. For example, a camera is provided at the center of the upper edge of the operation panel 20, and an image captured by the camera is analyzed to detect the operator's line of sight based on the orientation of the face and the position of the pupil in the eyes. The image processing apparatus 10 recognizes which part of the operation panel 20 the operator is viewing by detecting the operator's line of sight with the line-of-sight detection unit 28.

  FIG. 3 is a block diagram illustrating a schematic configuration of the operation display device 40. The operation display device 40 includes a CPU 41 that performs overall control of the operation of the operation display device 40. A ROM 42, a RAM 43, a nonvolatile memory 44, a hard disk device 45, an operation unit 48, a display unit 49, a network communication unit 51, an authentication unit 52, and a line-of-sight detection unit 53 are connected to the CPU 41 through a bus. Yes.

  The CPU 41 is based on the OS program, and executes middleware, application programs, and the like. Various programs are stored in the ROM 42, and the function of the operation display device 40 is realized by the CPU 41 executing various processes in accordance with these programs.

  The RAM 43 is used as a work memory for temporarily storing various data when the CPU 41 executes processing based on a program or for storing display data.

  The nonvolatile memory 44 is a memory (flash memory) whose stored contents are not destroyed even when the power is turned off, and is used for storing various setting information.

  The hard disk device 45 is a large-capacity nonvolatile storage device, and stores various programs and data in addition to display screen data. A management table 47 similar to the management table 17 of the image processing apparatus 10 is created and stored in the hard disk device 45.

  The display unit 49 functions to display various operation screens, setting screens, and the like. The display unit 49 includes a liquid crystal display and its driver. The operation unit 48 functions to receive various operations such as job submission from the operator. The operation unit 48 includes various hard keys such as a start button and a numeric keypad, and a touch panel provided on the display surface of the display unit 49. The touch panel detects a coordinate position where the display surface of the display unit 49 is touched with a touch pen or a finger. The operation unit 48 receives a flick operation and a drag operation through the touch panel.

  The network communication unit 51 has a function of communicating with the image processing apparatus 10, an external PC, a server, and the like. The network communication unit 51 is configured to be capable of both wired communication and wireless communication. Note that only one of wired communication and wireless communication may be configured.

  The authentication unit 52 authenticates an operator who uses the operation display device 40. Authentication is performed by ID card, fingerprint, user ID and password verification.

  The line-of-sight detection unit 53 detects the line of sight of the operator of the operation display device 40. Similar to the line-of-sight detection unit 28, the line-of-sight detection method may be arbitrary. The operation display device 40 detects the operator's line of sight with the line-of-sight detection unit 53, thereby recognizing which part of the operation display device 40 (which part of the display unit 49 and which operation button) the operator is viewing. To do.

  Next, an operation when receiving an operation from an operator on the operation panel 20 of the image processing apparatus 10 will be described. The operation when receiving an operation from the operator is the same between the image processing apparatus 10 and the operation display apparatus 40. Therefore, the operation of the image processing apparatus 10 will be described here, and the operation of the operation display apparatus 40 will be described. Description is omitted.

  FIG. 4 is a front view showing the appearance of the operation panel 20 of the image processing apparatus 10. In addition, since the front of the operation display apparatus 40 is the same as that of FIG. 4, the description is abbreviate | omitted. A display unit 22 is arranged on the left half of the operation panel 20, and various hard keys are arranged on the right half. Specifically, a numeric keypad 31 consisting of numeric input buttons from 0 to 9, and *, # input buttons, a start button 32, a stop button 33, a help button 34, a reset button 35, and the like are provided as hard keys. In addition, a camera lens (light intake) of the line-of-sight detection unit 28 is disposed at the upper center of the operation panel 20.

  FIG. 5 shows a state in which the operator operates the start button 32 while looking at the start button 32. The start button 32 is an important operation button for instructing start of job execution. An erroneous operation with respect to the start button 32 is a serious operation error that cannot be reversed. Therefore, the start button 32 is set as a line-of-sight button. If the operator views the start button 32 when receiving an operation on the start button 32 from the operator (if the operator's line of sight is at the start button 32), the image processing apparatus 10 operates the start button 32. Is accepted and accepted.

  On the other hand, as shown in FIG. 6, when the operator receives an operation on the start button 32 and the operator does not look at the start button 32 (unless the operator's line of sight is on the start button 32), the start button It is determined that the operation for 32 is invalid and is not accepted.

  In the example of FIG. 6, the operator operates the start button 32 without looking at the start button 32 while watching the display on the display unit 22, so this operation is invalidated.

  The numeric keypad 31 is used when inputting a telephone number of a transmission destination or inputting a personal identification number. For example, an erroneous operation of the numeric keypad 31 when inputting a telephone number is a minor operation error that can be recovered because the input content can be corrected. Therefore, the numeric keypad 31 is set as a line-of-sight unnecessary button. The image processing apparatus 10 receives the operation of the numeric keypad 31 from the operator, regardless of whether or not the operator is looking at the numeric keypad 31, that is, the operator's line of sight is not on the numeric keypad 31 being operated. However, it is determined that the operation on the numeric keypad 31 is valid and accepted.

  For example, as shown in FIG. 7, even when the operator operates the numeric keypad 31 while looking at the display unit 22, the operation on the numeric keypad 31 is determined to be valid and accepted.

  FIG. 8 shows an example of the management table 17. In the management table 17, valid / invalid information indicating whether the operation button is set as a line-of-sight requirement button or a line-of-sight unnecessary button is registered for each operation button. Specifically, for each operation button, the name of the operation button, valid / invalid information when there is a line of sight (information registered in the item “Yes” in the figure), and valid / invalid information when there is no line of sight (Information registered in the “none” item in the figure) is registered in association with each other.

  The valid / invalid information when there is a line of sight is information indicating whether this operation is validated or invalidated when an operator's line of sight is present when the operation button is operated. The valid / invalid information when there is no line of sight is information indicating whether this operation is validated or invalidated when there is no operator's line of sight when the operation button is operated.

  In the management table 17 of FIG. 8, an operation button in which “valid” is set in the item of “line of sight” and “invalid” is set in the item of “none” of the line of sight is a line-of-sight button. In the management table 17 of FIG. 8, an operation button in which “valid” is set in the item of “line of sight” and “valid” is set in the item of “none” of the line of sight is a line-of-sight unnecessary button.

  According to the management table 17 shown in FIG. 8, the start button 32 is set as a line-of-sight button, and when the operation button has a line of sight when operated, the operation is validated, and when operated, the start button 32 If there is no line of sight on the operation button, the operation is invalidated. The stop button 33 is also set as a line-of-sight required button, and when the operation button is operated, the operation is validated when the line of sight is present, and when the operation button is operated, the operation is invalid. To be.

  The numeric keypad (1) (number 1 input button) is set as a line-of-sight unnecessary button. If there is a line of sight to the operation button when the numeric keypad (1) is operated, the operation is validated, and the operation is validated even if the operation button is not line of sight when operated. The same applies to the numeric keypad (2).

  Note that the settings of the management table 17 shown in FIG. 8 and FIGS. 11 and 12 (to be described later) can be arbitrarily changed by the user (for example, an administrator or the like). That is, by changing the registered contents of the management table 17, it is possible to arbitrarily change the setting of whether each operation button is a gaze required button or a gaze unnecessary button.

<Specific example>
A case where a job of ScanToEmail transmission is performed in the image processing apparatus 10 will be described. The ScanToEmail transmission job is a job in which an image obtained by optically reading a document by the image reading unit 19 is converted into a file, and an electronic mail (Email) attached with the file is transmitted to a specified destination.

  In this job, the user sets a document on the image reading unit 19, selects a desired destination from the destination list displayed on the display unit 22 of the operation panel 20 by touch operation, and presses the start button 32. Executed. Normally, the image processing apparatus 10 starts transmission immediately after the start button 32 is pressed.

  By the way, it is assumed that the operator tries to press the numeric key 31 while looking at the screen displayed on the display unit 22. For example, assume that the numeric keypad 31 is operated to input a mail address when inputting a destination. At this time, the operator operated the numeric keypad 31 while looking at the screen on the display unit 22 without looking at the hard key, so that the operator's little finger or the like accidentally touched the start button 32, It is assumed that the start button 32 is depressed unintentionally.

  However, since the start button 32 is set as a line-of-sight button, the operation on the start button 32 is invalidated. Since the numeric keypad 31 is set as a line-of-sight unnecessary button, the operator can operate the numeric keypad 31 while looking at the screen on the display unit 22.

  Specifically, when the CPU 11 of the image processing apparatus 10 receives an operation of an arbitrary operation button from the operator on the operation panel 20, the operation button (in this example, the start button 32) is operated with reference to the management table 17. It is confirmed whether the line-of-sight button is set or the line-of-sight unnecessary button is set. When the operated operation button is set as a line-of-sight unnecessary button, the operation is validated.

  When the operation button that has been operated is set as the line-of-sight required button, it is confirmed whether or not the position of the operator's line-of-sight detected by the line-of-sight detection unit 28 is on the operation button that has been operated. . If the operated button has an operator's line of sight, the current operation is validated. If the operated button has no operator's line of sight, the current operation is invalidated.

  The determination procedure is not limited to the above, and may be as follows. It is detected whether or not the pressed operation button has a line of sight. If there is a line of sight, the validity / invalidity of the current operation is determined according to the validity / invalidity information for the “with line of sight” of the operation button registered in the management table 17. If there is no line of sight, the validity / invalidity of the current operation is determined according to the validity / invalidity information for “no line of sight” of the operation button registered in the management table 17.

  As described above, the operation panel 20 of the image processing apparatus 10 has a gaze-required button that is effective only when the operation button has an operator's gaze when operated, and an operation to the operation button when operated. A line-of-sight unnecessary button that is effective regardless of whether or not there is a person's line of sight is provided. While setting an operation button that causes an erroneous operation to be irreversible as a gaze-required button, and setting an operation button that returns even if an erroneous operation is performed as a gaze-free button, preventing an irreversible misoperation, Convenience in normal operation (convenient to operate while looking at another part) can be ensured.

  Next, a case where the setting of whether or not the line of sight regarding one operation button is necessary is switched according to the screen displayed on the display unit 22 will be described.

  FIG. 9 shows the operation panel 20 in a state where the destination operation screen 80 is displayed on the display unit 22. The destination operation screen 80 accepts an operation for executing transmission to the currently input destination and an operation for adding a destination to the destination list. Normally, the numeric keypad 31 is used for inputting numerical values, but is used as a shortcut key in the destination operation screen 80 shown in FIG.

  Specifically, the numeric keypad (1) performs the same function as the destination addition button 81, and the numeric keypad (2) performs the same function as the transmission execution button. Therefore, the image processing apparatus 10 sets each numeric keypad 31 as a line-of-sight button when the destination operation screen 80 is displayed on the display unit 22.

  For example, if the operator's line of sight is on the numeric keypad (1) when the numeric keypad (1) is pressed while the destination operation screen 80 is displayed on the display unit 22, the image processing apparatus 10 validates the operation. Similarly to the case where the destination addition button 81 is operated, the screen displayed on the display unit 22 is changed to the destination input screen 85 shown in FIG.

  On the other hand, if the operator's line of sight is not on the numeric keypad (1) when the numeric keypad (1) is pressed while the destination operation screen 80 is displayed on the display unit 22, the image processing apparatus 10 invalidates the operation. To do.

  As shown in FIG. 9, if the operator's line of sight is on the numeric keypad (2) when the numeric keypad (2) is pressed while the destination operation screen 80 is displayed on the display unit 22, the image processing apparatus 10 Performs the transmission process in the same manner as when the operation is validated and the transmission execution button 82 is operated.

  On the other hand, if the operator's line of sight is not on the numeric keypad (2) when the numeric keypad (2) is pressed while the destination operation screen 80 is displayed on the display unit 22, the image processing apparatus 10 invalidates the operation. , Do not execute the transmission process.

  On the destination input screen 85 shown in FIG. 10, the numeric keypad 31 is used for inputting numerical values. In a state where the destination input screen 85 is displayed on the display unit 22, the image processing apparatus 10 sets the numeric keypad 31 as a line-of-sight unnecessary button. The numeric keypad 86 in the destination input screen 85 of FIG. 10 is a software keyboard, and when pressed, a numerical value is entered in the destination column 87.

  For example, when the ten key (1) that is a hard key is pressed while the destination input screen 85 is displayed on the display unit 22, the operator's line of sight is displayed on the ten key because the operator is looking at the destination input screen 85. Even if it is not in (1), the image processing apparatus 10 validates the operation. Specifically, the input of the number “1” is accepted, and “1” is additionally displayed in the destination column 87.

  FIG. 11 shows a management table 17 corresponding to a case where each operation button is set as a gaze required button or a gaze unnecessary button is changed for each screen. In the management table 17 shown in FIG. 11, for each operation button, a setting when the destination operation screen 80 is displayed (valid / invalid information) and a setting when the destination input screen 85 is displayed (valid / invalid information). Is registered. In this example, the numeric keypad (1), numeric keypad (2), numeric keypad (3),... Are set as the line-of-sight required buttons when the destination operation screen 80 is displayed, and the line of sight when the destination input screen 85 is displayed. It is set as an unnecessary button.

  The CPU 11 functions as a setting switching unit that automatically switches the setting for each operation button. Specifically, when an arbitrary operation button is operated, the CPU 11 specifies the screen displayed on the display unit 22 at that time, and the valid / invalid information of the portion corresponding to the specified screen is obtained from the management table 17. Acquired, and based on the valid / invalid information, recognizes whether the operated operation button is set as a gaze-required button or a gaze-unnecessary button.

  Next, the case where the setting of whether or not the line of sight is necessary for one operation button is switched according to the function mode will be described.

  The image processing apparatus 10 has a plurality of function modes corresponding to the types of jobs to be set and input. When the image processing apparatus 10 receives a setting input operation for each job, it first receives a function mode selection. For example, when performing a setting input operation regarding a copy job, the user first selects a copy mode which is one of the function modes. Upon receiving the copy mode selection operation, the image processing apparatus 10 displays a copy job setting screen on the display unit 22 and accepts various setting operations.

  The function mode includes a copy mode that accepts input of copy job settings, a scan mode that accepts input of scan job settings such as ScanToEmail transmission, a FAX mode that accepts input of settings for facsimile jobs, and a box job setting that inputs and outputs to the box There is a BOX mode for accepting the input. A box is a storage area divided by user or group. Usually, an ID and a password are set for each box. Select a box by ID. A correct password is required to print out the file stored in the box.

  FIG. 12 shows an example of the management table 17 in which the setting (valid / invalid information) of whether one operation button is a gaze required button or a gaze unnecessary button is registered for each function mode. In FIG. 12, the setting in the copy mode, the setting in the scan mode, the setting in the FAX mode, and the setting in the BOX mode for the start button 32 are registered.

  The CPU 11 refers to the management table 17 of the part corresponding to the selected function mode. As a result, whether the start button 32 is set as a gaze-required button or a gaze-unnecessary button is automatically switched according to the selected function mode.

  In the example of FIG. 12, the start button 32 is automatically switched to be a line-of-sight unnecessary button in the copy mode and the BOX mode, and to be a line-of-sight required button in the scan mode and the FAX mode. Since transmission processing is executed in the scan mode or the FAX mode, an erroneous operation of the start button 32 becomes an irreversible operation error. For this reason, in these function modes, the start button 32 is set as a line-of-sight button.

  FIG. 13 shows a flow of processing performed by the image processing apparatus 10 that receives the operation of the operation button. When any one of the operation buttons provided on the operation panel 20 is pressed (step S101; Yes), the CPU 11 of the image processing apparatus 10 acquires information indicating the apparatus state (step S102). Here, the current function mode and identification information (screen ID or the like) of the screen being displayed on the display unit 22 are acquired as information indicating the device state.

  Also, information specifying the pressed operation button is acquired (step S103).

  Next, referring to the management table 17 of the part corresponding to the device state acquired in step S102 of the operation button specified in step S103, the valid / invalid information set for the operation button in the device state is obtained. Obtain (step S104).

  Next, it is recognized from the detection result of the line-of-sight detection unit 28 whether or not the pressed operation button has the line of sight of the operator (step S105). When the operator's line of sight is present on the pressed operation button (step S105; Yes), it is confirmed whether or not the content of the valid / invalid information acquired in step S104 is a setting for enabling the operation when there is a line of sight. (Step S106).

  If the content of the valid / invalid information acquired in step S104 is a setting for validating the operation when there is a line of sight (step S106; Yes), it is determined that the current operation on this operation button is valid, and the corresponding processing is performed. This is executed (step S107), and this processing is ended (END). If the content of the valid / invalid information acquired in step S104 is a setting for invalidating the operation when there is a line of sight (step S106; No), it is determined that the current operation with respect to the operation button is invalid, and the process ends. (End)

  When there is no line of sight of the operator on the pressed operation button (step S105; No), it is confirmed whether or not the content of the valid / invalid information acquired in step S104 is a setting for enabling the operation when there is no line of sight. (Step S108).

  If the content of the valid / invalid information acquired in step S104 is a setting for validating the operation when there is no line of sight (step S108; Yes), it is determined that the current operation on this operation button is valid, and the corresponding processing is performed. This is executed (step S109), and this processing is ended (END). If the content of the valid / invalid information acquired in step S104 is a setting for invalidating the operation when there is no line of sight (step S108; No), it is determined that the current operation with respect to the operation button is invalid, and the process ends. (End)

  The above operation is the same in the operation display device 40.

  As described above, in the image processing device 10 and the operation display device 40, an operation button that causes an erroneous operation that cannot be recovered is set as a gaze-required button, and an operation button that can be recovered even if an erroneous operation is performed is set as a gaze-free button. can do. As a result, it is possible to ensure convenience in normal operation (convenient to operate while looking at another part) while preventing irreparable erroneous operations.

  In addition, since the setting relating to the necessity of the line of sight for each operation button is automatically switched according to the type of screen displayed on the display units 22 and 49 and the selected function mode, the role of the operation button depends on the device state. It is also possible to cope with a change in the above.

  The embodiment of the present invention has been described with reference to the drawings. However, the specific configuration is not limited to that shown in the embodiment, and there are changes and additions within the scope of the present invention. Are also included in the present invention.

  In the embodiment, the image processing apparatus 10 is a multifunction peripheral. However, as long as the apparatus includes an image processing unit and an operation device that accepts an operation for inputting a job setting to be executed by the image processing unit, a copier, a printer, or the like The present invention is applicable to other types of apparatuses.

  Although the start button 32 and the stop button 33 are illustrated as the line-of-sight required buttons, the operation button that accepts any of the instruction to start the process, confirm the input, stop the process, or reset the input value is set as the line-of-sight required button. It is preferable. On the other hand, it is preferable to set an operation button that receives an instruction other than the start of processing execution, input confirmation, processing suspension, and input value resetting as a line-of-sight unnecessary button. The reason why the resetting of the input value is included is to prevent the input value input by taking time and effort from being erased because the reset button is erroneously pressed.

  Further, the operation button for determining whether the line of sight is necessary is not limited to a hard key, and may be an operation button (soft key) displayed on the display unit 22 or the like, or any operation button that accepts an operation by the operator.

  In the embodiment, for the line-of-sight required button, the operation is enabled when the operated button has a line of sight. However, the operation may be invalidated when there is no line of sight, and the condition for enabling the operation is other than the line of sight These conditions may be taken into consideration. In addition, for the line-of-sight unnecessary button, the operation on the operation button is validated regardless of the presence or absence of the line of sight, but the presence or absence of the line of sight does not have to be included in the condition for determining the validity / invalidity of the operation on the operation button. It may be configured to determine whether the operation is valid or invalid based on the above condition.

  Moreover, although the operation display apparatus 40 which operates the image processing apparatus 10 remotely is illustrated as an operation apparatus of this invention, it is not limited to this. Further, as shown in FIG. 14, the operating device of the present invention may be configured as an operating device 40B having a configuration in which the display unit 49 is removed from the operation display device 40 of FIG.

  In this embodiment, it is determined whether or not there is a line of sight in the range where the operation buttons exist. However, the effective range of the line of sight for each operation button does not necessarily match the range where the operation buttons exist. For example, it may be a range including the operation button and its vicinity, a predetermined range in the center of the operation button, a range in which characters indicating the function of the operation button are displayed, and the like. As for the numeric keypad, the effective range of the line of sight for each numeric keypad is the existing range of each numeric keypad. For example, the effective range of the visual line for each numeric keypad may be the existing range of the numeric keypad group.

  In the embodiment, the registered contents of the management table 17 can be arbitrarily changed by the user. However, a configuration in which the user cannot change previously registered contents may be used.

  In the embodiment, the validity / invalidity of the operation is determined based on the position of the line of sight when the operation button is pressed. However, the position of the line of sight immediately before the operation button is pressed may be taken into consideration. For example, it is possible to respond as an effective operation even when an operation is performed in which the position of the button is confirmed with a line of sight before pressing, and the line of sight is moved to another place when the fingertip approaches the operation button.

DESCRIPTION OF SYMBOLS 10 ... Image processing apparatus 11 ... CPU
12 ... ROM
13 ... RAM
DESCRIPTION OF SYMBOLS 14 ... Nonvolatile memory 15 ... Hard disk device 17 ... Management table 18 ... Automatic document conveyance part 19 ... Image reading part 20 ... Operation panel 21 ... Operation part 22 ... Display part 23 ... Image processing part 24 ... Printer part 25 ... Authentication part 26 ... Network communication unit 27 ... Facsimile communication unit 28 ... Gaze detection unit 31 ... Numeric keypad 32 ... Start button 33 ... Stop button 34 ... Help button 35 ... Reset button 40 ... Operation display device 40B ... Operation device 41 ... CPU
42 ... ROM
43 ... RAM
44 ... Non-volatile memory 45 ... Hard disk device 47 ... Management table 48 ... Operation unit 49 ... Display unit 51 ... Network communication unit 52 ... Authentication unit 53 ... Gaze detection unit 80 ... Destination operation screen 81 ... Destination addition button 82 ... Transmission execution button 85 ... Destination input screen 86 ... Numeric keypad 87 ... Destination field

Claims (7)

An operation unit having a first type operation button and a second type operation button;
A line-of-sight detection unit that detects the line of sight of an operator who operates the operation unit;
A determination unit that determines validity / invalidity of an operation on the operation button of the operation unit,
In the case where the operation button that has been operated by the operator is the first type of operation button, the determination unit, when receiving an operation on the operation button, if there is no operator's line of sight with respect to the operation button, In the case where the operation button is invalidated and the operation button that has been operated by the operator is the second type operation button, whether or not there is an operator's line of sight to the operation button when the operation button is operated The operating device is characterized in that it is not included in the condition for determining whether the operation for the operation button is valid or invalid. The first type of operation button is an operation button for receiving an instruction to start processing, confirm input, stop processing, or reset an input value.
The operation device according to claim 1, wherein the second type operation button is an operation button that receives an instruction other than the start of processing execution, input confirmation, processing suspension, and input value reset. . 3. A setting switching unit that switches between setting to the first type operation button or setting to the second type operation button for each operation button of the operation unit. The operating device described. For multiple types of jobs, it has a function to accept job setting input operations,
The setting switching unit determines whether to set a predetermined operation button as the first type operation button or the second type operation button according to the type of job that receives a setting input operation at the operation unit. The operating device according to claim 3, wherein the operating device is changed. It has a display unit that displays various screens,
The setting switching unit changes whether to set a predetermined operation button as the first type operation button or the second type operation button according to a screen displayed on the display unit. The operating device according to claim 3, wherein The operator's line of sight is determined to be present with respect to the operation button when the line of sight of the operator is within a range of the operation button that has been operated or a predetermined range in the center of the operation button. Item 6. The operating device according to any one of Items 1 to 5. An image processing unit;
An image processing apparatus comprising: the operation device according to claim 1 that accepts a job input operation performed by the image processing unit.