JP6253861B1 - Touch gesture determination device, touch gesture determination method, touch gesture determination program, and touch panel input device - Google Patents

Abstract

The touch gesture determination apparatus 110 includes an operation information input unit 11, an operation determination unit 12, a notification unit 13, and a display control unit 14. The operation determination unit 12 includes a display component input determination unit 12a and an entire screen. The entire screen input determination unit 12b includes an input determination unit 12b and an operation mode switching determination unit 12c for determining whether the touch gesture operation is an operation performed by the user without looking at the touch panel. It has a gesture input information determination unit 122 that determines whether the determination condition is satisfied.

Description

  The present invention relates to a touch gesture determination device, a touch gesture determination method, a touch gesture determination program, and a touch gesture operation for inputting operation information corresponding to a touch gesture operation and outputting a signal based on the input operation information. And a touch panel input device that outputs a signal based on a touch gesture operation.

  There is a technique for inputting information by operating a keyboard displayed on a touch panel without looking at the touch panel. Patent Document 1 discloses a portable information terminal and a character input method for displaying a virtual input key for inputting information based on the position of the input reference point when the user sets an input reference point on the touch panel. ing. The user first sets an input reference point by touching an arbitrary position on the touch panel with the thumb, and then touches a virtual input key arranged based on the position of the input reference point with a forefinger or the like. Enter a symbol, etc.

JP 2012-185565 A (for example, paragraphs 0027 to 0048)

  However, in Patent Document 1, when the user does not remember the virtual input key arrangement, it is necessary to view the touch panel after the virtual input key is displayed, and it is difficult to input information without completely viewing the touch panel. there were.

  In addition, it is difficult to grasp the positional relationship between your finger and the touch panel in touch gesture operations that are performed without looking at the touch panel. . However, since the touch panel determines the input touch gesture operation without considering the difference, the touch gesture operation performed without looking at the touch panel may not be recognized.

  The present invention has been made to solve the above-described problems, and it is an object of the present invention to easily recognize a touch gesture operation performed by a user without looking at the touch panel as a touch gesture operation.

A touch gesture determination apparatus according to an aspect of the present invention receives an operation image from a touch panel that displays an operation image on a screen, receives a user's touch gesture operation, and outputs operation information corresponding to the touch gesture operation. , a touch gesture determination apparatus for generating output information based on the operation information, based on the previous SL operation information, receives the operation determination unit, the output information for generating the output information for display of the touch panel A display control unit that displays an image according to the output information as the operation image on the touch panel, and the operation determination unit is based on a touch gesture operation performed on the entire screen of the touch panel. operation corresponding to the touch gesture operation performed in identifying the entire screen operation mode entry Te Has a whole screen input determination unit which determines the output information from the broadcast, the entire screen input determination unit, before Symbol operation information, in operation of the touch gesture operation is the user in the entire screen operation mode is carried out Oh whether determined for determining whether the determination condition for determining is satisfied, the determining that the touch gesture operation is the first operation in the entire screen operation mode when the determination condition is satisfied The determination condition is a condition determined in advance based on a change in the number of touches of the touch gesture operation and a movement amount of the touch position at a predetermined time .

The touch gesture determination method according to another aspect of the present invention displays an operation image on a screen, accepts a user's touch gesture operation, and outputs the operation information from a touch panel that outputs operation information corresponding to the touch gesture operation. receiving, a touch gesture determination method of generating output information based on the operation information, based on the previous SL operation information, the operation determination step of generating the output information for display of the touch panel, the output information A display control step of receiving and displaying an image according to the output information as the operation image on the touch panel, wherein the operation determination step is performed by a touch gesture operation performed on the entire screen of the touch panel. Tatchijesuchi conducted in identifying entire screen operation mode input content based Has a whole screen input determination step of determining the output information from the operation information corresponding to the operation, the entire screen input determination step, before Symbol operation information, the touch gesture operation is the user in the entire screen operating mode went determination condition for determining whether steering Sakudea Luca whether it is determined whether or not fulfilled, the first operation the touch gesture operation when the determination condition is satisfied in the entire screen operating mode The determination condition is a condition determined in advance based on a change in the number of touches of the touch gesture operation and a movement amount of the touch position at a predetermined time. To do.

A touch panel input device according to another aspect of the present invention displays an operation image on a screen, receives a touch gesture operation of a user, outputs operation information corresponding to the touch gesture operation, and receives the operation information. A touch gesture determination device that controls a display of the touch panel based on the operation information, wherein the touch gesture determination device outputs an output for displaying the touch panel based on the operation information. An operation determination unit that generates information; and a display control unit that receives the output information and causes the touch panel to display an image corresponding to the output information as the operation image. The operation determination unit includes the touch panel Identifies input based on touch gesture operations performed on the entire screen Has a whole screen input determination unit which determines the output information from the operation information corresponding to the touch gesture operation performed in the entire screen operation mode, the entire screen input determination unit, before Symbol operation information, the touch gesture operation There is determined whether the determination condition for determining whether steering Sakudea Luca whether said user has performed in the entire screen operation mode is satisfied, the touch gesture operation when the determination condition is satisfied It is determined that the operation is the first operation in the entire screen operation mode , and the determination condition is predetermined based on a change in the number of touches of the touch gesture operation and a movement amount of the touch position in a predetermined time. It is a condition .

  According to the present invention, a touch gesture operation performed by the user without looking at the touch panel can be easily recognized as a touch gesture operation by the touch panel.

It is a functional block diagram which shows schematic structure of the touchscreen input device which concerns on embodiment of this invention. It is a functional block diagram which shows schematic structure of the whole screen input determination part in embodiment. It is a figure which shows an example of the hardware (H / W) structure of the touchscreen input device which concerns on embodiment. (A) And (b) is a figure which shows an example of the screen and touch gesture operation of the touch panel in the touch panel input device which concerns on embodiment. It is a flowchart which shows the operation | movement (touch gesture determination method) of the touch gesture determination apparatus which concerns on embodiment. It is a flowchart which shows an example of operation | movement of the 2-point touch operation determination process by the gesture input information determination part in embodiment. It is a flowchart which shows the other example of operation | movement of the two-point touch operation determination process by the gesture input information determination part in embodiment.

  Embodiments of the present invention will be described below with reference to the accompanying drawings. In the following description, the touch panel input device includes a touch panel having a touch operation screen (operation screen) and a touch gesture determination device that receives operation information on the touch panel.

  When the touch panel input device is mounted on the target device or connected to be communicable with the target device, the operation screen of the electric device as the target device, the operation screen of the camera as the target device, and the target device The present invention can be applied to an operation screen of factory equipment, an operation screen mounted on a car, a ship, an aircraft, or the like as a target device, an operation screen of a portable information terminal such as a smartphone or a tablet terminal as a target device.

  The touch panel input device uses a signal (for example, a selection value) based on operation information input by a touch gesture operation (also referred to as “touch operation”) from the operation screen of the touch panel as a target device equipped with the touch panel input device, or a touch panel. This can be provided to a target device that can communicate with the input device.

  The touch panel is a touch gesture input unit that receives a touch gesture operation performed by a user. The touch gesture operation is an information input operation by a specific movement such as the user's finger (or the user's palm, or the user's finger and palm). Touch gesture operation is tapping, which is an operation of tapping the operation screen of the touch panel with a finger, flicking, which is an operation of flicking the operation screen of the touch panel with a finger, and a swipe which is an operation of sliding the operation screen of the touch panel with a finger (sliding the finger). Can be included.

  Touch gesture operations include dragging, which is an operation of dragging a display component on the touch panel with a finger, pinch-in, which is an operation of narrowing the interval between fingers while pinching with multiple fingers on the operation screen of the touch panel, and multiple touch gestures on the operation screen of the touch panel. It can include pinch out, which is an operation to increase the interval between fingers.

  Touch gesture operation is a dial gesture that operates to rotate the dial with two or more touches, and a slider that moves the finger to slide up, down, left, or right while touching the touch panel with two or more touches It can include gestures and the like. Note that the touch gesture operation can include an operation using a touch pen which is a pen-type input auxiliary tool.

  In the following description, a gesture performed while the user touches one point on the touch panel using one finger is referred to as a one-point touch operation, and the user performs two touches on the touch panel using two fingers. A gesture (for example, a dial gesture) is referred to as a two-point touch operation, and a gesture performed while the user touches three points on the touch panel using three fingers is referred to as a three-point touch operation.

Embodiment.
<< 1 >> Configuration FIG. 1 is a functional block diagram showing a schematic configuration of a touch panel input device 100 according to an embodiment of the present invention. FIG. 2 is a functional block diagram illustrating a schematic configuration of the entire screen input determination unit 12b according to the embodiment. As illustrated in FIG. 1, the touch panel input device 100 according to the embodiment includes a touch gesture determination device 110 and a touch panel 130. The touch gesture determination device 110 is a device that can execute the touch gesture determination method according to the embodiment and the touch gesture determination program according to the embodiment.

  As shown in FIG. 1, the touch panel 130 receives a touch gesture operation performed by a user, and outputs operation information (hereinafter, also referred to as “touch information”) A0 corresponding to the touch gesture operation. The display panel unit 131 is arranged so as to overlap the operation panel unit 132 and can display an operation image such as a GUI (Graphical User Interface) screen. The display panel unit 131 is, for example, a liquid crystal display.

  As illustrated in FIG. 1, the touch gesture determination device 110 includes an operation information input unit 11, an operation determination unit 12, and a display control unit 14. The touch gesture determination device 110 may include a notification unit 13.

  The operation information input unit 11 receives operation information (operation signal) A0 output from the operation panel unit 132. The operation information input unit 11 outputs input information A1 corresponding to the received operation information A0 to the operation determination unit 12. The input information A1 is information corresponding to the operation information A0, and may be the same information as the operation information A0.

  The operation determination unit 12 receives the input information A1 from the operation information input unit 11, and outputs a selection value A2 as output information that is a result of the operation determination to the notification unit 13 and the display control unit 14. The selection value A2 output from the operation determination unit 12 is a selection value determined by the operation determination unit 12 based on the input information A1, and an application program for a device in which the touch panel input device 100 is mounted based on the selection value A2. Etc. perform device control and the like.

  The operation determination unit 12 determines the type and content of the touch gesture operation by the user from the received input information A1. As shown in FIG. 1, the operation determination unit 12 includes a display component input determination unit 12a, a whole screen input determination unit 12b, and an operation mode switching determination unit 12c.

  In the display component operation mode in which the display component to be operated is displayed on the screen, the display component input determination unit 12a identifies the input content from the touch information on the display component displayed on the screen, accepts the operation, and selects the selected value. Take the decision.

  The entire screen input determination unit 12b identifies input contents from touch information on the entire screen in the entire screen operation mode in which the entire screen is set as an input range, and is responsible for receiving an operation and determining a selection value. As illustrated in FIG. 2, the entire screen input determination unit 12 b includes a parameter adjustment unit 121 and a gesture input information determination unit 122.

  The input content of touch information is identified by the parameter adjustment unit 121 and the gesture input information determination unit 122. The parameter adjustment unit 121 adjusts the parameter according to the operation mode before the input is started, and passes the adjusted parameter to the gesture input information determination unit 122.

  The gesture input information determination unit 122 determines a gesture input of an arbitrary pattern from the input information A1 received from the operation information input unit 11 and the parameter received from the parameter adjustment unit 121, and determines a selection value A2 corresponding thereto. . For example, the gesture input information determination unit 122 determines whether the touch gesture operation corresponding to the input information A1 is a one-point touch operation or a two-point touch operation, and the selection value A2 corresponding to the determined touch gesture operation. To decide.

  Here, conventionally, when it is determined that the operation is a two-point touch operation, for example, the coordinates of the tap positions of the two tapped points are moved by a predetermined distance (B pixel) or more within a predetermined time (A msec). It was determined that the operation is a two-point touch operation with the absence of the determination condition.

  However, when an operation is performed without looking at the touch panel 130, the positional relationship between the user's finger and the touch panel 130 is not known, and therefore there is a possibility that the determination cannot be made only with the above-described determination conditions. Therefore, it is desirable to newly set a determination condition for determining that the two-point touch operation is performed without looking at the touch panel 130. Hereinafter, a determination condition newly set for the touch gesture determination device 110 according to the embodiment to determine a two-point touch operation performed without looking at the touch panel 130 will be described.

  If the hand is extended without touching the touch panel 130 and the hand is extended, it is difficult to touch two points at the same time due to the relationship between the length of the finger and the direction of the hand. Therefore, the touch panel 130 is touched at one point, touched at two points, and when released, the touch returns to the one-point touch and the hand is released. In addition, when the operation is performed without looking at the touch panel 130, it is easy to perform an operation of pushing the touch panel 130 without knowing the force.

  Therefore, for example, the following first to third determination conditions are set as examples of the determination conditions for determining that the two-point touch operation is performed without looking at the touch panel 130. The first to third determination conditions are conditions determined in advance based on a change in the number of touch gesture operation touches or a movement amount of the touch position in a predetermined time (predetermined time). The first to third determination conditions can be stored in the parameter adjustment unit 121 or the gesture input information determination unit 122.

First determination condition: When the touch position during the two-point touch operation hardly moves (for example, the total amount of movement in the predetermined time (C0 msec: first time) of the touch position during the two-point touch operation is predetermined) Value (D0 pixel: first value) or less).
Second determination condition: When the touch position of the one-point touch operation immediately before the two-point touch operation hardly moves (for example, a predetermined time of the touch position of the one-point touch operation immediately before the two-point touch operation (C1 msec: second When the movement amount in (time) is less than or equal to a predetermined value (D1 pixel: second value)).
Third determination condition: When the touch position of the one-point touch operation immediately after the two-point touch operation hardly moves (for example, a predetermined time of the touch position of the one-point touch operation immediately after the two-point touch operation (C2 msec: third (When the movement amount in (time) is equal to or smaller than a predetermined value (D2 pixel: third value)).

  The gesture input information determination unit 122 is a two-point touch operation (first operation) in which the touch gesture operation is performed without looking at the touch panel when all of the first to third determination conditions are satisfied. If any one of the first to third determination conditions is not satisfied, it is determined that the touch gesture operation is not a two-point touch operation performed without looking at the touch panel. To do.

  However, other determination conditions may be used as the determination conditions. For example, if the hand is extended without touching the touch panel 130 and the hand is extended, the touch position cannot be immediately confirmed as compared with the case where the touch position is visually confirmed. Therefore, the gesture input information determination unit 122 determines that the touch gesture operation is a two-point touch operation performed without looking at the touch panel when the following fourth determination condition is satisfied, and the following fourth determination condition: Is not satisfied, it is determined that the touch gesture operation is not a two-point touch operation performed without looking at the touch panel.

  Fourth determination condition: When the operation is continued for a long time by two-point touch (for example, when the two-point touch operation duration is a predetermined value (C4 msec: fourth time) or more).

  The operation mode switching determination unit 12c determines from the input information A1 received from the operation information input unit 11 whether the input information A1 includes information related to switching of the screen operation mode. The screen operation modes include a display component operation mode in which display components to be operated are displayed in the screen, and an entire screen operation mode in which the entire screen is set as an input range. These operation modes can be switched. .

  The operation mode switching determination unit 12c switches the operation mode based on the determination result regarding the switching of the operation mode. When the operation mode switching determination unit 12c switches the operation mode, the display content of the operation screen, the input method, and the notification method are switched.

  The notification unit 13 switches the operation screen notification method according to the determination result of the operation mode switching determination unit 12c, receives the information of the selection value A2 determined by the operation determination unit 12, and notifies the operation status. The notification unit 13 issues a notification of notification contents according to the selection value A2 or outputs a notification signal.

  For example, according to the input information A2 received by the operation determination unit 12, the notification unit 13 notifies the status of the user's touch gesture operation by, for example, sound, screen display, vibration by a vibrator, or lamp lighting.

  When the notification by the notification unit 13 is a notification by sound, the notification unit 13 outputs a notification signal to a speaker as an audio output unit. The speaker is shown in FIG. When the notification by the notification unit 13 is an image display, the notification unit 13 sends notification information A3 to the display control unit 14, and the display control unit 14 transmits an image signal A4 based on the notification information A3 to the display panel unit 131 of the touch panel 130. Send to.

  The display control unit 14 switches the display content of the operation screen according to the determination result of the operation mode switching determination unit 12c, receives information on the selection value A2 determined by the operation determination unit 12, and reflects the operation result on the screen. As shown in FIG. 1, the display control unit 14 outputs an image signal A4 of an operation image displayed on the display panel unit 131 of the touch panel 130 to the display panel unit 131.

  FIG. 3 is a diagram illustrating an example of a hardware (H / W) configuration of the touch panel input device 100 according to the embodiment. As illustrated in FIG. 3, the touch panel input device 100 according to the embodiment includes a touch panel 130, a processor 301, a memory 302, and a speaker 303.

  A touch gesture determination device 110 shown in FIG. 1 includes a memory 302 as a storage device that stores a touch gesture determination program as software, and a processor 301 as an information processing unit that executes the touch gesture determination program stored in the memory 302. (For example, by a computer).

  In this case, the components 11 to 14 in FIG. 1 correspond to the processor 301 that executes the touch gesture determination program in FIG. A part of the touch gesture determination device 110 shown in FIG. 1 can also be realized by the memory 302 shown in FIG. 2 and the processor 301 that executes the touch gesture determination program.

  The touch panel 130 detects contact of a plurality of fingers and transmits touch information (an identification number, coordinates, and a contact state of each finger) to the processor 301. The processor 301 stores the touch information acquired from the touch panel 130 in the memory 302, and switches the operation screen, the input method, and the notification method based on the touch history information accumulated in the memory 302.

  Further, the processor 301 determines from the touch information stored in the memory 302 whether the operation is for the entire screen or an operation for the display component, and determines a selection value in each operation mode.

  The speaker 303 is a sound output unit that is used when, for example, a touch gesture operation state is notified by a sound such as an announcement. The touch panel input device 100 may include an additional device such as a vibrator, a lamp, and a transmission device for wirelessly transmitting a notification signal instead of the speaker 303 or as an additional configuration.

  4A and 4B are diagrams illustrating an example of a screen of the touch panel 130 and a touch gesture operation in the touch panel input device 100 according to the embodiment. FIG. 4A shows a screen example 401 displayed in the display component operation mode. As shown in FIG. 4A, the screen example 401 displays various parts to be operated, such as a button 402 for directly selecting a selection value. By touch-inputting the area where the display component is displayed, the target component can be operated.

  FIG. 4B shows an example screen 403 displayed in the entire screen operation mode. As shown in FIG. 4B, the screen example 403 includes a display 404 of the currently selected value, or a display prompting an operation instruction for switching the screen (for example, a cancel area 405 described later). Indicated. As an input method on this screen, for example, information is input by the number of tap operations, a gesture that rotates the dial with two or more touches (dial gesture), and the like.

  A cancel area 405, which is a rectangular area surrounding “>> Cancel >>”, is shown at the bottom of the screen example 403 in FIG. 4B. Select the cancel area 405 and swipe (slide your finger from left to right in a predetermined direction) to cancel the entire screen operation mode and switch from the entire screen operation mode to the display component operation mode screen. Switching can be performed.

  FIG. 5 is a flowchart illustrating an operation (touch gesture determination method) of the touch gesture determination device 110 according to the embodiment. As shown in FIG. 5, in step ST401, the user activates the system in the display component operation mode and initializes each processing unit.

  In the next step ST402, the operation mode switching determination unit 12c determines switching input to the entire screen operation mode based on the touch information input from the operation information input unit 11. When switching input to the entire screen operation mode is accepted (YES in ST402), in the next step ST403, the operation mode is changed, and the display contents, input method, and notification method in the entire screen operation mode are switched.

  In next step ST404, the gesture input information determination unit 122 identifies information related to the gesture input from the touch information input by the user, and thereby determines the selection value A2. For example, the user inputs information using a gesture (dial gesture) that rotates the dial with two or more touches.

  In the next step ST405, the display value is switched by passing the selection value A2 determined in step ST404 to the display control unit 14, and a screen reflecting the operation content is displayed.

  In the next step ST406, the selection value A2 determined in step ST404 is passed to the notification unit 13, so that the notification content is switched, the notification of the situation after the operation result, and the announcement for prompting the operation are performed.

  In the next step ST407, the operation mode switching determination unit 12c determines a switching input to the display component operation mode from the touch information input from the operation information input unit 11 and the touch history information.

  If a switching input is detected (YES in ST407), in the next step ST408, the display component operation mode is entered, and the operation screen for the display component displayed at the initial startup is entered. When there is no switching input to the display component operation mode, the touch input to the operation panel unit 132 is received until the switching input is received, and the display content and the notification content are switched accordingly.

  In the input determination regarding the screen switching in step ST402, when the input content is not switching to the entire screen operation mode (NO in ST402), input determination for the display component is performed in the next step ST709.

  The determination of the input to the display component in the display component operation mode is performed based on whether the touch input coordinates are included in the operation range of the display component. When the operation input of the display component is detected, the selection value A2 is determined in the next step ST410. When the operation target is not the display component, the touch input is accepted again in step ST402.

  In next step ST410, the display component input determination unit 12a determines the selection value A2 based on the touch information input from the operation information input unit 11. As an example of selection, as shown in the display screen of each display component in FIG. 3, a display component assigned with a specific selection value such as a button is arranged, and the selection value is input by touch input to the display component. decide.

  In the next step ST411, by passing the selection value A2 determined in step ST410 to the display control unit 14, the display content of the display panel unit 131 is switched, and a screen corresponding to the operation content is displayed.

  In the next step ST412, the selection value A2 determined in step ST410 is transferred to the notification unit 13 to switch the notification content, to notify the situation after the operation result, and to announce the operation.

  FIG. 6 is a flowchart illustrating an example of the operation of the two-point touch operation determination process by the gesture input information determination unit 122 according to the embodiment. Hereinafter, an example of processing in which the gesture input information determination unit 122 determines that the user's touch gesture operation is a two-point touch operation performed by the user without looking at the touch panel will be described.

  As shown in FIG. 6, in step ST501, the gesture input information determination unit 122 determines whether the total movement amount in C0 msec of the two touch positions during the two-point touch operation is equal to or less than D0 pixel ( First determination condition: When the touch position during the two-point touch operation hardly moves).

  When the movement amount within C0 msec is equal to or less than D0 pixel (YES in step ST501), the process proceeds to next step ST502. On the other hand, when the movement amount within C0 msec is larger than D0 pixel (NO in step ST501), the process proceeds to step ST505, and the gesture input information determination unit 122 performs the touch gesture operation without performing the touch panel operation. It is determined that it is not.

  In the next step ST502, the gesture input information determination unit 122 determines whether or not the movement amount at C1 msec of the touch position of the one-point touch operation immediately before the two-point touch operation is equal to or less than D1 pixel (second determination condition: When the touch position of the one-point touch operation immediately before the two-point touch operation hardly moves).

  When the movement amount at C1 msec of the touch position of the one-point touch operation immediately before the two-point touch operation is equal to or less than D1 pixel (YES in step ST502), the process proceeds to next step ST503. On the other hand, when the movement amount in C1 msec of the touch position of the one-point touch operation immediately before the two-point touch operation is larger than D1 pixel (NO in step ST502), the process proceeds to step ST505, and the touch gesture operation is performed without looking at the touch panel. It is determined that this is not a two-point touch operation.

  In the next step ST503, the gesture input information determination unit 122 determines whether or not the movement amount in C2 msec of the touch position of the one-point touch operation immediately after the two-point touch operation is equal to or less than D2 pixel (third determination condition: When the touch position of the one-point touch operation immediately after the two-point touch operation hardly moves).

  When the movement amount in C2 msec of the touch position of the one-point touch operation immediately after the two-point touch operation is equal to or less than D2 pixel (YES in step ST503), the process proceeds to step S504, and the gesture input information determination unit 122 performs the touch gesture operation. Is determined to be a two-point touch operation performed without looking at the touch panel.

  On the other hand, when the movement amount in C2 msec of the touch position of the one-point touch operation immediately after the two-point touch operation is larger than D2 pixel (NO in step ST503), the process proceeds to step ST505, and the gesture input information determination unit 122 performs the touch gesture. It is determined that the operation is not a two-point touch operation performed without looking at the touch panel.

  As described above, when the gesture input information determination unit 122 in the embodiment satisfies all the first to third determination conditions, the touch gesture operation is a two-point touch operation performed without looking at the touch panel. A determination is made and a selection value A2 corresponding to the determined touch gesture operation is determined.

  On the other hand, when any one or more of the first to third determination conditions is not satisfied, the gesture input information determination unit 122 performs the touch gesture operation without touching the touch panel. It is determined that the operation is not an operation, and a selection value A2 corresponding to the determined touch gesture operation is determined.

  In the above description, the gesture input information determination unit 122 determines that the touch gesture operation is a two-point touch operation performed without looking at the touch panel when all the first to third determination conditions are satisfied. When one or more of the first to third determination conditions are satisfied, the touch gesture operation may be determined as a two-point touch operation performed without looking at the touch panel.

  For example, when the first determination condition and the second determination condition are satisfied, the touch gesture operation may be determined as a two-point touch operation performed without looking at the touch panel. Further, another condition may be added to the determination condition for the two-point touch operation performed without looking at the touch panel. Also, the first to third determination conditions may be used for a two-point touch operation performed while looking at the touch panel.

  FIG. 7 is a flowchart illustrating another example of the operation of the two-point tap determination process performed by the gesture input information determination unit 122 according to the embodiment. Hereinafter, another example of processing in which the gesture input information determination unit 122 determines that the touch gesture operation is a two-point touch operation performed without the user looking at the touch panel will be described.

  7, in step ST601, the gesture input information determination unit 122 determines whether the two-point touch operation duration is C3 msec or more (fourth determination condition: operation with long-time two-point touch ).

  When the two-point touch operation continuation time is C3 msec or longer (YES in step ST601), the process proceeds to step ST602, and the gesture input information determination unit 122 determines that the touch gesture operation is a two-point touch operation.

  When the two-point touch operation duration is less than C3 msec (NO in step ST601), the process proceeds to step ST603, and the gesture input information determination unit 122 determines that the touch gesture operation is not a two-point touch operation.

<< 3 >> Effect As described above, according to the touch gesture determination device 110 according to the embodiment, the touch gesture operation tendency when performing the two-point touch operation without looking at the touch panel is performed without looking at the touch panel. First to third determination conditions (or fourth determination conditions) for determining whether or not a two-point touch operation is performed are set, and the gesture input information determination unit 122 sets the first to third determination conditions ( Or the fourth determination condition) determines whether the touch gesture operation is a two-point touch operation performed without looking at the touch panel. This makes it possible to distinguish between a touch gesture operation performed while looking at the touch panel and a touch gesture operation performed without looking at the touch panel, and the touch panel easily recognizes the touch gesture operation performed without looking at the touch panel. be able to.

<< 4 >> Modification In the touch gesture determination device 110 according to the above embodiment, the two-point touch operation performed without looking at the touch panel is determined based on the first to third determination conditions (or the fourth determination condition). The touch gesture operation determined by the touch gesture determination device 110 according to the embodiment is not limited to the two-point touch operation. For example, a determination condition may be newly set for a three-point touch operation (an operation performed by touching three fingers) performed without looking at the touch panel, and the three-point touch operation may be determined.

  DESCRIPTION OF SYMBOLS 11 Operation information input part, 12 Operation determination part, 12a Display component input determination part, 12b Whole screen input determination part, 13 Notification part, 14 Display control part, 100 Touch panel input device, 110 Touch gesture determination apparatus, 121 Parameter adjustment part, 122 gesture input information determination unit, 130 touch panel, 131 display panel unit, 132 operation panel unit, 301 processor, 302 memory, 303 speaker, A0 operation information, 401,403 screen example, 405 cancel area, A1 input information, A2 selection value , A3 notification information, A4 operation determination information.

Claims (11)

A touch gesture that displays an operation image on a screen, receives a touch gesture operation of a user, receives the operation information from a touch panel that outputs operation information corresponding to the touch gesture operation, and generates output information based on the operation information. A determination device ,
Based on the previous SL operation information, the operation determination unit configured to generate the output information for display of the touch panel,
A display control unit that receives the output information and causes the touch panel to display an image corresponding to the output information as the operation image;
The operation determination unit may determine the output information from the operation information corresponding to the touch gesture operation performed in identifying the entire screen operation mode input content based on the touch gesture operation performed on the entire screen of the touch panel A whole screen input determination unit
Whether the previous SL entire screen input judging unit, from the operation information, the determination condition for the touch gesture operation is determined whether steering Sakudea Luca whether said user has performed in the entire screen operation mode is satisfied And determining that the touch gesture operation is the first operation in the entire screen operation mode when the determination condition is satisfied ,
The touch gesture determination device , wherein the determination condition is a predetermined condition based on a change in the number of touches of the touch gesture operation and a movement amount of a touch position at a predetermined time . The touch gesture determination device according to claim 1 , wherein the first operation includes a two-point touch operation in which two fingers of the user simultaneously touch the touch panel. The determination condition is as follows:
The first determination condition total movement amount is condition Ru first value Der below a predetermined in a first predetermined time of the touch position of the two points in the two-point touch operation,
Second determination condition amount of movement is condition Ru der following second predetermined value in the second predetermined time of the touch position of the 1-point touch operation of the two-point touch operation immediately before,
And the third determination condition amount of movement is condition Ru third value Der below a predetermined in a third predetermined time of the touch position of the 1-point touch operation immediately after the two-point touch operation,
The touch gesture determination device according to claim 2 , wherein the touch gesture determination device includes all of the above. The touch gesture determination device according to claim 1 , wherein the first operation includes a three-point touch operation in which three fingers of the user simultaneously touch the touch panel. The operation determination unit is
The output information from operation information corresponding to the touch gesture operation performed in the display component operation mode for identifying the input content based on the touch gesture operation performed on the display component displayed as the operation image on the touch panel. A display component input determination unit for determining
The display component operating mode and touch gesture determination apparatus according to any one of claims 1 4, characterized by further having: an operation mode switching unit to switch between the entire screen operation mode. It receives the operation information output from the touch panel, any one of claims 1 to 5, characterized by further comprising an operation information input unit that outputs input information corresponding to the operation information to the operation determining unit received The touch gesture determination device according to claim 1. Issue a notice of notification content corresponding to the output information, or according to any one of claims 1 to 6, further comprising a notification unit for outputting a notification signal notification content in accordance with the output information Touch gesture determination device. A touch gesture that displays an operation image on a screen, receives a touch gesture operation of a user, receives the operation information from a touch panel that outputs operation information corresponding to the touch gesture operation, and generates output information based on the operation information. A determination method comprising :
Based on the previous SL operation information, the operation determination step of generating the output information for display of the touch panel,
A display control step of receiving the output information and causing the touch panel to display an image according to the output information as the operation image;
The operation determining step includes determining said output information from the operation information corresponding to the touch gesture operation performed in identifying the entire screen operation mode input content based on the touch gesture operation performed on the entire screen of the touch panel A whole screen input determination step to
The entire screen input determination step, whether before Symbol operation information, the determination condition for the touch gesture operation is determined whether steering Sakudea Luca whether said user has performed in the entire screen operation mode is satisfied And determining that the touch gesture operation is the first operation in the entire screen operation mode when the determination condition is satisfied ,
The touch gesture determination method , wherein the determination condition is a predetermined condition based on a change in the number of touches of the touch gesture operation and a movement amount of a touch position at a predetermined time . On the computer,
To display an operation image on the screen, accept a user's touch gesture operation, receive operation information from a touch panel that outputs operation information corresponding to the touch gesture operation, and generate output information based on the operation information ,
An operation determination process for generating output information for display on the touch panel based on the operation information;
Receiving the output information, and causing the touch panel to display an image according to the output information as the operation image,
The operation determination processing, determining the output information from the operation information corresponding to the touch gesture operation performed in identifying the entire screen operation mode input content based on the touch gesture operation performed on the entire screen of the touch panel The whole screen input judgment process to
The entire screen input determination process, whether or not the previous SL operation information, the determination condition for the touch gesture operation is determined whether steering Sakudea Luca whether said user has performed in the entire screen operation mode is satisfied And determining that the touch gesture operation is the first operation in the entire screen operation mode when the determination condition is satisfied ,
The touch gesture determination program , wherein the determination condition is a predetermined condition based on a change in the number of touches of the touch gesture operation and a movement amount of a touch position at a predetermined time . A touch panel that displays an operation image on a screen, accepts a user's touch gesture operation, and outputs operation information corresponding to the touch gesture operation;
A touch gesture determination apparatus that receives the operation information and controls a display of the touch panel based on the operation information;
The touch gesture determination device includes:
An operation determination unit that generates output information for display on the touch panel based on the operation information;
A display control unit that receives the output information and causes the touch panel to display an image corresponding to the output information as the operation image;
The operation determination unit may determine the output information from the operation information corresponding to the touch gesture operation performed in identifying the entire screen operation mode input content based on the touch gesture operation performed on the entire screen of the touch panel A whole screen input determination unit
The entire screen input determination unit, whether or not the previous SL operation information, the determination condition for the touch gesture operation is determined whether steering Sakudea Luca whether said user has performed in the entire screen operation mode is satisfied And determining that the touch gesture operation is the first operation in the entire screen operation mode when the determination condition is satisfied ,
The touch panel input device , wherein the determination condition is a predetermined condition based on a change in the number of touches of the touch gesture operation and a movement amount of the touch position at a predetermined time . The touch panel
An operation panel unit that receives the touch gesture operation and outputs operation information corresponding to the touch gesture operation, and a display panel unit that is arranged to overlap the operation panel unit and displays the operation image on the screen. The touch panel input device according to claim 10 .

Images