JP2017037583A - Computer input system - Google Patents

Abstract

An input device capable of providing vibration feedback with a stable strength regardless of how to use or use a computer device such as a touch screen device using an image keyboard. An input system that performs input to a computer includes a virtual keyboard that generates an input signal to the computer in response to an operation on the image keyboard, and an actuator that can be experienced in response to the generation of the input signal. And a mounting body configured to be mounted on the body separately from the virtual keyboard. [Selection] Figure 1

Description

  The present invention relates to a computer input system, and more particularly to a technique for improving input operability in a virtual keyboard, and further to a sensation feedback technique adapted to an input operation on a virtual keyboard.

  In an information processing device (computer device) using a CPU such as a smartphone or a tablet computer, an on-screen keyboard is used instead of a so-called physical keyboard that has been conventionally used as an input device for inputting characters and the like to the information processing device. It has been. The touch screen generally includes a display unit that displays information output from the information processing device, and a touch panel unit that inputs a contact position such as a finger / touch pen and a physical quantity (capacitance, pressure, etc.) associated with the contact to the information processing device. It is composed by overlapping. On-screen keyboard displays the same image (clock face image) as the keys on the conventional physical keyboard on the touch screen, and the keys pressed on the touch panel by the input operation of touching the fingertip or touch pen on the face image Character input is realized by detecting the position of and outputting the corresponding key code. There has also been proposed a projection type keyboard that projects a dial image on a desk or the like, detects the position of the fingertip, and discriminates the pressed key. Such a keyboard other than a physical keyboard used as an input device of a computer device is called a virtual keyboard, a screen keyboard, a software keyboard or the like (hereinafter referred to as “virtual keyboard”). Since the keys of the virtual keyboard have no physical unevenness or inclination, it is difficult for the user to position the finger. Further, since there is no movement or reaction associated with the pressing operation unlike the physical keyboard, the experience of the input operation is poor. Since the user performs a touch operation while looking at the image of the virtual keyboard, it takes time to input the virtual keyboard as compared to the physical keyboard, and there is a tendency that erroneous input also increases.

  In order to solve such a problem, Patent Document 1 discloses that a touch panel keyboard device is provided with a vibration motor that vibrates in conjunction with touch detection to notify that an input operation surface has been touched. Japanese Patent Application Laid-Open No. 2004-228688 discloses that notification is made by vibration, light emission, or sound when the home position of the image keyboard displayed on the LCD touch panel is at the touch position. In Patent Document 3, in an information processing apparatus (notebook personal computer) having an image keyboard of an LCD touch panel, when a touch operation is performed on a key of the keyboard, the image of the key is changed to a different display form and a personal computer is connected with a vibration module. Disclosure of vibrating body. Patent Document 4 discloses that when at least one input unit (key) of an image keyboard of an LCD touch panel generates an input signal, the presentation unit generates a confirmation message (voice, light, vibration, smell).

JP 2011-154561 A Republished WO2012-108342 2011-186819 JP 2013-89244 A

As described above, the usability of the virtual keyboard is improved to some extent by incorporating a vibrating body into a computer device equipped with a virtual keyboard and giving physical feedback similar to that of the physical keyboard by giving physical feedback by vibration during touch operations. Is possible.
However, the physical feedback strength experienced may vary depending on how the computer device using the virtual keyboard is used. For example, in the case of a smartphone with a built-in vibrating body equipped with a virtual keyboard, if you hold the smartphone in your hand and perform an input operation, the vibration of the smartphone is transmitted directly to your hand and you can feel the necessary vibration feedback, When an input operation is performed on the screen, vibration is dispersed on a desk or the like and vibration feedback is weakened. Moreover, since the contact part of a vibration part and a hand reduces, the bodily sensation of vibration feedback also becomes weak.

  Recently, there is a tendency to increase the size of touch screens used for virtual keyboards. A large touch screen tends to have a tendency (intensity unevenness) in the strength of physical feedback to be experienced depending on the position of an input operation. Increasing the size of the touch screen increases the energy required for generating perceptible physical feedback, causing problems such as increased power consumption, generation of noise associated with vibration, and increased unnecessary vibration of the entire device.

  Accordingly, an object of the present invention is to provide an input system capable of providing vibration feedback with a stable strength regardless of how to hold and use an input device such as a touch screen device used for a virtual keyboard. A further object of the present invention is to provide physical feedback capable of suppressing an increase in power, noise, and unnecessary vibration even when a touch screen device including a virtual keyboard is enlarged.

  To achieve the above object, according to an embodiment of the present invention, there is provided a virtual keyboard that generates an input signal to the computer in response to an operation on the image keyboard in which an input key is displayed as an image or a figure in an input system that performs input to the computer. And an attachment that is configured to be attachable to the body separately from the virtual keyboard and an actuator that can be experienced by the user of the virtual keyboard in response to the generation of the input signal. Input system.

  With this configuration, the user of the virtual keyboard directly receives the sensation feedback when operating the image keyboard, not from the virtual keyboard or the computer device, but from the wearing body attached to the body. This makes it possible to avoid changes in vibration feedback due to how the computer device is held or used. In addition, since the actuator that generates sensation feedback is separate from the virtual keyboard, it is possible to provide physical feedback that can suppress an increase in power, noise, and unnecessary vibration even when the touch screen device is enlarged. It becomes.

  The virtual keyboard includes display means for displaying the image keyboard, input signal generation means for generating an input signal by detecting an operation on the image keyboard, and an operation command signal corresponding to the generation of the input signal. It is desirable to provide an operation signal generating means for supplying to the actuator. Thus, when the virtual keyboard is operated, an electrical signal is sent to an actuator provided in a separate mounting body.

  The virtual keyboard preferably includes one of an LCD touch panel, an OLED touch panel (organic EL display), an electrophoretic touch panel, and a projection keyboard. It may be a virtual keyboard formed by connecting a separate image display and touchpad to a computer device. The LCD touch panel is configured by combining an LCD panel (liquid crystal display panel) for displaying an output image of a computer device and a transparent touch pad for inputting a position on the screen with a finger. The OLED touch panel is configured by combining an OLED panel (organic EL display) capable of displaying an output image of a computer device and a transparent touch pad for inputting a position on the screen with a finger. The electrophoretic touch panel is configured by combining an electrophoretic panel (electronic paper) and a transparent touch pad for inputting a position on the screen with a finger. The combination includes the case where the function of the touch panel portion is made on the substrate of the display, and the display panel and the touch panel separately manufactured are bonded and integrated. The projection type keyboard projects a keyboard image on a desk by a projector, and when a projected image key is touched with a finger, the discrimination device discriminates the corresponding key and outputs a corresponding code such as a character. It is. A virtual keyboard may be configured by adding a planar touchpad to the computer device.

  It is desirable that the type (for example, code code) of the operation command signal is set corresponding to information carried by the input signal. Thereby, the operation mode (motion amplitude, frequency and time (motion waveform)) of the actuator can be set, and a plurality of information associated with the key operation can be fed back to the user according to the difference in bodily sensation.

  The information that the input signal bears is the generation of the input signal by operating the image keyboard, the setting and changing of the input mode (for example, upper and lower case, Japanese, English, German, Chinese mode setting and changing), It is desirable to include at least one of the operation errors of the image keyboard (for example, when the user touches two keys at the same time). As a result, the user feels the key operation feeling in a pseudo manner through the actuator as the image keyboard is operated. In addition, it is possible to perform keyboard operations upon receiving feedback of body vibration corresponding to information related to key operations.

  It is preferable that the operation command signal is wired or wirelessly transmitted to the mounting body as a code signal carrying control information of the actuator. By digitizing the signal, it becomes easy to standardize the connection interface of the mounting body, and various mounting bodies can be used.

  Desirable operations of the actuator include vibration, movement (including hitting), rotation, electrical stimulation from electrodes, and the like of the members experienced by contact. Further, it may be signal sound generation from a transducer (speaker), light emission from a light emitter, or the like.

  It is desirable that there are a plurality of the mounted bodies. For example, when the attached body is attached to each of the left and right arms, the left-handed operation feedback uses the attached body actuator attached to the left arm, and the right-handed operation feedback uses the attached body actuator attached to the right arm. It is desirable to use it. Thereby, more realistic sensation feedback is formed.

  The wearing body is configured separately from a virtual keyboard such as a belt, a ring, a wristwatch, a bracelet, a necklace, an earring, glasses, an earpiece, an earphone, a hat, or a helmet that is worn on the wrist or torso of the user. It is desirable that the shape be attachable. Since it is in contact with the user's body, it is possible to obtain stronger sensation feedback.

  According to the technology of the present invention, the sensation feedback mechanism of the virtual keyboard is realized by an actuator provided in a wearable device separate from the virtual keyboard. It is possible to realize an input system capable of providing vibration feedback with a stable strength regardless of how to use or use an input device such as a touch screen device used for a virtual image keyboard. Furthermore, even if a touch screen device including a virtual keyboard is increased in size, it is possible to obtain physical feedback that can suppress an increase in power, noise, and unnecessary vibration.

It is explanatory drawing explaining the mounting body which incorporates the computer apparatus provided with a virtual keyboard, and the actuator comprised separately from the computer apparatus. It is explanatory drawing explaining the example of a tablet computer provided with a virtual keyboard. It is a block diagram explaining the control system of a computer apparatus provided with a virtual keyboard and a mounting body. It is a flowchart explaining control of the actuator of a mounting body. It is a block diagram explaining the control system of a computer apparatus provided with a virtual keyboard and a some mounting body. It is a flowchart explaining control of the actuator of a some mounting body. It is explanatory drawing explaining the example of a smart phone provided with a virtual keyboard. It is explanatory drawing explaining the example of a projection-type virtual keyboard. It is explanatory drawing explaining the example which connects a touchpad to a notebook computer and uses a virtual keyboard. It is explanatory drawing explaining the example which connects and uses an external tablet computer and a virtual keyboard. It is explanatory drawing explaining the structural example of a virtual keyboard. It is explanatory drawing explaining the structural example of a flat keyboard.

  In the present invention, an input system that performs input to a computer device includes a virtual keyboard that generates an input signal to the computer and a mounting body that is worn on the body of the user of the virtual keyboard. The mounting body is separate from the virtual keyboard and is configured outside the casing of the computer device or outside the casing of the virtual keyboard. An actuator for providing feedback to the user's body of the virtual keyboard is disposed on the wearing body. This actuator operates in accordance with the operation of the virtual keyboard. The computer device or virtual keyboard and the mounting body are connected by wire or wirelessly. The computer input system of the present invention will be described below with reference to the drawings.

  1 to 4 show a first embodiment of the present invention. In the drawings, corresponding parts are denoted by the same reference numerals, and description thereof will be omitted. Further, since the present invention relates to the virtual keyboard of the computer apparatus, the operation of other parts of the computer apparatus will not be mentioned.

  As shown in FIG. 1, a virtual keyboard 200 is provided in the computer device 100. The computer device 100 is a device that performs digital information processing using a CPU, and corresponds to, for example, the tablet computer shown in FIGS. The computer apparatus 100 includes a ROM 110 that stores a control program and a database in a nonvolatile manner, a CPU 112 that executes data processing according to a control program stored in advance, a RAM (Random Access Memory) 114 having a relatively large storage capacity, and an LCD panel 212. It includes an image memory 116 for storing image data to be displayed, a communication interface 118 for exchanging signals with the outside, a virtual keyboard 200, and the like. This includes smartphones (see FIG. 7), notebook computers (see FIG. 9), and the like. Any computer device that can use at least the virtual keyboard 200 as an input device may be used, and the computer device 100 is not limited to a specific type of computer device. Alternatively, the virtual keyboard 200 may be disposed outside the casing of the computer device 100 and electrically connected to each other (see FIGS. 10 to 12).

  For example, as shown in FIG. 3, the virtual keyboard 200 includes an LCD touch panel 210 and elements related to sensation feedback. The LCD touch panel 210 is integrally formed by attaching a transparent touch pad 214 for inputting a two-dimensional position to an LCD panel (liquid crystal display) 212 that displays an image keyboard 216 that displays keys representing various characters to be input as images. It is configured.

As elements related to the sensation feedback, a determination unit 230 (see FIG. 4) for performing touch output determination and output of an input signal to the computer device, which will be described later, a signal generation unit 240 for forming an operation command signal corresponding to the determination result, There is a communication interface 118 that transmits an operation command signal to the wearing body 300 side.
Here, the LCD panel 212 of the embodiment corresponds to a display unit, the touch pad 214 and the determination unit 230 correspond to an input signal generation unit, and the signal generation unit 240 corresponds to an operation signal generation unit.
Note that the components and the control program of the computer device 100 may correspond to the components of the virtual keyboard 200. For example, the communication function of the computer device can be used as the communication interface 118, and the determination unit 230 and the signal generation unit 240 can be realized by the resources and software of the CPU 112 of the computer device instead of the original CPU.

  As shown in FIG. 4, the determination unit (CPU) 230 observes the contact detection output SG <b> 1 that the LCD touch panel 210 detects contact in response to the user's finger operation, and the contact position output SG <b> 2 that corresponds to the finger contact position. (Step S10). For example, it is determined whether the fingertip touches or the palm touches according to the contact area, and when it is determined that the fingertip is detected, the contact detection SG1 is output. Thereby, erroneous input (noise) is reduced. If contact of the finger with the touch panel is not detected, the standby state is continued (step S12; No, end).

  When it is detected that the finger has touched the touch panel (step S12; Yes), a contact detection process is performed (step S20). The determination unit (CPU) 230 instructs the signal generation unit 240 to output the operation command signal 1 in response to the contact detection (step S22), ends the processing (step S60), and returns to the standby state (S12).

  If it is detected that the finger has touched the touch panel (step S12; Yes), the contact position output SG2 is read (step S14), and the contact position, the key display position of the image keyboard stored in advance, and the corresponding position are read. A character / symbol corresponding to the touched key is read with reference to a table with the corresponding code of the key (step S16). Based on the result of the reading (step S18), when the input corresponds to the input of a character / symbol (step S30), the character code or the like is sent as an input signal to the computer device and the character code or the like is sent to the signal generator 240. The output of the operation command signal 2 corresponding to the input is instructed (step S32), and the process is terminated (step S60). Thereafter, the process returns to the standby state (S12).

  If the result of the reading (step S18) corresponds to an operation for changing the input mode such as switching of the character system (step S40), a signal for instructing the change of the input mode is sent as an input signal to the computer device and the signal The generator 240 is instructed to output the operation command signal 3 corresponding to the change of the input mode (step S42). Examples of input mode changes include switching between English mode and Japanese mote, switching between uppercase and lowercase letters, and switching to special symbol input. Thereafter, the process is terminated (step S60), and the process returns to the standby state (S12).

  As a result of the reading (step S18), when the input operation corresponds to an error input operation such as a touch to a position shifted from the key position of the image keyboard or an operation of touching two keys (step S50), An input error is sent out, and the signal generator 240 is instructed to output an operation command signal 4 corresponding to the operation error (step S42). Thereafter, the process is terminated (step S60), and the process returns to the standby state (S12).

  The signal generator 240 sends an operation command signal n (n is any one of 1 to 4) corresponding to the communication interface 118 in response to the output commands of the operation command signals 1 to 4 from the determination unit 230. The communication interface 118 transmits the operation command signal n to the communication interface 312 on the wearing body, preferably by wireless communication. For the wireless communication, for example, a known Bluetooth (registered trademark) standard can be used. A wireless LAN may be used. If there is no problem with the connection wiring, a wired connection may be used. Infrared communication may be used as long as there is no problem with a light shielding object.

  The mounting body 300 is configured separately from the computer device 100 and the virtual keyboard 200 and is mounted on the user's wrist, arm, or the like. The wearing body 300 is convenient for wearing on a body such as a belt shape, a ring shape, a watch shape, a bracelet shape, a necklace shape, an earring shape, a glasses shape, an earpiece shape, an earphone shape, a hat shape or a helmet shape. It has a good shape and is equipped with wearing tools such as a band, a ring, a pin, a chain and a vine for wearing on the body as needed so that it can be worn on the body. The mounting body 300 is provided with a communication interface 312, a control unit 314, a drive unit 316, an actuator 318, and the like. Each unit operates using a rechargeable battery (not shown) as a power source. When receiving the radio signal transmitted from the computer apparatus 100 side, the communication interface 312 demodulates the radio signal and extracts the operation command signal n. The operation command signal n is sent to a control unit 314 composed of a CPU. The control unit 314 stores in advance a signal waveform to be output corresponding to the operation command signal n in a storage table. The control unit 314 sends a drive signal corresponding to the operation command signal n to the drive unit 316. The drive unit 316 is a power amplifier and amplifies the drive signal to supply it to the actuator 318. The actuator 318 performs an operation that can be sensed by the user of the virtual keyboard 200, and is, for example, a vibrating body, a hitting operation body, an electrode for applying electrical stimulation, or the like.

  For example, when the user wears the wristwatch-shaped wearing body 300 on the wrist and touches the image of the virtual keyboard 200, the operation command signal 1 is transmitted to the wearing body 300, and the vibration of the first pattern is transmitted to the wrist, and is simulated. A feeling of key operation is obtained. When the user correctly touches the image key, the input character is recognized and the operation command signal 2 is transmitted to the wearing body 300, and the user feels that the vibration of the second pattern is transmitted to the wrist and is correctly input. Further, when the user touches two image keys at the same time, an operation error is discriminated and the operation command signal 4 is transmitted to the wearing body 300, so that the vibration of the fourth pattern is transmitted to the wrist and recognized as an input error. The For example, the vibration of the first pattern is set to be a low frequency weak vibration, the vibration of the second pattern is a weak vibration of a higher frequency, and the vibration of the fourth pattern is set to a high frequency of strong vibration. Can do. These vibration characteristics can be tailored to your liking. For example, presence / absence of vibration, vibration rising characteristics, vibration frequency, vibration strength, vibration duration, number of vibration repetitions, etc. can be set for each operation command signal.

  The actuator 318 includes an electromagnet vibrating body that swings in response to the supply of an electric signal, a rotating motor, a vibrating body that generates vibration by rotating an eccentric weight, a voice coil motor that reciprocates, and a reciprocating motion or changing a moving position. The amount of protrusion of the contact pin that protrudes out of the housing of the mounting body 300 and contacts the skin (or hits the skin) and the protrusion pattern of the plurality of contact pins according to the electrical signal It may be a pin protruding type actuator (or a type that taps the skin) to be controlled, an actuator that applies electrical stimulation to the skin from an electrode, or the like. Further, signal sound generation, light emission from a light emitter, and the like may be accompanied with the operation of the actuator.

Next, a case where a plurality of mounting bodies 300 are used for an input operation from the virtual keyboard will be described with reference to FIGS.
As shown in FIG. 1, a plurality of mounting bodies 300a to 300c can be used for one virtual keyboard. However, in the control mode shown in FIG. 4, each mounting body 300a to 300c outputs the same operation command signal. Receive and do the same. However, when the same user wears the watch-like wearing body 300a on the left arm and the bracelet-like wearing body 300c on the right arm, the convenience is improved if controlled separately.
In the embodiment shown in FIGS. 5 and 6, an example in which the left arm mounting body 300a and the right arm mounting body 300c operate separately will be described. In each figure, parts corresponding to those in FIGS. 3 and 4 are given the same reference numerals, and description thereof is omitted.

  In the example shown in FIG. 5, the area of the touch pad 214 is divided into a left area 214a and a right area 214b. Consider a case where the user performs a keyboard operation on the left region 214a by a left hand operation and performs a keyboard operation on the right region by a right hand operation. Wireless channels (wireless communication routes) are individually set for the communication interfaces of the wearing bodies 300a and 300b. In addition, as for how to divide the area, each key of the keyboard may be grouped and associated with the wearing body 300n.

  The operation of the determination unit 230 in the example shown in FIG. 5 will be described with reference to FIG. In this example, the touch position output SG2 in the flowchart of FIG. 4 described above is read (step S14), and the key selected by referring to the table of the touch position, the key display position of the image keyboard stored in advance, and the corresponding code. In the process of reading the character / symbol etc. corresponding to (step S16), the comparison between the preliminarily stored areas 214a and 214b and the contact position is added to determine which area corresponds. Thereby, the transmission of the operation command signal n to the mounting body 300a or 300c assigned in advance to the region is determined. In this embodiment, a communication channel selection operation (steps S24, S34, S44, S54) for the communication interface 118 is added after the output process of the operation command signal n (steps S22, S32, S42, S52).

  In the communication channel selection, the operation command signal is individually distributed to the mounting body 300n by setting, in the communication interface 118, an individual wireless channel previously assigned to the mounting body 300a or 300c associated with the region of the contact position. can do. With such a mechanism, when the image key in the region 214a on the touch panel is subjected to a slack operation, sensation feedback is provided to the wearing body 300a worn on the left arm. When the image key in the region 214b on the touch panel is manipulated, sensation feedback is given to the wearing body 300b worn on the right arm.

  In this way, the mounting body n set in advance from the plurality of mounting bodies can be operated corresponding to the area set on the virtual keyboard. Thereby, for example, the left actuator operates when the left area of the virtual keyboard is operated, and the right actuator operates when operated in the right area of the virtual keyboard.

  FIG. 7 shows a smartphone incorporating a virtual keyboard and a computer as an example of a computer device. The user can connect the smartphone and the wearable body by wireless or wired communication and receive sensation feedback when inputting a virtual keyboard.

  FIG. 8 shows a projection type virtual keyboard as an example of a virtual keyboard. The mechanism of this keyboard is that the shape of the full keyboard is projected on the desk or wall with a laser beam from the projector, and when the projected individual keys are touched with a finger, the camera detects and recognizes it as a key touch It is. The technology of the present invention can also be applied to such a virtual keyboard.

  In FIG. 9, a touch pad is connected to a notebook computer, a keyboard image is displayed on the screen of the notebook computer, and a virtual keyboard is configured using the touch pad as a pointing device. The technology of the present invention can also be applied to such a virtual board.

  10 and 11 show an example in which a single virtual keyboard having a larger size and better operability is connected to a small tablet computer. As shown in FIG. 11, the virtual keyboard includes an LCD touch panel in which an LCD panel 212 and a touch pad 214 are combined, an image memory 116 that stores a keyboard image and sends an image signal to the LCD panel 212, and a touch output is read at a touch position. A discrimination unit 230 that discriminates characters and the like, a signal generation unit 240 that transmits an input signal such as the discriminated character code to the computer, a communication interface 118 that transmits a signal corresponding to the operation to the wearing body, and the like. The technology of the present invention can also be applied to a device using such a single virtual keyboard.

  FIG. 12 shows an example of a flat keyboard suitable for use in a tablet computer or the like. In this example, the LCD keyboard is removed from the virtual keyboard shown in FIG. 11, and a flat keyboard in which a keyboard pattern (FIG.) Is printed on a touch pad is used as an image keyboard. Even such a configuration can be used as a virtual keyboard. The technique of the present invention can also be applied to this example.

  As described above, in the technology of the present invention, the sensation feedback of the key operation in the virtual keyboard is performed on the actuator of one or a plurality of wearing bodies (wearable devices) attached to the body of the computer user. When an actuator is installed in a computer device, for example, attenuation of sensation vibration, variation in vibration intensity depending on location, increase in energy of sensation feedback due to enlargement of LCD touch panel, increase in power consumption, generation of noise due to vibration, Eliminate unnecessary vibration of the entire device).

  FIGS. 3 and 5 are merely a simplified description of the main hardware configuration and connection relations related to the present embodiment in order to describe the present embodiment. In addition to those mentioned above, many devices are used to configure a tablet computer. However, they are well known to those skilled in the art and will not be described in detail here. A person skilled in the art also arbitrarily selects a plurality of blocks described in the figure as one integrated circuit or device, or conversely, a block is divided into a plurality of integrated circuits or devices. Is included in the scope of the present invention. In addition, the types of buses and interfaces connecting the devices are merely examples, and other connections are included in the scope of the present invention as long as those skilled in the art can arbitrarily select them. It is.

In the embodiments, a virtual keyboard that is more suitable as an input device for a small computer device suitable for carrying is described. However, it is a matter of course that the virtual keyboard of the present application can also be used for a fixed computer device. .
Although the present invention has been described with the specific embodiments shown in the drawings, the present invention is not limited to the embodiments shown in the drawings, and is known so far as long as the effects of the present invention are achieved. It goes without saying that any configuration can be adopted.

  The present invention relates to a virtual keyboard as an input device of various computers, and improves the ease of use of the virtual keyboard when applied to an information processing apparatus.

100 Computer device 110 ROM
112 CPU
114 RAM
116 Image memory 118 Communication interface 200 Virtual keyboard 210 LCD touch panel 214 Touch pad 216 Image keyboard 230 Discrimination unit 240 Signal generation unit 300 Mounted body 312 Communication interface 314 Control unit 316 Drive unit 318 Actuator

Claims (8)

An input system for inputting to a computer,
A virtual keyboard for generating an input signal to the computer in response to an operation on an image keyboard displaying an input key as an image or a figure;
An input comprising: an actuator that includes an actuator that can be experienced by a user of the virtual keyboard in response to the generation of the input signal, and is configured to be attached to the body separately from the virtual keyboard. system.   The virtual keyboard includes display means for displaying the image keyboard, input signal generation means for detecting an operation on the image keyboard and generating the input signal, and an operation command signal corresponding to the generation of the input signal. The input system according to claim 1, further comprising: an operation signal generation unit that supplies the actuator.   The input system according to claim 1, wherein the virtual keyboard includes any one of an LCD touch panel, an OLED touch panel, an electrophoretic touch panel, a projection keyboard, and a combination of a separate image display and a touch pad.   The input system according to claim 2, wherein the type of the operation command signal is set corresponding to information carried by the input signal.   5. The input system according to claim 4, wherein the information carried by the input signal includes at least one of generation of the input signal by operation of the image keyboard, change of an input mode, and an operation error of the image keyboard.   The input system according to claim 2, wherein the operation command signal is wired or wirelessly transmitted to the mounting body as a code signal carrying control information of the actuator.   The input system according to claim 1, wherein the sensible operation of the actuator includes any one of vibration, movement, rotation of a member, generation of a signal sound from a transducer, and electrical stimulation from an electrode.   The input system according to any one of claims 1 to 7, wherein a plurality of the mounting bodies are provided.

Images