JP3939709B2 - Information input method and information input / output device - Google Patents

Description

The present invention relates to an information input method and an information input and output equipment, in particular, ATM (Automatic Teller Machine) or information by using a number touch for use in the kiosk terminal input method and touch input unit information input and output device having About.

Currently, terminals that combine touch control input and display devices such as LCD (liquid crystal display panel) and CRT are widely used in ticket vending machines and ATMs. There is a feature that can accept.
In addition, since the displayed menu buttons can be directly touched and input, it is similar to the actual button operation compared to an indirect input device such as a mouse or keyboard, so it is convenient for first-time users. It is considered a good terminal.
However, since the physical positions of the touch control and the display device are different, there is a problem that the input position by the display object and the touch control is shifted depending on the viewpoint, which causes many erroneous inputs.
Furthermore, the nature of the device itself used for touch control has problems such as reacting before touching the actual panel, and not responding unless the finger is touched firmly. However, it is not always easy for many users to use.
In order to make it easier for the user to detect that the terminal has been touched, it may be possible to react quickly to touching it, but it may also be detected if the user touches it unconsciously. On the contrary, it also increases the chances of incorrect input.
As a measure to reduce erroneous input under such circumstances, there is a time delay for releasing a finger when a reaction time is increased and a misoperation is noticed.

Although it is a measure to reduce erroneous input by accepting input while wondering where to touch by extending the reaction time, the user himself recognizes where he is touching However, it is not a fundamental solution to reduce erroneous input.
In addition, as a method for allowing the user himself / herself to recognize which place is being touched, there are methods such as changing the color of the touched part, vibrating, or generating a sound when receiving an input.
With these methods, it is possible to recognize whether the user is touching or whether an input is accepted.
However, since it is difficult to say that color changes, vibrations, and sounds are natural responses to touch input, it is difficult to instantly determine that they are responses to input, and that operation requires some familiarity. It is.
For this reason, there is a problem that the convenience cannot be greatly improved for the first time use or for a user who uses less frequently.
On the other hand, there is an attempt to improve the operability of touch control by using two touch panels (see Non-Patent Document 1 below).
This attempt is made by combining the two-layer touch control and the indication that the touch input is detected by the lower touch panel by displaying the enlarged part of the touch control by making it two layers and displaying the final input. Have proposed input terminals.

As prior art documents related to the invention of the present application, there are the following.
Junichi Kyokumoto, “Interactive Systems and Software IX” Japan Software Science Society WISS2001, Modern Science, 2001, p.215-216)

However, in the terminal described in Non-Patent Document 1 described above, it is necessary to match the detection positions detected by the two touch controls. However, it is inevitable that the position is shifted when the viewpoint is changed.
Further, it has been proposed to enlarge and display the vicinity when a position is detected in the upper layer, but if the image is simply enlarged, the entire image will be lost. In addition, when the image is partially enlarged, a problem that a portion that cannot be displayed appears or a portion that is greatly distorted appears.
The present invention has been made to solve the above-described problems of the prior art, and the object of the present invention is that the user himself / herself does not know whether the input is properly performed when inputting by touch control input. in the thus induce erroneous input drawbacks, Ru near to provide an information input method and an information input-output device by the touch control that solves without reducing convenience.
The above and other objects and novel features of the present invention will become apparent from the description of this specification and the accompanying drawings.

Of the inventions disclosed in this application, the outline of typical ones will be briefly described as follows.
The most important feature of the present invention is that the response of input by touch control is expressed using a three-dimensional display.
That is, the position information detected by the touch control is displayed by changing the position and shape of the object displayed in the depth direction on the input screen, and the response to the input information received by the touch control is presented by a method different from the above.
In the information input / output device of the present invention, input menu items are displayed, and the menu selected and pointed out by the operator is sunk (or floated) from the operator.
That is, by changing the depth position of the menu displayed on the three-dimensional display device, the operator is made to recognize the position detected by the information input / output device. If the depth position of the menu displayed on the three-dimensional display device changes continuously, it can be confirmed that the input is continuously received.
In the process of changing the depth position of the menu displayed on the three-dimensional display device, the operator confirms whether the device has selected the object he / she wants to select, and continues the state if the object is to be selected. Input is executed.
The conventional technique is that the operator can confirm whether the information input / output device senses the place to be operated by changing the depth position of the object by three-dimensional display, and after a predetermined time has passed, the information The difference is that the input / output device accepts input.

In an input method using a conventional touch panel, an input is determined without intuitively giving the operator information on the location sensed by the apparatus, and therefore, malfunctions are likely to occur.
On the other hand, in the information input method of the present invention, the position sensed by the information input / output device with respect to the position indicated by the operator is displayed in the depth direction displayed on the three-dimensional display device of the sensed object. Can be presented to the operator by a method of changing.
Since the depth position is changed, there is no display shape change such as distortion in the two-dimensional plane, so it is possible to determine whether the location pointed to is appropriate without giving the operator a sense of incongruity it can.
The input is accepted by the device by continuing the operation for a predetermined time when it is suitable for the place intended by the operator.
As a result, erroneous input can be greatly reduced, and touch control input with few erroneous inputs, which is an object of the present invention, can be performed.

The effects obtained by the representative ones of the inventions disclosed in the present application will be briefly described as follows.
According to the present invention, since the place where the operator is touching and the place where the information input / output device is sensing can be confirmed, the operator can execute input after confirming the input object. It is possible to greatly reduce erroneous input.
Since the input is accepted by continuing the same operation for a predetermined time after confirming the input object, there is an advantage that a complicated touch control input unit is not required.
Further, there is an advantage that appropriate input with few erroneous inputs can be performed even when the display position and the input reception position do not exactly match.
Furthermore, only a relatively large object can be indicated by touch control input. However, according to the present invention, there is an advantage that even a small and densely arranged object can be input accurately.
Furthermore, since the method of changing the depth position of an object is close to the action phenomenon of pressing a button of a real object, there is an advantage that it is natural and easy to use even for a first-time user.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
In all the drawings for explaining the embodiments, parts having the same functions are given the same reference numerals, and repeated explanation thereof is omitted.
[Example 1]
FIG. 1 is a block diagram showing a schematic configuration of an information input / output device according to an embodiment of the present invention.
In FIG. 1, 1 is an information input / output device, 2 is a touch panel control input device, and 3 is a three-dimensional display device.
In the present embodiment, a DFD (Depth-Fused 3D) type three-dimensional display device using two liquid crystal display panels as the three-dimensional display device 3 and an ultrasonic touch panel as the touch panel control input device 2 are used.
A commercially available personal computer (PC) is used as the information input / output device 1, and the menu screen displayed on the three-dimensional display device 3 is controlled by the personal computer (PC) based on the input position data from the touch control device 2. .
The information input / output device of the present embodiment can be applied to an automatic ticket vending machine, a kiosk terminal or the like.
First, a DFD type three-dimensional display device using two liquid crystal display panels will be described.

[Example of DFD type 3D display device]
FIG. 2 is a diagram for explaining an example of a DFD type three-dimensional display device.
The three-dimensional display device shown in FIG. 2 sets a plurality of surfaces, for example, display surfaces (101, 102) (the display surface 101 is closer to the viewer 100 than the display surface 102) on the front surface of the viewer 100. In order to display a plurality of two-dimensional images on the display surfaces (101, 102), an optical system 103 is constructed using a two-dimensional display device and various optical elements.
Examples of the two-dimensional display device include a CRT, a liquid crystal display, an LED display, a plasma display, an EL display, an FED display, a DMD, a projection display, a line drawing type display such as an oscilloscope, and the like as an optical element. For example, a lens, a total reflection mirror, a partial reflection mirror, a curved mirror, a prism, a polarizing element, a wave plate, or the like is used.
1 has the same configuration as that described in Japanese Patent No. 302258, and for the method of setting the display surface, refer to Japanese Patent No. 302258.
In the three-dimensional display device shown in FIG. 2, as shown in FIG. 3, a three-dimensional object 104 desired to be presented to the observer 100 is transferred from the line of sight of both eyes of the observer 100 to the display surface (101, 102). Projected images (hereinafter referred to as “2D images”) (105, 106) are generated.
As a method for generating the 2D image, for example, a method using a two-dimensional image obtained by photographing a three-dimensional object 104 with a camera from the line-of-sight direction, a method of combining from a plurality of two-dimensional images taken from different directions, or There are various methods such as a computer graphic synthesis technique and a method using modeling.

As shown in FIG. 2, the 2D image (105, 106) overlaps both the display surface 101 and the display surface 102 as viewed from a point on the line connecting the right eye and the left eye of the viewer 100. To display. This can be achieved, for example, by controlling the arrangement of the center position and the gravity center position of each 2D image (105, 106) and the enlargement / reduction of each image.
On the apparatus having such a configuration, the luminance of each of the 2D images (105, 106) is changed in accordance with the depth position of the three-dimensional object 104 while keeping the overall luminance viewed from the observer 100 constant. Thus, a three-dimensional stereoscopic image of the three-dimensional object 104 is displayed.
An example of how to change the luminance of each 2D image (105, 106) will be described. Here, since it is a black and white drawing, for the sake of easy understanding, in the following drawings, the higher luminance is shown darker.
For example, when the three-dimensional object 104 is on the display surface 101, as shown in FIG. 4, the luminance of the 2D image 105 above is made equal to the luminance of the three-dimensional object 104, and 2D on the display surface 102 is displayed. The luminance of the converted image 106 is zero.
Next, for example, when the three-dimensional object 104 is slightly away from the observer 100 and is slightly closer to the display surface 102 than the display surface 101, the brightness of the 2D image 105 is increased as shown in FIG. Slightly lower the brightness of the 2D image 106 slightly.

Next, for example, when the three-dimensional object 104 is further away from the viewer 100 and is further away from the display surface 101 toward the display surface 102, the brightness of the 2D image 105 is increased as shown in FIG. Further down, the brightness of the 2D image 106 is further increased.
Further, for example, when the three-dimensional object 104 is on the display surface 102, the luminance of the 2D image 106 on the display surface 102 is made equal to the luminance of the three-dimensional object 104 as shown in FIG. The brightness of the 2D image 105 is zero.
By displaying in this way, even if the 2D image (105, 106) is displayed due to the physiological or psychological factors or illusions of the observer (person) 100, it is as if the observer 100 It feels as if the three-dimensional object 104 is located in the middle of the display surface (101, 102).
For example, when a 2D image (105, 106) having substantially the same luminance is displayed on the display surface (101, 102), the three-dimensional object 104 appears near the middle of the depth position of the display surface (101, 102). I can feel it. In this case, the three-dimensional object 104 is perceived by the observer 100 with a stereoscopic effect.

In the above description, for example, the method of expressing the depth position of the entire three-dimensional object using, for example, a two-dimensional image displayed on the display surface (101, 102) has been described. It is obvious that the 3D display device can be used as a method of expressing the depth of the 3D object itself, for example.
An important point in expressing the depth of the three-dimensional object itself is that the luminance of each part of the 2D image (105, 106) is viewed from the observer 100 on the apparatus having the configuration shown in FIG. It is to change corresponding to the depth position of each part of the three-dimensional object 104 while keeping the overall luminance constant.
In the above description, the description has been given of the case where only two surfaces are mainly described among the surfaces on which the two-dimensional image is arranged, and the object to be presented to the observer is between the two surfaces. It is obvious that a three-dimensional stereoscopic image can be displayed by a similar method even when the number of surfaces on which images are arranged is larger than this or when the position of an object to be presented is different.
For example, there are three surfaces, a first three-dimensional object between the surface close to the observer 100 and the intermediate surface, and a second 3 between the intermediate surface and the surface far from the observer 100. When a three-dimensional object exists, a 2D image of the first three-dimensional object is displayed on a surface close to the observer 100 and an intermediate surface, and on the intermediate surface and a surface far from the observer 100. By displaying the 2D image of the second 3D object, it is possible to display 3D images of the first and second 3D objects.

Furthermore, regarding the case where the 2D image is moved three-dimensionally, the movement of the observer in the horizontal and vertical directions can be achieved by moving image reproduction on the display surface as in the case of a normal two-dimensional display device. Regarding the movement in the depth direction, the luminance of each of the 2D images (105, 106) is changed with time in the depth position of the three-dimensional stereoscopic image while keeping the overall luminance viewed from the observer 100 constant. It is clear that a moving image of a three-dimensional image can be expressed by changing it correspondingly.
For example, a case where a three-dimensional stereoscopic image moves from the display surface 101 to the display surface 102 in time will be described.
When the three-dimensional stereoscopic image is on the display surface 101, the luminance of the 2D image 105 on the display surface 101 is made equal to the luminance of the three-dimensional stereoscopic image, as shown in FIG. The luminance of the converted image 106 is zero.
Next, for example, when the three-dimensional stereoscopic image gradually moves away from the viewer 100 in time and slightly approaches in time from the display surface 101 toward the display surface 102, as shown in FIG. Corresponding to the movement of the depth position of the three-dimensional stereoscopic image, the luminance of the 2D image 105 is slightly lowered in time, and the luminance of the 2D image 106 is slightly increased in time.

Next, for example, when the three-dimensional stereoscopic image is further distant from the observer 100 in time and moved to a position closer to the display surface 102 than the display surface 101, as shown in FIG. Corresponding to the movement of the depth position of the three-dimensional stereoscopic image, the luminance of the 2D image 105 is further lowered in time, and the luminance of the 2D image 106 is further raised in time.
Furthermore, for example, when the three-dimensional stereoscopic image has moved to the display surface 102 over time, as shown in FIG. 7, the 2D image above this corresponding to the movement of the depth position of the three-dimensional stereoscopic image. The luminance of 106 is changed over time until it becomes equal to the luminance of the three-dimensional stereoscopic image, and is changed until the luminance of the 2D image 105 on the display surface 101 becomes zero.
By displaying in this way, even if a 2D image (105, 106) is displayed due to a human physiological or psychological factor or illusion, the viewer 100 is as if the display surface (101, 101) is displayed. 102), it is felt that the three-dimensional stereoscopic image moves from the display surface 101 to the display surface 102 in the depth direction.

In the above description, the case where the three-dimensional stereoscopic image moves from the display surface 101 to the display surface 102 has been described, but this moves from the halfway position between the display surfaces (101, 102) to the display surface 102. In the case of moving to a depth position in the middle between the display surface 101 and the display surface (101, 102) or from the depth position in the middle between the display surfaces (101, 102). It is clear that the same can be done even when moving to another depth position in the middle.
In the above description, a description is given of a case where only two surfaces are mainly described among surfaces on which a 2D image is arranged, and a three-dimensional stereoscopic image presented to the observer 100 moves between the two surfaces. However, even if the number of planes on which a two-dimensional image is arranged is larger than this, or even when a three-dimensional object to be presented moves across multiple planes, a three-dimensional stereoscopic image is displayed using the same method. Obviously, similar effects can be expected.
In the above description, the case where one three-dimensional stereoscopic image moves in two planes on which two-dimensional images are arranged has been described. However, when a plurality of three-dimensional objects move, that is, displayed. When the two-dimensional image includes a plurality of object images having different movement directions, the luminance of the object image displayed on each display surface changes for each object image according to the movement direction and movement speed of the object. Obviously, you can do that.

[Other examples of DFD type 3D display devices]
FIG. 8 is a diagram for explaining another example of the DFD type three-dimensional display device as a premise of the present invention.
The three-dimensional display device shown in FIG. 8 has a plurality of transmissive display devices, for example, transmissive display devices (111, 112) (the transmissive display device 111 is more observable than the transmissive display device 112 in front of the viewer 100. The optical system 103 is constructed using various optical elements and a light source 110. That is, in this embodiment, the transmissive display device (111, 112) is used instead of the display surface (101, 102) in FIG.
Examples of the transmissive display device (111, 112) include a twisted nematic liquid crystal display, an in-plane liquid crystal display, a homogeneous liquid crystal display, a ferroelectric liquid crystal display, a guest-host liquid crystal display, and a polymer dispersed liquid crystal. A display, a holographic polymer dispersed liquid crystal display, or a combination thereof is used. In addition, as the optical element, for example, a lens, a total reflection mirror, a partial reflection mirror, a curved mirror, a prism, a polarization element, a wave plate, or the like is used.
8 shows a case where the light source 110 is arranged at the rearmost position when viewed from the observer 100, and FIG. 8 has the same configuration as that described in Japanese Patent Laid-Open No. 2001-54144. It is.

Also in the three-dimensional display device shown in FIG. 8, as shown in FIG. 3 described above, the three-dimensional object 104 desired to be presented to the viewer 100 is viewed from the viewer 100 to the transmissive display device (111, 112). A projected 2D image (107, 108) is generated.
As shown in FIG. 8, the 2D image (107, 108) is obtained from one point on the line connecting the right eye and the left eye of the viewer 100 on both the transmissive display device 111 and the transmissive display device 112. The two-dimensional images (107, 108) are displayed so as to overlap.
This can be achieved, for example, by controlling the arrangement of the center position and the gravity center position of each 2D image (107, 108) and the enlargement / reduction ratio of each image.
On the apparatus having the above-described configuration, an image viewed by the observer 100 is generated by light emitted from the light source 110, transmitted through the 2D image 108, and further transmitted through the 2D image 107.
In the three-dimensional display device shown in FIG. 8, the distribution of the transmittance of each of the 2D images (107, 108) is kept constant on the device having the above-described configuration while keeping the overall luminance as viewed from the observer 100 constant. A three-dimensional stereoscopic image of the three-dimensional object existing between the transmissive display device 111 and the transmissive display device 112 is displayed in accordance with the depth position of the three-dimensional object 104.

An example of how to change the transparency of each of the 2D images (107, 108) will be described.
For example, when the three-dimensional object 104 is on the transmissive display device 111, the transparency on the transmissive display device 111 is set so that the luminance of the 2D image 107 is equal to the luminance of the three-dimensional object 104. For example, the transparency of the portion of the 2D image 108 on the transmissive display device 112 is set to the maximum value of the transmissive display device 112.
Next, for example, when the three-dimensional object 104 is slightly away from the observer 100 and is slightly closer to the transmissive display device 112 than the transmissive display device 111, the 2D display on the transmissive display device 111 is performed. The transmittance of the portion of the image 107 is slightly increased, and the transmittance of the portion of the 2D image 108 on the transmissive display device 112 is slightly decreased.
Next, for example, when the three-dimensional object 104 is further away from the viewer 100 and is closer to the transmissive display device 112 than the transmissive display device 111, 2D conversion on the transmissive display device 111 is performed. The transmittance of the portion of the image 107 is further increased, and the transmittance of the portion of the 2D image 108 on the transmissive display device 112 is further decreased.
Further, for example, when the three-dimensional object 104 is on the transmissive display device 112, the transmittance on the transmissive display device 112 is set so that the luminance of the 2D image 108 is equal to the luminance of the three-dimensional object 104. For example, the transparency of the portion of the 2D image 107 on the transmissive display device 111 is set to the maximum value of the transmissive display device 111.

By displaying in this way, even if a 2D image (107, 108) is displayed due to a physiological or psychological factor or illusion of the observer (person) 100, the observer 100 is as if it is displayed. It feels as if the three-dimensional object 104 is located in the middle of the transmissive display device (111, 112).
That is, for example, when a 2D image (107, 108) having substantially the same luminance is displayed on the transmissive display device (111, 112), 3 near the middle of the depth position of the transmissive display device (111, 112). A dimensional object 104 is felt. In this case, the three-dimensional object 104 is perceived by the observer 100 with a stereoscopic effect.
In the above description, for example, the method of expressing the depth position of the entire three-dimensional object using, for example, a two-dimensional image displayed on the transmissive display device (111, 112) has been mainly described. It is obvious that the three-dimensional display device shown in FIG. 8 can also be used as a method of expressing the depth of the three-dimensional object itself, for example, by a method similar to the method described in the three-dimensional display device shown in FIG.
In the three-dimensional display device shown in FIG. 8, when the 2D image is moved three-dimensionally by the same method as the method described in the three-dimensional display device shown in FIG. The movement in the vertical direction is possible by moving image reproduction in the transmissive display device as in the case of a normal two-dimensional display device, and the movement in the depth direction is transmitted through a plurality of transmissive display devices. It is obvious that a moving image of a three-dimensional stereoscopic image can be expressed by temporally changing the degree.

In the DFD type three-dimensional display device, the luminance viewed from the viewer 100 on each display surface is changed for each display surface to display a three-dimensional stereoscopic image.
That is, in the three-dimensional display device shown in FIG. 2, the depth of the three-dimensional object 104 is maintained while keeping the overall luminance viewed from the observer 100 constant in the distribution of the luminance of each of the 2D images (105, 106). A three-dimensional stereoscopic image is displayed in accordance with the position.
Further, in the three-dimensional display device shown in FIG. 8, the distribution of the transparency of each of the 2D images (107, 108) is kept constant for the three-dimensional object 104 while keeping the overall luminance viewed from the observer 100 constant. A three-dimensional stereoscopic image is displayed by changing in accordance with the depth position.
As described above, in the 3D display device shown in FIG. 2, the luminance of the 2D image displayed on the surface closer to the 3D object 104 is set to the 2D image displayed on the surface far from the 3D object 104. In contrast, in the three-dimensional display device shown in FIG. 8, the transparency of the 2D image displayed on the transmission type display device closer to the three-dimensional object 104 is given to the three-dimensional object 104. The difference is that the transmittance of the 2D image displayed on the farther transmissive display device is reduced.
Therefore, in the 3D display device shown in FIG. 8, when the depth of the 3D object itself is expressed using the same method as the 3D display device shown in FIG. 2, or a moving image of a 3D stereoscopic image is expressed. In the case where the luminance of the 2D image displayed on each display surface is increased in the 3D display device shown in FIG. 2, the transmittance of the 2D image displayed on each transmissive display device is increased. In the three-dimensional display device shown in FIG. 2, when the luminance of the 2D image displayed on each display surface is decreased, the transparency of the 2D image displayed on each transmissive display device is reduced. It may be increased.

FIG. 9 is a functional block diagram showing a schematic configuration of the information input / output device 1 of the present embodiment.
FIG. 10 is a flowchart showing the processing procedure of the information input / output device 1 of this embodiment.
Hereinafter, the processing procedure of the information input / output device 1 of this embodiment will be described with reference to FIGS. 9 and 10.
First, the display control means 12 displays a menu screen on the three-dimensional display device 3 under the control of the control means 10 (step 201).
Next, the position detection means 11 detects the position touched by the user based on the position data from the touch panel control input unit 2 (step 202), and the control means 10 has a menu button near the detected detection position. Whether or not (step 203).
If the determination result in Step 203 is No, the process returns to Step 202. If the determination result in Step 203 is Yes, the control means 10 controls the display control means 12, and the display control means 12 is the three-dimensional display device. 3. A menu button is displayed at a depth position corresponding to the distance from the detection position (step 204).
Next, the control means 10 determines whether or not the detection position detected based on the position data from the touch panel control input unit 2 in the position detection means 11 has changed (step 205).
If the determination result in step 205 is Yes, the process returns to step 204. If the determination result in step 205 is No, it is determined whether a predetermined time has elapsed since the position was detected in the menu button (step 206). .
If the determination result in Step 206 is No, the process returns to Step 205. If the determination result in Step 206 is Yes, the control means 10 accepts the input of the menu button, changes the display of the selected menu button, and changes the sound. Is sounded (step 207).

Hereinafter, an example of inputting alphabetic characters in the information input / output device 1 of the present embodiment will be described.
As shown in FIG. 11, a two-dimensional image (so-called menu button) shown as a key for each letter of the alphabet is displayed on the three-dimensional display device 3 at a depth position far from the user (that is, the operator).
When the user inputs characters, the user can input characters by touching the position corresponding to each display key. Here, a case where the character “D” is input will be described.
When the user touches a place that the user thinks is the position of the “D” key, the display control means 12 of the information input / output device 1 moves to the position detected by the three-dimensional display device 3 and the position detection means 11 of the information input / output device 1 With the corresponding key as the center, including the surrounding keys, the key is displayed in the depth direction approaching the user.
In this example, “D” is detected, and “D” is closest to the user on the three-dimensional display device 3 as shown in FIG. 12, and “E”, “R”, “S”, “ The “F”, “X”, and “C” keys are displayed at a depth position next to the user.
Since the key group centering on the “D” key approaches the user, the user can recognize where the information input / output device 1 is detecting.
If a key different from the one intended by the user approaches the user, the user notices that the touched position is not recognized as the location of the key he / she wants to press. be able to.

For this reason, when the information input / output device 1 recognizes a key different from the key intended by the user, if the user knows, the user can change the touch position at that time or release the hand from the touch control. Input of unintended characters can be prevented.
When the same key as the key intended by the user reacts, the user can continue to touch the touch control to accept the key input.
In order to make the user recognize when the reception is completed, the display state of the three-dimensional display device 3 is changed as shown in FIG. And so on.
FIG. 14 shows changes in the depth direction of the key, that is, the display position of the key in the case of the above example. Here, the time for which the user continues to press is 300 milliseconds. This time can be appropriately changed according to the use scene and the user layer, but a range of 200 milliseconds to 1 second is effective.
After displaying that the key has been received, you can return to the original screen and continue to input.
Note that a three-dimensional object such as a rectangular parallelepiped may be used as the menu button to change the depth position of the key displayed on the three-dimensional display device 3 and also to change the shape of the key in the depth direction.

In the combination of a conventional two-dimensional display and a touch panel, input is often accepted without knowing whether or not the user is touching.
In this embodiment, since the user can confirm where he / she is touching before the input is accepted, erroneous input can be reduced.
Further, when the viewpoint changes, the display position of the display device and the detection position of the touch input also change, so it is difficult to eliminate the shift between the display device and the input reception position. In this embodiment, erroneous input resulting from this can also be prevented.
In conventional devices, in order to prevent malfunctions when touched unintentionally, a method that intentionally slows the reaction time is also taken, but it does not respond because it is badly touched, or it touches a different place. It often gives an impression of whether or not it is present, so it was not convenient for users.
On the other hand, in this embodiment, since the reaction to the touch can be confirmed immediately, the user can immediately confirm whether the touch control is sensed, so that the user accumulates stress. There is also an advantage that touch input can be performed.

In addition, there is an example in which the display color is changed with respect to what is touched in the conventional apparatus. However, by changing the display color, there are many cases where the user feels that the input has been accepted, or even when the user has not even noticed that the color has changed. In this embodiment, the three-dimensional display device is used. It is used and the depth position of the key displayed on the three-dimensional display device is changed, so that it is intuitive and very easy to understand for the user.
In this embodiment, the DFD display device is used as the three-dimensional display device. However, a stereo method three-dimensional display device using a parallax barrier method or a three-dimensional display device using another method capable of displaying different depth positions is used. It is also possible to use it.
Further, although an ultrasonic touch panel is used as a touch control input, other types of touch panels such as an optical type and a resistance film type can also be used.

[Example 2]
The outline of the information input / output device according to the second embodiment of the present invention is the same as that shown in FIG.
In this embodiment, as the three-dimensional display device 3, a parallax barrier type three-dimensional display liquid crystal display (see Chihiro Masuda, “Three-dimensional display”, Sangyo Tosho, 1990, Chapter 5, p.123), As the touch control input device 2, a resistance film type touch panel was used.
Further, a commercially available personal computer (PC) is used as the information input / output device 1, and a menu screen displayed on the three-dimensional display device 3 by the personal computer (PC) is based on the input position data from the touch control device 2. Controlled.
The schematic configuration of the information input / output device 1 of the present embodiment is also the same as that shown in FIG.
FIG. 15 is a flowchart showing the processing procedure of the information input / output device 1 of this embodiment.
Hereinafter, the processing procedure of the information input / output device 1 of the present embodiment will be described with reference to FIGS. 9 and 15.

First, the display control means 12 displays a menu screen on the three-dimensional display device 3 under the control of the control means 10 (step 211).
Next, the position detection means 11 detects the position touched by the user based on the position data from the touch panel control input unit 2 (step 212), and the control means 10 has a menu button near the detected detection position. Whether or not (step 213).
If the determination result in step 213 is No, the process returns to step 212. If the determination result in step 213 is Yes, the control means 10 controls the display control means 12, and the display control means 12 is the three-dimensional display device. 3 starts to change the depth position of the character menu of the detected position displayed in step 3 (step 214).
Next, the control means 10 determines whether or not the detection position detected based on the position data from the touch panel control input unit 2 in the position detection means 11 has changed (step 215).
If the determination result in step 215 is Yes, the process returns to step 214. If the determination result in step 215 is No, it is determined whether a predetermined time has elapsed since the position was detected in the menu button (step 216). .
If the determination result in Step 216 is No, the process returns to Step 215. If the determination result in Step 216 is Yes, the control means 10 accepts the input of the menu button, changes the display of the selected menu button, and changes the sound. Is sounded (step 217).

Hereinafter, in this embodiment, an example in which a message is input in Japanese kana characters will be described.
As shown in FIG. 16, an image resembling a key corresponding to a kana character in the order of the Japanese syllabary is displayed on the three-dimensional display device 3 at a position in front of the user.
When the user inputs characters, the user can input characters by touching the position corresponding to each display key. Here, the case of inputting “su” is shown.
When the user touches a place corresponding to the “su” display as seen from the user, as shown in FIG. 17, the character corresponding to the position detected by the touch control device 2 displayed on the three-dimensional display device 3 is displayed on the user. It starts to change to the depth position in the back as viewed from the top.
By recognizing that the place you are touching is not the place of the intended character when you notice that a character that is different from your intended character begins to change, It is possible to input an intended character while preventing erroneous input.
Further, if the same character as the character intended by the user changes, the user can recognize that the place touched by the user is an appropriate position for the input of the intended character, and thus continues the touched state.
Here, while the user is touching, the key displayed on the three-dimensional display device 3 keeps changing in the back direction, so that the user can recognize that his / her input continues. When position detection for the same character continues for a predetermined time, the information input / output device accepts input of this character.

Simultaneously with this input reception, the input characters displayed on the three-dimensional display device 3 further move in the depth direction, and as shown in FIG. 18, the frame of the character key blinks at the same time and the sound of the input reception is sounded at the same time. As a result, the user can recognize that the input has been accepted.
FIG. 19 shows a change in the depth direction of the key, that is, the display position of the key in the case of the above example. Here, immediately after the touch control device 2 is detected, a change in the back direction is started, and a certain time until an input is received is set to 400 milliseconds. This fixed time can be appropriately changed according to the use scene and the user layer.
When the conventional 3D display device is not used, the input menu is enlarged in order to prevent erroneous input, so that it is practically impossible to display a large number of characters as shown in the present embodiment on a normal display. However, in this embodiment, even if the menu is made small, the place touched by the user can be confirmed before the input, so that it is possible to prevent an erroneous input due to an operation error.
In addition, in the conventional device, as the signal for accepting the menu, only the color was changed and the sound was sounded, this caused confusion between the signal indicating that it was touching or the signal indicating that the input was accepted. As a result, there was a strong tendency to give users an impression that it was difficult to use due to erroneous input.

On the other hand, in the present embodiment, when the menu key is pressed, the indication that the menu key is retracted is similar to the actual event of pressing the button, and is easy for the user to understand. It has become possible.
In this embodiment, a parallax barrier type display device is used as the three-dimensional display device. However, a three-dimensional display device using DFD display or another method capable of displaying different depth positions may be used.
Further, although a resistive film type touch panel is used as the touch control input device, other types of touch panels such as an optical type and an electromagnetic transfer type can also be used.
In the display method of this embodiment, the menu itself is a two-dimensional plane object, and the depth direction of the object is changed. However, the shape of the object in the depth direction may be changed.
Furthermore, in the display method of the present embodiment, a method in which the menu itself is a three-dimensional object and the shape of the object in the depth direction and / or the depth direction of the object is changed is also possible.

[Example 3]
The outline of the information input / output device according to the third embodiment of the present invention is the same as that shown in FIG.
In the present embodiment, a DFD type three-dimensional display liquid crystal display is used as the three-dimensional display device 3, and a resistive film type touch panel is used as the touch control input device 2.
Further, a commercially available personal computer (PC) is used as the information input / output device 1, and a menu screen displayed on the three-dimensional display device 3 by the personal computer (PC) is based on the input position data from the touch control device 2. Controlled.
The schematic configuration of the information input / output device 1 of the present embodiment is also the same as that shown in FIG.
FIG. 20 is a flowchart showing a processing procedure of the information input / output device 1 of this embodiment.
Hereinafter, the processing procedure of the information input / output device 1 of this embodiment will be described with reference to FIGS. 9 and 20.

First, the display control means 12 displays a menu screen on the three-dimensional display device 3 under the control of the control means 10 (step 221).
Next, the position detection means 11 detects the position touched by the user based on the position data from the touch panel control input unit 2 (step 222), and the control means 10 has a menu button near the detected detection position. Whether or not (step 223).
If the determination result in Step 223 is No, the process returns to Step 222. If the determination result in Step 223 is Yes, the control means 10 controls the display control means 12, and the display control means 12 is the three-dimensional display device. 3 starts the change of the display color of the character menu of the detection position displayed in 3 (step 224).
Next, the control means 10 determines whether or not the detection position detected based on the position data from the touch panel control input unit 2 in the position detection means 11 has changed (step 225).
If the determination result in step 225 is Yes, the process returns to step 224. If the determination result in step 225 is No, it is determined whether a predetermined time has elapsed since the position was detected in the menu button (step 226). .
If the determination result in step 226 is No, the process returns to step 225. If the determination result in step 226 is Yes, the control means 10 accepts the input of the menu button, changes the selected menu button display, and Is sounded (step 227).

Hereinafter, in this embodiment, an example in which a message is input in Japanese Kana characters is shown.
As shown in FIG. 21, an image resembling a key corresponding to a kana character in the order of the Japanese syllabary is displayed on the three-dimensional display device at a position in front of the user.
When the user inputs characters, the user can input characters by touching the position corresponding to each display key. Here, the case of inputting “su” is shown.
When a user touches a place corresponding to the “su” display, the display color of the character corresponding to the position detected by the touch control device 2 displayed on the three-dimensional display device 3 is displayed as shown in FIG. It gradually gets darker.
By recognizing that the place you are touching is not the place of the intended character when you notice that a character that is different from your intended character begins to change, It is possible to input an intended character while preventing erroneous input.
Further, if the same character as the character intended by the user changes, the user can recognize that the place touched by the user is an appropriate position for the input of the intended character, and thus continues the touched state.
Here, by continuously changing the display color while the user is touching, the user can recognize that his input continues.

Furthermore, when the information input / output device detects that the user has touched it, the sound is gradually increased and the scale is gradually increased so that the user is about to accept characters. Can be recognized.
When the position detection for the same character continues for a predetermined time, the control means 10 accepts the input of this character. Here, the sound is changed when the user touches it, but it is possible to obtain a certain effect even with a constant sound while touching.
As shown in FIG. 23, simultaneously with this input reception, the input characters displayed on the 3D display device 3 move in the rearward direction as viewed from the user, and at the same time, the borders of the character keys blink, and the input reception is performed simultaneously. Sound.
As a result, the user can recognize that the input has been accepted. Here, immediately after the touch control device 2 is detected, the change in the back direction is started and the predetermined time until the input is received is set to 500 milliseconds. This predetermined time can be appropriately changed according to the use scene and the user layer.

When the conventional 3D display device is not used, the input menu is enlarged in order to prevent erroneous input, so that it is practically impossible to display a large number of characters as shown in the present embodiment on a normal display. However, in this embodiment, even if the menu is made small, the place touched by the user can be confirmed before the input, so that it is possible to prevent an erroneous input due to an operation error.
In addition, in the conventional device, as the signal for accepting the menu, only the color was changed and the sound was sounded, this caused confusion between the signal indicating that it was touching or the signal indicating that the input was accepted. As a result, there was a strong tendency to give users an impression that it was difficult to use due to erroneous input.
On the other hand, in the present embodiment, when the menu key is pressed, the indication that the menu key is retracted is similar to the actual event of pressing the button, and is easy for the user to understand. It has become possible.

In the present embodiment, a DFD display device is used as the three-dimensional display device. However, a three-dimensional display device using another method capable of displaying different depth positions can be used.
Further, although a resistive film type touch panel is used as the touch control input device, other types of touch panels such as an optical type and an electromagnetic transfer type can also be used.
In the display method of this embodiment, the menu itself is a two-dimensional plane object, and the depth direction of the object is changed. However, the shape of the object in the depth direction may be changed.
Furthermore, in the display method of the present embodiment, a method in which the menu itself is a three-dimensional object and the shape of the object in the depth direction and / or the depth direction of the object is changed is also possible.
The processing shown in FIGS. 10, 15, and 20 can be realized by software on a personal computer, and the program can be provided through a recording medium or a network.
As mentioned above, the invention made by the present inventor has been specifically described based on the above embodiments. However, the present invention is not limited to the above embodiments, and various modifications can be made without departing from the scope of the invention. Of course.

It is a block diagram which shows schematic structure of the information input / output device of the Example of this invention. It is a figure for demonstrating an example of a DFD type three-dimensional display apparatus. FIG. 3 is a diagram for explaining a method of generating a 2D image displayed on the display surface of the DFD type three-dimensional display device shown in FIG. 2. It is a figure for demonstrating the display principle of the DFD type three-dimensional display apparatus shown in FIG. It is a figure for demonstrating the display principle of the DFD type three-dimensional display apparatus shown in FIG. It is a figure for demonstrating the display principle of the DFD type three-dimensional display apparatus shown in FIG. It is a figure for demonstrating the display principle of the DFD type three-dimensional display apparatus shown in FIG. It is a figure for demonstrating the other example of the three-dimensional display apparatus of a DFD type. It is a functional block diagram which shows schematic structure of the information input / output apparatus of Example 1 of this invention. It is a flowchart which shows the process sequence of the information input / output apparatus of Example 1 of this invention. It is a figure which shows the example of a display of the key displayed on a three-dimensional display apparatus in the information input / output device of Example 1 of this invention. In the information input / output apparatus of Example 1 of this invention, when a user performs touch input, it is a figure which shows the example of a display displayed on a three-dimensional display apparatus. In the information input / output device of Example 1 of this invention, it is a figure which shows the example of a display displayed on a three-dimensional display device, when input is received. In the information input / output apparatus of Example 1 of this invention, it is a figure showing the example of a relationship between a user's operation and the depth position of the key object displayed on a three-dimensional display apparatus. It is a flowchart which shows the process sequence of the information input / output apparatus of Example 2 of this invention. It is a figure which shows the example of a display of the key displayed on a three-dimensional display apparatus in the information input / output device of Example 2 of this invention. It is a figure which shows the example of a display displayed on a three-dimensional display device, when a user performs touch input in the information input / output device of Example 2 of this invention. It is a figure which shows the example of a display displayed on a three-dimensional display device, when the input is received in the information input / output device of Example 2 of this invention. It is a figure showing the example of a relationship between a user's operation and the depth position of the key object displayed on a three-dimensional display apparatus in the information input / output device of Example 2 of this invention. It is a flowchart which shows the process sequence of the information input / output device of Example 3 of this invention. It is a figure which shows the example of a display of the key displayed on a three-dimensional display apparatus in the information input / output device of Example 3 of this invention. It is a figure which shows the example of a display displayed on a three-dimensional display device, when a user performs a touch input in the information input / output device of Example 3 of this invention. It is a figure which shows the example of a display displayed on a three-dimensional display device, when the input is received in the information input / output device of Example 3 of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Information input / output apparatus 2 Touch-panel control input device 3 3D display apparatus 10 Control means 11 Position detection means 12 Display control means 100 Observer 101,102 Display surface 103 Optical system 104 Three-dimensional object 105,106,107,108 2D conversion Image 110 Light source

Claims (6)

In an information input method for selecting an object indicated by an operator from among a plurality of objects displayed on a three-dimensional display device as an input object,
The three-dimensional display device has a plurality of display surfaces arranged at different depth positions as viewed from the operator, and a two-dimensional image obtained by projecting a display object on the plurality of display surfaces from the line-of-sight direction of the operator Are respectively displayed on a plurality of display surfaces arranged at different depth positions as viewed from the operator, and the brightness of the two-dimensional image displayed on the plurality of display surfaces is viewed from the operator. 3D images are displayed by changing each surface independently.
The depth position of the object pointed to by the operator is changed and displayed on the three-dimensional display device, and the amount of change in the depth position of the object around the object pointed to by the operator is changed from the position pointed to by the operator. A first process of changing and displaying according to the distance of
In the first process, when the operator continues the operation pointing to the object for a predetermined time, the corresponding object is selected as the input object, and the change amount of the depth position of the corresponding object is further changed and displayed. information input method and having a second step. 2. The method according to claim 1, wherein when the amount of change in the depth position of the object is further changed in the second process, the depth direction is changed in a direction opposite to the depth direction changed in the first process. Information input method. 2. The information according to claim 1, wherein when the amount of change in the depth position of the object is further changed in the second step, the depth direction changed in the first step is changed in the same direction. input method. A three-dimensional display device for displaying a plurality of objects and inputting information by selecting an object from among the plurality of objects is located in front of the display unit and specifies a position indicated by an operator An information input / output device that controls based on an input from an input unit,
The three-dimensional display device has a plurality of display surfaces arranged at different depth positions as viewed from the operator, and a two-dimensional image obtained by projecting a display object on the plurality of display surfaces from the line-of-sight direction of the operator Are respectively displayed on a plurality of display surfaces arranged at different depth positions as viewed from the operator, and the brightness of the two-dimensional image displayed on the plurality of display surfaces is viewed from the operator. 3D images are displayed by changing each surface independently.
The depth position of the object pointed to by the operator is changed and displayed on the three-dimensional display device, and the amount of change in the depth position of the object around the object pointed to by the operator is changed from the position pointed to by the operator. First means for changing and displaying according to the distance,
A second means for selecting, when the operator continues an operation pointing to the object for a predetermined time, selecting the corresponding object as an input object and further changing the amount of change in the depth position of the corresponding object; information output device you, comprising. The said 2nd means changes the depth direction changed in the said 1st means in the reverse direction, when changing further the variation | change_quantity of the depth position of the said object. Information input / output device . 5. The method according to claim 4, wherein when the amount of change in the depth position of the object is further changed, the second means changes in the same direction as the depth direction changed in the first means. Information input / output device .

Images