JP2001142605A - Input system - Google Patents

Abstract

(57) [Problem] To provide an input system capable of performing an input operation simply, quickly, and reliably without using a large-sized input device or a voice input device. An optical system (12b) arranged at a fixed position with respect to an operator (10) and an image display light emitting means (2) changes an optical path of image display light (L) so that a predetermined symbol image can be displayed in the field of view of the operator (10). An image is formed at a fixed position. The combiner 16 of the optical system 12b transmits light from the image forming position of the symbol image. Position indicating sign 22 that can be moved by operator 10
Is arranged at the image forming position of the symbol image. The relative position of the sign 22 with respect to the symbol image is detected, and an input signal corresponding to the detected relative position of the sign 22 is output by operating the switch 21 by the operator 10.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] 1. Field of the Invention [0002] The present invention relates to an input system for inputting data such as characters and operation signals to an electronic computer or the like.

[0002]

2. Description of the Related Art Conventionally, an input to an electronic computer is performed by operating an input device such as a keyboard, a mouse, a trackball or the like with a finger, or a voice input from a microphone using a voice recognition technique.

[0003]

A keyboard, a mouse,
Trackballs, etc., need to have a certain size or more to ensure operability, are not suitable for wearable computers that are inconvenient to carry, and especially require miniaturization, and where space is limited. There is a problem that can not be used. When performing voice input, there is a problem that it is affected by ambient noise, and it is not suitable for a place where quietness is required because it is necessary to utter a certain loud voice.

[0004] An object of the present invention is to provide an input system capable of solving the above problem.

[0005]

According to the present invention, there is provided an input system comprising: a switch operable by an operator; a position indicating marker movable by the operator; and an output of an image signal corresponding to a predetermined symbol image. Means, means for emitting image display light corresponding to the image signal, and being arranged at a fixed position with respect to the operator and the image display light emitting means, to change the optical path of the image display light, An optical system having a combiner capable of transmitting a light from the image forming position of the symbol image while forming the symbol image at a fixed position in the field of view of the operator, and a symbol image of the sign disposed at the image forming position A position detecting means for detecting the relative position and an input signal corresponding to the detected relative position of the sign are output by operating the switch. And means. According to the configuration of the present invention, the optical path of the image display light emitted from the image display light emitting unit is changed by the optical system arranged at a fixed position with respect to the operator and the image display light emitting unit. The symbol image is formed at a fixed position in the field of view of the operator. The position indicating sign and the symbol image arranged at the image forming position are visually recognized by the operator via the combiner. The relative position of the position indicating marker with respect to the symbol image is detected, and an input signal corresponding to the detected relative position is output by an operation of the switch by the operator. By moving the position indicating mark by the operator, the relative position with respect to the symbol image changes, so that different input signals can be output. Thus, an input operation can be performed without using a large-sized input device or a voice input device.

The symbol image includes a plurality of character images arranged at predetermined positions with respect to each other, and the sign is arranged at a position corresponding to any one of the plurality of character images. Preferably, when the switch is operated, an input signal corresponding to the character image can be output. Thus, by arranging the position indicating marker at a position corresponding to any of the plurality of character images and operating the switch, it is possible to output an input signal corresponding to the character image, By moving the position indicating marker, an input signal corresponding to a different character image can be output, and an input operation can be performed without using a keyboard.

The switch is constituted by a switch mounted on a finger of an operator, and the marker emits light of a specific wavelength by operating the switch, and is mounted on a finger on which the operated switch is mounted. The light emitting element, wherein the position detecting means has an image pickup device having an optical filter that transmits light of the specific wavelength, and the position detection means is generated by imaging the light emitting element through the optical filter when the light emitting element emits light. It is preferable to determine the relative position of the marker based on the image signal. Thereby, by moving the position indicating sign along with the movement of the finger of the operator and operating the switch of the finger, an input signal corresponding to the relative position of the finger to the symbol image in the operator's field of view can be output, The input operation can be performed easily and quickly. In addition, an image pickup device arranged at a fixed position with respect to the operator takes an image of a light-emitting element constituting a marker arranged at a fixed position in the operator's field of view, and based on the image signal, a constant value in the operator's field of view. The relative position of the sign with respect to the symbol image formed at the position can be determined. Moreover,
When the light emitting element emits light of a specific wavelength by a switch operation, an image is taken through an optical filter that transmits the light of the specific wavelength, so that erroneous recognition of the marker can be prevented and a reliable input can be performed.

It is preferable that the image display light emitting means, the optical system, and the image pickup device are mounted on the head of the operator so as to be able to move together. Thereby, regardless of the orientation of the operator's head, a symbol image is formed at a fixed position in the operator's field of view, and an input signal corresponding to the relative position of the sign with respect to the symbol image can be output, thereby improving operability.

Means for outputting an image signal corresponding to the input signal, wherein image display light corresponding to the image signal corresponding to the input signal is emitted by the image display light emitting means and an optical path is provided by the optical system. By being changed,
Preferably, an image corresponding to the input signal is formed in the field of view of the operator. With this, an image corresponding to the input signal can be formed using the configuration for forming the symbol image and visually recognized by the operator, and the input content can be reduced without requiring a configuration more than required for input. You can check.

[0010]

DESCRIPTION OF THE PREFERRED EMBODIMENTS The input system shown in FIGS. 1 and 2 comprises a display device 2, a host computer 3, and an operation unit 4.
And an imaging device 5 and a control device 6 configured by a computer connected to the host computer 3. In the present embodiment, the display device 2 is an operator 10
The control device 6 is attached to the body of the operator 10 via a belt or the like. The host computer 3 is an operator 10
May be installed at a location away from the user, or may be a small one that can be worn on the body of the operator 10.

The head-mounted display device 2 has a display unit 12 mounted on the head of the operator 10 via a holding unit 11 so as to be able to move together. In the illustrated example, the holding unit 11 is formed in a helmet shape mounted on the head of the operator 10. However, the form is not limited as long as the display unit 12 can be mounted on the head of the operator 10. It may be in the form of a band or a headset to be worn on the camera, or may be in the form of a clip that can be attached to and detached from the glasses worn by the operator 10. In addition, the display device 2 of the present embodiment allows the operator 10 to visually recognize the image with both eyes, but the image may be visually recognized only with one eye. The display unit 12 is fixed to the holding unit 11 and includes a display unit 12a as an emission unit of the image display light L, and an optical system 12b that changes an optical path of the image display light L and guides the image display light L to the eyes of the observer 10.

The display unit 12a is composed of, for example, a liquid crystal display device with a backlight,
a 'and a liquid crystal drive circuit 12a ", and are connected to the control device 6 via the liquid crystal drive circuit 12a". The control device 6 outputs an image signal corresponding to a predetermined symbol image. In the present embodiment, as shown in FIG. 3, an image signal for displaying the symbol image S corresponding to the keyboard is output to the liquid crystal drive circuit 12a ″.
The symbol image S includes a plurality of character images arranged at predetermined positions with respect to each other. The liquid crystal drive signal corresponding to the scan data for forming the symbol image S is output from the liquid crystal drive circuit 12a ″ to the liquid crystal panel 12a ′, so that the image display light L corresponding to the symbol image S is displayed on the display unit. When a liquid crystal display device with a backlight is used as the display unit 12a, a cold cathode discharge tube or the like can be used as a backlight as a light source of the image display light L.

The optical system 12b is connected to the display unit 1
Lens group 1 for converging image display light L emitted from 2a
4, a mirror 15 for changing the optical path by reflecting the image display light L passing through the lens group 14, and the mirror 15
The optical path of the image display light L reflected by the
And a combiner 16 leading to the zero eye. The combiner 16 is arranged in front of the operator 10 to change the optical path by reflecting or diffracting the image display light L and transmit light from the field of view of the operator 10 and is constituted by a half mirror, a hologram element, and the like. You.

The image display light L is guided to the eyes of the operator 10 by the optical system 12b, so that the operator 1
The symbol image S is formed in the zero field of view. The display unit 12a and the optical system 12b are attached to the head of the operator 10 via the holding unit 11 so as to be able to move together, and the optical system 12b is arranged at a fixed position with respect to the operator 10 and the display unit 12a. The image forming position of the symbol image S is a fixed position in the field of view of the operator 10. The combiner 16 is disposed in front of the operator 10 and transmits light from the image forming position of the symbol image to guide the light to the operator 10.

As shown in FIGS. 1 and 4, the operating section 4 includes a pair of gloves 2 fitted to the hands of an operator 10.
0 and 10 attached to the fingers of the operator 10 by being attached to the respective ventral sides of the finger portions of each glove 20.
The glove 20 includes ten switches 21 and ten position indicating markers 22 that are attached to the fingers of the operator 10 by being attached to the finger sides of the finger portions of each glove 20. Each switch 21 is constituted by a pressure-sensitive sensor such as a tact switch operable by the operator 10, and is capable of outputting an operation signal by pressing against a desk D or the like to apply pressure. Each marker 22 is formed of a light emitting element such as an infrared light emitting diode, and can be moved by the operator 10 with the movement of a finger. Each switch 21 and the sign 22 are connected to the control device 6. When an operation signal is input by operating each switch 21, the control device 6 causes the light-emitting element forming the marker 22 attached to the finger corresponding to the operated switch 21 to light of a specific wavelength, for example, a specific light. Lights up to emit infrared rays of the wavelength. The power for turning on the light-emitting element may be supplied by incorporating a small battery in the globe 20, or the power for the display device 2 may be supplied via a wire. In addition, each switch 21 and the light emitting element constituting the marker 22 are directly connected without the intervention of a control device, and
Each light emitting element may be directly turned on by the operation 1.

The image pickup device 5 includes an optical filter 31 that transmits light of a specific wavelength emitted from a light emitting element constituting the marker 22, a lens system 32 that converges light passing through the optical filter 31, and a lens system And an image pickup device 33 such as a CCD device that performs photographing based on the light that has passed through. The imaging device 5 is fixed to the holding unit 11 and attached to the head of the operator 10 so as to be able to move along with the head, and is thereby arranged at a fixed position with respect to the operator 10. The image sensor 33 is connected to the control device 6 via an A / D converter 34.

The control device 6 determines the relative position of the marker 22 located at the image forming position with respect to the symbol image S based on the image pickup signal from the image pickup device 5. That is, when the light emitting element constituting the marker 22 arranged at the image forming position of the symbol image S by the operator 10 emits light by the operation of the switch 21 by the operator 10, the light emitting element is turned on by the optical filter 31 by the imaging device 5.
An imaging signal generated by being imaged via the
The data is input to the control device 6 via the D converter 34. The image forming position of the symbol image S is a fixed position in the field of view of the operator 10, and the imaging device 5 is arranged at a fixed position with respect to the operator 10. The relative position of the marker 22 with respect to the symbol image S at the image position can be determined.

The control device 6 controls the detected sign 22
An input signal corresponding to the relative position of the symbol image S with respect to the symbol image S is output as, for example, serial data. The output signal is input to the host computer 3. That is, when the marker 22 is arranged at a position corresponding to any one of the image forming positions in a plurality of character images constituting the symbol image S, the operator 10 operates the switch 21 corresponding to the marker 22 by operating the switch 21. , An input signal corresponding to the character image is output. The host computer 3 sends character image data corresponding to the input signal to the control device 6. The control device 6 outputs an image signal for displaying the character image corresponding to the input signal together with the symbol image S to the liquid crystal drive circuit 12a ″. As a result, the image display light corresponding to the character image is output. L is emitted from the display unit 12a, and the optical path of the image display light L is changed by the optical system 12b, so that a character image corresponding to the input signal is formed in the field of view of the operator 10. FIG. The field of view of the operator 10 where the symbol image S and the character image T are formed by the image display light L emitted from the display unit 12a is shown. Image S and character image T
And can be visually recognized. In the present embodiment, an image signal for displaying the frame image F surrounding the display area of the character image T is output from the control device 6.

In this embodiment, a liquid crystal shutter 41 is disposed in front of the combiner 16. The liquid crystal shutter 41 is opened and closed by a drive circuit 42 in response to an opening and closing instruction signal from the control device 6. For example, when the character image T is formed above the symbol image S as shown in FIG. The portion facing the upper side of 16 is in a light-shielding state, so that the visibility of the character image T is improved, and the lower side is in a light-transmitting state so that the symbol image S and the operation unit 4 can be viewed in an overlapping manner. Note that the brightness of the visual field of the operator 10 is c
The opening degree of the shutter 41 may be automatically adjusted by the control device 6 in accordance with the detected light amount, and the visibility of the character image T and the symbol image S may be improved. Further, when the operator 10 needs to view the entire foreground, the shutter 41 may be switchably controlled so that the whole is in a light-transmitting state.
Can visually recognize the entire foreground without removing the head-mounted display device 2. When no input is performed, the entire shutter 41 may be in a light-shielding state so that only the display on the head-mounted display device 2 can be visually recognized.

According to the above configuration, the optical path of the image display light L emitted from the display unit 12a is changed by the optical system 12b arranged at a fixed position with respect to the operator 10 and the display unit 12a. , Operator 1
The symbol image S is formed at a fixed position in the zero visual field. The position indicating sign 22 and the symbol image S arranged at the image forming position are transmitted to the operator 1 via the combiner 16.
It is visually recognized by 0. The relative position of the sign 22 with respect to the symbol image S is detected, and an input signal corresponding to the detected relative position is transmitted to the switch 21 by the operator 10.
Is output by the operation of. The sign 22 is assigned to the operator 1
Moving by 0 changes the relative position with respect to the symbol image S, so that different input signals can be output. Thus, an input operation can be performed without using a large-sized input device or a voice input device. Since the symbol image S is an image of a keyboard, the sign 22 is arranged at a position corresponding to any of a plurality of character images, and by operating the switch 21, an input signal corresponding to the character image is input. Can be output, and by moving the marker 22, an input signal corresponding to a different character image can be output. Thus, the input operation can be performed without using the keyboard. Also, by moving the sign 22 along with the movement of the finger of the operator 10 and operating the switch 21 of the finger,
Since an input signal corresponding to the relative position of the finger with respect to the symbol image S in the field of view of the operator 10 can be output, the input operation can be performed simply and quickly. Further, when the light emitting element forming the marker 22 emits light of a specific wavelength by operating the switch 21, the image is captured by the imaging device 5 through an optical filter that transmits the light of the specific wavelength, so that the marker 22 is emitted. Is detected, the erroneous recognition of the marker 22 can be prevented and a reliable input can be performed. Further, since the display unit 12a, the combiner 16, and the imaging device 5 are mounted on the head of the operator 10 so as to be able to move together, regardless of the orientation of the head of the operator 10,
The symbol image S is formed at a fixed position in the field of view of the operator 10, and an input signal corresponding to the relative position of the marker 22 with respect to the symbol image S can be output, so that operability can be improved. Then, the image display light corresponding to the input signal is
The display unit 12a that emits the image display light corresponding to the symbol image S is emitted, and the optical path of both display lights is changed by the common optical system 12b to form the symbol image S and the character image T in the field of view of the operator 10. Therefore, it is possible to confirm the input contents without requiring a configuration more than that required for the input.

The present invention is not limited to the above embodiment. For example, the display device and the imaging device may be mounted on a body such as an arm other than the head, or may be fixed on a desk or the like. Alternatively, a three-dimensional image may be displayed by providing a right-eye display unit and a left-eye display unit, and emitting image display light from each. The switch operated by the operator is not limited to the pressure sensor, and may be, for example, a push button switch. The number of switches and signs is not particularly limited, and may be single. The symbol image is not limited to the image imitating the keyboard, and is, for example, the symbol image S imitating the keyboard in the above embodiment.
May be switched to a display mode of a symbol image imitating a mouse. In this case, the symbol image imitating the mouse is initially formed at a fixed origin position, and the marker 22 is arranged at the image forming position. When the symbol image and the marker 22 overlap and are visually recognized by the operator 10, By operating the switch 21 to turn on the light emitting elements constituting the sign 22 and detecting the relative position of the sign 22 with respect to the image forming position of the symbol image, the image display light L corresponding to the cursor image is displayed from the display unit 12a. An output signal is output to cause the cursor image to be formed at a certain initial position. Further, when the symbol image and the sign 22 overlap and are visually recognized by the operator 10, the switch 21 is operated to emit light, and the sign 22 is moved, so that the image forming position of the cursor image is changed. Is changed in accordance with the movement of the sign 22, and an input signal for changing the image forming position of the symbol image imitating the mouse following the movement of the sign 22 is output. Further, the image formation position of the symbol image imitating the mouse may be returned to the origin position by releasing the operation of the switch 21, and the image formation position of the cursor image may not be changed. Thus, the same input as that of an actual mouse can be performed. Furthermore, as a symbol image imitating a mouse, an image including a click switch image is formed.
By arranging the marker 22 at a position corresponding to the switch image and operating the switch 21, it may be possible to output the same input signal as when an actual mouse click switch is operated. In addition, two imaging devices may be arranged on the left and right of the image forming position of the symbol image S, and the detection error of the relative position of the marker 22 with respect to the symbol image S due to parallax may be corrected. The arrangement pitch of a plurality of character images in the symbol image S can be made fine.

[0022]

According to the present invention, the same input operation as using a keyboard can be performed simply, quickly and reliably without using a large-sized input device or voice input device. No need to learn input operation,
The input contents can be checked without any extra configuration, and the operability and portability are excellent. When displaying the input contents on a head-mounted display device, the input can be concealed because the display is invisible to anyone other than the operator. System can be provided.

[Brief description of the drawings]

FIG. 1 is an explanatory diagram of a use state of an input system according to an embodiment of the present invention.

FIG. 2 is a configuration explanatory diagram of an input system according to the embodiment of the present invention;

FIG. 3 is a diagram showing a field of view of an operator using the input system according to the embodiment of the present invention;

FIG. 4 is a configuration explanatory view of an operation unit of the input system according to the embodiment of the present invention;

[Explanation of symbols]

 Reference Signs List 6 control device 10 operator 12a display unit 12b optical system 16 combiner 21 switch 22 sign 31 optical filter S symbol image

Claims (5)

[Claims] A switch operable by an operator;
A position indicating marker that can be moved by the operator, output means for an image signal corresponding to a predetermined symbol image, means for emitting image display light corresponding to the image signal, the operator and image display light By being arranged at a fixed position with respect to the emission means, the optical path of the image display light is changed so that the symbol image is formed at a fixed position in the field of view of the operator, and from the image forming position of the symbol image. An optical system having a combiner capable of transmitting light, position detecting means for detecting a relative position of the sign disposed at the image forming position with respect to the symbol image, and an input signal corresponding to the detected relative position of the sign, Means for outputting by operation of the switch. 2. The symbol image includes a plurality of character images arranged at predetermined positions with respect to each other, and the marker is located at a position corresponding to any image forming position in the plurality of character images. 2. The input system according to claim 1, wherein an input signal corresponding to the character image can be output when the switch is operated by operating the switch. 3. The switch comprises a switch mounted on a finger of an operator, and the marker emits light of a specific wavelength by operating the switch, and is mounted on a finger on which the operated switch is mounted. The position detecting means has an image pickup device having an optical filter that transmits light of the specific wavelength, and the image pickup device uses an image pickup device that emits light through the optical filter through the optical filter. 3. The input system according to claim 1, wherein the relative position of the marker is determined based on the generated image signal. 4. The input system according to claim 3, wherein the image display light emitting means, the optical system, and the imaging device are movably mounted on the head of the operator. 5. An optical system comprising: means for outputting an image signal corresponding to the input signal, wherein image display light corresponding to the image signal corresponding to the input signal is emitted by the image display light emitting means and the optical system By changing the optical path by
5. The input system according to claim 1, wherein an image corresponding to the input signal is formed in a field of view of an operator.