JPH085954A - Eyeglass type image display device - Google Patents

Abstract

PURPOSE:To make a spectacles type picture display device compact and very portable and to perform the input/output of a computer in a state where confidentiality is kept by synthesizing and displaying an output image from a calculation processor and the state of key input inside the device. CONSTITUTION:This device is constituted of a keyboard 101 being an input device, a spectacles type display part 102 being the spectacles type picture display device, and a processing part 103 including a central arithmetic processor and acting as the calculation processor. The display part 102 is constituted of a liquid crystal panel 104, a 1st objective lens 105, a 1st prism 106, a 2nd prism 107, a 2nd objective lens 108, and an ocular part 109. A picture near the keyboard 101 and an operator's hand which is fetched by the 2nd objective lens 108 being a lens for variable power is projected at the lower part of the visual field of the operator by the action of the 2nd prism 107 being a reflection mirror and the ocular part 109. The displayed picture on the liquid crystal panel 104 is displayed on the upper part of the visual field of the operator by the action of the 1st objective lens 105 and the 1st prism 106.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an eyeglass-type image display device for displaying characters and images on a computer such as a computer.

[0002]

2. Description of the Related Art Cathode ray tubes (CRTs) and recently liquid crystal display devices (LCDs) are used as display devices for computers, especially personal computers. In particular, LCDs are mostly used as display devices in small computers that emphasize portability.

FIG. 19 shows an example of the configuration of a small computer. In the figure, the small computer is composed of a keyboard 701, a processing unit 702 including a central processing unit, and a display (display unit) 703. In the conventional small-sized computer configured as described above, the operator inputs a signal from the keyboard 701 which is an input unit, and sees a figure or a character as an output from the computer on the display unit 703. The display unit 7 displays figures and characters displayed as a monitor of the input information.
While watching at 03, the calculation processing is interactively advanced with the processing unit 702 which is the main body of the computer.

FIG. 20 shows a general outline of this small computer. The small computer mainly includes a first housing 801 including a processing unit and a keyboard, and a second housing 802 including a display unit. In the small-sized computer configured in this way, the first housing 801 and the second housing 802 are connected by a hinge, and when not in use, the first housing 801
And the second housing 802 are closed so as to overlap each other. This makes the small calculator smaller and more convenient to carry.

[0005]

However, as shown in FIG.
In the conventional small-sized computer shown in (2), the second housing 802 mainly including the display portion is large, and is not lightweight enough to be always carried. In addition, in order to expand the two housings as in the state of FIG. 20, a certain amount of space is required, and since another person can easily see the display unit,
There is a problem that it is difficult to handle a highly confidential calculation process.

The present invention has been made in view of the above-mentioned conventional problems, and is small in size, highly portable, has less restrictions on the place of operation, and maintains computer confidentiality. It is an object to realize an eyeglass-type image display device that can perform input / output.

[0007]

According to a first aspect of the present invention, there is provided a display device for displaying an output image of a calculation processing device, and a first image for converting the display image of the display device into an apparent distance of an operator.
And a second optical device that combines an image near the keyboard of the computing device with an image of the display device,
It is characterized by including.

According to the second aspect of the present invention, the second optical device takes in an image in the vicinity of the keyboard and reflects the light emitted from the variable magnification lens for adjusting the magnification and the variable magnification lens in an arbitrary direction. And a reflecting mirror.

According to a third aspect of the present invention, an image input device for photographing the vicinity of the keyboard of the calculation processing device and converting it into an image signal, and a combination for combining the image signal of the image input device and the image signal of the calculation processing device. And a first optical device for converting the display image of the display device into the distance of the operator's clear vision.

In the invention of claim 4 of the present application, the synthesizing apparatus is
An image signal is synthesized so that the output image of the calculation processing device and the image of the image input device are displayed at a desired size and position on the screen of the display device.

According to a fifth aspect of the present invention, a display device for displaying the output image of the calculation processing device, a first optical device for converting the display image of the display device into the distance of the operator's clear vision, and the display device. And a goggle which fixes the first optical device to the operator's head and which is provided with a transparent portion and a display region of the display device in the operator's field of view.

In the invention of claim 6 of the present application, the goggles are:
The lower part of the display device and the first optical device is transparent.

According to a seventh aspect of the present invention, there is provided a keyboard-like input device which is formed in a plate shape and detects a key input by a contact position of an operator's hand, and a keyboard-like input device which is attached to an upper portion of the keyboard-like input device. A first image pickup device for picking up an image of the device and an operator's hand performing a key input, and a first input device for replacing the keyboard-like input device with a previously stored pattern image of a keyboard and synthesizing with an output image of a calculation processing device Image processing device, a display device for displaying an image of the first image processing device, and a first optical device for converting the display image of the display device into the distance of the operator's clear vision. It is what

According to the invention of claim 8 of the present application, in the keyboard-shaped input device, a plurality of pressure sensors are arranged in a grid pattern.
A key signal is output to the first image processing device by pressing a specific pressure sensor.

According to a ninth aspect of the present invention, a plurality of pressure sensors and light receiving elements are arranged in a grid pattern, a keyboard-like input device for detecting a key input by pressing a specific pressure sensor, and a plurality of light receiving elements. A second image that discriminates the level of each received light signal obtained from the output, outputs the shadow image of the operator's hand, and combines the image of the keyboard stored in advance with the shadow image and combines with the output image of the calculation processing device. A processing device, a display device for displaying an image of the second image processing device, and a first optical device for converting the display image of the display device into the distance of the operator's clear vision. It is a thing.

According to a tenth aspect of the present invention, an image of a plurality of button-shaped switches having a stereoscopic parallax is generated, an output image of the calculation processing device is converted into a stereoscopic image, and the image of the button-shaped switch and the calculation processing are performed. An image generation device that synthesizes the output image of the device, a display device that displays the output image of the image generation device, and the line of sight of the left and right eyes of the operator is detected, and which of the plurality of button switches is gazed by the operator. And a line-of-sight detection device for detecting whether or not the line of sight is detected.

In the eleventh aspect of the invention of the present application, the line-of-sight detection device is a third optical device for adjusting the size of the images of the left and right eyes of the operator, and left and right images output from the third optical device. It is characterized by comprising a second imaging device that alternately switches between and picks up images, and a gazing point determination device that detects the gazing points of the left and right eyes imaged by the second imaging device.

In a twelfth aspect of the present invention, the third optical device is a pair of left and right concave mirrors that reflect the images of the left and right eyes of the operator and adjust the size thereof. is there.

[0019]

According to the first and second aspects of the present invention having the above characteristics, the display device displays the output image of the calculation processing device. On the other hand, the first optical device converts the display image of the display device into the distance of the operator's clear vision. The second optical device then combines the image near the keyboard of the computing device with the image of the display device. In this way, the operator can perform the calculation process while keeping the eyeglass-type image display device on the head and hardly moving the viewpoint of his / her eyes.

According to the invention of claims 3 and 4 of the present application,
The image input device photographs the vicinity of the keyboard of the calculation processing device and converts it into an image signal. Next, the synthesizing device synthesizes the image signal of the image input device and the image signal of the calculation processing device.
The display device displays the image signal of the synthesizing device by dividing the image of the keyboard and the output image of the calculation processing device. And the first
The optical device converts the display image of the display device into the distance of the operator's clear vision. In this way, the operator can perform the calculation process while keeping the eyeglass-type image display device on, without moving the viewpoint of his / her eyes.

According to the fifth and sixth aspects of the present invention,
The display device displays the output image of the calculation processing device. Then, the first optical device converts the display image of the display device into the distance of the operator's clear vision. The operator also operates the keyboard through goggles with a transparent lower part. This eliminates the need for a keyboard display.

According to claims 7 and 8 of the present application,
The keyboard-like input device detects a key input according to the contact position of the operator's hand. Next, the first imaging device images the keyboard-like input device and the hand of the operator who inputs the key. In the first image processing device, the keyboard-like input device replaces the image pattern of the keyboard stored in advance and synthesizes it with the output image of the calculation processing device. The display device displays the image of the first image processing device, and the first optical device converts the image of the display device into the distance of the operator's clear vision.

According to the ninth aspect of the present invention, the keyboard-like input device detects a key input by pressing the pressure sensor. Next, the second image processing device discriminates the level of each received light signal from the plurality of light receiving elements and outputs a shadow picture of the operator's hand. Then, the image of the keyboard stored in advance and the shadow picture are combined, and combined with the output image of the calculation processing device. The display device displays the image of the second image processing device. The first optical device converts the display image of the display device into the distance of the operator's clear vision. This allows the display device to combine the image of the calculation processing device and the image of the keyboard including the hand at an arbitrary position.

Further, according to the inventions of claims 10 to 12, the image generating device generates images of a plurality of button-shaped switches having a stereoscopic parallax as a stereoscopic image and combines them with the output image of the calculation processing device. . Then, the display device displays the output image of the image generation device. The line-of-sight detection device detects the lines of sight of the left and right eyes of the operator and identifies which of the plurality of button switches is being gazed by the operator. This eliminates the need for a keyboard, and you can enter keys simply by changing your line of sight.

[0025]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS A spectacles (goggles) type image display device according to a first embodiment of the present invention will be described with reference to FIGS. FIG. 1 is a block diagram showing the relationship between the eyeglass-type image display device and the computer input / output device of the first embodiment. In this figure, a computer input / output device A is a keyboard 1 which is an input device.
01, a glasses-type display unit 102 which is a glasses-type image display device,
It includes a central processing unit and the like, and is configured by a processing unit 103 that operates as a calculation processing device.

A computer input / output device A having such a configuration
In the above, when the operator inputs using the keyboard 101, the glasses-type display unit 102 forms an image of the state in the vicinity of the keyboard 101 and the operator's hand, and the processing unit is displayed on the display screen in the glasses-type display unit 102. The image is displayed either side by side or side by side with the output of 103.

FIG. 2 is a specific configuration diagram of the eyeglass-type display unit 102, and the same portions as those in FIG. 1 are designated by the same reference numerals. See also FIG.
Is a screen of the eyeglass-type display unit 102 which is incident on the eyes of the operator. The spectacles type display unit 102 indicated by a dotted line in FIG.
Liquid crystal panel 104, first objective lens 105, first prism 106, second prism 107, second objective lens 10
8 and the eyepiece lens unit 109. The image near the keyboard 101 and the operator's hand captured by the second objective lens 108, which is a variable power lens, is the second reflection mirror.
Due to the functions of the prism 107 and the eyepiece lens unit 109, the image is projected in the lower part of the operator's visual field as shown in FIG. The display image on the liquid crystal panel 104 is the first objective lens 1
04 and the first prism 106 function to display an image in the upper part of the operator's visual field.

In the composite screen shown in FIG. 3, the output screen of the processing unit 103 is displayed in the upper part of the screen, and the image near the keyboard 101 is displayed in the lower part. This allows the operator to easily perform key input while looking at the keyboard 101 and his / her hand. Further, by adjusting the first objective lens 105 in FIG. 2, the position of the virtual image on the output screen of the processing unit 103 can be set to the same position as the image of the keyboard 101. This adjustment can reduce eye fatigue when moving the viewpoint. It is also possible to match the position of the keyboard 101 with the virtual image position of the output of the processing unit 103, or to adjust both positions according to the preference of the operator. In this embodiment, screens other than those shown in FIG. 3 can be configured, and the prisms 106 and 107 can also be configured by mirrors or the like.

Here, the liquid crystal panel 104 is the processing device 103.
The first objective lens 105 constitutes a first optical device for converting the display image of the liquid crystal panel 104 into the distance of the operator's clear vision. The second prism, the second objective lens 108, and the eyepiece lens unit 1
Reference numeral 09 indicates an image near the keyboard 101 on the liquid crystal panel 10.
A second optical device that is incident on the operator's eye is combined with the image of FIG.

Next, an eyeglass-type image display device according to the second embodiment of the present invention will be described with reference to FIGS. FIG. 4 is a configuration diagram showing the relationship between the eyeglass-type image display device and the computer input / output device B of the second embodiment. The same parts as those in the first embodiment are designated by the same reference numerals, and the description thereof will be omitted. To do. In this figure, the computer input / output device B is a keyboard 1
01, a spectacles type display unit 201 which is a spectacles type image display device,
The processing unit 103 is a calculation processing device.

Computer input / output device B having such a configuration
In, the operator inputs using the keyboard 101. The input information is processed by the processing unit 103,
The output of the processing unit 103 is an eyeglass-type display unit (display device) 201.
Is displayed inside. Further, the keyboard 101 and the operator's hand are imaged by the image input device 206 attached to the lower portion of the glasses-type display unit 201.

FIG. 5 is a block diagram of the glasses-type display unit 201. In the figure, a glasses-type display unit 201 includes an image input device 206 composed of a small camera such as a CCD, a magnification adjusting circuit 205 for adjusting a magnification, a signal applied to an input end 202 and an image signal of a processing unit 103. It is composed of a combining circuit (combining device) 203 for mixing a plurality of images and a liquid crystal panel 204 which is a display device. The glasses-type display unit 2
It is assumed that the first optical device is internally provided in 01 as in the first embodiment.

The spectacles type display unit 201 configured as described above
At, the image near the keyboard 101 and the operator's hand is input from the image input device 206. This image is adjusted to an appropriate size by the magnification adjustment circuit 205 and input to the synthesis circuit (synthesis device) 203. In the synthesis circuit 203, the image signal and the character signal input from the processing unit 103 of the computer,
The keyboard 101 input from the magnification adjusting circuit 205 and the image near the operator's hand are combined, and the image as shown in FIG. 3, for example, is displayed on the screen.

In this way, the operator can easily perform key input while looking at the keyboard 101 and his / her hand. The magnification adjusting circuit 205 and the combining circuit 203 are included in the processing unit 1.
According to the instruction from 03, it is possible to change the size of the image near the keyboard 101 and the operator's hand, and the arrangement when combining with the output screen of the processing unit 103. By instructing the size and arrangement of this image to the processing unit 103 through the keyboard 101, the operator can freely change the arrangement of the screen and the size of each constituent screen in addition to the screen shown in FIG.

Next, an eyeglass-type image display device according to the third embodiment of the present invention will be described with reference to FIGS. FIG. 6 is a configuration diagram showing the relationship between the eyeglass-type image display device and the computer input / output device C of the third embodiment. The same parts as those in the first embodiment are designated by the same reference numerals, and the description thereof will be omitted. To do. In this figure, the computer input / output device C is a keyboard 1
01, the processing unit 103, and the transmissive display unit 301. The transmissive display unit 301 is a goggle in which the display device (liquid crystal panel) and the first optical device are fixed to the head of the operator, and a transparent portion and a display area of the display device are provided in the operator's field of view. .

FIG. 7 is an explanatory diagram showing a display screen of the transmissive display unit 301. As shown in the figure, the output image of the processing unit 103 is displayed on the display device provided on the upper part of the display screen, and the keyboard 101 and one's own hand are shown below the output image. In this way, the operator can change the direction of the head to simultaneously view the display image of the processing unit 103 with a small amount of viewpoint movement while looking at the keyboard 101 and his / her hand. Further, by adjusting the position of the virtual image of the image of the processing unit 103 to the same extent as the distance between the keyboard 101 and the head, eye fatigue can be reduced.

Next, an eyeglass-type image display device according to the fourth embodiment of the present invention will be described with reference to FIGS. FIG. 8 is a block diagram showing the relationship between the eyeglass-type image display device and the computer input / output device D of the fourth embodiment. The same parts as those in the first embodiment are designated by the same reference numerals and the description thereof will be omitted. To do. In the figure, the computer input / output device D is composed of a processing unit 103, an input unit 401, an image processing unit 402, and a glasses-type display unit 403 of the computer. The input unit 401 includes a pressure sensor and an image input device. It is assumed that the display device and the first optical device are internally provided in the eyeglass-type display unit 403 as in the first embodiment.

As shown in the configuration diagram of FIG. 9A, the input unit 401 includes a pressure sensor input device 404, an image input device and a supporting device 405 thereof. As shown in FIG. 9A, the pressure sensor input device 404 is a keyboard-shaped input device in which a large number of pressure sensors are arranged in a grid pattern.
There is no particular marking on the surface for identifying the key. The image input device 408 attached to the support device is a first imaging device that reflects the operator's hand. FIG. 9B is a diagram showing the back side of the image input device and its supporting device 405 of FIG. 9A. The image input device 408 is, for example, a CCD
It is composed of a camera. The image input device 408 can be attached to the lower side of the support device to capture an image of the operator's hand.

The image of the image input device 408 is the image processing unit 4.
Sent to 02. FIG. 10 is a block diagram showing the configuration of the image processing unit 402. As shown in the figure, the image processing unit 40
Reference numeral 2 is composed of a keyboard information memory 412, a keyboard image producing section 413, and a synthesizing circuit 409. The keyboard information memory 412 is a memory that stores a keyboard-shaped image and a display pattern of key-shaped characters and numbers. The keyboard image creation unit 413 is a circuit that creates an image of the keyboard. The synthesizing circuit 409 is a circuit for synthesizing the image signal from the image input device 408 and the image from the keyboard image producing unit 413. The image processing unit 402 has a function of a first image processing device that replaces the image of the keyboard stored in advance with the input unit 401 and combines the input / output data of the processing unit 103.

The keyboard image production section 413 outputs the keyboard information memory 412 and the pressure sensor input device 40.
An image of the keyboard is created from the information (key signal) of 4. In this image, for example, as shown in the image of the keyboard of FIG. 11, characters or numbers are displayed on each key, and the pressed key is displayed so as to retract. In the synthesizing circuit 409 of FIG. 10, the image of the operator's hand input from the image input device 408 is synthesized with the output image of the keyboard image creating unit 413 as a background, and the output end 410 is used for image display as shown in FIG. The signal of is output. In this way, the operator does not feel uncomfortable with the operation of the input unit 401.

As described above, since the operator operates while looking at the output image of the synthesis circuit 409, the pressure sensor input device 4
It is not necessary to attach a key display to 04. Also, by changing the contents of the keyboard information memory 412, it is possible to handle keyboards of different shapes. Further, by storing the information of a plurality of keyboards in the keyboard information memory 412 and switching them, it is possible to immediately deal with keyboards having different shapes and key arrangements. In addition, by changing the camera of the image input device 408 to one compatible with wavelengths other than visible light (for example, infrared rays), it can be used in a dark place.

Next, an eyeglass-type image display device according to a fifth embodiment of the present invention will be described with reference to FIGS. FIG. 12 is a block diagram showing the relationship between the eyeglass-type image display device and the computer input / output device E of the fifth embodiment.
The same parts as those in the embodiment are designated by the same reference numerals, and the description of those parts will be omitted. In the figure, the computer input / output device E includes a processing unit 103, a spectacles type display unit 403, an image processing unit 5 of the computer.
01 and an input unit 502. The input unit 502 is composed of an array of pressure sensors and light receiving elements, and a lighting device.

As shown in the configuration diagram of FIG. 13A, the input section 502 has a pressure sensor 404 and a light receiving element 504 arranged in a key form as a set, and an illumination device and its supporting device 50.
3 is a keyboard-like input device provided with 3. Input section 5
On 02, pressure sensors 404 are arranged in a grid pattern, and the surface of the pressure sensor 404 is not particularly labeled for identifying a key. The arrangement of the light receiving elements 504 is, for example, each pressure sensor 404.
The light is received from the lighting device and its supporting device 503 at the center position of, but the amount of light decreases if the operator's hand is in the meantime. The image processing unit 501 of FIG.
4 is a second image processing device for creating an image in the vicinity of the input section by the signal of No. 4.

FIG. 13B is a structural view of the illuminating device of FIG. 13A and its supporting device 503 as viewed from the back side. In this way, the lighting device 505 is attached to the lower side of the support device 503. FIG. 14 is a block diagram of the image processing unit 501, and the same parts as those in the fourth embodiment are designated by the same reference numerals. As shown in the figure, the image processing unit 501 includes a nonlinear conversion circuit 50.
7, a two-dimensional low-frequency reactor wave circuit (LPF) 508, a keyboard information memory 412, a keyboard image production unit 413, and a synthesis circuit 409. The glasses-type display unit 40
It is assumed that the display device and the first optical device are internally provided in 3 as in the first embodiment.

In the image processing section 501 thus configured, when the signal from the input section 502 is input to the input end 506, the nonlinear conversion circuit 507 expands the signal from the light receiving element 504, for example, in a dark area. The shape of the hand is transformed by the non-linear transformation to. This makes it possible to reliably display the shape of the hand even if the operator's hand is slightly away from the input unit 502. The output of the non-linear conversion circuit 507 is the two-dimensional LPF 50.
8 is input, the two-dimensional LPF 508 performs horizontal and vertical low-pass reactor waves to smooth the image. Even if the number of light receiving elements 504 of the input unit 502 is small, the two-dimensional LPF 508 can smoothly obtain a hand image.

The output of the two-dimensional LPF 508 is the combining circuit 4
In 09, it is combined with the output of the keyboard image producing unit 413, and a clear keyboard image and a signal of the silhouette of the operator's hand are output via the output end 509. These images are combined with the output image of the processing unit 103, and the glasses-type display unit 4
It is displayed on 03. This output image is as shown in FIG. 15, for example. This screen is an example that incorporates the silhouette picture of the operator's hand and the image of the keyboard, and can be incorporated in any position on the screen in this way. Also, as in the fourth embodiment, the contents of the keyboard information memory 412 can be changed, and a plurality of keyboards can be dealt with immediately. In addition, the lighting device 505
By making the light receiving element 504 compatible with wavelengths other than visible light, it is possible to operate in a dark place without being seen by others.

Next, an eyeglass-type image display device according to a sixth embodiment of the present invention will be described with reference to FIGS. FIG. 16 is a block diagram showing the relationship between the eyeglass-type image display device and the computer input / output device F of the sixth embodiment.
The same parts as those in the fifth embodiment are designated by the same reference numerals, and the description of those parts will be omitted. In the figure, the computer input / output device F has an input unit 401, a processing unit 103, an image processing unit 402, and an eyeglass-type display unit 600.

The spectacles type display section 600 includes a concave mirror 60 for the left eye.
1, a right-eye concave mirror 602, a liquid crystal shutter 603, a left-eye image display device 606, and a right-eye image display device 607. The left-eye image display device 606 and the right-eye image display device 607 are connected to cables 608 and 609, respectively.
Is connected to the image processing unit 605 via. In addition, the liquid crystal shutter 603 and the image input device 604 are connected to the cable 61.
It is connected to the line-of-sight calculation device 630 via 0.

Here, it is assumed that the input section 401 and the image processing section 402 operate in the same manner as in the fourth embodiment. Similar to the first to fifth embodiments, the spectacles type display unit 600 is used by the operator wearing it in front of the head like the spectacles, and FIG. 16 is a view seen from the side of the wearing operator.

Now, the image processing apparatus (image generating apparatus) 605.
Has two effects. The first effect is to convert the output of the processing unit 103 into a stereoscopic image. That is, the image processing device 605 adds the parallax according to the convergence of the left and right eye pupils to the output of the processing unit 103. The output from the processing unit 103 is 2
Since it is a three-dimensional image, it can be easily converted into a three-dimensional image by changing the display positions of the right eye and the left eye according to the parallax according to the depth degree. The depth degree can be adjusted by the operator. The operator proceeds with work while looking at the screen of the stereoscopic image displayed on the image display device for left eye 606 and the image display device for right eye 607.

The second function of the image processing apparatus 605 is to display a stereoscopic input button in the eyeglass-type display section 600. FIG. 17 is an example of a display screen of the glasses-type display unit 600. As shown in FIG. 17, these button groups are mainly displayed in the peripheral portion of the screen so as not to disturb the operation. As shown in FIG. 17, the output image 612 of the processing unit 103 and the output images 613 and 614 of the image processing apparatus 605 are three-dimensionally displayed inside the display range 611.

In the spectacles type display section 600 shown in FIG. 16, the left-eye concave mirror 601 and the right-eye concave mirror 602 reflect the images of the left eye and the right eye, respectively, and adjust the size of the images. This light is photographed by the image input device 604 through the liquid crystal shutter 630. The image input device 604 and the liquid crystal shutter 603 operate in conjunction with each other to alternately pick up images of the left and right eyes for each field, and constitute a second image pickup device. Here, the left-eye concave mirror 601 and the right-eye concave mirror 602 form a third optical device that adjusts the size of the images of the left and right eyes of the operator.

FIG. 18 is a structural diagram showing the operation principle of the eyeglass-type display section 600 including the liquid crystal shutter 603. The liquid crystal shutter 603 is composed of a right eye liquid crystal shutter 620 and a left eye liquid crystal shutter 621. The liquid crystal shutter 620 for the right eye and the liquid crystal shutter 621 for the left eye are alternately opened and closed for each field to transmit or block light. Therefore, the image input device 604 captures images of the left and right eyes for each field.

The signal from the image input device 604 is sent to the line-of-sight computing device (gazing point determination device) 630 of FIG. The line-of-sight calculation device 630 calculates the gazing point (position and depth) from the positions of the left and right eyes, and determines which of the left and right button groups in FIG. 17 is gazing. In the processing unit 103 of FIG. 16, for example, when a certain button is gazed for a certain period of time or more based on the output of the visual line calculation device 630, it is determined that the button is input. Further, when a certain key input is made while gazing at a certain button, that button may be input. In this way, the output images 613 and 614 of the three-dimensional button group can be used as the input means. Here, the left-eye concave mirror 601, the right-eye concave mirror 602, the liquid crystal shutter 603, and the image input device 60.
4. The line-of-sight calculation device 630 constitutes a line-of-sight detection device that detects the lines of sight of the left and right eyes of the operator and detects which of the plurality of button switches is being gazed by the operator. In this way, by moving frequently input keys to the three-dimensional button portion, the key input to the processing unit 103 becomes faster. Also, the keyboard itself can be eliminated, and the computer input / output device can be made more compact.

[0055]

As described in detail above, according to the inventions of claims 1 to 12 of the present application, the output image of the calculation processing device and the state of key input can be combined and displayed inside the eyeglass-type image display device. it can. This makes the display very small,
The operator can perform the calculation process with the eyeglass-type image display device attached, without moving the viewpoint of his / her eyes. Also, because the display contents are not known to others,
You can perform highly confidential work.

In particular, according to the first and second aspects of the present invention, the image near the keyboard including the operator's hand is optically captured and combined with the output of the calculation processing device inside the eyeglass-type image display device. To display. Therefore, an image pickup device for picking up an image of the keyboard becomes unnecessary.

According to the third and fourth aspects of the present invention, an image near the keyboard including the operator's hand is picked up and displayed inside the spectacle-type image display device in combination with the output of the calculation processing device. To do. Therefore, the display device is extremely small and lightweight.

According to the fifth and sixth aspects of the present invention, since the lower part of the display device for displaying the image of the calculation processing device in the eyeglass-type image display device is composed of transparent goggles, the operator Can work by looking at the images on the keyboard and display at the same time. In this case, an image pickup device for picking up an image of the keyboard and an optical device are unnecessary, and the spectacles are further reduced.

According to the seventh and eighth aspects of the present invention, an image of the operator's hand captured by the first image pickup device,
The image of the keyboard-like input device can be combined in a precise positional relationship. In particular, the key arrangement of the keyboard input device can be easily changed by image processing. In addition, the weight of the keyboard-like input device can be significantly reduced as compared with a normal input device.

According to the invention of claim 9 of the present application,
As a keyboard-like input device, pressure sensors and light-receiving elements are arranged in a grid pattern, a shadow of the operator's hand captured in the light-receiving element is created, and input operation to the calculation processing device is performed in an accurate positional relationship with the keyboard image. Can be displayed. Therefore, the key arrangement of the keyboard-like input device can be easily changed by image processing. Further, there is an effect that the weight of the keyboard-like input device can be remarkably reduced as compared with a normal input device.

According to the tenth to twelfth aspects of the present invention, the image of the button-shaped switch is three-dimensionally displayed on the display device by the image generation device, and the operator can see which switch the user is gazing at. The detection device detects it. For this reason, the operator of the calculation processing device can input a key that is frequently input by using the visual field of the eye without using the keyboard, which has the effect of accelerating the input work. Also, the keyboard itself can be eliminated, and the calculation processing device can be made significantly smaller.

[Brief description of drawings]

FIG. 1 is a diagram showing a relationship between an eyeglass-type image display device and a computer input / output device according to a first embodiment of the present invention.

FIG. 2 is a configuration diagram of an eyeglass-type image display device according to a first embodiment.

FIG. 3 is a diagram showing a screen of the eyeglass-type image display device of the first embodiment.

FIG. 4 is a diagram showing a relationship between an eyeglass-type image display device and a computer input / output device according to a second embodiment of the present invention.

FIG. 5 is a configuration diagram of an eyeglass-type image display device according to a second embodiment.

FIG. 6 is a diagram showing a relationship between a glasses-type image display device and a computer input / output device according to a third embodiment of the present invention.

FIG. 7 is a diagram showing a screen of an eyeglass-type image display device according to a third embodiment.

FIG. 8 is a diagram showing a relationship between an eyeglass-type image display device and a computer input / output device according to a fourth embodiment of the present invention.

FIG. 9 is an external view of an input unit used in the eyeglass-type image display device according to the fourth embodiment.

FIG. 10 is a configuration diagram of an eyeglass-type image display device according to a fourth embodiment.

FIG. 11 is a diagram showing a screen of an eyeglass-type image display device according to a fourth embodiment.

FIG. 12 is a diagram showing a relationship between a spectacles-type image display device and a computer input / output device according to a fifth embodiment of the present invention.

FIG. 13 is an external view of an input unit used in the eyeglass-type image display device according to the fifth embodiment.

FIG. 14 is a configuration diagram of an eyeglass-type image display device according to a fifth embodiment.

FIG. 15 is a diagram showing a screen of an eyeglass-type image display device according to a fifth example.

FIG. 16 is a diagram showing a relationship between a spectacles-type image display device and a computer input / output device according to a sixth embodiment of the present invention.

FIG. 17 is a diagram showing a screen of an eyeglass-type image display device according to a sixth embodiment.

FIG. 18 is a structural diagram showing the operation principle of the eyeglass-type display device of the sixth embodiment.

FIG. 19 is a block diagram of a conventional small-sized computer.

FIG. 20 is an external view of a conventional small-sized computer.

[Explanation of symbols]

 101 keyboard 102, 201, 403, 600 spectacles type display unit 103 processing unit 104, 204 liquid crystal panel 105, 108 objective lens 106, 107 prism 109 eyepiece lens unit 202, 411, 506 input end 203, 409 composite circuit 205 magnification adjustment circuit 206, 408, 604 Image input device 301 Transmissive display unit 401, 502 Input unit 402, 501 Image processing unit 404 Pressure sensor 405 Image input device and support device 410, 509 Output end 412 Keyboard information memory 413 Keyboard image production unit 503 Lighting Device and supporting device 504 Light receiving element 505 Lighting device 507 Non-linear conversion circuit 508 Two-dimensional LPF 601 Concave mirror for left eye 602 Concave mirror for right eye 603 Liquid crystal shutter 605 Image processing device 606 Image table for left eye 606 Device 607 right-eye image display device 608,609,610 cable 611 display screen 612, 613, and 614 output image 620 right-eye liquid-crystal shutter 621 right-eye liquid-crystal shutter 630 gaze computing device

Claims (12)

[Claims] 1. A display device for displaying an output image of a calculation processing device, a first optical device for converting a display image of the display device into a distance of the operator's clear vision, and a display device near a keyboard of the calculation processing device. A second optical device for combining an image with the image of the display device, and a spectacle-type image display device. 2. The second optical device includes a variable power lens that captures an image in the vicinity of the keyboard and adjusts a magnification, and a reflecting mirror that reflects light emitted from the variable power lens in an arbitrary direction. The eyeglass-type image display device according to claim 1, further comprising: 3. An image input device for photographing the vicinity of a keyboard of a calculation processing device and converting it into an image signal, a combination device for combining the image signal of the image input device and the image signal of the calculation processing device, and the combination. An eyeglass-type image display device, comprising: a display device that displays an image of the device; and a first optical device that converts the display image of the display device into a distance that is a clear vision of an operator. 4. The synthesizing device synthesizes an image signal so that an output image of the calculation processing device and an image of the image input device are displayed at a desired size and position on the screen of the display device. The eyeglass-type image display device according to claim 3, wherein the eyeglass-type image display device is provided. 5. A display device for displaying an output image of a calculation processing device, a first optical device for converting a display image of the display device into a distance of clear vision of an operator, the display device and the first An eyeglass-type image display device comprising an optical device fixed to an operator's head and a goggle having a transparent portion and a display area of the display device provided in the operator's field of view. 6. The eyeglass-type image display device according to claim 5, wherein the goggles are transparent at a lower portion of the display device and the first optical device. 7. A keyboard-shaped input device which is formed in a plate shape and detects a key input depending on a contact position of an operator's hand; and a keyboard-shaped input device mounted on an upper portion of the keyboard-shaped input device, A first image pickup device for picking up an image of the operator's hand, and a first image processing device for replacing the keyboard-like input device with a previously stored pattern image of a keyboard and synthesizing it with an output image of a calculation processing device. And a display device that displays an image of the first image processing device, and a first optical device that converts the display image of the display device into a distance of the operator's clear vision. Eyeglass-type image display device. 8. The keyboard-shaped input device, wherein a plurality of pressure sensors are arranged in a grid pattern, and a key signal is output to the first image processing device by pressing the specific pressure sensor. The spectacles-type image display device according to claim 7. 9. A keyboard-shaped input device in which a plurality of pressure sensors and light receiving elements are arranged in a grid pattern, and a key input is detected by pressing the specific pressure sensor, and each light receiving element obtained from the plurality of light receiving elements. A second image processing device that discriminates the signal level, outputs a shadow picture of the operator's hand, combines the image of the keyboard stored in advance with the shadow picture, and combines with the output image of the calculation processing device; A spectacles type comprising: a display device that displays an image of the second image processing device; and a first optical device that converts the display image of the display device into a distance that is a clear vision of an operator. Image display device. 10. An image of a plurality of button-shaped switches having stereoscopic parallax is generated, an output image of the calculation processing device is converted into a stereoscopic image, and the image of the button-shaped switch and the output image of the calculation processing device are converted. An image generating device to be combined, a display device for displaying an output image of the image generating device, and a line of sight of the left and right eyes of the operator is detected, and which of the plurality of button switches is gazed by the operator is detected. An eyeglass-type image display device comprising: a line-of-sight detection device for detecting. 11. The line-of-sight detection device alternately switches between a third optical device that adjusts the size of the image of the left and right eyes of the operator and the left and right images output from the third optical device. 11. The eyeglasses according to claim 10, further comprising: a second image capturing device that captures an image, and a gaze point determining device that detects a gaze point of the left and right eyes imaged by the second image capturing device. Type image display device. 12. The third optical device is a pair of left and right concave mirrors that reflect the images of the left and right eyes of the operator and adjust the size thereof.
1. The eyeglass-type image display device described in 1.