JP2000298544A - Input / output device and input / output method - Google Patents

Abstract

(57) [Problem] To provide an input / output device which can perform input / output without occupying a desk space, is highly convenient, and can be operated with a sense of play. SOLUTION: In an input / output device for displaying a result processed according to an input operation, a projection means 19 for projecting a display screen and operation keys on a plane, and a display screen or operation keys projected on a plane. An image capturing means 20 for capturing an input operation performed by the operator, and an image identifying means 15 for analyzing an image captured by the image capturing means and identifying the input operation performed by the operator.
And processing means 18 and 16 for performing processing according to the identified input operation and controlling the projection means to reflect the processing result on the display of the display screen. Space is not occupied because input / output is performed on the projected image.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an input / output device on which an input operation of a computer or the like is performed and an output of the input / output device is displayed, and an input / output method thereof. It was made.

[0002]

2. Description of the Related Art Conventionally, console type computers have
It has a keyboard for input and a CRT for display,
They are placed on a desk and connected by various wires. In addition, portable computers in which a liquid crystal display screen is foldably coupled to a keyboard have become widespread.

[0003] In a business form in an office or a counter, these devices are arranged on a desk, an input operation is performed from a keyboard, and the result is displayed on a display screen. At the counter, if necessary, an operation is performed in which the display screen of the device is turned to the customer to confirm the display content.

In addition, personal computers, word processors, etc.
A plurality of models are arranged on a desk, and different models are used depending on the contents of work.

[0005]

However, when these devices are placed on a desk, the space on the desk is occupied, and the devices become obstacles, preventing other work on the desk.

In recent years, it has become necessary to install several types of devices in one counter, and the space shortage of the counter has become remarkable. In addition, when multiple devices are actually arranged at the counter, the counter table becomes narrow, which makes it difficult to carry out procedures such as reception, etc. is there.

[0007] The present invention is to solve such a conventional problem, and it is possible to perform input and output without occupying the space on the desk, regardless of the type of the model, and it is convenient. It is another object of the present invention to provide an input / output device which can be operated in a sense of play, and to provide an input / output method thereof.

[0008]

Therefore, in the input / output device of the present invention, a projection means for projecting a display screen and operation keys on a plane, and an operator with respect to the display screen or the operation keys projected on the plane. Imaging means for capturing an input operation performed by
Analyzing the image taken by the imaging means, the image identification means for identifying the input operation performed by the operator, performs processing according to the identified input operation, controls the projection means, and displays the processing result on the display screen. Is provided.

In the input / output method of the present invention, a display screen and operation keys are projected on a plane, an input operation is performed on the display screen or the operation keys, and an image obtained by capturing the input operation is analyzed. The content of the input operation is identified, processing is performed in accordance with the content of the input operation, and the processing result is reflected on the display screen.

Therefore, the input processing can be performed without occupying the space on the plane, and the processing result can be displayed.

[0011]

DESCRIPTION OF THE PREFERRED EMBODIMENTS The invention according to a first aspect of the present invention is directed to an input / output device for displaying a result processed according to an input operation, a projection means for projecting a display screen and operation keys on a plane. And an imaging unit that captures an input operation performed by the operator on a display screen or operation keys projected on a plane, and analyzes an image captured by the imaging unit to identify the input operation performed by the operator. An image identification means and a processing means for performing processing according to the identified input operation and controlling the projection means to reflect the processing result on the display screen are provided. Not take up space.

According to a second aspect of the present invention, the projecting means projects the display screen and the operation keys on a desk top surface or a wall surface, and projects the operation screen anywhere on a flat surface. can do.

According to a third aspect of the present invention, the image identifying means identifies the input operation based on the length of the shadow of the operator's fingertip. It disappears, and it can be recognized that the key is selected.

According to a fourth aspect of the present invention, a plurality of image pickup means having different photographing directions are provided as image pickup means, and it is possible to prevent a situation in which the movement of a short finger cannot be caught by a long finger. Can be.

According to a fifth aspect of the present invention, the image identifying means identifies the input operation based on the shape or behavior of one or more fingers of the operator, and the finger is bent or the fingertip is bent. The key selection can be displayed by an action such as moving the.

According to a sixth aspect of the present invention, an operator performs an input operation using an auxiliary tool having a light emitting element, and the image identifying means identifies the input operation based on a light emitting position of the auxiliary tool. The light emitting element emits light at the position of the key to be selected, and the key selection is displayed.

According to a seventh aspect of the present invention, the assisting tool comprises a rod having a light emitting element at the tip, and the light emitting element emits light when a push button provided on the rod is pressed. Hold the auxiliary tool as if holding a pencil, and emit light at the position of the key to be selected.

In the invention according to claim 8, the auxiliary tool comprises a cap to be fitted to a fingertip, a light emitting element is provided on the claw side upper surface of the cap, and the light emitting element is turned on when pressed on the lower surface side of the cap. A switch is provided, and the cap is pressed against the projection surface at the position of the key to be selected to cause the light emitting element to emit light.

According to a ninth aspect of the present invention, the glove having the cap at each fingertip constitutes an auxiliary tool, and the input operation can be performed using each finger of the hand.

According to a tenth aspect of the present invention, a plurality of types of image identification means and processing means are provided so that input and output can be performed with a plurality of types of display screens and operation keys using projection means and imaging means. Then, by selecting the type and turning on the power switch, a desired operation screen is projected on the desk, and when the power switch is turned off, it disappears.

According to the eleventh aspect of the present invention, there is provided an image identification means for identifying a marking code from an image of a document or the like taken by the imaging means. Mistakes can be eliminated and the input operation can be simplified.

According to a twelfth aspect of the present invention, there is provided an image identification means for reading a character from an image of a document or the like taken by an image pickup means. Input operation can be simplified.

According to a thirteenth aspect of the present invention, there is provided an invisible light projecting means for projecting an invisible light onto a document or the like, an invisible light imaging means for photographing an invisible light image, and a stealth image obtained by the invisible light imaging means. An image identification means for reading the marking code is provided, and the marking code can be read while maintaining security.

According to a fourteenth aspect of the present invention, there is provided a display image size adjusting means for adjusting the size of the image projected by the projecting means, and a picked-up image size adjusting means for adjusting the size of the image picked up by the imaging means. And an operation screen of an appropriate size can be displayed.

According to a fifteenth aspect of the present invention, there is provided a display image position / angle adjusting means for adjusting a position and an angle of an image projected by a projection means, and a picked-up image position for adjusting a position and an angle of an image picked up by an image pick-up means. / Angle adjusting means, so that the operation screen can be displayed at a desired position and angle.

[0026] According to a sixteenth aspect of the present invention, there is provided a display image brightness adjusting means for adjusting the brightness of an image projected by the projecting means,
And a brightness adjustment unit for adjusting the brightness of the image captured by the imaging unit, so that the operation screen can be displayed at a desired brightness. According to a seventeenth aspect of the present invention, the image identification unit identifies the shape or the action of the operator's finger from the image captured by the imaging unit, and the display image size adjustment unit, the captured image size adjustment unit, the display image position / The angle adjusting means, the captured image position / angle adjusting means, the display image brightness adjusting means or the captured image brightness adjusting means perform the adjustment based on the identification result of the image identifying means. By forming a predetermined shape or performing a predetermined operation, the size, position, and the like of the operation screen can be adjusted.

The invention according to claim 18 is provided with a capturing means for capturing a voice and a voice identification means for identifying the captured voice, the display image size adjusting means, the picked-up image size adjusting means, the display image position / Angle adjustment means, captured image position /
The angle adjustment means, the display image brightness adjustment means or the captured image brightness adjustment means are adapted to perform adjustment based on the identification result of the voice identification means, and the operator makes a voice,
By clapping the hand, the size and position of the operation screen can be adjusted.

According to a nineteenth aspect of the present invention, the projection means includes:
Two types of projection means for projecting a complementary polarization image and a different-phase polarization image are provided, the imaging means captures a polarization image that can be viewed by an operator wearing polarizing glasses, and the image identification means includes an imaging means. It analyzes the image taken by the operator and identifies the input operation performed by the operator, and the person who performs the window procedure or a third party cannot read it, but the operator of the device cannot Because it can be read, security can be ensured.

According to a twentieth aspect of the present invention, the projection means comprises:
Projecting an image of invisible light such as infrared light or ultraviolet light, the imaging means shoots an image of invisible light, and the operator performs input operation by wearing glasses of a filter that visualizes the invisible light, Although it cannot be read by the person who performs the counter procedure or by a third party, it can be read by the operator of the apparatus, so that security can be ensured.

According to a twenty-first aspect of the present invention, the projecting means comprises:
It is configured to have a light source that can move parallel to the projection plane inside a housing that has a projection light transmission port, and distortion occurs even when the projection image of the operation screen is moved on a plane. do not do.

According to a twenty-second aspect of the present invention, a plurality of projection means for projecting images on different desks are provided as projection means, and each projection means projects the same image. It is possible to project the operation screen on which the user performs an input operation on the counter of the counter user.

According to a twenty-third aspect of the present invention, the desk surface on which the image is projected by the projection means is inclined so that it can be easily seen.

According to a twenty-fourth aspect of the present invention, there is provided communication means for transmitting and receiving image data projected from the projection means to and from each other. It becomes possible to exchange screen data and to share operation screens by communicating image data with a remote location.

According to a twenty-fifth aspect of the present invention, an RFID reading means for reading an RFID is provided. For example, by taking in an ID from a procedure document with an RFID function, an input error is eliminated and an input operation is simplified. Can be

According to a twenty-sixth aspect of the present invention, the RFID reading means is arranged below a projection surface on which an image is projected from the projection means, so that the ID can be easily taken in from a procedure document with an RFID function. Can be.

According to a twenty-seventh aspect of the present invention, there is provided a click feeling imparting device for forming a depression at a position of an operation key on which an input operation has been performed in response to an input operation by an operator.
The operator can confirm the input operation and reduce erroneous operations.

According to a twenty-eighth aspect of the present invention, there is provided a voice generating means for generating a voice for input confirmation in response to an input operation by the operator, so that the operator can confirm the input operation. , Can reduce erroneous operations.

According to a twenty-ninth aspect of the present invention, the electronic key reading means is provided, and the operation is started on condition that the read electronic key is appropriate, so that security can be maintained.

According to a thirtieth aspect of the present invention, a marking code reading means for personal authentication is provided, and the operation is started on condition that the marking code read from the operator's name tag is appropriate. , Security can be maintained. The invention according to claim 31 is provided with personal recognition determination means for recognizing a physical feature such as a human phase, and starts operation on condition that the recognized physical feature matches a registered physical feature. As a result, security can be maintained.

According to a thirty-second aspect of the present invention, there is provided RFID reading means for reading RFID from an ID card, and the operation is started on condition that the RFID read from the ID card of the operator is appropriate. Yes,
Security can be maintained.

According to a thirty-third aspect of the present invention, the projection means and the imaging means are held on a support standing on a partition between desks, and the image identification means and the processing means are arranged inside the partition. Nothing occupies the desk space.

According to a thirty-fourth aspect of the present invention, the projection means and the imaging means are held on a support standing on the side plate of the reception counter, and the image identification means and the processing means are arranged inside the side plate. Nothing occupies the space on the counter.

According to a thirty-fifth aspect of the present invention, in the input / output method for displaying a result processed in accordance with an input operation, a display screen and operation keys are projected on a plane, and the display screen or the operation keys are Performs an input operation, analyzes the captured image of the input operation, identifies the content of the input operation, performs processing according to the input operation content, and reflects the processing result on the display screen display. Yes, the input processing can be performed without occupying the space on the plane, and the processing result can be displayed.

According to a thirty-sixth aspect of the present invention, when the length of the shade of the fingertip shown in the image is shorter than a predetermined length, a key or icon located at the fingertip is identified as being selected, When the fingertip is put on the projection surface, the shadow disappears, and it can be recognized that the key is selected.

According to a thirty-seventh aspect of the present invention, when a finger shown in an image performs a predetermined action, a key or an icon located at the fingertip is identified as being selected. A key selection can be displayed by moving the fingertip little by little.

According to a thirty-eighth aspect of the present invention, a hand of an operator performing an input operation is photographed from two directions, and movements of different fingers are analyzed from images in each photographing direction. It is possible to prevent a situation in which the movement of a short finger is hidden by the finger and cannot be caught. In the invention according to claim 39, an input operation is performed using an auxiliary tool having a light emitting element, and when a light emitting element that emits light is reflected in an image, a key or an icon of a light emitting position is identified as being selected. The light-emitting element emits light at the position of the key to be selected, and the key selection is displayed.

According to the present invention, a marking code or a character is identified by analyzing an image of a document or the like.
The input information is fetched as input information, thereby eliminating input errors and simplifying the input operation.

According to the invention described in claim 41, the size of the image to be projected, the projection position and angle, the luminance of the projection image, the size of the image to be photographed, the photographing position and angle, or the luminance of the photographed image are represented by the finger The operator adjusts the position and size of the operation screen by creating a predetermined finger shape and performing a predetermined movement. Can be.

According to a twenty-second aspect of the present invention, a display screen and operation keys are projected on a plane by polarized light, and an image of a differently polarized light complementary to the polarized light is projected on the projected image, and the operator wears polarized glasses. Only when it is used, the display screen and the operation keys can be read, so that security can be maintained.

According to the present invention, the display screen and the operation keys are projected on the plane by invisible light, and the display screen and the operation keys are displayed only when the operator uses the glasses of the filter for visualizing the invisible light. The key is made legible, and security can be maintained.

According to a forty-fourth aspect of the present invention, a depression is formed at the position of the operation key on which the input operation has been performed so that the input operation can be confirmed, and the operator confirms the input operation. Erroneous operation can be reduced.

According to a forty-fifth aspect of the present invention, a voice is output in response to an input operation so that the input operation can be confirmed. The operator can confirm the input operation and perform an erroneous operation. Can be reduced.

According to the invention described in claim 46, the pointer is moved in the display screen in accordance with the movement of one finger indicating the pointer on the display screen, and the pointer is positioned at a position where the number of fingers becomes two. The pointer on the display screen can be moved by the operation of the finger.

According to the invention described in claim 47, the icon is moved in the display screen in accordance with the movement of the fingertip sandwiching the icon on the display screen, and the icon is positioned at a position where one of the fingers is bent. Yes, an icon on the display screen can be moved to a desired position by a finger operation.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.

(First Embodiment) As shown in the perspective view of FIG. 2 and the side view of FIG. 3, an input / output device according to a first embodiment includes a device main body 23 installed at one corner on a desk and a projection device. And a video camera 20 for photographing. From the projector 19, an image of a display operation screen including a keyboard 21 and a display screen 22 is projected on a desk,
The video camera 20 captures the state of the operator's hand operating the keyboard 21. And video camera 20
The image taken with is analyzed and the operator's finger is
Which key of the key 21 is pressed is detected, the calculation based on the keyboard operation is performed in the apparatus main body 23, and the calculation result is projected on the display screen 22 by the projector 19.

As shown in FIG. 1, the main body of the input / output device includes a projection display screen display control unit 16 for controlling the display of a display screen 22 projected from the projector 19, and a keyboard 21 projected from the projector 19. A projection-type operation key display control unit 17 for controlling the display of an image, and an image analysis unit 15 for analyzing an image photographed by the photographing video camera 20 and recognizing an input.
And a storage circuit unit 11 for storing necessary data, a storage medium read / write device unit 12 for reading and writing data from and on a storage medium, a printing device unit 13 for printing, and each unit of an input / output device. A power supply unit 14 that supplies power and a CPU 18 that controls each unit and performs arithmetic processing are provided.

In this device, the operation of the keyboard is performed on the projected keyboard, and the operated key is detected by the image analysis of the image analysis unit 15. The processing such as the operation based on the operated key and the operation of recording data on the storage medium and reading the data are performed in the same manner as a conventional computer, and the processing result is transmitted to the projection display screen display control unit 16. The image is projected from the projector 19 under the control.

Accordingly, the display function of the conventional computer is changed to the display screen 22 projected on the desk, and the keyboard of the conventional computer is changed to the keyboard 21 projected on the desk. Just like a computer.

FIG. 4 shows the operation flow of this device.

Step 1: When the operator turns on the power switch, power supply is started from the power supply unit 14 to each unit. Step 2: The storage area of the storage circuit unit 11 is cleared. Step 3: Storage medium read / write device The program read from the storage medium is loaded by the unit 12.

Step 4: After each input / output is initialized, Step 5: The projection display screen display control unit 16 and the projection operation key display control unit 17 control the projection of the display screen and the keyboard.

Step 6: When the display operation screen is projected, Step 7: The operator performs key operation on the keyboard portion of the display operation screen.

Step 8: The image analysis section 15 performs image analysis on the imaged screen of the keyboard portion. Step 9: The result of the image analysis is input to the CPU 18.

Step 10: The CPU 18 performs calculations according to the input contents, and also performs procedural business processing and the like.

Step 11: This processing result is sent to the projection display screen display control unit 16, and the projection display screen display control unit 16
Controls to display this processing result on a display screen projected from the projector 19.

Step 12: The procedures of Steps 7 to 11 are repeated until the processing such as the procedure work is completed. When the processing is completed, Step 13: The operator performs an end operation.

In this apparatus, it is determined as follows whether or not the operator's finger has pressed the projected keyboard key.

As shown in FIG. 5A, when the hand is placed on the desk on which the keyboard is projected, the shade of the finger is projected on the desk by the light of the image projected by the projector 19. As shown in FIG. 6, the length of the shade from the fingertip becomes longer as the fingertip is further away from the desk, and when the fingertip comes into contact with the desk, as shown in FIG. 7 and FIG. Be shorter.

The image analysis section 15 analyzes the length of the shade of the fingertip from the image taken by the video camera 20, and determines that a key has been pressed when the length is shorter than a predetermined value. .

The position of the pressed key is determined as follows.

As shown in FIG. 8, a graphic (checkered pattern) serving as a mark is projected on the four corners of the keyboard to be projected, and the positional relationship between the mark and each key of the keyboard is stored in a computer in advance. On the other hand, with the video camera 20,
The operator's finger is photographed together with the landmark figure, and when the operator places his / her finger on a key selected, the image is analyzed,
The selected key is calculated from the relative position between the finger position and the mark figure at that time.

In another method, as shown in FIG.
The positions of the keys of the projected image on the keyboard are assigned to the pixels of the CCD image pickup device of the video camera 20, and the relationship between each pixel and the position of the keys is stored in the computer in advance. When the operator places a finger on a key to be selected, an image of the keyboard and the finger is analyzed to determine which key corresponds to the position of the finger.

Further, the image of the original keyboard is compared with the image of the keyboard on which the finger is reflected, and image analysis is performed to determine the point where the difference appears remarkably.
The position of the key selected by the finger can also be determined.

As described above, the input / output device of this embodiment can perform an input operation by projecting the display / operation screen on the desk, and by erasing the projection, the input / output device of the desk with the display / operation screen is present. The upper part returns to the state where there is nothing. Therefore, an input / output device that does not occupy a desk space can be provided.

Here, the case where the operator operates the projected keyboard with a finger has been described. In this apparatus, however, the icon displayed on the display screen of a normal computer is projected so as to be designated by a mouse. It is also possible to perform various processes by designating the displayed icon on the display screen with a finger.

As shown in FIG. 10, it is also possible to project a display operation screen on a wall surface or the like, perform an input operation, and output a processing result.

(Second Embodiment) In the second embodiment,
A configuration that enables an accurate input operation even when a large number of fingers are used will be described.

This input / output device, as shown in FIG.
Two video cameras A and B that capture the position of the hand from different directions are installed as video cameras for shooting.

Since the fingers of a human hand are long and short, in shooting from only one direction, there is a case where the long finger conceals the short finger and the input operation of each finger cannot be identified on the image. Therefore, in this device, two video cameras are installed, and from an image captured by the video camera A, for example, a little finger,
To identify the movement of the ring finger and the middle finger and, from the image captured by the video camera B, capture the finger that cannot be clearly captured at one camera position with the other camera, such as identifying the movement of the index finger and the thumb. This makes it possible to accurately capture input operations by all fingers.

(Third Embodiment) In the third embodiment,
An input operation method for displaying a key selection by a gesture of a finger will be described.

As shown in FIG. 12, when the operator selects a key on the projected keyboard, the operator shakes his fingertip to the left or right. When detecting the movement of the fingertip from the image, the image analysis unit 15 identifies that the key has been selected.

As shown in FIG. 13, when the operator selects a projected key on the keyboard, the operator bends the finger forward or backward within the key frame.

Further, the operator can read the information shown in FIGS.
As shown in FIG. 6, when the projected keyboard key is selected, an operation of superimposing two fingertips is performed.

By detecting such a gesture of the finger from the image of the video camera 20, it is possible to identify that the projected key of the keyboard is selected.

(Fourth Embodiment) In the fourth embodiment,
An input operation method for displaying selection of a key using an auxiliary tool will be described.

FIGS. 17 and 18 show a case where key selection is performed using a pencil-shaped indicator device. This indicator device has a switch button on the shaft,
An indicator lamp that lights up when the switch button is pressed is provided at the tip.

The operator touches the tip of the indicator device with the key to be selected and presses the switch button with the finger. With this operation, the indicator lamp is turned on to indicate that the key has been selected.

FIG. 19, FIG. 20, and FIG. 21 show a case where a key is selected by putting a cap on a fingertip. This cap has a pressure-sensitive switch on the lower surface side and a light emitting element on the claw side on the upper surface.

The operator presses the fingertip fitted with the cap on the key to be selected. With this operation, the pressure-sensitive switch is turned on, and the light emitting element on the nail side emits light, indicating that the key is selected.

FIG. 22 shows a glove in which this cap is fitted to each finger. The operator can perform an input operation using each finger by wearing the glove.

(Fifth Embodiment) In the fifth embodiment,
An input / output device that can be used for input / output of a plurality of types of computers will be described.

In this apparatus, as shown in FIG. 23, the apparatuses A, B and C are connected to a common projector and a video camera for photographing. Although the basic configuration of each device is the same, as shown in FIG. 24, the shapes of the keyboards projected by the devices A, B, and C are different from each other, and the input / output software of each device is different accordingly. are doing.

The operator selects the devices A, B, and C according to the job.
And turn on the power switch. The device with the power switch turned on starts up, projects the keyboard and display screen of the device on a desk, and when an operator selects a key from the keyboard, performs a calculation according to the key input, and displays the calculation result on the display screen. Projected to

As described above, this apparatus can be used as a plurality of apparatuses by sharing the projector and the video camera for photographing.

(Sixth Embodiment) The input / output device according to the sixth embodiment has a function of reading bar codes and characters.

As shown in FIG. 25, this device includes a visible light display / projection device 31 for projection, and a camera 32 for imaging, and an image analysis unit 33 recognizes an input. 34 and a marking code reading / recognition / analysis unit that reads marking codes such as barcodes and two-dimensional barcodes
35. Other configurations are the same as those of the first embodiment (FIG. 1).

In this apparatus, the input correspondence recognition / analysis section 34 of the image analysis section 33 performs a function as an input / output device.
Marking code reading / recognition / analysis unit 35 of image analysis unit 33
To read the marking code.

In this case, a document or card with a marking code is placed on a projection surface on a desk,
To shoot. The marking code reading / recognition / analysis unit 35 of the image analysis unit 33 cuts out and analyzes the marking code part from the photographed image, and the CPU 18 identifies the marking code based on the analysis result.

In this apparatus, by inputting the management number and the like by reading the marking code, the input operation can be simplified, and the input / output processing can be made faster and more accurate.

FIG. 26 shows an apparatus in which the digital camera video camera 36 and the image analyzer 33 perform optical reading of characters and marking codes in addition to input correspondence recognition.

In this apparatus, when a voucher, a form, a procedure document, or the like on which characters or the like are written is placed on the projection surface, the characters or the like are read by the image analysis unit 33. Therefore, the input operation of such information can be omitted, and the input / output processing can be speeded up and accurate.

(Seventh Embodiment) The input / output device of the seventh embodiment has a function of reading a stealth marking code that cannot be seen with the naked eye.

As shown in FIG. 27, this device includes an invisible light projecting / scanning device 42 for irradiating invisible light such as ultraviolet light or infrared light, an invisible light photographing device 41 for taking an image in response to the invisible light, and an invisible light photographing device 41. A stealth marking code reading device 43 that reads stealth markings from an image captured by the imaging device 41 is provided.

Although the stealth marking is invisible to the naked eye, it can be photographed by irradiating ultraviolet rays or the like, and the stealth marking code reader 43 can analyze the image and read the marking code.

In the apparatus of this embodiment, high security can be ensured by reading the input of the management number and the like from the stealth marking code.

(Eighth Embodiment) The input / output device of the eighth embodiment can adjust the size of the display operation screen to be projected.

In this apparatus, as shown in FIG. 28, a display screen projecting device 44 for projection has a display image size adjusting means 46, and a camera 45 for imaging has an image size adjusting means 47. Other configurations are the same as those of the first embodiment.

As shown in FIG. 29, the display image size adjusting means 46 of the display screen projecting device 44 adjusts the display operation screen to be projected to an appropriate size by enlarging or reducing it.
The imaging size adjustment means 47 of the imaging camera 45 adjusts the imaging size according to the size of the projected display operation screen.

(Ninth Embodiment) The input / output device of the ninth embodiment can adjust the projection position and angle of the display operation screen.

In this device, as shown in FIG. 30, a display screen projection device 44 for projection is provided with adjusting means 48 for adjusting the position, angle and the like of a display image, and a camera 45 for image capture is used to adjust the position of the captured image. Adjusting means 49 for adjusting the angle and the like.
Other configurations are the same as those of the first embodiment.

Position / Angle Adjusting Means of Display Screen Projector 44
As shown in FIG. 31, the position of the display operation screen to be projected can be moved up, down, left and right, and rotated, and the adjusting means 49 of the imaging camera 45 The captured image can be adjusted according to the position and angle of the screen.

(Tenth Embodiment) The input / output device of the tenth embodiment can adjust the brightness of the display operation screen. As shown in FIG. 32, a projection display screen projection device 44 adjusts the brightness of a display image as shown in FIG.
It has 50. Other configurations are the same as those of the first embodiment.

The luminance adjusting means 48 of the display screen projection device 44
Adjust the brightness so that the projected display operation screen is easy to see.

(Eleventh Embodiment) The input / output device of the eleventh embodiment can adjust the size, position, angle, brightness, and the like of the display operation screen by hand.

In this device, as shown in FIG. 33, a projection display screen projection device 44 includes an adjusting means 51 for adjusting the size, position, angle, luminance, etc. of a display image, and a camera 45 for image capturing. Equipped with adjustment means 52 for adjusting the size, position, angle, brightness, etc. of the captured image, and an image analysis unit 53 performs an adjustment and on / off operation by recognizing an input correspondence recognition unit 55 and a gesture or shape of a finger. And an operation determination unit 54 for identifying

FIG. 34 exemplifies various shapes and actions of fingers. The operator turns on or off the device, designates the contents of adjustment, and instructs execution by taking a predetermined hand shape or performing an action on the projection surface.

The shape and behavior of the hand are determined by the shooting camera 45.
And sent to the image analysis unit 53. The operation determination unit 54 of the image analysis unit 53 analyzes the image, determines on / off and adjustment instructions, and displays the display screen projection device 44 and the imaging camera.
Input is made to 45 adjusting means 51 and 52. Adjustment means 51, 52, the size of the display operation screen or the captured image according to the input instruction,
Adjust position, angle, brightness, etc.

As described above, the apparatus of this embodiment can automatically adjust the size, position, angle, brightness, and the like of the display / operation screen according to the shape and actions of the hand.

(Twelfth Embodiment) The input / output device of the twelfth embodiment can adjust the size, position, angle, brightness, etc. of the display operation screen by voice.

As shown in FIG. 35, this device includes a microphone 56 and a sound analyzer 57 for analyzing a sound input from the microphone 56.

The operator inputs a predetermined sound, a predetermined number of claps, etc. from the microphone 56 in accordance with the content of the adjustment. This sound is analyzed by the sound analyzer 57,
The device is turned on / off based on the analysis result, or
The identified adjustment instruction is sent to the projection display screen display control unit 16.
And input to the adjustment means 51, 52 of the display screen projection device 44 and the camera 45 for shooting via the projection type operation key display control unit 17,
The size, position, angle, brightness, and the like of the display operation screen and the captured image are adjusted.

(Thirteenth Embodiment) The input / output device of the thirteenth embodiment can read the display / operation screen only when wearing polarized glasses.

As shown in FIG. 36, this device comprises a polarization image projection display screen and operation key display control unit 58 for controlling the display of the polarization image on the display operation screen, and a polarization image display projection unit for projecting the polarization image. A device 62, a camera 63 for taking a polarization image for taking this polarization image, and a camera 63 for taking a polarization image
An image analysis unit 59 for analyzing an image captured by the controller, and a different-phase polarized image display screen and operation keys for an operator for controlling display of a display operation screen with different-phase polarization complementary to the polarization of the polarization image display projection device 62 A display controller 60, a different-phase polarization image projection device 64 that projects the different-phase polarization image, a different-phase polarization image imaging camera 65 that captures the different-phase polarization image, and an image captured by the different-phase polarization image imaging camera 65. And an image analysis unit 61 for analyzing.

In this apparatus, since different images are simultaneously projected from the polarization image display projection device 62 and the out-of-phase polarization image projection device 64, the contents of the image cannot be read by the naked eye of the projection surface. However, since the operator wearing the polarized glasses 67 can see only the image of the display operation screen projected from the out-of-phase polarized image projection device 64, the input operation can be performed on the display operation screen.

The image due to the out-of-phase polarized light is picked up by the out-of-phase polarized light image capturing camera 65, the image is analyzed by the image analyzing unit 61, and the calculation result corresponding to the input operation is displayed by the display control unit 60.
Is projected by the out-of-phase polarization image projection device 64 under the control of. Therefore, the operator wearing the polarizing glasses 67 can read the calculation result displayed on the projection surface, but cannot read it with the naked eye.

As described above, with this apparatus, input / output processing can be performed in a state in which it cannot be read by the counterpart of the counter procedure operation or a third party, and high security can be maintained for matters requiring confidentiality.

(Fourteenth Embodiment) In the input / output device of the fourteenth embodiment, the display operation screen is projected with invisible light,
The display operation screen can be read only when wearing glasses for visualizing invisible light.

As shown in FIG. 37, this device comprises an invisible light image display / projection device 69 for projecting an invisible light image, an invisible light image projection type display screen for controlling the display of the image, and an operation key display control section 68. And an invisible light image capturing camera 70 for capturing the image. Other configurations are the same as those of the first embodiment.

A display operation screen is projected from an invisible light image display / projection device 69 of this device by invisible light such as ultraviolet light or infrared light, and glasses 71 composed of a filter for converting the invisible light to visible light are put on. If the operator is not the operator, he cannot see this projected image.

Therefore, the input operation can be performed with high security.

(Fifteenth Embodiment) In a fifteenth embodiment, a projection method capable of projecting an image with little distortion even when the projection position is moved will be described.

As shown in FIG. 39, when an image is projected directly below the projection device, no image distortion occurs. However, if the direction of the projection device is changed to move the position of the projection image, As shown at 40, the projected image is distorted.

In order to prevent such a phenomenon, in the apparatus of this embodiment, as shown in FIG. 38, a light source 73 is installed in a projection apparatus 72 having a lens 74 so as to be movable in parallel.

In this apparatus, when moving the position of the projection image, the light source 73 is translated in the projection apparatus 72 in a direction opposite to the moving direction. The light from the light source 73 is
, After reaching the desk, the projected image is displayed, but the image displayed on the desk is not distorted even if the light source 73 is moved.

For this reason, in this device, even when the display operation screen is moved to a desired position on the desk to perform an input operation,
It is possible to project a display operation screen without distortion.

(Sixteenth Embodiment) The input / output device of the sixteenth embodiment can show a window user the same display operation screen operated by the operator.

As shown in FIG. 41, this device includes a window staff operation screen projection device 78 for projecting a window staff operation screen 77 on the desk to which the window staff 76 is heading, and a window counter table 75. Operation screen 77 for showing to user 80
And a window user screen projection device 79 for projecting an image.

The same image data is input to the window user's screen projection device 79 and the window staff operation screen projection device 78. The window user's screen projection device 78 is The same screen as the operation screen 77 to be projected is projected onto the counter counter table 75.

[0140] Therefore, the counter staff 76 can perform the counter reception work while showing the same operation screen 77 to the counter user 80, so that the procedure can be speeded up without any mistake and the procedure can be proceeded without error. Can be.

FIG. 42 shows a configuration in which the window counter table on which the operation screen 77 is projected and the surface of the desk are inclined so that the operation screen can be easily viewed by the window user and the window attendant. I have. With this configuration, the counter staff can easily perform an input operation on the operation screen.

(Seventeenth Embodiment) In the seventeenth embodiment, a system in which communication means is provided in each input / output device to enable data exchange between them will be described.

Each input / output device is provided with communication means for communicating image data of a display operation screen projected from the projection device. Each input / output device can display the same screen as the input / output device of the communication partner by projecting the image data of the display operation screen received through the communication unit from the projection device.

FIG. 43 shows an example of the use of such a system. An input / output device having communication means is installed at the desks of teachers and students. The student can receive image data projected on the teacher's desk through the input / output device and project the same display operation screen as the teacher on his / her desk. Based on the image data received from the input / output device, the same screen as that of the student can be displayed on the teacher's desk.

As described above, since each input / output device has the communication means, the same screen can be displayed on a plurality of devices placed in a classroom or in a remote place.

(Eighteenth Embodiment) The input / output device of the eighteenth embodiment has a radio ID (RFID) reading function.

As shown in FIG. 44, this device
An RFID reader 81 for reading an ID wirelessly transmitted from a document or the like to which the D function is added is provided. Other configurations are the same as those of the first embodiment.

A document having an RFID function includes an RFID response antenna and a memory, and transmits an ID stored in the memory from the RFID response antenna in response to wireless transmission from the RFID reader 81. .
The RFID reader 81 receives this ID and takes it in as data.

FIG. 45 shows an RFID reader 82
Is provided at the position of the projection plane.

As described above, the RFID function is added to the procedural document, and the ID is read by the RFID reader of the input / output device, so that the input operation can be omitted, and the ID and the like can be input quickly and accurately. become.

(Nineteenth Embodiment) In the input / output device of the nineteenth embodiment, a response when inputting can be given to the operator.

As shown in FIG. 46, this device is provided with a click feeling imparting device 84 on the projection surface on which the keyboard is projected so that the input position is depressed to give the feel of the input operation.
The apparatus main body is provided with a click feeling imparting device 83 at the time of operation input for driving the click feeling imparting device 84.

The click feeling imparting device 84 below the projection plane includes:
As shown in FIG. 47, a plurality of piezo elements are two-dimensionally arranged. When the operator performs a key selection operation on the projected keyboard, the image is analyzed and the position of the selected key is identified. The CPU transmits the position of the key to the click sensation imparting device 83 at the time of operation input to instruct the click sensation imparting operation, and the click sensation imparting device 83 at the time of operation input.
Applies a voltage to the piezo element at the specified key position. As a result, the position of the key selected by the operator is depressed, and the operator can obtain a feeling that the position is depressed by pressing the key.

As described above, in this input / output device, the operator can confirm the key input by obtaining the feeling of pressing the key, thereby reducing erroneous operations.

The apparatus shown in FIG. 48 includes a speaker or buzzer 85 that emits a sound when a key is selected by an operator.

In this input / output device, when key selection is identified by image analysis, a signal is output from the CPU to the speaker or buzzer 85, and the speaker or buzzer 85 generates sound. As described above, in this device, the operator can confirm the key input by voice, and reduce erroneous operations.

(Twentieth Embodiment) In the twentieth embodiment, a method of moving indicators and icons on the display screen by hand will be described.

As shown in FIG. 49, the indicator (arrow) displayed on the projected display screen is pointed by the tip of a single protruding finger, and then the fingertip is moved. In this gesture, the arrow moves with the movement of the fingertip. When the arrow is guided to a predetermined position, as shown in FIG. 50, the finger next to the finger that guided the arrow is protruded. By sticking out two fingers in this way, the position of the arrow is determined.

As shown in FIG. 51, when a pattern such as an icon displayed on the projected display screen is moved, the pattern is sandwiched between two fingertips and the hand is moved in that state. . This action causes the pattern to move with the movement of the hand. Next, when the pattern is guided to a predetermined position, one finger is bent as shown in FIG. With this action, the position of the pattern is determined.

[0160] The hands making such actions are imaged together with the indicators and icons, and the image analysis section analyzes the contents represented by the actions, and displays the movement of the indicators and icons based on the analysis results.

As described above, in this device, the movement of the indicator or the icon can be easily and simply performed by the hand.
Can be done quickly.

(Twenty-First Embodiment) In a twenty-first embodiment, a configuration for ensuring security of an input / output device will be described.

The device shown in FIG. 53 has an electronic key reader 87 in the main body of the device. This device does not start operation until the operator has made the electronic key reading device 87 read the electronic key.

Therefore, it is possible to prevent the operation of another person who does not have the key, and to maintain security.

The device shown in FIG. 54 includes a personal authentication marking code reading device 87 for reading a bar code or the like attached to an operator's name tag 89. This device starts its operation only when it is possible to identify from the code read from the operator's name tag 89 that the operator sitting in front of the device is a proper operator.

The device shown in FIG. 55 includes a personal recognition determining device 88 for identifying the operator's face. This device identifies the operator's face with the personal recognition determination device 88, and starts operating only when the operator sitting in front of the device can be identified as a proper operator.

The device shown in FIG. 56 reads an RFID from an RFID ID card 91 worn by an operator.
A D reading device 90 is provided. This device starts operation only when the RFID read from the operator's ID card 91 is a proper operator's ID.

[0168] In these devices, operations by persons other than the proper operator can be prevented, and security can be improved.

(Twenty-second Embodiment) In a twenty-second embodiment, the arrangement of input / output devices will be described.

FIG. 57 shows an example of arrangement on a desk. A printing device 92 is arranged under the desk, and the main body of the device is built in a partition 93 between the desks. A column is erected on the partition, and a projection device and an imaging device are arranged beyond the support.

FIG. 58 shows an example in which the structure of the apparatus main body is incorporated in a partition 94 which can be self-supported, a column is erected on this partition, and a projection device and an image pickup device are arranged beyond the column. The partition 94 in FIG. 58 can be used instead of the partition 93 in FIG.

FIG. 59 shows an example in which an input / output device is arranged at a reception counter. The main body of the device is built in a side plate 95 holding a counter table surface. The device is arranged, and the printing device 92 is arranged below the counter table 96.

With such an arrangement, a large space can be secured on the desk, other work on the desk is not hindered, and the aesthetic appearance can be maintained.

[0174]

As is apparent from the above description, in the input / output device and the input / output method of the present invention, it is not necessary to arrange various displays and operation keyboards on a desk or the like, thereby simplifying the desk. Can improve the aesthetic appearance of the counter and desk, and enhance the image.

In addition, one input / output device can perform input / output processing corresponding to a plurality of types of devices. In addition, even if the specification of the device group needs to be changed or added, it can be dealt with by changing software or adding software, so that the degree of freedom is high and the total cost is low.

Further, not only can the operability of the computer applied equipment be improved, but also the unexpectedness and fun of the input operation can attract the interest of young people and children. It can also be used for input processing.

Further, by adding various secondary functions, the range of application can be expanded.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a configuration of an input / output device according to a first embodiment;

FIG. 2 is a perspective view of the input / output device according to the first embodiment;

FIG. 3 is a side view of the input / output device according to the first embodiment;

FIG. 4 is a flowchart showing the operation of the input / output device according to the first embodiment;

FIG. 5 is a diagram illustrating a state (a) before key selection by a finger and a state (b) after key selection is performed in the input / output device according to the first embodiment;

FIG. 6 is an explanatory diagram showing a state before a finger touches a projection surface in the input / output device according to the first embodiment;

FIG. 7 is an explanatory diagram showing a state after a finger touches a projection surface in the input / output device according to the first embodiment;

FIG. 8 is an exemplary view for explaining a method of determining a selected key position in the input / output device according to the first embodiment;

FIG. 9 is an exemplary view for explaining another method of determining a key position selected in the input / output device according to the first embodiment;

FIG. 10 is a diagram showing a state in which the input / output device of the first embodiment is projected on a wall surface.

FIG. 11 is a diagram showing positions of two cameras in the input / output device according to the second embodiment;

FIG. 12 is a diagram showing a key selection method for moving a finger in the input / output device according to the third embodiment;

FIG. 13 is a view showing a key selection method for bending a finger in the input / output device according to the third embodiment;

FIG. 14 is a diagram showing a key selection method for overlapping a finger on the input / output device according to the third embodiment;

FIG. 15 is a diagram showing a state before selection of a key selection method for overlapping a finger on the input / output device according to the third embodiment;

FIG. 16 is a diagram showing a state after selection of a key selection method of overlapping a finger on the input / output device according to the third embodiment;

FIG. 17 is a diagram showing a key selection method using a stick-shaped auxiliary tool in the input / output device according to the fourth embodiment;

FIG. 18 is a diagram illustrating a state when a key selection method using a stick-shaped auxiliary tool is selected in the input / output device according to the fourth embodiment;

FIG. 19 is a diagram showing a key selection method using a cap-like auxiliary tool in the input / output device according to the fourth embodiment;

FIG. 20 is a diagram showing a state before selection of a key selection method using a cap-like auxiliary tool in the input / output device of the fourth embodiment;

FIG. 21 is a view showing a state after selection of a key selection method using a cap-like auxiliary tool in the input / output device of the fourth embodiment;

FIG. 22 is a view showing a key selection method using gloves having a cap-like auxiliary tool in the input / output device of the fourth embodiment;

FIG. 23 is a block diagram showing a configuration of an input / output device according to a fifth embodiment;

FIG. 24 is a block diagram showing types of a plurality of keyboards displayed by the input / output device according to the fifth embodiment;

FIG. 25 is a block diagram showing a configuration of an input / output device according to a sixth embodiment;

FIG. 26 is a block diagram showing another configuration of the input / output device according to the sixth embodiment;

FIG. 27 is a block diagram illustrating a configuration of an input / output device according to a seventh embodiment;

FIG. 28 is a block diagram showing a configuration of an input / output device according to an eighth embodiment;

FIG. 29 is a view showing an example of screen size adjustment in the input / output device according to the eighth embodiment;

FIG. 30 is a block diagram showing a configuration of an input / output device according to a ninth embodiment;

FIG. 31 is a view showing an example of adjustment of movement / rotation of a screen in the input / output device according to the ninth embodiment;

FIG. 32 is a block diagram showing a configuration of an input / output device according to a tenth embodiment;

FIG. 33 is a block diagram illustrating a configuration of an input / output device according to an eleventh embodiment.

FIG. 34 is a view showing the shape and behavior of a hand used in the input / output device according to the eleventh embodiment;

FIG. 35 is a block diagram showing a configuration of an input / output device according to a twelfth embodiment;

FIG. 36 is a block diagram showing a configuration of an input / output device according to a thirteenth embodiment;

FIG. 37 is a block diagram showing a configuration of an input / output device according to a fourteenth embodiment;

FIG. 38 is a diagram showing a configuration of a projection device in the input / output device according to the fifteenth embodiment;

FIG. 39 is a view showing a projection state of a conventional projection apparatus.

FIG. 40 is a diagram showing a projection state when a projection figure is moved by a conventional projection apparatus.

FIG. 41 is a view showing a counter using the input / output device of the sixteenth embodiment;

FIG. 42 is a view showing a counter having an inclined surface using the input / output device of the sixteenth embodiment;

FIG. 43 is a diagram showing the inside of a classroom using the input / output device of the seventeenth embodiment;

FIG. 44 is a block diagram showing a configuration of an input / output device according to an eighteenth embodiment.

FIG. 45 is a block diagram showing another configuration of the input / output device according to the eighteenth embodiment;

FIG. 46 is a block diagram showing a configuration of an input / output device according to a nineteenth embodiment;

FIG. 47 is a view showing a click feeling imparting device used in the input / output device according to the nineteenth embodiment;

FIG. 48 is a block diagram showing another configuration of the input / output device according to the nineteenth embodiment;

FIG. 49 is a view showing a method of moving the indicator in the input operation method according to the twentieth embodiment;

FIG. 50 is a view showing a method for positioning an indicator in the input operation method according to the twentieth embodiment;

FIG. 51 is a view showing a method of moving an icon in the input operation method according to the twentieth embodiment;

FIG. 52 is a view showing a method for positioning icons in the input operation method according to the twentieth embodiment;

FIG. 53 is a block diagram of a configuration using an electronic key of the input / output device according to the twenty-first embodiment;

FIG. 54 is a block diagram of a configuration for reading the personal authentication marking code of the input / output device according to the twenty-first embodiment;

FIG. 55 is a block diagram of a configuration for performing physical characteristic determination of the input / output device according to the twenty-first embodiment;

FIG. 56 is a block diagram of a configuration for performing RFID reading of the input / output device according to the twenty-first embodiment;

FIG. 57 is a perspective view showing a configuration of an input / output device according to a twenty-second embodiment;

FIG. 58 is a perspective view showing a modification of the configuration of the input / output device according to the twenty-second embodiment;

FIG. 59 is a perspective view showing another configuration of the input / output device of the twenty-second embodiment.

[Explanation of symbols]

11 Storage circuit unit 12 Storage medium read / write unit 13 Printing unit 14 Power supply unit 15 Image analysis unit 16 Projection display screen display control unit 17 Projection operation key display control unit 18 CPU 19 Projector 20 Video camera 21 Keyboard 22 Display Screen 23 Main unit 31 Visible light display / projection device 32 Imaging camera 33 Image analysis unit 34 Input correspondence recognition / analysis unit 35 Marking code reading recognition / analysis unit 36 Digital camera video camera 41 Invisible light photographing device 42 Invisible light projection scanning device 43 Stealth marking code reader 44 Display screen projection device 45 Imaging camera 46 Display image size adjustment means 47 Imaging size adjustment means 48 Position / angle adjustment means 49 Position / angle adjustment means 50 Brightness adjustment means 51 Display image size / position / Angle / brightness adjustment means 52 Size / position / angle / brightness adjustment means of captured image 53 image analysis unit 54 operation discrimination unit 5 5 Input recognition unit 56 Microphone 57 Sound analysis unit 58 Polarized image projection display screen and operation key display control unit 59 Image analysis unit 60 Heterogeneous polarization image display screen for operator and operation key display control unit 61 Image analysis unit 62 Polarized image Display and projection device 63 Camera for imaging polarized light image 64 Heterogeneous polarized light image projecting device 65 Camera for imaging out-of-phase polarized image 67 Polarized glasses 68 Invisible light image projection display screen and operation key display control unit 69 Invisible light image display / projection device 70 Invisible light image Imaging camera 71 Invisible light visible light glasses 72 Projector 73 Light source 74 Lens 75 Window counter table 76 Window clerk 77 Operation screen 78 Window clerk operation screen projector 79 Window user screen projector 80 Window user 81 RFID reading Device 82 RFID reader 83 Click sensation device for operation input 84 Click sensation device 85 Speaker / buzzer 86 Electronic key reading Ri device 87 personal identification marking code reader 88 personal recognition determination unit 89 name tag 90 RFID reader 91 ID card 92 printer 93 partition 94 self-sustainable partition 95 side plate 96 counter table

 ──────────────────────────────────────────────────続 き Continued on the front page F term (reference) 5B087 AA06 AE00 BC05 BC17 BC19 BC26 BC32 CC09 CC12 CC15 CC20 CC21 CC25 CC26 CC33 DD03 DD06 DE03 5E501 AA02 BA05 BA17 BA20 CA03 CB07 EA02 FA02 FA04

Claims (47)

[Claims] 1. An input / output device for displaying a result processed according to an input operation, comprising: a projection means for projecting a display screen and operation keys on a plane; and a display screen or operation keys projected on the plane. Image capturing means for capturing an input operation performed by the operator, image identifying means for analyzing an image captured by the image capturing means to identify the input operation performed by the operator, and processing corresponding to the identified input operation And a processing means for controlling the projection means to reflect a processing result on the display of the display screen. 2. The input / output device according to claim 1, wherein the projection unit projects the display screen and the operation keys on a desk top surface or a wall surface. 3. The input / output device according to claim 1, wherein said image identification means identifies an input operation based on a length of a shade behind a fingertip of an operator. 4. The apparatus according to claim 1, wherein said image pickup means includes a plurality of image pickup means having different photographing directions.
An input / output device according to item 1. 5. The input / output device according to claim 1, wherein the image identification unit identifies an input operation based on a shape or a behavior of one or a plurality of fingers of the operator. 6. An operator performs an input operation using an auxiliary tool having a light emitting element, and said image identifying means identifies the input operation based on a light emitting position of said auxiliary tool. Item 1. The input / output device according to Item 1. 7. The light emitting device according to claim 6, wherein the assisting tool comprises a rod having a light emitting element at a tip thereof, and the light emitting element emits light when a push button provided on the rod is pressed. I / O device. 8. The auxiliary tool comprises a cap fitted to a fingertip, and includes a light emitting element on a claw side upper surface of the cap.
The input / output device according to claim 6, further comprising a switch on a lower surface side of the cap, the switch turning on the light emitting element when pressed. 9. The input / output device according to claim 8, wherein the assisting tool comprises a glove having the cap at each fingertip. 10. The apparatus according to claim 1, wherein a plurality of types of said image discriminating means and processing means are provided, and input and output by a plurality of types of display screens and operation keys are enabled by using said projecting means and imaging means. 2. The input / output device according to 1. 11. The input / output device according to claim 1, further comprising an image identification unit that identifies a marking code from an image of a document or the like captured by the imaging unit. 12. The input / output apparatus according to claim 1, further comprising image identification means for reading characters from an image of a document or the like taken by said imaging means. 13. An invisible light projecting means for projecting invisible light on a document or the like, an invisible light imaging means for photographing an invisible light image, and an image identification for reading a stealth marking code from the image photographed by said invisible light imaging means. 2. The input / output device according to claim 1, further comprising means. 14. An image display apparatus comprising: a display image size adjusting unit that adjusts a size of an image projected by the projecting unit; and a captured image size adjusting unit that adjusts a size of an image captured by the imaging unit. The input / output device according to claim 1. 15. A display image position / angle adjusting unit for adjusting a position and an angle of an image projected by the projecting unit, and a captured image position / angle adjusting unit for adjusting a position and an angle of an image captured by the imaging unit. The input / output device according to claim 1, further comprising: 16. An image display apparatus comprising: a display image brightness adjusting unit for adjusting brightness of an image projected by the projection unit; and a captured image brightness adjusting unit for adjusting brightness of an image captured by the imaging unit. The input / output device according to claim 1. 17. The image identification unit identifies a shape or an action of an operator's finger from an image captured by the imaging unit, and the display image size adjustment unit, the captured image size adjustment unit, and the display image position / angle. 17. The image processing apparatus according to claim 14, wherein the adjusting unit, the captured image position / angle adjusting unit, the display image luminance adjusting unit, or the captured image luminance adjusting unit performs the adjustment based on the identification result of the image identifying unit. I / O devices. 18. A system comprising: a capturing unit for capturing a voice; and a voice identifying unit for identifying the captured voice, wherein the display image size adjusting unit, the captured image size adjusting unit, the display image position / angle adjusting unit, and the image capturing 17. The input / output device according to claim 14, wherein an image position / angle adjustment unit, a display image luminance adjustment unit, or a captured image luminance adjustment unit performs adjustment based on the identification result of the voice identification unit. . 19. The projection means comprises two types of projection means for projecting a complementary polarized image and a different-phase polarized image, and the polarized image which can be viewed by an operator wearing polarized glasses. 2. The image capturing device according to claim 1, wherein the image identifying unit analyzes an image captured by the image capturing unit to identify an input operation performed by an operator.
An input / output device according to item 1. 20. The projection unit projects an invisible light image, the imaging unit captures the invisible light image,
The input / output device according to claim 1, wherein the operator performs an input operation by wearing glasses of a filter that visualizes invisible light. 21. The input / output device according to claim 1, wherein said projection means includes a light source capable of moving in parallel with a projection plane in a housing having a transmission opening of projection light. 22. The input / output apparatus according to claim 1, further comprising a plurality of projecting means for projecting an image on different desks as the projecting means, wherein each of the projecting means projects the same image. . 23. The input / output device according to claim 22, wherein a surface of the desk on which the image is projected by the projecting means is inclined for easy viewing. 24. The input / output device according to claim 1, further comprising communication means for mutually transmitting and receiving image data projected by said projection means. 25. The input / output device according to claim 1, further comprising an RFID reader for reading the RFID. 26. The input / output device according to claim 25, wherein said RFID reading means is arranged below a projection surface on which an image is projected from said projection means. 27. The input / output device according to claim 1, further comprising a click feeling imparting device that forms a depression at a position of the operation key where the input operation is performed in response to an input operation of the operator. . 28. The input / output device according to claim 1, further comprising a voice generating means for generating a voice for input confirmation according to an input operation by an operator. 29. The input / output device according to claim 1, further comprising electronic key reading means, wherein the operation is started on condition that the read electronic key is appropriate. 30. An input device according to claim 1, further comprising a marking code reading means for personal authentication, wherein the operation is started on condition that the marking code read from the name tag of the operator is appropriate. Output device. 31. An apparatus comprising personal recognition judging means for recognizing a physical feature such as a human phase, wherein an operation is started on condition that the recognized physical feature matches a registered physical feature. The input / output device according to claim 1, wherein 32. R for reading RFID from an ID card
The input / output device according to claim 1, further comprising FID reading means, wherein the operation is started on condition that the RFID read from the ID card of the operator is appropriate. 33. The image processing apparatus according to claim 33, wherein said projection means and image pickup means are held on a support standing on a partition between desks, and said image identification means and processing means are arranged inside said partition. Item 1. The input / output device according to Item 1. 34. The image forming apparatus according to claim 34, wherein the projection unit and the image pickup unit are held by a support standing on a side plate of a reception counter, and the image identification unit and the processing unit are arranged inside the side plate. 2. The input / output device according to 1. 35. An input / output method for displaying a result processed according to an input operation, wherein a display screen and operation keys are projected on a plane, and an input operation is performed on the display screen or the operation keys. An input / output method comprising: analyzing an image obtained by photographing an operation to identify an input operation content; performing a process according to the input operation content; and reflecting a processing result on a display of the display screen. 36. The input / output according to claim 35, wherein when the length of the shade of the fingertip shown in the image is shorter than a predetermined length, it is identified that a key or an icon located at the fingertip is selected. Method. 37. The input / output method according to claim 35, wherein when a finger shown in the image performs a predetermined action, a key or an icon located at the fingertip is identified as being selected. 38. The input / output method according to claim 35, wherein the hand of the operator performing the input operation is photographed in two directions, and the movement of a different finger is analyzed from the image in each photographing direction. 39. An input operation is performed using an auxiliary tool having a light-emitting element, and when a light-emitting element that emits light appears in the image, it is identified that a key or an icon of a light-emitting position has been selected. The input / output method according to claim 35. 40. The input / output method according to claim 35, wherein an image obtained by photographing a document or the like is analyzed to identify a marking code or a character and input as input information. 41. The size of an image to be projected, the projection position and angle, the brightness of the projection image, the size of the image to be shot, the shooting position and angle, or the brightness of the shot image, according to the shape or action of a finger reflected in the image. 36. The input / output method according to claim 35, wherein the input and output are adjusted. 42. The display screen and the operation keys are projected on the plane by polarized light, and an image of a different-phase polarized light complementary to the polarized light is projected on the plane, and only when the operator uses polarized glasses. 36. The input / output method according to claim 35, wherein the display screen and the operation keys are readable. 43. The display screen and the operation keys are projected on the plane by invisible light, and the display screen and the operation keys can be read only when an operator uses spectacles of a filter for visualizing the invisible light. 36. The input / output method according to claim 35, wherein: 44. The input / output method according to claim 35, wherein a depression is formed at a position of the operation key where the input operation has been performed so that the input operation can be confirmed. 45. A sound is output according to an input operation so that the input operation can be confirmed.
Input / output method described in. 46. The display device according to claim 35, wherein the pointer is moved in the display screen in accordance with the movement of one finger pointing the pointer on the display screen, and the pointer is positioned at a position where the number of fingers becomes two. Input / output method described in. 47. The method according to claim 35, wherein the icon is moved in the display screen in accordance with the movement of a fingertip sandwiching the icon on the display screen, and the icon is positioned at a position where one of the fingers is bent. Input / output method described.