CN105659193A - Multifunctional human-computer interaction equipment - Google Patents

Abstract

The human interface device is characterized by comprising the following steps: receiving input of a first gesture from a user via a text entry area; generating first text-related information according to the first gesture; transmitting the text information to a digital device connected to the human-computer interaction device in a wired or wireless manner; and receiving input of a second gesture from the user.

Description

Multifunctional human-computer interaction equipment

technical field

The present invention relates to a human-computer interaction device configured to receive text information or indicate location information from a user in a digital device, which can receive text or indicate location-related information, such as a computer, notebook (or laptop), Tablet PC, mobile phone, etc., and send the received information to the digital device.

Background technique

Text input devices, such as keyboards, configured to enter text in personal computers or portable (or mobile) digital devices have been disclosed. Furthermore, a pointing device configured to control a pointing position of a pointer and perform a function of the pointer, such as a mouse device, configured to control a digital device has also been disclosed.

The text input device and the pointing device of the related art are either provided as separate devices, or the pointing input area is arranged in a separate area from the text input area of the text input device. In an operating environment in which text input, pointing position information input, and pointing execution command input are frequently switched, the operating efficiency decreases due to an excessive number of hand movements.

Contents of the invention

In the present invention, by setting the pointing position information input area of the pointing device on the text input area of the text input device, and by setting the switching unit configured to switch to and from the text input mode and the pointing position information input mode, in the text In inputting, performance of pointing input becomes possible while minimizing user's hand motion by simply switching the input mode, and accordingly, operation efficiency can be improved.

By integrating separately provided text input means and pointing means with a single human-computer interaction means, the price and size of products can be reduced, and operational efficiency can be improved by eliminating unnecessary operations in user manipulation.

Description of drawings

FIG. 1 shows an exemplary illustration of an integrated text input device equipped with a pointing device.

FIG. 2 shows a flowchart describing an exemplary sequence of operations corresponding to mode switching of a pointing device and a text device.

Fig. 3 shows an exemplary embodiment of the structure of a text input device and a pointing device.

FIG. 4 shows an exemplary embodiment of a mode conversion unit integrating a pointer execution command unit.

FIG. 5 shows an exemplary embodiment of the structure of a pointer position information input device.

FIG. 6 shows a structural diagram of an infrared ray laser sensor module.

FIG. 7 illustrates an exemplary embodiment of an input area for position information of a pointer.

FIG. 8 shows a first exemplary embodiment of a pointer position information input device detachable from a text input device.

FIG. 9 shows a second exemplary embodiment of a pointer position information input device detachable from a text input device.

FIG. 10 shows a third exemplary embodiment of a pointer position information input device detachable from a text input device.

Fig. 11 shows a front view and a perspective view of a human-computer interaction device applied with a low-position indicator position information input device.

FIG. 12 shows an exemplary embodiment of a mode conversion unit integrating a pointer execution command unit.

Fig. 13 shows an exemplary embodiment of a cover using a human-computer interaction device with a low-position indicator position information input device applied.

Fig. 14 shows an exemplary embodiment of a human-computer interaction device applied to a mobile notebook.

FIG. 15 illustrates an exemplary embodiment of applying a lower-order pointer position information input device and a lower-order pointer execution command unit.

specific embodiment

The present invention relates to a multi-machine interactive device configured to receive text information or pointing position information from a user in a digital device and transmit the received information to a digital device that can receive text or pointing position related information , and such as a computer, notebook (or laptop), tablet PC, mobile phone, and the like.

A keyboard configured by an elastic body and a plurality of physical keys respectively connected to corresponding switches is being widely used as a conventional text information input device.

In addition, in a digital device equipped with a touch interface, when a virtual keyboard is displayed on a display and when a part of the user's body touches the virtual keyboard displayed on the display, a method displayed on the part touched by the user may also be used. A virtual keyboard and a method of entering text by detecting the user's gestures or also using electrical signals.

A touch interface may recognize a user's touch by: by recognizing the motion of a part of the user's body, or by recognizing a contact made on a specific contact surface, or by detecting an electrical current flowing through the user's body, or by detecting a movement of the user's body. Blocking or interference of light or sound waves caused by a part, etc.

Examples of touch screen interfaces include: resistive touch screens, capacitive touch screens, optical touch screens, surface acoustic wave (or ultrasonic) touch screens, and the like.

The resistive touch screen corresponds to a touch screen configured to operate by recognizing pressure.

While resistive touchscreens have the advantage of being cheap and the ability to take notes or write small letters by using a stylus, resistive touchscreens are also known to have a disadvantage in that, due to the way they use pressure, The touch cannot be recognized when pressed with too much force, and the resistive touch screen has slower touch sensitivity compared to the capacitive touch screen.

The resistive touch screen consists of multiple layers.

Among such layers, there is a conductive layer consisting of two layers facing each other with an air layer interposed therebetween.

When the outside of the screen is pressed, the above-mentioned two conductive layers come into contact with each other, and due to this contact, resistance and current change, thereby enabling the touch to be recognized.

A capacitive sensing or capacitive touch method corresponds to a method of sensing motion by using a capacitive coupling effect.

Unlike resistive touchscreens, which utilize pressure, capacitive touchscreens are made of a highly conductive glass known as indium tin oxide.

By having sensors attached to each of the four corners of the glass, the glass surface is in a state where current flows through it.

The principle of the capacitive method corresponds to the recognition of changes in electrical current through the use of such glasses.

When a finger touches the screen, the electrodes cause a current to flow through the glass and into the body through the finger, and, here, the capacitive method corresponds to an operation method of having the sensor detect where such a change in current occurs.

Capacitive touch screens are known to provide smooth manipulation and scrolling due to the capacitive touch method that recognizes a touch by lightly touching the screen, rather than by applying force to press on the screen.

Furthermore, capacitive touch methods can provide multi-touch functionality, where several points can be touched.

Since the capacitive touch method corresponds to an operation method using a changed amount of electric current, operations cannot be performed while wearing leather gloves through which electric current cannot flow or using nails or a stylus.

However, the screen can be touched by using a separate stylus dedicated to capacitive touchscreens.

Since the sensor is highly sensitive, the capacitive touch screen may be affected by other peripheral devices.

The optical touch screen operates by measuring coordinates using an infrared light ray camera installed at the apex of the touch screen and the shadow of an object intended to touch the screen, and the shadow is created by infrared light.

Surface acoustic wave (or ultrasonic) touch screens operate by measuring coordinates by emitting ultrasonic waves on the screen to detect interference effects caused by a user's touch.

In addition, various touch input techniques can be used in the present invention, which can be used to recognize the position information of the user's body part by detecting the user's contact or motion, thereby controlling the position information of the pointer.

FIG. 1 is an exemplary diagram illustrating an integrated text input device equipped with a pointing device.

A text input device integrating a pointing device may have a housing (100) configured to support a text input device and a pointer position information input area.

The casing has the hardness (or strength) that can resist the pressure input by the user, and the casing can be configured with a control unit, a storage unit, a battery unit, an encoding unit, a sending unit, etc., for receiving text input information and indicator position information The information is entered and for sending the corresponding information to the digital device, which is connected by a wired or wireless connection to the text input device integrating the pointing device.

The text input device integrating a pointing device may be provided with a plurality of keys (109) for receiving text input information from a user.

The above-mentioned multiple keys (109) may be composed of physical keys or virtual keys.

A physical button is composed of a button connected to an elastic body or a button itself that is elastic. The physical button is characterized in that, due to the elasticity of the button, when the button receives user input, the button is displaced, and, when the user input is removed, the button Return to its original position.

The physical key is configured to be connected to an electrical switch, and the physical key may be configured to have a structure in which, when the user applies pressure, the key is displaced and the phase of the switch is changed, thereby generating a text input value for the corresponding key .

The physical key corresponds to a resilient structure without an electrical switch, wherein the resilient structure is configured to be displaced after receiving user input and return to its original position when the user input is removed (or released), and the user The text input information may be generated based on position information of a position where the user's pressure or gesture is recognized through the touch input device described above.

The virtual keys may be configured to display text entry keys on the display device.

The virtual key may correspond to any key displayed by projecting light on a transparent or translucent or opaque object.

The virtual keys are not recognized by the user's eyes, but the virtual keys can generate corresponding text input information based on the user's pressure or posture information by using dedicated (or unique) position information for each text.

The integrated text input device equipped with a pointing device may have a text input area (107) and pointing position information input areas (108a, 108b) each having at least one part as a common area.

The indication position information input area (108a, 108b) corresponds to the area located at the surface or the upper part or the lower part of the key designated for text input, and, as shown in FIG. Share at least some of it.

The input area indicating position information may include a text input area, or the text input area may include an input area indicating position information.

The indicating position information input area and the text input area may have at least one part in common, and the at least one part may be used as the indicating position information input area but not used as the text input area, or the at least one part may be used as the text input area , but is not used to indicate a location information input area.

The integrated text input device equipped with a pointing device may be configured with a pointer position information input device (105) configured to create a virtual text input area or a virtual pointer position information input area for inputting text, or to use For inputting pointing position information, or for inputting text and pointing position information, it is arranged inside or outside the integrated text input device equipped with pointing means.

The indicator position information input device (105) can be detected by using an infrared light ray generator and an infrared light ray receiver, an RGB camera, an ultrasonic generator and an ultrasonic receiver, or an infrared light ray generator and an infrared light ray camera. Parts of the user's body on the surface of the housing (100) or above the housing (100) to receive position information and posture information.

In order to expand the input area or improve the accuracy and sensitivity, the indicator position information input device can be configured with multiple devices.

For example, a pointer position information input means (105b) for configuring text input of the right hand or pointing position information input area (108b) may be provided.

Alternatively, a pointer position information input device (105a) for configuring a left hand text input or pointing position information input area (108a) may also be provided.

The text input area or pointing position information input area (108b) assigned to the right hand may include the area of the J key in the English standard keyboard.

The text input area designated as the left hand or the pointing position information input area (108a) may include the area of the F key in the English standard keyboard.

The pointer position information input device may include two regions of the J key and the F key in the English standard keyboard.

In the case where the integrated text input device equipped with a pointing device is connected to a plurality of digital devices each having a display unit, then the pointing position information input area is capable of performing pointer position shifting within the plurality of display units.

For example, area division can be performed so that the pointer position information input area can be matched with each display unit, or an independent key of the guide display unit can be operated so as to transmit the pointer position information from the corresponding display unit, or, Pointer position information is sent such that the pointer can shift its position within a virtual single display unit by recognizing (or identifying) the plurality of display units as the virtual single display unit.

The integrated text input device equipped with a pointing device includes a pointing position information input device configured with a pointing input area and receiving pointing position information from a user. The integrated text input device equipped with a pointing device may have a pointer executing command unit (101, 102), which is configured to execute at least one function in the button, image, space, icon or text input window where the pointer is located, The pointer is moved (or repositioned) by the pointing position information input device.

The indicator execution command unit can be configured with one button or two buttons, each button is responsible for the first function and the second function respectively, and each button can be located at the left or right or central part of the housing.

For example, the first function may perform the same function as a left click of a computer mouse, and the second function may perform the same function as a right click of a computer mouse.

The pointer execution command unit equipped with one key or two keys may be provided on both the left and right sides of the housing so that both left-handers and right-handers can conveniently use the pointer execution command unit.

The pointer execution command unit may be configured to be operated by recognizing a touch of a part of the user's body or blocking of light or interference or shadow of the ultrasonic wave by the user's body part using the above-mentioned touch technology.

The indicator execution command unit may be configured with flexible physical keys.

The pointer execution command unit may be configured to operate by using at least one of text keys located in a text input area other than the indicated position information input area.

The pointer execution command unit can be operated by selecting a physical or virtual text key in the pointing position information input area.

For example, in the case where the virtual input means is used as the pointing position information input means, and in the case where the physical keys are used as the text input means, by inputting the pointing position in the virtual pointing position information input area in the pointing position information input mode The location information of the indicator, and pressing (or pushing) the physical button at the corresponding position can generate the indicator to execute the command.

The pointer execution command unit may receive the pointer position information according to (or by) a first user gesture within the pointing position information input area, and the pointer execution command unit may receive the pointer position information according to (or by) a second user gesture from the pointing position to generate pointer execution commands.

The pointer execution command unit may be configured to have a first function executed by using a first gesture of the user's body or a first voice, a first wink (or eye blink), a first shape of a mouth (or lips).

The pointer execution command unit may be configured to have a second function executed by using a second gesture of the user's body or a second voice, a second wink (or eye blink), a second shape of the mouth (or lips).

The integrated text input device equipped with the pointing device may be composed of the following modes: a text input mode, which can receive text information through the text input device; and an indication position information input mode, which can indicate the position information input mode The location information input device receives the indicated location information.

The text input mode and the pointing position information input mode can be switched by a mode switching unit (103).

The mode switching unit (103) may be configured with a switch separately located on the housing.

The mode conversion unit (103) may perform mode conversion by detecting at least one text input key included in the text input device or simultaneous reception of a plurality of text inputs.

The mode conversion unit (103) can perform mode conversion by receiving control information from a digital device connected to the integrated text input device equipped with a pointing device through a wired or wireless connection.

The mode conversion unit (103) may be configured to be integrated with the pointer execution command unit (102).

For example, a structure can be made such that the mode can be switched by detecting a first touch or a first pressure applied by a first gesture such as a contact of a part of the user's body with the pointer execution command unit (102), This is firstly in response to a first touch or first pressure, and secondly in response to a second touch or second pressure, and makes it possible to execute commands by generating the pointer in response to the second touch or second pressure produced by the second gesture, secondly Gestures such as pressing (or pushing) a key.

The mode conversion unit (103) may consist of a temporary mode conversion mode and a permanent mode conversion mode.

For example, the temporary switching mode may be configured to switch the text input mode to the pointing position information input mode by responding to the first touch or the first pressure, and when the first touch or the first pressure is removed (or released), return to text input mode.

Alternatively, the temporary switching mode may be configured to switch the pointing position information input mode into the text input mode by responding to the first touch or the first pressure, and when the first touch or the first pressure is removed (or released) , returns to the pointing position information input mode.

The long-term switching mode may be configured to switch the text input mode to the pointing position information input mode by responding to the second touch, the second pressure, or pushing the switch, and even if the second touch or the second pressure is removed (or released). Keep indicating the location information input mode.

The temporary mode switching may be performed by using first control information received from a digital device connected to the integrated text input device equipped with a pointing device via a wired or wireless connection.

Long-term mode switching may be performed by using second control information received from a digital device connected to the integrated text input device equipped with a pointing device via a wired or wireless connection.

The mode conversion unit (103) may be configured to be integrated with the pointer execution command unit.

For example, when a first touch or a first pressure is detected on the pointer execution command unit, a temporary mode transition from the text input mode to the pointer position information input mode may be established, and when a second touch or a second pressure is detected , generate a pointer execution command, and when a third touch or a third pressure is applied, a long-term mode transition can be established, which enables the operation to remain in the pointer position information input mode even if the third touch or third pressure is removed (or freed).

At this point, it is also possible to make such a configuration that in the long-term switching mode, the pointer execution command input can be performed.

The mode conversion unit may be arranged on the left side or the right side (106a, 106b) of the casing.

The mode switching units (106a, 106b) disposed on the left side, or right side, or both sides of the casing may be equipped with virtual keys or physical keys for operations by detecting user's touch input or pressure.

The mode conversion unit (106a, 106b) arranged on the left side, or right side, or both sides of the housing may be configured to have a distance corresponding to 3 cm or more and less than 15 cm along the side of the housing. Enter the area.

The integrated text input device equipped with a pointing device may include a sending unit (104) configured to send data to an external digital device via wired or wireless transmission or include an integrated text input device equipped with a pointing device. digital devices for text input devices.

The digital device may receive text input or may receive pointer position information.

Figure 2 shows a flowchart describing an exemplary sequence of operations corresponding to mode transitions of a pointing device and a text device.

An integrated text input device equipped with a pointing device may have a separate power unit, or may be powered by an external power source through a wired or wireless connection. The integrated text input device equipped with the pointing device may separately have a switch for controlling the power unit.

When power is supplied to the integrated text input device equipped with the pointing device by using a switch configured to control the power unit, it can be determined whether the integrated text input device equipped with the pointing device is currently in the text input mode or in the text input mode. A location information input mode is indicated (200).

Based on the determined result, in case the multi-machine interaction device is in a text input mode, the text input device may be activated and a text input may be received from a user (201).

Text input entered by the user may be sent to a digital device connected via a wired or wireless connection (202).

While operating in the text input mode, when a mode transition to the position-indicating input mode occurs, the text input mode may be switched to the position-indicating input mode.

Alternatively, a configuration may be made such that the input of the indication position information is performed simultaneously with the input of the text.

When the mode is switched to the indicating location information input mode, indicating location information may be received with a user's input (204).

The received pointer position information may be sent to a digital device connected via a wired or wireless connection (205).

When the integrated text input device equipped with the pointing device receives the pointer first execution command (206), the integrated text input device equipped with the pointing device can send the pointer first execution command to the The connected digital device is wirelessly connected (207).

When the integrated text input device equipped with the pointing device receives the pointer second execution command (208), the integrated text input device equipped with the pointing device may send the pointer second execution command to the Connected digital device (209).

An integrated text input device equipped with a pointing device may switch to a text input mode when a temporary mode switch is canceled, or when a long-term mode switch is cancelled.

In the event that power to the integrated text input device equipped with a pointing device is terminated when the integrated text input device equipped with a pointing device is blocked (or cut off) from the power switch of the power unit, there are no connected digits device, in the absence of user input for a predetermined period of time, the connection has been disconnected, or termination may be performed by control of a digital device connected via a wired or wireless connection.

Fig. 3 shows an exemplary embodiment of the structure of a text input device and a pointing device.

The integrated text input device equipped with a pointing device may include: a first housing (301), the first housing (301) including a power unit, a control unit or a communication unit, etc., and for configuring the text input area and A second housing (302) indicating a location information input area.

An integrated text input device equipped with a pointing device may have a text input device that receives text input from a user and a text input area (303).

At this point, the text input area (303) can be configured with virtual keys or physical keys.

Since the pointing position information input device is configured in the form of a resistive or capacitive touch panel, the pointing position information input device may be located on a physical key of the text input device (304).

In this regard, in the case where the text input device is configured in the form of a physical touch panel, such as a resistive or capacitive type, the touch panel can be used as the text input device and the pointing position information input device, and the touch panel can be used Used to convert its mode by a mode conversion unit.

In this regard, a physical touchpad, such as a resistive or capacitive type, may be configured as a large-surface touchpad-type integrated text input device (300) equipped with a pointing device, which is configured with a plurality of text input devices including a text input unit. A touchpad (304) in the button area.

Alternatively, a physical touchpad such as a resistive or capacitive type may also be configured as a multi-touchpad type integrated text input device (310) equipped with a pointing device, which is configured with a plurality of text input devices including a text input unit. A touchpad (311) in the button area.

Optionally, the pointing position information input can be configured as an upper camera-type integrated text input device (320) equipped with a pointing device, and is performed by an infrared camera or RGB camera (222) located on the upper part of the pointing position information input area. Receive (321).

In this regard, the upper camera type integrated text input device (320) equipped with a pointing device may configure a virtual text input key (303) by using an upper camera.

A lower camera (332) type integrated text input device (330) equipped with a pointing device may be constructed and configured by arranging the camera on the lower part of the second housing so as to receive pointing position information input (331) .

In this regard, a lower camera type integrated text input device (330) equipped with a pointing device may be configured with virtual text input keys (303) that replace physical text input keys by using the lower camera .

Optionally, the camera can be configured as an integrated text input device (340) equipped with a pointing device for sending/receiving (or sending and receiving), and it receives pointing position information input through a virtual pointing position information input area (341), wherein, The infrared light rays or ultrasonic waves transmitted by the infrared light ray emitter or the ultrasonic wave emitter are paired with the infrared light receiver or the ultrasonic receiver which receives information blocked or interfered by a part of the user's body.

In this regard, the virtual pointing position information input areas formed in pairs can also be used as virtual text key input means instead of physical text keys by using the mode switching unit.

FIG. 4 shows an exemplary embodiment of a mode conversion unit integrating a pointer execution command unit.

In the key-type indicator execution command unit, the key-type indicator execution command unit includes: an elastic body (403) configured to change its position due to user's pressure and return when the pressure is released (or removed) to its initial position; a key (402), which is configured to receive user's pressure; and switches (404, 405), which are configured to produce indicators when in contact with each other by changing their positions respectively due to user's pressure to execute the command , the mode switching unit (400) integrated with the pointer execution command unit may be configured, wherein the mode switching unit (401) configured to switch the text mode and the indication position information input mode by detecting the user's touch input is located on the upper part of the key .

In the key-type indicator execution command unit, the key-type indicator execution command unit includes: an elastic body (403) configured to change its position due to user's pressure and return when the pressure is released (or removed) to its initial position; a key (402), which is configured to receive a first pressure from the user; and a first switch (404, 405), which is configured to contact each other by changing their positions respectively due to the user's pressure To generate an indicator execution command, a mode conversion unit (410) integrated with a pressure differentiation indicator execution command unit may be configured, wherein the mode conversion unit integrated with a pressure differentiation indicator execution command unit is equipped with a second switch unit (411, 412), The second switch unit is configured to generate a mode switching execution command when contacting each other due to a user's second pressure that is smaller than the user's first pressure.

In the mode conversion unit (410) integrated with the pressure distinction indicator execution command unit, by changing the position of the key (402), the key (402) can be fixed so that it will not return to its original position due to the elastic body (403) initial position.

In this regard, when the key is fixed by setting its fixed position to a position where the second switch (411, 412) contacts but not the first switch (404, 405), the configuration can be set to operate in the long-term mode transition mode the device.

In the mode switching unit (400) integrated with the pointer execution command unit using touch input, it can be configured so that the long-term mode switching switch (414) can be operated by changing the position by sliding the key unit etc., and when additional pressure is applied, the indicator actuation command switches (404, 405) may be configured to operate while the permanent mode switch (414) is active.

The mode conversion unit (410) integrated with the pointer execution command unit is equipped with a touch panel (421) so that: when the contact surface of the user's body part touching the touch panel is within the first predetermined range, as the mode The switching unit is operated; and the command mode is operated as an indicator when the contact surface is within a second predetermined range.

FIG. 5 shows an exemplary embodiment of the structure of a pointer position information input device.

The indicator position information input device of the human-computer interaction device according to the present invention may include a sensor module (501) including a light emitter and a camera.

The light emitter of the sensor module (501) performs the function of configuring the light plane, so that the light path can be blocked or reflected by an obstacle such as a user's finger placed on the indicating position information input area (108) (108) is arranged on the light plane composed of the light emitted by the light emitter.

The camera of the sensor module includes an optical sensor configured to detect light blocked or reflected by an obstacle.

The optical sensor may use a line camera capable of recognizing line images.

For a line camera, an image sensor with 400 to 1000 elements in line form is sufficient and, preferably, a line camera with 500 to 700 elements would be ideal.

The light emitters are configured as light emitting devices for configuring the light plane, wherein the light emitters are placed above the text input keys (303) so as to be separated by about 1 mm.

An indication location information input area (108) is configured as part of the light plane.

For example, infrared light ray emitters, infrared laser emitters, laser emitters, infrared light ray emitters, visible light emitters, etc. may be used as the light emitting device.

It would be desirable to use an infrared laser emitter as the light emitting device, which does not require a reflective plate to be installed on the edge portion.

For infrared laser emitters it is sufficient to operate a laser with a laser wave of 800 to 850 nm at 0.3 to 1 mW.

The light emitter passes the light of the infrared emitter through the line lens so that the light can form a plane while being dispersed.

A line lens may be further included in the light emitting unit of the light emitter so that light emitted from the light emitting device may constitute a light plane.

The line lens is positioned such that the light emitted by the light emitting device constitutes a light plane substantially parallel to the text input unit.

The indicator position information input device can also be configured with a filter (504), so that only light in a specific wavelength range of the light from the light emitter can pass through.

The optical filter (504) is installed so that the light emitted from the light emitter can pass through, and, additionally, the optical filter (504) can also be installed in front of the camera when the light reflected or blocked by an obstacle is received by the camera , to prevent light not emitted from the light emitter from being received.

Although the light emitter and filter for the camera are separately configured, it is preferable to mount the light emitter and camera adjacently so that both light being emitted by one filter as well as light received can be filtered.

The optical filter can be designed to be perpendicular to the direction of travel of the light from the light emitter.

Based on one aspect of design, the optical filter may be mounted at an angle of 30 to 60 degrees or 120 degrees or 150 degrees relative to the direction of travel of the light emitter.

The sensor module (501) may be installed to allow the light of the light emitter to be directly emitted as a light plane. (510)

The sensor module (501) may further include a reflective plate (503), so that the light of the light emitter can be refracted once and emitted as a light plane. (520)

At this point, the light reflected or blocked by the obstacle can also be received by the camera after being refracted once by the reflective plate (503).

The sensor module (501) may include two reflective plates (503a, 503b) such that the light of the light emitter can be emitted as a light plane after being refracted twice. (530)

At this point, the light reflected or blocked by the obstacle can also be received by the camera after being refracted twice by the two reflecting plates (503a, 503b).

Accordingly, the sensor module can be installed in the first housing (301).

In this regard, the discrete filter (504) can be replaced by coating the filter on the reflective plate (503).

When the pointing position information input area (108) is activated by the sensor module (501) by using the user's finger, the user moves his (or her) finger to input Indicates location information.

At this point, in order to prevent the movement of the user's fingers from being disturbed due to the distance between each text input key (303), the distance between each text input key (303) is set to a range of 0.1 mm to 1 mm is ideal.

In addition, a plurality of text input keys (303) are located at the lower part of the indicated position information input area (108), so that the upper surfaces of the plurality of text input keys can be located on a plane.

A light source passes through the light channel (502), which corresponds to the light source emitted from the sensor module (501), which is reflected by a reflective plate or obstacle and received back to the camera.

In this regard, when the upper surface of the light channel is replaced by a part of the first housing (301), the thickness of the light channel can be reduced.

The lower surface and side surfaces of the light channel can be designed as a structure separate from the first housing.

Fig. 6 shows a structural diagram of an infrared ray laser sensor module.

The principle of the infrared sensor module is basically by using a light source (601) to emit light covering an area indicating position information, analyzing the light reflected or blocked by an obstacle, and calculating the distance of the obstacle by using one camera or two cameras (603). Location.

In this regard, in order to diffuse the light emitted by the light source (601) so that the light can be emitted to a desired area, a line lens (602) may be used.

It is preferable to use a line camera as a camera for recognizing the state of a light source reflected or blocked by an obstacle.

The camera can be equipped with a light guide channel in front of the camera, wherein the light guide channel can help the light being received to receive light in the desired area.

According to the invention, the light source may correspond to infrared light rays, ultraviolet light rays, laser light or the like.

The light source and camera can be replaced by ultrasound and ultrasound receiver, respectively.

According to the present invention, in order to avoid installing reflective plates at the edge of the keyboard, it is preferable to use infrared light ray laser as light source.

In the case of using infrared light, a reflective plate may be installed on the edge of the keyboard, or an output of a light source may be doubled or more compared to an optical touch module of a general screen, or an auxiliary light source may be additionally installed.

The sensor module may have a supplementary control board configured to control the light source and the camera, and to send received signals from the camera to the main control board.

The pointer position information input unit may be positioned to include a portion of an extended surface of the text input unit plane.

The text input unit includes: a plurality of keys receiving at least one text, said keys generating a text selection signal by shifting from a first position to a second position due to pressure exerted by a user, and said keys may be configured in the form of physical keys, It returns to its original position thanks to its elastic body.

The text input unit includes F4 and F5 keys, and two cameras are included as cameras of the indicator position information input unit, and the text input unit can be designed so that among the keys of the text input unit, the F4 key or the F5 key can be configured as The button located closest to the left of the two cameras.

Therefore, in the case where the position of the index finger of the right hand is placed at the F position in the text input key, when the pointer position information is input by using the right hand, the effect of the index finger of the left hand blocking the camera may be reduced.

In the text input unit, when a key having the largest surface area such as a space bar is configured as a pointer execution command unit, for example, when position information of a mouse is input by using the right hand, the pointer execution command unit can be easily executed by using the left hand .

At this point, since the left hand may already be executing the mode switching unit, it is preferable to set the minimum distance between the mode switching unit and the indicator execution command unit to be 8 to 15 cm.

The mode switching unit may be provided separately from the keys of the text input unit, and the mode switching unit may input the mode to and from the text input mode and the pointer position information by recognizing that a part of the user's body has touched a part of the human interaction body. switch, and, here, the device may operate in a pointer position information input mode when touched, and in a text input mode when not touched (or not touched).

The pointer execution command unit is configured with two keys, and, when the first key is pressed, a first function such as a left click of a mouse is performed, and when the second key is pressed, a second function such as a right click of a mouse is performed , and, here, among the text input keys, the first key corresponds to the key with the largest surface area such as the space bar, and when the second key is set as the first key located on the left or right side of the first key When the indicator executes the command unit, it can be conveniently controlled by the thumb of the right hand, thus providing a simple and convenient user experience.

When the mode has been switched to the text input mode or the pointer position information input mode by the mode conversion unit, an indication indicating the text input mode or the pointer position information input mode may be displayed.

The display of the pointer position information input mode may be temporarily indicated at the time when the touch occurs on the mode conversion unit, or may indicate the pointer position information input area from the time when the touch occurs on the mode conversion unit to the time when the touch is released, and , here, the indication can be displayed as sound or text or light signal.

By doing so, there is an advantage in that the user can recognize the current mode state of the keyboard, and, in the case of the pointer position information input mode, the user can easily know at which position the pointer position information will be input.

As shown in Figure 1, the text input area of the text input unit can be designed to be the same as the pointer position information input area of the pointer position information input unit, or the text input area of the text input unit can be designed to include the pointer position information The pointer position information input area of the input unit.

As an exemplary embodiment for configuring the pointer position information input unit, the pointer position information input unit may include one or two light emitters and camera(s).

The optical signal being received by the camera can be designed to pass through the optical channel so as to block external noisy light sources.

The light channel may be constructed before the light signal is emitted from the light emitter to the pointer position information input area, and the light channel may be installed on the front surface of the camera, which receives a user's input signal from the pointer position information input area.

In this regard, a reflective plate may be positioned that is configured to refract the light signal being emitted from the light emitter or being received by the camera.

By assigning a certain degree of freedom in the installation position and direction of the indicator position information input unit by the reflective plate, efficient use of space in architecture and advantages in design can be obtained.

Due to the light emitter and the camera, the pointer position information input unit may be configured to have a pointer position information input area at a position at least 0.1 to 5 mm above the text input unit.

Accordingly, pointer position information may be received only when a user's distinctive (or accurate) touch is intended.

If an infrared light ray laser having a wave ranging from 800 to 850 nm and operating at 0.3 to 1 mW is used in a light emitter, it is possible to obtain excellent power consumption and cost, stability, safety, and appearance.

The light transmitter may further include a line lens that scatters the light signal to enable the light signal to be configured parallel to the pointer position information area of the text input unit.

The pointer position information input unit may be designed to block optical external noise by using a filter that allows only a light signal in an infrared light ray region to pass.

When designed to have a distance between physical keys ranging from 0.1 to 1 mm, the text input unit can sufficiently provide soft and flat tactile perception to a user while inputting pointer position information.

FIG. 7 illustrates an exemplary embodiment of an input area for position information of a pointer.

The human-computer interaction device according to the present invention may be designed to further include pointer position information input display units (701, 702), which visually display (or indicate) the pointer position information input area in the pointer position information input mode .

The mode switching unit according to the present invention is also set separately from the keys of the text input unit, and the mode switching unit can be designed to switch to and from the text input mode by recognizing that a part of the user's body has touched a part of the human interaction body. and pointer position information input mode, and, herein, the device may be designed to operate in pointer position information input mode when touched and in text input mode when not touched (or not touched) down operation.

In this regard, in case the part of the user's body for performing mode switching corresponds to the right hand (refer to 106b), the mode switching unit may be designed to cause the left hand to perform pointer position information input (refer to 108a).

In this case, preferably, the pointer position information input area can be designed to be located at a corner closer to the corner where the mode conversion unit is located, and when the left hand and right hand are used in opposite ways, the design can be done according to the same principle. out (see 106a, 108b).

On the contrary, the mode switching unit may also be designed such that the right hand corresponds to the part of the user's body used to perform mode switching, and the right hand also corresponds to the hand performing pointer position information input.

In this case, it is preferable to design the indicator position information input area to be located closer to the corner where the mode switching unit is located rather than toward the corresponding corner, and in the case of the left hand, the design can also be made according to the same principle out.

The mode conversion unit may determine the text input mode and the pointer position information input mode according to the number of the user's fingers recognized by the pointer position information input unit.

The number of user fingers recognized when the input mode is determined as the pointer position information input mode is smaller than the number of user fingers recognized when the input mode is determined as the text input mode.

For example, while controlling the mode switching unit by using the left hand, the fingers of the left hand may be in a state of not touching the text input key, and the index finger of the right hand may be in a state of touching so as to perform pointer position information input, and, in this case , the number of identified user fingers is equal to one.

On the contrary, when the fingers of the left and right hands are touching the keyboard in order to perform text input, the number of recognized user's fingers may be recognized as 2 to 8 or less.

The pointer position information input mode display unit may be temporarily displayed (or indicated) when the input mode is switched to the pointer position information input mode by the mode switching unit, or when the input mode has been switched to the pointer position information input mode From the time point of to the time point when the corresponding mode is released (or canceled), the pointer position information input area may be visually displayed (or indicated).

The pointer position information input mode display unit may be designed to be displayed from the text input keys due to the visible light ray generator, or reflected light caused by the text input keys, or by the distance between the text input keys.

The indicator position information input mode display unit is configured with a surface deposited with a dye (or colorant) that emits visible light rays and invisible light rays by optically responding to the invisible light ray generator (701a, 701b), and the dye can be deposited On the text entry keys or on the spaces (or spaces) between the text entry keys.

The mode conversion unit may further include a hand side determination unit configured to determine whether the user performs the pointer position information input with his left hand or his right hand.

The display area of the pointer position information input display unit can be flexibly displayed according to the hand side determination unit.

The key arrangement and operation of the pointer execution command unit can be flexibly switched according to the hand side determination unit.

For example, in a case where the pointer execution command unit includes right and left clicks of the mouse, keys to respectively perform the right and left clicks of the mouse may be switched according to the determination of the hand side determination unit.

The pointer position information input mode display unit may indicate (or display) different pointer position information input regions according to the determination result of the hand side determination unit (702a, 702b).

When operating in the pointer position information input mode, when the user does not input the pointer position information input for a predetermined period of time, or when an input is received through the text input key, the mode switching unit may be designed to automatically switch to the text input mode.

The indicator position information input mode display unit may be designed to be visually indicated (or displayed) regardless of the mode switching unit by depositing a dye (or colorant) on the text input key or a portion of the text input key mode to recognize pointer input areas even during text input mode.

FIG. 8 shows a first exemplary embodiment of a pointer position information input device detachable from a text input device.

The pointer position information input device (810) designed to be detached from the text input device (800) can be attached (801) or detached (802) from the text input device.

At this point, power from the power supply of the text input device (800) may be supplied to the power connection unit (820) included in the pointer position information input device.

The pointer position information input device (810) includes at least one pointer position information input device (105a, 105b), and may further include a control unit and a filter (504).

A detachable pointer position information input device (810) may be attached so that the pointer position information input area (801) is configured on a surface parallel to the text input area, and, by being positioned on the left side of the text input device (803 ) or the right side (804), indicating that the location information input area can be configured on the bottom surface where the text input device is placed.

In this regard, the pointing position information input device and the power connection unit ( 820 ) are designed to be flexibly modified according to position shift (or change) of the pointing position information input device.

FIG. 9 shows a second exemplary embodiment of a pointer position information input device detachable from a text input device.

The indicator position information input device (900) includes: an internal power unit.

When the indicator position information input device (900) operates in the first position information input mode (902), the housing of the indicator position information input device (900) can be designed to have a stable height and angle so that the indicator The position information input area can be parallel to the text input area of the text input device.

When the indicator position information input device (900) operates in the second position information input mode (904), the housing of the indicator position information input device (900) can be designed to have a stable height and angle, so that the indicator The position information input area can be parallel to the bottom surface where the indicator position information input device (900) is located.

Preferably, at this point, the height of the optical filter (504) in the first position information input mode is higher than the height of the optical filter (504) in the second position information input mode.

When the indicator position information input device (900) operates in the third position information input mode (906), the casing of the indicator position information input device (900) can be designed to have a stable height and angle, so that it can form The indicator position information input area is perpendicular to the bottom surface where the indicator position information input device (900) is placed.

In order to be able to recognize two modes among the first position information input mode, the second position information input mode and the third position information input mode according to the state in which it is placed on the bottom surface, the indicator position information input device (900) can Includes positional information input mode sensor unit.

The positional information input mode sensor unit may be configured with a sensor or a switch using gravity.

FIG. 10 shows a third exemplary embodiment of a pointer position information input device detachable from a text input device.

The location information input device (1000) may have a housing (1001) surrounding at least two surfaces in the text input device so that the text input device (800) may be installed.

The position information input device (1000) is configured with an indicator position information input device (105a, 105b), a mode conversion unit (106), a control unit (1001), a housing (1001), and an optical filter (504) (1010).

The text input device (800) is installed to the indicator position information input device (1000), and then, the optical filter is located at a part higher than the text input device (800), so that the upper part ( The light source of the indicator position information input area of 800) can pass through the filter (504).

According to different types of indicator position information input devices, the surface material of at least one surface (1002) of the casing (1001) surrounding the text input device can be treated as reflective mirror, transparent glass or plastic, or black group of light absorbing body, so that the light source emitted from the indicator position information input device (105) can be reflected, transmitted (or passed through) or absorbed.

8 , 9 and 10 correspond to an exemplary embodiment of a pointing position information input device detachable from a text input device and having the following components.

The pointer position information input device includes a pointer position information input unit that receives information on the position of the pointer from a user.

The pointer position information input device receives user's pointing position information input through the pointing position information input area configured by the pointer position information input device.

The pointer position information input device includes a pointer execution command receiving unit that receives a signal of a pointer execution command unit that receives a user's command so that at least one function can be executed at a position where the pointer is located.

The pointer execution command unit may be configured with keys or touch switches included in the pointer position information input unit, or the pointer execution command unit may be configured with a control unit, when the user input received from the text input device When a predefined input is received in the control unit, the control unit switches to the indicator to execute the command.

The pointer position information input device includes a mode switching command receiving unit that receives a signal of the mode switching unit to switch to the pointer position information input mode.

The mode switching unit may be configured in the pointing position information input device, or may be configured in the text input device or may be configured as a separate device.

The pointer position information input device includes a power unit that supplies power to the pointer position information input unit, the pointer execution command reception unit, and the mode switching command reception unit.

The power unit may correspond to a power unit with an embedded battery or may correspond to a contactor supplied with power from an external source.

The pointer position information input device includes a pointer position information transmission unit configured to transmit information related to the pointer position input to the pointer position information input unit to a digital device connected to the human-computer interaction device via a wired or wireless connection. device.

The pointer position information input area of the pointer position information input unit is set to have a predetermined height and angle so that the pointer position information input area can be positioned parallel to at least a part of the text input area of the text input device, said The text input device is configured with multiple physical keys.

In the case that the mode conversion unit is separately provided with the text input keys of the text input device, the mode conversion unit may be fixed to at least one surface of the text input device, and the mode conversion unit may indicate that the mode corresponds to Information on the input mode of the pointer position information is sent to the mode switching command receiving unit via a wired or wireless connection.

The indicator position information input unit may include an optical emitter and a camera, and the optical signal received by the camera may be designed to pass through an optical filter after passing through an optical channel.

The indicator position information input device includes a position state identification unit configured to: identify position state information relative to the gravity information of the human-computer interaction device, or position state information relative to the bottom of the human-computer interaction device, Or the position status information of the human-computer interaction device input by the user.

The position state can be configured in at least two types, and, in the case of the first position state, the mode is switched to the first pointer position information input mode, and in the case of the second position state, the mode is switched to the second position state. Two indicator position information input mode.

The pointer position information input area corresponding to the first position state indicates that the pointer position information input area is positioned parallel to at least a part of the text input area of the text input device.

The indicator position information input area corresponding to the second position state indicates that the indicator position information input area is positioned parallel to the bottom surface on which the indicator position information input device is placed.

By arranging the upper surface of the indicating position information input device operated in the first indicator position information input mode on the bottom surface, when switching to the second indicator position information input mode, the coordinates of the indicating position information input are identically and the abscissa indicating the position information input is calculated by alternating (or switching) increasing and decreasing directions.

Among the text input keys of the text input device, a space bar may be used as a pointer execution command unit, and another key adjacent to the space bar may be additionally used as a pointer execution command unit.

The power unit may be supplied with power from the text input device.

The predefined height and angle of the location information input area corresponding to the first location state can be defined by an adjuster, which allows the user to adjust within a predefined range.

The adjuster can adjust its angle by adjusting the connection angle with a surface adjacent to at least one surface of the housing of the input device indicating position information.

The adjuster can adjust its height by adjusting the height of at least one surface of the casing indicating the position information input device.

The adjuster can adjust its predefined angle and height by adjusting the angle and height of the optical module of the indicating position information input unit of the indicating position information input device.

Fig. 11 shows a front view of the human-computer interaction device applied with the low-position indicator position information input device.

The human-computer interaction device includes: a text input unit, which includes a plurality of physical keys; an indicator position information input unit, which is configured to receive information related to the position of the indicator from the user; an indicator execution command receiving unit, which is configured to Receiving a signal of an indicator execution command unit that receives a user's command to perform at least one function at the indicator position; a mode conversion command receiving unit configured to receive a mode converted to an indicator position information input mode a signal of the converting unit; a power unit configured to deliver electric power to the indicator position information input unit, the indicator execution command receiving unit, and a mode switching command receiving unit; an indicator position information transmitting unit configured to transmit the power input to The information on the position of the pointer from the pointer position information input unit is transmitted to the digital device connected to the human-computer interaction device through a wired or wireless connection. The pointer position information input area of the pointer position information input unit is positioned parallel to (321) at least a portion of the text input area of the text input unit including a plurality of physical keys, wherein the pointer position information input unit is configured with at least Two sensor modules, wherein the at least two sensor modules are respectively located on the lower left side (1102) and the right side (1103) of the human-computer interaction device.

The indicator position information input unit includes a light emitter and a camera, and light signals received by the camera pass through the light channel.

The mode switching unit is set separately from the text input keys of the text input device.

The mode conversion unit is located on the left side of the text input area of the text input device, and, by recognizing the reception of the user input of the mode conversion unit, the mode conversion unit sends information indicating that the mode corresponds to the pointer position information input mode to the mode Conversion command receiving unit.

The physical key is configured with an upper portion of the key that receives pressure from the user's finger, and an elastomer that applies a physical force so that the upper portion of the key can return to its original position when pressure from the user's finger is removed.

The human-computer interaction device is provided with reflectors or absorbers (1101) on the left, right and upper parts of the text input area, respectively reflecting or absorbing the light source generated by the indicator position information input unit, while the lower part of the text input area At least one section is not provided with reflectors or absorbers.

The reflector is used when the light source generated by the pointer position information input unit corresponds to infrared light rays, and the absorber is used when the light source corresponds to infrared light ray laser.

At least two sensor modules (1102, 1103) of the pointer position information input unit are positioned such that at least a portion of each sensor module is included in a lower portion of an outer left area and an outer right area of the text input area. More specifically, the left side sensor is positioned at a position below the control keys of a standard Windows keyboard, including at least a portion of the left side of the control keys, that is, further down toward the corner of the housing without the control keys . Therefore, in order to maximize the attractiveness of the appearance of the multi-machine interaction device, the sensor module enables the multi-machine interaction device to be configured with a minimum volume.

Furthermore, by positioning the sensor adjacent to the apex of the text input area (1110), the sensor faces the diagonal direction of the text input device, compared to the horizontal direction and the vertical direction of the text input area when the sensor is positioned in the corner area. direction, the pointer position information input area may be configured to have a larger surface area. Furthermore, the entire pointer position information input area in the upper part of the text input area can be maximized by changing the position of a portion having relatively low position information detection accuracy of pointer position information between one sensor and the other sensor.

Additionally, the location of the sensor may be at the lower end of the space bar of a standard keyboard so as to have a width smaller than the width of the keyboard (1120). The width between one sensor and the other determines the width of the pointer position information input area, and therefore, although the surface area of the pointer position information input area is reduced compared to when the sensor is positioned at a corner (1110), it can be A relatively high detection resolution of pointer position information is obtained.

The distance between one sensor and the other eliminates reflectors or absorbers of the light source and, by lowering the height of the housing, prevents the thumb from being rested by the housing when pressed on the space bar of a standard keyboard. ).

The pointer execution command unit (1104 and 1105) is provided separately from the text input area of the text input device and the mode switching unit.

FIG. 12 shows an exemplary embodiment of a mode conversion unit integrating a pointer execution command unit.

When an input operation resulting in frequent transitions to and from the text input mode and pointer position information input mode is performed, the number of sessions of input mode transitions and pointer execution commands increases.

For example, in the case of a right-handed user, when the user wishes to input pointer position information while performing text input in the text input mode, the user needs to perform mode switching by using his (or her) left or right hand, and then, when inputting After the pointer position information, the user needs to make an input to the pointer real-name command unit by using his (or her) left hand.

Generally, when performing a swift operation, the user tends to lock his (or her) eye (or eye view) on the monitor while inputting text and pointer position information and pointer execution information, in the Therefore, in the case where the mode switching unit and the pointer execution command input unit are provided separately, this may cause hand movements to occur too frequently, and the user may not be able to correctly execute the desired position because the exact position of the unit cannot be correctly located. functions you want or experience inconvenience during work where you have to look directly at the keyboard.

To solve this problem, for example, in the case of a right-handed user, after performing text input in the text input mode, when the user puts his (or her) left hand on the mode switching unit, a mode switching command is generated, whereby the The mode switches to pointer input mode. Then, after inputting the pointer position information by using the right hand while the hand is placed on the mode switching unit, the pointer execution command unit receives a user's input when pressure is applied on the mode switching unit.

Therefore, the user can share the position of the mode switching unit for performing mode switching and the position of the pointer execution command unit for executing the pointer execution command.

As an exemplary embodiment for realizing the mode switching unit, the mode switching unit is equipped with a touch switch that can receive a touch input of the user's hand, and the pointer execution command unit is configured with a switch that responds to pressure, such as text switch and located below the mode switching unit.

In this regard, the first pointer execution command unit (1104) and the second pointer execution command unit (1105) are configured to be connected to each other through a conductive material capable of recognizing a touch from the user's hand, or the first pointer The execution command unit (1104) and the second pointer execution command unit (1105) are configured to be commonly connected to each other through the mode switching unit (1201), so that whether the user touches the first pointer execution command unit or whether the user touches the second pointer execution command unit The two indicator execution command units can both realize the mode conversion in the same way.

In this regard, the mode switching activates the pointer position information input mode while the touch is applied, and operates in the text input mode when the touch is released.

In addition to touch, mode switching performed by touch may be configured with another switch operated with a lower pressure than that applied for a pointer to execute a command, or may be configured with a sensor capable of sensing the position of a user's finger.

In this regard, the mode switching and pointer execution command unit is located in an area distinguished from the text input area. Preferably, in case of a right-handed user, the mode switching and pointer execution command unit is located in the outer left area of the text input area. In the case where the mode switching and pointer execution command unit is located outside the text input area, the possibility that the pointer position information input unit confuses each input with the pointer position information input can be eliminated, and the pointer position information input area can be is expanded.

The multi-person computer interaction device according to the present invention may be provided with a second mode conversion unit (1202). As a switch operating as a toggle switch, the second mode switching unit switches to and from the text input mode and the pointer position information input mode each time an input is received from the user. Therefore, even if the user does not touch the mode switching unit with his (or her) left hand, the user can perform pointer position information input by using only his (or her) right hand.

At this point, in the case that the multi-machine interaction device is in the text mode due to the second mode switching unit, and in the case of receiving a mode switching command generated by touch, then the multi-machine interaction device according to the present invention The interaction device operates in an indicator position information input mode. In addition, when the multi-machine interaction device is in the pointer position information input mode due to the second mode switching unit, and in the case of receiving a mode switching command generated by touch, when the pointer position information input mode is maintained When the mode switching command generated by the touch is canceled at the same time, or when a text input is received through the text input unit, the mode is switched to the text input mode.

In this regard, when the mode switch is performed by text input, at least the first text input will be ignored, and when at least two or more text inputs are received, the mode switches to the text input mode.

In this regard, when at least two or more text inputs are received and the mode is switched to a text input mode, the multi-person machine interaction device sends a text input including at least one first text that is ignored to the digital device, Then, the multi-machine interaction device sends the newly input text input information to the digital device.

Figure 13 shows an exemplary embodiment of a lid using a multi-person machine interaction device.

In order for the pointer position information input device to form a pointer position information input area, the multi-person machine interaction device requires a space of at least 1 mm to 2 mm above the flat surface (or plane) of the text input device, which is configured The edge that is the physical device and used to place the absorber for absorbing the light signal or the reflector for reflecting the light signal may need to surround the text entry area and may need to be formed on at least 3 corners.

At this point, there may be a difference of at least 1 to 2 millimeters between the height of the edges of at least 3 corners and the height of the flat surface (or plane) of the text entry area, roughly forming a cubic (or nearly cubic) space .

The multi-person computer interaction device according to the present invention can be further equipped with a multifunctional cover (1322) on the considerable cube-shaped space (1310), which is configured to protect (or shield) the text input area from external impact.

The multifunctional cover (1322) can be detached from the multi-machine interaction device (1320), and can be attached or detached due to magnets or physical structures.

The multifunctional cover (1322) may be configured to have a structure that can be folded multiple times. Preferably, as a structure that can be folded twice, the width of at least one of the divided parts may be smaller than that of the other parts. (1341)

When the multifunctional cover is folded and installed on the lower part, this enables the inclination of the multi-machine interaction device to be further reduced, so that the inclination of the multi-machine interaction device can be adjusted.

After being folded, when the multifunctional cover is installed on the bottom surface of the multi-machine interaction device, among the folded surfaces, the part that contacts (or touches) the ground can be provided with an inclined surface (1342), so that the part that touches the ground The surface can be enlarged.

The desired inclination of the multi-functional machine interaction device can be adjusted according to the number of times the multifunctional cover (1322) is folded.

The multifunctional cover (1322) may be equipped with a rechargeable battery (1323) integrated inside the cover.

The electrodes of the power supply of the rechargeable battery (1323) may be located on the part (1331) of the area protruding from the part covering the text input area, and the part (1331) of this area covers the lower part of the multifunctional cover covering the text input area edge of the section. And, in a case where the multifunctional cover covers the text input device (1310), the electrodes may be connected to the electrodes provided on the upper part of the multi-machine interaction device.

In addition, in the case where the multifunctional cover is folded, and under the condition that the multifunctional cover is installed in the lower part to adjust the inclination of the multi-machine interactive device, the electrodes of the battery can be connected to the bottom surface of the multi-machine interactive device. the electrodes.

The multi-machine interaction device can supply power to the rechargeable battery (1323) embedded in the multifunctional cover by connecting to an external power source, or can charge the multifunctional cover separately.

In this regard, the bottom surface of the multi-machine interaction device is equipped with a coverage area (1332) covering the text input area, which has a different height than the protruding edge area (1331) where the electrodes are located and where the magnets or physical connection means or cover are inserted. Grooves for detachment or attachment at the exact location.

The edges of the multifunctional cover are deposited with material that removes (or eliminates) fine dust particles or grease, moisture, etc., and, each time the cover is attached to or detached from the multi-machine interactive device, Foreign matter on the absorbing plate, or reflective plate, or the front surfaces of the light emitter and camera can be removed (or eliminated).

In the case of detecting that the multifunctional cover covers the text input area, the power of the multi-person machine interaction device may be turned off.

In the case that the multifunctional cover is installed on the bottom surface of the multi-machine interaction device, the power supply of the multi-person machine interaction device can be turned on.

Additionally, after power is turned on, if there is no user input for a predetermined period of time, the power may be blocked or the device may be transitioned to a standby mode.

In the case where the multifunctional cover covers the text input area (1310), the multi-machine interaction device is basically configured to have a cube shape composed of thin plates, and can be designed to not tilt when it is placed on the ground , thereby maximizing the attractiveness of its appearance.

At the same time, when the multifunctional cover is folded and installed on the bottom surface of the multi-machine interaction device, it can only provide tilt like a common keyboard.

Although the multifunctional cover is detachable, the multifunctional cover may be designed to be folded due to the hinge by making a downward circular motion from the upper surface to the lower surface of the multi-machine interaction device.

Fig. 14 shows an exemplary embodiment of a human-computer interaction device applied to a notebook computer.

The multi-machine interaction device (1420) can be used as an input device for a mobile notebook computer.

A mobile notebook computer including a multi-machine interaction device according to the present invention can be designed to have a structure in which a display unit is equipped with a display panel (1411) and a frame (1410) supporting the display panel, and the display unit is It is connected with the multi-machine interaction device through a hinge (1427) so as to be covered and opened.

At this point, the display unit is configured to be inserted into a wall, which is equipped with a reflective or absorbing plate (1424) of the human-computer interaction device according to the invention. Therefore, the thickness of the mobile notebook computer using the human-computer interaction device can be minimized.

In order to do this, the display unit of the mobile notebook computer should be designed to be smaller than the width of the human-computer interaction device (1420) according to the present invention by at least twice the width of the reflecting or absorbing plates (1423, 1424).

In other words, in FIG. 13, the device should be designed such that the display unit can be inserted where the multifunctional cover will be placed.

The display unit has a structure in which two corners are rounded or obliquely (or diagonally) cut (1413).

When the display unit is folded, the pointer position information input means (1421, 1422) is positioned outside the rounded or chamfered corners.

When the mobile electronic device is folded, this allows the mobile notebook computer to be folded while maintaining a thin thickness without interference from the pointer position information input means (1421, 1422).

In this regard, the mode conversion unit and the pointer execution command unit may be located outside the side of the human-computer interaction device.

In addition, more specifically, the mode conversion unit and the pointer execution command unit may be located at an outer lower portion of the text input area. (1425, 1426)

In this regard, as shown in FIG. 12, although it is preferable that the mode conversion unit and the pointer execution command unit are configured as a single body, the mode conversion unit and the pointer execution command unit may be divided and provided separately.

In this regard, in the case where the mode switching unit or the pointer execution command unit is located at the outer lower part of the text input area, in the case where the user places his (or her) hand to control the mode switching unit or the pointer execution command unit , in order to prevent the pointer position information input device (1421, 1422) from malfunctioning when the user has input the position information of the pointer, the pointer position information input area should be constructed to exclude the area where the mode conversion unit or the pointer execution command unit is located .

In order to do this, by adjusting the area covered by the light signal generated by the pointer position information input device, the light signal can be designed not to reach the mode conversion unit or the pointer execution command unit.

Alternatively, in order to prevent the camera from receiving a light signal generated by reflection or interference or blocking between the light signal and the user's finger placed on the mode conversion unit or the pointer execution command unit, the light signal of the camera may be adjusted The angle of reception, or the camera can be configured to ignore light signals received from the corresponding direction.

The mobile notebook computer is designed to include, on at least three corners, an absorbing plate for absorbing a light source or a reflective plate for reflecting a light source generated by the indicator position information input device.

In this regard, when two surfaces are located on the sides of the human-computer interaction device (1423, 1424), and when one surface causes the display unit to open within a predetermined angle relative to the surface on which the display unit contacts the human-computer interaction device , in order that the light source generated from the indicator position information input device (1421, 1422) can be sufficiently reflected or absorbed, a reflector or absorber is placed in a predetermined area (1412).

FIG. 15 shows an exemplary embodiment of applying a low position indicator position information input device and a low position indicator execution command unit.

The human-computer interaction device includes: a text input unit (1501) including a plurality of physical keys; an indicator position information input unit configured to receive information about the position of the indicator from a user; an indicator execution command receiving unit configured to Configured to receive the signal of the pointer execution command unit (1505, 1506), the pointer execution command unit (1505, 1506) receives the user's command to perform at least one function at the pointer position; the mode conversion command receiving unit is configured to receive a signal of the mode switching unit that switches to an indicator position information input mode; an indicator position information transmitting unit configured to transmit information on the position of the indicator input to the indicator position information input unit to the indicator position information input unit via wired or wireless A digital device connected to a human-computer interaction device. The pointer position information input area of the pointer position information input unit is positioned parallel to at least a portion of the text input area of the text input unit including a plurality of physical keys, and wherein the pointer position information input unit includes an optical signal reflector or Absorbers (1503a, 1503b, 1503c) formed on the first to third surfaces (1502a, 1502a, 1502c) surrounding the text input unit and higher than the height of the text input unit, and wherein The fourth surface (1502d) is formed to be lower in height than the first to third surfaces, and wherein the fourth surface may include an indicator execution command unit (1505, 1506). Each of the first surface and the third surface may be located on the left and right sides of the text input unit, the second surface may be located on the upper side of the text input unit, and the fourth surface may be located on the lower side of the text input unit. .

The pointer position information input unit includes at least two sensor modules, and the two sensor modules may be respectively located at a lower left corner area and a lower right corner area of the text input unit.

The mode switching unit is operated by a user's first input input through the first key, and the pointer execution command receiving unit may be operated by a user's second input input through the first key.

The first key may be made of a material capable of detecting an electrical signal generated by a finger touch, and may generate the first input by recognizing the electrical signal.

The device operates in the pointer position information input mode while the first input is maintained, and the pointer position information input mode may be canceled when the first input is released (or canceled). The first input may be generated by physical pressure.

The mode switching unit can be operated by the user's second input input to the second key, and when the second input is input once, in the case where the indicator position information input mode is in a canceled state, then the corresponding mode can be is activated, and in the event that the indicator position information input mode is activated, the corresponding mode can be deactivated.

In this case, preferably, the light source and image receiving means generated by the pointer position information input means (1421, 1422) are located towards the center of the keyboard.

However, in order for the keyboard to ensure a small pointer position information input area or a pointer position information input area with a wider area, the reflective plate or the absorbing plate (1423, 1424) located on one side of the human-computer interaction device uses reflective Instead of the absorbing plate, the light source and image receiving means generated by the pointer position information input means (1421, 1422) may be located towards the reflecting plate (1423, 1424).

That is, the pointer position information input device (1421) may receive the pointer position information reflected and received by the reflection plate (1423).

In addition, the pointer position information input device (1422) may receive the pointer position information reflected and received by the reflection plate (1424).

Therefore, such an effect can be achieved that the installation position of the pointer position information input device (1423, 1424) is located at the left outer and right outer parts of the real multi-machine interaction device, so as to obtain a wider mouse pointer position information input area .

In this case, the reflection plate may be installed such that its angle has a predetermined angle of 1 to 15 degrees. That is, the lower ends of the reflective plates (1423, 1424) may become wider than the upper ends of the reflective plates (1423, 1424).

Therefore, the installation position of the pointer position information input device (1423, 1424) can be realized to be located at the left outer and right outer effects of the real multi-machine interaction device, and to move to the top with a predetermined distance without being disturbed. The indicator located at the lower end of the keyboard performs command input device interference.

The multi-machine interaction device includes a reflective unit for reflecting the light source generated by the indicator position information input unit. At least two indicator position input units are installed on the left side and the right side of the human-computer interaction device. The reflective units are installed on the left and right sides of the human-computer interaction device. The left indicator position information input unit is installed toward the left reflective unit and receives the light source input through the left reflective unit. The right indicator position information input unit is installed toward the right reflective unit, and receives a light source input through the right reflective unit.

The left reflective unit and the right reflective unit are not installed in parallel to become wider toward the portion where the left and right pointer position information input units are located.

The pointer position information input area may be divided into a first area and a second area. For example, a pointer position information input signal input from the right hand may be received from the first area, and a pointer position information input signal input from the left hand may be received from the second area.

Generally, after multiple touch input signals are received, the multi-touch control determines a control command according to the next moving orientation of the multiple touch input signals.

However, in the present embodiment, the first pointer position information input signal received from the first pointer position information input area may be used to identify the number of touch inputs.

In addition, the second pointer position information input signal received from the second pointer position information input area may be used to receive the movement signal of the touch input.

That is, for example, when one finger of the right hand inputs a vertical slide touch input while the left hand maintains an input of two finger touches, this can be replaced by a signal such as two touch signals of a common multi-touch function for a vertical touch input. In general, when a vertical slide touch input is performed by two touches in a MacBook of Apple Inc., a vertical scroll input of an Internet browser can be performed. In this case, when one finger of the right hand is tapped, because there are two touch inputs of the left hand, it has the same function as a two-finger tap.

As another example, when the left hand makes a horizontal slide touch input while the left hand holds three touch inputs, this may be replaced by the case of a vertical slide touch input by three touch signals of a general multi-touch function. In general, for example, when a horizontal slide touch input is performed by three touches in Apple's Macbook, a full screen of three fingers or a dragged application swipe function can be performed. In this case, since the left hand performs three touch inputs when one finger of the right hand taps, the same function as the case of tapping by three fingers can be performed. The left-handed and right-handed examples can be replaced with right-handed and left-handed examples. The number of input signals for determining the number of touches is not limited to two and three, and may include one, four, and five touches.

The information on the pointer position received by the pointer position information input unit may include first pointer position related information for moving the pointer position, and for switching the human-computer interaction device from the text input mode to the pointer position Information related to the position of the second indicator of the information input mode.

For example, when a pointer position information input signal greater than a preset threshold is generated in the text input mode, the human-computer interaction device may be switched to the pointer position information input mode.

1 to 15 collectively describe an example of an integrated text input device equipped with a pointing device to be described in the present invention. In addition, the types and techniques used of text input devices and indicative location information input devices included herein may be changed and/or substituted without modification or change of the basic purpose by any person skilled in the art.

Specific embodiments of the invention

As mentioned above, the relevant details have been described in the best mode of carrying out the present invention.

Industrial Applicability

As mentioned above, the present invention can be fully or partially applied to a multi-person computer interaction device including a text input device and a pointer position information input device.

Claims (20)

1. A digital device comprising a human-computer interaction device, said digital device comprising: a text input unit comprising a plurality of physical keys, a pointer position information input unit configured to receive information on a pointer position from a user, a pointer execution command receiving unit configured to receive a command from the user to perform at least one function at a pointer location, and, a first mode switching unit configured to activate and deactivate an indicator position information input mode, and Wherein, the pointer position information input area of the pointer position information input unit is positioned parallel to at least a part of the text input area of the text input unit including the plurality of physical keys, wherein the first mode switching The unit is operated by a first input input via the first key, and the pointer execution command receiving unit is operated by a second input input via the first key. 2. The device according to claim 1, wherein the pointer position information input unit comprises a touch sensor included in a physical key of the text input unit, or a touch sensor for identifying a physical key of the text input unit. At least two cameras and at least one optical emitter of the subject. 3. The device according to claim 1, wherein the first key is disposed in an area outside the text input area of the text input unit. 4. The device of claim 1, wherein the physical key comprises a key top for receiving physical pressure, and a resilient member for applying a physical force to the key top when the physical pressure is removed . 5. The device according to claim 1, wherein the human-computer interaction device is provided with a light source for reflecting the light source generated by the indicator position information input unit on the left side, the right side and the upper part of the text input area. A reflector or an absorber for absorbing the light source generated by the pointer position information input unit is not provided on at least one portion of the lower portion of the text input area. 6. The device according to claim 1, wherein the pointer position information input unit comprises at least two optical sensor modules, and the at least two optical sensor modules are located outside and right of the lower left end of the text input area. area outside the lower end. 7. The device according to claim 1, wherein the first key receives the first input and the second input, the first input is an input using a first touch sensing, the first A mode switching unit activates the pointer position information input mode during reception of the first input, and deactivates the pointer position information input mode when the first input is released, the second input being a second input by the user. Touch or pressure due to first pressure. 8. The device according to claim 1, further comprising a second mode switching unit configured to switch the indicator position information input mode from activation to deactivation or from deactivation to activation each time an input is received. 9. The device according to claim 8, wherein when the first mode switching unit receives the first input and is activated in a state in which the pointer position information input mode is activated by the second mode switching unit When released, the indicator position information input mode is released. 10. The device according to claim 8, wherein, when a text input is received in a state in which the pointer position information input mode is activated by the second mode switching unit, the pointer position information input mode is deactivated. live. 11. A user input method for a digital device, the user input method comprising the following steps: receiving a user's text input through a text input unit, the text input unit including a plurality of physical keys, receiving information about the position of the pointer from the user through the pointer position information input unit; receiving a signal from a pointer execution command unit that receives a command from the user to execute at least one function at the pointer position by a pointer execution command receiving unit, receiving a signal for activating the indicator position information input mode from the mode switching unit through the mode switching command receiving unit, supplying power to the pointer position information input unit, the pointer execution command receiving unit, and the mode switching command receiving unit, and transmitting the information on the position of the pointer input to the pointer position information input unit to a digital device connected to the human-computer interaction device via a wired or wireless connection, Wherein, the pointer position information input area of the pointer position information input unit is positioned parallel to at least a part of the text input area of the text input unit including the plurality of physical keys, wherein, using the input via the first key The mode switching command receiving unit is operated by a user's first input, and the pointer execution command receiving unit is operated by a user's second input input via the first key. 12. The user input method according to claim 11, wherein the pointer position information input unit comprises a touch sensor included in a physical key of the text input unit, or the touch sensor for identifying the text input unit. At least two cameras and at least one optical emitter of the object on the physical button. 13. The user input method according to claim 11, wherein the first key is disposed in an area outside a text input area of the text input unit. 14. The user input method according to claim 11, wherein the physical key comprises: a key top for receiving physical pressure, and an elastic member for applying physical force to the key top when the physical pressure is removed . 15. The user input method according to claim 11, wherein the digital device is provided with a light source for reflecting a light source generated by the pointer position information input unit on the left side, the right side and the upper part of the text input area. A reflector or an absorber for absorbing the light source generated by the pointer position information input unit is not provided on at least one portion of the lower portion of the text input area. 16. The user input method according to claim 11, wherein the pointer position information input unit comprises at least two optical sensor modules, and the at least two optical sensor modules are located outside the lower left end of the text input area and the area outside the lower right end. 17. The user input method according to claim 11, wherein the first key receives the first input and the second input, the first input is an input using a first touch sensing, the The first mode switching unit activates the pointer position information input mode during receiving the first input, and deactivates the pointer position information input mode when the first input is released, the second input is The user's second touch or pressure due to the first pressure. 18. The user input method according to claim 11, wherein the digital device further comprises a second mode switching unit, and the user input method further comprises switching the pointer position information input mode from active to Deactivation or transition from deactivation to activation. 19. The user input method according to claim 18, wherein when the first mode switching unit receives the first input in a state where the pointer position information input mode is activated by the second mode switching unit And when released, the indicator position information input mode is released. 20. The user input method according to claim 18, wherein, when a text input is received in a state in which the pointer position information input mode is activated by the second mode switching unit, the pointer position information input mode is deactivated. live.