WO2013180369A1 - Human interface apparatus having input unit for pointer location information and pointer command execution unit - Google Patents

Description

[Correction 13.11.2013] according to Rule 26. Human interface device having a pointer location information input unit and a pointer execution command unit

The present invention relates to a human interface for receiving text information or pointing location information from a user on a digital device capable of receiving text or pointing location related information such as a computer, a laptop, a tablet PC, a mobile phone, and transmitting the same to the digital device.

Text input devices, such as keyboards for text input, have been disclosed in personal computers and portable digital devices. In addition, pointing devices such as a mouse device for controlling a pointing position of a pointer for controlling the digital device and performing a function have been disclosed.

Conventionally, the text input device and the pointing device are provided as separate devices or have a pointing input area configured at a separate location separate from the text input area of the text input device. As a result, the user's hand is moved more than necessary in a work environment in which text input, pointing location information input and pointer execution command input are frequently switched, thereby reducing work efficiency.

It has a pointing position information input area of the pointing device on the top of the text input area plane of the text input device, and has a switching unit for switching between the text input mode and the pointing position information input mode. Work efficiency can be improved by enabling pointing input with minimal movement.

By integrating the text input device and the pointing device provided separately in one human interface device, the cost and size of the product can be reduced, and the work efficiency can be improved by eliminating unnecessary operations of the user's operation.

1 is an exemplary diagram of a composite human interface device having a pointing device and a text input device.

2 is a flowchart illustrating an example of an operation procedure according to mode switching between a pointing device and a text device.

3 is a diagram illustrating embodiments of a text input device and a pointing device.

4 illustrates exemplary embodiments of a pointer execution command unit integrated mode switching unit.

5 illustrates embodiments of a structure of a pointer location information input device.

6 is a configuration diagram of an infrared laser sensor module.

7 is a diagram illustrating an example of displaying a pointer location information input area.

8 is a first embodiment of a pointer location information input device that can be separated from a text input device.

9 is a second embodiment of a pointer location information input device that can be separated from a text input device.

FIG. 10 is a third embodiment of a pointer location information input device that can be separated from a text input device.

11 is a front view and a perspective view of a human interface device to which the bottom positional pointer location information input device is applied.

12 is an embodiment of a pointer execution command unit integrated mode switching unit.

FIG. 13 illustrates an embodiment using a cover of a human interface device to which a lower position pointer type location information input device is applied.

14 is an embodiment of a human interface device applied to a portable electronic device.

FIG. 15 illustrates an embodiment in which a lower position type pointer position information input device and a lower position type pointer execution command unit are applied.

The present invention relates to a complex human interface for receiving text information or pointing location information from a user on a digital device capable of receiving text or pointing location information such as a computer, a laptop, a tablet PC, a mobile phone, and transmitting the same to the digital device.

As a conventional text information input device, a keyboard composed of a plurality of physical buttons connected to an elastic body and a switch is widely used.

In addition, in a digital device having a touch interface, a virtual keyboard is displayed on a display, and when a part of the user's body is touched by the virtual keyboard displayed on the display, a user's gesture or electrical signal is detected and the user touches the virtual keyboard. The method of inputting text on the virtual keyboard displayed on the part is also used.

The touch interface recognizes movement of a part of the user's body, recognizes that the user has touched a specific contact surface, detects the flow of current through the user's body, or blocks light or sound waves from being blocked or interfered with by a part of the user's body. The user's touch can be recognized by sensing.

Examples of the touch interface include a pressure sensitive touch screen, a capacitive touch screen, an optical touch screen, and an ultrasonic touch screen.

The resistive touch screen or the pressure sensitive touch screen is a touch screen that operates by sensing pressure.

Resistive touch screens are inexpensive and can be written in small spaces with a stylus pen, but because they use pressure, they are hard to recognize when pressed harder, and they are slightly less dull than the capacitive touch method. It is known to be a disadvantage.

Resistive touchscreens consist of multiple layers.

Among these several layers is the conductive layer, which has two layers facing the air layer.

When the outer screen is pressed, the two conductive layers come into contact with each other, which causes a change in resistance and current to recognize that the touch is made.

Capacitive sensing or capacitive touch is a method of sensing an operation using a capacitive coupling effect.

Capacitive touchscreens are made of highly conductive glass called indium tin oxide, unlike pressure-sensitive touchscreens.

Sensors are attached to the four corners of the glass so that a current flows through the glass surface.

It is the principle of the electrostatic that recognizes the change of current through this.

At this point, when the finger touches the screen, the electrons that flowed on the glass flow into the body through the finger, and the sensor detects the position where the change occurred.

The capacitive touch method is known to have a smooth feeling of operation and scrolling as compared to a pressure sensitive touch screen because it is recognized only by touching the screen, not by pressing the screen with force.

In addition, the capacitive touch method is capable of multi-touch to touch several places.

Since the capacitive touch method is operated by using a change amount of current, the capacitive touch method may be worn with a non-current leather glove or a fingernail or a stylus pen.

However, if you use a separate capacitive stylus pen, you can touch the screen.

The sensor is sensitive and may be affected by peripherals.

An optical touchscreen works by using an infrared camera mounted at the vertex of the touchscreen and an infrared light that measures coordinates with the shadow of the object you want to touch the screen.

The ultrasonic touch screen operates by measuring the coordinates by emitting an ultrasonic wave on the screen to detect the interference effect of the user's touch.

In addition, various touch input technologies may be used in the present invention, which may be used to detect location information of a part of the user's body by sensing a contact or movement of the user and control the location information of the pointer.

1 is an exemplary diagram of a composite human interface device having a pointing device and a text input device.

The pointing device integrated text input device may have a housing 100 for supporting the text input device and the pointer location information input area.

The housing has a strength that can withstand the pressure of the user input, and receives the text input information and the pointer position information input information and transmits the information to a digital device connected to the pointing device integrated text input device by wire or wirelessly. The controller may include a controller, a memory unit, a battery unit, an encoder, a transmitter, and the like.

The pointing device integrated text input device may include a plurality of buttons 109 for receiving text input information from a user.

The plurality of buttons 109 may be configured as physical buttons or virtual buttons.

The physical button may be composed of a button that is connected to the elastic body or the button itself is elastic, it may be characterized by moving to a position when receiving the user's input and returning to its original position when the user's pressure is removed.

The physical button is connected to an electrical switch, the user's pressure is applied to move the position of the button to change the phase of the switch may be configured in a structure that generates a text input value of the button.

The physical button has an elastic structure without an electrical switch and moves to a position under pressure of the user and returns to its original position when the pressure of the user is removed, and the user's text input information is controlled by the touch input device. The text input information may be generated based on the location information on which the user's pressure or gesture is recognized.

The virtual button may be configured by displaying a text input button on a display device.

The virtual button may display an arbitrary button by projecting light onto a transparent, translucent, or opaque object.

The virtual button may generate the corresponding text input information based on the user's pressure or gesture information with the unique location information for each text without being recognized by the user's eyes.

The complex human interface device may have a pointing location information input area 108a or 108b having a text input area 107 and at least a portion thereof as a common area.

The pointing location information input areas 108a and 108b are areas located at the top or bottom or bottom of the button for text input. As shown in FIG. 1, the pointing location information input areas may have at least a part of the text input area in common. have.

The pointing location information input area may include the text input area or the text input area may include a point location information input area.

The pointing location information input area and the text input area are at least partially in common, and at least some of them are used as the pointing location information input area but are not used as the text input area, and at least some are used as the text input area. May not be used.

The complex human interface device includes a pointer location information input device 105 for text input or for pointing location information input or for forming a virtual text input area or a virtual pointing location information input area for text input and pointing location information input. It may be configured on the composite human interface device or external to the composite human interface device.

The pointer location information input device 105 is composed of a device such as an infrared generator and an infrared receiver or an RGB camera or an ultrasonic generator and an ultrasonic receiver or an infrared generator and an infrared camera, and the surface or the housing 100 of the housing 100. A part of the user's body may be sensed in the air to receive location information and gesture information.

The pointer location information input device may be modularized and configured as a plurality of modules to expand the pointer location information input area or to improve accuracy and sensitivity.

For example, it may have a pointer location information input device 105b for configuring a text input or pointing location information input area 108b of the right hand.

Alternatively, the device may have a pointer location information input device 105a for configuring a text input or pointing location information input area 108a of the left hand.

The text input area or the pointing location information input area 108b for the right hand may include an area of the J button of the English standard keyboard.

The text input area or the pointing location information input area 108a for the left hand may include an area of the F button of the English standard keyboard.

The pointer location information input device may include both the J and F buttons of the English standard keyboard when there is no division for the left hand and the right hand.

The pointing location information input area may be a pointer position movement on the plurality of display parts when the complex human interface device is connected to a plurality of digital devices having a display part.

For example, the pointer location information input area may be divided to match each display unit, or a separate button indicating a display unit may be operated to transmit pointer position information from the corresponding display unit, or a plurality of display units may be virtually single. Recognizing the display unit may transmit the pointer position information so that the pointer can move on the virtual single display unit.

The composite human interface device includes a pointing location information input device that configures a pointing input area and receives pointer location information from a user, wherein the button or image, space, icon, or text input on which the pointer moved by the pointing location information input device is located is located. It may have a pointer execution command unit (101, 102) for executing at least one function on the window.

The pointer execution command unit may be composed of one or two buttons, respectively, and may serve as a first function and a second function, and may be located at the left side of the housing or at the post or center.

The first function may, for example, function as a left click of a computer mouse and the second function may, for example, function as a right click of a computer mouse.

The pointer execution command unit including one or two buttons may be provided at both the left side and the post of the housing.

The pointer execution command unit may be configured to be operated by recognizing a touch or light blocking of the user's body part or interference of ultrasonic waves or a shadow of the user's body part using the above-described touch technology.

The pointer execution command unit may be configured of an elastic physical button.

The pointer execution command unit may operate by using at least one button of the text button located in the text input area in addition to the pointing position information input area.

The pointer execution command unit may operate by selecting a physical or virtual text button on a pointing location information input area.

For example, when using a virtual input device that can input location information in space as a pointing location information input device and using a physical button as a text input device, the position of the pointer on the virtual pointing location information input area in the pointing location information input mode. You can issue a pointer execution command by entering information and pressing the physical text button at that location.

The pointer execution command unit may receive pointer position information by a user first gesture in a pointing position information input area and generate a pointer execution command by a user second gesture at the same position.

The pointer execution command unit may be configured to execute a first function by a first gesture or a first voice of the user's body, a first blink, a first mouth shape, or the like.

The pointer execution command unit may be configured to execute the second function by a second gesture or a second voice of the user's body, a second blink, a second mouth shape, or the like.

The complex human interface device may include a text input mode for receiving text information through the text input device and a pointing location information input mode for receiving pointing location information through the pointing location information input device.

The text input mode and the pointing position information input mode may be switched by the mode switching unit 103.

The mode switching unit 103 may be configured as a switch located separately on the housing.

The mode switching unit 103 may perform mode switching by sensing that at least one text input button or a plurality of text inputs included in the text input device are simultaneously received.

The mode switching unit 103 may switch the mode by receiving control information from a digital device connected to the composite human interface device by wire or wirelessly.

The mode switching unit 103 may be integrally formed with the pointer execution command unit 102.

For example, by a first gesture such as contact of a part of the user's body on a first button that reacts first to a first touch or first pressure and reacts second to a second touch or second pressure. It may be configured to generate a pointer execution command in response to the second touch or the second pressure by a second gesture such as sensing a touch or the first pressure to switch modes and pressing a button.

The mode switching unit 103 may be configured of a temporary mode switching mode and a permanent mode switching mode.

For example, in response to the first touch or the first pressure, switching from the text input mode to the pointing position information input mode and returning to the text input mode when the first touch or the first pressure is removed may be set as the temporary switching mode. have.

Alternatively, the switching from the pointing position information input mode to the text input mode in response to the first touch or the first pressure and returning to the pointing position information input mode when the first touch or the first pressure is removed may be set as a temporary switching mode. .

Switch from text input mode to pointing position information input mode in response to the second touch or second pressure or toggle switch, and configure the permanent switching mode to maintain the pointing position information input mode even if the second touch or second pressure is removed. Can be.

Temporary mode switching may be performed by first control information received from a digital device connected to the composite human interface device by wire or wirelessly.

Permanent mode switching may be performed by the second control information received from the digital device connected to the composite human interface device by wire or wirelessly.

The mode switching unit 103 may be integrated with the pointer execution command unit.

For example, when the first touch or the first pressure is detected on the pointer execution command unit, the temporary mode is switched from the text input mode to the pointer position information input mode, and when the second touch or the second pressure is detected, the pointer execution command is executed. When the third touch or the third pressure is applied and the third touch or the third pressure is removed, the permanent touch mode may be set to the permanent switching mode to operate in the pointer position information input mode even when the third touch or the third pressure is removed.

At this time, the pointer execution command can be input even during the permanent switching mode.

The mode switching unit may be configured on the left or right side of the housing (106a, 106b)

The mode switching units 106a and 106b configured on the left side or the right side or the left side and the right side of the housing may be configured as virtual buttons or physical buttons to sense and operate a user's touch input or pressure.

The mode switching units 106a and 106b configured on the left side or the right side or the left side and the right side of the housing may be configured to have an input area of 3 centimeters or more and less than 15 centimeters along the side of the housing.

When the length of the mode switch is less than 5 centimeters, it is preferable to set the position of the mode switch to include the left space of the left tab key of the window standard keyboard.

The composite human interface device may have a transmitter 104 for transmitting data by wire or wirelessly to a digital device including an external or composite human interface device.

The digital device may receive a text input or receive pointer location information.

2 is a flowchart illustrating an example of an operation procedure according to mode switching between a pointing device and a text device.

The composite human interface device may have a separate power supply unit or may receive power from the outside by wire or wirelessly, and may have a separate switch controlling the power supply unit.

When power is supplied to the composite human interface device by the switch controlling the power supply unit, it may be determined whether the composite human interface device is currently in the text input mode or the pointing location information input mode (200).

As a result of the determination, in the text input mode, the text input device may be activated and a text input may be received from the user (201).

The input text input of the user may be transmitted to a digital device connected by wire or wirelessly (202).

When a mode change occurs to the pointing position information input mode during the text input mode, the text input mode may be switched to the pointing position information input mode.

Alternatively, it may be configured to input pointing position information simultaneously with text input.

When the mode is switched to the pointing location information input mode, the pointing location information may be received by the user's input (204).

The input pointer position information may be transmitted to a digital device connected by wire or wirelessly (205).

When the composite human interface device receives the pointer first execution command 206, the composite human interface device may transmit the pointer first execution command to a digital device that is connected by wire or wirelessly (207).

When the composite human interface device receives the pointer second execution command 208, the composite human interface device may transmit the pointer first execution command to a digital device connected by wire or wirelessly (209).

When the temporary mode switch is released or the permanent mode switch is released, the composite human interface device may switch to the text input mode.

The power switch of the power supply unit may be terminated when the power supply of the complex human interface device is disconnected or there is no connected digital device, or when the connection is lost, or when there is no user input for a predetermined time or by control of a digital device connected by wire or wirelessly.

3 illustrates embodiments of a text input device and a pointing device.

The complex human interface device may include a first housing 301 including a power supply unit, a controller, or a communication unit, and a second housing 302 for configuring a text input area and a pointing location information input area.

The composite human interface device may have a text input device and a text input area 303 that receive text input from a user.

In this case, the text input area 303 may be configured as a virtual button or a physical button.

The pointing location information input device may be configured in a pressure sensitive or capacitive touch pad type and positioned on a physical button of the text input device (304).

In this case, when the text input device is configured in the form of a physical touch pad such as a pressure sensitive or capacitive touch panel, the touch pad may be used as the text input device and the pointing location information input device, and the mode switching unit may switch the mode.

At this time, a physical touch pad such as a pressure sensitive or capacitive touch panel may be configured as a large-area touch pad type complex human interface device 300 including a touch pad 304 including a plurality of text button regions of a text input unit.

Alternatively, a physical touch pad such as a pressure sensitive or capacitive touch panel may be configured as a plurality of touch pad type human interface devices 310 including a plurality of touch pads 311 including one text button area of the text input unit.

Alternatively, the upper camera type human interface device 320 constituting the pointer location information input area 321 by an infrared camera or an RGB camera 222 positioned at an upper end of the pointing location information input area. It can be configured as.

In this case, the upper camera type complex human interface device 320 may configure the virtual text input button 303 using the upper camera.

The camera may be configured as a bottom camera 332 type composite human interface device 330 configured to be positioned at the bottom of the second housing to form a pointing position information input area 331.

In this case, the lower camera type complex human interface device 330 may configure a virtual text input button 303 to replace the physical text button using the lower camera.

Or a virtual pointing location information input area composed of a pair of infrared receivers or ultrasound receivers for receiving information from which infrared or ultrasonic waves transmitted by an infrared transmitter or an ultrasonic transmitter are blocked or interfered with by a part of the user's body. 341 may be configured as a transmit / receive composite human interface device 340.

In this case, the pair of virtual pointing position information input areas may be used as a virtual text button input means in place of the physical text button by the mode switching unit.

4 is a diagram illustrating embodiments of the pointer execution command unit integrated mode switching unit.

When the position is moved by the pressure of the user and the elastic body 403 for returning to the original position when the pressure is removed and the button 402 receiving the pressure of the user and the position is moved by the user's pressure, the pointer execution command In the button type pointer execution command unit having switches 404 and 405 for generating a touch input, a touch input located at a top of the button detects a user's touch input to switch a text mode and a pointing position information input mode. Using the pointer execution command unit integrated mode switching unit 400 can be configured.

When the user moves the position by the pressure of the user and the pressure is removed, the elastic body 403 returns to the original position and the button 402 receives the user's pressure and the position is moved by the user's first pressure. A second switch section 411, which is joined by a user second pressure less than the user first pressure in the button type pointer execution command section with the first switches 404 and 405 for generating an execution command, to generate a mode switch execution command; The pressure-sensitive pointer execution command unit integrated mode switching unit 410 configured as 412 may be configured.

 In the pressure-sensitive pointer execution command unit integrated mode switching unit 410, the button unit 402 may be moved to fix the button unit 402 so as not to return to its original position by the elastic body 403.

At this time, the position where the button is fixed may be configured to be operated in the permanent mode switching mode when the button is fixed by setting the position where the second switches 411 and 412 are bonded and the first switches 404 and 405 not bonded. .

 In the pointer execution command unit integrated mode switching unit 400 using a touch input, the permanent mode switching switch 414 may be configured to operate the permanent mode switching switch 414 by moving a position such as sliding the button unit. The pointer execution command switches 404 and 405 may be configured to operate when additional pressure is applied in the operated state.

The pointer execution command unit-integrated mode switching unit 410 is configured as a touch pad 421 to operate as a mode switching unit when the contact area of a part of the user's body in contact with the touch pad is within the first predetermined range and is within the second predetermined range. Can act as a pointer execution command.

5 illustrates embodiments of a structure of a pointer location information input device.

The pointer location information input device of the human interface device may include a sensor module 501 including a light emitter and a camera.

The light emitter of the sensor module 501 has a path of light blocked by an obstacle, for example, a user's finger, on a pointing location information input area 108 configured on a light plane composed of light emitted from a light emitter. It serves to configure the light plane to be reflected.

 The camera of the sensor module includes an optical sensor for detecting the light blocked or reflected by the obstacle.

The optical sensor may use a line camera that can recognize a line image.

The line camera is suitable that the image sensor is composed of 400 to 1000 elements in the form of a line, preferably 500 to 700 elements is ideal.

The line camera may include a plurality of line image sensors that are smaller than one five fifth to one seventh one of the 500 to 700 elements.

The light emitter is composed of a light emitting element for constructing a light plane on the upper end of the character input button 303 about 1 millimeter.

The pointing location information input area 108 is composed of a part of the light plane.

As the light emitting device, for example, an infrared emitter, an infrared laser emitter, a laser emitter, an ultraviolet emitter, a visible light emitter, or the like can be used.

The light emitting device is ideal to use an infrared laser emitter that does not require a reflector on the edge.

Infrared laser emitters are suitable for driving lasers having a laser wavelength of 800 to 850 nanometers at 0.3 to 1 milliwatt.

The light emitter lets the light from the infrared emitter pass through the line lens to spread in a plane.

A line lens may be further included in the light emitter of the light emitter so that the light emitted from the light emitting device may form a light plane.

The line lens is positioned so that the light emitted from the light emitting element may form a light plane substantially parallel to the character input unit.

The pointer location information input device may further configure the optical filter 504 to transmit light of the light emitter to only light of a specific wavelength band.

The optical filter 504 is installed so that the light emitted from the light emitter passes through, and also prevents the light emitted from the light emitter from being received by the camera when light reflected or blocked by an obstacle is received by the camera. Can also be installed.

Although the optical filter for the light emitter and the camera may be configured separately, it is preferable to design the light emitter and the camera in close proximity so as to filter both the light transmitted and the received light with one optical filter. .

The optical filter may be installed to be perpendicular to the traveling direction of the light of the light emitter.

The optical filter may be installed to be 30 degrees to 60 degrees or 120 degrees to 150 degrees in the advancing direction of the light emitter in consideration of design.

The sensor module 501 may be installed so that the light of the light emitter is directly radiated to the light plane.

The sensor module 501 may further include one reflector 503 such that the light of the light emitter is refracted once and radiated to the light plane.

At this time, the light blocked or reflected by the obstacle may be refracted by the reflector 503 once and received by the camera.

The sensor module 501 may include two reflecting plates 503a and 503b such that the light of the light emitter is refracted twice and radiated to the light plane.

In this case, the light blocked or reflected by the obstacle may be refracted twice by the two reflecting plates 503a and 503b and received by the camera.

In this way, the sensor module may be installed in the first housing 301.

In this case, an optical filter may be coated on the reflecting plate 503 to replace a separate optical filter 504.

When the pointing location information input area 108 is activated by the sensor module 501, the user moves the text input button 303 by swiping with his / her finger to input the pointing location information.

In this case, the distance between the text input buttons 303 is ideally 0.1 millimeter to 1 millimeter so that the user's fingers are not disturbed by the distance between the text input buttons 303.

In addition, the plurality of text input buttons 303 positioned below the pointing location information input region 108 may be positioned on a plane where the top surfaces of the plurality of text input buttons are flat.

The light source emitted from the sensor module 501 is reflected by a reflector or an obstacle and the light source received by the camera passes through the light tunnel 502.

At this time, if the upper surface of the light tunnel is replaced with a portion of the first housing 301 can reduce the thickness of the housing.

The lower surface and the side surface of the light tunnel may be designed as a separate structure from the first housing.

6 is a configuration diagram of an infrared laser sensor module.

The infrared sensor module basically emits the light covering the pointing location information area by using the light source 601 and analyzes the light reflected or blocked by the obstacle to locate the obstacle to one or two cameras 603. Calculation principle.

In this case, a line lens 602 may be used to scatter light so that light emitted from the light source 601 may be emitted to a desired area.

It is preferable to use a line camera as a camera for recognizing a state in which the light source is reflected or blocked by an obstacle.

The camera may install a guide light tunnel in front of the camera to help the incoming light to receive light in a desired area.

The light source may be infrared rays, ultraviolet rays, lasers, or the like.

The light source and camera can be replaced by an ultrasonic and ultrasonic receiver.

It is preferable to use an infrared laser as a light source in order not to install a reflector on the edge of the keyboard.

If you want to use infrared light, you can install a reflector at the edge of the keyboard, increase the output of the light source more than twice as much as the optical touch module for the general screen, or install an additional auxiliary light source.

The sensor module may have an auxiliary control board 604 that controls the light source and the camera and transmits a received signal of the camera to the main control board.

The pointer location information input unit may be positioned to include a portion of an extended surface of the text input unit plane.

The text input unit includes a plurality of buttons for receiving at least one text, wherein the buttons generate a text selection signal while moving from the first position to the second position by the pressure applied by the user, and the first position by the elastic body. It can be configured in the form of a physical button returning to.

The text input unit includes F4 and F5 buttons on a Windows standard keyboard, and two cameras of the pointer position information input unit are provided. The camera on the left of the two cameras and the text input unit are provided. One of the buttons can be designed to be the F4 or F5 button at the closest distance.

Alternatively, the camera on the left side may be positioned below the space bar of the Windows standard keyboard, above the zero space where the space between the F4 and F5 buttons is moved downward.

In this way, when the position of the index finger of the right hand is located in the F position of the text input button, the index finger of the left hand can obstruct the camera when inputting the pointer position information with the right hand.

When the pointer execution command unit is set to a button having the largest area among the text input units, for example, a space bar, it is convenient to execute the pointer execution command unit with the left hand while inputting mouse position information with the right hand, for example.

At this time, since the left hand may operate the mode switching unit, the mode switching unit and the pointer execution command unit preferably have a shortest distance of 8 to 15 centimeters.

The mode switching unit may be provided separately from the button of the text input unit and recognizes that a part of the user's body is touched by a part of the human interface body to switch to the text input mode and the pointer position information input mode. It operates in the pointer location information mode and can operate in the text input mode when it is not touched.

The pointer execution command unit includes two buttons to perform a first function when a first button is pressed, for example, a left click of the mouse, and a second function when a second button is pressed, for example, a right click of a mouse, The first button is a button having the largest area among the text input buttons, for example, a space bar button, and the second button is the first button located at the left or right side of the first button. The thumb's thumb is convenient to control and provides an easy user experience.

When the mode switching unit is switched to the text input mode or the pointer location information input mode, a display indicating the text input mode or the pointer location information input mode may be displayed.

The pointer position information input mode may be displayed by temporarily displaying a moment when a touch occurs in the mode switching unit or displaying the pointer position information input region from a time when a touch of the mode switch is generated to a release point. lighting) signal.

By doing this, the user recognizes which mode the keyboard is currently in, and in the pointer position information input mode, it is easy to know at which position the pointer position information should be input.

The text input area of the text input part may be designed to be the same as the pointer location information input area of the pointer location information input part or to include a pointer location information input area of the pointer location information input part as shown in FIG. 1.

In one embodiment of configuring the pointer position information input unit, one or two optical emitters and a camera may be configured.

The optical signal received by the camera may pass through a light tunnel to block an external noise light source.

The light tunnel may be configured before the optical signal is emitted from the optical emitter to the pointer location information input area, and may be installed in front of a camera that receives a user input signal from the pointer location information input area.

At this time, it is possible to arrange a reflector for refracting the optical signal emitted from the optical emitter or the optical signal received by the camera.

The reflection plate provides freedom to the installation position and the direction of the pointer position information input unit, thereby obtaining space utilization and design benefits.

The pointer location information input unit may be configured to configure the pointer location information input area at least 0.1 to 5 millimeters above the text input unit by the optical emitter and the camera.

Through this, the pointer location information can be received only when there is a clear touch intention of the user.

When used as an optical emitter using an infrared laser having a wavelength of 800 to 850 nanometers and designed to operate at 0.3 to 1 milliwatt, the optical emitter exhibits excellent power consumption, cost, stability, safety, and visual characteristics.

The optical emitter may further include a line lens for scattering the optical signal such that the optical signal constitutes a pointer location information input area parallel to the text input unit.

The pointer location information input unit may be designed to block optical external noise by using an optical filter that transmits only an optical signal in an infrared region.

When the text input unit is designed to have a distance between 0.1 mm and 1 mm between physical buttons, the text input unit may provide a user with a sufficiently soft and flat feeling during input of the pointer location information.

7 is a diagram illustrating an example of displaying a pointer location information input area.

The human interface device may be designed to further include pointer location information input area display units 701 and 702 for visually displaying the pointer location information input area in the pointer location information input mode.

The mode switching unit is provided separately from the button of the text input unit and recognizes that a part of the user's body is touched by a part of the complex human interface housing to switch to the text input mode and the pointer position information input mode, but when the touch is performed, the pointer is touched. It can be designed to operate in location information input mode and to operate in text input mode during non-touch.

In this case, when a part of the body used for the mode switching is the right hand (106b), the hand for the pointer position information input 108a may be designed to be the left hand.

In this case, it is preferable that the pointer position information input area is designed to be closer to the opposite edge of the corner where the mode switching unit is located, and the same principle can be used when the left hand and the right hand are used in reverse. (106a, 108b)

On the other hand, a part of the body used for the mode switching is the right hand and the hand for inputting the pointer position information may be designed to be the right hand.

In this case, it is preferable that the pointer location information input area is designed to be closer to the corner where the mode switching part is located than the opposite corner of the corner where the mode switching part is located, and the left hand may be designed in the same principle.

The mode switching unit may determine the text input mode and the pointer location information input mode based on the number or positions of user fingers recognized by the pointer location information input unit.

The number of recognized user fingers in the determination of the pointer position information input mode is smaller than the number of recognized user fingers in the determination of the text input mode.

For example, while controlling the mode switch with the left hand, the finger of the left hand may be non-touched from the text input button and the index finger of the right hand may be touched for inputting the pointer location information. The number of is one.

On the other hand, when the fingers of the left hand and the right hand are touched on the keyboard for text input, the number of fingers of the recognized user of 2 to 8 or less is recognized.

The pointer position information input mode display unit temporarily displays the pointer position information input area when the mode switch is switched to the pointer position information input mode or when the pointer position information input mode is switched to the release point from the pointer position information input mode. Can be displayed visually.

The pointer position information input mode display unit may be displayed by the visible light generator from the text input button, reflected light by the text input button, or through the interval between the text input buttons.

At this time, the input mode may be displayed even in the text input mode, and the text input mode and the pointer location information input mode may be displayed to be distinguished.

The pointer position information input mode display unit includes invisible light generators 701a and 701b or surfaces 702a and 702b coated with dyes that optically respond to the invisible light and emit visible light, and the dye is the text. It can be applied to the interval between the input button or the text input button.

The mode switching unit may further include a handside determination unit that determines whether the user uses the pointer position information input with the left hand or the right hand.

The display of the pointer location information input display unit may be changed according to the handside determination unit.

According to the handside determination unit, it is possible to flexibly switch the button arrangement and operation of the pointer execution command unit.

For example, when the pointer execution command unit includes right-click and left-click, the button for performing right-click and left-click may be switched according to the determination of the handside determiner.

The pointer location information input area display unit may display different pointer location information input areas according to the determination result of the handside determination unit 702a or 702b.

The mode switching unit may be designed to automatically switch to the text input mode when the pointer location information input is not input from the user for a predetermined time or when an input is received through a text input button in the pointer location information input mode.

The pointer location information input area display unit may apply a dye to the text input button or a portion of the text input area so as to be visually displayed regardless of the mode of the mode switching unit so that the pointer input area may be recognized even during the text input mode. .

8 is a first embodiment of a pointer location information input device that can be separated from a text input device.

The pointer location information input device 810 may be designed to be separated from the text input device 800, so that the pointer location information input device 810 may be combined with or separated from the text input device 801.

In this case, the power connection unit 820 included in the pointer location information input device may receive power from a power source of the text input device 800.

The pointer location information input device 801 includes at least one pointer location information input device 105a, 105b, and may further include a controller and an optical filter 504.

The detachable pointer position information input device 810 may be combined to form a pointing position information input area on a plane parallel to the text input area (801), and on the left side 803 or the right side 804 of the text input device. In this case, the pointing location information input area may be configured on the bottom surface of the text input device.

At this time, the pointing position information input device and the power connection unit 820 are designed to be flexibly deformed to the positional change of the pointing position information input device.

9 is a second embodiment of a pointer location information input device that can be separated from a text input device.

The pointer location information input device 900 includes a built-in power supply to receive power from an external or its own battery.

When the pointer location information input device 900 is in the first location information input mode 902, the pointer location information input device 900 is positioned at a constant height and angle so that the pointer location information input area is parallel to the text input area of the text input device. The housing can be designed.

Alternatively, the apparatus may further include a first position information input mode adjusting device that adjusts the height and tilt of the housing so that the user may arbitrarily adjust the height and angle of the position information input area.

  When the pointer position information input device 900 is in the second position information input mode 904, the pointer position information input area is input at a constant height and angle so that the pointer position information input area is parallel to the bottom surface on which the pointer position information input device 900 is placed. The housing of the device 900 can be designed.

At this time, preferably, the height of the optical filter 504 in the first positional information input mode is higher than the height of the optical filter 504 in the second positional information input mode.

When the pointer location information input device 900 is in the third location information input mode 906, the pointer location information input area is formed to have a constant height so as to include an area perpendicular to the bottom surface on which the pointer location information input device 900 is placed. The housing of the pointer position information input device 900 can be designed at an angle with and.

The pointer location information input apparatus 900 may distinguish between at least two modes of the first location information input mode, the second location information input mode, and the third location information input mode according to the state placed on the floor. It may include a sensor unit.

The location information input mode sensor unit may include a sensor utilizing gravity, a sensor detecting a surface placed on the floor, or a switch.

The pointer location information input apparatus 900 may have at least one mode of the first to third location information input modes.

In particular, in the third location information input mode 906, mode switching for switching between the text input mode and the pointer location information input mode may be replaced by whether the user's hand or finger is detected in the location information input apparatus 900. Can be.

That is, when the user is inputting text, the user's hand or finger is not detected by the location information input device 900 in the third location information input mode.

When the user places a hand or finger on the top of the location information input device in the third location information input mode 906 to input the location information of the pointer, the location information input device 900 inputs the pointer location information. Switch to the mode.

Alternatively, a text input mode based on a state in which a digital device connected to the text input unit 800 and the location information input device 900 by wire or wirelessly detects the user's hand or finger. And pointer location information input mode can be switched.

Alternatively, the text input unit 800 to which the location information input device 900 is connected by wire or wirelessly may receive mode information of the location information input device 900 to change modes or the digital device may change modes. Information can also be sent.

At this time, when the text input is in progress, the location information input apparatus 900 may be switched to the first power saving mode which consumes less power than in the pointer location information input mode.

After the text input is interrupted, the first power saving mode may be switched from the first power saving mode to the active mode during the first first interval.

When the user's hand or finger is not detected during the first first interval after the text input is interrupted, the user may enter the second power saving mode which consumes less power than the first power saving mode.

In the first power saving mode, the sensor may be periodically controlled with less power than the active mode to determine the presence of the user's hand or finger.

When the user's hand or finger is detected in the first power saving mode, the user may switch to the activation mode.

 In the activation mode, it is possible to switch to the pointer position information input mode.

The pointer execution command unit for a pointer execution command in the pointer position information input mode may generate a pointer execution command using a button provided in the text input device or based on a position or shape change of the detected user's hand or finger. Can be.

The location information input device 900 may be activated by a mode switching unit on the text input device 800.

FIG. 10 is a third embodiment of a pointer location information input device that can be separated from a text input device.

The pointer location information input apparatus 1000 may have a housing 1001 surrounding at least two sides of the text input apparatus so that the text input apparatus 800 may be mounted.

The pointer location information input device 1000 includes a pointer location information input device 105a, 105b, a mode switching unit 106, a controller 1001, a housing 1002, and an optical filter 907 (1010).

After the text input device 800 is mounted on the pointer location information input device 1000 (1020), an optical filter 907 may be used to configure a pointing location information input area parallel to an upper end of the text input device 800 input area. The optical filter is positioned higher than the text input device 800 so that the light source can pass therethrough.

At least one surface 1003 surrounding the text input device of the housing 1002 may be a surface such that a light source radiated from the pointer location information input device 105 may be reflected, transmitted, or absorbed according to the type of the pointer location information input device. Each material can be treated with a mirror, transparent glass or plastic, or a black light absorber.

8, 9, and 10 are embodiments of a pointing position information input apparatus detachable from a text input apparatus, and have the following components.

The pointer location information input unit receives information related to the pointer location from the user.

The pointer location information input unit receives the user's pointing location information input through the pointing location information input area configured by the pointer location information input device.

The pointer execution command receiving unit receives a signal of a pointer execution command unit that receives a user's command to perform at least one function where the pointer is located.

The pointer execution command unit may be configured as a button or a touch switch included in the pointer location information input unit, or may be configured as a control unit that switches to a pointer execution command when a predetermined input among user inputs received from the text input device is received.

And a mode switching command receiver for receiving a signal of a mode switching unit for switching to the pointer position information input mode.

The mode switching unit may be configured in a pointing location information input device, a text input device, or may be configured as a separate device.

And a power supply unit configured to transfer power to the pointer location information input unit, the pointer execution command receiver, and the mode change command receiver.

The power supply unit may be a power supply unit having its own battery or a contactor supplied with power from the outside.

And a pointer location information transmitter for transmitting information related to the pointer location input to the pointer location information input unit to a digital device connected to the human interface device by wire or wirelessly.

The pointer location information input area of the pointer location information input unit may be positioned at a predetermined height and angle so that the pointer location information input area may be parallel to an upper end of at least a portion of the text input area of the text input device including a plurality of physical buttons. Is set.

When the mode switch is provided separately from the text input button of the text input device, the mode switch may be fixed to at least one surface of the text input device and recognize that the user input is received in the mode switch to input the pointer position information. The mode change command receiver may be transmitted by wire or wirelessly.

The pointer location information input unit includes an optical emitter and a camera, and the optical signal received by the camera may be designed to pass through an optical filter through a light tunnel.

It may have a position state recognition unit for recognizing the position state information on the gravity direction of the human interface, the position state information on the floor on which the human interface is placed, or the position state information of the human interface through a user input.

The position state is composed of at least two types, and when the first position state is switched to the first pointer position information input mode, and when the second position state is switched to the second pointer position information input mode.

The pointer location information input area in the first location state refers to a position parallel to at least a portion of the text input area of the text input device.

The pointer position information input area in the second position state means that the pointer position information input area is parallel to the bottom surface on which the pointing position information input device is placed.

Pointing in the first pointer positional information input mode The upper position of the pointing positional information input device is located on the floor, and when the second pointer positional information input mode is switched, the ordinate coordinates of the pointing positional information input are the same but the calculation of the abscissa is increased or decreased. Calculate by changing direction.

The pointer execution command unit may use a space bar among text input buttons of the text input device, and another button adjacent to the space bar may be used as the pointer execution command unit.

The power supply may receive power from the text input device.

The predefined height and angle of the pointer position input area in the first position state may be defined by an adjuster to enable adjustment within a predefined range by the user.

The adjuster may adjust the angle by adjusting a bonding angle of at least one surface of the housing of the pointing position information input device with an adjacent surface.

The adjuster may adjust the height by adjusting the height of at least one surface of the housing of the pointing position information input device.

The controller may adjust the predefined height and angle by adjusting the height and angle of the optical module of the pointing location information input unit of the pointing location information input device.

FIG. 11 is a front view of a human interface device to which a bottom positional pointer location information input device is applied.

The human interface device may include a text input unit including a plurality of physical buttons, a pointer location information input unit for receiving information regarding a pointer position from a user, and a pointer execution command for receiving a user's command to perform at least one function at a location of the pointer. A pointer execution command receiving unit for receiving a negative signal, a mode switching command receiving unit for receiving a signal of a mode switching unit for switching to a pointer position information input mode, the pointer position information input unit, the pointer execution command receiving unit, and a mode switching command receiving unit A power supply unit for transmitting a pointer position information transmitter for transmitting information related to the pointer position inputted to the pointer position information input unit to a digital device connected to the human interface device by wire or wirelessly, on a pointer of the pointer position information input unit The information input area is positioned parallel to the top of at least a portion of the text input area of the text input part including the plurality of physical buttons, and the pointer location information input part is composed of at least two sensor modules and the at least two sensors. The module is located on the lower left side 1102 and the right side 1103 of the human interface device.

The pointer location information input unit includes an optical emitter and a camera, and the optical signal received by the camera passes through a light tunnel.

The mode switching unit may be provided separately from a text input button of the text input device.

The mode switch is located on the left side of the text input area of the text input device and recognizes that the user input is received in the mode switch, and transmits the pointer position information input mode to the mode switch command receiver.

The physical button is characterized by consisting of an elastic body for applying a physical force to return the upper part of the button and the upper part of the button when the user's finger pressure is removed from the user's finger pressure.

The complex human interface device may include a reflector or an absorber 1101 that reflects a light source generated by the pointer location information input unit at left, right, and top sides of the text input area, but not at least partially below. It is done.

The reflector is used when the light source generated by the pointer position information input unit is an infrared ray, and an absorber when an infrared laser is used.

At least two sensor modules 1102 and 1103 of the pointer location information input unit may be positioned to include at least a portion of the left outer area and the right outer area of the text input area. In other words, the left sensor includes at least a part of the left side of the control button of the standard window keyboard, and is lowered downward toward the housing corner without the key button. In this way, the sensor module enables the configuration of the minimum volume of the complex human interface device to maximize the aesthetic effect of the complex human interface.

Also, positioning the sensor near a vertex of the text input area 1110 to direct the sensor in the diagonal direction of the text input area is more than directing the sensor to the horizontal and vertical direction of the text input area. A pointer area information input area having a larger area can be configured. In addition, it is possible to maximize the pointer location information input area at the top of the text input area by moving the position of the location where the position information detection accuracy of the pointer location information input area between the sensor and the sensor is relatively low.

In addition, the position of the sensor may be positioned 1120 narrower than the width of the keyboard below the space bar of the standard keyboard. The width between the sensor and the sensor determines the width of the pointer location information input area, thereby reducing the area of the pointer location information input area but obtaining a relatively high pointer location information detex resolution than the location 1110 at the corner.

The sensor eliminates the reflector or absorber of the light source and lowers the height of the housing to prevent the thumb from being caught by the housing when the thumb presses the space bar of a standard keyboard with the thumb.

12 is an embodiment of a pointer execution command unit integrated mode switching unit.

In the input operation in which the frequent switching between the text input mode and the pointer position information input mode is performed, the number of mode switching and pointer execution commands is input.

For example, in the case of right-handed operation, if you want to input the pointer position information while text input in text input mode, you need to switch the mode with the left or right hand, enter the pointer position information, and then enter the pointer real name command with the left hand. do.

In general, during quick operation, the user inputs text and pointer position information and pointer execution command while keeping an eye on the monitor. When a mode switching unit and a pointer execution command input unit are separately provided, hand movement frequently occurs. It can be cumbersome, for example, because it can't find the exact location and can't perform the function properly or look at the keyboard.

To solve this problem, for example, in the case of a right-handed hand, if the user puts his hand on the mode switching unit with his left hand after entering text in the text input mode, a mode switching command is generated and the pointer input mode is changed. The pointer execution command unit may receive the user input by inputting the pointer position information with the right hand with the hand on the mode switching unit and applying pressure to the mode switching unit.

Thus, the user can share the position of the mode switch unit for the mode switch and the pointer execution command unit for the pointer execution command.

In one embodiment for this purpose, the mode switching unit is configured as a touch switch that can accept a touch input of the user's hand and the pointer execution command unit is configured as a switch that responds to the pressure, such as a text switch is located below the mode switching unit.

In this case, the first pointer execution command unit 1104 and the second pointer execution command unit 1105 are connected to each other by a conductor material capable of recognizing a touch from a user's hand, or commonly connected to the mode switching unit 1201. Therefore, whether the user touches the first pointer execution command unit or the second pointer execution command unit is configured to make the mode change in the same manner.

At this time, the mode switch operates in the pointer location information input mode while the touch is being made, and in the text input mode when the touch is released.

Mode switching by touch may be configured as a sensor that can sense the position of the user's finger or another switch that operates at a pressure less than the pressure for the pointer execution command in addition to the touch.

In this case, the mode switching and pointer execution command unit may be located in an area distinct from the text input area.

Preferably, in the case of the right-handed, it is located in the outer left area of the text input area.

If the mode switching unit and the pointer execution command unit are located outside the text input region, the possibility of confusion with the pointer position information input unit is eliminated and the pointer position information input region can be expanded.

The complex human interface device may include a second mode switch 1202. The second mode switching unit is a switch which operates like a toggle switch, and switches to a text input mode and a pointer position information input mode whenever an input from a user is received. Thus, even if the user does not touch the left hand with the mode switching unit, the pointer position information can be input using only the right hand.

In this case, when the mode change command by touch is received when the composite human interface device is in the text mode by the second mode switching unit, the composite human interface device operates in the pointer position information input mode. In addition, when the composite human interface device by the second mode switching unit is the pointer position information input mode, when the mode switch command by touch is received, the pointer position information input mode is maintained, but the mode switch command by the touch is released. When text input is received through the text input unit, the text input mode is switched.

In this case, when the text input mode is switched by the text input, at least the first text input may be ignored, and when at least two text inputs are received, the text input mode may be switched.

In this case, when at least two text inputs are received and the text input mode is switched, the composite human interface device transmits the text input including the ignored at least first text to the digital device and then newly inputs the text input information to the digital device. To send.

13 illustrates an embodiment utilizing a cover of the composite human interface device.

The complex human interface device requires at least one millimeter to two millimeters of space on top of a text input device plane composed of physical devices for the pointer position input device to form a pointer position input area, and an absorber for absorbing or reflecting an optical signal. Alternatively, a border for positioning the reflector may be required at least three edges surrounding the text input area.

At this time, a difference of at least 1 to 2 millimeters occurs between the height of the edge of the at least three sides of the edge and the height of the text input area plane, and a substantially rectangular parallelepiped type space is formed at the top of the text input area.

The complex human interface device may further include a multipurpose cover 1322 in the substantially rectangular parallelepiped type space for protecting a text input area from external impact.

The multipurpose cover 1322 is separated from the composite human interface device 1320, and may be combined and separated by a magnet or a physical structure.

The multipurpose cover 1322 may be a structure folded over several times. Preferably, the width of at least one area of the divided area of the utility cover in a double folding structure may be smaller than the width of the other area (1341).

This can further reduce the inclination of the composite human interface device when the multi-purpose cover is folded in the bottom to adjust the inclination of the composite human interface device.

When the multi-purpose cover is folded and then mounted on the bottom of the composite human interface device, a portion of the folded surface that comes into contact with the ground may include an inclined surface 1342 so that the area of contact with the ground may be widened.

The inclination of the multi-purpose cover 1322 can be adjusted by the user to the desired tilt of the composite human interface device.

The multi-purpose cover may include a rechargeable battery 1323 in the cover.

An electrode of a power source of the rechargeable battery 1323 may be positioned at a lower end of the multipurpose cover, and may be located at a portion of the protruding region rather than a portion covering the text input area (1331) and the multipurpose cover may cover the text input device. If present (1310) is connected to the electrode provided on the top of the composite human interface device.

In addition, when the multi-purpose cover is folded and mounted on the lower end to adjust the tilt of the composite human interface device, the cover may be connected to an electrode provided on the bottom of the composite human interface device.

The composite human interface device may be connected to an external power source to supply power to the rechargeable battery 1323 inside the multipurpose cover or to separately charge the multipurpose cover.

At this time, the bottom surface of the composite human interface device is a magnet or a physical coupling device or the like so as to be able to check at an accurate position with the area 1332 covering the protruding edge area where the electrode 1331 is located and the text input area having a height difference therebetween. It may have a groove into which the cover is inserted.

The edge of the multi-purpose cover is coated with a material capable of removing fine dust, oil, moisture, etc., so that foreign matters on the absorber plate, reflector plate, optical emitter, or the front of the camera can be removed whenever it is attached to the complex human interface device. have.

When the multi-purpose cover covers the text input area, the multi-purpose cover can detect the power supply of the composite human interface device.

When the multipurpose cover is mounted on the bottom of the composite human interface device, the composite human interface device may be turned on.

In addition, if there is no input by the user for a certain time after the power is turned on, the power may be turned off or the standby mode may be changed.

When the multipurpose cover covers the text input area (1310) The composite human interface device 1321 has a substantially rectangular parallelepiped shape and does not have an inclination when placed on the ground or when the multipurpose cover is mounted at the bottom. Designed to be smaller, it can maximize aesthetic effect and increase portability.

On the other hand, when the multi-purpose cover is folded and mounted under several composite human interface devices, it can be tilted like a normal keyboard.

The multi-purpose cover may be configured to be detachable, but may be designed in such a way that the hinge is returned from the top to the bottom of the composite human interface device by folding.

14 is an embodiment of a human interface device applied to a portable electronic device such as a portable electronic device or a tablet personal computer.

The complex human interface device 1420 may be used as an input device for a portable electronic device.

A portable electronic device having a composite human interface device has a structure in which a display unit composed of a display panel 1411 and a frame 1410 supporting the display panel is bound and covered and opened by the composite human interface device and the hinge 1427. Can be designed.

At this time, the display unit is inserted into a substantially hexahedral space formed by the text input area of the human interface device and the reflector or absorber plate 1424. Then, the thickness of the portable electronic device using the human interface device can be minimized.

To this end, the display unit of the portable electronic device must be designed to have a width smaller than the width of the human interface device 1420 by at least twice the thickness of the reflector or absorber plates 1423 and 1424.

In other words, it should be designed so that the display unit can be placed in place of the multipurpose cover in FIG. 13.

The display unit has a feature 1413 that allows both edges to be rounded or diagonally cut.

When the display unit is folded, the pointer location information input devices 1421 and 1422 may be positioned toward the outer edge of the rounded or diagonally cut portion.

This is to fold the portable electronic device so that it can be kept thin without being disturbed by the pointer position information input devices 1421 and 1422.

At this time, the mode switching unit and the pointer execution command unit are located outside the side text input area of the human interface device as described above, the mode switching unit is outside the text input area, and the pointer execution command unit is at least one of the text input buttons, or the mode switching. Both the negative and pointer command execution units may operate as at least one of the text input buttons.

In addition, it may be more preferably located below the outside of the text input area (1425, 1426).

At this time, the mode switching unit and the pointer execution command unit are preferably integrally formed as shown in FIG. 12, but may be separately separated.

At this time, when the mode switching unit or the pointer execution command unit is located outside the text input area, when the user places a finger to control the mode switching unit or the pointer execution command unit, the pointer location information input devices 1421 and 1422 The pointer location information input area should be set except the area where the mode switching unit or the pointer execution command unit is located so that the user does not malfunction by inputting the location information of the pointer.

To this end, the optical signal generated from the pointer position information input device may be adjusted to prevent the optical signal from reaching the mode switching unit or the pointer execution command unit.

Alternatively, the optical signal reception angle of the camera may be adjusted or received in a corresponding direction so that the camera does not receive an optical signal generated by reflection, interference, or blocking between the user's finger and the optical signal located in the mode switching unit or the pointer execution command unit. The optical signal can be ignored.

The portable electronic device is designed to have at least three corner portions of an absorbing plate or a reflecting plate for absorbing or reflecting a light source generated by the pointer position information input device.

At this time, the two surfaces are located on the side of the human interface device (1423, 1424) and the other surface is the pointer position information input device (1421) when the display unit is open within a predetermined angle on the surface where the display unit is in contact with the human interface device. The reflector or absorber may be positioned in a constant region 1412 of the edge of the display unit so that the light source generated by the 1422 is sufficiently reflected or absorbed.

In FIG. 14, the display unit may be configured as a flexible display unit. The display unit may be curved to cover the text input area of the complex human interface device and be wound around the bottom surface of the complex human interface device.

In addition, in FIG. 14, the display unit may be replaced with the multipurpose cover described in FIG. 13, and the absorber or reflector may be positioned at a corner portion of the multipurpose cover bonded to the composite human interface device, and flipped to the rear by a hinge to allow the composite human It can also be used to adjust the height of the interface device.

FIG. 15 illustrates an embodiment in which a lower position type pointer position information input device and a lower position type pointer execution command unit are applied.

The human interface device may include a text input unit 1501 including a plurality of physical buttons, a pointer location information input unit for receiving information regarding a pointer position from a user, and a pointer for receiving a user's command to perform at least one function at a location of the pointer. A pointer execution command receiving unit for receiving signals from the execution command units 1505 and 1506, a mode switching command receiving unit for receiving a signal of a mode switching unit for switching to a pointer position information input mode, and a pointer position input to the pointer position information input unit A pointer location information transmitter for transmitting information to a digital device connected to the human interface device in a wired or wireless manner, and the pointer location information input area of the pointer location information input unit is at least a portion of a text input area of the text input unit including the plurality of physical buttons. Of An optical signal reflector or absorber 1503a, 1503b, or 1503c positioned parallel to the upper end and having the pointer location information input unit formed higher than the height of the text input unit on first to third surfaces 1502a, 1502b, and 1502c surrounding the text input unit; And a fourth surface 1502d surrounding the text input unit is lower than the height of the first to third surfaces, and the fourth surface may include the pointer execution command units 1505 and 1506. have.

The first surface and the third surface may be located on the left and right sides of the text input unit, respectively, and the second surface may be located above the text input unit, and the fourth surface may be positioned below the text input unit.

The pointer location information input unit may include at least two sensor modules, and each of the two sensor modules may be located at a lower left corner and a lower right corner of the text input unit, respectively. The mode switching unit may be operated by a first input of a user input to a first button, and the pointer execution command receiving unit may be operated by a second input of a user input to the first button.

The first button may be made of a material capable of sensing an electrical signal generated by a finger touch, and the first input may be generated by recognizing the electrical signal.

The pointer position information input mode may be operated while the first input is maintained, and when the first input is released, the pointer position information input mode may be released and the first input may be generated by physical pressure.

The mode switching unit may be operated by a second input of a user input to a second button. When the second input is input once, the mode switching unit is activated when the pointer location information input mode is released and the pointer location information input mode is activated. If it is activated, it can be released.

1 to 15 illustrate an example of a composite human interface device to be described by the present invention, and each embodiment is not limited to the technology described in each embodiment, and the technical features described in the above-described embodiments are different from those described above. Applicable to In addition, the type of the text input device pointing location information input device and the technology used include those that can be changed or replaced by those skilled in the art without changing the basic purpose.

As described above, in the best mode for carrying out the invention, related matters have been described.

As described above, the present invention can be applied in whole or in part to a composite human interface device having a text input device and a pointer position information input device.

Claims (17)

In the human interface device, A text input unit consisting of a plurality of physical buttons, Pointer location information input unit for receiving information related to the pointer location from the user, Pointer execution command receiving unit for receiving a user's command to perform at least one function where the pointer is located, A first mode switching unit for switching to and off the pointer location information input mode, A pointer location information transmitter for transmitting information related to the pointer location input to the pointer location information input unit to a digital device connected to the human interface device by wire or wirelessly; The pointer location information input area of the pointer location information input part is positioned to be parallel to an upper end of at least a portion of the text input area of the text input part consisting of the plurality of physical buttons, and the first mode switching part is configured to control the user's input to the first button. And a pointer execution command receiving unit operated by a first input and operated by a second input of a user input to the first button. The human interface device of claim 1, wherein the pointer location information input unit comprises an optical emitter and a camera, and the optical signal received by the camera passes through a light tunnel. The human interface device of claim 1, wherein the first mode switch is provided in an area separate from the text input area of the text input device. 2. The apparatus of claim 1, wherein the first mode switch is located outside the left side of the text input area of the text input device and recognizes that a user input is received in the first mode switch. A human interface device, characterized by transmitting to a mode switch command receiver. The method of claim 1, wherein the physical button is composed of a human body characterized in that the upper part of the button receiving the pressure from the user's finger and the elastic body for applying a physical force to return the upper part of the button when the user's finger pressure is removed Interface device. The apparatus of claim 1, wherein the human interface device includes a reflector or an absorber that reflects a light source generated by the pointer location information input unit at left, right side, and upper side of the text input area, and does not include at least a portion thereof at a lower side thereof. A human interface device, characterized in that. The human interface device of claim 1, wherein at least two sensor modules of the pointer location information input unit are positioned to include at least a portion of a left outer region and a lower end of the right outer region of the text input region. The human interface device of claim 1, wherein at least two sensor modules of the pointer location information input unit are located at a lower outer area of the text input area than a width of the text input area. The method of claim 1, wherein the first input of the user is operated by a switch for recognizing a user's touch or a switch operated by a pressure less than the pressure for inputting the pointer execution command or by a light obscured by the user's hand. A human interface device, characterized in that the switch. The human interface device of claim 1, wherein the first mode switching unit operates in a pointer location information input mode while a user input is maintained, and releases the pointer location information input mode when the user input is released. . The human interface device of claim 1, further comprising a second mode switching unit configured to dynamically change the pointer location information input mode from operation to release or from release to the input whenever a user input is received once. 12. The human interface of claim 11, wherein the pointer position information input mode is canceled when an input is received from the first mode switch and then released during operation in the pointer position information input mode by the second mode switch. Device. 12. The human interface device of claim 11, wherein the pointer location information input mode is released when a text input is received during operation in the pointer location information input mode by the second mode switching unit. The text input mode of claim 13, wherein the text input mode is ignored when the text input is received during operation in the pointer position information input mode by the second mode switching unit, and when at least two text inputs are received. Human interface device, characterized in that switching to. 15. The apparatus of claim 13, wherein when the at least two text inputs are received and the user enters the text input mode, the composite human interface device transmits the text input of the user including the ignored at least first text to the digital device and subsequently inputs the text. A human interface device for transmitting input information to a digital device. The human interface device of claim 11, wherein the second mode is switched by a user third input input to the second button and a pointer execution command is received by the user fourth input input to the second button. . Receiving a text input of a user from a text input unit including a plurality of physical buttons, A pointer location information input step of receiving information related to a pointer location from a user through a pointer location information input unit, A pointer execution command receiving step of receiving a signal of a pointer execution command unit that receives a user's command to perform at least one function where a pointer is located, A mode switching command receiving step of receiving a signal of a mode switching unit for switching to a pointer location information input mode; Transmitting power to the pointer location information input unit, the pointer execution command receiving unit, and the mode switching command receiving unit; And a pointer location information transmitting step of transmitting information related to the pointer location input to the pointer location information input unit to a digital device connected to the human interface device by wire or wirelessly. The pointer location information input area of the pointer location information input part is positioned to be parallel to an upper end of at least a portion of the text input area of the text input part consisting of the plurality of physical buttons, and the mode change command receiving part of the user inputted to the first button. And a pointer execution command receiving unit operated by a first input and operated by a second input of a user inputted to the first button.

Images