CN106406563A - Character inputting method and apparatus in VR environment - Google Patents
Character inputting method and apparatus in VR environment Download PDFInfo
- Publication number
- CN106406563A CN106406563A CN201610819404.2A CN201610819404A CN106406563A CN 106406563 A CN106406563 A CN 106406563A CN 201610819404 A CN201610819404 A CN 201610819404A CN 106406563 A CN106406563 A CN 106406563A
- Authority
- CN
- China
- Prior art keywords
- keyboard
- physical keyboard
- environment
- camera
- physical
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
- G06F3/023—Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
- G06F3/0233—Character input methods
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
- G06F3/0202—Constructional details or processes of manufacture of the input device
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
- G06F3/0202—Constructional details or processes of manufacture of the input device
- G06F3/0219—Special purpose keyboards
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0489—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using dedicated keyboard keys or combinations thereof
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Input From Keyboards Or The Like (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention proposes a character input method and apparatus in the VR environment. The method comprises that a physical keyboard and a human finger on the physical keyboard are collected by using a camera, and the physical keyboard and the human finger are projected into the 3D environment so as to form a virtual keyboard and a virtual finger; and a user adjusts the position of the human finger relative to the physical keyboard in the real environment by looking at the position of the virtual finger on the virtual keyboard, and inputs corresponding character information through the physical keyboard.
Description
Technical field
The present invention relates to character input method and device under VR field, more particularly, to VR environment.
Background technology
VR is the english abbreviation of Virtual Reality, and Chinese means virtual reality.Under 3D immersive environment, user
The keyboard in reality cannot be checked, thus under VR environment, the input realizing word is extremely difficult.Solution of the prior art
Certainly scheme has：
(1) patent publication No. is the patent of CN105892928A, discloses the dummy keyboard under a kind of 3D immersive environment
And its method for designing, its dummy keyboard, it is heavy that this dummy keyboard can coordinate the input mode interactive mode of eyeball tracking to realize 3D
Input through keyboard under immersion environment.
(2) patent for CN200410055241 for the patent publication No. discloses a kind of three-dimensional input equipment and method, soft key
Mapping method and the dummy keyboard using soft key mapping method construction, using the three-dimensional input equipment bag of dummy keyboard input information
Include：Sensing device, including multiple sensors corresponding with finger, this sensing device senses clicks on the hand of the button of dummy keyboard
The motion referring to；Signal processing unit, for the position to detect each sensor for the signal that processes from sensing device output and carry
Take the information with regard to finger motion；Hand position and finger order determining unit, for from the information extracted by signal processing unit
In, determine and click on button with which finger is used to click on button；Key information memory cell, is mapped to regard to a plurality of for storage
The each key information of button and information by the key assignments clicking on the described finger order mapping clicking on button；With key determining unit,
For find corresponding at the hand position in key information memory cell and finger order determining unit determine information key assignments simultaneously
Export this key assignments.
Said method is although the word being capable of under 3D environment inputs, but is inputted using dummy keyboard mode, due to
During input, finger does not carry force feedback, and Consumer's Experience effect is poor；Secondly, above-mentioned process of realizing is more complicated, and precision is not high.
Content of the invention
For solving above technical problem, the present invention proposes character input method and device under a kind of VR environment, make use of
Conventional physical input through keyboard, by additional camera, shoots the state of physical keyboard, its image is mapped in virtual monitor
Suitable position is so that user can intuitively see the state of its hand and keyboard so that in virtual environment under virtual environment
Under, writing efficiency, close to the efficiency in actual environment, improves the efficiency of typewriting, and Experience Degree is high.
The present invention be employed technical scheme comprise that by its technical problem of solution,
Character input method under a kind of VR environment, gathers physical keyboard and the human body being located on physical keyboard by camera
Finger, is projected in 3D environment, forms dummy keyboard and virtual finger；User is by checking virtual finger in virtual key
Position on disk, adjusts human finger in actual environment relative to the position of physical keyboard and corresponding by physical keyboard input
Word message.
During use, because physical keyboard has been mapped completely in 3d space, form a dummy keyboard, solve 3D and immerse
Under formula environment, user cannot check the problem of the keyboard in reality, and user only needs to by checking virtual finger in virtual key
Position on disk, and then adjusting in actual environment human finger relative to the position of physical keyboard, and inputted by physical keyboard
Corresponding Word message.
Can completely correspond between above-mentioned dummy keyboard and physical keyboard, will the Word message on keyboard all give birth to
Become on dummy keyboard.
Can also be not quite identical between above-mentioned dummy keyboard and physical keyboard, in this case, dummy keyboard should be extremely
Include all Word messages on physical keyboard less, and also include some other supplementary textual information, how ratio is with regard to making
Introduction with keyboard etc..
Preferably, physical keyboard is provided with wearable design, physical keyboard can be followed the motion of human hands and be moved.
Such design, range of application in 3D environment for the expansible keyboard.
Preferably, described camera is 1 or more than 1.Multiple camera settings, can increase IMAQ effect, will
Dummy keyboard is preferably presented in 3D environment.
Preferably, described camera annex is provided with light source.The setting of light source, can improve the IMAQ effect of camera
Really, especially when finger is placed on keyboard, partial optical presence is blocked, and leads to gather the problem of not fogging Chu.
Present invention also offers input device under a kind of VR environment, including physical keyboard with the upside of physical keyboard
Camera, and be located at 3D environment in dummy keyboard；Described dummy keyboard shoots physical keyboard in 3D ring by camera
Formed in border, user adjusts, by dummy keyboard, the position that human finger is relative to physical keyboard, and is inputted by physical keyboard
Word message.
Preferably, described camera is 1 or more than 1.
Preferably, it is provided with auxiliary lampet below described camera.
Preferably, described physical keyboard is arranged connecting post, described camera, auxiliary lampet are according in connecting post.Even
Connect and can adopt detachable connection between post and physical keyboard, a hole or groove are such as opened on connecting post, and will connect
Post insertion is fixed.Can also achieve a fixed connection between connecting post and physical keyboard, now, can carry out between connecting post and keyboard
0-180 degree rotates.
Preferably, described physical keyboard is provided with wearable device.
Preferably, wearable device is wrist strap.Wrist strap adopts the fixed elastic webbing can also be using being combined with VELCRO
Mode realizes the fixation of wrist.
It is an advantage of the current invention that input device structure is simple, when using, because physical keyboard has been mapped completely to
In 3d space, form a dummy keyboard, solve under 3D immersive environment, user cannot check the problem of the keyboard in reality,
User only needs to by checking virtual finger position on the virtual keyboard, and then adjusting human finger phase in actual environment
Position to physical keyboard, and corresponding Word message is inputted by physical keyboard.Because being inputted using physical keyboard mode, input
When carry force feedback, input efficiency is high, and user experience is high.
Brief description
Fig. 1 is the structural representation of the embodiment of the present invention 1.
Fig. 2 is the structural representation of physical keyboard in the embodiment of the present invention 2.
Specific embodiment
In order that technological means, creation characteristic, reached purpose and effect that the present invention realizes are easy to understand, tie below
Close diagram and specific embodiment, the present invention is expanded on further.
Embodiment 1
As shown in figure 1, input device under VR environment, the connecting post 2 including keyboard 1 with positioned at keyboard side, connect
Camera 3, auxiliary lampet 4 are provided with post 2, wherein auxiliary lampet 4 is located at below camera.
Input device also includes the dummy keyboard 6 in 3D environment；Described dummy keyboard is shot by camera
Physical keyboard is formed in 3D environment, and user adjusts, by dummy keyboard, the position that human finger is relative to physical keyboard, and leads to
Cross physical keyboard inputting word information.
Connecting post and keyboard are detachable design, such as by way of setting groove on keyboard 1, connecting post are inserted
Enter.
During use, open lampet, camera, physical keyboard and the human body hand being located on physical keyboard are gathered by camera
Refer to, and keyboard is projected to formation dummy keyboard and virtual finger in 3D environment, user is by checking virtual finger virtual
Position on keyboard, adjusts position on physical keyboard for the human finger in actual environment, and corresponding by physical keyboard input
Word message.
Embodiment 2
The difference of embodiment 2 and embodiment 1 is, keyboard 1 is provided with a pair of wrist strap 5, by by the hand of user
Stretch into wrist strap 5, keyboard be fixed in the wrist of user, by using the motion of person's hand, drive the motion of keyboard so that
Keyboard can change position with the motion of user, can expand range of application in 3D application for the keyboard.
In the present embodiment, wrist strap 5 is elastic wristband.
General principle, principal character and the advantages of the present invention of the present invention have been shown and described above.The technology of the industry
, it should be appreciated that the present invention is not restricted to the described embodiments, the simply explanation described in above-described embodiment and specification is originally for personnel
Invention principle, without departing from the spirit and scope of the present invention the present invention also have various changes and modifications, these change
Change and improvement both falls within scope of the claimed invention.
Claims (10)
1. under a kind of VR environment character input method it is characterised in that by camera gather physical keyboard and be located at secondary or physical bond
Human finger on disk, maps that in 3D environment, forms dummy keyboard and virtual finger；User is by checking virtual hand
Refer to position on the virtual keyboard, adjust the position of human finger physical keyboard relatively in actual environment, and by physical keyboard
Input corresponding Word message.
2. character input method according to claim 1 is it is characterised in that be provided with wearable design on physical keyboard,
Physical keyboard can be followed the motion of human hands and be moved.
3. character input method according to claim 1 is it is characterised in that described camera is 1 or more than 1.
4. character input method according to claim 1 is it is characterised in that described camera annex is provided with light source.
5. input device, it is characterised in that including physical keyboard and being located at camera on the upside of physical keyboard, and is located at
Dummy keyboard in 3D environment；Described dummy keyboard shoots physical keyboard by camera and is formed in 3D environment, and user is led to
Cross dummy keyboard and adjust the position that human finger is relative to physical keyboard, and pass through physical keyboard inputting word information.
6. device according to claim 5 is it is characterised in that described camera is 1 or more than 1.
7. device according to claim 6 is it is characterised in that be provided with auxiliary lampet below described camera.
8. device according to claim 6 it is characterised in that on described physical keyboard arrange connecting post, described camera,
Auxiliary lampet is according in connecting post.
9. device according to claim 1 is it is characterised in that be provided with wearable device on described physical keyboard.
10. device according to claim 1 is it is characterised in that wearable device is wrist strap.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610819404.2A CN106406563A (en) | 2016-08-31 | 2016-08-31 | Character inputting method and apparatus in VR environment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610819404.2A CN106406563A (en) | 2016-08-31 | 2016-08-31 | Character inputting method and apparatus in VR environment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106406563A true CN106406563A (en) | 2017-02-15 |
Family
ID=57999710
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610819404.2A Pending CN106406563A (en) | 2016-08-31 | 2016-08-31 | Character inputting method and apparatus in VR environment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106406563A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107368179A (en) * | 2017-06-12 | 2017-11-21 | 广东网金控股股份有限公司 | The input method and device of a kind of virtual reality system |
| CN111984116A (en) * | 2020-07-31 | 2020-11-24 | 成都易瞳科技有限公司 | VR perception touch device |
| TWI840926B (en) * | 2022-08-25 | 2024-05-01 | 廣達電腦股份有限公司 | Computer device and method for displaying augmented reality virtual keyboard |
| US12210671B2 (en) | 2022-01-17 | 2025-01-28 | Samsung Electronics Co., Ltd. | Electronic apparatus and controlling method thereof using first external device and second external device |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6388657B1 (en) * | 1997-12-31 | 2002-05-14 | Anthony James Francis Natoli | Virtual reality keyboard system and method |
| US6611253B1 (en) * | 2000-09-19 | 2003-08-26 | Harel Cohen | Virtual input environment |
| CN102905182A (en) * | 2011-07-26 | 2013-01-30 | 联想(北京)有限公司 | Input method, intelligent television and intelligent interaction system |
| US20140035819A1 (en) * | 2012-08-03 | 2014-02-06 | Research In Motion Limited | Method and Apparatus Pertaining to an Augmented-Reality Keyboard |
-
2016
- 2016-08-31 CN CN201610819404.2A patent/CN106406563A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6388657B1 (en) * | 1997-12-31 | 2002-05-14 | Anthony James Francis Natoli | Virtual reality keyboard system and method |
| US6611253B1 (en) * | 2000-09-19 | 2003-08-26 | Harel Cohen | Virtual input environment |
| CN102905182A (en) * | 2011-07-26 | 2013-01-30 | 联想(北京)有限公司 | Input method, intelligent television and intelligent interaction system |
| US20140035819A1 (en) * | 2012-08-03 | 2014-02-06 | Research In Motion Limited | Method and Apparatus Pertaining to an Augmented-Reality Keyboard |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107368179A (en) * | 2017-06-12 | 2017-11-21 | 广东网金控股股份有限公司 | The input method and device of a kind of virtual reality system |
| CN111984116A (en) * | 2020-07-31 | 2020-11-24 | 成都易瞳科技有限公司 | VR perception touch device |
| US12210671B2 (en) | 2022-01-17 | 2025-01-28 | Samsung Electronics Co., Ltd. | Electronic apparatus and controlling method thereof using first external device and second external device |
| TWI840926B (en) * | 2022-08-25 | 2024-05-01 | 廣達電腦股份有限公司 | Computer device and method for displaying augmented reality virtual keyboard |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10571263B2 (en) | User and object interaction with an augmented reality scenario | |
| CN114127669B (en) | Method, apparatus and computer readable storage medium for trackability enhancement of passive stylus | |
| JP7130057B2 (en) | Hand Keypoint Recognition Model Training Method and Device, Hand Keypoint Recognition Method and Device, and Computer Program | |
| Shao et al. | Teaching american sign language in mixed reality | |
| CN117120962A (en) | Bimanual interaction between mapped hand areas for controlling virtual and graphical elements | |
| US10825248B2 (en) | Eye tracking systems and method for augmented or virtual reality | |
| CN104778746B (en) | A kind of method for carrying out accurate three-dimensional modeling using natural gesture based on data glove | |
| US12260024B2 (en) | Interaction method, electronic device, and interaction system | |
| CN104035557B (en) | Kinect action identification method based on joint activeness | |
| US10741175B2 (en) | Systems and methods for natural language understanding using sensor input | |
| CN106406563A (en) | Character inputting method and apparatus in VR environment | |
| CN117597743A (en) | Virtual guided fitness routines for augmented reality experiences | |
| Chen et al. | Lisee: A headphone that provides all-day assistance for blind and low-vision users to reach surrounding objects | |
| CN104679222B (en) | Medical office system, medical information sharing system and method based on man-machine interaction | |
| CN105068657A (en) | Gesture identification method and device | |
| Gupta et al. | Training in virtual environments: A safe, cost effective, and engaging approach to training | |
| CN120359547A (en) | Generation and rendering of extended view geometry in video perspective (VST) Augmented Reality (AR) systems | |
| CN109171604A (en) | A kind of intelligent endoscope operating system having AR function | |
| CN103810399A (en) | Sandplay evaluation system | |
| TW201619754A (en) | Medical image object-oriented interface auxiliary explanation control system and method thereof | |
| CN205451550U (en) | Body feeling education system | |
| CN105957000A (en) | Equipment and method used for realizing virtual display of artwork | |
| Peng et al. | A review of gesture interaction technology based on virtual reality | |
| TW202422385A (en) | Method for recognizing object assemblies in augmented reality images | |
| Henshall et al. | Towards a high fidelity simulation of the kidney biopsy procedure |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170215 |