[go: up one dir, main page]

CN1378171A - Computer input system - Google Patents

Computer input system Download PDF

Info

Publication number
CN1378171A
CN1378171A CN 02117354 CN02117354A CN1378171A CN 1378171 A CN1378171 A CN 1378171A CN 02117354 CN02117354 CN 02117354 CN 02117354 A CN02117354 A CN 02117354A CN 1378171 A CN1378171 A CN 1378171A
Authority
CN
China
Prior art keywords
hand
information
computer
assigned object
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN 02117354
Other languages
Chinese (zh)
Inventor
许旻
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN 02117354 priority Critical patent/CN1378171A/en
Publication of CN1378171A publication Critical patent/CN1378171A/en
Priority to CN 03131101 priority patent/CN1462929A/en
Priority to CNA031361447A priority patent/CN1489022A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • User Interface Of Digital Computer (AREA)
  • Position Input By Displaying (AREA)

Abstract

The computer input system consists of two parts of image inducing device and inducing information characteristic extracting device, the former is used to obtain the spatial state of hands and the latter is used to extract the characteristic information of spatial hand state and input the information into computer. The computer produces computer operating command according to the input characteristic information while displaying the spatial state of hands. Via the said system, the operator of the computer can feel the spatial state and position of his hands for interactive man-computer intercourse. The present invention has the functions of five commonly used input equipments, and can be used to input pictograph and hand-drawn figure.

Description

A kind of computer input
The present invention is a kind of computer input, is the computer input that substitutes input equipments commonly used such as keyboard, mouse, touch pad, clipboard and touch-screen.
Common computer entry devices such as keyboard, mouse, handwriting pad, touch pad and touch-screen have become the standard peripherals of computing machine mostly, even they have deficiency separately, people also have to accept the many disadvantages of these equipment in appliance computer.Sum up the characteristic of these computer input devices commonly used, be not difficult to know that they have following defective:
Keyboard: its needs and mouse is used in combination, and can not fast cursor be moved on to optional position on the screen by keyboard, also very difficultly carries out graphic operation with keyboard.Usually can only input alphabet and numeric character, and other several function keys.The keyboard that comes from the west helps the input of alphabetic writing letter, and fundamentally there is very big obstacle in so hieroglyphic input for Chinese character.Existing multiple input method by Chinese characters for keyboard inputting on the one hand because of multikey operating influence input efficiency, needs to memorize mechanically the part input rule on the other hand.Because do not see complete Chinese character symbol on the keyboard, making that these input methods use can not intuitive and convenient, attempts to import pictograph and figure has inborn deficiency by keyboard.
Mouse: mouse moving is linear continual moving.If mouse on the screen is moved to target from a bit, need the user to keep in touch with mouse all the time during this period, not only taken the more time of user, needed the user to keep notice simultaneously, limited the freedom of motion and the use-pattern of hand mouse.
Touch pad: the function of existing touch pad is to replace traditional tumbling-type mouse, point-like or column mouse to work, it also have aforementioned conventional mouse moving poor efficiency, restriction user hand exercise freedom, the more user's of expending notice etc. defective.In addition, it has only gathered few information of user's hand, can not understand the multiple action of user's hand.
Handwriting pad: do not possess agility and the intuitive of keyboard when input regulation symbol, letter, numeral, purposes is single.Handwriting pad can only be accepted single-point information, and once input is a single point or single line bar on the plane, and does not reflect the information of touching the discontinuous a plurality of positions above it simultaneously.The user's who receives or reflect quantity of information is few, and the bulk information of user's hand does not obtain utilizing, and man-machine communication's level is restricted.
Touch-screen: when the user used the finger point on touch-screen, hand can block touch-screen, and many people watch the content on the touch-screen to be restricted simultaneously.Give directions on touch-screen, the user must at first lift upper arm, lifts arm for a long time and also can cause fatigue.These limitations make it can only often be placed in minority places such as hall and use as assistant service equipment.
The publication information of relevant calculation machine input system:
The CN1291316A patent of invention has been announced a kind of image detection operator input device, just detects the situation of the default graphic change of a certain apparatus surface, and just based on the moving of input media, can only obtain relative displacement information.The particularly important is, it is not hinted obliquely at the form (or image) of user's hand (or assigned object) to computer display screens and goes to allow the user understand the form or the position of the hand (or assigned object) of oneself at any time.
CN1322982A patent of invention bulletin (belonging to an application for a patent for invention people together with the present invention) has been announced a kind of inductor induction hand information, by induction information disposal system information extraction feature and according to this characteristic information as the instruction of computer operation.But the undeclared user's hand of this patent (or assigned object) information of form in three dimensions is obtained and is utilized.The present invention is utilizing user's hand (or assigned object) to do to improve and replenish at three-dimensional message context.
Design philosophy of the present invention:
The present invention extracts its characteristic information and characteristic information is sent to computer system processor formation computer-managed instruction by collecting computer operator's the hand (and finger) or the spatial shape information of computer operation person's assigned object.Computing machine with the spatial shape information (or image) of operator's hand (and finger) (or assigned object) on computer display, show make the operator experience oneself hand or assigned object in the position in space, the characteristic information of simultaneous computer execution analysis operator hand (or assigned object) and form computer-managed instruction.
Technical scheme of the present invention:
Fig. 1 show sell (or assigned object), image sensing apparatus and induction information feature deriving means, and the space relativeness between the computer display, wherein the actual induction surface of effective display surface on the computer display and image sensing apparatus is the corresponding relation that is in proportion.The object that is used for appointment for other the computer operation persons except that hand (abbreviates as in the literary composition: assigned object.For example: lip pencil thing, the substitute of small wooden or other alternative finger functions etc.) can do same the processing, obtain same result with hand.
Among Fig. 1, the spatial movement of hand (or assigned object) (1) is caught by image sensing apparatus (2), extract by the characteristic information of image information feature extraction element (8) the spatial shape of hand (or assigned object), pass to Computer Processing (if adopting Wireless transmission mode not influence enforcement of the present invention) through transmission line (9), and as the input of the information of vectoring computer operation, promptly as the input of the peripheral operation instruction of computer operation.
Behind the characteristic information of intact these spatial shape of Computer Processing, form computer-managed instruction, go up at the screen (6) of graphoscope simultaneously and show the sell mapped graphics (4) of (or assigned object) and the mapped graphics (5) of the track (3) that hand (1) (or assigned object) is streaked on the surface of image sensing apparatus (2), this mapped graphics is the directly perceived reflection of spatial shape on computer screen of hand (or assigned object), allows computer operation person can experience the spatial shape and the position of (or assigned object) in one's hands in good time.The mode of traditional dependence mouse and keyboard and other existing input equipments is changed in this information input operation to computing machine, make the man-machine communication under interactive state, carry out fully, friendly interface, amount of information exchange are big and quick, can realize all functions of existing input equipment, and carry out direct figure, image input easily, hieroglyphic input is also convenient and quick.
The characteristic information of the spatial shape of hand among Fig. 1 (or assigned object) comprises locus, moving direction and the speed of whole hand (comprising each finger) (or assigned object).If hand (or assigned object) contacts with the surface of image sensing apparatus (2), time of the lip-deep contact pressure size of image sensing apparatus (2), displacement and velocity information (other information, as finger print information, infrared, sound wave, electric capacity, magnetic information etc.) also be the part of characteristic information of the spatial shape of hand.
Among Fig. 1, the motion of hand (1) (or assigned object) is the arbitrary motion in space and moves, knocks, stops the lip-deep of image sensing apparatus (2), above-mentionedly moves, knocks, stops the translation that comprised each autokinesis respectively and rotation, single-point and multiple spot, fast and at a slow speed and movement characteristic such as stop.
Among Fig. 1, hand (1) (or assigned object) is in spatial movement, the track that streaks on the surface of image sensing apparatus (2) (3), the corresponding position on the screen (6) of graphoscope can demonstrate pairing visual mapped graphics (4) and (5) of corresponding hand (1) (or assigned object) and track (3).Being corresponding relation in logic between this mapped graphics and the original, is not the correspondent equal one by one of the size on the three-dimensional, but can become certain proportionate relationship on the size, and the position becomes corresponding relation with direction of motion.
By the computer system of Fig. 1, many quiet, the multidate information of hand (or assigned object) have passed through visualization processing, and computer operation person only by the simple gesture and the specific action of hand (or assigned object), can finish the operation to computing machine.The incident that the spatial shape of hand (or assigned object) can be experienced as computer control instruction and computing machine after by visualization processing takes place, realize the function of mouse, touch pad, touch-screen and handwriting pad, also can realize keypad function by visual keyboard technique (such as by the soft keyboard operation on the computer screen).
The existing equipment and the technology obtained with the processing of image information of image information have many kinds, much can be applied to the present invention.The imaging components and parts that are used for visible light commonly used have CCD picture pick-up device, MOS array picture pick-up device, pick-up tube, and other electrooptical devices such as variable sensitivity photoelectricity testing part (VSPD) and some photoelectric functional ultrathin membranes etc.
The device of similar touch-screen can be adopted in the surface of image sensing apparatus (sensitive surface).Like this, image sensing apparatus not only can acquisition operations person's hand or assigned object at three-dimensional aspect graph picture, and can gather its induction information (pressure, heat, electricity and magnetic signal, acoustic signals etc.) on sensitive surface.
Computer operating system: working environment requirement of the present invention, except can moving on the MicrosoftWindows operating system platform, also can move under (SuSE) Linux OS.The different device drivers that just will develop at the individual operation system.
The selection of computer interface: no matter the selection of computer interface is USB interface, serial ports, parallel port or pci interface also without limits, all is feasible.The technology barrier that interface is selected does not exist.
The realization of mouse function: owing to the form (image) of user's hand (or assigned object) can be hinted obliquely on the computer display, the user only need see that display screen just knows the position of own hand.When went up on the surface (label is 2 part among Fig. 1) that hand (or assigned object) touches image sensing apparatus, computing machine just according to the setting that designs, took a decision as to whether and presses action.Certainly, can set too click, the recognition mode of a series of hand motions such as double-click, left click, right click.Fig. 4 explanation directly perceived is when hand during image sensing apparatus surperficial, and its form is hinted obliquely at the image on the computer screen.
Enabling of the soft keyboard of mobilism: Fig. 4 is same to illustrate in the present invention how soft keyboard works.When the user knocked on the surface of image sensing apparatus, he was hand (or assigned object) the knocking on soft keyboard of oneself what see on the screen at any time.The design of soft keyboard is decided by needs and convenience.We so far can accomplish the mobilism and abundantization of keyboard.Therefore all functions of conventional keyboard have realized easily.
The realization of touch pad and tablet function: because the shape information of superincumbent touch information of user's hand (or assigned object) and hand can be read in the surface of image sensing apparatus, by the processing of software to these touch informations, the present invention has also just realized the existing capability of touch pad naturally again.
The realization of touch screen function: because the present invention can hint obliquely at the image of user's hand (or assigned object) on the computer display, the position of image on screen of hand just can be adjusted in the position of the hand of nature user by moving oneself, the image of hand is on display screen thereby played the effect of indicating, and touch screen functionality has just realized.
The selection of input method: all kinds of existing input methods, after having adopted input system of the present invention, can continue to use in theory.Do some change as long as will have the interface of all kinds of input methods on display screen now, be beneficial to the operation of hand such as the area that increases soft keyboard, increase the options prompt window to improve efficiency of selection and handled easily, the design of enriching soft keyboard makes the user that more selection selection etc. be arranged, like this after having adopted the present invention, the efficient that existing all kinds of input methods not only can continue to use but also can use can be higher, and using also can be more convenient.
In a word, the present invention by collecting computer user hand (or assigned object) at the shape information in space with at the touch information on image sensing apparatus surface, the form (image) of user's hand (or assigned object) is hinted obliquely on the display screen, and form by software design adversary (or assigned object) and action are analyzed to computing machine and are sent operational order, be used in combination the soft keyboard on the screen, just realized traditional keyboard, mouse, clipboard, touch pad and touch screen functionality fully.
About user's hand (or assigned object) in the information of spatial shape and the processing of the characteristic information that therefrom extracts, these relate to the technology of writing and the image data processing technique of computer peripheral equipment driver commonly used, these computer software technologies all are open and ripe, repeat no more here.
Description of drawings:
Fig. 1: the image detection computer input unit systematic schematic diagram of hand (or assigned object);
1-hand (or assigned object);
2-image sensing apparatus;
The track that 3-hand (or assigned object) streaks;
The figure mapping of 4-hand (or assigned object);
The figure mapping of the track that 5-hand (or assigned object) streaks;
6-computer display screens;
7-main frame;
8-image information feature extraction element;
9-transmission line
Fig. 2: image detection information acquisition and transmission system structural representation that band DSP realizes;
Fig. 3: image detection information acquisition and the transmission system structural representation of realizing with DSP not;
Fig. 4: the user uses the display interface synoptic diagram when of the present invention.
Embodiment:
As the example of an illustration, adopt the sensor of CCD (charge-coupled image sensor-ChargedCoupled Device) camera as image information acquisition.Fig. 2 has provided hand shape image information acquisition and the transmission system that CCD camera, A/D converter, dsp processor, computer interface, main frame, the graphoscope be made up of optical lens and ccd image sensor are formed.In this system, the spatial shape of hand converts the analog quantity of picture signal to by the CCD camera, is transformed into digital signal through A/D converter, sends into digital signal processor DSP and carries out signal Processing and Flame Image Process.DSP handles the characteristic information of the spatial shape of back output hand, and computing machine is further handled this characteristic information, demonstrates corresponding mapped graphics on the screen of graphoscope, and read characteristics information produces the corresponding calculated machine operation.In this course, the displacement of hand, moving direction, moving speed are after dsp processor is handled, can in time pass to the part of computing machine as characteristic information, the knocking specific actions such as (click, double-click, multi-hit) and also can produce corresponding characteristic information and import computing machine into of finger, computing machine is operated according to the characteristic information that these are obtained by Flame Image Process.
As the example of an illustration, can also adopt infrared CCD camera device, the generation and the processing procedure of its image information are the same.
In order to make full use of the resource of computing machine, reduce manufacturing cost, the present invention proposes another implementation.As shown in Figure 3.Hand shape image information acquisition and transmission system that CCD camera, A/D converter, computer interface, main frame, the graphoscope be made up of optical lens and ccd image sensor are formed have been provided among the figure.In this system, the spatial shape of hand converts the analog quantity of picture signal to by the CCD camera, be transformed into digital signal through A/D converter, directly import main frame into by computer interface, and directly carry out Flame Image Process by main frame, the characteristic information of the spatial shape that extraction is sold, and then by these characteristic informations generation corresponding calculated machine operations, the corresponding position on the screen of graphoscope shows corresponding mapped graphics simultaneously.This system constitutes work with the signal Processing of original dsp processor and Flame Image Process and is transferred to main frame and finishes, and system constitutes simple relatively, and main frame is finished needs the processing of whole input image datas.
On the basis that aforementioned hardware system constitutes, by writing driver again, utilize existing maturation and disclosed computer software technology just can on existing popular operating system platform, move well, realize all functions of this patent.

Claims (3)

1. a computer input is made up of image sensing apparatus and image information feature extraction element, it is characterized in that:
Image sensing apparatus obtains the shape information of hand (or assigned object) in the space, the image information feature extraction element extract sell (or assigned object) spatial shape characteristic information and import main frame into, the spatial shape (or its image) that shows sell (or assigned object) on computer display screen, simultaneous computer produces computer-managed instruction according to the characteristic information that is imported into.
2. according to the described computer input of claim 1, it is characterized in that:
The spatial shape that image sensing apparatus obtains hand (or assigned object) is meant position and the motion state information of hand (or assigned object) in the space, comprise that whole hand (and finger) (or assigned object) is in three-dimensional positional information, travel direction and velocity information comprise that also the coordinate of (single-point or the multiple spot) induction point on hand (and finger) (or assigned object) and the image sensing apparatus sensitive surface and other contact information are (as finger print information, pressure, infrared, sound wave, electric capacity, ground magnetic information etc.), hand (and finger) (or assigned object) is in image sensing apparatus lip-deep (translation and rotation, single-point or multiple spot, fast with at a slow speed) move, (single-point or multiple spot, fast with at a slow speed) information of the various motions and the mode of stop such as knock.
3. according to the described computer input of claim 1, it is characterized in that:
The big or small proportion relation of the size of the effective display surface on the computer display and the sensitive surface of image sensing apparatus.Hand (or assigned object) is mapping relations in the image of the spatial shape of the hand that demonstrates on the computer display screen (or assigned object) and the space.
CN 02117354 2002-05-20 2002-05-20 Computer input system Pending CN1378171A (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CN 02117354 CN1378171A (en) 2002-05-20 2002-05-20 Computer input system
CN 03131101 CN1462929A (en) 2002-05-20 2003-05-12 Input system of computers
CNA031361447A CN1489022A (en) 2002-05-20 2003-05-17 Computer imput system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 02117354 CN1378171A (en) 2002-05-20 2002-05-20 Computer input system

Publications (1)

Publication Number Publication Date
CN1378171A true CN1378171A (en) 2002-11-06

Family

ID=4744402

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 02117354 Pending CN1378171A (en) 2002-05-20 2002-05-20 Computer input system

Country Status (1)

Country Link
CN (1) CN1378171A (en)

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100365552C (en) * 2004-07-05 2008-01-30 英业达股份有限公司 Keyboard capable of automatically adjusting key spacing and method thereof
CN100374998C (en) * 2005-03-01 2008-03-12 联想(北京)有限公司 A touch-type information input device and method
CN100380392C (en) * 2004-02-13 2008-04-09 株式会社日立制作所 desktop information terminal
CN100468303C (en) * 2003-02-14 2009-03-11 奈克斯特控股公司 Touch screen and method for optically detecting whether object exists relative to touch screen
WO2009059479A1 (en) * 2007-11-07 2009-05-14 Pohsien Chiu Input devices with virtual input interfaces
CN101464752A (en) * 2009-01-13 2009-06-24 刘平 Electronic drawing board used for computer graphics
CN1549102B (en) * 2003-05-07 2010-04-21 精模电子科技(深圳)有限公司 Azimuth switch type rocking rod and azimuth scanning method thereof
CN101847057A (en) * 2010-06-01 2010-09-29 郭小卫 Method for touchpad to acquire input information
CN102135839A (en) * 2010-01-22 2011-07-27 联想(北京)有限公司 Terminal and input method thereof
CN102402277A (en) * 2010-09-16 2012-04-04 联想(北京)有限公司 Electronic terminal and information input processing method
CN102411471A (en) * 2010-06-22 2012-04-11 通用电气公司 Method and system for interacting with datasets for display
CN102023911B (en) * 2009-09-16 2012-10-03 致伸科技股份有限公司 Test system of input device model
CN103064623A (en) * 2012-12-12 2013-04-24 晏永全 Virtual finger drawing system
CN103294219A (en) * 2012-02-28 2013-09-11 联想(北京)有限公司 Character input method and device
CN103530061A (en) * 2013-10-31 2014-01-22 京东方科技集团股份有限公司 Display device, control method, gesture recognition method and head-mounted display device
CN106095081A (en) * 2016-05-30 2016-11-09 合肥联宝信息技术有限公司 Man-machine interaction method and device

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100468303C (en) * 2003-02-14 2009-03-11 奈克斯特控股公司 Touch screen and method for optically detecting whether object exists relative to touch screen
CN1549102B (en) * 2003-05-07 2010-04-21 精模电子科技(深圳)有限公司 Azimuth switch type rocking rod and azimuth scanning method thereof
CN100380392C (en) * 2004-02-13 2008-04-09 株式会社日立制作所 desktop information terminal
CN100365552C (en) * 2004-07-05 2008-01-30 英业达股份有限公司 Keyboard capable of automatically adjusting key spacing and method thereof
CN100374998C (en) * 2005-03-01 2008-03-12 联想(北京)有限公司 A touch-type information input device and method
WO2009059479A1 (en) * 2007-11-07 2009-05-14 Pohsien Chiu Input devices with virtual input interfaces
CN101464752A (en) * 2009-01-13 2009-06-24 刘平 Electronic drawing board used for computer graphics
CN102023911B (en) * 2009-09-16 2012-10-03 致伸科技股份有限公司 Test system of input device model
CN102135839B (en) * 2010-01-22 2014-07-30 联想(北京)有限公司 Terminal and input method thereof
CN102135839A (en) * 2010-01-22 2011-07-27 联想(北京)有限公司 Terminal and input method thereof
WO2011088793A1 (en) * 2010-01-22 2011-07-28 北京联想软件有限公司 Terminal and input method thereof
CN101847057A (en) * 2010-06-01 2010-09-29 郭小卫 Method for touchpad to acquire input information
CN102411471A (en) * 2010-06-22 2012-04-11 通用电气公司 Method and system for interacting with datasets for display
CN102402277A (en) * 2010-09-16 2012-04-04 联想(北京)有限公司 Electronic terminal and information input processing method
CN102402277B (en) * 2010-09-16 2014-11-05 联想(北京)有限公司 Electronic terminal and information input processing method
CN103294219A (en) * 2012-02-28 2013-09-11 联想(北京)有限公司 Character input method and device
CN103064623A (en) * 2012-12-12 2013-04-24 晏永全 Virtual finger drawing system
CN103530061A (en) * 2013-10-31 2014-01-22 京东方科技集团股份有限公司 Display device, control method, gesture recognition method and head-mounted display device
CN103530061B (en) * 2013-10-31 2017-01-18 京东方科技集团股份有限公司 Display device and control method
CN106095081A (en) * 2016-05-30 2016-11-09 合肥联宝信息技术有限公司 Man-machine interaction method and device

Similar Documents

Publication Publication Date Title
US11093086B2 (en) Method and apparatus for data entry input
CN104898879B (en) Method and device for data input
Westerman et al. Multi-touch: A new tactile 2-d gesture interface for human-computer interaction
US9891820B2 (en) Method for controlling a virtual keyboard from a touchpad of a computerized device
US9678662B2 (en) Method for detecting user gestures from alternative touchpads of a handheld computerized device
US20160364138A1 (en) Front touchscreen and back touchpad operated user interface employing semi-persistent button groups
EP2717120B1 (en) Apparatus, methods and computer program products providing finger-based and hand-based gesture commands for portable electronic device applications
CN1378171A (en) Computer input system
US9529523B2 (en) Method using a finger above a touchpad for controlling a computerized system
US9891821B2 (en) Method for controlling a control region of a computerized device from a touchpad
US20170017393A1 (en) Method for controlling interactive objects from a touchpad of a computerized device
US9477874B2 (en) Method using a touchpad for controlling a computerized system with epidermal print information
Greenstein et al. Input devices
US9542032B2 (en) Method using a predicted finger location above a touchpad for controlling a computerized system
US20150363038A1 (en) Method for orienting a hand on a touchpad of a computerized system
JPH05508500A (en) User interface with pseudo devices
CN101576780A (en) Computer mouse peripheral
KR20090096528A (en) Human computer interaction device, electronic device and human computer interaction method
NZ529518A (en) Input method, system and device
US20210247849A1 (en) Input device, signal processing unit thereto, and method to control the input device
CN103995610A (en) Method for user input from alternative touchpads of a handheld computerized device
KR20110023654A (en) Finger mouse
JP2019522855A (en) Adaptive user interface for handheld electronic devices
US20140253486A1 (en) Method Using a Finger Above a Touchpad During a Time Window for Controlling a Computerized System
Au et al. Multitouch finger registration and its applications

Legal Events

Date Code Title Description
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C06 Publication
PB01 Publication
C02 Deemed withdrawal of patent application after publication (patent law 2001)
WD01 Invention patent application deemed withdrawn after publication