CN106055098B - Air gesture operation method and device - Google Patents
Air gesture operation method and device Download PDFInfo
- Publication number
- CN106055098B CN106055098B CN201610350215.5A CN201610350215A CN106055098B CN 106055098 B CN106055098 B CN 106055098B CN 201610350215 A CN201610350215 A CN 201610350215A CN 106055098 B CN106055098 B CN 106055098B
- Authority
- CN
- China
- Prior art keywords
- gesture
- air
- preset
- empty
- interface
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The disclosure is directed to every empty gesture operation method and device.This method comprises: identification user in space relative to the interface done every empty-handed gesture;It according to described every empty-handed gesture, is determined on the interface described every the corresponding operating position of empty-handed gesture, and shows arrow mark in the operating position;The target object shown on the operating position is operated every empty-handed gesture corresponding predetermined registration operation form according to described.The technical solution, it should be every empty-handed gesture according to what is identified, it can accurately determine this every the corresponding operating position of empty-handed gesture on the interface of the equipment, and then according to this every the corresponding predetermined registration operation form of empty-handed gesture, the target object (such as application program, file, document) shown on the operating position is operated, it uses to realize and space-by-space operation should be carried out to target object every empty-handed gesture, family also can be used simultaneously and know clearly target operation object, and understand the entire space-by-space operation process to the target operation object.
Description
Technical field
This disclosure relates to gesture operation technical field, more particularly to every empty gesture operation method and device.
Background technique
Currently, gesture identification is essentially all the recognition methods based on contact, i.e. user does on the touch screen of terminal
The operations such as some slidings, then terminal can carry out sequence of operations according to a series of gesture operations movement detected, and this must
It must be based on touch screen, and user must carry out contact operation;But in fact, user sometimes want to carry out it is some every sky
Operation, therefore, this operating method will bring some inconvenience to user.It is in the prior art in order to further facilitate user
Some manufacturers are also that user is proposed and some can complete some operations by some contactless movements of identification user
Equipment, such as: Kinectfor Xbox 360, abbreviation Kinect are developed by Microsoft, it can be applied to 360 host of Xbox
Peripheral equipment operate Xbox360's by using phonetic order or gesture when can be not hand-held in player or trampling controller
System interface.It can also capture the movement of player's whole body or more, carry out game with body, bring player and " exempt from the trip of controller
Play and recreation experience ", but this operating method is still less accurate, and user does not know current practical operation situation, always
It is to finish epicycle game muddleheadedly, does not also know where need to improve, bring many puzzlements to user.
Summary of the invention
The embodiment of the present disclosure is provided every empty gesture operation method and device.The technical solution is as follows:
According to the first aspect of the embodiments of the present disclosure, one kind is provided every empty gesture operation method, comprising:
Identification user in space relative to the interface done every empty-handed gesture;
According to described every empty-handed gesture, determined on the interface it is described every the corresponding operating position of empty-handed gesture, and in institute
It states operating position and shows arrow mark;
The target object shown on the operating position is carried out every empty-handed gesture corresponding predetermined registration operation form according to described
Operation.
In one embodiment, it is described identification user in space relative to the interface done every empty-handed gesture it
Before, the method also includes:
Judge whether to get for opening the default unlatching gesture every empty hand gesture recognition mode;
After getting the default unlatching gesture, switch to it is described every empty hand gesture recognition mode, to be transferred to described in identification
Every the empty-handed gesture the step of.
In one embodiment, it is shown every the corresponding predetermined registration operation form of empty-handed gesture on the operating position according to described
Before the target object shown is operated, the method also includes:
Whether the judgement vertical range between empty-handed gesture and the interface is less than or equal to pre-determined distance;
When the vertical range is less than or equal to the pre-determined distance, it is transferred to corresponding default every empty-handed gesture according to described
The step of operation format operates the target object shown on the operating position.
In one embodiment, it is shown every the corresponding predetermined registration operation form of empty-handed gesture on the operating position according to described
Before the target object shown is operated, the method also includes:
Determine the matching rate every empty-handed gesture and default gesture;
When the matching rate is greater than or equal to preset matching rate, it is transferred to according to described every the corresponding predetermined registration operation of empty-handed gesture
The step of form operates the target object shown on the operating position;Or
When the matching rate is less than the preset matching rate, prompt information is issued, to prompt the user whether according to
The target object is operated every empty-handed gesture corresponding predetermined registration operation form;And
Receive for the prompt information make when confirming gesture every sky, be transferred to corresponding every empty-handed gesture according to described
The predetermined registration operation form the step of target object is operated.
In one embodiment, it is described according to every empty-handed gesture, determined on the interface described every empty-handed gesture pair
The operating position answered, comprising:
Determine the upright projection position every empty-handed gesture on the interface;
Determine that the upright projection position is the operating position.
In one embodiment, it is described according to every empty-handed gesture, determined on the interface described every empty-handed gesture pair
The operating position answered, comprising:
Determine the current spatial location every empty-handed gesture relative to the interface;
According to it is preset every empty-handed gesture relative to the interface current spatial location and the interface on each position it
Between position mapping relations and the current spatial location, determine the operating position.
In one embodiment, it is described according to every the corresponding predetermined registration operation form of empty-handed gesture on the operating position
The target object of display is operated, comprising:
It the target object is clicked every empty-handed gesture corresponding predetermined registration operation form, double-clicked, deleted, beaten according to described
Open and close are closed, exited, unloading and one or more operations on the move;Or
When the vertical range every empty-handed gesture Yu the interface is less than or equal to the pre-determined distance, described hang down is determined
Current distance section where the length scale of straight distance;
According to preset every empty-handed gesture, the corresponding relationship between section and predetermined registration operation form three, from it is described every
Current operation form corresponding with the current distance section is determined in the corresponding predetermined registration operation form of empty-handed gesture;
The target object shown on the operating position is operated according to the current operation form.
In one embodiment, described every empty-handed gesture includes: that finger is clicked every sky, finger is double-clicked every sky, finger is sliding every sky
Dynamic and palm is every at least one of sky translation gesture.
According to the second aspect of an embodiment of the present disclosure, one kind is also provided every empty gesture operation device, comprising:
Identification module, for identification user in space relative to the interface done every empty-handed gesture;
First determining module, it is described corresponding every empty-handed gesture for, every empty-handed gesture, being determined on the interface according to described
Operating position, and the operating position show arrow mark;
First operation module, for being shown every the corresponding predetermined registration operation form of empty-handed gesture on the operating position according to described
The target object shown is operated.
In one embodiment, described device further include:
First judgment module, for it is described identification user in space relative to the interface done every empty-handed gesture it
Before, judge whether to get for opening the default unlatching gesture every empty hand gesture recognition mode;
Switching module, it is described every empty hand gesture recognition mode for switching to after getting the default unlatching gesture, with
Identification is described every empty-handed gesture.
In one embodiment, described device further include:
Second judgment module, for according to it is described every the corresponding predetermined registration operation form of empty-handed gesture to the operating position
Before the target object of display is operated, the judgement vertical range between empty-handed gesture and the interface whether be less than or
Equal to pre-determined distance;
Second operation module is used for when the vertical range is less than or equal to the pre-determined distance, according to described every sky
The corresponding predetermined registration operation form of gesture operates the target object shown on the operating position.
In one embodiment, described device further include:
Second determining module, for according to it is described every the corresponding predetermined registration operation form of empty-handed gesture to the operating position
Before the target object of display is operated, the matching rate every empty-handed gesture and default gesture is determined;
Third operation module is used for when the matching rate is greater than or equal to preset matching rate, according to described every empty-handed gesture
Corresponding predetermined registration operation form operates the target object shown on the operating position;Or
Cue module, for prompt information being issued, to prompt user when the matching rate is less than the preset matching rate
Whether the target object is operated every empty-handed gesture corresponding predetermined registration operation form according to described;And
4th operation module, for receive for the prompt information make every sky confirm gesture when, according to institute
It states and the target object is operated every empty-handed gesture corresponding predetermined registration operation form.
In one embodiment, first determining module includes:
First determines submodule, for determining the upright projection position every empty-handed gesture on the interface;
Second determines submodule, for determining that the upright projection position is the operating position.
In one embodiment, first determining module further include:
Third determines submodule, for determining the current spatial location every empty-handed gesture relative to the interface;
4th determine submodule, for according to it is preset every empty-handed gesture relative to the current spatial location at the interface and institute
The position mapping relations between each position on interface and the current spatial location are stated, determines the operating position.
In one embodiment, first operation module includes:
First operation submodule, for according to it is described every the corresponding predetermined registration operation form of empty-handed gesture to the target object into
Row is clicked, double-clicked, deleting, opening, closing, exiting, unloading and one or more operations on the move;Or
5th determines submodule, described pre- for being less than or equal in the vertical range every empty-handed gesture with the interface
If apart from when, determine the current distance section where the length scale of the vertical range;
6th determines submodule, is used for according to preset every empty-handed gesture, between section and predetermined registration operation form three
Corresponding relationship, from described corresponding with the current distance section every being determined in the corresponding predetermined registration operation form of empty-handed gesture
Current operation form;
Second operation submodule, for according to the current operation form to the target object shown on the operating position
It is operated.
In one embodiment, described every empty-handed gesture includes: that finger is clicked every sky, finger is double-clicked every sky, finger is sliding every sky
Dynamic and palm is every at least one of sky translation gesture.
According to the third aspect of an embodiment of the present disclosure, one kind is additionally provided every empty gesture operation device, comprising:
Processor;
Memory for storage processor executable instruction;
Wherein, the processor is configured to:
Identification user in space relative to the interface done every empty-handed gesture;
According to described every empty-handed gesture, determined on the interface it is described every the corresponding operating position of empty-handed gesture, and in institute
It states operating position and shows arrow mark;
The target object shown on the operating position is carried out every empty-handed gesture corresponding predetermined registration operation form according to described
Operation.
The technical scheme provided by this disclosed embodiment can include the following benefits:
The technical scheme provided by this disclosed embodiment should accurately can be set at this according to what is identified every empty-handed gesture
This is determined on standby interface every the corresponding operating position of empty-handed gesture, and then according to this every the corresponding predetermined registration operation shape of empty-handed gesture
Formula operates the target object (such as application program, file, document) shown on the operating position, to realize
Space-by-space operation is carried out to target object every empty-handed gesture using this, while family also can be used and know clearly target operation object,
And understanding is to the entire space-by-space operation process of the target operation object.
It should be understood that above general description and following detailed description be only it is exemplary and explanatory, not
The disclosure can be limited.
Detailed description of the invention
The drawings herein are incorporated into the specification and forms part of this specification, and shows the implementation for meeting the disclosure
Example, and together with specification for explaining the principles of this disclosure.
Fig. 1 is a kind of flow chart every empty gesture operation method shown according to an exemplary embodiment.
Fig. 2 is another flow chart every empty gesture operation method shown according to an exemplary embodiment.
Fig. 3 is the flow chart according to another shown in an exemplary embodiment one every empty gesture operation method.
Fig. 4 A is the flow chart according to another shown in an exemplary embodiment one every empty gesture operation method.
Fig. 4 B is the flow chart according to another shown in an exemplary embodiment one every empty gesture operation method.
Fig. 5 is the flow chart according to another shown in an exemplary embodiment one every empty gesture operation method.
Fig. 6 is the flow chart according to another shown in an exemplary embodiment one every empty gesture operation method.
Fig. 7 is the flow chart according to another shown in an exemplary embodiment one every empty gesture operation method.
Fig. 8 is a kind of block diagram every empty gesture operation device shown according to an exemplary embodiment.
Fig. 9 is another block diagram every empty gesture operation device shown according to an exemplary embodiment.
Figure 10 be it is shown according to an exemplary embodiment another every empty gesture operation device block diagram.
Figure 11 A be it is shown according to an exemplary embodiment another every empty gesture operation device block diagram.
Figure 11 B be it is shown according to an exemplary embodiment another every empty gesture operation device block diagram.
Figure 12 be it is shown according to an exemplary embodiment another every empty gesture operation device block diagram.
Figure 13 be it is shown according to an exemplary embodiment another every empty gesture operation device block diagram.
Figure 14 A be it is shown according to an exemplary embodiment another every empty gesture operation device block diagram.
Figure 14 B be it is shown according to an exemplary embodiment another every empty gesture operation device block diagram.
Figure 15 is shown according to an exemplary embodiment suitable for referring to the block diagram every empty gesture operation device.
Specific embodiment
Example embodiments are described in detail here, and the example is illustrated in the accompanying drawings.Following description is related to
When attached drawing, unless otherwise indicated, the same numbers in different drawings indicate the same or similar elements.Following exemplary embodiment
Described in embodiment do not represent all implementations consistent with this disclosure.On the contrary, they be only with it is such as appended
The example of the consistent device and method of some aspects be described in detail in claims, the disclosure.
Currently, gesture identification is essentially all the recognition methods based on contact, i.e. user does on the touch screen of terminal
The operations such as some slidings, then terminal can carry out sequence of operations according to a series of gesture operations movement detected, and this must
It must be based on touch screen, and user must carry out contact operation;But in fact, user sometimes want to carry out it is some every sky
Operation, therefore, this operating method will bring some inconvenience to user.It is in the prior art in order to further facilitate user
Some manufacturers are also that user is proposed and some can complete some operations by some contactless movements of identification user
Equipment, but this operating method is still less accurate, and user does not know current practical operation situation, it is always muddleheaded
Ground finishes epicycle game, does not also know where need to improve, brings many puzzlements to user.
In order to solve the above-mentioned technical problem, the embodiment of the present disclosure provides one kind every empty gesture operation method, and this method can
For every in empty-handed gesture operation sequence, system or device, executing subject to can be the equipment such as terminal, as shown in Figure 1, this method
Including step S101-S103:
In step s101, identification user in space relative to interface done every empty-handed gesture;
In step s 102, it according to every empty-handed gesture, determining operating position corresponding every empty-handed gesture on interface, and is grasping
Make position and shows arrow mark;
According to this every empty-handed gesture, it can accurately determine this every the corresponding operative position of empty-handed gesture on the interface of the equipment
It sets, and shows arrow mark (such as pointer, small hand icon) on the operating position, then can play suggesting effect, make user
Specify current operating position.
In step s 103, according to every the corresponding predetermined registration operation form of empty-handed gesture to the target object shown on operating position
It is operated.
Identifying that this, can be according to this every the corresponding predetermined registration operation form of empty-handed gesture, to the operative position after empty-handed gesture
The target object (such as application program, file, document) for setting display is operated, such as: when this is corresponding every empty-handed gesture
Predetermined registration operation form be open the target object when, so that it may the target object is opened according to the predetermined registration operation form, when this
When the corresponding predetermined registration operation form of empty-handed gesture is to delete the target object, so that it may delete the mesh according to the predetermined registration operation form
Object is marked, space-by-space operation should be carried out to target object every empty-handed gesture to realize and use, while family also can be used clearly
Solve entire space-by-space operation process.
It certainly, may be that this is in moving process every empty-handed gesture if there is no target object on the operating position,
It is not yet directed toward target object to be operated, then current operation is sky.
As shown in Fig. 2, in one embodiment, before step S101, method further include:
In step s 201, judge whether to get for opening the default unlatching gesture every empty hand gesture recognition mode;
In step S202, after getting default unlatching gesture, switch to every empty hand gesture recognition mode, to be transferred to identification
Every the empty-handed gesture the step of.
In identification before empty-handed gesture, it is also necessary to judge whether the equipment receives unlatching and be somebody's turn to do every empty gesture identification mould
The default unlatching gesture of formula illustrates that user it is expected that starting is somebody's turn to do every empty hand gesture recognition mode if getting default unlatching gesture,
It should be every empty-handed gesture, so that space-by-space operation is realized, therefore, it is possible to switch to this every empty hand gesture recognition mode to start identification;Certainly,
If not getting default unlatching gesture, user may be in order to avoid accidentally carrying out space-by-space operation, thus undesirable starting
It should be every empty hand gesture recognition mode, at this point it is possible to not switch to this every empty hand gesture recognition mode.
As shown in figure 3, in one embodiment, before step S103, method further include:
In step S301, judge whether the vertical range between empty-handed gesture and interface is less than or equal to pre-determined distance;
In step s 302, it when vertical range is less than or equal to pre-determined distance, is transferred to according to corresponding pre- every empty-handed gesture
If the step of operation format operates the target object shown on operating position.
In identification before empty-handed gesture, into after hand gesture recognition mode, under can also judging every empty-handed gesture and the interface it
Between vertical range whether be less than or equal to pre-determined distance, with ensure only the vertical range be less than or equal to this it is default away from
From, should be every in the sufficiently effective situation of empty-handed gesture, just according to should be every the corresponding predetermined registration operation form of empty-handed gesture to the target object
It is operated;And be greater than the pre-determined distance in vertical range, identify in the case where should may be mistake every empty-handed gesture, not root
The target object is operated every empty-handed gesture corresponding predetermined registration operation form according to this.
As shown in Figure 4 A, in one embodiment, before step S103, method further include:
In step S401, the matching rate every empty-handed gesture and default gesture is determined;
When determining matching rate, gesture can should be preset with each of pre-stored in this equipment every empty-handed gesture for what is done
It is compared, to determine the highest default gesture of matching rate, and records the matching rate.
In step S402, when matching rate is greater than or equal to preset matching rate, it is transferred to according to corresponding pre- every empty-handed gesture
If the step of operation format operates the target object shown on operating position;
When the matching rate is greater than or equal to preset matching rate, illustrate that user shows should be exactly the matching rate every empty-handed gesture
The highest default gesture, then can according to this every the empty-handed gesture i.e. default corresponding predetermined registration operation form of gesture to the target pair
As being operated.
Or
As shown in Figure 4 B, in one embodiment, before step S103, method further include:
In step S403, when matching rate is less than preset matching rate, prompt information is issued, to prompt the user whether basis
Target object is operated every empty-handed gesture corresponding predetermined registration operation form;
When the matching rate is less than the preset matching rate, illustrate that user shows should every empty-handed gesture there is no preset hand with this
Gesture meets very much, and what which identified is likely to be mistake every empty-handed gesture, then prompt information should be issued, to prompt user
Identify that the recognition result every empty-handed gesture may be mistake, if need to continue according to should be every the empty-handed gesture i.e. default gesture pair
The predetermined registration operation form answered operates the target object.And
In step s 404, receive for prompt information make when confirming gesture every sky, be transferred to according to every empty-handed
The step of corresponding predetermined registration operation form of gesture operates target object.
Receive for the prompt information make when confirming gesture every sky, illustrate that customer acceptance identifies should be every sky
Gesture, it is believed that should every empty-handed gesture be correctly, then can immediately according to every the corresponding predetermined registration operation form of empty-handed gesture to target pair
As being operated, to meet the needs of user carries out space-by-space operation to the target object.
As shown in figure 5, in one embodiment, above-mentioned steps S102 can be performed as:
In step S501, the upright projection position every empty-handed gesture on interface is determined;
In step S502, determine that upright projection position is operating position.
When according to the operating position is determined every empty-handed gesture, the vertical throwing every empty-handed gesture on the surface can be first determined
Shadow position, then directly determining the upright projection position is the operating position, so that the object on the upright projection position
As target operation object.
As shown in fig. 6, in one embodiment, above-mentioned steps S102 can be performed as:
In step s 601, the current spatial location every empty-handed gesture relative to interface is determined;
When according to the operating position is determined every empty-handed gesture, the current spatial every empty-handed gesture relative to interface can also be determined
Position, that is, the parallel plane where the interface of being subject to establish space coordinates, and then determining should sit every empty-handed gesture in the space
Space coordinate in mark system certainly, can be with this every the finger tip or palm in empty-handed gesture in order to make the space coordinate in order to accurate
Central point be reference point, and using the space coordinate of the reference point as the space coordinate every empty-handed gesture, in addition, if identification
Out should every the finger tip in empty-handed gesture be it is multiple, then using highest finger tip in multiple finger tip as reference point, by the highest finger tip
Space coordinate as the space coordinate every empty-handed gesture;
In step S602, according to everybody on preset current spatial location and interface every empty-handed gesture relative to interface
Position mapping relations and current spatial location between setting, determine operating position.
It is mapped according to the position between each position on current spatial location and interface of the empty-handed gesture relative to interface
Relationship and current spatial location can accurately determine out the current spatial location mapped operating position, according to
Operation should be carried out to correct target object every the corresponding predetermined registration operation form of empty-handed gesture to lay the foundation.
As shown in fig. 7, in one embodiment, above-mentioned steps S103 can be performed as:
According to target object clicked every empty-handed gesture corresponding predetermined registration operation form, double-clicked, deleted, opened, closed,
It exits, unload and one or more operations on the move;Or
It can should be to click, double-click, delete, open, close, exit, unload every the corresponding predetermined registration operation form of empty-handed gesture
With a kind of operation on the move or a variety of operations, such as: when this is OK gesture, and the predetermined registration operation shape of the OK gesture every empty advantage
Formula is when clicking with opening operation, then after identifying the OK gesture, so that it may first click the target object, then open the mesh
Object is marked, also for example: when this is that index finger is upward every empty-handed gesture, other four fingers are fastened, and the index finger is upward, what other four fingers fastened
The predetermined registration operation form of gesture is when exiting with unloading operation, then to identify that the index finger is upward, the gesture that other four fingers fasten
Afterwards, so that it may first exit the target object, then unload the target object.
In step s 701, it when the vertical range every empty-handed gesture and interface is less than or equal to pre-determined distance, determines vertical
Current distance section where the length scale of distance;
The vertical range every empty-handed gesture Yu the interface is less than or equal to the pre-determined distance, is to ensure that gesture identification accuracy
Higher basis may further determine that the current distance area where the length scale of the vertical range is specific on this basis
Between.
In step S702, according to preset every empty-handed gesture, the correspondence between section and predetermined registration operation form three
Relationship determines current operation form corresponding with current distance section from every the corresponding predetermined registration operation form of empty-handed gesture;
On the basis of the vertical range is less than or equal to the pre-determined distance, in order to meet the individual demand of user, to the greatest extent
This is possibly made full use of to carry out various different operations to target object every empty-handed gesture, it is even identical every empty-handed gesture, it hangs down
Directly apart from place apart from section difference, the current operation form of the operating gesture be can also be different, therefore, should be every empty-handed working as
When the corresponding a variety of predetermined registration operation forms of gesture, after determining the current distance section where the length scale of the vertical range,
It can be according to preset every empty-handed gesture, the corresponding relationship between section and predetermined registration operation form three, from this every empty-handed gesture
Current operation form corresponding with the current distance section is determined in corresponding a variety of predetermined registration operation forms, to determine most to accord with
Share the current desired current operation form being somebody's turn to do every empty-handed gesture in family.
In step S703, the target object shown on operating position is operated according to current operation form.
And then exact operations are carried out to the target object according to the current operation format.
In one embodiment, every empty-handed gesture include: finger is clicked every sky, finger is double-clicked every sky, finger every sky sliding and
Palm is every at least one of sky translation gesture.
It should can be that finger is clicked every sky, finger is double-clicked every sky, finger is translated every sky every sky sliding and palm every empty-handed gesture
At least one of gesture, and it is different different predetermined registration operation forms is corresponded to every empty-handed gesture, so as to meet user to not
With the different operation demand of target operation object.
The above-mentioned every empty gesture operation method of embodiment of the present disclosure offer is corresponded to, the embodiment of the present disclosure also provides one kind every sky
Gesture operation device, as shown in figure 8, the device includes:
Identification module 801, be configured as identification user in space relative to the interface done every empty-handed gesture;
First determining module 802 is configured as being determined on the interface according to described every empty-handed gesture described every empty-handed
The corresponding operating position of gesture, and arrow mark is shown in the operating position;
First operation module 803 is configured as according to described every the corresponding predetermined registration operation form of empty-handed gesture to the operation
The target object shown on position is operated.
As shown in figure 9, in one embodiment, described device further include:
First judgment module 901, be configured as it is described identification user in space relative to the interface done every
Before empty-handed gesture, judge whether to get the default unlatching gesture for being configured as opening every empty hand gesture recognition mode;
Switching module 902 is configured as after getting the default unlatching gesture, is switched to described every empty gesture identification
Mode, it is described every empty-handed gesture to identify.
As shown in Figure 10, in one embodiment, described device further include:
Second judgment module 1001, be configured as according to it is described every the corresponding predetermined registration operation form of empty-handed gesture to the behaviour
Before the target object for making to show on position is operated, the judgement vertical range between empty-handed gesture and the interface is
It is no to be less than or equal to pre-determined distance;
Second operation module 1002 is configured as when the vertical range is less than or equal to the pre-determined distance, according to
It is described that the target object shown on the operating position is operated every empty-handed gesture corresponding predetermined registration operation form.
As shown in Figure 11 A, in one embodiment, described device further include:
Second determining module 1101, be configured as according to it is described every the corresponding predetermined registration operation form of empty-handed gesture to the behaviour
Before the target object for making to show on position is operated, the matching rate every empty-handed gesture and default gesture is determined;
Third operation module 1102 is configured as when the matching rate is greater than or equal to preset matching rate, according to described
The target object shown on the operating position is operated every empty-handed gesture corresponding predetermined registration operation form;Or
As shown in Figure 11 B, in one embodiment, described device further include:
Cue module 1103 is configured as issuing prompt information when the matching rate is less than the preset matching rate, with
It prompts the user whether to operate the target object every the corresponding predetermined registration operation form of empty-handed gesture according to described;And
4th operation module 1104, be configured as receive for the prompt information make every sky confirm gesture
When, the target object is operated every empty-handed gesture corresponding predetermined registration operation form according to described.
As shown in figure 12, in one embodiment, first determining module 802 includes:
First determines submodule 8021, is configured to determine that the upright projection position every empty-handed gesture on the interface
It sets;
Second determines submodule 8022, is configured to determine that the upright projection position is the operating position.
As shown in figure 13, in one embodiment, first determining module 802 further include:
Third determines submodule 8023, is configured to determine that the current spatial position every empty-handed gesture relative to the interface
It sets;
4th determines submodule 8024, is configured as according to the preset current spatial every empty-handed gesture relative to the interface
Position mapping relations and the current spatial location between each position on position and the interface, determine the operation
Position.
As shown in Figure 14 A, in one embodiment, first operation module 803 includes:
First operation submodule 8031, is configured as according to described every the corresponding predetermined registration operation form of empty-handed gesture to the mesh
Mark object is clicked, double-clicked, deleted, opened, closed, exited, unloaded and one or more operations on the move;Or
As shown in Figure 14B, in one embodiment, first operation module 803 includes:
5th determines submodule 8032, is configured as being less than or waiting every the vertical range at empty-handed gesture with the interface described
When the pre-determined distance, the current distance section where the length scale of the vertical range is determined;
6th determines submodule 8033, is configured as according to preset every empty-handed gesture, apart from section and predetermined registration operation form
Corresponding relationship between three is determined and the current distance from described every in the corresponding predetermined registration operation form of empty-handed gesture
The corresponding current operation form in section;
Second operation submodule 8034 is configured as according to the current operation form to showing on the operating position
Target object is operated.
In one embodiment, described every empty-handed gesture includes: that finger is clicked every sky, finger is double-clicked every sky, finger is sliding every sky
Dynamic and palm is every at least one of sky translation gesture.
According to the third aspect of an embodiment of the present disclosure, one kind is provided every empty gesture operation device, comprising:
Processor;
Memory for storage processor executable instruction;
Wherein, processor is configured as:
Identification user in space relative to the interface done every empty-handed gesture;
According to described every empty-handed gesture, determined on the interface it is described every the corresponding operating position of empty-handed gesture, and in institute
It states operating position and shows arrow mark;
The target object shown on the operating position is carried out every empty-handed gesture corresponding predetermined registration operation form according to described
Operation.
Above-mentioned processor is also configured to:
It is described identification user in space relative to the interface done before empty-handed gesture, the method is also wrapped
It includes:
Judge whether to get for opening the default unlatching gesture every empty hand gesture recognition mode;
After getting the default unlatching gesture, switch to it is described every empty hand gesture recognition mode, to be transferred to described in identification
Every the empty-handed gesture the step of.
Above-mentioned processor is also configured to:
According to it is described every the corresponding predetermined registration operation form of empty-handed gesture to the target object shown on the operating position into
Before row operation, the method also includes:
Whether the judgement vertical range between empty-handed gesture and the interface is less than or equal to pre-determined distance;
When the vertical range is less than or equal to the pre-determined distance, it is transferred to corresponding default every empty-handed gesture according to described
The step of operation format operates the target object shown on the operating position.
Above-mentioned processor is also configured to:
According to it is described every the corresponding predetermined registration operation form of empty-handed gesture to the target object shown on the operating position into
Before row operation, the method also includes:
Determine the matching rate every empty-handed gesture and default gesture;
When the matching rate is greater than or equal to preset matching rate, it is transferred to according to described every the corresponding predetermined registration operation of empty-handed gesture
The step of form operates the target object shown on the operating position;Or
When the matching rate is less than the preset matching rate, prompt information is issued, to prompt the user whether according to
The target object is operated every empty-handed gesture corresponding predetermined registration operation form;And
Receive for the prompt information make when confirming gesture every sky, be transferred to corresponding every empty-handed gesture according to described
The predetermined registration operation form the step of target object is operated.
Above-mentioned processor is also configured to:
It is described according to every empty-handed gesture, determined on the interface described every the corresponding operating position of empty-handed gesture, packet
It includes:
Determine the upright projection position every empty-handed gesture on the interface;
Determine that the upright projection position is the operating position.
Above-mentioned processor is also configured to:
It is described according to every empty-handed gesture, determined on the interface described every the corresponding operating position of empty-handed gesture, packet
It includes:
Determine the current spatial location every empty-handed gesture relative to the interface;
According to it is preset every empty-handed gesture relative to the interface current spatial location and the interface on each position it
Between position mapping relations and the current spatial location, determine the operating position.
Above-mentioned processor is also configured to:
It is described according to every the corresponding predetermined registration operation form of empty-handed gesture to the target object shown on the operating position
It is operated, comprising:
It the target object is clicked every empty-handed gesture corresponding predetermined registration operation form, double-clicked, deleted, beaten according to described
Open and close are closed, exited, unloading and one or more operations on the move;Or
When the vertical range every empty-handed gesture Yu the interface is less than or equal to the pre-determined distance, described hang down is determined
Current distance section where the length scale of straight distance;
According to preset every empty-handed gesture, the corresponding relationship between section and predetermined registration operation form three, from it is described every
Current operation form corresponding with the current distance section is determined in the corresponding predetermined registration operation form of empty-handed gesture;
The target object shown on the operating position is operated according to the current operation form.
Above-mentioned processor is also configured to:
Described every empty-handed gesture includes: that finger is clicked every sky, finger is double-clicked every sky, finger is translated every sky every sky sliding and palm
At least one of gesture.
Figure 15 is a kind of block diagram for every empty gesture operation device 1500 shown according to an exemplary embodiment, the dress
It sets and is suitable for terminal device.For example, device 1500 can be mobile phone, computer, digital broadcast terminal, information receiving and transmitting set
It is standby, game console, tablet device, Medical Devices, body-building equipment, personal digital assistant etc..
Referring to Fig.1 5, device 1500 may include with next or at least two components: processing component 1502, memory
1504, power supply module 1506, multimedia component 1508, audio component 1510, input/output (I/O) interface 1512, sensor group
Part 1514 and communication component 1516.
The integrated operation of the usual control device 1500 of processing component 1502, such as with display, telephone call, data communication,
Camera operation and record operate associated operation.Processing component 1502 may include one or at least two processors 1520
It executes instruction, to perform all or part of the steps of the methods described above.In addition, processing component 1502 may include one or at least
Two modules, convenient for the interaction between processing component 1502 and other assemblies.For example, processing component 1502 may include multimedia
Module, to facilitate the interaction between multimedia component 1508 and processing component 1502.
Memory 1504 is configured as storing various types of data to support the operation in device 1500.These data
Example includes the instruction for any storage object or method that operate on device 1500, contact data, telephone book data,
Message, picture, video etc..Memory 1504 can by any kind of volatibility or non-volatile memory device or they
Combination is realized, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), it is erasable can
Program read-only memory (EPROM), programmable read only memory (PROM), read-only memory (ROM), magnetic memory, flash memory
Reservoir, disk or CD.
Power supply module 1506 provides power supply for the various assemblies of device 1500.Power supply module 1506 may include power management
System, one or at least two power supplys and other with for device 1500 generate, manage, and distribute the associated component of power supply.
Multimedia component 1508 includes the screen of one output interface of offer between described device 1500 and user.?
In some embodiments, screen may include liquid crystal display (LCD) and touch panel (TP).If screen includes touch panel,
Screen may be implemented as touch screen, to receive input signal from the user.Touch panel includes one or at least two touchings
Sensor is touched to sense the gesture on touch, slide, and touch panel.The touch sensor can not only sense touch or cunning
The boundary of movement, but also detect duration and pressure associated with the touch or slide operation.In some embodiments
In, multimedia component 1508 includes a front camera and/or rear camera.When device 1500 is in operation mode, such as
When screening-mode or video mode, front camera and/or rear camera can receive external multi-medium data.Before each
Setting camera and rear camera can be a fixed optical lens system or has focusing and optical zoom capabilities.
Audio component 1510 is configured as output and/or input audio signal.For example, audio component 1510 includes a wheat
Gram wind (MIC), when device 1500 is in operation mode, when such as call mode, recording mode, and voice recognition mode, microphone quilt
It is configured to receive external audio signal.The received audio signal can be further stored in memory 1504 or via communication
Component 1516 is sent.In some embodiments, audio component 1510 further includes a loudspeaker, is used for output audio signal.
I/O interface 1512 provides interface, above-mentioned peripheral interface module between processing component 1502 and peripheral interface module
It can be keyboard, click wheel, button etc..These buttons may include, but are not limited to: home button, volume button, start button and
Locking press button.
Sensor module 1514 includes one or at least two sensors, for providing the shape of various aspects for device 1500
State assessment.For example, sensor module 1514 can detecte the state that opens/closes of device 1500, the relative positioning of component, example
Such as the display and keypad that the component is device 1500, sensor module 1514 can be with detection device 1500 or device
The position change of 1500 1 components, the existence or non-existence that user contacts with device 1500,1500 orientation of device or acceleration/subtract
The temperature change of speed and device 1500.Sensor module 1514 may include proximity sensor, be configured to not any
Physical contact when detect the presence of nearby objects.Sensor module 1514 can also include optical sensor, as CMOS or CCD schemes
As sensor, for being used in imaging applications.In some embodiments, which can also include acceleration
Sensor, gyro sensor, Magnetic Sensor, pressure sensor or temperature sensor.
Communication component 1516 is configured to facilitate the communication of wired or wireless way between device 1500 and other equipment.Dress
The wireless network based on communication standard, such as WiFi can be accessed by setting 1500,2G or 3G or their combination.It is exemplary at one
In embodiment, communication component 1516 receives broadcast singal or broadcast correlation from external broadcasting management system via broadcast channel
Information.In one exemplary embodiment, the communication component 1516 further includes near-field communication (NFC) module, to promote short distance
Communication.For example, radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra wide band can be based in NFC module
(UWB) technology, bluetooth (BT) technology and other technologies are realized.
In the exemplary embodiment, device 1500 can by one or at least two application specific integrated circuits (ASIC),
Digital signal processor (DSP), digital signal processing appts (DSPD), programmable logic device (PLD), field-programmable gate array
It arranges (FPGA), controller, microcontroller, microprocessor or other electronic components to realize, for executing the above method.
In the exemplary embodiment, a kind of non-transitorycomputer readable storage medium including instruction, example are additionally provided
It such as include the memory 1504 of instruction, above-metioned instruction can be executed by the processor 1520 of device 1500 to complete the above method.Example
Such as, the non-transitorycomputer readable storage medium can be ROM, random access memory (RAM), CD-ROM, tape, soft
Disk and optical data storage devices etc..
A kind of non-transitorycomputer readable storage medium, when the instruction in the storage medium is by above-mentioned apparatus 1500
When processor executes, so that above-mentioned apparatus 1500 is able to carry out one kind every empty gesture operation method, comprising:
Identification user in space relative to the interface done every empty-handed gesture;
According to described every empty-handed gesture, determined on the interface it is described every the corresponding operating position of empty-handed gesture, and in institute
It states operating position and shows arrow mark;
The target object shown on the operating position is carried out every empty-handed gesture corresponding predetermined registration operation form according to described
Operation.
In one embodiment, it is described identification user in space relative to the interface done every empty-handed gesture it
Before, the method also includes:
Judge whether to get for opening the default unlatching gesture every empty hand gesture recognition mode;
After getting the default unlatching gesture, switch to it is described every empty hand gesture recognition mode, to be transferred to described in identification
Every the empty-handed gesture the step of.
In one embodiment, it is shown every the corresponding predetermined registration operation form of empty-handed gesture on the operating position according to described
Before the target object shown is operated, the method also includes:
Whether the judgement vertical range between empty-handed gesture and the interface is less than or equal to pre-determined distance;
When the vertical range is less than or equal to the pre-determined distance, it is transferred to corresponding default every empty-handed gesture according to described
The step of operation format operates the target object shown on the operating position.
In one embodiment, it is shown every the corresponding predetermined registration operation form of empty-handed gesture on the operating position according to described
Before the target object shown is operated, the method also includes:
Determine the matching rate every empty-handed gesture and default gesture;
When the matching rate is greater than or equal to preset matching rate, it is transferred to according to described every the corresponding predetermined registration operation of empty-handed gesture
The step of form operates the target object shown on the operating position;Or
When the matching rate is less than the preset matching rate, prompt information is issued, to prompt the user whether according to
The target object is operated every empty-handed gesture corresponding predetermined registration operation form;And
Receive for the prompt information make when confirming gesture every sky, be transferred to corresponding every empty-handed gesture according to described
The predetermined registration operation form the step of target object is operated.
In one embodiment, it is described according to every empty-handed gesture, determined on the interface described every empty-handed gesture pair
The operating position answered, comprising:
Determine the upright projection position every empty-handed gesture on the interface;
Determine that the upright projection position is the operating position.
In one embodiment, it is described according to every empty-handed gesture, determined on the interface described every empty-handed gesture pair
The operating position answered, comprising:
Determine the current spatial location every empty-handed gesture relative to the interface;
According to it is preset every empty-handed gesture relative to the interface current spatial location and the interface on each position it
Between position mapping relations and the current spatial location, determine the operating position.
In one embodiment, it is described according to every the corresponding predetermined registration operation form of empty-handed gesture on the operating position
The target object of display is operated, comprising:
It the target object is clicked every empty-handed gesture corresponding predetermined registration operation form, double-clicked, deleted, beaten according to described
Open and close are closed, exited, unloading and one or more operations on the move;Or
When the vertical range every empty-handed gesture Yu the interface is less than or equal to the pre-determined distance, described hang down is determined
Current distance section where the length scale of straight distance;
According to preset every empty-handed gesture, the corresponding relationship between section and predetermined registration operation form three, from it is described every
Current operation form corresponding with the current distance section is determined in the corresponding predetermined registration operation form of empty-handed gesture;
The target object shown on the operating position is operated according to the current operation form.
In one embodiment, described every empty-handed gesture includes: that finger is clicked every sky, finger is double-clicked every sky, finger is sliding every sky
Dynamic and palm is every at least one of sky translation gesture.
Those skilled in the art will readily occur to its of the disclosure after considering specification and practicing disclosure disclosed herein
Its embodiment.This application is intended to cover any variations, uses, or adaptations of the disclosure, these modifications, purposes or
Person's adaptive change follows the general principles of this disclosure and including the undocumented common knowledge in the art of the disclosure
Or conventional techniques.The description and examples are only to be considered as illustrative, and the true scope and spirit of the disclosure are by following
Claim is pointed out.
It should be understood that the present disclosure is not limited to the precise structures that have been described above and shown in the drawings, and
And various modifications and changes may be made without departing from the scope thereof.The scope of the present disclosure is only limited by the accompanying claims.
Claims (16)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610350215.5A CN106055098B (en) | 2016-05-24 | 2016-05-24 | Air gesture operation method and device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610350215.5A CN106055098B (en) | 2016-05-24 | 2016-05-24 | Air gesture operation method and device |
Publications (2)
Publication Number | Publication Date |
---|---|
CN106055098A CN106055098A (en) | 2016-10-26 |
CN106055098B true CN106055098B (en) | 2019-03-15 |
Family
ID=57174342
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201610350215.5A Active CN106055098B (en) | 2016-05-24 | 2016-05-24 | Air gesture operation method and device |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN106055098B (en) |
Families Citing this family (21)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107239201A (en) * | 2017-06-30 | 2017-10-10 | 珠海市魅族科技有限公司 | Display content operating method, device, terminal and storage medium |
CN108829319B (en) * | 2018-06-15 | 2020-09-01 | 驭势科技(北京)有限公司 | Interaction method and device for touch screen, electronic equipment and storage medium |
CN109240571A (en) * | 2018-07-11 | 2019-01-18 | 维沃移动通信有限公司 | A kind of control device, terminal and control method |
CN110908578A (en) * | 2018-09-18 | 2020-03-24 | 网易(杭州)网络有限公司 | Virtual object moving method and device |
CN111198644B (en) * | 2018-11-16 | 2023-10-27 | 西安易朴通讯技术有限公司 | Screen operation identification method and system of intelligent terminal |
CN111338461A (en) * | 2018-12-18 | 2020-06-26 | 鸿合科技股份有限公司 | Gesture operation method and device, and electronic device |
CN110448903A (en) * | 2019-01-22 | 2019-11-15 | 网易(杭州)网络有限公司 | Determination method, apparatus, processor and the terminal of control strategy in game |
CN110045819B (en) * | 2019-03-01 | 2021-07-09 | 华为技术有限公司 | A gesture processing method and device |
CN117784927A (en) * | 2019-08-19 | 2024-03-29 | 华为技术有限公司 | Interaction method and electronic device for space gestures |
CN111736688B (en) * | 2020-02-27 | 2025-01-14 | 珠海市杰理科技股份有限公司 | Bluetooth headset, system and gesture recognition method thereof |
CN111309153B (en) * | 2020-03-25 | 2024-04-09 | 北京百度网讯科技有限公司 | Man-machine interaction control method and device, electronic equipment and storage medium |
EP4553631A3 (en) * | 2020-04-30 | 2025-07-30 | Shenzhen Yinwang Intelligent Technologies Co., Ltd. | Control method and apparatus based on mid-air gesture, and system |
CN112015270A (en) * | 2020-08-21 | 2020-12-01 | 上海擎感智能科技有限公司 | Terminal control method, terminal and computer storage medium |
CN112445340B (en) * | 2020-11-13 | 2022-10-25 | 杭州易现先进科技有限公司 | AR desktop interaction method and device, electronic equipment and computer storage medium |
CN112543248A (en) * | 2020-11-24 | 2021-03-23 | 深圳传音控股股份有限公司 | Air-separating operation method, terminal and storage medium |
CN112278668B (en) * | 2020-12-23 | 2021-07-23 | 福建工蜂物联科技有限公司 | Garbage putting management method, system and device |
CN112699796B (en) * | 2020-12-30 | 2024-11-15 | 维沃移动通信有限公司 | Method and device for operating electronic equipment |
CN115484394B (en) * | 2021-06-16 | 2023-11-14 | 荣耀终端有限公司 | Guide use method of air separation gesture and electronic equipment |
CN113791685A (en) * | 2021-08-16 | 2021-12-14 | 青岛海尔科技有限公司 | Method and device for moving component, electronic equipment and storage medium |
CN117032447B (en) * | 2022-05-31 | 2024-07-26 | 荣耀终端有限公司 | Method, device, electronic chip and electronic device for air gesture interaction |
CN115904065A (en) * | 2022-11-01 | 2023-04-04 | 蓝影(重庆)数字科技有限公司 | A separate empty gesture operation three-dimensional model viewing system for in operating room |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1517228A2 (en) * | 2003-09-16 | 2005-03-23 | Smart Technologies, Inc. | Gesture recognition method and touch system incorporating the same |
CN103529942A (en) * | 2006-06-28 | 2014-01-22 | 诺基亚公司 | Touchless gesture-based input |
CN104898981A (en) * | 2015-06-29 | 2015-09-09 | 安一恒通(北京)科技有限公司 | Gesture recognizing method, device and terminal |
CN104992156A (en) * | 2015-07-07 | 2015-10-21 | 济南大学 | Gesture control method based on flexible mapping between gesture and multiple meanings |
CN105190520A (en) * | 2013-03-13 | 2015-12-23 | 微软技术许可有限责任公司 | Hover gestures for touch-enabled devices |
-
2016
- 2016-05-24 CN CN201610350215.5A patent/CN106055098B/en active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1517228A2 (en) * | 2003-09-16 | 2005-03-23 | Smart Technologies, Inc. | Gesture recognition method and touch system incorporating the same |
CN103529942A (en) * | 2006-06-28 | 2014-01-22 | 诺基亚公司 | Touchless gesture-based input |
CN105190520A (en) * | 2013-03-13 | 2015-12-23 | 微软技术许可有限责任公司 | Hover gestures for touch-enabled devices |
CN104898981A (en) * | 2015-06-29 | 2015-09-09 | 安一恒通(北京)科技有限公司 | Gesture recognizing method, device and terminal |
CN104992156A (en) * | 2015-07-07 | 2015-10-21 | 济南大学 | Gesture control method based on flexible mapping between gesture and multiple meanings |
Also Published As
Publication number | Publication date |
---|---|
CN106055098A (en) | 2016-10-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN106055098B (en) | Air gesture operation method and device | |
CN104536684B (en) | interface display method and device | |
CN106547663B (en) | Key management method and device | |
EP2441271B1 (en) | Mobile device which automatically determines operating mode | |
CN103955275B (en) | Application control method and apparatus | |
CN105373334B (en) | Interactive screen control method and device | |
CN105677473B (en) | A method and device for switching application programs | |
CN105224171B (en) | Icon display method, device and terminal | |
CN107800955A (en) | The control method and storage medium of communicator, communicator | |
CN106873834A (en) | Method and device and mobile terminal that key range is triggered | |
CN105487798B (en) | The method and device that messaging application is operated on touch screen terminal | |
CN105487805A (en) | Object operating method and device | |
CN105515952B (en) | Method of sending message in multimedia and device | |
CN106648063A (en) | Gesture recognition method and device | |
CN109144385A (en) | The moving method and device of suspension ball | |
CN103942047A (en) | User instruction execution method and device | |
CN105376410B (en) | Alarm clock setting method and device | |
CN109358929A (en) | Split-screen display method, device and storage medium | |
WO2017075896A1 (en) | Method and device for exchanging icon locations | |
CN112905035B (en) | Touch screen control method and device and computer storage medium | |
CN105204712B (en) | The display methods and device of folder icon | |
CN106325621B (en) | Mobile terminal and touch-responsive method | |
CN111610921A (en) | Gesture recognition method and device | |
CN108920079A (en) | Gesture identification method and device | |
CN109359441A (en) | Permission configuration method and device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |