[go: up one dir, main page]

CN106055098B - Air gesture operation method and device - Google Patents

Air gesture operation method and device Download PDF

Info

Publication number
CN106055098B
CN106055098B CN201610350215.5A CN201610350215A CN106055098B CN 106055098 B CN106055098 B CN 106055098B CN 201610350215 A CN201610350215 A CN 201610350215A CN 106055098 B CN106055098 B CN 106055098B
Authority
CN
China
Prior art keywords
gesture
air
preset
empty
interface
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201610350215.5A
Other languages
Chinese (zh)
Other versions
CN106055098A (en
Inventor
陈志军
张旭华
杨松
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Xiaomi Mobile Software Co Ltd
Original Assignee
Beijing Xiaomi Mobile Software Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Xiaomi Mobile Software Co Ltd filed Critical Beijing Xiaomi Mobile Software Co Ltd
Priority to CN201610350215.5A priority Critical patent/CN106055098B/en
Publication of CN106055098A publication Critical patent/CN106055098A/en
Application granted granted Critical
Publication of CN106055098B publication Critical patent/CN106055098B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The disclosure is directed to every empty gesture operation method and device.This method comprises: identification user in space relative to the interface done every empty-handed gesture;It according to described every empty-handed gesture, is determined on the interface described every the corresponding operating position of empty-handed gesture, and shows arrow mark in the operating position;The target object shown on the operating position is operated every empty-handed gesture corresponding predetermined registration operation form according to described.The technical solution, it should be every empty-handed gesture according to what is identified, it can accurately determine this every the corresponding operating position of empty-handed gesture on the interface of the equipment, and then according to this every the corresponding predetermined registration operation form of empty-handed gesture, the target object (such as application program, file, document) shown on the operating position is operated, it uses to realize and space-by-space operation should be carried out to target object every empty-handed gesture, family also can be used simultaneously and know clearly target operation object, and understand the entire space-by-space operation process to the target operation object.

Description

Every empty gesture operation method and device
Technical field
This disclosure relates to gesture operation technical field, more particularly to every empty gesture operation method and device.
Background technique
Currently, gesture identification is essentially all the recognition methods based on contact, i.e. user does on the touch screen of terminal The operations such as some slidings, then terminal can carry out sequence of operations according to a series of gesture operations movement detected, and this must It must be based on touch screen, and user must carry out contact operation;But in fact, user sometimes want to carry out it is some every sky Operation, therefore, this operating method will bring some inconvenience to user.It is in the prior art in order to further facilitate user Some manufacturers are also that user is proposed and some can complete some operations by some contactless movements of identification user Equipment, such as: Kinectfor Xbox 360, abbreviation Kinect are developed by Microsoft, it can be applied to 360 host of Xbox Peripheral equipment operate Xbox360's by using phonetic order or gesture when can be not hand-held in player or trampling controller System interface.It can also capture the movement of player's whole body or more, carry out game with body, bring player and " exempt from the trip of controller Play and recreation experience ", but this operating method is still less accurate, and user does not know current practical operation situation, always It is to finish epicycle game muddleheadedly, does not also know where need to improve, bring many puzzlements to user.
Summary of the invention
The embodiment of the present disclosure is provided every empty gesture operation method and device.The technical solution is as follows:
According to the first aspect of the embodiments of the present disclosure, one kind is provided every empty gesture operation method, comprising:
Identification user in space relative to the interface done every empty-handed gesture;
According to described every empty-handed gesture, determined on the interface it is described every the corresponding operating position of empty-handed gesture, and in institute It states operating position and shows arrow mark;
The target object shown on the operating position is carried out every empty-handed gesture corresponding predetermined registration operation form according to described Operation.
In one embodiment, it is described identification user in space relative to the interface done every empty-handed gesture it Before, the method also includes:
Judge whether to get for opening the default unlatching gesture every empty hand gesture recognition mode;
After getting the default unlatching gesture, switch to it is described every empty hand gesture recognition mode, to be transferred to described in identification Every the empty-handed gesture the step of.
In one embodiment, it is shown every the corresponding predetermined registration operation form of empty-handed gesture on the operating position according to described Before the target object shown is operated, the method also includes:
Whether the judgement vertical range between empty-handed gesture and the interface is less than or equal to pre-determined distance;
When the vertical range is less than or equal to the pre-determined distance, it is transferred to corresponding default every empty-handed gesture according to described The step of operation format operates the target object shown on the operating position.
In one embodiment, it is shown every the corresponding predetermined registration operation form of empty-handed gesture on the operating position according to described Before the target object shown is operated, the method also includes:
Determine the matching rate every empty-handed gesture and default gesture;
When the matching rate is greater than or equal to preset matching rate, it is transferred to according to described every the corresponding predetermined registration operation of empty-handed gesture The step of form operates the target object shown on the operating position;Or
When the matching rate is less than the preset matching rate, prompt information is issued, to prompt the user whether according to The target object is operated every empty-handed gesture corresponding predetermined registration operation form;And
Receive for the prompt information make when confirming gesture every sky, be transferred to corresponding every empty-handed gesture according to described The predetermined registration operation form the step of target object is operated.
In one embodiment, it is described according to every empty-handed gesture, determined on the interface described every empty-handed gesture pair The operating position answered, comprising:
Determine the upright projection position every empty-handed gesture on the interface;
Determine that the upright projection position is the operating position.
In one embodiment, it is described according to every empty-handed gesture, determined on the interface described every empty-handed gesture pair The operating position answered, comprising:
Determine the current spatial location every empty-handed gesture relative to the interface;
According to it is preset every empty-handed gesture relative to the interface current spatial location and the interface on each position it Between position mapping relations and the current spatial location, determine the operating position.
In one embodiment, it is described according to every the corresponding predetermined registration operation form of empty-handed gesture on the operating position The target object of display is operated, comprising:
It the target object is clicked every empty-handed gesture corresponding predetermined registration operation form, double-clicked, deleted, beaten according to described Open and close are closed, exited, unloading and one or more operations on the move;Or
When the vertical range every empty-handed gesture Yu the interface is less than or equal to the pre-determined distance, described hang down is determined Current distance section where the length scale of straight distance;
According to preset every empty-handed gesture, the corresponding relationship between section and predetermined registration operation form three, from it is described every Current operation form corresponding with the current distance section is determined in the corresponding predetermined registration operation form of empty-handed gesture;
The target object shown on the operating position is operated according to the current operation form.
In one embodiment, described every empty-handed gesture includes: that finger is clicked every sky, finger is double-clicked every sky, finger is sliding every sky Dynamic and palm is every at least one of sky translation gesture.
According to the second aspect of an embodiment of the present disclosure, one kind is also provided every empty gesture operation device, comprising:
Identification module, for identification user in space relative to the interface done every empty-handed gesture;
First determining module, it is described corresponding every empty-handed gesture for, every empty-handed gesture, being determined on the interface according to described Operating position, and the operating position show arrow mark;
First operation module, for being shown every the corresponding predetermined registration operation form of empty-handed gesture on the operating position according to described The target object shown is operated.
In one embodiment, described device further include:
First judgment module, for it is described identification user in space relative to the interface done every empty-handed gesture it Before, judge whether to get for opening the default unlatching gesture every empty hand gesture recognition mode;
Switching module, it is described every empty hand gesture recognition mode for switching to after getting the default unlatching gesture, with Identification is described every empty-handed gesture.
In one embodiment, described device further include:
Second judgment module, for according to it is described every the corresponding predetermined registration operation form of empty-handed gesture to the operating position Before the target object of display is operated, the judgement vertical range between empty-handed gesture and the interface whether be less than or Equal to pre-determined distance;
Second operation module is used for when the vertical range is less than or equal to the pre-determined distance, according to described every sky The corresponding predetermined registration operation form of gesture operates the target object shown on the operating position.
In one embodiment, described device further include:
Second determining module, for according to it is described every the corresponding predetermined registration operation form of empty-handed gesture to the operating position Before the target object of display is operated, the matching rate every empty-handed gesture and default gesture is determined;
Third operation module is used for when the matching rate is greater than or equal to preset matching rate, according to described every empty-handed gesture Corresponding predetermined registration operation form operates the target object shown on the operating position;Or
Cue module, for prompt information being issued, to prompt user when the matching rate is less than the preset matching rate Whether the target object is operated every empty-handed gesture corresponding predetermined registration operation form according to described;And
4th operation module, for receive for the prompt information make every sky confirm gesture when, according to institute It states and the target object is operated every empty-handed gesture corresponding predetermined registration operation form.
In one embodiment, first determining module includes:
First determines submodule, for determining the upright projection position every empty-handed gesture on the interface;
Second determines submodule, for determining that the upright projection position is the operating position.
In one embodiment, first determining module further include:
Third determines submodule, for determining the current spatial location every empty-handed gesture relative to the interface;
4th determine submodule, for according to it is preset every empty-handed gesture relative to the current spatial location at the interface and institute The position mapping relations between each position on interface and the current spatial location are stated, determines the operating position.
In one embodiment, first operation module includes:
First operation submodule, for according to it is described every the corresponding predetermined registration operation form of empty-handed gesture to the target object into Row is clicked, double-clicked, deleting, opening, closing, exiting, unloading and one or more operations on the move;Or
5th determines submodule, described pre- for being less than or equal in the vertical range every empty-handed gesture with the interface If apart from when, determine the current distance section where the length scale of the vertical range;
6th determines submodule, is used for according to preset every empty-handed gesture, between section and predetermined registration operation form three Corresponding relationship, from described corresponding with the current distance section every being determined in the corresponding predetermined registration operation form of empty-handed gesture Current operation form;
Second operation submodule, for according to the current operation form to the target object shown on the operating position It is operated.
In one embodiment, described every empty-handed gesture includes: that finger is clicked every sky, finger is double-clicked every sky, finger is sliding every sky Dynamic and palm is every at least one of sky translation gesture.
According to the third aspect of an embodiment of the present disclosure, one kind is additionally provided every empty gesture operation device, comprising:
Processor;
Memory for storage processor executable instruction;
Wherein, the processor is configured to:
Identification user in space relative to the interface done every empty-handed gesture;
According to described every empty-handed gesture, determined on the interface it is described every the corresponding operating position of empty-handed gesture, and in institute It states operating position and shows arrow mark;
The target object shown on the operating position is carried out every empty-handed gesture corresponding predetermined registration operation form according to described Operation.
The technical scheme provided by this disclosed embodiment can include the following benefits:
The technical scheme provided by this disclosed embodiment should accurately can be set at this according to what is identified every empty-handed gesture This is determined on standby interface every the corresponding operating position of empty-handed gesture, and then according to this every the corresponding predetermined registration operation shape of empty-handed gesture Formula operates the target object (such as application program, file, document) shown on the operating position, to realize Space-by-space operation is carried out to target object every empty-handed gesture using this, while family also can be used and know clearly target operation object, And understanding is to the entire space-by-space operation process of the target operation object.
It should be understood that above general description and following detailed description be only it is exemplary and explanatory, not The disclosure can be limited.
Detailed description of the invention
The drawings herein are incorporated into the specification and forms part of this specification, and shows the implementation for meeting the disclosure Example, and together with specification for explaining the principles of this disclosure.
Fig. 1 is a kind of flow chart every empty gesture operation method shown according to an exemplary embodiment.
Fig. 2 is another flow chart every empty gesture operation method shown according to an exemplary embodiment.
Fig. 3 is the flow chart according to another shown in an exemplary embodiment one every empty gesture operation method.
Fig. 4 A is the flow chart according to another shown in an exemplary embodiment one every empty gesture operation method.
Fig. 4 B is the flow chart according to another shown in an exemplary embodiment one every empty gesture operation method.
Fig. 5 is the flow chart according to another shown in an exemplary embodiment one every empty gesture operation method.
Fig. 6 is the flow chart according to another shown in an exemplary embodiment one every empty gesture operation method.
Fig. 7 is the flow chart according to another shown in an exemplary embodiment one every empty gesture operation method.
Fig. 8 is a kind of block diagram every empty gesture operation device shown according to an exemplary embodiment.
Fig. 9 is another block diagram every empty gesture operation device shown according to an exemplary embodiment.
Figure 10 be it is shown according to an exemplary embodiment another every empty gesture operation device block diagram.
Figure 11 A be it is shown according to an exemplary embodiment another every empty gesture operation device block diagram.
Figure 11 B be it is shown according to an exemplary embodiment another every empty gesture operation device block diagram.
Figure 12 be it is shown according to an exemplary embodiment another every empty gesture operation device block diagram.
Figure 13 be it is shown according to an exemplary embodiment another every empty gesture operation device block diagram.
Figure 14 A be it is shown according to an exemplary embodiment another every empty gesture operation device block diagram.
Figure 14 B be it is shown according to an exemplary embodiment another every empty gesture operation device block diagram.
Figure 15 is shown according to an exemplary embodiment suitable for referring to the block diagram every empty gesture operation device.
Specific embodiment
Example embodiments are described in detail here, and the example is illustrated in the accompanying drawings.Following description is related to When attached drawing, unless otherwise indicated, the same numbers in different drawings indicate the same or similar elements.Following exemplary embodiment Described in embodiment do not represent all implementations consistent with this disclosure.On the contrary, they be only with it is such as appended The example of the consistent device and method of some aspects be described in detail in claims, the disclosure.
Currently, gesture identification is essentially all the recognition methods based on contact, i.e. user does on the touch screen of terminal The operations such as some slidings, then terminal can carry out sequence of operations according to a series of gesture operations movement detected, and this must It must be based on touch screen, and user must carry out contact operation;But in fact, user sometimes want to carry out it is some every sky Operation, therefore, this operating method will bring some inconvenience to user.It is in the prior art in order to further facilitate user Some manufacturers are also that user is proposed and some can complete some operations by some contactless movements of identification user Equipment, but this operating method is still less accurate, and user does not know current practical operation situation, it is always muddleheaded Ground finishes epicycle game, does not also know where need to improve, brings many puzzlements to user.
In order to solve the above-mentioned technical problem, the embodiment of the present disclosure provides one kind every empty gesture operation method, and this method can For every in empty-handed gesture operation sequence, system or device, executing subject to can be the equipment such as terminal, as shown in Figure 1, this method Including step S101-S103:
In step s101, identification user in space relative to interface done every empty-handed gesture;
In step s 102, it according to every empty-handed gesture, determining operating position corresponding every empty-handed gesture on interface, and is grasping Make position and shows arrow mark;
According to this every empty-handed gesture, it can accurately determine this every the corresponding operative position of empty-handed gesture on the interface of the equipment It sets, and shows arrow mark (such as pointer, small hand icon) on the operating position, then can play suggesting effect, make user Specify current operating position.
In step s 103, according to every the corresponding predetermined registration operation form of empty-handed gesture to the target object shown on operating position It is operated.
Identifying that this, can be according to this every the corresponding predetermined registration operation form of empty-handed gesture, to the operative position after empty-handed gesture The target object (such as application program, file, document) for setting display is operated, such as: when this is corresponding every empty-handed gesture Predetermined registration operation form be open the target object when, so that it may the target object is opened according to the predetermined registration operation form, when this When the corresponding predetermined registration operation form of empty-handed gesture is to delete the target object, so that it may delete the mesh according to the predetermined registration operation form Object is marked, space-by-space operation should be carried out to target object every empty-handed gesture to realize and use, while family also can be used clearly Solve entire space-by-space operation process.
It certainly, may be that this is in moving process every empty-handed gesture if there is no target object on the operating position, It is not yet directed toward target object to be operated, then current operation is sky.
As shown in Fig. 2, in one embodiment, before step S101, method further include:
In step s 201, judge whether to get for opening the default unlatching gesture every empty hand gesture recognition mode;
In step S202, after getting default unlatching gesture, switch to every empty hand gesture recognition mode, to be transferred to identification Every the empty-handed gesture the step of.
In identification before empty-handed gesture, it is also necessary to judge whether the equipment receives unlatching and be somebody's turn to do every empty gesture identification mould The default unlatching gesture of formula illustrates that user it is expected that starting is somebody's turn to do every empty hand gesture recognition mode if getting default unlatching gesture, It should be every empty-handed gesture, so that space-by-space operation is realized, therefore, it is possible to switch to this every empty hand gesture recognition mode to start identification;Certainly, If not getting default unlatching gesture, user may be in order to avoid accidentally carrying out space-by-space operation, thus undesirable starting It should be every empty hand gesture recognition mode, at this point it is possible to not switch to this every empty hand gesture recognition mode.
As shown in figure 3, in one embodiment, before step S103, method further include:
In step S301, judge whether the vertical range between empty-handed gesture and interface is less than or equal to pre-determined distance;
In step s 302, it when vertical range is less than or equal to pre-determined distance, is transferred to according to corresponding pre- every empty-handed gesture If the step of operation format operates the target object shown on operating position.
In identification before empty-handed gesture, into after hand gesture recognition mode, under can also judging every empty-handed gesture and the interface it Between vertical range whether be less than or equal to pre-determined distance, with ensure only the vertical range be less than or equal to this it is default away from From, should be every in the sufficiently effective situation of empty-handed gesture, just according to should be every the corresponding predetermined registration operation form of empty-handed gesture to the target object It is operated;And be greater than the pre-determined distance in vertical range, identify in the case where should may be mistake every empty-handed gesture, not root The target object is operated every empty-handed gesture corresponding predetermined registration operation form according to this.
As shown in Figure 4 A, in one embodiment, before step S103, method further include:
In step S401, the matching rate every empty-handed gesture and default gesture is determined;
When determining matching rate, gesture can should be preset with each of pre-stored in this equipment every empty-handed gesture for what is done It is compared, to determine the highest default gesture of matching rate, and records the matching rate.
In step S402, when matching rate is greater than or equal to preset matching rate, it is transferred to according to corresponding pre- every empty-handed gesture If the step of operation format operates the target object shown on operating position;
When the matching rate is greater than or equal to preset matching rate, illustrate that user shows should be exactly the matching rate every empty-handed gesture The highest default gesture, then can according to this every the empty-handed gesture i.e. default corresponding predetermined registration operation form of gesture to the target pair As being operated.
Or
As shown in Figure 4 B, in one embodiment, before step S103, method further include:
In step S403, when matching rate is less than preset matching rate, prompt information is issued, to prompt the user whether basis Target object is operated every empty-handed gesture corresponding predetermined registration operation form;
When the matching rate is less than the preset matching rate, illustrate that user shows should every empty-handed gesture there is no preset hand with this Gesture meets very much, and what which identified is likely to be mistake every empty-handed gesture, then prompt information should be issued, to prompt user Identify that the recognition result every empty-handed gesture may be mistake, if need to continue according to should be every the empty-handed gesture i.e. default gesture pair The predetermined registration operation form answered operates the target object.And
In step s 404, receive for prompt information make when confirming gesture every sky, be transferred to according to every empty-handed The step of corresponding predetermined registration operation form of gesture operates target object.
Receive for the prompt information make when confirming gesture every sky, illustrate that customer acceptance identifies should be every sky Gesture, it is believed that should every empty-handed gesture be correctly, then can immediately according to every the corresponding predetermined registration operation form of empty-handed gesture to target pair As being operated, to meet the needs of user carries out space-by-space operation to the target object.
As shown in figure 5, in one embodiment, above-mentioned steps S102 can be performed as:
In step S501, the upright projection position every empty-handed gesture on interface is determined;
In step S502, determine that upright projection position is operating position.
When according to the operating position is determined every empty-handed gesture, the vertical throwing every empty-handed gesture on the surface can be first determined Shadow position, then directly determining the upright projection position is the operating position, so that the object on the upright projection position As target operation object.
As shown in fig. 6, in one embodiment, above-mentioned steps S102 can be performed as:
In step s 601, the current spatial location every empty-handed gesture relative to interface is determined;
When according to the operating position is determined every empty-handed gesture, the current spatial every empty-handed gesture relative to interface can also be determined Position, that is, the parallel plane where the interface of being subject to establish space coordinates, and then determining should sit every empty-handed gesture in the space Space coordinate in mark system certainly, can be with this every the finger tip or palm in empty-handed gesture in order to make the space coordinate in order to accurate Central point be reference point, and using the space coordinate of the reference point as the space coordinate every empty-handed gesture, in addition, if identification Out should every the finger tip in empty-handed gesture be it is multiple, then using highest finger tip in multiple finger tip as reference point, by the highest finger tip Space coordinate as the space coordinate every empty-handed gesture;
In step S602, according to everybody on preset current spatial location and interface every empty-handed gesture relative to interface Position mapping relations and current spatial location between setting, determine operating position.
It is mapped according to the position between each position on current spatial location and interface of the empty-handed gesture relative to interface Relationship and current spatial location can accurately determine out the current spatial location mapped operating position, according to Operation should be carried out to correct target object every the corresponding predetermined registration operation form of empty-handed gesture to lay the foundation.
As shown in fig. 7, in one embodiment, above-mentioned steps S103 can be performed as:
According to target object clicked every empty-handed gesture corresponding predetermined registration operation form, double-clicked, deleted, opened, closed, It exits, unload and one or more operations on the move;Or
It can should be to click, double-click, delete, open, close, exit, unload every the corresponding predetermined registration operation form of empty-handed gesture With a kind of operation on the move or a variety of operations, such as: when this is OK gesture, and the predetermined registration operation shape of the OK gesture every empty advantage Formula is when clicking with opening operation, then after identifying the OK gesture, so that it may first click the target object, then open the mesh Object is marked, also for example: when this is that index finger is upward every empty-handed gesture, other four fingers are fastened, and the index finger is upward, what other four fingers fastened The predetermined registration operation form of gesture is when exiting with unloading operation, then to identify that the index finger is upward, the gesture that other four fingers fasten Afterwards, so that it may first exit the target object, then unload the target object.
In step s 701, it when the vertical range every empty-handed gesture and interface is less than or equal to pre-determined distance, determines vertical Current distance section where the length scale of distance;
The vertical range every empty-handed gesture Yu the interface is less than or equal to the pre-determined distance, is to ensure that gesture identification accuracy Higher basis may further determine that the current distance area where the length scale of the vertical range is specific on this basis Between.
In step S702, according to preset every empty-handed gesture, the correspondence between section and predetermined registration operation form three Relationship determines current operation form corresponding with current distance section from every the corresponding predetermined registration operation form of empty-handed gesture;
On the basis of the vertical range is less than or equal to the pre-determined distance, in order to meet the individual demand of user, to the greatest extent This is possibly made full use of to carry out various different operations to target object every empty-handed gesture, it is even identical every empty-handed gesture, it hangs down Directly apart from place apart from section difference, the current operation form of the operating gesture be can also be different, therefore, should be every empty-handed working as When the corresponding a variety of predetermined registration operation forms of gesture, after determining the current distance section where the length scale of the vertical range, It can be according to preset every empty-handed gesture, the corresponding relationship between section and predetermined registration operation form three, from this every empty-handed gesture Current operation form corresponding with the current distance section is determined in corresponding a variety of predetermined registration operation forms, to determine most to accord with Share the current desired current operation form being somebody's turn to do every empty-handed gesture in family.
In step S703, the target object shown on operating position is operated according to current operation form.
And then exact operations are carried out to the target object according to the current operation format.
In one embodiment, every empty-handed gesture include: finger is clicked every sky, finger is double-clicked every sky, finger every sky sliding and Palm is every at least one of sky translation gesture.
It should can be that finger is clicked every sky, finger is double-clicked every sky, finger is translated every sky every sky sliding and palm every empty-handed gesture At least one of gesture, and it is different different predetermined registration operation forms is corresponded to every empty-handed gesture, so as to meet user to not With the different operation demand of target operation object.
The above-mentioned every empty gesture operation method of embodiment of the present disclosure offer is corresponded to, the embodiment of the present disclosure also provides one kind every sky Gesture operation device, as shown in figure 8, the device includes:
Identification module 801, be configured as identification user in space relative to the interface done every empty-handed gesture;
First determining module 802 is configured as being determined on the interface according to described every empty-handed gesture described every empty-handed The corresponding operating position of gesture, and arrow mark is shown in the operating position;
First operation module 803 is configured as according to described every the corresponding predetermined registration operation form of empty-handed gesture to the operation The target object shown on position is operated.
As shown in figure 9, in one embodiment, described device further include:
First judgment module 901, be configured as it is described identification user in space relative to the interface done every Before empty-handed gesture, judge whether to get the default unlatching gesture for being configured as opening every empty hand gesture recognition mode;
Switching module 902 is configured as after getting the default unlatching gesture, is switched to described every empty gesture identification Mode, it is described every empty-handed gesture to identify.
As shown in Figure 10, in one embodiment, described device further include:
Second judgment module 1001, be configured as according to it is described every the corresponding predetermined registration operation form of empty-handed gesture to the behaviour Before the target object for making to show on position is operated, the judgement vertical range between empty-handed gesture and the interface is It is no to be less than or equal to pre-determined distance;
Second operation module 1002 is configured as when the vertical range is less than or equal to the pre-determined distance, according to It is described that the target object shown on the operating position is operated every empty-handed gesture corresponding predetermined registration operation form.
As shown in Figure 11 A, in one embodiment, described device further include:
Second determining module 1101, be configured as according to it is described every the corresponding predetermined registration operation form of empty-handed gesture to the behaviour Before the target object for making to show on position is operated, the matching rate every empty-handed gesture and default gesture is determined;
Third operation module 1102 is configured as when the matching rate is greater than or equal to preset matching rate, according to described The target object shown on the operating position is operated every empty-handed gesture corresponding predetermined registration operation form;Or
As shown in Figure 11 B, in one embodiment, described device further include:
Cue module 1103 is configured as issuing prompt information when the matching rate is less than the preset matching rate, with It prompts the user whether to operate the target object every the corresponding predetermined registration operation form of empty-handed gesture according to described;And
4th operation module 1104, be configured as receive for the prompt information make every sky confirm gesture When, the target object is operated every empty-handed gesture corresponding predetermined registration operation form according to described.
As shown in figure 12, in one embodiment, first determining module 802 includes:
First determines submodule 8021, is configured to determine that the upright projection position every empty-handed gesture on the interface It sets;
Second determines submodule 8022, is configured to determine that the upright projection position is the operating position.
As shown in figure 13, in one embodiment, first determining module 802 further include:
Third determines submodule 8023, is configured to determine that the current spatial position every empty-handed gesture relative to the interface It sets;
4th determines submodule 8024, is configured as according to the preset current spatial every empty-handed gesture relative to the interface Position mapping relations and the current spatial location between each position on position and the interface, determine the operation Position.
As shown in Figure 14 A, in one embodiment, first operation module 803 includes:
First operation submodule 8031, is configured as according to described every the corresponding predetermined registration operation form of empty-handed gesture to the mesh Mark object is clicked, double-clicked, deleted, opened, closed, exited, unloaded and one or more operations on the move;Or
As shown in Figure 14B, in one embodiment, first operation module 803 includes:
5th determines submodule 8032, is configured as being less than or waiting every the vertical range at empty-handed gesture with the interface described When the pre-determined distance, the current distance section where the length scale of the vertical range is determined;
6th determines submodule 8033, is configured as according to preset every empty-handed gesture, apart from section and predetermined registration operation form Corresponding relationship between three is determined and the current distance from described every in the corresponding predetermined registration operation form of empty-handed gesture The corresponding current operation form in section;
Second operation submodule 8034 is configured as according to the current operation form to showing on the operating position Target object is operated.
In one embodiment, described every empty-handed gesture includes: that finger is clicked every sky, finger is double-clicked every sky, finger is sliding every sky Dynamic and palm is every at least one of sky translation gesture.
According to the third aspect of an embodiment of the present disclosure, one kind is provided every empty gesture operation device, comprising:
Processor;
Memory for storage processor executable instruction;
Wherein, processor is configured as:
Identification user in space relative to the interface done every empty-handed gesture;
According to described every empty-handed gesture, determined on the interface it is described every the corresponding operating position of empty-handed gesture, and in institute It states operating position and shows arrow mark;
The target object shown on the operating position is carried out every empty-handed gesture corresponding predetermined registration operation form according to described Operation.
Above-mentioned processor is also configured to:
It is described identification user in space relative to the interface done before empty-handed gesture, the method is also wrapped It includes:
Judge whether to get for opening the default unlatching gesture every empty hand gesture recognition mode;
After getting the default unlatching gesture, switch to it is described every empty hand gesture recognition mode, to be transferred to described in identification Every the empty-handed gesture the step of.
Above-mentioned processor is also configured to:
According to it is described every the corresponding predetermined registration operation form of empty-handed gesture to the target object shown on the operating position into Before row operation, the method also includes:
Whether the judgement vertical range between empty-handed gesture and the interface is less than or equal to pre-determined distance;
When the vertical range is less than or equal to the pre-determined distance, it is transferred to corresponding default every empty-handed gesture according to described The step of operation format operates the target object shown on the operating position.
Above-mentioned processor is also configured to:
According to it is described every the corresponding predetermined registration operation form of empty-handed gesture to the target object shown on the operating position into Before row operation, the method also includes:
Determine the matching rate every empty-handed gesture and default gesture;
When the matching rate is greater than or equal to preset matching rate, it is transferred to according to described every the corresponding predetermined registration operation of empty-handed gesture The step of form operates the target object shown on the operating position;Or
When the matching rate is less than the preset matching rate, prompt information is issued, to prompt the user whether according to The target object is operated every empty-handed gesture corresponding predetermined registration operation form;And
Receive for the prompt information make when confirming gesture every sky, be transferred to corresponding every empty-handed gesture according to described The predetermined registration operation form the step of target object is operated.
Above-mentioned processor is also configured to:
It is described according to every empty-handed gesture, determined on the interface described every the corresponding operating position of empty-handed gesture, packet It includes:
Determine the upright projection position every empty-handed gesture on the interface;
Determine that the upright projection position is the operating position.
Above-mentioned processor is also configured to:
It is described according to every empty-handed gesture, determined on the interface described every the corresponding operating position of empty-handed gesture, packet It includes:
Determine the current spatial location every empty-handed gesture relative to the interface;
According to it is preset every empty-handed gesture relative to the interface current spatial location and the interface on each position it Between position mapping relations and the current spatial location, determine the operating position.
Above-mentioned processor is also configured to:
It is described according to every the corresponding predetermined registration operation form of empty-handed gesture to the target object shown on the operating position It is operated, comprising:
It the target object is clicked every empty-handed gesture corresponding predetermined registration operation form, double-clicked, deleted, beaten according to described Open and close are closed, exited, unloading and one or more operations on the move;Or
When the vertical range every empty-handed gesture Yu the interface is less than or equal to the pre-determined distance, described hang down is determined Current distance section where the length scale of straight distance;
According to preset every empty-handed gesture, the corresponding relationship between section and predetermined registration operation form three, from it is described every Current operation form corresponding with the current distance section is determined in the corresponding predetermined registration operation form of empty-handed gesture;
The target object shown on the operating position is operated according to the current operation form.
Above-mentioned processor is also configured to:
Described every empty-handed gesture includes: that finger is clicked every sky, finger is double-clicked every sky, finger is translated every sky every sky sliding and palm At least one of gesture.
Figure 15 is a kind of block diagram for every empty gesture operation device 1500 shown according to an exemplary embodiment, the dress It sets and is suitable for terminal device.For example, device 1500 can be mobile phone, computer, digital broadcast terminal, information receiving and transmitting set It is standby, game console, tablet device, Medical Devices, body-building equipment, personal digital assistant etc..
Referring to Fig.1 5, device 1500 may include with next or at least two components: processing component 1502, memory 1504, power supply module 1506, multimedia component 1508, audio component 1510, input/output (I/O) interface 1512, sensor group Part 1514 and communication component 1516.
The integrated operation of the usual control device 1500 of processing component 1502, such as with display, telephone call, data communication, Camera operation and record operate associated operation.Processing component 1502 may include one or at least two processors 1520 It executes instruction, to perform all or part of the steps of the methods described above.In addition, processing component 1502 may include one or at least Two modules, convenient for the interaction between processing component 1502 and other assemblies.For example, processing component 1502 may include multimedia Module, to facilitate the interaction between multimedia component 1508 and processing component 1502.
Memory 1504 is configured as storing various types of data to support the operation in device 1500.These data Example includes the instruction for any storage object or method that operate on device 1500, contact data, telephone book data, Message, picture, video etc..Memory 1504 can by any kind of volatibility or non-volatile memory device or they Combination is realized, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), it is erasable can Program read-only memory (EPROM), programmable read only memory (PROM), read-only memory (ROM), magnetic memory, flash memory Reservoir, disk or CD.
Power supply module 1506 provides power supply for the various assemblies of device 1500.Power supply module 1506 may include power management System, one or at least two power supplys and other with for device 1500 generate, manage, and distribute the associated component of power supply.
Multimedia component 1508 includes the screen of one output interface of offer between described device 1500 and user.? In some embodiments, screen may include liquid crystal display (LCD) and touch panel (TP).If screen includes touch panel, Screen may be implemented as touch screen, to receive input signal from the user.Touch panel includes one or at least two touchings Sensor is touched to sense the gesture on touch, slide, and touch panel.The touch sensor can not only sense touch or cunning The boundary of movement, but also detect duration and pressure associated with the touch or slide operation.In some embodiments In, multimedia component 1508 includes a front camera and/or rear camera.When device 1500 is in operation mode, such as When screening-mode or video mode, front camera and/or rear camera can receive external multi-medium data.Before each Setting camera and rear camera can be a fixed optical lens system or has focusing and optical zoom capabilities.
Audio component 1510 is configured as output and/or input audio signal.For example, audio component 1510 includes a wheat Gram wind (MIC), when device 1500 is in operation mode, when such as call mode, recording mode, and voice recognition mode, microphone quilt It is configured to receive external audio signal.The received audio signal can be further stored in memory 1504 or via communication Component 1516 is sent.In some embodiments, audio component 1510 further includes a loudspeaker, is used for output audio signal.
I/O interface 1512 provides interface, above-mentioned peripheral interface module between processing component 1502 and peripheral interface module It can be keyboard, click wheel, button etc..These buttons may include, but are not limited to: home button, volume button, start button and Locking press button.
Sensor module 1514 includes one or at least two sensors, for providing the shape of various aspects for device 1500 State assessment.For example, sensor module 1514 can detecte the state that opens/closes of device 1500, the relative positioning of component, example Such as the display and keypad that the component is device 1500, sensor module 1514 can be with detection device 1500 or device The position change of 1500 1 components, the existence or non-existence that user contacts with device 1500,1500 orientation of device or acceleration/subtract The temperature change of speed and device 1500.Sensor module 1514 may include proximity sensor, be configured to not any Physical contact when detect the presence of nearby objects.Sensor module 1514 can also include optical sensor, as CMOS or CCD schemes As sensor, for being used in imaging applications.In some embodiments, which can also include acceleration Sensor, gyro sensor, Magnetic Sensor, pressure sensor or temperature sensor.
Communication component 1516 is configured to facilitate the communication of wired or wireless way between device 1500 and other equipment.Dress The wireless network based on communication standard, such as WiFi can be accessed by setting 1500,2G or 3G or their combination.It is exemplary at one In embodiment, communication component 1516 receives broadcast singal or broadcast correlation from external broadcasting management system via broadcast channel Information.In one exemplary embodiment, the communication component 1516 further includes near-field communication (NFC) module, to promote short distance Communication.For example, radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra wide band can be based in NFC module (UWB) technology, bluetooth (BT) technology and other technologies are realized.
In the exemplary embodiment, device 1500 can by one or at least two application specific integrated circuits (ASIC), Digital signal processor (DSP), digital signal processing appts (DSPD), programmable logic device (PLD), field-programmable gate array It arranges (FPGA), controller, microcontroller, microprocessor or other electronic components to realize, for executing the above method.
In the exemplary embodiment, a kind of non-transitorycomputer readable storage medium including instruction, example are additionally provided It such as include the memory 1504 of instruction, above-metioned instruction can be executed by the processor 1520 of device 1500 to complete the above method.Example Such as, the non-transitorycomputer readable storage medium can be ROM, random access memory (RAM), CD-ROM, tape, soft Disk and optical data storage devices etc..
A kind of non-transitorycomputer readable storage medium, when the instruction in the storage medium is by above-mentioned apparatus 1500 When processor executes, so that above-mentioned apparatus 1500 is able to carry out one kind every empty gesture operation method, comprising:
Identification user in space relative to the interface done every empty-handed gesture;
According to described every empty-handed gesture, determined on the interface it is described every the corresponding operating position of empty-handed gesture, and in institute It states operating position and shows arrow mark;
The target object shown on the operating position is carried out every empty-handed gesture corresponding predetermined registration operation form according to described Operation.
In one embodiment, it is described identification user in space relative to the interface done every empty-handed gesture it Before, the method also includes:
Judge whether to get for opening the default unlatching gesture every empty hand gesture recognition mode;
After getting the default unlatching gesture, switch to it is described every empty hand gesture recognition mode, to be transferred to described in identification Every the empty-handed gesture the step of.
In one embodiment, it is shown every the corresponding predetermined registration operation form of empty-handed gesture on the operating position according to described Before the target object shown is operated, the method also includes:
Whether the judgement vertical range between empty-handed gesture and the interface is less than or equal to pre-determined distance;
When the vertical range is less than or equal to the pre-determined distance, it is transferred to corresponding default every empty-handed gesture according to described The step of operation format operates the target object shown on the operating position.
In one embodiment, it is shown every the corresponding predetermined registration operation form of empty-handed gesture on the operating position according to described Before the target object shown is operated, the method also includes:
Determine the matching rate every empty-handed gesture and default gesture;
When the matching rate is greater than or equal to preset matching rate, it is transferred to according to described every the corresponding predetermined registration operation of empty-handed gesture The step of form operates the target object shown on the operating position;Or
When the matching rate is less than the preset matching rate, prompt information is issued, to prompt the user whether according to The target object is operated every empty-handed gesture corresponding predetermined registration operation form;And
Receive for the prompt information make when confirming gesture every sky, be transferred to corresponding every empty-handed gesture according to described The predetermined registration operation form the step of target object is operated.
In one embodiment, it is described according to every empty-handed gesture, determined on the interface described every empty-handed gesture pair The operating position answered, comprising:
Determine the upright projection position every empty-handed gesture on the interface;
Determine that the upright projection position is the operating position.
In one embodiment, it is described according to every empty-handed gesture, determined on the interface described every empty-handed gesture pair The operating position answered, comprising:
Determine the current spatial location every empty-handed gesture relative to the interface;
According to it is preset every empty-handed gesture relative to the interface current spatial location and the interface on each position it Between position mapping relations and the current spatial location, determine the operating position.
In one embodiment, it is described according to every the corresponding predetermined registration operation form of empty-handed gesture on the operating position The target object of display is operated, comprising:
It the target object is clicked every empty-handed gesture corresponding predetermined registration operation form, double-clicked, deleted, beaten according to described Open and close are closed, exited, unloading and one or more operations on the move;Or
When the vertical range every empty-handed gesture Yu the interface is less than or equal to the pre-determined distance, described hang down is determined Current distance section where the length scale of straight distance;
According to preset every empty-handed gesture, the corresponding relationship between section and predetermined registration operation form three, from it is described every Current operation form corresponding with the current distance section is determined in the corresponding predetermined registration operation form of empty-handed gesture;
The target object shown on the operating position is operated according to the current operation form.
In one embodiment, described every empty-handed gesture includes: that finger is clicked every sky, finger is double-clicked every sky, finger is sliding every sky Dynamic and palm is every at least one of sky translation gesture.
Those skilled in the art will readily occur to its of the disclosure after considering specification and practicing disclosure disclosed herein Its embodiment.This application is intended to cover any variations, uses, or adaptations of the disclosure, these modifications, purposes or Person's adaptive change follows the general principles of this disclosure and including the undocumented common knowledge in the art of the disclosure Or conventional techniques.The description and examples are only to be considered as illustrative, and the true scope and spirit of the disclosure are by following Claim is pointed out.
It should be understood that the present disclosure is not limited to the precise structures that have been described above and shown in the drawings, and And various modifications and changes may be made without departing from the scope thereof.The scope of the present disclosure is only limited by the accompanying claims.

Claims (16)

1.一种隔空手势操作方法,用于显示有界面的手持移动设备,其特征在于,包括:1. a gesture operation method in the air, for displaying the hand-held mobile device with an interface, it is characterized in that, comprising: 识别用户在空间中相对于所述界面所做的隔空手势;recognizing a spacer gesture made by the user in space relative to the interface; 根据所述隔空手势,在所述界面上确定出所述隔空手势对应的操作位置,并在所述操作位置显示指向标记;According to the air gesture, determining the operation position corresponding to the air gesture on the interface, and displaying a pointing mark at the operation position; 根据所述隔空手势对应的预设操作形式对所述操作位置上显示的目标对象进行操作;operate the target object displayed on the operation position according to the preset operation form corresponding to the air gesture; 所述根据所述隔空手势对应的预设操作形式对所述操作位置上显示的目标对象进行操作,包括:The operating the target object displayed on the operating position according to the preset operating form corresponding to the air gesture includes: 在所述隔空手势与所述界面的垂直距离小于或等于预设距离时,确定所述垂直距离的长度大小所在的当前距离区间;When the vertical distance between the air gesture and the interface is less than or equal to a preset distance, determining the current distance interval where the length of the vertical distance is located; 根据预设的隔空手势、距离区间、和预设操作形式三者之间的对应关系,从所述隔空手势对应的所述预设操作形式中确定出与所述当前距离区间对应的当前操作形式;According to the corresponding relationship among the preset air gestures, distance intervals, and preset operation forms, determine the current distance corresponding to the current distance interval from the preset operation forms corresponding to the air gestures form of operation; 根据所述当前操作形式对所述操作位置上显示的目标对象进行操作。The target object displayed on the operation position is operated according to the current operation form. 2.根据权利要求1所述的方法,其特征在于,2. The method according to claim 1, wherein 在所述识别用户在空间中相对于所述界面所做的隔空手势之前,所述方法还包括:Before the recognizing the in-air gesture performed by the user relative to the interface in space, the method further includes: 判断是否获取到用于开启隔空手势识别模式的预设开启手势;Determine whether a preset opening gesture for opening the air gesture recognition mode is obtained; 在获取到所述预设开启手势后,切换至所述隔空手势识别模式,以转入识别所述隔空手势的步骤。After acquiring the preset opening gesture, switch to the air gesture recognition mode to transfer to the step of recognizing the air gesture. 3.根据权利要求1所述的方法,其特征在于,3. The method according to claim 1, wherein 在根据所述隔空手势对应的预设操作形式对所述操作位置上显示的目标对象进行操作之前,所述方法还包括:Before operating the target object displayed on the operation position according to the preset operation form corresponding to the air gesture, the method further includes: 判断所述隔空手势与所述界面之间的垂直距离是否小于或等于所述预设距离;Determine whether the vertical distance between the air gesture and the interface is less than or equal to the preset distance; 当所述垂直距离小于或等于所述预设距离时,转入根据所述隔空手势对应的预设操作形式对所述操作位置上显示的目标对象进行操作的步骤。When the vertical distance is less than or equal to the preset distance, the operation proceeds to the step of operating the target object displayed on the operation position according to the preset operation form corresponding to the air gesture. 4.根据权利要求1所述的方法,其特征在于,4. The method of claim 1, wherein 在根据所述隔空手势对应的预设操作形式对所述操作位置上显示的目标对象进行操作之前,所述方法还包括:Before operating the target object displayed on the operation position according to the preset operation form corresponding to the air gesture, the method further includes: 确定所述隔空手势与预设手势的匹配率;determining the matching rate between the air gesture and the preset gesture; 当所述匹配率大于或等于预设匹配率时,转入根据所述隔空手势对应的预设操作形式对所述操作位置上显示的目标对象进行操作的步骤;或者When the matching rate is greater than or equal to a preset matching rate, proceed to the step of operating the target object displayed on the operating position according to the preset operating form corresponding to the air gesture; or 当所述匹配率小于所述预设匹配率时,发出提示信息,以提示用户是否根据所述隔空手势对应的预设操作形式对所述目标对象进行操作;以及When the matching rate is less than the preset matching rate, sending out prompt information to prompt the user whether to operate the target object according to the preset operation form corresponding to the air gesture; and 在接收到针对所述提示信息作出的隔空确认手势时,转入根据所述隔空手势对应的预设操作形式对所述目标对象进行操作的步骤。When an air-space confirmation gesture for the prompt information is received, the operation proceeds to the step of operating the target object according to a preset operation form corresponding to the air-space gesture. 5.根据权利要求1至4中任一项所述的方法,其特征在于,5. The method according to any one of claims 1 to 4, characterized in that, 所述根据所述隔空手势,在所述界面上确定出所述隔空手势对应的操作位置,包括:Determining, on the interface, the operating position corresponding to the air-space gesture according to the air-space gesture, including: 确定所述隔空手势在所述界面上的垂直投影位置;determining the vertical projection position of the space gesture on the interface; 确定所述垂直投影位置为所述操作位置。The vertical projection position is determined as the operation position. 6.根据权利要求1至4中任一项所述的方法,其特征在于,6. The method according to any one of claims 1 to 4, characterized in that, 所述根据所述隔空手势,在所述界面上确定出所述隔空手势对应的操作位置,包括:Determining, on the interface, the operating position corresponding to the air-space gesture according to the air-space gesture, including: 确定所述隔空手势相对于所述界面的当前空间位置;determining the current spatial position of the air gesture relative to the interface; 根据预设的隔空手势相对于所述界面的当前空间位置与所述界面上的各位置之间的位置映射关系、和所述当前空间位置,确定出所述操作位置。The operation position is determined according to the position mapping relationship between the preset air gesture relative to the current spatial position of the interface and each position on the interface, and the current spatial position. 7.根据权利要求1至4中任一项所述的方法,其特征在于,7. The method according to any one of claims 1 to 4, characterized in that, 所述隔空手势包括:手指隔空单击、手指隔空双击、手指隔空滑动和手掌隔空平移中的至少一种手势。The air gestures include: at least one gesture of finger air click, finger air double-tap, finger air slide, and palm air translation. 8.一种隔空手势操作装置,用于显示有界面的手持移动设备,其特征在于,包括:8. An air gesture operating device for displaying a handheld mobile device with an interface, characterized in that, comprising: 识别模块,用于识别用户在空间中相对于所述界面所做的隔空手势;an identification module, used for recognizing the air gestures made by the user relative to the interface in space; 第一确定模块,用于根据所述隔空手势,在所述界面上确定出所述隔空手势对应的操作位置,并在所述操作位置显示指向标记;a first determining module, configured to determine an operation position corresponding to the air-space gesture on the interface according to the air-space gesture, and display a pointing mark at the operation position; 第一操作模块,用于根据所述隔空手势对应的预设操作形式对所述操作位置上显示的目标对象进行操作;a first operation module, configured to operate the target object displayed on the operation position according to the preset operation form corresponding to the air gesture; 第五确定子模块,用于在所述隔空手势与所述界面的垂直距离小于或等于预设距离时,确定所述垂直距离的长度大小所在的当前距离区间;The fifth determination submodule is used to determine the current distance interval where the length of the vertical distance is located when the vertical distance between the air gesture and the interface is less than or equal to a preset distance; 第六确定子模块,用于根据预设的隔空手势、距离区间、和预设操作形式三者之间的对应关系,从所述隔空手势对应的所述预设操作形式中确定出与所述当前距离区间对应的当前操作形式;The sixth determination sub-module is configured to determine, from the preset operation forms corresponding to the air gestures, the corresponding relationship between the preset air gestures, the distance interval, and the preset operation forms. the current operation form corresponding to the current distance interval; 第二操作子模块,用于根据所述当前操作形式对所述操作位置上显示的目标对象进行操作。The second operation sub-module is configured to operate the target object displayed on the operation position according to the current operation form. 9.根据权利要求8所述的隔空手势操作装置,其特征在于,所述隔空手势操作装置还包括:9. The air gesture operation device according to claim 8, wherein the air gesture operation device further comprises: 第一判断模块,用于在所述识别用户在空间中相对于所述界面所做的隔空手势之前,判断是否获取到用于开启隔空手势识别模式的预设开启手势;a first judgment module, configured to determine whether a preset opening gesture for opening the air gesture recognition mode is obtained before the recognition of the space gesture made by the user relative to the interface in space; 切换模块,用于在获取到所述预设开启手势后,切换至所述隔空手势识别模式,以识别所述隔空手势的。The switching module is configured to switch to the air gesture recognition mode after acquiring the preset open gesture, so as to recognize the air gesture. 10.根据权利要求8所述的隔空手势操作装置,其特征在于,所述隔空手势操作装置还包括:10 . The air gesture operation device according to claim 8 , wherein the air gesture operation device further comprises: 10 . 第二判断模块,用于在根据所述隔空手势对应的预设操作形式对所述操作位置上显示的目标对象进行操作之前,判断所述隔空手势与所述界面之间的垂直距离是否小于或等于所述预设距离;The second judgment module is configured to judge whether the vertical distance between the space gesture and the interface is before the target object displayed on the operation position is operated according to the preset operation form corresponding to the space gesture less than or equal to the preset distance; 第二操作模块,用于当所述垂直距离小于或等于所述预设距离时,根据所述隔空手势对应的预设操作形式对所述操作位置上显示的目标对象进行操作。The second operation module is configured to operate the target object displayed on the operation position according to the preset operation form corresponding to the air gesture when the vertical distance is less than or equal to the preset distance. 11.根据权利要求8所述的隔空手势操作装置,其特征在于,所述隔空手势操作装置还包括:11. The air gesture operation device according to claim 8, wherein the air gesture operation device further comprises: 第二确定模块,用于在根据所述隔空手势对应的预设操作形式对所述操作位置上显示的目标对象进行操作之前,确定所述隔空手势与预设手势的匹配率;a second determining module, configured to determine the matching rate between the air-space gesture and the preset gesture before operating the target object displayed on the operation position according to the preset operation form corresponding to the air-space gesture; 第三操作模块,用于当所述匹配率大于或等于预设匹配率时,根据所述隔空手势对应的预设操作形式对所述操作位置上显示的目标对象进行操作;或者a third operation module, configured to operate the target object displayed on the operation position according to the preset operation form corresponding to the air gesture when the matching rate is greater than or equal to the preset matching rate; or 提示模块,用于当所述匹配率小于所述预设匹配率时,发出提示信息,以提示用户是否根据所述隔空手势对应的预设操作形式对所述目标对象进行操作;以及a prompting module, configured to issue prompt information when the matching rate is less than the preset matching rate, to prompt the user whether to operate the target object according to the preset operation form corresponding to the air gesture; and 第四操作模块,用于在接收到针对所述提示信息作出的隔空确认手势时,根据所述隔空手势对应的预设操作形式对所述目标对象进行操作。The fourth operation module is configured to operate the target object according to the preset operation form corresponding to the air-space gesture when receiving the air-space confirmation gesture made for the prompt information. 12.根据权利要求8至11中任一项所述的隔空手势操作装置,其特征在于,12. The air gesture operating device according to any one of claims 8 to 11, wherein, 所述第一确定模块包括:The first determining module includes: 第一确定子模块,用于确定所述隔空手势在所述界面上的垂直投影位置;a first determination submodule, used for determining the vertical projection position of the air gesture on the interface; 第二确定子模块,用于确定所述垂直投影位置为所述操作位置。The second determination submodule is configured to determine the vertical projection position as the operation position. 13.根据权利要求8至11中任一项所述的隔空手势操作装置,其特征在于,13. The air gesture operating device according to any one of claims 8 to 11, wherein, 所述第一确定模块还包括:The first determining module further includes: 第三确定子模块,用于确定所述隔空手势相对于所述界面的当前空间位置;a third determination submodule, configured to determine the current spatial position of the air gesture relative to the interface; 第四确定子模块,用于根据预设的隔空手势相对于所述界面的当前空间位置与所述界面上的各位置之间的位置映射关系、和所述当前空间位置,确定出所述操作位置。The fourth determination sub-module is configured to determine the said operating position. 14.根据权利要求8至11中任一项所述的隔空手势操作装置,其特征在于,14. The air gesture operating device according to any one of claims 8 to 11, wherein, 所述隔空手势包括:手指隔空单击、手指隔空双击、手指隔空滑动和手掌隔空平移中的至少一种手势。The air gestures include: at least one gesture of finger air click, finger air double-tap, finger air slide, and palm air translation. 15.一种隔空手势操作装置,其特征在于,包括:15. An air gesture operating device, characterized in that, comprising: 处理器;processor; 用于存储处理器可执行指令的存储器;memory for storing processor-executable instructions; 其中,所述处理器被配置为:wherein the processor is configured to: 识别用户在空间中相对于界面所做的隔空手势;Recognize space gestures made by the user relative to the interface in space; 根据所述隔空手势,在所述界面上确定出所述隔空手势对应的操作位置,并在所述操作位置显示指向标记;According to the air gesture, determining the operation position corresponding to the air gesture on the interface, and displaying a pointing mark at the operation position; 根据所述隔空手势对应的预设操作形式对所述操作位置上显示的目标对象进行操作;operate the target object displayed on the operation position according to the preset operation form corresponding to the air gesture; 所述根据所述隔空手势对应的预设操作形式对所述操作位置上显示的目标对象进行操作,包括:The operating the target object displayed on the operating position according to the preset operating form corresponding to the air gesture includes: 在所述隔空手势与所述界面的垂直距离小于或等于所述预设距离时,确定所述垂直距离的长度大小所在的当前距离区间;When the vertical distance between the air gesture and the interface is less than or equal to the preset distance, determining the current distance interval where the length of the vertical distance is located; 根据预设的隔空手势、距离区间、和预设操作形式三者之间的对应关系,从所述隔空手势对应的所述预设操作形式中确定出与所述当前距离区间对应的当前操作形式;According to the corresponding relationship among the preset air gestures, distance intervals, and preset operation forms, determine the current distance corresponding to the current distance interval from the preset operation forms corresponding to the air gestures form of operation; 根据所述当前操作形式对所述操作位置上显示的目标对象进行操作。The target object displayed on the operation position is operated according to the current operation form. 16.一种非临时性计算机可读存储介质,其上存储有计算机程序,其特征在于,所述程序被处理器执行时实现权利要求1至7中任一项所述方法的步骤。16. A non-transitory computer-readable storage medium on which a computer program is stored, characterized in that, when the program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.
CN201610350215.5A 2016-05-24 2016-05-24 Air gesture operation method and device Active CN106055098B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610350215.5A CN106055098B (en) 2016-05-24 2016-05-24 Air gesture operation method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610350215.5A CN106055098B (en) 2016-05-24 2016-05-24 Air gesture operation method and device

Publications (2)

Publication Number Publication Date
CN106055098A CN106055098A (en) 2016-10-26
CN106055098B true CN106055098B (en) 2019-03-15

Family

ID=57174342

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610350215.5A Active CN106055098B (en) 2016-05-24 2016-05-24 Air gesture operation method and device

Country Status (1)

Country Link
CN (1) CN106055098B (en)

Families Citing this family (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107239201A (en) * 2017-06-30 2017-10-10 珠海市魅族科技有限公司 Display content operating method, device, terminal and storage medium
CN108829319B (en) * 2018-06-15 2020-09-01 驭势科技(北京)有限公司 Interaction method and device for touch screen, electronic equipment and storage medium
CN109240571A (en) * 2018-07-11 2019-01-18 维沃移动通信有限公司 A kind of control device, terminal and control method
CN110908578A (en) * 2018-09-18 2020-03-24 网易(杭州)网络有限公司 Virtual object moving method and device
CN111198644B (en) * 2018-11-16 2023-10-27 西安易朴通讯技术有限公司 Screen operation identification method and system of intelligent terminal
CN111338461A (en) * 2018-12-18 2020-06-26 鸿合科技股份有限公司 Gesture operation method and device, and electronic device
CN110448903A (en) * 2019-01-22 2019-11-15 网易(杭州)网络有限公司 Determination method, apparatus, processor and the terminal of control strategy in game
CN110045819B (en) * 2019-03-01 2021-07-09 华为技术有限公司 A gesture processing method and device
CN117784927A (en) * 2019-08-19 2024-03-29 华为技术有限公司 Interaction method and electronic device for space gestures
CN111736688B (en) * 2020-02-27 2025-01-14 珠海市杰理科技股份有限公司 Bluetooth headset, system and gesture recognition method thereof
CN111309153B (en) * 2020-03-25 2024-04-09 北京百度网讯科技有限公司 Man-machine interaction control method and device, electronic equipment and storage medium
EP4553631A3 (en) * 2020-04-30 2025-07-30 Shenzhen Yinwang Intelligent Technologies Co., Ltd. Control method and apparatus based on mid-air gesture, and system
CN112015270A (en) * 2020-08-21 2020-12-01 上海擎感智能科技有限公司 Terminal control method, terminal and computer storage medium
CN112445340B (en) * 2020-11-13 2022-10-25 杭州易现先进科技有限公司 AR desktop interaction method and device, electronic equipment and computer storage medium
CN112543248A (en) * 2020-11-24 2021-03-23 深圳传音控股股份有限公司 Air-separating operation method, terminal and storage medium
CN112278668B (en) * 2020-12-23 2021-07-23 福建工蜂物联科技有限公司 Garbage putting management method, system and device
CN112699796B (en) * 2020-12-30 2024-11-15 维沃移动通信有限公司 Method and device for operating electronic equipment
CN115484394B (en) * 2021-06-16 2023-11-14 荣耀终端有限公司 Guide use method of air separation gesture and electronic equipment
CN113791685A (en) * 2021-08-16 2021-12-14 青岛海尔科技有限公司 Method and device for moving component, electronic equipment and storage medium
CN117032447B (en) * 2022-05-31 2024-07-26 荣耀终端有限公司 Method, device, electronic chip and electronic device for air gesture interaction
CN115904065A (en) * 2022-11-01 2023-04-04 蓝影(重庆)数字科技有限公司 A separate empty gesture operation three-dimensional model viewing system for in operating room

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1517228A2 (en) * 2003-09-16 2005-03-23 Smart Technologies, Inc. Gesture recognition method and touch system incorporating the same
CN103529942A (en) * 2006-06-28 2014-01-22 诺基亚公司 Touchless gesture-based input
CN104898981A (en) * 2015-06-29 2015-09-09 安一恒通(北京)科技有限公司 Gesture recognizing method, device and terminal
CN104992156A (en) * 2015-07-07 2015-10-21 济南大学 Gesture control method based on flexible mapping between gesture and multiple meanings
CN105190520A (en) * 2013-03-13 2015-12-23 微软技术许可有限责任公司 Hover gestures for touch-enabled devices

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1517228A2 (en) * 2003-09-16 2005-03-23 Smart Technologies, Inc. Gesture recognition method and touch system incorporating the same
CN103529942A (en) * 2006-06-28 2014-01-22 诺基亚公司 Touchless gesture-based input
CN105190520A (en) * 2013-03-13 2015-12-23 微软技术许可有限责任公司 Hover gestures for touch-enabled devices
CN104898981A (en) * 2015-06-29 2015-09-09 安一恒通(北京)科技有限公司 Gesture recognizing method, device and terminal
CN104992156A (en) * 2015-07-07 2015-10-21 济南大学 Gesture control method based on flexible mapping between gesture and multiple meanings

Also Published As

Publication number Publication date
CN106055098A (en) 2016-10-26

Similar Documents

Publication Publication Date Title
CN106055098B (en) Air gesture operation method and device
CN104536684B (en) interface display method and device
CN106547663B (en) Key management method and device
EP2441271B1 (en) Mobile device which automatically determines operating mode
CN103955275B (en) Application control method and apparatus
CN105373334B (en) Interactive screen control method and device
CN105677473B (en) A method and device for switching application programs
CN105224171B (en) Icon display method, device and terminal
CN107800955A (en) The control method and storage medium of communicator, communicator
CN106873834A (en) Method and device and mobile terminal that key range is triggered
CN105487798B (en) The method and device that messaging application is operated on touch screen terminal
CN105487805A (en) Object operating method and device
CN105515952B (en) Method of sending message in multimedia and device
CN106648063A (en) Gesture recognition method and device
CN109144385A (en) The moving method and device of suspension ball
CN103942047A (en) User instruction execution method and device
CN105376410B (en) Alarm clock setting method and device
CN109358929A (en) Split-screen display method, device and storage medium
WO2017075896A1 (en) Method and device for exchanging icon locations
CN112905035B (en) Touch screen control method and device and computer storage medium
CN105204712B (en) The display methods and device of folder icon
CN106325621B (en) Mobile terminal and touch-responsive method
CN111610921A (en) Gesture recognition method and device
CN108920079A (en) Gesture identification method and device
CN109359441A (en) Permission configuration method and device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant