CN106200967A - A method for terminal projection gesture control - Google Patents
A method for terminal projection gesture control Download PDFInfo
- Publication number
- CN106200967A CN106200967A CN201610543724.XA CN201610543724A CN106200967A CN 106200967 A CN106200967 A CN 106200967A CN 201610543724 A CN201610543724 A CN 201610543724A CN 106200967 A CN106200967 A CN 106200967A
- Authority
- CN
- China
- Prior art keywords
- gesture
- terminal
- projection
- camera
- area
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Projection Apparatus (AREA)
Abstract
Description
技术领域technical field
本发明通信领域，尤其涉及一种终端投射手势控制的方法。The present invention relates to the communication field, and in particular to a method for terminal projection gesture control.
技术领域technical field
随着智能终端的发展，智能终端在市场上越来越普及。With the development of smart terminals, smart terminals are becoming more and more popular in the market.
目前智能终端的显示屏均是触摸显示屏，用户通过对显示屏的触摸手势操作，向终端发送控制指令，终端响应该控制指令，从而进行相应的操作。比如，用户对显示屏进行滑动手势操作，终端则对显示屏的应用页面进行翻页；用户对显示屏进行点击手势操作，终端则对显示屏中的应用对象进行选择操作；用户对显示屏进行双指滑动手势操作，终端则对显示屏中应用对象进行缩放操作。At present, the display screens of smart terminals are all touch display screens. Users send control commands to the terminal through touch gesture operations on the display screen, and the terminal responds to the control commands to perform corresponding operations. For example, the user performs a sliding gesture operation on the display screen, and the terminal performs page turning on the application page of the display screen; the user performs a click gesture operation on the display screen, and the terminal selects an application object in the display screen; Two-finger slide gesture operation, and the terminal performs zoom operation on the application object in the display screen.
但是，这种控制方式会使得用户的手指遮盖住一部分的显示屏，使得用户无法看到被遮盖的显示屏所显示的内容，导致用户的体验不佳。However, this control method will cause the user's finger to cover a part of the display screen, so that the user cannot see the content displayed on the covered display screen, resulting in poor user experience.
发明内容Contents of the invention
本发明提供了一种终端投射手势控制的方法。The invention provides a method for terminal projection gesture control.
本发明提供的终端投射手势控制的方法，包括：The method for terminal projection gesture control provided by the present invention includes:
终端通过手势摄像头实时采集用户的投射手势，所述投射手势用于向所述终端发送控制指令；The terminal collects the user's projection gestures in real time through the gesture camera, and the projection gestures are used to send control instructions to the terminal;
所述终端在显示屏上显示所述投射手势在所述显示屏上所投射的位置；The terminal displays on the display screen the projected position of the projection gesture on the display screen;
所述终端响应所述投射手势所对应的控制指令；The terminal responds to a control instruction corresponding to the projection gesture;
所述终端根据所述控制指令进行相应的操作。The terminal performs corresponding operations according to the control instruction.
可选地，所述投射手势包括滑动投射手势，所述滑动投射手势用于向终端发送滑动控制指令；Optionally, the projection gesture includes a sliding projection gesture, and the sliding projection gesture is used to send a sliding control instruction to the terminal;
所述终端根据所述控制指令进行相应的操作，包括：The terminal performs corresponding operations according to the control instructions, including:
所述终端根据所述滑动控制指令对所述显示屏进行滑动操作。The terminal performs a sliding operation on the display screen according to the sliding control instruction.
可选地，所述投射手势包括双指互搓投射手势，所述双指互搓投射手势用于向终端发送缩放控制指令；Optionally, the projection gesture includes a two-finger rubbing projection gesture, and the two-finger rubbing projection gesture is used to send a zoom control instruction to the terminal;
所述终端根据所述控制指令进行相应的操作，包括：The terminal performs corresponding operations according to the control instructions, including:
所述终端根据所述缩放指令对所述双指互搓投射手势在所述显示屏所投射的位置的对象进行缩放。The terminal zooms the object at the position projected by the two-finger rubbing gesture on the display screen according to the zoom instruction.
可选地，所述投射手势包括点击投射手势，所述点击投射手势用于向终端发送选择控制指令；Optionally, the projection gesture includes a click and projection gesture, and the click and projection gesture is used to send a selection control instruction to the terminal;
所述终端根据所述控制指令进行相应的操作，包括：The terminal performs corresponding operations according to the control instructions, including:
所述终端根据所述选择控制指令对所述点击投射手势在所述显示屏所投射的位置上所对应的对象进行选择。The terminal selects the object corresponding to the projection position of the click and projection gesture on the display screen according to the selection control instruction.
可选地，所述方法还包括：Optionally, the method also includes:
所述终端创建手势工作区域和投射区域，所述投射区域包含所述手势摄像头的拍摄范围；The terminal creates a gesture working area and a projection area, and the projection area includes the shooting range of the gesture camera;
所述终端获取自身的位置参数；The terminal acquires its own location parameters;
所述终端根据所述位置参数调整所述投射区域，以使得所述兴趣区域覆盖所述手势工作区域。The terminal adjusts the projection area according to the position parameter, so that the interest area covers the gesture working area.
可选地，所述终端根据所述位置参数调整所述投射区域包括：Optionally, the terminal adjusting the projection area according to the position parameter includes:
当所述手势摄像头进行俯视或仰视时，所述终端通过所述位置参数获得俯仰角，所述俯仰角用于指示所述终端向下或向上偏移的角度；When the gesture camera is looking down or looking up, the terminal obtains a pitch angle through the position parameter, and the pitch angle is used to indicate a downward or upward offset angle of the terminal;
所述终端根据所述俯仰角利用第一关系式计算手势识别摄像头的调整角度；The terminal calculates the adjustment angle of the gesture recognition camera by using the first relational expression according to the pitch angle;
所述终端根据所述调整角度调整反射镜的角度和/或通过旋转马达调整所述手势识别摄像头的拍摄角度，进而调整所述投射区域，所述反射镜用于将所述终端的视野范围内的影像反射进所述手势识别摄像头的拍摄范围内；The terminal adjusts the angle of the mirror according to the adjustment angle and/or adjusts the shooting angle of the gesture recognition camera by rotating the motor, thereby adjusting the projection area. The image reflected into the shooting range of the gesture recognition camera;
所述第一关系式为：The first relational expression is:
或，or,
所述(Xworld,Yworld,Zworld)为所述手势工作区域的坐标，所述(Xcamera,Ycamera,Zcamera)为所述投射区域的坐标，所述为所述俯仰角，所述φ为所述调整角度，所述θ为所述投射区域的视角度，所述1为所述手势摄像头的长度，所述dx为所述手势摄像头与所述手势工作区域的垂直距离，所述dz为所述手势摄像头与所述手势工作区域的水平距离。The (X world , Y world , Z world ) are the coordinates of the gesture work area, the (X camera , Y camera , Z camera ) are the coordinates of the projection area, and the is the pitch angle, the φ is the adjustment angle, the θ is the viewing angle of the projection area, the 1 is the length of the gesture camera, and the d x is the distance between the gesture camera and the The vertical distance of the gesture working area, and the d z is the horizontal distance between the gesture camera and the gesture working area.
本发明可以通过摄像头采集用户的投射手势操作，从而根据用户的投射手势操作对终端进行相应的操作，避免了用户通过手指对显示屏进行触摸操作而遮盖一部分显示屏带来的不良影响。The present invention can collect the user's projection gesture operation through the camera, so as to perform corresponding operations on the terminal according to the user's projection gesture operation, and avoid the adverse effect caused by the user touching the display screen with fingers and covering a part of the display screen.
附图说明Description of drawings
图1为终端投射手势控制的流程示意图。FIG. 1 is a schematic flow chart of terminal projection gesture control.
具体实施方式detailed description
为了使本领域的技术人员更好的理解本发明的技术方案，下面结合附图和具体实施方式对本发明作进一步的详细说明。In order to enable those skilled in the art to better understand the technical solutions of the present invention, the present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments.
请参阅图1，本发明实施例中一种终端投射手势控制的方法包括：Please refer to FIG. 1, a method for terminal projection gesture control in an embodiment of the present invention includes:
101、终端通过手势摄像头实时采集用户的投射手势，所述投射手势用于向所述终端发送控制指令；101. The terminal collects the projection gesture of the user in real time through the gesture camera, and the projection gesture is used to send a control instruction to the terminal;
所述投射手势为非触摸显示屏的手势。The projection gesture is a non-touch display gesture.
102、所述终端在显示屏上显示所述投射手势在所述显示屏上所投射的位置；102. The terminal displays on the display screen the projected position of the projection gesture on the display screen;
显示屏上显示所述投射手势在所述显示屏上所投射的位置可以用鼠标等标志性图像进行表示。The position displayed on the display screen where the projection gesture is projected on the display screen may be represented by a symbolic image such as a mouse.
103、所述终端响应所述投射手势所对应的控制指令；103. The terminal responds to a control instruction corresponding to the projection gesture;
104、所述终端根据所述控制指令进行相应的操作。104. The terminal performs a corresponding operation according to the control instruction.
参照图1实施例，可选地，所述投射手势包括滑动投射手势，所述滑动投射手势用于向终端发送滑动控制指令；Referring to the embodiment in FIG. 1, optionally, the projection gesture includes a sliding projection gesture, and the sliding projection gesture is used to send a sliding control instruction to the terminal;
所述终端根据所述控制指令进行相应的操作，包括：The terminal performs corresponding operations according to the control instructions, including:
所述终端根据所述滑动控制指令对所述显示屏进行滑动操作。The terminal performs a sliding operation on the display screen according to the sliding control instruction.
参照图1实施例，可选地，所述投射手势包括双指互搓投射手势，所述双指互搓投射手势用于向终端发送缩放控制指令；Referring to the embodiment in FIG. 1 , optionally, the projection gesture includes a two-finger rubbing projection gesture, and the two-finger rubbing projection gesture is used to send a zoom control instruction to the terminal;
所述终端根据所述控制指令进行相应的操作，包括：The terminal performs corresponding operations according to the control instructions, including:
所述终端根据所述缩放指令对所述双指互搓投射手势在所述显示屏所投射的位置的对象进行缩放。The terminal zooms the object at the position projected by the two-finger rubbing gesture on the display screen according to the zoom instruction.
参照图1实施例，可选地，所述投射手势包括点击投射手势，所述点击投射手势用于向终端发送选择控制指令；Referring to the embodiment in FIG. 1, optionally, the projection gesture includes a click and projection gesture, and the click and projection gesture is used to send a selection control instruction to the terminal;
所述终端根据所述控制指令进行相应的操作，包括：The terminal performs corresponding operations according to the control instructions, including:
所述终端根据所述选择控制指令对所述点击投射手势在所述显示屏所投射的位置上所对应的对象进行选择。The terminal selects the object corresponding to the projection position of the click and projection gesture on the display screen according to the selection control instruction.
参照图1实施例，可选地，所述方法还包括：Referring to the embodiment in FIG. 1, optionally, the method further includes:
所述终端创建手势工作区域和投射区域，所述投射区域包含所述手势摄像头的拍摄范围；The terminal creates a gesture working area and a projection area, and the projection area includes the shooting range of the gesture camera;
所述终端获取自身的位置参数；The terminal acquires its own location parameters;
所述终端根据所述位置参数调整所述投射区域，以使得所述兴趣区域覆盖所述手势工作区域。The terminal adjusts the projection area according to the position parameter, so that the interest area covers the gesture working area.
参照图1实施例，可选地，所述终端根据所述位置参数调整所述投射区域包括：Referring to the embodiment in FIG. 1, optionally, the terminal adjusting the projection area according to the position parameter includes:
当所述手势摄像头进行俯视或仰视时，所述终端通过所述位置参数获得俯仰角，所述俯仰角用于指示所述终端向下或向上偏移的角度；When the gesture camera is looking down or looking up, the terminal obtains a pitch angle through the position parameter, and the pitch angle is used to indicate a downward or upward offset angle of the terminal;
所述终端根据所述俯仰角利用第一关系式计算手势识别摄像头的调整角度；The terminal calculates the adjustment angle of the gesture recognition camera by using the first relational expression according to the pitch angle;
所述终端根据所述调整角度调整反射镜的角度和/或通过旋转马达调整所述手势识别摄像头的拍摄角度，进而调整所述投射区域，所述反射镜用于将所述终端的视野范围内的影像反射进所述手势识别摄像头的拍摄范围内；The terminal adjusts the angle of the mirror according to the adjustment angle and/or adjusts the shooting angle of the gesture recognition camera by rotating the motor, thereby adjusting the projection area. The image reflected into the shooting range of the gesture recognition camera;
所述第一关系式为：The first relational expression is:
或，or,
所述(Xworld,Yworld,Zworld)为所述手势工作区域的坐标，所述(Xcamera,Ycamera,Zcamera)为所述投射区域的坐标，所述为所述俯仰角，所述φ为所述调整角度，所述θ为所述投射区域的视角度，所述1为所述手势摄像头的长度，所述dx为所述手势摄像头与所述手势工作区域的垂直距离，所述dz为所述手势摄像头与所述手势工作区域的水平距离。The (X world , Y world , Z world ) are the coordinates of the gesture work area, the (X camera , Y camera , Z camera ) are the coordinates of the projection area, and the is the pitch angle, the φ is the adjustment angle, the θ is the viewing angle of the projection area, the 1 is the length of the gesture camera, and the d x is the distance between the gesture camera and the The vertical distance of the gesture working area, and the d z is the horizontal distance between the gesture camera and the gesture working area.
以上所述，以上实施例仅用以说明本发明的技术方案，而非对其限制；尽管参照前述实施例对本发明进行了详细的说明，本领域的普通技术人员应当理解：其依然可以对前述各实施例所记载的技术方案进行修改，或者对其中部分技术特征进行等同替换；而这些修改或者替换，并不使相应技术方案的本质脱离本发明各实施例技术方案的精神和范围。As mentioned above, the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: it can still understand the foregoing The technical solutions recorded in each embodiment are modified, or some of the technical features are replaced equivalently; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the various embodiments of the present invention.
Claims (6)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610543724.XA CN106200967A (en) | 2016-07-09 | 2016-07-09 | A method for terminal projection gesture control |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610543724.XA CN106200967A (en) | 2016-07-09 | 2016-07-09 | A method for terminal projection gesture control |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106200967A true CN106200967A (en) | 2016-12-07 |
Family
ID=57476854
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610543724.XA Pending CN106200967A (en) | 2016-07-09 | 2016-07-09 | A method for terminal projection gesture control |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106200967A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108470280A (en) * | 2018-03-16 | 2018-08-31 | 东莞市华睿电子科技有限公司 | A payment method and mobile terminal |
| CN110890041A (en) * | 2018-09-10 | 2020-03-17 | 深圳市易云数字科技有限责任公司 | Interactive aerial imaging system |
| CN111356970A (en) * | 2017-11-30 | 2020-06-30 | 深圳市柔宇科技有限公司 | Angle adjustment method, intelligent seat and computer storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102353351A (en) * | 2011-06-28 | 2012-02-15 | 惠州Tcl移动通信有限公司 | Lateral shooting angle detecting method, inclined shooting angle detecting method and mobile phone |
| US20140282274A1 (en) * | 2013-03-15 | 2014-09-18 | Qualcomm Incorporated | Detection of a gesture performed with at least two control objects |
| CN105190482A (en) * | 2013-03-15 | 2015-12-23 | 高通股份有限公司 | Detection of pinch gestures |
| CN105224089A (en) * | 2015-10-23 | 2016-01-06 | 上海斐讯数据通信技术有限公司 | Gesture operation method and device, mobile terminal |
-
2016
- 2016-07-09 CN CN201610543724.XA patent/CN106200967A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102353351A (en) * | 2011-06-28 | 2012-02-15 | 惠州Tcl移动通信有限公司 | Lateral shooting angle detecting method, inclined shooting angle detecting method and mobile phone |
| US20140282274A1 (en) * | 2013-03-15 | 2014-09-18 | Qualcomm Incorporated | Detection of a gesture performed with at least two control objects |
| CN105190482A (en) * | 2013-03-15 | 2015-12-23 | 高通股份有限公司 | Detection of pinch gestures |
| CN105224089A (en) * | 2015-10-23 | 2016-01-06 | 上海斐讯数据通信技术有限公司 | Gesture operation method and device, mobile terminal |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111356970A (en) * | 2017-11-30 | 2020-06-30 | 深圳市柔宇科技有限公司 | Angle adjustment method, intelligent seat and computer storage medium |
| CN108470280A (en) * | 2018-03-16 | 2018-08-31 | 东莞市华睿电子科技有限公司 | A payment method and mobile terminal |
| CN110890041A (en) * | 2018-09-10 | 2020-03-17 | 深圳市易云数字科技有限责任公司 | Interactive aerial imaging system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10514842B2 (en) | Input techniques for virtual reality headset devices with front touch screens | |
| CN110456907A (en) | Virtual screen control method, device, terminal equipment and storage medium | |
| TWI610218B (en) | Apparatus and method of controlling screens in a device | |
| CN105009035B (en) | Strengthen touch input using gesture | |
| US20160188195A1 (en) | Cellphone with projection capability | |
| US20140298273A1 (en) | Systems and Methods for Implementing Three-Dimensional (3D) Gesture Based Graphical User Interfaces (GUI) that Incorporate Gesture Reactive Interface Objects | |
| CN102819398A (en) | Method for slidingly controlling camera via touch screen device | |
| CN104182132B (en) | A kind of intelligent terminal gestural control method and intelligent terminal | |
| CN107589836B (en) | A kind of on-screen display (osd) area method of adjustment and mobile terminal | |
| CN107392933B (en) | A kind of image segmentation method and mobile terminal | |
| CN104345887A (en) | Position regulation method and device for desktop icons | |
| WO2021097600A1 (en) | Inter-air interaction method and apparatus, and device | |
| CN104898972A (en) | Method and equipment for regulating electronic image | |
| JP2012238293A (en) | Input device | |
| CN106796484B (en) | Display device and control method thereof | |
| CN104506765A (en) | Mobile terminal and focusing method based on touch gesture of mobile terminal | |
| CN106200916B (en) | Augmented reality image control method, device and terminal device | |
| CN106200967A (en) | A method for terminal projection gesture control | |
| CN108200419A (en) | A kind of projecting method and electronic equipment | |
| US10248307B2 (en) | Virtual reality headset device with front touch screen | |
| CN104994293B (en) | The control method and electric terminal of a kind of wide-angle camera | |
| CN110162257A (en) | Multiconductor touch control method, device, equipment and computer readable storage medium | |
| CN106126057B (en) | Screen capture method and device and terminal equipment | |
| CN104679395A (en) | Document presenting method and user terminal | |
| CN112333395A (en) | Focus control method, device and electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20161207 |