CN107229409A - The operating method and device of remote virtual desktop system - Google Patents
The operating method and device of remote virtual desktop system Download PDFInfo
- Publication number
- CN107229409A CN107229409A CN201710378257.4A CN201710378257A CN107229409A CN 107229409 A CN107229409 A CN 107229409A CN 201710378257 A CN201710378257 A CN 201710378257A CN 107229409 A CN107229409 A CN 107229409A
- Authority
- CN
- China
- Prior art keywords
- touch screen
- screen device
- remote
- virtual desktop
- remote virtual
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
本发明提供了一种在触摸屏设备上操作远程虚拟桌面系统的方法及装置,该方法包括:捕获用户在触摸屏设备上的操作手势;按预定规则将操作手势解析为远程虚拟桌面系统的对应操作;将解析后所述对应操作发送至所述远程虚拟桌面系统。通过本发明,将用户在触摸屏设备上的操作手势进行识别,解析为远程虚拟桌面系统的对应操作,以在远程虚拟桌面系统执行该对应操作,从而照顾了用户使用移动终端的已有习惯,提升用户通过移动终端操作云桌面的使用体验,以方便云桌面在移动应用场景下的使用推广。
The present invention provides a method and device for operating a remote virtual desktop system on a touch screen device. The method includes: capturing a user's operation gesture on the touch screen device; analyzing the operation gesture into a corresponding operation of the remote virtual desktop system according to a predetermined rule; Send the corresponding operation after parsing to the remote virtual desktop system. Through the present invention, the user's operation gestures on the touch screen device are recognized and analyzed into corresponding operations of the remote virtual desktop system, so that the corresponding operations can be performed on the remote virtual desktop system, thereby taking care of the user's existing habits of using mobile terminals and improving The experience of users operating cloud desktops through mobile terminals is to facilitate the use and promotion of cloud desktops in mobile application scenarios.
Description
技术领域technical field
本发明涉及通信领域,具体而言,涉及一种远程虚拟桌面系统的操作方法及装置。The present invention relates to the communication field, in particular to an operation method and device for a remote virtual desktop system.
背景技术Background technique
随着云计算技术的发展,传统的使用PC机办公的场景受到冲击。越来越多的企业和政府等机构采用更绿色安全的云桌面办公的方式。With the development of cloud computing technology, the traditional scene of using PCs for office work has been impacted. More and more enterprises and government agencies are adopting a greener and safer cloud desktop office method.
云桌面办公的方式是指将个人使用的桌面系统以虚拟机或其他方式集中部署于云服务器,个人通过云终端设备,或者其他接入方式访问位于云服务器的桌面系统。The way of cloud desktop office means that the desktop system used by individuals is deployed on the cloud server in a virtual machine or other ways, and individuals access the desktop system located on the cloud server through cloud terminal devices or other access methods.
使用云桌面办公的优点之一就是云桌面可以很方便地使用手机,平板电脑等设备进行访问,从而摆脱固定办公位置的束缚,可以随时随地接入办公。One of the advantages of using a cloud desktop for office work is that the cloud desktop can be easily accessed using mobile phones, tablet computers and other devices, so that you can get rid of the shackles of a fixed office location and access to office anytime, anywhere.
但使用手机或平板电脑访问云桌面时也有不方便之处。不方便之处在于,手机或平板电脑的操作系统一般是以触摸屏为输入设备来设计的(例如android、iOS系统的手机);而云桌面系统一般是采用传统的桌面操作系统(例如windows),即,以鼠标、键盘为输入设备进行操作的。现在要在以触摸屏为输入设备的手机或平板电脑上操作以鼠标、键盘为输入设备的桌面系统。使用习惯和操作风格的迥异,会让用户的使用体验变差,从而影响云桌面在移动场景下的使用推广。However, there are also inconveniences when using a mobile phone or tablet to access the cloud desktop. The inconvenience is that the operating systems of mobile phones or tablet computers are generally designed with touch screens as input devices (such as mobile phones with android and iOS systems); and cloud desktop systems generally adopt traditional desktop operating systems (such as windows). That is, the mouse and keyboard are used as input devices for operation. Now it is necessary to operate a desktop system using a mouse and a keyboard as input devices on a mobile phone or a tablet computer using a touch screen as an input device. The difference in usage habits and operating styles will make the user's experience worse, thus affecting the promotion of cloud desktops in mobile scenarios.
发明内容Contents of the invention
本发明提供了一种远程虚拟桌面系统的操作方法及装置,以至少解决相关技术中触摸屏设备访问云桌面所带来的操作不便的问题。The present invention provides an operation method and device for a remote virtual desktop system, so as to at least solve the problem of inconvenient operation caused by a touch screen device accessing a cloud desktop in the related art.
根据本发明的一个方面,提供了一种远程虚拟桌面系统的操作方法,包括:捕获用户在触摸屏设备上的操作手势;按预定规则将所述操作手势解析为远程虚拟桌面系统的对应操作;将解析后所述对应操作发送至所述远程虚拟桌面系统。According to one aspect of the present invention, a method for operating a remote virtual desktop system is provided, including: capturing the user's operation gestures on the touch screen device; analyzing the operation gestures into corresponding operations of the remote virtual desktop system according to predetermined rules; After parsing, the corresponding operation is sent to the remote virtual desktop system.
优选地,所述方法还包括:接收所述远程桌面虚拟系统返回的执行所述对应操作的操作结果,并在所述触摸屏设备上显示所述操作结果。Preferably, the method further includes: receiving an operation result of executing the corresponding operation returned by the remote desktop virtual system, and displaying the operation result on the touch screen device.
优选地,所述操作手势包括以下至少之一:触屏点数、触屏压力大小、触屏滑动方向、触屏时长。Preferably, the operation gesture includes at least one of the following: touch screen points, touch screen pressure, touch screen sliding direction, and touch screen duration.
优选地,所述对应操作为通过鼠标或键盘的输入操作。Preferably, the corresponding operation is an input operation via a mouse or a keyboard.
优选地,所述触摸屏设备与所述远程虚拟桌面系统之间通过以下至少之一协议进行通讯:Spice协议、VMware协议、RDP协议、Citrix协议。Preferably, the touch screen device communicates with the remote virtual desktop system through at least one of the following protocols: Spice protocol, VMware protocol, RDP protocol, Citrix protocol.
优选地,所述触摸屏设备所采用的操作系统为Android或IOS;所述远程虚拟桌面系统所采用的操作系统为视窗Windows操作系统。Preferably, the operating system adopted by the touch screen device is Android or IOS; the operating system adopted by the remote virtual desktop system is Windows operating system.
根据本发明的另一个方面,提供了一种触摸屏设备,包括:操作手势识别接口,用于捕获用户在所述触摸屏设备上的操作手势;用户意图识别模块,用于按预定规则将所述操作手势解析为所述远程虚拟桌面系统的对应操作;通讯模块,用于将解析后所述对应操作发送至所述远程虚拟桌面系统。According to another aspect of the present invention, a touch screen device is provided, including: an operation gesture recognition interface, used to capture the user's operation gestures on the touch screen device; The gesture is resolved into a corresponding operation of the remote virtual desktop system; the communication module is configured to send the analyzed corresponding operation to the remote virtual desktop system.
优选地,所述通讯模块还用于接收来自所述远程虚拟桌面系统的执行所述对应操作的操作结果。Preferably, the communication module is further configured to receive an operation result of executing the corresponding operation from the remote virtual desktop system.
优选地,所述触摸屏设备还包括显示模块,用于在所述触摸屏设备上显示所述操作结果。Preferably, the touch screen device further includes a display module, configured to display the operation result on the touch screen device.
根据本发明的又一方面,提供了一种远程虚拟桌面系统的操作方法,包括:接收触摸屏设备所捕获的用户在所述触摸屏设备上的操作手势;按预定规则将所述操作手势解析为远程虚拟桌面系统的对应操作。According to yet another aspect of the present invention, there is provided a method for operating a remote virtual desktop system, including: receiving a user's operation gesture captured by a touch screen device on the touch screen device; and parsing the operation gesture into a remote The corresponding operation of the virtual desktop system.
优选地,所述方法还包括:调用所述远程桌面虚拟系统的API接口执行所述对应操作,并将执行所述对应操作的操作结果返回至所述触摸屏设备。Preferably, the method further includes: calling an API interface of the remote desktop virtual system to execute the corresponding operation, and returning an operation result of executing the corresponding operation to the touch screen device.
优选地,所述操作手势包括以下至少之一:触屏点数、触屏压力大小、触屏滑动方向、触屏时长。Preferably, the operation gesture includes at least one of the following: touch screen points, touch screen pressure, touch screen sliding direction, and touch screen duration.
优选地,所述对应操作为通过鼠标或键盘的输入操作。Preferably, the corresponding operation is an input operation via a mouse or a keyboard.
优选地,所述触摸屏设备与所述远程虚拟桌面系统之间通过以下至少之一协议进行通讯:Spice协议、VMware协议、RDP协议、Citrix协议。Preferably, the touch screen device communicates with the remote virtual desktop system through at least one of the following protocols: Spice protocol, VMware protocol, RDP protocol, Citrix protocol.
优选地,所述触摸屏设备所采用的操作系统为Android或IOS;所述远程虚拟桌面系统所采用的操作系统为视窗Windows操作系统。Preferably, the operating system adopted by the touch screen device is Android or IOS; the operating system adopted by the remote virtual desktop system is Windows operating system.
根据本发明的又一方面,提供了一种远程虚拟桌面系统,包括:通讯模块,用于接收触摸屏设备所捕获的用户在所述触摸屏设备上的操作手势;用户意图识别模块,用于按预定规则将所述操作手势解析为远程虚拟桌面系统的对应操作。According to yet another aspect of the present invention, a remote virtual desktop system is provided, including: a communication module, configured to receive the user's operation gestures on the touch screen device captured by the touch screen device; The rule resolves the operation gesture into a corresponding operation of the remote virtual desktop system.
优选地,所述远程虚拟桌面系统还包括用户意图处理模块,用于调用所述远程桌面虚拟系统的API接口执行所述对应操作;所述通讯模块还用于将在所述远程桌面虚拟系统上执行所述对应操作的操作结果返回给所述触摸屏设备。Preferably, the remote virtual desktop system further includes a user intention processing module, which is used to call the API interface of the remote desktop virtual system to perform the corresponding operation; the communication module is also used to transfer the An operation result of executing the corresponding operation is returned to the touch screen device.
根据本发明的又一方面,提供了一种远程虚拟桌面系统的操作装置,包括前文中所述的触摸屏设备以及远程桌面虚拟系统,其中,所述远程虚拟桌面系统包括:通讯模块,用于接收来自所述触摸屏设备的所述对应操作;用户意图处理模块,用于调用所述远程桌面虚拟系统的API接口执行所述对应操作。According to yet another aspect of the present invention, an operating device for a remote virtual desktop system is provided, including the aforementioned touch screen device and the remote desktop virtual system, wherein the remote virtual desktop system includes: a communication module for receiving The corresponding operation from the touch screen device; a user intention processing module, configured to call the API interface of the remote desktop virtual system to execute the corresponding operation.
优选地,所述远程虚拟桌面系统的通讯模块还用于将在所述远程桌面虚拟系统上执行所述对应操作的操作结果返回给所述触摸屏设备。Preferably, the communication module of the remote virtual desktop system is further configured to return the operation result of the corresponding operation performed on the remote desktop virtual system to the touch screen device.
根据本发明的又一方面,提供了一种远程虚拟桌面系统的操作装置,包括前文中所述的远程桌面虚拟系统以及触摸屏设备,其中,所述触摸屏设备包括:操作手势识别接口,用于捕获用户在所述触摸屏设备上的操作手势;通讯模块,用于将所述操作手势发送至所述远程桌面虚拟系统。According to yet another aspect of the present invention, an operating device for a remote virtual desktop system is provided, including the remote desktop virtual system described above and a touch screen device, wherein the touch screen device includes: an operation gesture recognition interface for capturing A user's operation gesture on the touch screen device; a communication module, configured to send the operation gesture to the remote desktop virtual system.
优选地,所述触摸屏设备还包括显示模块,用于在所述触摸屏设备上显示所述操作结果。Preferably, the touch screen device further includes a display module, configured to display the operation result on the touch screen device.
通过本发明,将用户在触摸屏设备上的操作手势进行识别,解析为远程虚拟桌面系统的对应操作,以在远程虚拟桌面系统执行该对应操作,从而照顾了用户使用移动终端的已有习惯,提升用户通过移动终端操作云桌面的使用体验,以方便云桌面在移动应用场景下的使用推广。Through the present invention, the user's operation gestures on the touch screen device are recognized and analyzed into corresponding operations of the remote virtual desktop system, so that the corresponding operations can be performed on the remote virtual desktop system, thereby taking care of the user's existing habits of using mobile terminals and improving The experience of users operating cloud desktops through mobile terminals is to facilitate the use and promotion of cloud desktops in mobile application scenarios.
附图说明Description of drawings
此处所说明的附图用来提供对本发明的进一步理解,构成本申请的一部分,本发明的示意性实施例及其说明用于解释本发明,并不构成对本发明的不当限定。在附图中:The accompanying drawings described here are used to provide a further understanding of the present invention and constitute a part of the application. The schematic embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute improper limitations to the present invention. In the attached picture:
图1是根据本发明实施例在触摸屏设备上操作远程虚拟桌面系统的方法流程图;1 is a flowchart of a method for operating a remote virtual desktop system on a touch screen device according to an embodiment of the present invention;
图2是根据本发明实施例的远程虚拟桌面系统的操作装置的结构示意图;2 is a schematic structural diagram of an operating device of a remote virtual desktop system according to an embodiment of the present invention;
图3是根据本发明实施例的远程虚拟桌面系统的操作装置的结构示意图;3 is a schematic structural diagram of an operating device of a remote virtual desktop system according to an embodiment of the present invention;
图4是根据本发明实施例在触摸屏设备上操作远程虚拟桌面系统的方法流程图;4 is a flowchart of a method for operating a remote virtual desktop system on a touch screen device according to an embodiment of the present invention;
图5是根据本发明实施例的手指点击操作的识别流程图;FIG. 5 is a flow chart of identifying a finger click operation according to an embodiment of the present invention;
图6是根据本发明实施例的鼠标左键单击或双击的识别流程图;FIG. 6 is a flow chart of identifying single or double clicks of the left mouse button according to an embodiment of the present invention;
图7是根据本发明实施例的手指点击映射为鼠标左键单击或双击的处理流程图;Fig. 7 is a processing flow chart of mapping finger clicks to single clicks or double clicks with the left mouse button according to an embodiment of the present invention;
图8是根据本发明实施例的手指长按滑动的识别流程图;Fig. 8 is a flow chart of recognition of finger long press and slide according to an embodiment of the present invention;
图9是根据本发明实施例的手指长按滑动映射为windows窗口滚动条滚动操作的流程图;Fig. 9 is a flow chart of the scrolling operation of the windows window scroll bar according to the embodiment of the present invention in which the finger presses and slides for a long time;
图10是根据本发明实施例的手指拨动的识别流程图;Fig. 10 is a flow chart of recognition of finger flipping according to an embodiment of the present invention;
图11是根据本发明实施例的手指拨动映射为windows窗口的翻页操作的流程图。Fig. 11 is a flow chart of a page-turning operation mapped to a windows window according to an embodiment of the present invention.
具体实施方式detailed description
下文中将参考附图并结合实施例来详细说明本发明。需要说明的是,在不冲突的情况下,本申请中的实施例及实施例中的特征可以相互组合。Hereinafter, the present invention will be described in detail with reference to the drawings and examples. It should be noted that, in the case of no conflict, the embodiments in the present application and the features in the embodiments can be combined with each other.
需要说明的是,本发明的说明书和权利要求书及上述附图中的术语“第一”、“第二”等是用于区别类似的对象,而不必用于描述特定的顺序或先后次序。It should be noted that the terms "first" and "second" in the description and claims of the present invention and the above drawings are used to distinguish similar objects, but not necessarily used to describe a specific sequence or sequence.
在本发明实施例中,提供了一种方便用户使用触屏移动设备操作远程桌面系统的方法和装置。移动智能终端与远程桌面之间的连接可通过特定的远程桌面协议来建立。该远程桌面协议可以是目前业界主流的Spice,VMware,RDP,Citrix等协议,也可以是用户自定义的具有相同功能的协议。在移动终端与远程桌面之间已建立好基本的通信连接的场景下,本发明实施例以用户使用触屏移动设备的操作习惯为参考,提供一种基于触摸屏的手势操作习惯来操作桌面系统的技术方案。同时,在移动终端与远程桌面之间的基本的通信连接建立后,桌面系统的画面将以图像的形式在移动终端的屏幕上刷新显示。In an embodiment of the present invention, a method and an apparatus for conveniently operating a remote desktop system for a user using a mobile device with a touch screen are provided. The connection between the smart mobile terminal and the remote desktop can be established through a specific remote desktop protocol. The remote desktop protocol can be the current mainstream Spice, VMware, RDP, Citrix and other protocols in the industry, and can also be a user-defined protocol with the same function. In the scenario where a basic communication connection has been established between the mobile terminal and the remote desktop, the embodiment of the present invention takes the user's operating habit of using a touch-screen mobile device as a reference, and provides a touch-screen-based gesture operation habit to operate the desktop system. Technical solutions. At the same time, after the basic communication connection between the mobile terminal and the remote desktop is established, the picture of the desktop system will be refreshed and displayed on the screen of the mobile terminal in the form of an image.
在本实施例中提供了一种在触摸屏设备上操作远程虚拟桌面系统的方法,图1是根据本发明实施例的流程图,如图1所示,该流程包括如下步骤:In this embodiment, a method for operating a remote virtual desktop system on a touch screen device is provided. FIG. 1 is a flow chart according to an embodiment of the present invention. As shown in FIG. 1 , the process includes the following steps:
步骤S102,捕获用户在触摸屏设备上的操作手势;Step S102, capture the user's operation gesture on the touch screen device;
步骤S104,按预定规则将操作手势解析为远程虚拟桌面系统的对应操作;Step S104, analyzing the operation gesture into a corresponding operation of the remote virtual desktop system according to predetermined rules;
步骤S106,将解析后所述对应操作发送至所述远程虚拟桌面系统。Step S106, sending the analyzed corresponding operation to the remote virtual desktop system.
在上述实施例中,通过利用触屏设备操作系统以及桌面类操作系统已有的接口,构建了一种方便用户使用触屏设备操作桌面系统的方法,以屏蔽了不同类型的操作系统输入方式的差异,从而照顾了用户使用移动终端的已有习惯,提升用户通过移动终端操作云桌面的使用体验,以方便云桌面在移动应用场景下的使用推广。In the above-mentioned embodiment, by utilizing the existing interfaces of the touch-screen device operating system and the desktop-type operating system, a method is constructed to facilitate the user to use the touch-screen device to operate the desktop system, so as to shield different types of operating system input methods. In order to take care of the user's existing habits of using mobile terminals, improve the user experience of operating cloud desktops through mobile terminals, and facilitate the use and promotion of cloud desktops in mobile application scenarios.
其中,在步骤S102中,在用户通过触摸屏设备登录进入远程虚拟桌面系统后,可通过触摸屏设备操作系统的手势识别接口来捕获用户的操作手势。Wherein, in step S102, after the user logs into the remote virtual desktop system through the touch screen device, the user's operation gesture can be captured through the gesture recognition interface of the operating system of the touch screen device.
其中,在上述实施例中,操作手势包括以下至少之一:触屏点数、触屏压力大小、触屏滑动方向、触屏时长。Wherein, in the above embodiment, the operation gesture includes at least one of the following: touch screen points, touch screen pressure, touch screen sliding direction, and touch screen duration.
其中,在上述步骤S106之后,还包括,远程桌面虚拟系统调用其操作系统的API接口执行该对应操作,并将执行对应操作的操作结果返回给触摸屏设备。触摸屏设备刷新显示该操作结果。Wherein, after the above step S106, the remote desktop virtual system calls the API interface of its operating system to perform the corresponding operation, and returns the operation result of the corresponding operation to the touch screen device. The touch screen device refreshes to display the operation result.
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到根据上述实施例的方法可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。基于这样的理解,本发明的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质(如ROM/RAM、磁碟、光盘)中,包括若干指令用以使得一台终端设备(可以是手机,计算机,服务器,或者网络设备等)执行本发明各个实施例所述的方法。Through the description of the above embodiments, those skilled in the art can clearly understand that the method according to the above embodiments can be implemented by means of software plus a necessary general-purpose hardware platform, and of course also by hardware, but in many cases the former is Better implementation. Based on such an understanding, the essence of the technical solution of the present invention or the part that contributes to the prior art can be embodied in the form of software products, and the computer software products are stored in a storage medium (such as ROM/RAM, disk, CD) contains several instructions to enable a terminal device (which may be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in various embodiments of the present invention.
在本实施例中还提供了一种远程虚拟桌面系统的操作装置,该装置用于实现上述实施例及优选实施方式,已经进行过说明的不再赘述。如以下所使用的,术语“模块”可以实现预定功能的软件和/或硬件的组合。尽管以下实施例所描述的装置较佳地以软件来实现,但是硬件,或者软件和硬件的组合的实现也是可能并被构想的。In this embodiment, an operating device for a remote virtual desktop system is also provided. The device is used to realize the above-mentioned embodiments and preferred implementation modes, and those that have already been described will not be repeated. As used below, the term "module" may be a combination of software and/or hardware that realizes a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, implementations in hardware, or a combination of software and hardware are also possible and contemplated.
如图2和3所示,该操作装置的各功能模块根据所实现的功能的不同设置于触摸屏设备和虚拟桌面中。具体地,该装置包括如下模块:As shown in FIGS. 2 and 3 , each functional module of the operating device is set in the touch screen device and the virtual desktop according to different functions to be realized. Specifically, the device includes the following modules:
用户意图识别模块:该模块可以位于触屏设备上(如图2所示),也可以位于虚拟桌面中(如图3所述),这两种设置的区别仅在于用户意图识别模块的位置不同,其功能基本是一致的,当用户在触屏上进行操作时,用户意图识别模块根据从操作系统的手势识别接口获取到的手势操作或者操作组合以及其相关的时间等特性,来对用户意图进行识别。User intent recognition module: this module can be located on the touch screen device (as shown in Figure 2) or in the virtual desktop (as shown in Figure 3). The difference between these two settings is only the location of the user intent recognition module. , its functions are basically the same. When the user operates on the touch screen, the user intention recognition module recognizes the user intention according to the gesture operation or operation combination obtained from the gesture recognition interface of the operating system and its related time characteristics. to identify.
通讯模块:包括位于移动触屏设备上的通讯模块和位于虚拟桌面中的通讯模块,其中,位于移动触屏设备上的通讯模块其功能是与位于虚拟桌面中的通讯模块进行通信,来完成指令的发送与接收。位于虚拟桌面中的通讯模块其功能是与位于触屏设备中的通讯模块进行通信,来完成指令的发送与接收。两个通讯模块大多数的时候需要通过Internet建立通信链接,一般两个通讯模块会建立一个TCP连接来进行指令的收发。Communication module: including the communication module located on the mobile touch screen device and the communication module located in the virtual desktop, wherein the function of the communication module located on the mobile touch screen device is to communicate with the communication module located in the virtual desktop to complete the instruction sending and receiving. The function of the communication module located in the virtual desktop is to communicate with the communication module located in the touch screen device to complete the sending and receiving of instructions. Most of the time, the two communication modules need to establish a communication link through the Internet. Generally, the two communication modules will establish a TCP connection to send and receive commands.
用户意图处理模块:位于虚拟桌面中,其功能是根据接收到的用户意图,调用桌面操作系统中对应的接口来实现该意图。User intention processing module: located in the virtual desktop, its function is to call the corresponding interface in the desktop operating system to realize the intention according to the received user intention.
需要进一步说明的是,需要以下辅助模块来配合以上4个模块构成一个完整的架构:It should be further explained that the following auxiliary modules are required to cooperate with the above four modules to form a complete architecture:
触屏设备的操作系统,其中需要包含有手势操作的识别接口。例如当用户的手指在触屏上按下时,该接口需要捕获press事件,当用户的手指离开触屏时,该接口需要捕获up事件,同时所捕获的事件可供外部使用。The operating system of the touch screen device needs to include a recognition interface for gesture operation. For example, when the user's finger is pressed on the touch screen, the interface needs to capture the press event, and when the user's finger leaves the touch screen, the interface needs to capture the up event, and the captured event can be used externally.
虚拟桌面的桌面操作系统,其中包含有桌面操作系统的输入接口,例如可向外部提供鼠标左键单击,右键单击,双击等接口。The desktop operating system of the virtual desktop includes an input interface of the desktop operating system, for example, interfaces such as left-click, right-click, and double-click can be provided to the outside.
以上部分由于都是触屏设备或者虚拟桌面中已包含的模块和功能,所以未将之包含在本方法所描述的系统之中,但需要它们配合已构成完整的方法。Since the above parts are all modules and functions included in the touch screen device or virtual desktop, they are not included in the system described in this method, but they need to cooperate to form a complete method.
在本发明的实施例中,上述远程虚拟桌面系统的操作装置可以通过在现有的触摸屏设备和虚拟桌面中部署上述功能模块来实现,也可以是一个包括触摸屏设备和虚拟桌面的完整系统。In the embodiment of the present invention, the operating device of the above-mentioned remote virtual desktop system can be implemented by deploying the above-mentioned functional modules in the existing touch screen device and virtual desktop, or it can be a complete system including the touch screen device and virtual desktop.
基于前文中的操作装置,本发明实施例还提供了一种用户使用触屏设备操作桌面系统的方法,如图4所示,该方法包括如下流程:Based on the aforementioned operating device, the embodiment of the present invention also provides a method for a user to operate a desktop system using a touch screen device, as shown in FIG. 4 , the method includes the following process:
步骤S401,用户通过app的方式在移动智能设备上登陆进入远程的虚拟桌面中。此时,用户再触碰移动智能设备的触摸屏,智能设备的操作系统捕获用户的操作,并将之解析为操作系统所定义的基本原子操作(例如:单指press,单指up等)。In step S401, the user logs in to a remote virtual desktop on the mobile smart device through an app. At this time, the user touches the touch screen of the mobile smart device again, and the operating system of the smart device captures the user's operation and parses it into the basic atomic operation defined by the operating system (for example: single-finger press, single-finger up, etc.).
步骤S402,用户意图识别模块监听操作系统的手势操作解析结果,并根据手势操作结果的组合以及对应的时间,力度,幅度等信息特性来判定用户的操作意图。判断的策略是开放性的,在之后的实施例中将给出多种操作判定的实例。Step S402, the user intention identification module monitors the gesture operation analysis results of the operating system, and determines the user's operation intention according to the combination of the gesture operation results and the corresponding information characteristics such as time, strength, and amplitude. The judging strategy is open, and various operational judging examples will be given in the following embodiments.
步骤S403,触屏设备上的通讯模块,将用户意图识别模块的判定结果,发送至远端虚拟桌面的通讯模块。Step S403, the communication module on the touch screen device sends the determination result of the user intention identification module to the communication module of the remote virtual desktop.
步骤S404,位于虚拟桌面中的用户意图处理模块,接收通讯模块中的用户意图,再调用桌面操作系统中的对应的API接口,实现该用户意图。Step S404, the user intention processing module located in the virtual desktop receives the user intention in the communication module, and then calls the corresponding API interface in the desktop operating system to realize the user intention.
步骤S405,用户意图的操作结果通过远程桌面协议的图像通道(或者以其他方式也可,不限)传回给移动智能设备的app。Step S405, the operation result intended by the user is sent back to the app of the mobile smart device through the image channel of the remote desktop protocol (or in other ways, not limited).
步骤S406,触屏设备上的app在屏幕上刷新图像以显示该用户意图的所得结果。Step S406, the app on the touch screen device refreshes the image on the screen to display the obtained result of the user's intention.
基于以上方法及流程,最终实现的效果是以用户所习惯的移动终端触屏的操作方式来完成远程桌面系统中的对应操作,尽量照顾用户对移动终端设备的操作习惯,以方便云桌面在移动终端场景的使用推广。Based on the above method and process, the final effect is to complete the corresponding operation in the remote desktop system by using the mobile terminal touch screen operation mode that the user is accustomed to, and try to take care of the user's operating habits of the mobile terminal device, so as to facilitate the cloud desktop on the move. Promotion of the use of terminal scenarios.
为使本发明的目的、技术方案更加清楚,下面将结合附图对本发明的实施方式作进一步地详细描述。在下面的具体实施例中,触屏设备为采用iOS/android系统的手机或者平板电脑,云端系统的虚拟桌面为采用windows系统的云桌面。通过以下优选的实施方式具体描述了如何按预定规则将操作手势解析为远程虚拟桌面系统的对应操作。In order to make the purpose and technical solution of the present invention clearer, the following will further describe the implementation of the present invention in detail in conjunction with the accompanying drawings. In the following specific embodiments, the touch screen device is a mobile phone or a tablet computer using the iOS/android system, and the virtual desktop of the cloud system is a cloud desktop using the windows system. How to resolve an operation gesture into a corresponding operation of the remote virtual desktop system according to a predetermined rule is specifically described through the following preferred implementation manners.
实施方式1:将手指的单指点击映射为鼠标的左键单击或者左键双击。Embodiment 1: Map single-finger click to left-click or double-click of mouse.
该操作是由位于触屏设备上的用户意图识别模块来实现,将用户在屏幕上的手势操作识别为一次手指点击。具体识别流程如图5所示,包括以下步骤:This operation is realized by the user intention recognition module located on the touch screen device, which recognizes the user's gesture operation on the screen as a finger click. The specific identification process is shown in Figure 5, including the following steps:
步骤S501,手指触碰屏幕。Step S501, touching the screen with a finger.
步骤S502,在指定时间内,手指抬起,离开屏幕。Step S502, within a specified time, lift the finger and leave the screen.
步骤S503,识别为一次手指的点击操作。Step S503, identifying as a finger click operation.
图6所示流程是由位于触屏设备上的用户意图识别模块在图5识别手指点击的基础上,将用户在屏幕上的手势操作识别为一次鼠标左键单击或者鼠标左键双击的过程,具体包括如下步骤:The process shown in Figure 6 is a process in which the user's intention recognition module located on the touch screen device recognizes the user's gesture operation on the screen as a left-click or double-click on the basis of identifying the finger click in Figure 5 , including the following steps:
步骤S601,判断是否是一次手指的点击操作,如果是,则继续执行步骤S602,如果否则流程结束。Step S601, judge whether it is a finger click operation, if yes, continue to execute step S602, otherwise, the process ends.
步骤S602,等待指定时间。Step S602, waiting for a specified time.
步骤S603,判断在指定时间内,是否发生了其他手势操作,如果否,则执行步骤S604,如果是则执行步骤S605。Step S603, judging whether other gesture operations have occurred within a specified time, if not, execute step S604, and if yes, execute step S605.
步骤S604,进一步判断是否是一次手指的点击操作,如果是,则执行步骤S605,如果否则流程结束。Step S604, further judge whether it is a finger click operation, if yes, execute step S605, otherwise, the process ends.
步骤S606,识别为鼠标左键双击。In step S606, it is recognized as a double click with the left mouse button.
步骤S605,识别为鼠标左键单击。Step S605, identifying a mouse left button click.
图7所示流程是将触屏设备上的手指的单指点击映射为远端windows桌面中的鼠标左键单击或者左键双击的整体处理过程,包括如下步骤:The process shown in Figure 7 is the overall process of mapping the single-finger click of the finger on the touch-screen device to the left-click or double-click of the mouse on the remote windows desktop, including the following steps:
步骤S701,触屏设备上的用户意图识别模块识别出一次鼠标左键单击或双击的操作意图,具体识别策略可参考前文的识别流程。,In step S701, the user intention recognition module on the touch screen device recognizes the operation intention of a left mouse click or double click, and the specific recognition strategy can refer to the above recognition process. ,
步骤S702,触屏设备上的通讯模块将识别结果发送给远端的windows虚拟桌面中的通讯模块。Step S702, the communication module on the touch screen device sends the recognition result to the communication module in the remote windows virtual desktop.
步骤S703,位于桌面中的用户意图处理模块接收到通讯模块中的识别结果,按照识别结果调用windows系统的api来进行对应的操作。例如如果是单击,则连续调用windows的WM_LBUTTONDOWN与WM_LBU TTONUP两个接口;如果是双击,则直接调用windows的WM_LBUTTONDBCLK接口。Step S703, the user intention processing module located on the desktop receives the recognition result from the communication module, and calls the api of the windows system according to the recognition result to perform corresponding operations. For example, if it is a single click, it will continuously call the WM_LBUTTONDOWN and WM_LBUTTONUP interfaces of windows; if it is a double click, it will directly call the WM_LBUTTONDBCLK interface of windows.
步骤S704,虚拟桌面中的当前活动窗口执行接口调用,并将调用执行后的桌面图像数据回传给触屏设备。图像数据的压缩与回传一般由特定的远程桌面协议来完成。如spice协议,citrix协议,RDP协议等。Step S704, the current active window in the virtual desktop executes the interface call, and sends back the desktop image data after the call is executed to the touch screen device. Compression and return of image data are generally completed by a specific remote desktop protocol. Such as spice protocol, citrix protocol, RDP protocol, etc.
步骤S705,触屏设备接收到图像数据后,刷新屏幕数据以完成操作结果的图像显示。In step S705, after receiving the image data, the touch screen device refreshes the screen data to complete the image display of the operation result.
实施方式2:将手指的长按滑动映射为windows窗口滚动条的滚动操作。Embodiment 2: Map the long press and slide of the finger to the scroll operation of the scroll bar of the windows window.
该操作是由位于触屏设备上的用户意图识别模块来实现,将用户在屏幕上的手势操作识别为一次长按滑动的操作。具体识别流程如图8所示,包括如下步骤:This operation is realized by the user intention recognition module located on the touch screen device, which recognizes the user's gesture operation on the screen as a long press and slide operation. The specific identification process is shown in Figure 8, including the following steps:
步骤S801,手指触碰屏幕。Step S801, touching the screen with a finger.
步骤S802,判断手指是否在屏幕上移动超过指定长度,如果否,则流程结束。Step S802, judging whether the finger moves on the screen for more than a specified length, if not, the process ends.
步骤S803,进一步判断手指在屏幕上的移动是否超过指定时间,如果否,则流程结束。In step S803, it is further judged whether the movement of the finger on the screen exceeds a specified time, if not, the process ends.
步骤S804,手指抬起离开屏幕。Step S804, lifting the finger away from the screen.
步骤S805,在步骤S802和步骤S803均满足条件的情况下,识别为一次手指的长按滑动。In step S805, if the conditions of both step S802 and step S803 are satisfied, it is recognized as a long press and slide of a finger.
如图9所示,位于触屏设备上的用户意图识别模块在识别出一次长按滑动的操作的基础上,将该长按滑动映射为windows窗口滚动条的滚动操作,具体包括如下步骤:As shown in Figure 9, the user intention recognition module located on the touch screen device, on the basis of recognizing a long-press and slide operation, maps the long-press and slide to the scroll operation of the windows window scroll bar, specifically including the following steps:
步骤S901,触屏设备上的用户意图识别模块识别出一次长按滑动的操作。在本实施方式中,可将长按滑动的操作认为是用户期望在当前的windows桌面中进行滚动条滚动的操作,后续按滚动条滚动的操作来进行映射及后续处理。对于滚动条的滚动,可根据长按滑动的路径,进一步识别是垂直滚动还是水平滚动。In step S901, the user intention recognition module on the touch screen device recognizes a long press and slide operation. In this embodiment, the operation of long-pressing and sliding can be regarded as an operation that the user expects to perform scroll bar scrolling on the current windows desktop, and the subsequent operation of pressing the scroll bar to perform mapping and subsequent processing. For the scrolling of the scroll bar, it can further identify whether it is vertical scrolling or horizontal scrolling according to the path of long-pressing and sliding.
步骤S902,触屏设备上的通讯模块将识别结果发送给远端的windows虚拟桌面中的通讯模块。Step S902, the communication module on the touch screen device sends the recognition result to the communication module in the remote windows virtual desktop.
步骤S903,位于桌面中的用户意图处理模块接收到通讯模块中的识别结果,按照识别结果调用windows系统的API来进行对应的操作。例如如果是水平滚动,则调用windows的WS_HSCROLL相关接口;如果是垂直滚动,则调用windows的WS_VSCROLL相关接口。同时根据长按滑动的距离和时间来决定调用接口发送相关操作的次数。Step S903, the user intention processing module on the desktop receives the recognition result from the communication module, and calls the API of the windows system according to the recognition result to perform corresponding operations. For example, if it is scrolling horizontally, call the WS_HSCROLL related interface of windows; if it is vertical scrolling, call the WS_VSCROLL related interface of windows. At the same time, the number of times to call the interface to send related operations is determined according to the distance and time of the long-press slide.
步骤S904,虚拟桌面中的当前活动窗口执行接口调用。如果当前窗口是有对应滚动条的话,将实际执行滚动操作;如果当前窗口无对应滚动条,则实际将不执行操作。之后,将调用执行后的桌面图像数据回传给触屏设备。图像数据的压缩与回传一般由特定的远程桌面协议来完成。如spice协议,citrix协议,RDP协议等。In step S904, the current active window in the virtual desktop executes an interface call. If the current window has a corresponding scroll bar, the scroll operation will actually be performed; if the current window does not have a corresponding scroll bar, the actual operation will not be performed. Afterwards, the desktop image data after the call is executed is returned to the touch screen device. Compression and return of image data are generally completed by a specific remote desktop protocol. Such as spice protocol, citrix protocol, RDP protocol, etc.
步骤S905,触屏设备接收到图像数据后,刷新屏幕数据以完成操作结果的图像显示。In step S905, after receiving the image data, the touch screen device refreshes the screen data to complete the image display of the operation result.
实施方式3:将手指的拨动映射为翻页操作。Embodiment 3: Mapping finger movements to a page-turning operation.
在本实施例中,触屏设备上的用户意图识别模块识别出一次手指的拨动操作,手指拨动的具体识别策略如图10所示,包括如下步骤:In this embodiment, the user intention recognition module on the touch screen device recognizes a finger-flicking operation, and the specific recognition strategy for finger-flicking is shown in Figure 10, including the following steps:
步骤S1001,手指触碰屏幕。Step S1001, touching the screen with a finger.
步骤S1002,手指抬起离开屏幕。Step S1002, lifting the finger away from the screen.
步骤S1003,判断手指是否在屏幕上移动超过一个较短的指定长度,但小于长按滑动的下限,如果是,则执行步骤S1004,如果否,则结束流程。In step S1003, it is judged whether the finger moves on the screen beyond a short specified length, but less than the lower limit of long-press sliding, if yes, execute step S1004, if not, end the process.
步骤S1004,判断手指在屏幕上的移动是否超过一个较短的指定时间,但短于长按滑动的下限,如果是,则执行步骤S1005,如果否,则结束流程。Step S1004, judging whether the movement of the finger on the screen exceeds a short specified time, but shorter than the lower limit of long press and slide, if yes, execute step S1005, if not, end the process.
步骤S1005,识别为一次单指拨动。Step S1005, identifying as a single-finger swipe.
如图11所示,在本实施例中,将手指的拨动映射为翻页操作包括如下步骤:As shown in FIG. 11 , in this embodiment, mapping finger movement to a page-turning operation includes the following steps:
步骤S1101,触屏设备上的用户意图识别模块识别出一次手指的拨动操作,手指拨动的具体识别策略参见前文,注意与前文中长按滑动的识别策略的区别。在本实施方式中,将手指拨动的操作认为是用户期望在当前的windows桌面中在阅读文档时希望进行翻页的操作,后续按翻页的操作来进行映射及后续处理。对于翻页也有向上翻页与向下翻页,可根据手指移动的路径是向上移动还是向下移动,来进一步识别是上翻页还是下翻页。In step S1101, the user intention recognition module on the touch screen device recognizes a finger swipe operation. For the specific recognition strategy of finger swipe, please refer to the previous article, and note the difference from the recognition strategy of long press and slide in the previous article. In this embodiment, the operation of flipping a finger is regarded as an operation that the user wishes to perform page turning when reading a document on the current windows desktop, and the subsequent page turning operation is used for mapping and subsequent processing. There are also page-up and page-down for page-turning, which can be further identified as page-up or page-down according to whether the path of finger movement is moving up or down.
步骤S1102,触屏设备上的通讯模块将识别结果发送给远端的windows虚拟桌面中的通讯模块。Step S1102, the communication module on the touch screen device sends the recognition result to the communication module in the remote windows virtual desktop.
步骤S1103,位于桌面中的用户意图处理模块接收到通讯模块中的识别结果,按照识别结果调用windows系统的api来进行对应的操作。例如如果是向上翻页,则调用windows的接口发送一个page up的键盘按键事件;如果是向下翻页,则调用windows的接口发送一个page down的键盘按键事件。Step S1103, the user intention processing module located on the desktop receives the recognition result from the communication module, and calls the api of the windows system according to the recognition result to perform corresponding operations. For example, if the page is turned up, the interface of windows is called to send a page up keyboard key event; if the page is turned down, the interface of windows is called to send a page down keyboard key event.
步骤S1104,虚拟桌面中的当前活动窗口来响应page up或page down的按键事件。如果当前窗口是一个可以翻页的文档,则实际执行翻页操作;否则,则实际将不执行操作。之后,将调用执行后的桌面图像数据回传给触屏设备。图像数据的压缩与回传一般由特定的远程桌面协议来完成。如spice协议,citrix协议,RDP协议等。Step S1104, the current active window in the virtual desktop responds to the page up or page down key event. If the current window is a page-turnable document, the page-turning operation is actually performed; otherwise, no operation is actually performed. Afterwards, the desktop image data after the call is executed is returned to the touch screen device. Compression and return of image data are generally completed by a specific remote desktop protocol. Such as spice protocol, citrix protocol, RDP protocol, etc.
步骤S1105,触屏设备接收到图像数据后,刷新屏幕数据以完成操作结果的图像显示。Step S1105, after receiving the image data, the touch screen device refreshes the screen data to complete the image display of the operation result.
在本发明的上述具体实施例中,通过用户意图识别模块,可以根据用户在触屏上的操作或操作组合来自定义需要在远程桌面系统中所做的操作,这种可扩展性是本方案的优点,当应用此方案在使用移动只能终端操作云桌面时,可以根据用户对移动终端的使用习惯来不断改进对桌面系统的操作方式,可持续提升用户使用云桌面的操作体验。In the above-mentioned specific embodiments of the present invention, through the user intention recognition module, the operations that need to be done in the remote desktop system can be customized according to the user's operation or combination of operations on the touch screen. This kind of scalability is the key to this solution. Advantages, when this solution is used to operate the cloud desktop using a mobile smart terminal, the operation mode of the desktop system can be continuously improved according to the user's usage habits of the mobile terminal, and the user's operation experience of using the cloud desktop can be continuously improved.
本发明实施例还提供了一种触摸屏设备,该触摸屏设备包括:The embodiment of the present invention also provides a touch screen device, the touch screen device includes:
操作手势识别接口,与触摸屏设备的操作系统耦合,用于在用户通过触摸屏设备登录进入远程虚拟桌面系统后,捕获用户在触摸屏设备上的操作手势;The operation gesture recognition interface, coupled with the operating system of the touch screen device, is used to capture the user's operation gestures on the touch screen device after the user logs in to the remote virtual desktop system through the touch screen device;
用户意图识别模块,用于按预定规则将操作手势解析为远程虚拟桌面系统的对应操作;The user intention recognition module is used to resolve the operation gesture into a corresponding operation of the remote virtual desktop system according to a predetermined rule;
通讯模块,用于将解析后对应操作发送至远程虚拟桌面系统。The communication module is used to send the corresponding operation after parsing to the remote virtual desktop system.
在另一实施例中,该触摸屏设备不包括上述的用户意图识别模块,该用户意图识别模块的功能可以由虚拟桌面来实现,即,可在虚拟桌面中设置该用户意图识别模块将操作手势解析为对应操作。In another embodiment, the touch screen device does not include the above-mentioned user intention recognition module, the function of the user intention recognition module can be realized by the virtual desktop, that is, the user intention recognition module can be set in the virtual desktop to analyze the operation gesture for the corresponding operation.
本发明实施例还提供了一种远程虚拟桌面系统,该远程虚拟桌面系统包括:The embodiment of the present invention also provides a remote virtual desktop system, the remote virtual desktop system includes:
通讯模块,用于在用户通过触摸屏设备登录进入远程虚拟桌面系统后,接收触摸屏设备所捕获的操作手势,其中,操作手势由触摸屏设备按预定规则解析为远程虚拟桌面系统的对应操作;The communication module is used to receive the operation gesture captured by the touch screen device after the user logs into the remote virtual desktop system through the touch screen device, wherein the operation gesture is resolved by the touch screen device into the corresponding operation of the remote virtual desktop system according to predetermined rules;
用户意图处理模块,用于调用远程桌面虚拟系统的API接口执行对应操作。The user intention processing module is used to call the API interface of the remote desktop virtual system to perform corresponding operations.
其中,在另一优先实施例中,远程虚拟桌面系统还可以设置一用户意图识别模块,即,在所接收到的操作手势未解析为远程虚拟桌面系统的对应操作的情况下,通过该用户意图识别模块对操作手势进行相应的解析。Wherein, in another preferred embodiment, the remote virtual desktop system can also be provided with a user intention identification module, that is, when the received operation gesture is not resolved into a corresponding operation of the remote virtual desktop system, the user intention will be The recognition module analyzes the operation gestures accordingly.
需要说明的是,上述各个模块是可以通过软件或硬件来实现的,对于后者,可以通过以下方式实现,但不限于此:上述模块均位于同一处理器中;或者,上述模块分别位于多个处理器中。It should be noted that each of the above-mentioned modules can be implemented by software or hardware. For the latter, it can be implemented in the following manner, but not limited to this: the above-mentioned modules are all located in the same processor; or, the above-mentioned modules are respectively located in multiple in the processor.
本发明的实施例还提供了一种存储介质。在本实施例中,该存储介质可以被设置为存储用于执行前文实施例的步骤的程序代码。The embodiment of the invention also provides a storage medium. In this embodiment, the storage medium may be configured to store program codes for executing the steps of the foregoing embodiments.
可选地,在本实施例中,上述存储介质可以包括但不限于:U盘、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、移动硬盘、磁碟或者光盘等各种可以存储程序代码的介质。Optionally, in this embodiment, the above-mentioned storage medium may include but not limited to: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, magnetic disk Various media that can store program codes such as discs or optical discs.
显然,本领域的技术人员应该明白,上述的本发明的各模块或各步骤可以用通用的计算装置来实现,它们可以集中在单个的计算装置上,或者分布在多个计算装置所组成的网络上,可选地,它们可以用计算装置可执行的程序代码来实现,从而,可以将它们存储在存储装置中由计算装置来执行,并且在某些情况下,可以以不同于此处的顺序执行所示出或描述的步骤,或者将它们分别制作成各个集成电路模块,或者将它们中的多个模块或步骤制作成单个集成电路模块来实现。这样,本发明不限制于任何特定的硬件和软件结合。Obviously, those skilled in the art should understand that each module or each step of the above-mentioned present invention can be realized by a general-purpose computing device, and they can be concentrated on a single computing device, or distributed in a network formed by multiple computing devices Alternatively, they may be implemented in program code executable by a computing device so that they may be stored in a storage device to be executed by a computing device, and in some cases in an order different from that shown here The steps shown or described are carried out, or they are separately fabricated into individual integrated circuit modules, or multiple modules or steps among them are fabricated into a single integrated circuit module for implementation. As such, the present invention is not limited to any specific combination of hardware and software.
以上所述仅为本发明的优选实施例而已,并不用于限制本发明,对于本领域的技术人员来说,本发明可以有各种更改和变化。凡在本发明的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and changes. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present invention shall be included within the protection scope of the present invention.
Claims (21)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710378257.4A CN107229409A (en) | 2017-05-24 | 2017-05-24 | The operating method and device of remote virtual desktop system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710378257.4A CN107229409A (en) | 2017-05-24 | 2017-05-24 | The operating method and device of remote virtual desktop system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107229409A true CN107229409A (en) | 2017-10-03 |
Family
ID=59934473
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710378257.4A Withdrawn CN107229409A (en) | 2017-05-24 | 2017-05-24 | The operating method and device of remote virtual desktop system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107229409A (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107844243A (en) * | 2017-11-09 | 2018-03-27 | 新华三云计算技术有限公司 | Cloud tabletop touch implementation method and device |
| CN109375786A (en) * | 2018-10-09 | 2019-02-22 | 上海达龙信息科技有限公司 | A kind of method and system manipulating long-range PC desktop based on physics key mouse equipment |
| CN109885236A (en) * | 2019-02-25 | 2019-06-14 | 合肥谐桐科技有限公司 | The method for interacting formula operation with remote system desktop is realized based on mobile device |
| CN110174946A (en) * | 2019-05-16 | 2019-08-27 | 上海达龙信息科技有限公司 | Mouse action analogy method, simulation system, storage medium and electronic equipment |
| CN112202825A (en) * | 2020-12-09 | 2021-01-08 | 江苏北弓智能科技有限公司 | Remote mobile cloud desktop transmission system and method |
| CN112214148A (en) * | 2019-07-09 | 2021-01-12 | 福建天泉教育科技有限公司 | Method for extending touch function in remote control system and storage medium |
| CN112558827A (en) * | 2020-12-03 | 2021-03-26 | 南京机敏软件科技有限公司 | Method and system for accessing cloud mobile phone status bar and terminal equipment status bar in cloud mobile phone |
| CN112732399A (en) * | 2021-03-31 | 2021-04-30 | 统信软件技术有限公司 | Switching method of desktop display protocol, computing device and readable storage medium |
| CN113391749A (en) * | 2020-03-11 | 2021-09-14 | 上海达龙信息科技有限公司 | Mouse click simulation method and device, computer readable storage medium and electronic equipment |
| CN113805705A (en) * | 2020-05-28 | 2021-12-17 | 成都鼎桥通信技术有限公司 | Terminal shortcut key operation method and device |
| CN116069433A (en) * | 2023-03-08 | 2023-05-05 | 山东乾云启创信息科技股份有限公司 | Image drifting method and system based on virtual desktop infrastructure and action recognition |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102866848A (en) * | 2012-09-13 | 2013-01-09 | 电子科技大学 | Method for controlling cloud classroom intelligent pointer based on wifi |
| CN103324348A (en) * | 2013-06-28 | 2013-09-25 | 华南理工大学 | Windows desktop control method based on intelligent mobile terminals |
| CN104317390A (en) * | 2014-09-24 | 2015-01-28 | 北京云巢动脉科技有限公司 | Method and system for replacing mouse operation by multiple gestures based on virtual machine of mobile terminal |
| CN105094583A (en) * | 2014-05-13 | 2015-11-25 | 中兴通讯股份有限公司 | Quick operation method and apparatus for digital terminal with touch screen |
| CN105700864A (en) * | 2014-11-28 | 2016-06-22 | 华为技术有限公司 | TWAIN protocol remote redirection method, apparatus and system |
-
2017
- 2017-05-24 CN CN201710378257.4A patent/CN107229409A/en not_active Withdrawn
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102866848A (en) * | 2012-09-13 | 2013-01-09 | 电子科技大学 | Method for controlling cloud classroom intelligent pointer based on wifi |
| CN103324348A (en) * | 2013-06-28 | 2013-09-25 | 华南理工大学 | Windows desktop control method based on intelligent mobile terminals |
| CN105094583A (en) * | 2014-05-13 | 2015-11-25 | 中兴通讯股份有限公司 | Quick operation method and apparatus for digital terminal with touch screen |
| CN104317390A (en) * | 2014-09-24 | 2015-01-28 | 北京云巢动脉科技有限公司 | Method and system for replacing mouse operation by multiple gestures based on virtual machine of mobile terminal |
| CN105700864A (en) * | 2014-11-28 | 2016-06-22 | 华为技术有限公司 | TWAIN protocol remote redirection method, apparatus and system |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107844243A (en) * | 2017-11-09 | 2018-03-27 | 新华三云计算技术有限公司 | Cloud tabletop touch implementation method and device |
| CN109375786A (en) * | 2018-10-09 | 2019-02-22 | 上海达龙信息科技有限公司 | A kind of method and system manipulating long-range PC desktop based on physics key mouse equipment |
| CN109375786B (en) * | 2018-10-09 | 2022-08-05 | 上海达龙信息科技有限公司 | Method and system for controlling remote PC desktop based on physical keyboard and mouse equipment |
| CN109885236A (en) * | 2019-02-25 | 2019-06-14 | 合肥谐桐科技有限公司 | The method for interacting formula operation with remote system desktop is realized based on mobile device |
| CN109885236B (en) * | 2019-02-25 | 2021-06-25 | 电科云(北京)科技有限公司 | Method for realizing interactive operation with remote system desktop based on mobile equipment |
| CN110174946A (en) * | 2019-05-16 | 2019-08-27 | 上海达龙信息科技有限公司 | Mouse action analogy method, simulation system, storage medium and electronic equipment |
| CN112214148A (en) * | 2019-07-09 | 2021-01-12 | 福建天泉教育科技有限公司 | Method for extending touch function in remote control system and storage medium |
| CN113391749A (en) * | 2020-03-11 | 2021-09-14 | 上海达龙信息科技有限公司 | Mouse click simulation method and device, computer readable storage medium and electronic equipment |
| CN113805705A (en) * | 2020-05-28 | 2021-12-17 | 成都鼎桥通信技术有限公司 | Terminal shortcut key operation method and device |
| CN112558827A (en) * | 2020-12-03 | 2021-03-26 | 南京机敏软件科技有限公司 | Method and system for accessing cloud mobile phone status bar and terminal equipment status bar in cloud mobile phone |
| CN112202825A (en) * | 2020-12-09 | 2021-01-08 | 江苏北弓智能科技有限公司 | Remote mobile cloud desktop transmission system and method |
| CN112732399B (en) * | 2021-03-31 | 2021-07-16 | 统信软件技术有限公司 | Switching method of desktop display protocol, computing device and readable storage medium |
| CN112732399A (en) * | 2021-03-31 | 2021-04-30 | 统信软件技术有限公司 | Switching method of desktop display protocol, computing device and readable storage medium |
| CN116069433A (en) * | 2023-03-08 | 2023-05-05 | 山东乾云启创信息科技股份有限公司 | Image drifting method and system based on virtual desktop infrastructure and action recognition |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107229409A (en) | The operating method and device of remote virtual desktop system | |
| CN103324348B (en) | A kind of windows desktop control method based on intelligent mobile terminal | |
| KR102544780B1 (en) | Method for controlling user interface according to handwriting input and electronic device for the same | |
| US9632693B2 (en) | Translation of touch input into local input based on a translation profile for an application | |
| CN104123024B (en) | A kind of terminal device and apparatus control method | |
| CN108595220B (en) | Application component processing method, device and computer-readable storage medium | |
| US10055120B2 (en) | Managing content displayed on a touch screen enabled device using gestures | |
| CN108549510A (en) | Figure calibration method, equipment and storage medium for showing boarding application | |
| WO2020073980A1 (en) | Method and device for processing guest application, and computer-readable storage medium | |
| WO2014121626A1 (en) | Displaying method, device and storage medium of mobile terminal shortcuts | |
| US20170205980A1 (en) | Method and an apparatus for providing a multitasking view | |
| CN105183306A (en) | Screen capturing method and device for display content in mobile terminal | |
| CN106776821A (en) | A kind of album creating method and terminal | |
| CN107977155A (en) | Handwriting recognition method, device, equipment and storage medium | |
| CN107172258A (en) | A method, device, terminal and storage medium for storing contact information | |
| US20220004287A1 (en) | Layout method, device and equipment for window control bars | |
| CN108492349B (en) | Processing method, device and equipment for writing strokes and storage medium | |
| CN105094583A (en) | Quick operation method and apparatus for digital terminal with touch screen | |
| CN106970899A (en) | A kind of text handling method and device | |
| CN108108417B (en) | Interactive method, system, device and storage medium for cross-platform adaptive control | |
| US20140082483A1 (en) | Method and system for restoring closed webpages | |
| CN107526597A (en) | User interface edit methods, device, terminal and computer-readable recording medium | |
| US12219083B2 (en) | Cross-channel configurable navigation | |
| CN106778296A (en) | An access method, device and terminal for accessing objects | |
| CN110088750B (en) | Method and system for providing context function in static webpage |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20171003 |
|
| WW01 | Invention patent application withdrawn after publication |