CN104065679B - The method and client of a kind of remote desktop operation - Google Patents

Abstract

The embodiment of the present invention provides a remote desktop operation method and a client, so that the browser-based remote desktop can support operations on extended data other than basic input and output. The method includes: receiving a remote desktop protocol RDP operation command sent by a server; determining whether the RDP operation command needs to call the local interface of the client; if the RDP operation command needs to call the local interface of the client, according to the RDP The operation command invokes the application programming interface API of the corresponding client, so that the client performs the operation requested by the RDP operation command. The embodiments of the present invention are applicable to the field of network technologies.

Description

Method and client for remote desktop operation

technical field

The invention relates to the field of network technology, in particular to a method and a client for realizing a remote desktop.

Background technique

The remote desktop mainly provides the user with a graphical interface of another machine, allowing the user to control another machine locally. Usually remote desktop is divided into two parts: server and client. The server and the client communicate with each other based on the Remote Desktop Protocol (RDP).

The fifth version of Hypertext Markup Language (Hypertext Markup Language.5, referred to as HTML5) is the next major revision of Hypertext Markup Language (Hypertext Markup Language, referred to as HTML). Network technology for full-duplex communication.

And in the prior art, based on the remote desktop of HTML5 browser, gateway is generally arranged between described server and client, and gateway is as the transit of RDP agreement and HTML5 agreement, and specifically this gateway is used for described server-side After the remote desktop protocol image data is analyzed, it is packaged and encapsulated as HTML5 data and sent to the browser of the client; correspondingly, it is also used when the browser captures that the user inputs an operation command on the human-computer interaction interface of the client , such as the operation command input by the mouse and keyboard, the operation command is sent to the gateway, and the gateway parses the operation command, packages and encapsulates it as RDP data and sends it to the remote desktop RDP server.

However, since HTML5-based browsers only support basic computer input and output data, such as image data and mouse and keyboard data, the current remote desktop system does not support some operations related to extended data, for example, it does not support file system steering, making customers The client cannot use the local file system; the client cannot use the local printer because it does not support the redirection of the printer; it does not support the input and output of audio and video data on the client, and the application on the server cannot use the audio and video input device of the client.

Contents of the invention

Embodiments of the present invention provide a remote desktop operation method and client, so that the browser-based remote desktop can support operations on extended data other than basic input and output.

In order to achieve the above object, embodiments of the present invention adopt the following technical solutions:

In the first aspect, the embodiment of the present invention provides a method for remote desktop operation, the method is based on the HTML5 browser of the fifth version of hypertext markup language for remote desktop operation, the method includes:

Receive the remote desktop protocol RDP operation command sent by the server;

Determine whether the RDP operation command needs to call the local interface of the client;

If the RDP operation command needs to call the local interface of the client, call the corresponding application program interface API of the client according to the RDP operation command, so that the client performs the operation requested by the RDP operation command.

In a first possible implementation, according to the first aspect, the determining whether the RDP operation command requests to call the local interface of the client includes:

It is determined whether the RDP operation command requires the HTML5 browser to process the graphical interface data, and if not, it is determined that the RDP operation command needs to call the local interface of the client.

In the second possible implementation, according to the first possible implementation, it also includes:

If the RDP operation command requires the HTML5 browser to process the graphical interface data, the HTML5 browser is invoked, so that the HTML5 browser parses the RDP operation command to generate image information.

In the third possible implementation manner, according to the second possible implementation manner, before invoking the HTML5 browser, the method further includes: converting the RDP operation command into a format supported by the HTML5 protocol.

In the fourth possible implementation manner, in combination with the first aspect or according to the first to third possible implementation manners, the second operation request sent by the HTML5 browser according to the user operation is received, and the second operation request requires the client to Operate on the current graphical interface of the terminal;

According to the second operation request, perform operations on the local interface of the client, so that the client performs the operation requested by the second operation command.

In the fifth possible implementation manner, according to the fourth possible implementation manner, the second operation request is an operation request for enlarging or reducing the graphical interface.

In a second aspect, the embodiment of the present invention provides a client for remote desktop operation, the client includes: an HTML5 browser module, a communication module, a local application program interface API module and a calling module;

The HTML5 browser module is used to perform remote desktop operations based on the HTML5 browser of the fifth version of Hypertext Markup Language;

The communication module is configured to receive the Remote Desktop Protocol RDP operation command sent by the server;

The calling module is used to determine whether the RDP operation command needs to call the local interface of the client, if necessary, call the corresponding local API module of the client according to the RDP operation command, if not, call the HTML5 browser device module;

The local API module is configured to execute the operation requested by the RDP operation command when receiving the calling command of the calling module.

In the first possible implementation, in combination with the second aspect, if the remote desktop protocol RDP operation command sent by the server needs to process the graphical interface data, the HTML5 browser module is also used to parse and generate the RDP operation command image information.

In a second possible implementation, in combination with the second aspect or according to the first possible implementation, the HTML5 browser module includes: a WebSocket server submodule and an HTML5 Canvas submodule;

The calling module is also used to convert the RDP operation command into a format supported by the HTML5 protocol;

The WebSocket server submodule is used to send the converted operation command supporting the HTML5 protocol to the HTML5 Canvas submodule;

The HTML5 Canvas submodule is used to analyze the converted operation command to generate image information.

In the third possible implementation, according to the second possible implementation, the client further includes an input interface and a human-computer interaction interface;

The HTML5 Canvas submodule is also used to capture the operation request input by the user through the input interface and/or human-computer interaction interface, and send the operation request to the WebSocket server;

The WebSocket server submodule is also used to forward the operation request to the calling module;

The calling module is also used to determine whether the operation request needs to operate the current graphical interface of the client; if it is determined that the operation request does not need to operate the current graphical interface of the client, then convert the operation request format supported by the RDP protocol.

In the fourth possible implementation, according to the third possible implementation, the WebSocket server submodule is further configured to send the operation request if the operation request needs to operate on the current graphical interface of the client to the calling module, so that the calling module calls the corresponding local API module.

In the fifth possible implementation manner, according to the fourth possible implementation manner, the operation request for operating the current graphical interface of the client includes: an operation request for enlarging or reducing the graphical interface.

In a sixth possible implementation manner, in combination with the second aspect or the first to fifth possible implementation manners, the calling module is a gateway plug-in.

The embodiment of the present invention provides a method for remote desktop operation and a client, the method includes: receiving a remote desktop protocol RDP operation command sent by the server; determining whether the RDP operation command needs to call the local interface of the client; if the The above RDP operation command needs to call the local interface of the client, and call the corresponding application program interface API of the client according to the RDP operation command, so that the client performs the operation requested by the RDP operation command. In this way, when the client using HTML5 browser accesses the remote server, the method can still call the API of the local client, so when the remote desktop operation is performed based on the browser, the operation on the image data is implemented using HTML At the same time, it can also support the extended channel of the RDP protocol, and the operation on the extended data can be redirected to the local client, and the corresponding local API can be called for execution.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention. Those skilled in the art can also obtain other drawings based on these drawings without creative work.

FIG. 1 provides a schematic flowchart of a method for remote desktop operation according to an embodiment of the present invention;

FIG. 2 provides a schematic flowchart of another remote desktop operation method according to an embodiment of the present invention;

FIG. 3 is an example diagram of a remote desktop system provided by an embodiment of the present invention;

Fig. 4 is a schematic diagram of the system interaction of the redirected recording operation provided by the embodiment of the present invention;

FIG. 5 is a schematic structural diagram of a remote desktop operation client provided by an embodiment of the present invention;

FIG. 6 is a schematic structural diagram of another remote desktop operation client provided by an embodiment of the present invention;

FIG. 7 is a schematic structural diagram of another remote desktop operation client provided by an embodiment of the present invention.

Detailed ways

The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

It should be noted that the "local interface", "local API interface" and "local API interface module" appearing in the embodiments of the present invention can be used interchangeably. In addition, the term "and/or" in this article is only an association relationship describing associated objects, which means that there may be three relationships, for example, A and/or B, which can mean: A exists alone, A and B exist simultaneously, and A and B exist separately. There are three cases of B. In addition, the character "/" in this article generally indicates that the contextual objects are an "or" relationship.

Embodiment one,

In order to solve the problem that the current remote desktop system does not support some extended data-related operations, the embodiment of the present invention expands the functions of the client, and adds a calling module of the local application program interface on the client side, and the calling module of the local application program interface receives After the call command to the local application program interface is sent by the server according to the user's instruction, the corresponding local application program interface is called to complete the corresponding operation on the extended data.

An embodiment of the present invention provides a method for remote desktop operation, wherein the method is based on a browser for remote desktop operation, and the method is applied to an application scenario where a client remotely accesses a remote server, and the client uses HTML5 to browse device, as shown in Figure 1, the method includes:

101. Receive a remote desktop protocol RDP operation command sent by the server.

Wherein, the RDP operation command sent by the server may be a command for operating image data, or an operation for extended data.

Wherein, the operation on the image data can be completed through the HTML5 of the client, and the operation on the extended data needs to be completed by calling the corresponding local application program interface API of the client.

102. Determine whether the RDP operation command needs to call a local interface of the client.

After receiving the RDP operation command sent by the server, the client needs to judge whether it needs to call the local interface of the client or operate the image data, so that the client can determine HTML5 to execute the request, or call the local API to execute the request.

103. If the operation command needs to call the local interface of the client, call the application program interface API of the corresponding client according to the RDP operation command, so that the client executes the request requested by the RDP operation command operate.

Optionally, since the client of the remote desktop operation can call the local API of the client, the method may further include: receiving a second operation request sent by the HTML5 browser according to user operation, and the second operation request needs to Operate on the current graphical interface of the client;

According to the second operation request, perform operations on the local interface of the client, so that the client performs the operation requested by the second operation command.

The embodiment of the present invention provides a method for remote desktop operation, because this method can still call the API of the local client when the client using the HTML5 browser accesses the remote server, so that the remote desktop operation is performed based on the browser When the operation on the image data is implemented in HTML, it can also support the extended channel of the RDP protocol, and the operation on the extended data can be redirected to the local client, and the corresponding API is called for execution.

Embodiment two,

An embodiment of the present invention provides a method for remote desktop operation, wherein the method performs remote desktop operation based on hypertext markup language HTML, as shown in FIG. 2 , the method includes:

201. The client accesses the remote server.

202. The client sends a first operation request to the server according to a user operation.

Wherein, the first operation request is used to operate an application corresponding to the client, for example, an application displayed on a graphical interface.

The application corresponding to the client is installed or stored and executed on the remote server.

For example, the first operation request may be that the user starts an application program displayed on the graphical interface of the client, or plays audio and video files displayed on the graphical interface of the client, or prints a file displayed on the graphical interface. .

Wherein, the first operation request is an operation command input through an input interface of the client; and/or, an operation command input through a human-computer interaction interface.

Specifically, the input interface may be at least one of the following interfaces: an audio input interface, a video input interface, and a universal serial bus interface (Universal Serial BUS, USB for short). The input interfaces referred to in the embodiment of the present invention are not limited thereto, and are not exhaustive here.

For example, the user may request an operation of an application through a mouse, and the user may also input a voice operation request through audio.

203. The server sends an RDP operation command to the client according to the first operation request.

Wherein, the RDP operation command may carry an indication of a local application program interface of the client or data of a graphical interface that the RDP operation command needs to call.

Since the remote operation client and the server follow the RDP protocol, the first operation command is encapsulated in an RDP format.

The application displayed on the graphical interface of the client is installed or stored and executed on the server. After the client of the remote desktop operation receives the first operation request, it needs to send the first operation request to the server, so that The server executes the first operation request.

It should be noted that, if the server needs to directly execute the first operation request, after executing the first operation request, the server sends the data of the graphical interface after executing the first operation request to The client is to redirect the image data to the client, so that the client can draw and display.

And if the server determines that the first operation request can be performed by calling the local application program interface of the client, and does not directly execute the first operation request, the server redirects the first operation request (in the form of an RDP operation command) ), the RDP operation command carries an indication of the client’s local application program interface that the RDP operation command needs to call, and sends the RDP operation command to the client, so that the remote client executes the operation command and calls the local API.

204. The client receives the RDP operation command sent by the server.

205. The client determines whether the RDP operation command requires the HTML5 browser to process graphical interface data.

Wherein, the local API of the client includes a file system interface of the client, a local printer interface of the client, a communication port of the client, or an interface of audio and video input and output devices of the client, and the like.

206. If the RDP operation command requires the HTML5 browser to process the graphical interface data, call the HTML5 browser, so that the HTML5 browser parses the RDP operation command to generate image information.

Specifically, the canvas tool Canvas in HTML5 may be used to analyze the image data included in the RDP operation command to generate image information.

Before parsing the image data contained in the RDP operation command to generate image information, the client may further convert the RDP operation command into a WebSocket format supported by the HTML5 protocol.

After analyzing the image data contained in the RDP operation command to generate image information, the generated image information is displayed on the client.

207. If the RDP operation command does not require the HTML5 browser to process the graphical interface data, call the local application program interface API of the corresponding client according to the operation requested by the RDP operation command, and determine that the RDP operation command requires The local interface of the client makes a call, so that the client performs the operation requested by the RDP operation command.

The following specifically takes the redirection recording function as an example. As shown in Figure 3, the system example diagram of the remote desktop, the client consists of four parts, including: gateway plug-in, WebSocket server, HTML5 Canvas and local API.

Among them, the WebSocket server is used to push the image data from the server to the HTML5 Canvas; at the same time, it is also used to send the operation requests of the mouse and keyboard input captured by the HTML5 Canvas to the server through the gateway plug-in. HTML5 Canvas is used to capture the operation requests input by the mouse and keyboard, and upload the operation requests to the WebSocket server. The gateway plug-in is used to convert the data based on the WebSocket protocol from the HTML5 browser and the data from the RDP protocol from the server. It is also used to receive the RDP operation command sent by the server. If the operation command is a request to the client Call the local interface of the terminal and call the corresponding local API.

It should be noted that the composition diagram of the client in FIG. 3 is only a schematic description, and is not limited to the structure of the client. Of course, the client can also only include the WebSocket server, HTML5 Canvas, local API and local API call unit, as for the data from the HTML5 browser based on the WebSocket protocol and the data from the RDP protocol from the server. The gateway for protocol conversion Plugins are also available as standalone devices, or as modules for servers. Specifically, this embodiment of the present invention does not specifically limit it.

Taking the system of the remote desktop shown in FIG. 4 as an example below, it is specifically described that the method includes:

301. The user clicks a recording button of an application on the HTML5 Canvas program interface, and the HTML5 Canvas captures the recording request.

302. The HTML5 Canvas uploads the recording request to the Websocket server.

303. The Websocket server sends the recording request to the gateway plug-in.

304. The gateway plug-in packages and encapsulates the recording request into a command in RDP format.

305. The gateway plug-in sends the command in the RDP format to the server.

306. The server triggers the monitoring event of the recording button on the local program, and calls the local sound interface program.

307. The server captures the monitoring event, and sends the sound format supported by the server to the gateway plug-in.

308. The gateway plug-in calls the local API, that is, queries the local API for the sound format supported by the client.

309. The local API returns the sound format supported by the client to the gateway plug-in.

310. The gateway plug-in packages and encapsulates the sound format supported by the client into an RDP format and sends it to the server.

311. The server sends an RDP operation command to the gateway plug-in, and the RDP operation command requests the client to open the sound device.

312. After receiving the RDP operation command, the gateway plug-in invokes a local sound device for recording.

313. The local API returns the recording information to the gateway plug-in.

314. The gateway plug-in packages and encapsulates the recording information into an RDP format and returns it to the server.

The embodiment of the present invention provides a method for remote desktop operation. When a client using an HTML5 browser accesses a remote server, it can still call the API of the local client. In this way, when performing remote desktop operations based on the browser, that is While the operation on the image data is realized by HTML, it can also support the extended channel of the RDP protocol, and the operation on the extended data can be redirected to the local client, and the corresponding API is called for execution.

Embodiment three,

An embodiment of the present invention provides a client terminal for remote desktop operation, and the client performs remote desktop operation based on the HTML5 browser of the fifth version of hypertext markup language. Specifically, as shown in FIG. 5 , the client includes: an HTML5 browser module 51 , a call module 52 , a local application program interface API module 53 and a communication module 54 .

The HTML5 browser module 51 is used to perform remote desktop operations based on the HTML5 browser of the fifth version of Hypertext Markup Language;

The communication module 54 is configured to receive the Remote Desktop Protocol RDP operation command sent by the server;

The calling module 52 is used to determine whether the RDP operation command needs to call the local interface of the client, if necessary, call the local API module of the corresponding client according to the RDP operation command, if not, call the HTML5 browser module 51;

The local API module 53 is configured to execute the operation requested by the RDP operation command when receiving the calling command from the calling module 52 .

Wherein, the RDP operation command sent by the server may be a command for operating image data, or an operation for extended data.

Wherein, the operation on the image data can be performed by the HTML5 browser module 51 to analyze and generate image information, while the operation on the extended data needs to be completed by calling the local API module 53 of the corresponding client by the calling module 52 .

Further, if the remote desktop protocol RDP operation command sent by the server needs to process the graphical interface data, the HTML5 browser module 51 is also configured to analyze the RDP operation command to generate image information.

Further, as shown in FIG. 6, the HTML5 browser module 51 includes: a WebSocket server submodule 511 and an HTML5 Canvas submodule 512;

The calling module 52 is also used to convert the RDP operation command into a format supported by the HTML5 protocol;

The WebSocket server submodule 511 is configured to send the converted operation command supporting the HTML5 protocol to the HTML5 Canvas submodule 512;

The HTML5 Canvas submodule 512 is configured to analyze the converted operation command to generate image information.

Further, as shown in FIG. 7 , the client also includes an input interface 55 and a human-computer interaction interface 56;

Wherein, the user's operation may be an operation input through the input interface 55 and/or the human-computer interaction interface 56 .

The user's operation request is used to operate an application corresponding to the client, for example, an application displayed on a graphical interface.

The application corresponding to the client is installed or stored and executed on the remote server.

For example, the user's operation request may be that the user starts an application program displayed on the graphical interface of the client, or plays audio and video files displayed on the graphical interface of the client, or prints a file displayed on the graphical interface. .

Specifically, the input interface 55 may be at least one of the following interfaces: an audio input interface, a video input interface, and a universal serial bus interface (Universal Serial BUS, USB for short). The input interfaces referred to in the embodiment of the present invention are not limited thereto, and are not exhaustive here.

For example, the user may request an operation of an application through a mouse, and the user may also input a voice operation request through audio.

The HTML5 Canvas submodule 512 is also used to capture the operation request input by the user through the input interface 55 and/or the human-computer interaction interface 56, and send the operation request to the WebSocket server 511;

The WebSocket server submodule 511 is further configured to forward the operation request to the calling module 52;

The calling module 52 is also used to determine whether the operation request needs to operate the current graphical interface of the client; if it is determined that the operation request does not need to operate the current graphical interface of the client, then the operation request is converted format supported by the RDP protocol.

Then, the operation request is sent to the server through the communication module 53 .

Further, the WebSocket server sub-module 511 is also configured to send the operation request to the calling module 52 if the calling module 52 determines that the operation request needs to operate on the current graphical interface of the client to The calling module 52 is made to call the corresponding local API module 53 .

Wherein, the operation request for operating the current graphical interface of the client includes: an operation request for enlarging or reducing the graphical interface.

Optionally, the invoking module 52 is specifically a gateway plug-in, for example, refer to the client shown in FIG. 3 .

It should be noted that those skilled in the art can clearly understand that for the convenience and brevity of the description, the specific working process and description of the remote desktop operation client described above can be referred to in the first and second method embodiments The corresponding process will not be repeated here.

The embodiment of the present invention provides a client for remote desktop operations. Since the client can still call the API of the local client when accessing the remote server, when performing remote desktop operations based on the browser, the image While the data operation is realized by using HTML, it can also support the extended channel of the RDP protocol, and the operation on the extended data can be redirected to the local client, and the corresponding local API is called for execution.

Through the description of the above embodiments, those skilled in the art can clearly understand that for the convenience and brevity of the description, only the division of the above-mentioned functional modules is used as an example for illustration. In practical applications, the above-mentioned functions can be allocated according to needs It is completed by different functional modules, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. For the specific working process of the above-described system, device, and unit, reference may be made to the corresponding process in the foregoing method embodiments, and details are not repeated here.

In the several embodiments provided in this application, it should be understood that the disclosed system, device and method can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the modules or units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be Incorporation may either be integrated into another system, or some features may be omitted, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.

If the integrated unit is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the essence of the technical solution of the present invention or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium , including several instructions to make a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor (processor) execute all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or optical disk and other media that can store program codes. .

The above is only a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Anyone skilled in the art can easily think of changes or substitutions within the technical scope disclosed in the present invention. Should be covered within the protection scope of the present invention. Therefore, the protection scope of the present invention should be determined by the protection scope of the claims.

Claims (13)

1. a method for remote desktop operation, described method carries out remote desktop operation based on hypertext markup language fifth edition HTML5 browser, it is characterized in that, the method comprises: Receive the remote desktop protocol RDP operation command sent by the server; Determine whether the RDP operation command needs to call the local interface of the client; If the RDP operation command needs to call the local interface of the client, call the corresponding application program interface API of the client according to the RDP operation command, so that the client performs the operation requested by the RDP operation command. 2. The method according to claim 1, wherein the determining whether the RDP operation command requests to call the local interface of the client comprises: It is determined whether the RDP operation command requires the HTML5 browser to process the graphical interface data, and if not, it is determined that the RDP operation command needs to call the local interface of the client. 3. The method according to claim 2, further comprising: If the RDP operation command requires the HTML5 browser to process the graphical interface data, the HTML5 browser is invoked, so that the HTML5 browser parses the RDP operation command to generate image information. 4. The method according to claim 3, further comprising: converting the RDP operation command into a format supported by the HTML5 protocol before calling the HTML5 browser. 5. The method according to any one of claims 1-4, characterized in that the method further comprises: Receiving the second operation request sent by the HTML5 browser according to the user operation, the second operation request needs to operate the current graphical interface of the client; According to the second operation request, the local interface of the client is called, so that the client performs the operation requested by the second operation command. 6. The method according to claim 5, wherein the second operation request is an operation request for zooming in or zooming out the graphical interface. 7. A client for remote desktop operations, characterized in that the client includes: an HTML5 browser module, a communication module, a local application program interface API module and a calling module; The HTML5 browser module is used to perform remote desktop operations based on the HTML5 browser of the fifth version of Hypertext Markup Language; The communication module is used to receive the remote desktop protocol RDP operation command sent by the server; The calling module is used to determine whether the RDP operation command needs to call the local interface of the client, if necessary, call the corresponding local API module of the client according to the RDP operation command, if not, call the HTML5 browser device module; The local API module is configured to execute the operation requested by the RDP operation command when receiving the calling command of the calling module. 8. The client according to claim 7, wherein, if the Remote Desktop Protocol RDP operation command sent by the server needs to process the graphical interface data, the HTML5 browser module is also used to process the RDP operation command Parsing generates image information. 9. The client according to claim 8, wherein the HTML5 browser module comprises: a WebSocket server submodule and an HTML5Canvas submodule; The calling module is also used to convert the RDP operation command into a format supported by the HTML5 protocol; The WebSocket server submodule is used to send the converted operation command supporting the HTML5 protocol to the HTML5Canvas submodule; The HTML5Canvas submodule is used to analyze the converted operation command to generate image information. 10. The client according to claim 9, further comprising an input interface and a human-computer interaction interface; The HTML5Canvas submodule is also used to capture the operation request input by the user through the input interface and/or human-computer interaction interface, and send the operation request to the WebSocket server submodule; The WebSocket server submodule is also used to forward the operation request to the calling module; The calling module is also used to determine whether the operation request needs to operate the current graphical interface of the client; if it is determined that the operation request does not need to operate the current graphical interface of the client, then convert the operation request format supported by the RDP protocol. 11. The client according to claim 10, wherein the WebSocket server submodule is further configured to send the operation request to the client if the operation request needs to operate the current graphical interface of the client. The above calling module, so that the calling module calls the corresponding local API module. 12 . The client according to claim 11 , wherein the operation request for operating the current graphical interface of the client includes: an operation request for enlarging or reducing the graphical interface. 13 . 13. The client according to any one of claims 7-11, wherein the calling module is a gateway plug-in.