WO2011097793A1 - Method, apparatus and system for remote access - Google Patents

Abstract

Embodiments of the present invention provide a method, an apparatus and a system for remote access. The method includes: establishing a connection with a local end; acquiring in real time the remote end desktop displaying image and/or the remote end audio signal in the unit of frame or slice; respectively compressing the acquired remote end desktop displaying image and/or the remote end audio signal; and transmitting in real time the compressed data to the local end. The method, apparatus and system in the embodiments of the present invention enable the transmission of the remote end audio and video to the local end, achieve the effect of viewing in real time, and at the same time enable the real-time control of the remote end through the peripheral controlling apparatus such as a keyboard, a mouse and the like at the local end, and solve the problems of high cost in local end, being unable to smoothly transmit video images and being inconvenient to realize cross-platform in the prior art.

Description

 Remote access method, device and system

Technical field

 The present invention relates to computers, and more particularly to a remote access method, apparatus and system. Background technique

 Since the invention of the computer, there has been a great demand for remote access and parallel use of computers. This method can bring people various conveniences and can realize more meaningful applications, such as: You can control the computer from a distance. The remote computer can be used by different terminals, which is more convenient to use; one computer can be shared by multiple people, and the utilization rate is higher; the host is uniformly maintained, and the maintenance cost is reduced.

 One of the remote access methods is the technology of remote desktop. Remote desktop is a service launched by the network administrator to manage the maintenance server. By using the remote desktop connection program, any remote control connected to the network is enabled. A computer is just like running the computer itself, running a program, maintaining a database, and so on. In the specific practice process, the remote desktop system has a relatively large delay time, and the parameter transfer method is used to implement its function. Therefore, a higher device must be configured on the local end to cooperate. Summary of the invention

 The embodiment of the invention provides a remote access method, device and system for transmitting audio and video of a remote end to a local end to achieve real-time viewing effect, and simultaneously controlling a remote end at a local end through a peripheral control device such as a keyboard or a mouse. .

 The above object of the embodiment of the present invention is achieved by the following technical solutions:

 A remote access method, the method is applied to a remote end, and the method includes:

 Establish a connection with the local end;

 Collecting the desktop display image of the remote end in real time in units of frames or slices, and/or collecting audio signals of the remote end;

The collected desktop display image of the remote end and/or the audio signal of the remote end are respectively pressed The compressed data is sent to the local end in real time.

 A remote access method, the method is applied to a local end, and the method includes:

 Establish a connection with the remote end;

 Receiving the compressed desktop display image and/or audio signal sent by the remote end in real time; decompressing the compressed desktop display image and/or audio signal in real time to display and/or play.

 A collection and encoding device for remote access, the device comprising:

 a connection unit, configured to establish a connection with the local end;

 a collecting unit, configured to acquire a desktop display image of the remote end in real time in units of frames or slices, and/or collect audio signals of the remote end;

 a compression unit, configured to compress the desktop display image of the remote end collected by the collection unit and/or the audio signal of the remote end respectively;

 And a sending unit, configured to send the compressed data to the local end in real time.

 A decoding display device for remote access, the device comprising:

 a connection unit, configured to establish a connection with the remote end;

 a receiving unit, configured to receive a compressed desktop display image and/or an audio signal sent by the remote end in real time;

 And a decoding unit, configured to decompress and display and/or play the compressed desktop display image and/or audio signal in real time.

 A remote access system, characterized in that the system comprises: a remote end and at least one local end, wherein:

 The remote end includes the aforementioned acquisition and coding device;

 The local end includes the aforementioned decoding display device.

The method, the device and the system of the embodiment of the invention can transmit the audio and video of the remote end to the local end, and achieve the effect of real-time viewing. At the same time, the remote control can be controlled in real time through a peripheral control device such as a keyboard or a mouse at the local end, thereby solving the present problem. In the technology, the local end is costly and cannot be smoothly transmitted. Video screens and inconveniences such as cross-platform. DRAWINGS

 The drawings described herein are provided to provide a further understanding of the invention and are in no way of limitation. In the drawing:

 1 is a flowchart of a remote access method according to an embodiment of the present invention;

 2 is a flow chart of a method for establishing a connection between a remote end and a local end;

 3 is a flowchart of a remote access method according to another embodiment of the present invention;

 4 is a schematic diagram of data transmission of a remote access method according to the embodiment;

 FIG. 5 is a flowchart showing the operation of the remote access method according to the embodiment; FIG.

 6 is a block diagram showing the composition of an acquisition and coding apparatus according to an embodiment of the present invention;

 7 is a block diagram showing the composition of a decoding display device according to an embodiment of the present invention;

 FIG. 8 is a block diagram showing the composition of a remote access system according to an embodiment of the present invention. detailed description

 In order to make the objects, the technical solutions and the advantages of the embodiments of the present invention more clearly, the embodiments of the present invention will be described in detail below with reference to the embodiments and drawings. The illustrative embodiments of the invention and the description thereof are intended to be illustrative of the invention, but are not intended to limit the invention.

 FIG. 1 is a flowchart of a remote access method according to an embodiment of the present invention. The method is applied to a remote end in a remote access process. Referring to FIG. 1, the method includes:

 Step 101: The remote end establishes a connection with the local end;

 In this embodiment, the connection between the remote end and the local end can be accomplished by using the method shown in FIG. 2. Referring to FIG. 2, the method includes:

 Step 201: The remote end receives a connection request sent by the local end;

 Step 202: The remote end verifies the validity of the local end according to the connection request. Step 203: When the local end is legal, the remote end establishes a connection with the local end.

The remote end and the local end establish a connection through the network, which may be a wired network, or may be Wireless network, this embodiment is not limited thereto.

 The remote end can be composed of a PC including a network card, and has functions of acquisition, encoding, and the like. Step 102: The remote end collects the desktop display image of the remote end in real time in units of frames or slices, and/or collects audio signals of the remote end;

 In this embodiment, only the desktop display image may be collected, or only the audio signal may be collected, or the desktop display image and the audio signal may be simultaneously acquired. This embodiment is not limited thereto.

 Step 103: The remote end compresses the collected desktop display image of the remote end and/or the audio signal of the remote end respectively;

 In this embodiment, the remote end compresses the collected desktop display image by using an H.264 compression algorithm. If the remote end collects the desktop display image in real time on a frame basis, the collected image is divided into each frame. A number of slices are compressed, and each slice is sent immediately after compression. If the remote end collects the desktop display image in real time in the form of Slice, each slice of each captured image is compressed and immediately transmitted.

 In this embodiment, the compression of the collected audio data by the remote end may be performed by using an AAC (Adaptive Audio Coding) compression algorithm, and details are not described herein again.

 Step 104: The remote end sends the compressed data to the local end in real time.

 In this embodiment, the remote end sends the collected and compressed data in real time, and can be sent by using a User Datagram Protocol (UDP). In order to make the receiving effect better, a sequence number can be added to the sent data packet. Timestamps, etc., will not be described here.

 According to an embodiment of the embodiment, the method further includes:

 Step 105: The remote end receives a desktop control signal sent by the local end by using a peripheral control device connected to the remote end;

 In this embodiment, the peripheral control device may be a mouse, a keyboard, a game controller, or other control device, and the embodiment is not limited thereto.

Step 106: The remote end refreshes the desktop display image and/or audio signal of the remote end according to the desktop control signal. In this embodiment, the local terminal may send a desktop control signal to the remote end through a peripheral control device connected to the remote end, and after receiving the desktop control signal, the remote end may perform corresponding processing according to the desktop control signal, thereby refreshing The remote desktop displays the content, so that the remote terminal collects the image information and/or audio information displayed by the refreshed desktop according to the method of step 102.

 Wherein, the connection mode between the local peripheral peripheral control device and the remote end depends on the distance between the local end and the remote end and needs, for example, at a relatively close distance, the local peripheral peripheral control device can directly connect to the remote end by using an extended connection, It can be connected to the remote end using short-range wireless transmission technology. For example, the local mouse and keyboard can be directly connected to the remote end using an extended keyboard and mouse connection, or the local mouse and keyboard can be connected to the remote end via Bluetooth, ZigBee (Zigbee, IEEE 802.15.4 protocol), etc.; In this case, the peripheral peripheral control device can be connected to the remote end through the network. The above is only an example, and the embodiment is not limited thereto.

 Through the remote access method of the embodiment, the remote end does not need to have an understanding of the operating system of the remote host computer or only requires little knowledge, and the desktop content (including image, sound or image and sound) of the remote host computer can be obtained. Transfer to the local end, the local end can display the desktop display content of the remote host computer host in real time, play the sound content of the remote end computer host, and realize the cross-platform capability and maximum system-independent remote access.

 FIG. 3 is a flowchart of a remote access method according to an embodiment of the present invention. The method is applied to a local end of a remote access process. According to FIG. 3, the method includes:

 Step 301: The local end establishes a connection with the remote end;

 Step 302: The local end receives the compressed desktop display image and/or audio signal sent by the remote end in real time;

 Step 303: The local terminal displays and/or plays the compressed desktop display image and/or audio signal in real time after being decompressed.

The method in this embodiment corresponds to the method in the embodiment shown in FIG. 1. When the remote end transmits the compressed data to the local end in real time according to the method shown in FIG. 1, the local end decodes and plays the data. . In this embodiment, the local end may also receive data by using UDP, analyze the type, serial number, and the like of the data packet after receiving the data, remove the type representation, and send the video data to the video decoding part of the local end, and the audio is The data is sent to the audio decoding portion of the local end.

 In this embodiment, the local end decodes the received video data and audio data separately according to a decompression (decoding) algorithm corresponding to the compression (encoding) algorithm of the front end, and restores the original data.

 In this embodiment, since the remote end sends the collected image of each frame into several slices for compression, or sends each slice that is collected and then immediately, the method according to the embodiment is After receiving the Slice data, the local end decompresses and displays it. After receiving each Slice, it immediately decompresses it and immediately displays it after decompression.

 According to an embodiment of the embodiment, the method further includes:

 Step 304: The local terminal sends a desktop control signal to the remote end through a peripheral control device connected to the remote end, and the desktop display image and/or audio signal of the remote end is refreshed by the desktop control signal.

 In this embodiment, the local terminal may send a desktop control signal to the remote end through a peripheral control device connected to the remote end, such as a mouse or a keyboard, and after receiving the desktop control signal by the remote end, the desktop control signal may be Corresponding processing is performed to refresh the content on the remote desktop, so that the remote terminal collects the image information and/or audio information and the like displayed by the refreshed desktop according to the method of step 102.

 The connection between the local end and the remote end has been described in detail in the embodiment shown in FIG. 1, and details are not described herein again.

 Through the method of the embodiment, the local end can display the desktop content of the remote host computer and play the sound content of the remote host computer in real time, thereby realizing the cross-platform capability and the maximum system-independent remote access.

FIG. 4 is a schematic diagram of data transmission according to the remote access method according to the embodiment. Referring to FIG. 4, the remote end performs acquisition, encoding, and transmission of multimedia content on the desktop of the computer host according to the method of the embodiment. And the local end according to the method of the embodiment, the same as the received The data is decoded and displayed in real time, that is, the acquisition, encoding, transmission, decoding, and display of the entire remote access are performed in units of slices, and the parallel pipeline is used. Thus, the remote end does not need to operate on the remote host computer. The system has the knowledge or only a little understanding, you can transfer the desktop content of the remote host computer to the local end, the local end can display the desktop content of the remote host computer in real time, play the sound content of the remote host computer, and realize Strong cross-platform capabilities and maximum system-independent remote access.

 In order to make the remote access method of the present embodiment more clear and easy to understand, the remote access method of this embodiment will be described in detail below by taking a 5-minute movie on the remote end of the computer at the local end as an example. Referring to FIG. 5, the method includes the following steps:

 Step 501: The local end sends a connection request to the remote end.

 Step 502: The remote end verifies whether the local end is legal. When the local end is legal, the remote end establishes a connection with the local end, and the remote end encodes the content displayed on the current screen and sends the content to the local end; Step 503: The local end passes the mouse Control the remote computer cursor, open the movie;

 Step 504: The remote end collects the display content (movie) of the desktop of the computer, and collects the audio at the same time. Step 505: The computer at the remote end compresses (encodes) the collected audio and video information;

 Step 506: The remote end sends the compressed data to the local end through the network;

 Step 507: After receiving the data, the local end decompresses (decodes);

 Step 508: The local end displays the decoded video image and plays the decoded audio.

 Through the method of the embodiment, the user can display the desktop content of the remote host computer and play the sound content of the remote host computer in real time, without having to know the remote host operating system or only need little understanding, the local end It only needs to decode and display the received compressed data and return control information as needed. Therefore, it is relatively simple. This remote access method has the advantages of strong cross-platform capability and maximum system independence.

FIG. 6 is a schematic diagram of a composition of a collection and encoding device for remote access according to an embodiment of the present invention. The device is applied to a remote end. Referring to FIG. 6, the device includes: a connecting unit 61, configured to establish a connection with the local end;

 The collecting unit 62 is configured to collect the desktop display image of the remote end in real time in units of frames or slices, and/or collect audio signals of the remote end;

 The compression unit 63 is configured to compress the desktop display image of the remote end collected by the collection unit and/or the audio signal of the remote end respectively;

 The sending unit 64 is configured to send the compressed data to the local end in real time.

 According to an embodiment of the embodiment, the connecting unit 61 may include:

 The receiving module 611 is configured to receive a connection request sent by the local end.

 The verification module 612 is configured to verify the validity of the local end according to the connection request, and the connection module 613 is configured to establish a connection with the local end when the local end is legal. According to an embodiment of the embodiment, the compression unit 63 may include:

 The video compression module 631 is configured to divide each frame of the desktop display image collected by the collection unit 62 into a plurality of slices for compression, or to collect each slice of the desktop display image of each frame of the remote end collected by the acquisition unit 62. Compressing;

 The audio compression module 632 is configured to compress the audio signal collected by the collection unit 62. According to an embodiment of the embodiment, the apparatus further includes:

 The receiving unit 65 is configured to receive a desktop control signal sent by the local end by using a peripheral control device connected to the remote end;

 The refreshing unit 66 is configured to refresh the desktop display image and/or audio signal of the remote end according to the desktop control signal, so that the compression unit 63 compresses the refreshed data.

 According to an embodiment of the present embodiment, the sending unit 64 is configured to send the compressed data to the local end in real time by using a user data packet protocol.

The components of the acquisition and coding apparatus for remote access in this embodiment are respectively used to implement the steps of the method of the embodiment shown in FIG. 1. Since the method has been detailed in the embodiment shown in FIG. Description, no longer repeat here. With the device of the embodiment, the remote end does not need to know the operating system of the remote computer host or only needs a little understanding, and the content on the desktop of the remote host computer can be transmitted to the local end, and the local end can display in real time. The desktop content of the remote host computer and the sound content of the remote host computer host realize cross-platform capability and maximum system-independent remote access.

 FIG. 7 is a schematic diagram of a composition of a decoding display device for remote access according to an embodiment of the present invention. The device is applied to a local end. Referring to FIG. 7, the device includes:

 a connecting unit 71, configured to establish a connection with the remote end;

 The receiving unit 72 is configured to receive the compressed desktop display image and/or audio signal sent by the remote end in real time;

 The decoding unit 73 is configured to perform real-time decompression and display and/or playback of the compressed desktop display image and/or audio signal.

 According to an embodiment of the embodiment, the device further includes:

 The sending unit 74 is configured to send a desktop control signal to the remote end through a peripheral control device connected to the remote end, and refresh the desktop display image and/or audio signal of the remote end by the desktop control signal.

 The components of the decoding display device for remote access of this embodiment are respectively used to implement the steps of the method of the embodiment shown in FIG. 3, because in the embodiment shown in FIG. 3, the method has been detailed. Description, no longer repeat here.

 Through the device of the embodiment, the local end can display the desktop content of the remote host computer in real time and play the sound content of the remote host computer host, thereby realizing cross-platform capability and maximum system-independent remote access.

 FIG. 8 is a structural block diagram of a remote access system according to an embodiment of the present invention. Referring to FIG. 8, the system includes:

The remote end 81 is configured to collect, compress, and transmit the multimedia content on the desktop. The at least one local end 82 is configured to receive the multimedia content, and decode and display and/or play the multimedia content. In this embodiment, the remote end 81 may include the acquisition coding apparatus of the embodiment shown in FIG. 6, and the local end 82 may include the decoding display apparatus of the embodiment shown in FIG. 7, as implemented in FIG. 6 and FIG. In the example, each device has been described in detail, and details are not described herein again.

 With the system of the embodiment, the remote end does not need to know the operating system of the remote host computer host or only needs a little understanding, and the content on the desktop of the remote host computer host can be transmitted to the local end, and the local end can be real-time. Display the desktop content of the remote host computer and play the sound content of the remote host computer, realizing cross-platform capability and maximum system-independent remote access.

 The steps of a method or algorithm described in connection with the embodiments disclosed herein may be implemented directly in hardware, a software module executed by a processor, or a combination of both. The software module can be placed in random access memory (RAM), memory, read only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, removable disk, CD-ROM, or technical field. Any other form of storage medium known.

 The specific embodiments of the present invention have been described in detail with reference to the preferred embodiments of the present invention. The scope of the invention, any modifications, equivalents, improvements, etc., made within the spirit and scope of the invention are intended to be included within the scope of the invention.

Claims

Claim  A remote access method, the method being applied to a remote end, wherein the method comprises:  Establish a connection with the local end;  Collecting the desktop display image of the remote end in real time in units of frames or slices, and/or collecting audio signals of the remote end;  The collected desktop display image of the remote end and/or the audio signal of the remote end are respectively pressed to transmit the compressed data to the local end in real time.  2. The method according to claim 1, wherein establishing a connection with the local end comprises:  Receiving a connection request sent by the local end;  Verifying the validity of the local end according to the connection request;  When the local end is legal, a connection is established with the local end.  3. The method according to claim 1, wherein compressing the collected desktop display image of the remote end comprises:  If the desktop display image of the remote end is collected in real time in units of frames, the desktop display image of each frame of the collected remote end is divided into multiple pieces for compression;  If the desktop display image of the remote end is acquired in real time in units of slices, each piece of the desktop display image of each frame of the acquired remote end is compressed.  The method according to claim 1, wherein the method further comprises: receiving a desktop control signal sent by the local terminal through a peripheral control device connected to the remote end;  Refreshing the desktop display image and/or audio signal of the remote end according to the desktop control signal. The method according to claim 1, wherein the compressed data is sent to the local end in real time, including: The compressed data is sent to the local end in real time by using a user data packet protocol. A remote access method, the method is applied to a local end, and the method includes:  Establish a connection with the remote end;  Receiving the compressed desktop display image and/or audio signal sent by the remote end in real time; decompressing the compressed desktop display image and/or audio signal in real time to display and/or play.  The method according to claim 6, wherein the method further comprises: sending, by the peripheral control device connected to the remote end, a desktop control signal to the remote end, and refreshing the desktop control signal by using the desktop control device The desktop on the remote side displays images and/or audio signals.  An acquisition and coding device for remote access, the device includes: a connection unit, configured to establish a connection with a local end;  a collecting unit, configured to acquire a desktop display image of the remote end in real time in units of frames or slices, and/or collect audio signals of the remote end;  a compression unit, configured to compress the desktop display image of the remote end collected by the collection unit and/or the audio signal of the remote end respectively;  And a sending unit, configured to send the compressed data to the local end in real time.  The device according to claim 8, wherein the connection unit comprises: a receiving module, configured to receive a connection request sent by the local end;  a verification module, configured to verify validity of the local end according to the connection request;  a connection module, configured to establish a connection with the local end when the local end is legal.  The device according to claim 8, wherein the compression unit comprises: a video compression module, configured to divide each frame of the desktop display image of the remote end collected by the collection unit into multiple pieces for compression, Or compressing each slice of the desktop display image of each frame of the remote end collected by the collection unit; And an audio compression module, configured to compress the audio signal collected by the collection unit. The device according to claim 8, wherein the device further comprises: a receiving unit, configured to receive a desktop control signal sent by the local terminal through a peripheral control device connected to the remote end;  And a refreshing unit, configured to refresh the desktop display image and/or audio signal of the remote end according to the desktop control signal, so that the compression unit compresses the refreshed data.  The device according to claim 8, wherein the sending unit is configured to send the compressed data to the local end in real time by using a user data packet protocol.  A decoding display device for remote access, characterized in that: the device comprises: a connection unit, configured to establish a connection with a remote end;  a receiving unit, configured to receive a compressed desktop display image and/or an audio signal sent by the remote end in real time;  And a decoding unit, configured to decompress and display and/or play the compressed desktop display image and/or audio signal in real time.  The device according to claim 13, wherein the device further comprises: a sending unit, configured to send a desktop control signal to the remote end by using a peripheral control device connected to the remote end, by using the The desktop control signal refreshes the desktop display image and/or audio signal of the remote end.  15. A remote access system, the system comprising: a remote end and at least one local end, wherein:  The remote terminal includes the acquisition and coding device of any one of claims 8 to 12; and the local terminal includes the decoding display device according to any one of claims 13-14.  16. The system according to claim 15, wherein the remote end and the at least one local end are connected to each other through a wired network or a wireless network. 17. The system according to claim 15, wherein the local peripheral peripheral control device is connected to the remote end by an extended connection, or Bluetooth, or Z _lg Bee, or a network.