CN102547204B - Receiving device, screen image transmission system and transmission method thereof - Google Patents

Abstract

The invention discloses a receiving device, a screen picture transmission system and a transmission method thereof, wherein the transmission method comprises the following steps: a transmission end captures screen picture information and transmits the screen picture information to a receiving end, detects the operation of a user and outputs a mode switching signal; the receiving end temporarily stores the screen picture information transmitted by the transmitting end so that a display device can update the screen picture of the display device, and switches to an operation mode or a video mode according to the mode switching signal, wherein the screen picture information with longer playing time length is temporarily stored in the video mode, and the screen picture information with shorter playing time length is temporarily stored in the operation mode. According to the receiving device, the screen image transmission system and the transmission method thereof, the video can be smoothly played in the video mode, and better instant control feeling is provided in the operation mode.

Description

Receiving device, screen image transmission system and transmission method thereof

technical field

The invention relates to a receiving device, a screen image transmission system and a transmission method thereof, in particular to a receiving device with adjustable delay time, a screen image transmission system and a transmission method thereof.

Background technique

Sharing screen images is one of the important applications of information technology, such as remote control with a remote desktop, or a computer connected to a projector through wireless communication for presentations. In the past, the technology of sharing screen images was only suitable for transmitting relatively static content because of the low frame rate. However, with the continuous improvement of computer performance, image compression technology and wireless network bandwidth, the technology of sharing screen images has advanced to the point where the video content on the remote desktop can be viewed smoothly through the wireless network. In this field, the screen image information is to obtain the undistorted screen image information through the operating system through a software program.

When the existing remote desktop system transmits the screen image, the receiving end hardly stores the screen image data temporarily, so as to reduce the time delay (latency delay) from the transmitting end sending the screen image to the receiving end presenting the screen image. However, in order to smoothly transmit the desktop containing video content in the wireless transmission environment, it is necessary for the receiving end to temporarily store the screen image data. Because in most wireless transmission environments, especially wireless networks, the transmission packets arrive at the receiving end at different times. At this time, only by temporarily storing enough screen data at the receiving end as a buffer can the video content be transmitted to the receiving end. Maintain a smooth and jitter-free playback speed. In other words, if the receiving end has temporarily stored screen image data, the time delay between transmitting the screen image at the transmitting end and presenting the screen image at the receiving end will increase accordingly. However, when remote control is performed, a large delay cannot give the remote user a better sense of real-time control. For example, the corresponding response can only be generated on the display screen after the user taps the keyboard at the remote end for 2 to 3 seconds. At this time, it is difficult for the user to control the remote host computer.

To sum up, to propose a method and system for transmitting screen images so as to maintain the smoothness of the video when playing the video, and to have a better sense of real-time control when operating the host computer is the goal that needs to be worked hard at present.

Contents of the invention

The present invention provides a receiving device, a screen image transmission system and its transmission method. It detects the user's operation to control the system to switch between an operation mode and a video mode. In the operation mode, there is less temporary memory The on-screen image information makes the time delay of displaying the on-screen image shorter, so that the user has a better sense of real-time control, and in the video mode, more on-screen image information is temporarily stored, so that it can be played more smoothly video.

A screen image transmission system according to an embodiment of the present invention includes a transmitting device and a receiving device. The transmission device includes a capturing module, which is used to capture a screen image information; a first communication interface, which is used to convert the screen image information into a communication signal for transmission; and a first processing unit, which is connected with the capture The module is electrically connected with the first communication interface for processing screen image information and sending it out through the first communication interface. The receiving device includes a second communication interface, which is used to receive communication signals; a buffer, which is used to temporarily store screen image information for a display device to update its screen image according to the screen image information; a detection module, It is used to detect a user's operation, and output a mode switching signal corresponding to an operation mode or a video mode; and a second processing unit, which is electrically connected with the second communication interface, the buffer and the detection module , the second processing unit is used to access the buffer, and control the receiving device to switch to the operation mode or the video mode according to the mode switching signal, wherein, when the buffer is switched to the video mode, the output of the screen image information is suspended or the output screen image is reduced The speed of the information, and restore the normal output speed when the screen image information of the first playing time length is accumulated enough to temporarily store the screen image information of the first playing time length, and discard or accelerate the output when switching to the operation mode The screen image information temporarily stored in the video mode is used to temporarily store the screen image information of a second playing time length, and the first playing time length is longer than the second playing time length.

In another embodiment of the present invention, a receiving device and a transmitting device form a screen image transmission system. The receiving device includes a communication interface, a buffer, a detection module and a processing unit. The communication interface is used for receiving the communication signal sent by the transmission device, which includes a screen image information. The buffer is used for temporarily storing screen image information for a display device to update its screen image according to the screen image information. The detection module is used to detect a user's operation, and output a mode switch signal corresponding to an operation mode or a video mode. The processing unit is electrically connected with the communication interface, the buffer and the detection module. The processing unit is used to access the buffer, and control the receiving device to switch to the operation mode or the video mode according to the mode switching signal, wherein, when the buffer is switched to the video mode, the output of the screen picture information is suspended or the speed of outputting the screen picture information is reduced , and restore the normal output speed when accumulating enough screen image information of a first playing time length to temporarily store the screen image information of the first playing time length, and discard or speed up the output when switching to the operation mode. The temporarily stored screen image information is used to temporarily store the screen image information of a second playing time length, and the first playing time length is longer than the second playing time length.

A screen image transmission method according to another embodiment of the present invention includes: a transmitting end captures a screen image information and transmits it to a receiving end; detects a user's operation, and outputs the information corresponding to an operation mode or a video mode A mode switching signal; the receiving end receives and temporarily stores the screen image information for a display device to update its screen image according to the screen image information; and the receiving end switches to the operation mode or video mode according to the mode switching signal, wherein, When switching to the video mode, the output of the screen image information is suspended or the speed of the output screen image information is reduced, and the normal output speed is resumed when the screen image information is accumulated enough for a first playing time length, so as to temporarily store the first playing time The length of the screen image information, when switching to the operation mode, discard or accelerate the output of the temporarily stored screen image information in the video mode, so as to temporarily store the screen image information of a second playing time length, and the first playing time The length is greater than the second playing time length.

The receiving device, the screen image transmission system and the transmission method thereof in the embodiment of the present invention detect the operation of the user to control the system to switch between an operation mode and a video mode, and the video can be played smoothly in the video mode. In the operation mode, there is a better sense of immediate control.

Description of drawings

The drawings described here are used to provide further understanding of the present invention, constitute a part of the application, and do not limit the present invention. In the attached picture:

FIG. 1 is a block diagram showing a screen image transmission system according to an embodiment of the present invention;

FIG. 2 is a flowchart showing a screen image transmission method according to an embodiment of the present invention.

Figure number:

10 Screen image transmission system

11 Transmission device

111 Extraction module

112 The first communication interface

113 The first processing unit

114 encoding module

115 The first detection module

12 receiving device

121 Second communication interface

122 Second processing unit

123 buffer

124 Second detection module

125 Play module

126 The first connection interface

127 Second connection interface

20 display device

30 Human interface device

S21～S27 screen image transmission steps

Detailed ways

In the following, detailed descriptions will be made through specific embodiments and accompanying drawings, so that it is easier to understand the purpose, technical content, features and effects of the present invention.

Please refer to FIG. 1 , a screen frame transmission system 10 according to an embodiment of the present invention includes a transmission device 11 and a receiving device 12 . The transmission device 11 includes a capture module 111 , a first communication interface 112 and a first processing unit 113 . The capturing module 111 is used for capturing a screen image information. For example, the capture module 111 obtains undistorted screen image information through the operating system through a software program. The first communication interface 112 is used for converting the screen image information captured by the capturing module 111 into a communication signal for transmission. The first processing unit 113 is electrically connected with the capture module 111 and the first communication interface 112 , and is used for processing the screen image information captured by the capture module 111 and sending out through the first communication interface 112 . In an embodiment, an encoding module 114 may be disposed between the capturing module 111 and the first processing unit 113 . The encoding module 114 is used for encoding the screen frame information captured by the capturing module 111 to reduce the computing load of the first processing unit 113 .

The receiving device 12 includes a second communication interface 121 , a buffer 123 , a second detection module 124 and a second processing unit 122 . The second communication interface 121 is used for receiving the communication signal transmitted by the transmission device 11 . In one embodiment, the first communication interface 112 and the second communication interface 121 conform to the communication standard of wired network or wireless network. The second processing unit 122 is electrically connected to the second communication interface 121 , the buffer 123 and the second detection module 124 . The second processing unit 122 receives the screen image information demodulated from the second communication interface 121, and temporarily stores the screen image information in the buffer 123 as required, so that a display device 20 can use the screen information in the buffer 123 Updates its screen with on-screen information.

The second detection module 124 is used to detect a user's operation, and output a mode switch signal corresponding to an operation mode or a video mode. For example, the second detection module 124 is to detect an input signal of a human interface device (Human Interface Device, HID), such as a keyboard, a mouse, and other input devices, to determine whether the user is performing an operation. If the input signal of the human interface device is detected, it means that the user is operating, and the second detection module 124 outputs a mode switching signal corresponding to the operating mode. If the input signal of the human interface device is not detected within a predetermined time, it means that the user has stopped operating, and the second detection module 124 outputs a mode switching signal corresponding to the video mode.

Continuing the above description, the second processing unit 122 can control the receiving device 12 to switch to the operation mode or the video mode according to the mode switching signal output by the second detection module 124 . When in the video mode, the second processing unit 122 temporarily stores the screen image information of a first playing time length in the buffer 123, and when in the operation mode, the second processing unit 122 temporarily stores a second playing time in the buffer 123. Screen image information of a time length, wherein the first play time length is greater than the second play time length. In other words, in the video mode, the time delay between the transmission device 11 transmitting the screen image and the receiving device 12 presenting the screen image is longer; while in the operation mode, the time delay is shorter. It is foreseeable that the shorter the second playing time, the shorter the time delay between the transmission device 11 transmitting the screen image and the receiving device 12 presenting the screen image.

In one embodiment, the second processing unit 122 can play the screen image information stored in the buffer 123 through a playing module 125 . For example, the playing module 125 can be implemented by software, but not limited thereto. In the video mode, the playback module 125 waits for the preset buffer time before starting to play the screen images stored in the buffer 123 at the original playback speed according to the time stamp (time stamp) in each screen image information. information. When the receiving device 12 switches from the video mode to the operation mode, in order to shorten the time delay quickly, the playback module 125 can speed up the screen information temporarily stored in the output buffer 123 in the video mode, such as increasing the frame rate of the output video (frame rate), that is, the playback module 125 ignores the time stamp of each screen frame information, and outputs the screen frame information stored in the buffer 123 at a faster playback speed. Alternatively, the playing module 125 may also directly discard the screen image information temporarily stored in the buffer 123 in the video mode. In this way, the screen image information received by the receiving device 12 is the screen image of the user during operation. Due to the short time delay, the user cannot even perceive it, so the user can have better real-time control feel.

On the contrary, when the receiving device 12 is switched from the operation mode to the video mode, the playback module 125 can suspend outputting the screen image information temporarily stored in the buffer 123, or reduce the output of the screen image information temporarily stored in the buffer 123. For example, reduce the frame rate of the output video, so that the buffer 123 can temporarily store more screen image information. After accumulating the screen image information of the set playing time length, the playing module 125 can output the screen image at the original playback speed according to the time stamp of each screen image information.

In one embodiment, the receiving device 12 can be built in the display device 20 . Alternatively, the receiving device 12 may include a first connection interface 126 electrically connected to the second processing unit 122 . The display device 20 can be electrically connected to the receiving device 12 via the first connection interface 126 . For example, the first connection interface 124 can be a video port; the display device 20 can be an electronic device capable of displaying images such as a TV, a monitor, or a projector.

In one embodiment, the receiving device 12 may include a second connection interface 127 electrically connected to the second processing unit 122 . The human interface device 30 can be electrically connected to the receiving device 12 via the second connection interface 127 , so that the user can use the human interface device 30 connected to the receiving device 12 to operate a remote host. For example, the second connection interface 127 can be a USB interface. According to the above structure, the display device 20 lacking an input device, such as a projector, can be connected with the receiving device 12 including the human interface device 30 so that the user can control the remote host, such as selecting a video to play.

It should be noted that the transmission device 11 may also include a first detection module 115 electrically connected to the first processing unit 113 . The first detection module 115 is also used to detect the user's operation, and output a corresponding mode switching signal to the receiving device 12 , and the receiving device 12 switches to the corresponding playback mode according to the mode switching signal output by the transmitting device 11 . For example, the user operates the remote computer via the human interface device connected to the receiving device 11, but uses a wireless keyboard or a wireless mouse to operate, and the receiving device 12 can still switch according to the mode switching signal output by the transmitting device 11. to the corresponding playback mode to provide a better sense of real-time control.

Please refer to FIG. 2 to illustrate a screen image transmission method according to an embodiment of the present invention. Firstly, a transmitting terminal captures a screen image information and transmits it to a receiving terminal (S21). The transmitting end or the receiving end detects a user's operation, and outputs a mode switching signal corresponding to an operating mode or a video mode (S22). Next, the receiving end receives and temporarily stores the screen image information transmitted by the transmitting end, and receives a mode switching signal (S23). The receiving end judges according to the mode switching signal that it should switch to the operation mode or the video mode (S24). If switching to the video mode, the receiving end temporarily stores the screen image information with a longer playing time (S25), so that the time delay between the transmitting end sending the screen image and the receiving end presenting the screen image is relatively long, and can be more smoothly Play video. If switching to the operation mode, the receiving end temporarily stores the screen image information of a shorter playing time (S26), so that the time delay between the transmitting end transmitting the screen image and the receiving end presenting the screen image is relatively short, so that the user can enjoy A better sense of instant control. Finally, the display device updates its screen image according to the screen image information temporarily stored by the receiving end (S27). Other detailed descriptions are as described above, and will not be repeated here.

To sum up the above, the receiving device, the screen image transmission system and the transmission method thereof of the present invention detect the operation of the user to control the system to switch between an operation mode and a video mode, wherein in the operation mode, the temporary storage is more Less screen information makes the time delay of displaying the screen shorter, so that the user has a better sense of real-time control. Play video.

The above-described embodiments are only for illustrating the technical ideas and characteristics of the present invention, and its purpose is to enable those skilled in the art to understand the content of the present invention and implement it accordingly. When it cannot limit the scope of the present invention, that is, generally Equivalent changes or modifications made according to the spirit disclosed in the present invention should still be covered within the patent scope of the present invention.

Claims (14)

1. A screen image transmission system, characterized in that, comprising: A transmission device comprising: a capture module, which is used to capture a screen image information; A first communication interface, which is used to convert the screen image information into a communication signal for transmission; and A first processing unit, which is electrically connected with the capture module and the first communication interface, and is used to process the screen information and send it out through the first communication interface; and A receiving device comprising: a second communication interface, which is used to receive the communication signal; a buffer for temporarily storing the screen image information for a display device to update its screen image according to the screen image information; A second detection module, which is used to detect a user's operation, and output a mode switching signal corresponding to an operation mode or a video mode; and A second processing unit, which is electrically connected to the second communication interface, the buffer, and the second detection module, the second processing unit is used to access the buffer, and according to the mode A switching signal controls the receiving device to switch to the operation mode or the video mode, wherein the buffer suspends output of the screen picture information or reduces the output of the screen picture information when switching to the video mode speed, and restore the normal output speed when enough screen image information of a first playing time length is accumulated, so as to temporarily store the screen image information of the first playing time length, and switch to the operation Discard or accelerate the output of the screen image information temporarily stored in the video mode when in the video mode, so as to temporarily store the screen image information of a second playing time length, and the first playing time length is longer than the specified the second playback time length. 2. The screen image transmission system according to claim 1, wherein the second detection module detects an input signal of a human interface device to determine whether the user is operating. 3. The screen image transmission system as claimed in claim 1, wherein the second detection module does not detect an input signal of a human interface device within a predetermined time, and then determines that the user has not operated , and output the mode switching signal corresponding to the video mode. 4. The screen image transmission system according to claim 1, wherein the receiving device comprises a first connection interface electrically connected to the second processing unit for the display device to pass through The first connection interface is electrically connected to the receiving device. 5. The screen image transmission system according to claim 1, wherein the receiving device includes a second connection interface electrically connected to the second processing unit for a human interface device electrically connected to the receiving device via the second connection interface. 6. The screen image transmission system according to claim 1, wherein the transmission device comprises a first detection module electrically connected to the first processing unit for detecting the user's and outputting the mode switching signal corresponding to the operating mode or the video mode to the receiving device. 7. The screen image transmission system according to claim 1, wherein the transmission device comprises an encoding module electrically connected between the capturing module and the first processing unit for encoding the screen image information. 8. A receiving device, which forms a screen picture transmission system with a transmission device, and the transmission device transmits a communication signal comprising a screen picture information, it is characterized in that the receiving device comprises: a communication interface, which is used to receive the communication signal; a buffer for temporarily storing the screen image information for a display device to update its screen image according to the screen image information; A detection module, which is used to detect a user's operation, and output a mode switching signal corresponding to an operation mode or a video mode; and A processing unit, which is electrically connected to the communication interface, the buffer, and the detection module, the processing unit is used to access the buffer, and control the switching of the receiving device according to the mode switching signal to the operation mode or the video mode, wherein the buffer suspends outputting the screen information or reduces the speed of outputting the screen information when switching to the video mode, and accumulates enough The normal output speed is restored when the screen image information of the first playing time length is played, so as to temporarily store the screen image information of the first playing time length, and when switching to the operation mode, the output speed is discarded or accelerated. The screen image information temporarily stored in the video mode is used to temporarily store the screen image information of a second playing time length, and the first playing time length is longer than the second playing time length. 9. The receiving device according to claim 8, further comprising a first connection interface electrically connected to the processing unit for the display device to communicate with the processing unit via the first connection interface The receiving device is electrically connected. 10. The receiving device according to claim 8, further comprising a second connection interface, which is electrically connected to the processing unit, for a human interface device to communicate with through the second connection interface. The receiving device is electrically connected. 11. A screen image transmission method, characterized in that, comprising: A transmitting terminal captures a screen image information and transmits it to a receiving terminal; Detecting a user's operation, and outputting a mode switching signal corresponding to an operation mode or a video mode; The receiving end receives and temporarily stores the screen image information for a display device to update its screen image according to the screen image information; and The receiving end switches to the operation mode or the video mode according to the mode switching signal, wherein when switching to the video mode, the output of the screen picture information is suspended or the output of the screen picture information is reduced. speed, and restore the normal output speed when accumulating enough screen image information of a first playing time length, to temporarily store the screen image information of the first playing time length, and switch to the operation mode temporarily discarding or accelerating the output of the screen image information temporarily stored in the video mode to temporarily store the screen image information of a second playing time length, and the first playing time length is longer than the Second playback time length. 12. The screen image transmission method as claimed in claim 11, wherein the detection step is to detect an input signal of a human interface device to determine whether the user is performing an operation. 13. The screen image transmission method as claimed in claim 11, wherein the detecting step includes determining that the user has not performed an operation if no input signal of a human interface device is detected within a predetermined time period, and outputting the mode switching signal corresponding to the video mode. 14. The screen image transmission method according to claim 11, wherein the detecting step is performed by at least one of the transmitting end and the receiving end.