[go: up one dir, main page]

WO2019210667A1 - Procédé de transmission d'image d'écran, dispositif, serveur et support de stockage - Google Patents

Procédé de transmission d'image d'écran, dispositif, serveur et support de stockage Download PDF

Info

Publication number
WO2019210667A1
WO2019210667A1 PCT/CN2018/113685 CN2018113685W WO2019210667A1 WO 2019210667 A1 WO2019210667 A1 WO 2019210667A1 CN 2018113685 W CN2018113685 W CN 2018113685W WO 2019210667 A1 WO2019210667 A1 WO 2019210667A1
Authority
WO
WIPO (PCT)
Prior art keywords
screen
server
receiving
data
display screen
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2018/113685
Other languages
English (en)
Chinese (zh)
Inventor
郭庆伟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Shiyuan Electronics Thecnology Co Ltd
Guangzhou Shirui Electronics Co Ltd
Original Assignee
Guangzhou Shiyuan Electronics Thecnology Co Ltd
Guangzhou Shirui Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Shiyuan Electronics Thecnology Co Ltd, Guangzhou Shirui Electronics Co Ltd filed Critical Guangzhou Shiyuan Electronics Thecnology Co Ltd
Publication of WO2019210667A1 publication Critical patent/WO2019210667A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/16—Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
    • H04L69/164—Adaptation or special uses of UDP protocol

Definitions

  • the present invention relates to the field of screen sharing, and in particular, to a screen picture transmission method, device, server, system, and storage medium.
  • Screen sharing is of high application value in modern work and has a wide range of applications in modern teaching.
  • a participant wants to share the screen screen that the source device is playing to other participants.
  • the speaker at the meeting will share the content to the audience.
  • the player's device is played on the device, or the teacher shares the lecture content on the student's device for display, so that multiple participants of the event can see the same display content on their device.
  • screen transmission is the core technology.
  • the transmitting end in order to realize screen screen transmission, the transmitting end often connects to the receiving end through the socket and transmits the screen image data, and the receiving end receives the screen screen data through the socket and displays it, thereby sharing the display content of the transmitting end.
  • the receiving end In a specific implementation, one of the methods is that the transmitting end and the receiving end are directly connected through the socket, and the other method is that the sending end is connected to the external forwarding unit through the socket, and the transmitting end is received by the forwarding unit through the socket. The screen data sent is sent to the receiving end.
  • the inventors have found that in the existing screen picture transmission technology, since the underlying layer of the socket is based on the TCP protocol and is limited by the congestion control and retransmission strategy of the TCP protocol, the redundant information transmitted will gradually accumulate. The delay between the playback content of each receiving end and the playing content of the transmitting end is increased, the information transmission efficiency is low, affecting the real-time and smoothness of sharing, and the number of participants in the same network is greatly restricted.
  • the object of the embodiments of the present invention is to provide a screen picture transmission method, device, server, system, and storage medium, which can effectively improve the real-time and smoothness of screen picture transmission, and improve the upper limit of participants that can be supported in screen picture transmission.
  • an embodiment of the present invention provides a screen picture transmission method, including:
  • the data of the display screen is used to trigger the server to send it to the subscribed receiving end device through the media channel, and trigger the receiving of the
  • the receiving end device that displays the data of the screen performs rendering display on the data of the display screen by using a browser; wherein the media channel is a communication link of the UDP protocol based on WebRTC.
  • the subscription instruction is used to trigger the server to forward the subscription instruction to at least one receiving end device, and set a subscription status of the receiving end device that feeds the subscription request to be subscribed.
  • a browser-based screen image transmission method intercepts a display screen of a current time of the device, and sends the intercepted data of the display screen through a browser.
  • the server is then sent to the receiving device through the media channel of the WebRTC-based UDP protocol for display, thereby realizing the transmission of the screen image.
  • the transmission of the media channel based on the WebRTC-based UDP protocol solves the problem that the transmission efficiency of the prior art is low due to the congestion control and retransmission strategy of the TCP protocol, and the real-time and smoothness of the sharing is not high and can be supported.
  • the technical problem with lower participant limit effectively improves the real-time and smoothness of screen transmission, and increases the upper limit of participants that can be supported in screen transmission.
  • the embodiment of the invention further provides another screen picture transmission method, including the steps:
  • the first media channel receives, by the first media channel, data of a display screen sent by the sending end device through the browser; wherein the first media channel is a communication link of a UDP protocol based on WebRTC, and data of the display screen is used by the sending end
  • the device intercepts the current display screen
  • the second media channel Receiving, by the second media channel, the received data of the display screen to the currently subscribed receiving end device; wherein the second media channel is a communication link of a WebRTC-based UDP protocol.
  • the subscription status of the receiving device that issued the subscription request is set to subscribed.
  • the communication link with the transmitting device further includes a first signaling channel of a TCP protocol-based TCP protocol; and before the receiving the subscription request from the receiving device, :
  • the sending end device Receiving, by the sending end device, a subscription instruction sent by the first signaling channel; the subscription instruction includes address information of the local device;
  • the subscription instruction further includes address information of the at least one receiving end device; the receiving end device to be subscribed to is the receiving end device corresponding to the address information of the receiving end device.
  • the communication link with the receiving end device further includes a second signaling channel of a TCP protocol-based TCP protocol; and the second signaling channel is used to the receiving end to be subscribed
  • the device forwards the received subscription instruction and receives a subscription signal sent by the receiving device in response to the subscription instruction.
  • a browser-based screen image transmission method receives data of a display screen sent by a transmitting end device through a first media channel, and passes the data of the display screen through The two media channels are forwarded to the receiving device, thereby implementing transmission of the screen of the transmitting device.
  • the first media channel and the second media channel are both communication links of the UDP protocol of the WebRTC, which solves the problem that the transmission efficiency of the prior art is low due to congestion control and retransmission policies of the TCP protocol.
  • the technical problem of low real-time and fluency of sharing and low supportable upper limit of participants can effectively improve the real-time and smoothness of screen transmission and increase the upper limit of participants that can be supported in screen transmission.
  • the embodiment of the invention further provides a screen image transmission device, comprising:
  • a screen intercepting module configured to intercept a display screen at a current time
  • a picture transmission module configured to transmit the intercepted data of the display screen to a local browser
  • a screen forwarding module based on the local browser, sending data of the display screen to a server; the data of the display screen is used to trigger the server to send it to the subscribed receiving device through the media channel, and trigger
  • the receiving end device receiving the data of the display screen performs rendering display on the data of the display screen by using a browser; wherein the media channel is a communication link of a UDP protocol based on WebRTC.
  • An embodiment of the present invention further provides another screen picture transmission apparatus, including a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, the processor executing the computer program
  • the first screen transmission method as described above is implemented.
  • An embodiment of the present invention further provides a screen transfer server, including a first sub-server, where the first sub-server includes:
  • a receiving module configured to receive data of a display screen sent by the sending end device through the browser through the first media channel, where the first media channel is a communication link of a UDP protocol based on WebRTC, and the data of the display screen Obtaining, by the sending end device, the current display screen;
  • a detecting module configured to obtain a receiving device that is currently subscribed to
  • a forwarding module configured to forward the received data of the display screen to the currently subscribed receiving end device by using the second media channel, where the second media channel is a communication link of a WebRTC-based UDP protocol.
  • the second sub-server is further included, and the second sub-server includes:
  • An instruction receiving module configured to receive a subscription instruction sent by the sending end device; the subscription instruction includes address information of the first sub-server;
  • an instruction forwarding module configured to forward the received subscription instruction to the receiving end device to be subscribed, and receive a subscription signal sent by the receiving end device in response to the subscription instruction.
  • the first sub-server and the second sub-server are provided on the same computer device or on different computer devices.
  • Another embodiment of the present invention provides a screen transfer server including a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, the processor executing the computer program
  • the second screen transmission method as described above is implemented.
  • the embodiment of the present invention further provides a computer readable storage medium, comprising: a stored computer program, wherein, when the computer program is running, controlling a device where the computer readable storage medium is located performs any of the above A screen transmission method as described.
  • the embodiment of the present invention further provides a screen picture transmission system, comprising the screen picture transmission device according to any one of the preceding claims, and a plurality of receiving end devices, further comprising the screen picture transmission server according to any one of the preceding claims;
  • the screen picture transmission device is connected to the screen picture transmission server through a network as a source device; the receiving device is connected to the screen picture transmission server through a network.
  • the screen picture transmission system Compared with the prior art, the screen picture transmission system provided by the embodiment of the present invention intercepts the display screen of the current time of the screen picture transmission device, and transmits the data of the display screen to the screen screen transmission through the first media channel. And transmitting, by the screen transmission server, the second screen channel to the receiving end device, thereby implementing transmission of the screen image of the screen image transmission device.
  • the first media channel and the second media channel are both communication links of the UDP protocol of the WebRTC, which solves the problem that the transmission efficiency of the prior art is low due to congestion control and retransmission policies of the TCP protocol.
  • the technical problem of low real-time and fluency of sharing and low supportable upper limit of participants can effectively improve the real-time and smoothness of screen transmission and increase the upper limit of participants that can be supported in screen transmission.
  • FIG. 1 is a schematic structural diagram of a screen picture transmission system according to an embodiment of the present invention.
  • FIG. 2 is a schematic flowchart of a screen picture transmission method according to an embodiment of the present invention.
  • FIG. 3 is a schematic flowchart diagram of another screen picture transmission method according to an embodiment of the present invention.
  • FIG. 4 is a flow chart showing an alternative flow of the screen transfer method shown in FIG.
  • FIG. 5 is a schematic flowchart of a screen picture transmission method according to an embodiment of the present invention.
  • FIG. 6 is a schematic structural diagram of a screen picture transmission apparatus according to an embodiment of the present invention.
  • FIG. 7 is a schematic structural diagram of a screen picture transmission server according to an embodiment of the present invention.
  • FIG. 8 is a schematic structural diagram of a screen picture transmission apparatus according to an embodiment of the present invention.
  • the screen transmission system includes at least one transmitting device, at least one server, and a plurality of receiving devices; wherein the transmitting device and the receiving device have at least a display function and are installed with browsing Program related to the function.
  • the transmitting device is connected to the server through a network
  • the receiving device is connected to the server through a network
  • the screen transmission system 100 includes a sender device 110, a server 120, and three receiver devices 130, wherein Both the end device 110 and the sink device 130 are connected to the server 120 via a network.
  • the structure shown in the screen transmission system 100 is only an example. In other cases, the number of devices in the screen transmission system may be adjusted, for example, two or four receiving devices may be included, or It is a larger number of sender devices, and can also be a larger number of servers, without affecting the beneficial effects that can be achieved by the present invention.
  • the embodiment of the invention provides a screen picture transmission method as shown in FIG. 2, and the screen picture transmission method can be performed by a sender device of the screen picture transmission system.
  • a sender device of the screen picture transmission system.
  • any participant's tablet or smart phone can be used as the sender device, while other participants
  • the network display device can be used as the receiving device; for example, in the teaching class, the teacher's tablet or smart phone can be used as the sending device, and the student's tablet or smart phone can be used as the receiving device.
  • the types of devices that can be used as the transmitting device include, but are not limited to, a tablet computer or a smart phone, and can also be a display computer having a display function and a related program with a browser function, such as a notebook computer, a desktop computer, or a learning machine. Electronic equipment.
  • the screen picture transmission method provided by the embodiment of the present invention includes the following steps S110 to S130.
  • the sending end device may intercept the display screen of the device itself at the current time, thereby obtaining data of the display screen.
  • the display screen may be all content being displayed by the display module of the sending end device, or may be part of content being displayed; the intercepting may be data extraction to obtain data of the display screen. It is also possible to obtain the data of the display screen by saving the display screen without affecting the advantageous effects obtained by the present invention.
  • the sending end device may transmit data of the display screen to the local browser by using an internal data channel of the device itself; and performing intercepting of the display screen by the local browser.
  • the data of the display screen intercepted by the local browser may be transmitted and transmitted within the program.
  • S130 Send, according to the local browser, data of the display screen to a server, where the data of the display screen is used to trigger the server to send the data to the subscribed receiving end device through the media channel, and trigger the receiving.
  • the receiving end device of the data of the display screen performs rendering display on the data of the display screen by using a browser; wherein the media channel is a communication link of a UDP protocol based on WebRTC.
  • the subscription status of all or part of the receiving end device may be set to be subscribed by sending a subscription instruction to the server in advance; wherein the subscription instruction is used to trigger when received by the server
  • the server forwards a subscription instruction to the at least one receiving end device; the subscription instruction forwarded by the server is configured to trigger the receiving end device to feed back a subscription request to the server when received by the receiving end device, the server
  • the subscription status of the receiving device that feeds back the subscription request is set to subscribed. It can be understood that the timing of sending the subscription instruction to the server may be performed before step S110 or before step S120 or step S130, without affecting the beneficial effects obtained by the present invention.
  • the media channel connected between the sender device and the server is pre-built based on the UDP protocol of WebRTC.
  • the sending end device may establish a communication link to connect to the server according to a WebRTC UDP protocol by accessing an IP address of the server on the local browser, and perform subsequent steps via the communication link.
  • the data of the display screen intercepted is sent to the server. Since the media channel is built based on the WebRTC UDP channel, and the function of the device is implemented based on a local browser, it is not necessary to develop different client programs for different operating systems, and the screen is improved while reducing the development difficulty. The compatibility and stability of the picture transmission method in different application environments.
  • the browser-based screen image transmission method provided by the embodiment of the present invention, the interception of the display screen of the current time of the device is performed, and the intercepted data of the display screen is sent to the server by the browser, and then The server sends the media channel based on the WebRTC-based UDP protocol to the receiving device for display, thereby realizing the transmission of the screen image.
  • the transmission of the media channel based on the WebRTC-based UDP protocol solves the problem that the transmission efficiency of the prior art is low due to the congestion control and retransmission strategy of the TCP protocol, and the real-time and smoothness of the sharing is not high and can be supported.
  • the technical problem with lower participant limit effectively improves the real-time and smoothness of screen transmission, and increases the upper limit of participants that can be supported in screen transmission.
  • the embodiment of the present invention further provides a browser-based screen image transmission method as shown in FIG. 3, which may be executed by a server of the screen image transmission system, and includes steps S210 to S230 as described below.
  • S210 Receive, by using a first media channel, data of a display screen sent by a sending device by using a browser, where the first media channel is a communication link of a WebRTC-based UDP protocol, and the data of the display screen is The sending device intercepts the current display screen.
  • the server is connected to the sending end device by using the first media channel. Specifically, the server may receive a network access request of the sending end device in advance and respond, so that the UDP protocol based on the WebRTC is constructed and The communication link between the sender devices is the first media channel.
  • the server may directly obtain the subscribed receiving device by performing the step of performing the step, or the server may perform the steps in FIG. 4 by using the step.
  • the flow shown in step S221 to step S224 or the flow as shown in step S223 to step S224 is performed to instantly update the subscription status of the receiving device to provide flexibility in adjusting the subscription status of the receiving device. It can be understood that the above two control modes for the subscription state of the receiving device are only used as an example, and the method for controlling the subscription state of the receiving device in the above manner does not affect the present invention. The beneficial effects achieved.
  • steps S221 to S224 are as follows:
  • the subscription instruction includes address information of the local device.
  • the subscription instruction may further include address information of the at least one receiving end device, and the receiving end device corresponding to the address information of the receiving end device is used as the receiving end device to be subscribed.
  • the address information of the device may be an IP address of the server or other information including an address of the server in the network.
  • the first signaling channel is a pre-built WebSocket-based TCP communication link, and the communication link connects the server and the sending end device, so that signaling between the server and the sending end device.
  • the stream and the media stream are transmitted through different communication links, which avoids the mutual influence of the transmission of the media stream and the signaling stream, and improves the bandwidth utilization and communication efficiency.
  • the subscription instruction is used to trigger the receiving device to initiate a subscription request to the local device according to the address information in the subscription instruction.
  • the server may be that the receiving end device forwards the received subscription instruction through the second signaling channel.
  • the second signaling channel is a pre-built WebSocket-based TCP communication link, and the communication link connects the server and the receiving end device to enable signaling flow between the server and the receiving end device.
  • the media stream is transmitted through different communication links, which avoids the interaction between the media stream and the signaling stream, and improves bandwidth utilization and communication efficiency.
  • the subscription request may be request information for constructing a media channel that is sent by the receiving device to the server, or request information for subscribing to the server, or may be received by the receiving device.
  • the server may be configured to receive the subscription request that is sent by the receiving end device, that is, directly perform step S223 without performing step S221 and step S222; or may receive the receiving device to send under a specific trigger condition. If the server performs step S221 and step S222, the receiving end device is triggered to send a subscription request, and then the content of step S223 is executed, thereby improving the controllability of the subscription status of the receiving end device and the subscription status.
  • the convenience of regulation It can be understood that regardless of whether the server receives the subscription request sent by the receiving device by using the above manner, the beneficial effects that can be achieved by the present invention are not affected.
  • the second media channel may be constructed when the receiving device accesses the server, or may be constructed when the server receives the subscription request sent by the receiving device, without affecting The beneficial effects that can be achieved by the present invention.
  • the screen picture transmission method provided by the embodiment of the invention receives the data of the display screen sent by the sending end device through the first media channel, and forwards the data of the display screen to the receiving end device through the second media channel, thereby realizing The transmission of the screen of the transmitting device.
  • the first media channel and the second media channel are both communication links of the UDP protocol of the WebRTC, which solves the problem that the transmission efficiency of the prior art is low due to congestion control and retransmission policies of the TCP protocol.
  • the technical problem of low real-time and fluency of sharing and low supportable upper limit of participants can effectively improve the real-time and smoothness of screen transmission and increase the upper limit of participants that can be supported in screen transmission.
  • the embodiment of the present invention further provides a screen image transmission method as shown in FIG. 5, which may be executed by a screen screen transmission system, and includes the following steps S310 to S370:
  • the transmitting device intercepts the display screen at the current time.
  • the sending end device transmits the intercepted data of the display screen to a local browser.
  • the sending end device sends, according to the local browser, data of the display screen to a server by using a first media channel, where the first media channel is a communication link of a UDP protocol based on WebRTC.
  • the server receives data of the display screen by using the first media channel.
  • the server acquires a currently subscribed receiving end device.
  • the server forwards the received data of the display screen to a currently subscribed receiving end device by using a second media channel, where the second media channel is a communication link of a WebRTC-based UDP protocol.
  • the receiving end device receives data of the display screen from the second media channel, and performs rendering display on data of the display screen.
  • the screen transmission system 100 includes a transmitting device 110, a server 120, a receiving device 130A, a receiving device 130B, and a receiving device 130C.
  • the source device 110 is connected to the sink devices 130A, 130B, and 130C through the server 120.
  • the transmitting device 110 intercepts the display screen A of its current time to obtain the data of the display screen A.
  • the source device 110 transmits the data of the display screen A to the local browser, and then transmits the data of the display screen A to the server 120 based on the local browser.
  • the data is triggered by the server 120 to perform the forwarding operation, that is, the data of the display screen A is forwarded to the receiving device.
  • the server 120 forwards the data of the display screen A, the subscription instruction B sent by the source device 110 is also received, and the server 120 forwards the subscription instruction B to the receiving device 130A and the receiving device 130B, and the receiving device After receiving the subscription instruction B forwarded by the server 120, the 130A feeds back the subscription request C to the server 120. After receiving the subscription request C, the server 120 sets the subscription status of the receiving device 130A to subscribed. When the server 120 forwards the data of the display screen A, since the subscription status of the receiving end device 130A is subscribed, the subscription status of the receiving end devices 130B and 130C is not set to subscribed, so the server 120 forwards the data of the display screen A. To the receiving end device 130A, the receiving end device 130A performs rendering display on the received data of the display screen A, so that the intercepted display screen of the transmitting end device 110 is shared with the receiving end device 130A.
  • the screen picture transmission method provided by the embodiment of the present invention, the current display screen is intercepted by the sending end device, and the data of the display screen is sent to the server through the first media channel, and the data of the display screen is passed by the server.
  • the second media channel is forwarded to the receiving device, thereby implementing transmission of the screen of the transmitting device.
  • the first media channel and the second media channel are both communication links of the UDP protocol of the WebRTC, which solves the problem that the transmission efficiency of the prior art is low due to congestion control and retransmission policies of the TCP protocol.
  • the technical problem of low real-time and fluent sharing and low supportable participants has effectively improved the real-time and smoothness of screen transmission and increased the upper limit of participants that can be supported in screen transmission.
  • the embodiment of the invention further provides a screen picture transmission device.
  • the screen picture transmission device 40 can be used as a transmitting end device of the screen picture transmission system, or can be used as a component of the transmitting end device.
  • the screen picture transmission device 40 includes:
  • the screen capture module 41 is configured to intercept the display screen at the current time
  • the screen transmission module 42 is configured to transmit the intercepted data of the display screen to a local browser
  • the screen forwarding module 43 sends the data of the display screen to the server based on the local browser; the data of the display screen is used to trigger the server to send it to the subscribed receiving device through the media channel, and The receiving end device that triggers the data received by the display screen performs rendering display on the data of the display screen by using a browser; wherein the media channel is a communication link of a WebRTC-based UDP protocol.
  • the workflow of the screen transfer device 40 is the same as the screen transfer method shown in FIG. 2, and details are not described herein.
  • the screen picture transmission device intercepts the display screen of the current time of the device, sends the intercepted data of the display screen to the server through the browser, and then passes the server through the WebRTC.
  • the media channel of the UDP protocol is sent to the receiving device for display, thereby realizing the transmission of the screen image.
  • the transmission of the media channel based on the WebRTC-based UDP protocol solves the problem that the transmission efficiency of the prior art is low due to the congestion control and retransmission strategy of the TCP protocol, and the real-time and smoothness of the sharing is not high and can be supported.
  • the technical problem with lower participant limit effectively improves the real-time and smoothness of screen transmission, and increases the upper limit of participants that can be supported in screen transmission.
  • the embodiment of the present invention further provides a screen transfer server.
  • the screen transfer server 50 can serve as a server of the screen transfer system or as a component of the server.
  • the screen transfer server 50 includes a first sub-server 51, and the first sub-server 51 includes a receiving module 51a, a detecting module 51b, and a forwarding module 51c.
  • the receiving module 51a is configured to receive data of a display screen sent by the sending end device through the browser through the first media channel, where the first media channel is a communication link of a UDP protocol based on WebRTC, and the display screen is The data is obtained by intercepting the current display screen by the transmitting device.
  • the detecting module 51b is configured to obtain the receiving device that is currently subscribed.
  • the forwarding module 51c is configured to forward, by using the second media channel, the received data of the display screen to the currently subscribed receiving end device, where the second media channel is a communication link of a WebRTC-based UDP protocol.
  • the screen transfer server 50 may further include a second sub-server 52, and the second sub-server 52 includes an instruction receiving module 52a and an instruction forwarding module 52b.
  • the instruction receiving module 52a is configured to receive a subscription instruction sent by the sender device, where the subscription instruction includes address information of the first subserver.
  • the instruction forwarding module 52b is configured to forward the received subscription instruction to the receiving end device to be subscribed, and receive a subscription signal sent by the receiving end device in response to the subscription instruction.
  • first sub-server 51 and the second sub-server 52 may be located on the same computer device; the first sub-server 51 and the second sub-server 52 may also be located on different computer devices and share the same IP address.
  • another child server can remain in normal operation, providing stability to the system screen transfer server.
  • the working process of the screen transfer server 50 is the same as the screen transfer method shown in FIG. 3, and details are not described herein.
  • the browser-based screen image transmission server provided by the embodiment of the present invention receives the data of the display screen sent by the sending end device through the first media channel, and forwards the data of the display screen to the receiving end device through the second media channel. Thereby, the transmission of the screen of the transmitting device is realized.
  • the first media channel and the second media channel are both communication links of the UDP protocol of the WebRTC, which solves the problem that the transmission efficiency of the prior art is low due to congestion control and retransmission policies of the TCP protocol.
  • the technical problem of low real-time and fluency of sharing and low supportable upper limit of participants can effectively improve the real-time and smoothness of screen transmission and increase the upper limit of participants that can be supported in screen transmission.
  • the embodiment of the invention further provides a screen picture transmission device.
  • the screen picture transmission device 60 can be used as a component of the sender device in the screen picture transmission system or as a sender device or as a screen image.
  • a component or server of the server in the transmission system, the screen transfer device 60 includes a processor 61, a memory 62, and a computer program stored in the memory and operable on the processor, such as a screen transfer program .
  • the processor 61 executes the computer program, the steps in the above embodiments of the respective screen image transmission methods are implemented, for example, step S120 shown in FIG.
  • the processor executes the computer program, the functions of each module in the foregoing device embodiments are implemented, such as the screen screen transmission device or the screen screen transmission server described in the above embodiments.
  • the computer program can be partitioned into one or more modules that are stored in the memory 62 and executed by the processor 61 to complete the present invention.
  • the one or more modules may be a series of computer program instruction segments capable of performing a particular function, the instruction segments being used to describe the execution of the computer program in the screen transmission device 60.
  • the computer program may be divided into a screen intercepting module, a screen transmission module, and a screen forwarding module, and the specific functions of each module are as follows: the screen intercepting module is configured to intercept a current time display screen; the screen transmission module Transmitting, by the screen forwarding module, the data of the display screen to the server according to the local browser; the data of the display screen is used by the screen forwarding module And the receiving end device that triggers the server to send the data to the subscribed receiving end device through the media channel, and triggers the receiving the data of the display screen to display and display the data of the display screen by using a browser;
  • the media channel is a communication link of the WebRTC-based UDP protocol.
  • the computer program can also be divided into a receiving module, a detecting module and a forwarding module.
  • the specific functions of each module are as follows: the receiving module is configured to receive, by using the first media channel, data of a display screen sent by the sending end device through the browser.
  • the first media channel is a communication link of the UDP protocol based on the WebRTC, and the data of the display screen is obtained by the sending end device to intercept the current display image;
  • the detecting module is configured to acquire the current
  • the subscribed receiving device is configured to forward the received data of the display screen to the currently subscribed receiving end device through the second media channel; wherein the second media channel is a WebRTC-based
  • the communication link of the UDP protocol is a WebRTC-based
  • the screen transmission device 60 may be a computing device such as a desktop computer, a notebook, a palmtop computer, and a cloud server.
  • the screen transfer device 60 may include, but is not limited to, a processor 61 and a memory 62. It will be understood by those skilled in the art that the schematic diagram is merely an example of a screen transmission device, does not constitute a limitation of the screen transmission device 60, may include more or less components than those illustrated, or may combine certain components. Or different components, such as the screen transmission device 60, may also include input and output devices, network access devices, buses, and the like.
  • the processor 61 may be a central processing unit (CPU), or may be other general-purpose processors, a digital signal processor (DSP), an application specific integrated circuit (ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, etc.
  • the general purpose processor may be a microprocessor or the processor may be any conventional processor or the like, and the processor 61 is a control center of the screen transmission device 60, and connects the entire screen transmission by using various interfaces and lines. Various parts of device 60.
  • the memory 62 can be used to store the computer program and/or module, by executing or executing computer programs and/or modules stored in the memory 62, and recalling data stored in the memory 62, Various functions of the screen transmission device 60 are implemented.
  • the memory 62 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may be Stores data created based on the use of the phone (such as audio data, phone book, etc.).
  • the memory 62 may include a high-speed random access memory, and may also include a non-volatile memory such as a hard disk, a memory, a plug-in hard disk, a smart memory card (SMC), and a secure digital (SD). Card, flash card, at least one disk storage device, flash device, or other volatile solid state storage device.
  • a non-volatile memory such as a hard disk, a memory, a plug-in hard disk, a smart memory card (SMC), and a secure digital (SD).
  • SSD secure digital
  • flash card at least one disk storage device, flash device, or other volatile solid state storage device.
  • the module integrated by the screen transmission device 60 can be stored in a computer readable storage medium if it is implemented in the form of a software functional unit and sold or used as a separate product. Based on such understanding, the present invention implements all or part of the processes in the foregoing embodiments, and may also be completed by a computer program to instruct related hardware.
  • the computer program may be stored in a computer readable storage medium. The steps of the various method embodiments described above may be implemented when the program is executed by the processor.
  • the computer program comprises computer program code, which may be in the form of source code, object code form, executable file or some intermediate form.
  • the computer readable medium may include any entity or device capable of carrying the computer program code, a recording medium, a USB flash drive, a removable hard disk, a magnetic disk, an optical disk, a computer memory, a read-only memory (ROM). , random access memory (RAM, Random Access Memory), electrical carrier signals, telecommunications signals, and software distribution media.
  • the screen picture transmission apparatus provided by the embodiment of the present invention can obtain the beneficial effects of the screen picture transmission apparatus shown in FIG. 6 when it is used as a component of the transmission end device of the screen picture transmission system or as a transmission end device;
  • the beneficial effects of the screen transmission server shown in FIG. 7 can be obtained, and details are not described herein.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Computer Security & Cryptography (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

L'invention concerne un procédé de transmission d'image d'écran basé sur un navigateur. Ledit procédé comprend les étapes consistant à : capturer une image d'affichage au moment actuel ; transmettre des données de l'image d'affichage capturée à un navigateur local ; transmettre, sur la base du navigateur local, les données de l'image d'affichage à un serveur, les données de l'image d'affichage étant utilisées pour déclencher le serveur afin d'envoyer, au moyen d'un canal multimédia, lesdites données vers un dispositif d'extrémité de réception ayant souscrit auxdites données, et pour déclencher le dispositif d'extrémité de réception ayant reçu les données de l'image d'affichage afin de restituer et d'afficher, au moyen du navigateur, les données de l'image d'affichage, le canal multimédia étant une liaison de communication sur la base du protocole UDP de WebRTC. Les modes de réalisation de la présente invention concernent en outre un dispositif de transmission d'image d'écran, un support de stockage et un système, capables d'améliorer efficacement l'instantanéité et la fluidité d'une transmission d'image d'écran, et d'améliorer la limite supérieure de participants pouvant être pris en charge dans la transmission d'image d'écran.
PCT/CN2018/113685 2018-05-03 2018-11-02 Procédé de transmission d'image d'écran, dispositif, serveur et support de stockage Ceased WO2019210667A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810418450.0 2018-05-03
CN201810418450.0A CN108848121A (zh) 2018-05-03 2018-05-03 屏幕画面传输方法、装置、服务器、系统及存储介质

Publications (1)

Publication Number Publication Date
WO2019210667A1 true WO2019210667A1 (fr) 2019-11-07

Family

ID=64212658

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/113685 Ceased WO2019210667A1 (fr) 2018-05-03 2018-11-02 Procédé de transmission d'image d'écran, dispositif, serveur et support de stockage

Country Status (2)

Country Link
CN (1) CN108848121A (fr)
WO (1) WO2019210667A1 (fr)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110113298B (zh) * 2019-03-19 2021-09-28 视联动力信息技术股份有限公司 数据传输方法、装置、信令服务器和计算机可读介质
CN113132376B (zh) * 2021-04-14 2022-11-22 腾讯科技（深圳）有限公司 媒体数据处理方法及装置、系统、电子设备和存储介质

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102510405A (zh) * 2011-11-18 2012-06-20 深圳中兴网信科技有限公司 一种屏幕共享方法及其系统
CN106161571A (zh) * 2015-04-27 2016-11-23 Tcl集团股份有限公司 一种基于WebRTC的远程操作方法及系统
CN107040574A (zh) * 2016-11-17 2017-08-11 阿里巴巴集团控股有限公司 一种截图、数据处理方法及设备
CN107783807A (zh) * 2016-08-29 2018-03-09 中兴通讯股份有限公司 一种屏幕截图的方法及装置

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101809605B (zh) * 2007-08-14 2014-04-09 三星电子株式会社 用于出席信息的基于会话发起协议的动态广告的方法和系统
ES2555653T3 (es) * 2013-02-22 2016-01-07 Telefónica Digital España, S.L.U. Método y sistema para conferencia de telecomunicación basada en una red entre pares (P2P) y en servidor de retransmisión central combinado que usa un protocolo de telefonía y conferencia
CN105376194B (zh) * 2014-08-15 2019-03-26 中国电信股份有限公司 实时通信方法、系统和平台设备
US10264035B2 (en) * 2016-02-23 2019-04-16 At&T Intellectual Property I, L.P. Method and apparatus for architecting multimedia conferencing services using SDN

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102510405A (zh) * 2011-11-18 2012-06-20 深圳中兴网信科技有限公司 一种屏幕共享方法及其系统
CN106161571A (zh) * 2015-04-27 2016-11-23 Tcl集团股份有限公司 一种基于WebRTC的远程操作方法及系统
CN107783807A (zh) * 2016-08-29 2018-03-09 中兴通讯股份有限公司 一种屏幕截图的方法及装置
CN107040574A (zh) * 2016-11-17 2017-08-11 阿里巴巴集团控股有限公司 一种截图、数据处理方法及设备

Also Published As

Publication number Publication date
CN108848121A (zh) 2018-11-20

Similar Documents

Publication Publication Date Title
US11140106B2 (en) Method, device and storage medium for interactive message in video page
US9641559B2 (en) Methods and systems for dynamic adjustment of session parameters for effective video collaboration among heterogeneous devices
US9118729B2 (en) Method for sharing resource of a videoconference using a video conferencing system
US11316909B2 (en) Data transmission method and apparatus, and computer storage medium
US10630739B2 (en) Parallel peer to peer connection establishment in WebRTC conferencing
US10897599B1 (en) Facilitation of video conference based on bytes sent and received
CN108600777B (zh) 一种流媒体回放服务器、客户端
US11838572B2 (en) Streaming video trunking
CN109981711A (zh) 文档动态播放方法、装置、系统及计算机可读存储介质
CN110198478B (zh) 交互录播方法、系统、客户端、装置、设备及存储介质
CN102970513A (zh) 监视系统及其相关控制方法
US11240469B1 (en) Systems and methods for audience interactions in real-time multimedia applications
CN106162043A (zh) 一种视频会议系统中多媒体文件演示方法
CN110620953A (zh) 一种多屏互动方法、装置及系统
CN112788276A (zh) 视频流显示方法、发送方法、装置、终端、服务器及介质
WO2020248649A1 (fr) Procédé, appareil et système de lecture synchrone de données audio et vidéo, dispositif électronique et support
WO2014180234A1 (fr) Procede et dispositif de reproduction et de pousser de bureau virtuel, et systeme de bureau virtuel
WO2020015750A1 (fr) Procédé et appareil de partage de données, dispositif électronique et support de stockage
WO2022134928A1 (fr) Procédé de partage de bureau en nuage vers un système de téléconférence, terminal de bureau en nuage et bureau en nuage
WO2019196577A1 (fr) Procédé de lecture multimédia en continu, serveur, client et dispositif informatique
CN114928641A (zh) 基于云应用的数据分享方法、装置、电子设备及存储介质
WO2019210667A1 (fr) Procédé de transmission d'image d'écran, dispositif, serveur et support de stockage
WO2016197955A1 (fr) Procédé et dispositif de multidiffusion de flux multimédia
WO2023082585A1 (fr) Procédé et appareil de partage d'informations basés sur le droit de sélection bidirectionnelle, dispositif et support
CN110830752B (zh) 一种视频会议主机

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18917470

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18917470

Country of ref document: EP

Kind code of ref document: A1