CN102694816B - The implementation method of remote subscriber interface, Apparatus and system - Google Patents
The implementation method of remote subscriber interface, Apparatus and system Download PDFInfo
- Publication number
- CN102694816B CN102694816B CN201210188550.1A CN201210188550A CN102694816B CN 102694816 B CN102694816 B CN 102694816B CN 201210188550 A CN201210188550 A CN 201210188550A CN 102694816 B CN102694816 B CN 102694816B
- Authority
- CN
- China
- Prior art keywords
- user interface
- client
- server
- data
- graphic
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Telephonic Communication Services (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
本发明公开了一种远程用户界面的实现方法、装置及系统，涉及通信技术领域，降低控制远程用户界面的复杂，能够在不影响用户体验的情况下准确进行远程控制。本发明包括：采集服务端的用户界面数据；将所述用户界面数据发送给客户端；接收所述客户端发送的操作信息；根据所述操作信息对服务端上当前运行的业务进行对应的操作，并监测所述服务端的用户界面是否发生变化；若监测到所述服务端的用户界面发生变化，则采集变化后的用户界面数据，并将所述变化后的用户界面数据发送给所述客户端。本发明实施例主要应用于远程控制过程中。
The invention discloses a method, device and system for realizing a remote user interface, relates to the field of communication technology, reduces the complexity of controlling the remote user interface, and can accurately perform remote control without affecting user experience. The present invention includes: collecting user interface data of the server; sending the user interface data to the client; receiving operation information sent by the client; performing corresponding operations on the services currently running on the server according to the operation information, And monitor whether the user interface of the server changes; if it is detected that the user interface of the server changes, collect the changed user interface data, and send the changed user interface data to the client. The embodiments of the present invention are mainly applied in the remote control process.
Description
Technical Field
The present invention relates to the field of communications technologies, and in particular, to a method, an apparatus, and a system for implementing a remote user interface.
Background
Increasingly, intelligent terminal devices owned by home users, such as televisions, intelligent set top boxes, PCs (personal computers), PADs of tablet computers, Mobile phones and the like, build an intelligent home network to promote free sharing of contents among the intelligent terminals. At present, a home internal network is built and shows a trend, namely, an intelligent set top box and a television are taken as centers, and the set top box is responsible for butting all terminals and displaying the contents of the terminals through a large screen of the television after gathering the contents. By using the mode taking the set-top box and the television as the center, the user can browse and manage the contents on all the terminal devices through a uniform interface, and the user experience is greatly improved.
However, the convergence of the content increases the complexity of the user interface, and in order to cope with the situation, only the physical keys, the virtual keys or new external devices are added continuously at the existing control end, such as an infrared remote controller or a software remote controller, so that the complexity of controlling the remote user interface is increased.
Disclosure of Invention
Embodiments of the present invention provide a method, an apparatus, and a system for implementing a remote user interface, which can reduce the complexity of controlling the remote user interface.
In order to achieve the above purpose, the embodiment of the invention adopts the following technical scheme:
a method for implementing a remote user interface, comprising:
collecting user interface data of a server;
sending the user interface data to a client so that the client displays a user interface of the server on a touch screen of the client according to the user interface data;
receiving operation information sent by the client, wherein the operation information is generated by a user through a user interface displayed on the touch screen;
performing corresponding operation on the currently running service on the server according to the operation information, and monitoring whether a user interface of the server changes;
if the change of the user interface of the server is monitored, the changed user interface data is collected and sent to the client, so that the client displays the changed user interface of the server on a touch screen of the client according to the changed user interface data.
A method for implementing a remote user interface, comprising:
receiving user interface data sent by a server, and displaying a user interface of the server on a touch screen of a client according to the user interface data, wherein the user interface data is data corresponding to the user interface of the server;
collecting operation information generated on a user interface displayed by a touch screen by a user, and sending the operation information to the server, so that the server performs corresponding operation on a service currently running by the server according to the operation information, and when monitoring that the user interface of the server changes, collecting changed user interface data, and sending the collected changed user interface data to the client as new user interface data;
and receiving new user interface data sent by the server, and displaying the changed user interface of the server on a touch screen of the client according to the new user interface data.
An apparatus for implementing a remote user interface, comprising:
the system comprises a collecting unit, a first sending unit and a second sending unit, wherein the collecting unit is used for collecting user interface data of a server and transmitting the user interface data of the server to the first sending unit;
the first sending unit is used for sending the user interface data collected by the collecting unit to a client so that the client can display the user interface of the server on a touch screen of the client according to the user interface data;
the receiving unit is used for receiving the operation information sent by the client and transmitting the operation information to the processing unit, wherein the operation information is generated by a user through a user interface displayed on the touch screen;
the processing unit is used for carrying out corresponding operation on the currently running service on the server according to the operation information received by the receiving unit;
the monitoring unit is used for monitoring whether the user interface of the server side changes;
the acquisition unit is further used for acquiring changed user interface data and transmitting the changed user interface data to the first sending unit when the monitoring unit monitors that the user interface of the server side changes;
the first sending unit is further configured to send the changed user interface data acquired by the acquisition unit to the client, so that the client displays the changed user interface of the server on the touch screen of the client according to the changed user interface data.
An apparatus for implementing a remote user interface, comprising:
the first receiving unit is used for receiving user interface data sent by the server and transmitting the user interface data to the display unit;
the display unit is used for displaying the user interface of the server on the touch screen of the client according to the user interface data received by the first receiving unit, wherein the user interface data is data corresponding to the user interface of the server;
the acquisition unit is used for acquiring operation information generated on a user interface displayed by a touch screen by a user and transmitting the operation information to the first sending unit;
the first sending unit is used for sending the operation information received by the acquisition unit to the server so that the server performs corresponding operation on the currently running service of the server according to the operation information, acquiring changed user interface data when monitoring that the user interface of the server changes, and sending the acquired changed user interface data to the client as new user interface data;
the first receiving unit is further configured to receive new user interface data sent by a server and transmit the new user interface data to the display unit;
the display unit is further configured to display the changed user interface of the server on the touch screen of the client according to the new user interface data received by the first receiving unit.
A system for implementing a remote user interface, comprising: a server and a client; wherein,
the server is used for acquiring user interface data of the server; sending the user interface data to the client; receiving operation information sent by the client, performing corresponding operation on the current running service according to the operation information, and monitoring whether the user interface of the client changes; if the user interface of the client side is monitored to change, acquiring changed user interface data and sending the changed user interface data to the client side;
the client is used for receiving the user interface data sent by the server and displaying the user interface of the server on a touch screen of the client according to the user interface data; collecting operation information generated on a user interface displayed by the touch screen by a user, and sending the operation information to the server; and receiving the changed user interface data sent by the server, and displaying the changed user interface of the server on a touch screen of the server according to the changed user interface data.
According to the method, the device and the system for realizing the remote user interface, the user interface data of the server side are sent to the client side, the client side displays the corresponding user interface on the touch screen according to the user interface data, so that a user can use the touch screen on the client side to send operation information while watching the user interface on the client side, the server side processes the user interface after receiving the operation information and sends the processed user interface data to the client side for continuous display.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a flowchart of a method for implementing a remote user interface according to embodiment 1 of the present invention;
fig. 2 is a flowchart of another method for implementing a remote user interface according to embodiment 1 of the present invention;
fig. 3 is an information interaction flowchart of an implementation method of a remote user interface in embodiment 2 of the present invention;
fig. 4 is an information interaction flowchart of another method for implementing a remote user interface according to embodiment 2 of the present invention;
fig. 5 is an information interaction flowchart of another method for implementing a remote user interface according to embodiment 2 of the present invention;
fig. 6 is a block diagram of an apparatus for implementing a remote user interface according to embodiment 3 of the present invention;
fig. 7 is a block diagram of an apparatus for implementing another remote user interface according to embodiment 3 of the present invention;
FIG. 8 is a block diagram of an apparatus for implementing another remote user interface according to embodiment 3 of the present invention;
fig. 9 is a block diagram of an apparatus for implementing another remote user interface according to embodiment 3 of the present invention;
fig. 10 is a block diagram of an apparatus for implementing another remote user interface according to embodiment 3 of the present invention;
fig. 11 is a block diagram of an apparatus for implementing another remote user interface according to embodiment 3 of the present invention;
fig. 12 is a block diagram of an apparatus for implementing another remote user interface according to embodiment 3 of the present invention;
fig. 13 is a block diagram of an apparatus for implementing another remote user interface according to embodiment 3 of the present invention;
fig. 14 is a block diagram of an apparatus for implementing another remote user interface according to embodiment 3 of the present invention;
fig. 15 is a block diagram of another system for implementing a remote user interface according to embodiment 3 of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Example 1
An embodiment of the present invention provides a method for implementing a remote desktop, as shown in fig. 1, the method is a method on a server side, and includes:
101. collecting user interface data of a server
The user interface is an interface which is displayed at the server and can be operated by a user; the user interface data is data corresponding to the user interface, namely data required for displaying the user interface, and is stored in a graphic buffer area of the server, and the server can directly collect the user interface data from the graphic buffer area.
102. And sending the user interface data to a client so that the client displays the user interface of the server on a touch screen of the client according to the user interface data.
The sending of the user interface data to the client is specifically realized as follows:
and adjusting the user interface data according to the graphic parameters, and sending the adjusted user interface data to the client according to the data channel parameters.
The graphic parameters and the data channel parameters corresponding to the client need to be obtained before the user interface data is sent to the client in step 102.
The graphic parameters corresponding to the client include parameters such as resolution, video encoding and decoding format, and data transmission protocol of the client, and the data channel parameters corresponding to the client include parameters such as a data port number of the client.
Further, the specific steps of adjusting the user interface data according to the graphic parameters and sending the adjusted user interface data to the client according to the data channel parameters may be, but are not limited to:
firstly, the resolution ratio corresponding to the user interface data is adjusted to the resolution ratio of the client, then the user interface data corresponding to the coding format of the client is compressed and coded, then the user interface data after being compressed and coded is packaged by using the data transmission protocol of the client, and finally the packaged user interface data is sent to the client.
103. And receiving operation information sent by the client, wherein the operation information is generated on a user interface displayed by the touch screen through a user.
The operation information comprises actions recognizable by the touch screen, such as sliding, clicking and the like.
104. And performing corresponding operation on the currently running service on the server according to the operation information, and monitoring whether the user interface of the server changes.
Wherein, the currently running service on the server must be able to support touch screen control.
105. And if the user interface of the server side is monitored to be changed, acquiring changed user interface data.
The implementation method of step 105 is similar to the implementation method of step 101, and is not described again in this embodiment of the present invention.
It should be noted that, if the user interface of the server is not monitored to be changed, the current user interface is maintained unchanged.
106. And sending the changed user interface data to the client so that the client displays the changed user interface of the server on a touch screen of the client according to the changed user interface data.
The implementation method of step 106 is similar to the implementation method of step 102, and is not described again in this embodiment of the present invention.
An embodiment of the present invention further provides a method for implementing a remote desktop, as shown in fig. 2, the method is a client-side method, and includes:
201. and receiving user interface data sent by a server, wherein the user interface data is data corresponding to a user interface of the server.
202. And displaying the user interface of the server on the touch screen of the client according to the user interface data.
If the user interface data received by the client is the video stream after compression coding, the player on the client is used for rendering the received user interface data, and the corresponding user interface is displayed on the touch screen. Of course, if the user interface data received by the client is data in other forms, the user interface data may also be implemented by using a corresponding processing method, which is not limited in this embodiment of the present invention.
203. Operation information generated by a user on a user interface displayed by the touch screen is collected.
Wherein the related description of the operation information is the same as the related description in the step 103.
204. And sending the operation information to the server, so that the server performs corresponding operation on the currently running service of the server according to the operation information, collects the changed user interface data when monitoring that the user interface of the server changes, and sends the collected changed user interface data to the client as new user interface data.
It should be noted that, the client sends the operation information to the server through the dedicated signaling channel.
205. And receiving new user interface data sent by the server.
206. And displaying the changed user interface of the server on a touch screen of the client according to the new user interface data.
According to the implementation method of the remote user interface provided by the embodiment of the invention, the user interface data of the server is sent to the client, the client displays the corresponding user interface on the touch screen according to the user interface data, so that a user can use the touch screen on the client to send operation information while watching the user interface on the client, the server processes the user interface after receiving the operation information and sends the processed user interface data to the client for continuous display.
Example 2
The technical scheme provided by the embodiment of the invention can be applied to a home network architecture, wherein the home network architecture comprises at least one client, at least one server and a selectable large screen externally connected to the server. The client can be an intelligent mobile terminal and supports touch operation, for example, a tablet computer or a smart phone; the server may be an intelligent set-top box and runs an operating system supporting touch operations, such as Android or a handheld device operating system IOS developed by apple inc. The large screen can be a liquid crystal display device and the like.
Based on the above home network structure, an embodiment of the present invention provides an information interaction process of a method for implementing a remote desktop of a user, as shown in fig. 3, where the information interaction process includes:
301. the client searches the server and selects one server from the searched servers for connection.
302. And carrying out graph capability negotiation between the server and the client.
As shown in fig. 4, the implementation process of performing graph capability negotiation between the server and the client includes steps 3021 to 30211, which specifically includes:
3021. and the server side acquires the graph capability information of the client side.
The graphics capability information is used to indicate graphics processing capability of the client, and may include information such as a resolution range supportable by the client, a supported video codec format type, and a supported data transmission protocol type.
The server side may obtain the graph capability information of the client side by actively reporting the graph capability information when the client side is connected to the server side, or by sending an obtaining request to the client side for the server side, which is not limited in the embodiment of the present invention.
3022. And the server side selects the graphic parameters matched with the graphic processing capacity of the client side from the graphic parameter set of the server side according to the graphic processing capacity of the client side.
3023. And the server side sends the selected graphic parameters to the client side.
The implementation method for selecting the graphic parameters matched with the graphic processing capability of the client from the graphic parameters of the server may be as follows: selecting from the graph parameters of the server according to the optimal graph processing capacity of the client, for example, the highest resolution of the client is 1024 × 768, and if the highest resolution that the server can provide is 1280 × 1024, the server selects 1024 × 960 for the client; if the highest resolution that the server can provide is 800 × 600, the resolution that the server selects for the client is 800 × 600. Other graphical parameters are selected similarly.
3024. And the client receives the graphic parameters sent by the server.
3025. And the client judges whether the server is allowed to perform graphic processing according to the graphic parameters or not according to a preset strategy. If the server side is allowed to perform the graphic processing according to the graphic parameters, executing step 3026; otherwise, step 3027 is performed.
The preset strategy can be set to return a successful message of the graphic capability negotiation when the graphic parameters sent by the server meet the optimal configuration of the client; otherwise, returning a graphic capability negotiation failure message. Of course, the embodiment of the present invention is not limited to this, and may be set according to actual needs.
3026. The client sends a message of success in negotiation of graphics capabilities to the server and executes step 3028.
3027. And the client sends a graphic capability negotiation failure message to the server. And step 30310 is performed.
3028. And the server receives the graphics capability negotiation success message sent by the client.
3029. And the server side determines the selected graphic parameters as the graphic parameters corresponding to the client side according to the graphic capability negotiation success message.
30210. And the server receives the graphic capability negotiation failure message sent by the client.
30211. And the server side sends a message of refusing access to the client side.
303. And after the graph capability negotiation is successful, carrying out data channel negotiation between the server and the client.
The implementation process of data channel negotiation between the server and the client is shown in fig. 5, and includes steps 3031 to 3035, and specifically includes:
3031. the client selects a data channel for transmitting the user interface data from the currently idle data channels.
3032. And the client sends the data channel parameters corresponding to the selected data channel to the server, wherein the data channel parameters comprise data channel port identification information corresponding to the data channel for transmitting the user interface data.
The data channel port identification information may be a port number of the data channel port.
3033. And the server receives the data channel parameters sent by the client, wherein the data channel parameters comprise the data channel port identification information of the client.
3034. And the server judges whether the data channel port identification information of the client is legal data channel port identification information or not. If the data channel port identification information of the client is determined to be legal data channel port identification information, executing step 3035; otherwise, a data channel reselection request is sent to the client, and step 3031 is executed again.
The implementation method for the server to determine whether the data channel port identification information of the client is legal data channel port identification information includes, for example, using the identification information as a port number:
judging whether the number of the data channel port is within a set threshold range, and if the number of the data channel port of the client is determined to be within the set threshold range, executing a step 3035; otherwise, a data channel reselection request is sent to the client, and step 3031 is executed again.
The set threshold range is 0 to 65535, and is used to identify a value range of a port number corresponding to a data channel port that can be used to transmit user interface data.
It should be noted that the determination method described herein by taking the data channel port identification number as an example is only one implementation method of the step 3034, and the corresponding determination method is also different according to different data channel port identification information, which is not limited in this embodiment of the present invention.
3035. And the server determines the received data channel parameters as the data channel parameters of the client.
304. The server collects user interface data.
305. And the server side adjusts the user interface data according to the graphic parameters.
306. And the server sends the adjusted user interface data to the client according to the data channel parameters.
307. And the client receives the user interface data sent by the server.
308. And the client displays the user interface of the server on the touch screen of the client according to the user interface data.
309. The client collects operation information generated by a user on a user interface displayed by the touch screen.
310. And the client sends the operation information to the server.
311. And the server receives the operation information sent by the client.
312. And the server performs corresponding operation on the currently running service on the server according to the operation information and monitors whether the user interface of the server changes. If the user interface of the server side is changed, step 313 is executed. Otherwise, continuing monitoring.
313. And the server side collects the changed user interface data.
314. And the server side adjusts the changed user interface data according to the graphic parameters.
315. And the server sends the adjusted changed user interface data to the client according to the data channel parameters.
316. And the client receives the changed user interface data sent by the server.
317. And the client displays the changed user interface of the server on a touch screen of the client according to the changed user interface data.
Note that, if the server has a function of storing client information, the server may perform the following steps without performing steps 301 to 303, including:
and acquiring identification information of the client, and inquiring a stored data table according to the identification information to obtain a graphic parameter and a data channel parameter corresponding to the client.
The stored data table comprises corresponding relations among client identification information, graphic parameters and data channel parameters.
It should be noted that the correspondence between the information client identifier information, the graphic parameter, and the data channel parameter may be stored in a form of not only a data table, but also a database, a data file, and the like, which is not limited in this embodiment of the present invention.
In addition, it should be noted that, in the above embodiment, the functions of the client and the server may be implemented by setting dedicated hardware modules on the client device and the server device, or by installing software having these functions on the operating systems of the client device and the server device, respectively.
According to the implementation method of the remote user interface provided by the embodiment of the invention, the user interface data of the server is sent to the client, the client displays the corresponding user interface on the touch screen according to the user interface data, so that a user can use the touch screen on the client to send operation information while watching the user interface on the client, the server processes the user interface after receiving the operation information and sends the processed user interface data to the client for continuous display.
And through the graph capability negotiation and the data channel negotiation, the client can display the user interface with the optimal graph parameters, and the user experience is further ensured.
Example 3
An embodiment of the present invention provides an apparatus for implementing a remote user interface, as shown in fig. 6, the apparatus includes: an acquisition unit 41, a first sending unit 42, a receiving unit 43, a processing unit 44, and a monitoring unit 45.
The collecting unit 41 is configured to collect user interface data of the server and transmit the user interface data of the server to the first sending unit 42.
A first sending unit 42, configured to send the user interface data acquired by the acquiring unit 41 to a client, so that the client displays the user interface of the server on a touch screen of the client according to the user interface data.
The receiving unit 43 is configured to receive operation information sent by the client, and transmit the operation information to the processing unit 44, where the operation information is operation information generated by a user through a user interface displayed on the touch screen.
The processing unit 44 is configured to perform corresponding operations on the currently running service on the server according to the operation information received by the receiving unit 43.
And the monitoring unit 45 is used for monitoring whether the user interface of the server side changes.
The acquiring unit 41 is further configured to acquire changed user interface data when the monitoring unit 45 monitors that the user interface of the server is changed, and transmit the changed user interface data to the first sending unit 42.
The first sending unit 42 is further configured to send the changed user interface data acquired by the acquiring unit 41 to the client, so that the client displays the changed user interface of the server on the touch screen of the client according to the changed user interface data.
Optionally, as shown in fig. 7, the apparatus further includes: an acquisition unit 46.
An obtaining unit 46, configured to obtain a graph parameter and a data channel parameter corresponding to the client, and transmit the graph parameter and the data channel parameter corresponding to the client to the first sending unit 42, where the graph parameter corresponding to the client is used to represent a graph processing capability of the client, and the data channel parameter corresponding to the client is used to identify a transmission channel between the client and the server, where the transmission channel is used to transmit user interface data.
The first sending unit 42 is specifically configured to adjust the user interface data according to the graphic parameters acquired by the acquiring unit 46, and send the adjusted user interface data to the client according to the data channel parameters acquired by the acquiring unit 46.
The first sending unit 42 is further specifically configured to adjust the changed user interface data according to the graphic parameters acquired by the acquiring unit 46, and send the adjusted changed user interface data to the client according to the data channel parameters acquired by the acquiring unit 46.
Optionally, as shown in fig. 8, the obtaining unit 46 includes: an obtaining module 461, a selecting module 462, a sending module 463, a first receiving module 464, and a first determining module 465.
The obtaining module 461 is configured to obtain the graphics capability information of the client, and transmit the graphics capability information of the client to the selecting module 462, where the graphics capability information is used to represent the graphics processing capability of the client.
A selecting module 462, configured to select, according to the graphics capability information of the client obtained by the obtaining module 461, a graphics parameter matching the graphics processing capability of the client from the graphics parameter set of the server, and transmit the graphics parameter matching the graphics processing capability of the client to the sending module 463.
A sending module 463, configured to send the graphics parameters selected by the selecting module 462 to the client.
A first receiving module 464, configured to receive a graphics capability negotiation success message sent by the client after receiving the selected graphics parameters, and transmit the graphics capability negotiation success message to the first determining module 464.
A first determining module 465, configured to determine, according to the graphics capability negotiation success message received by the first receiving module 464, that the selected graphics parameter is a graphics parameter corresponding to the client, where the graphics capability negotiation success message is a message sent when the client agrees to perform graphics processing using the selected graphics parameter after receiving the selected graphics parameter.
Optionally, as shown in fig. 9, the obtaining unit further includes: the second receiving module 466 and the second determining module 467.
The second receiving module 466 is configured to receive the data channel parameter sent by the client, and transmit the data channel parameter to the second determining module 467, where the data channel parameter includes the data channel port identification information of the client.
The second determining module 467 is configured to determine, if the determining module 466 determines that the data channel port identification information of the client is legal data channel port identification information, that the received data channel parameter is the data channel parameter corresponding to the client.
Optionally, as shown in fig. 10, the apparatus further includes: the query unit 47.
And the query unit 47 is configured to obtain the identification information of the client, and query a stored data table according to the identification information to obtain a graph parameter and a data channel parameter corresponding to the client, where the stored data table includes the graph parameter, the data channel parameter, and a correspondence relationship between the graph parameter, the data channel parameter, and the client identification information.
An embodiment of the present invention provides an apparatus for implementing a remote user interface, as shown in fig. 11, the apparatus includes: a first receiving unit 51, a display unit 52, a second receiving unit 53, and a first transmitting unit 54.
The first receiving unit 51 is configured to receive user interface data sent by a server, and transmit the user interface data to the display unit 52.
A display unit 52, configured to display the user interface of the server on the touch screen of the client according to the user interface data received by the first receiving unit 51, where the user interface data is data corresponding to the user interface of the server.
The acquisition unit 53 is configured to acquire operation information generated on the touch screen by a user, and transmit the operation information to the first sending unit 54.
The first sending unit 54 is configured to send the operation information received by the acquiring unit 53 to the server, so that the server performs corresponding operation on a currently running service of the server according to the operation information, and when it is monitored that a user interface of the server changes, acquires changed user interface data, and sends the acquired changed user interface data to the client as new user interface data.
The first receiving unit 51 is further configured to receive new user interface data sent by the server, and transmit the new user interface data to the display unit 52.
The display unit 52 is further configured to display the changed user interface of the server on the touch screen of the client according to the new user interface data received by the first receiving unit 51.
Optionally, as shown in fig. 12, the apparatus further includes: the connection unit 55 is searched.
And a search connection unit 55, configured to search for a server, and select one server from the searched servers to connect.
Optionally, as shown in fig. 13, the apparatus further includes: a second receiving unit 56, a first judging unit 57, and a second transmitting unit 58.
The second receiving unit 56 is configured to receive a graph parameter sent by the server, where the graph parameter is a graph parameter that is selected by the server from the graph parameter set of the server according to the graph capability of the client and matches the graph processing capability of the client, and transmit the graph parameter to the first determining unit 57.
The first judging unit 57 is configured to judge whether the server side is permitted to perform graphics processing according to the graphics parameters received by the third receiving unit 56 according to a predetermined policy, and transmit a judgment result to the second sending unit 58.
A second sending unit 58, configured to send a successful negotiation of the graphics capability message to the server when the first determining unit 57 agrees that the server performs the graphics processing according to the graphics parameters, so that the server adjusts the user interface data according to the graphics parameters and sends the adjusted user interface data to the client, where the successful negotiation of the graphics capability message is used to indicate that the client agrees that the server performs the graphics processing according to the graphics parameters.
Optionally, as shown in fig. 14, the apparatus further includes: a selecting unit 59 and a third sending unit 510.
A selecting unit 59, configured to select one data channel for transmitting the user interface data from the currently idle data channels.
A third sending unit 510, configured to send the data channel parameter corresponding to the data channel for transmitting the user interface data, which is selected by the selecting unit 59, to the server, so that the server sends the user interface data through the selected data channel; the data channel parameters include the port identification information of the data channel corresponding to the data channel selected by the selecting unit 59 and used for transmitting the user interface data.
An embodiment of the present invention provides a system for implementing a remote user interface, as shown in fig. 15, where the system includes: a server 61 and a client 62; wherein,
the server 61 is used for collecting user interface data of the server; sending the user interface data to the client 62; receiving the operation information sent by the client 62, performing corresponding operation on the currently running service according to the operation information, and monitoring whether the user interface of the client changes; if the user interface of the client side is monitored to be changed, changed user interface data is collected and sent to the client side 62.
The client 62 is configured to receive user interface data sent by the server 61, and display a user interface of the server 61 on a touch screen of the client according to the user interface data; collecting operation information generated on a user interface displayed by the touch screen by a user, and sending the operation information to the server 61; and receiving the changed user interface data sent by the server 61, and displaying the changed user interface of the server 61 on the touch screen of the server according to the changed user interface data.
According to the implementation system of the remote user interface provided by the embodiment of the invention, the user interface data of the server is sent to the client, the client displays the corresponding user interface on the touch screen according to the user interface data, so that a user can use the touch screen on the client to send operation information while watching the user interface on the client, the server processes the user interface after receiving the operation information and sends the processed user interface data to the client for continuous display.
And through the graph capability negotiation and the data channel negotiation, the client can display the user interface with the optimal graph parameters, and the user experience is further ensured.
Through the above description of the embodiments, those skilled in the art will clearly understand that the present invention may be implemented by software plus necessary general hardware, and certainly may also be implemented by hardware, but in many cases, the former is a better embodiment. Based on such understanding, the technical solutions of the present invention may be substantially implemented or a part of the technical solutions contributing to the prior art may be embodied in the form of a software product, which is stored in a readable storage medium, such as a floppy disk, a hard disk, or an optical disk of a computer, and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device) to execute the methods according to the embodiments of the present invention.
The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and all the changes or substitutions should be covered within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the appended claims.
Claims (12)
1. A method for implementing a remote user interface, comprising:
collecting user interface data of a server;
sending the user interface data to a client so that the client displays a user interface of the server on a touch screen of the client according to the user interface data;
receiving operation information sent by the client, wherein the operation information is generated on a user interface displayed by a user through the touch screen;
performing corresponding operation on the currently running service on the server according to the operation information, and monitoring whether a user interface of the server changes;
if the change of the user interface of the server is monitored, acquiring changed user interface data, and sending the changed user interface data to the client, so that the client displays the changed user interface of the server on a touch screen of the client according to the changed user interface data;
wherein before sending the user interface data to the client, the method further comprises:
acquiring a graphic parameter and a data channel parameter corresponding to the client, wherein the graphic parameter corresponding to the client is used for representing the graphic processing capacity of the client, and the data channel parameter corresponding to the client is used for identifying a transmission channel used for transmitting user interface data between the client and the server;
the sending the user interface data to the client specifically includes:
adjusting the user interface data according to the graphic parameters, and sending the adjusted user interface data to the client according to the data channel parameters;
the sending the changed user interface to the client specifically includes:
and adjusting the changed user interface data according to the graphic parameters, and sending the adjusted changed user interface data to the client according to the data channel parameters.
2. The method according to claim 1, wherein the obtaining of the graphic parameter corresponding to the client specifically includes:
acquiring the graph capacity information of the client, wherein the graph capacity information is used for representing the graph processing capacity of the client;
according to the graph processing capacity of the client, selecting a graph parameter matched with the graph processing capacity of the client from a graph parameter set of the server, and sending the selected graph parameter to the client;
and receiving a graph capability negotiation success message sent by the client after receiving the selected graph parameters, and determining that the selected graph parameters are the graph parameters corresponding to the client according to the graph capability negotiation success message, wherein the graph capability negotiation success message is sent when the client agrees the server to use the selected graph parameters to perform graph processing.
3. The method according to claim 2, wherein the obtaining of the data channel parameter corresponding to the client specifically includes:
receiving a data channel parameter sent by a client, wherein the data channel parameter comprises data channel port identification information of the client;
and if the data channel port identification information of the client is legal data channel port identification information, determining that the received data channel parameters are the data channel parameters corresponding to the client.
4. The method according to claim 1, wherein the obtaining of the graphics parameters and the data channel parameters corresponding to the client specifically comprises:
and acquiring identification information of the client, and inquiring a stored data table according to the identification information to obtain a graphic parameter and a data channel parameter corresponding to the client, wherein the stored data table comprises the corresponding relation among the client identification information, the graphic parameter and the data channel parameter.
5. A method for implementing a remote user interface, comprising:
receiving user interface data sent by a server, and displaying a user interface of the server on a touch screen of a client according to the user interface data, wherein the user interface data is data corresponding to the user interface of the server;
collecting operation information generated on a user interface displayed by a touch screen by a user, and sending the operation information to the server, so that the server performs corresponding operation on a service currently running by the server according to the operation information, and when monitoring that the user interface of the server changes, collecting changed user interface data, and sending the collected changed user interface data to the client as new user interface data;
receiving new user interface data sent by the server, and displaying the changed user interface of the server on a touch screen of the client according to the new user interface data;
before receiving user interface data sent by a server, the method further comprises the following steps: searching the server, and selecting one server from the searched servers for connection;
before receiving user interface data sent by a server, the method further comprises the following steps:
receiving graphic parameters sent by the server, wherein the graphic parameters are selected from a graphic parameter set of the server according to the graphic capability of the client and are matched with the graphic processing capability of the client;
judging whether the server side is allowed to perform graphic processing according to the graphic parameters or not according to a preset strategy;
if the server side is allowed to perform the graphic processing according to the graphic parameters, sending a graphic capability negotiation success message to the server side so that the server side adjusts the user interface data according to the graphic parameters and then sends the user interface data to the client side, wherein the graphic capability negotiation success message is used for indicating that the client side is allowed to perform the graphic processing according to the graphic parameters.
6. The method of claim 5, before receiving the user interface data sent by the server, further comprising:
selecting a data channel for transmitting user interface data from the current idle data channels;
sending the data channel parameters corresponding to the selected data channel to the server side so that the server side sends user interface data through the selected data channel; the data channel parameters comprise data channel port identification information corresponding to the data channel for transmitting the user interface data.
7. An apparatus for implementing a remote user interface, comprising:
the system comprises a collecting unit, a first sending unit and a second sending unit, wherein the collecting unit is used for collecting user interface data of a server and transmitting the user interface data of the server to the first sending unit;
the first sending unit is used for sending the user interface data collected by the collecting unit to a client so that the client can display the user interface of the server on a touch screen of the client according to the user interface data;
the receiving unit is used for receiving the operation information sent by the client and transmitting the operation information to the processing unit, wherein the operation information is generated by a user through a user interface displayed on the touch screen;
the processing unit is used for carrying out corresponding operation on the currently running service on the server according to the operation information received by the receiving unit;
the monitoring unit is used for monitoring whether the user interface of the server side changes;
the acquisition unit is further used for acquiring changed user interface data and transmitting the changed user interface data to the first sending unit when the monitoring unit monitors that the user interface of the server side changes;
the first sending unit is further configured to send the changed user interface data acquired by the acquisition unit to the client, so that the client displays the changed user interface of the server on the touch screen of the client according to the changed user interface data;
wherein, still include:
the system comprises an acquisition unit, a first sending unit and a second sending unit, wherein the acquisition unit is used for acquiring the graphic parameters and the data channel parameters corresponding to the client and transmitting the graphic parameters and the data channel parameters corresponding to the client to the first sending unit, the graphic parameters corresponding to the client are used for representing the graphic processing capacity of the client, and the data channel parameters corresponding to the client are used for identifying a transmission channel used for transmitting user interface data between the client and the server;
the first sending unit is specifically configured to adjust the user interface data according to the graphic parameters acquired by the acquiring unit, and send the adjusted user interface data to the client according to the data channel parameters acquired by the acquiring unit;
the first sending unit is further specifically configured to adjust the changed user interface data according to the graphic parameters acquired by the acquiring unit, and send the adjusted changed user interface data to the client according to the data channel parameters acquired by the acquiring unit.
8. The apparatus according to claim 7, wherein the obtaining unit specifically includes:
the acquisition module is used for acquiring the graph capability information of the client and transmitting the graph capability information of the client to the selection module, wherein the graph capability information is used for representing the graph processing capability of the client;
the selection module is used for selecting the graphic parameters matched with the graphic processing capability of the client from the graphic parameter set of the server according to the graphic capability information of the client acquired by the acquisition module and transmitting the graphic parameters matched with the graphic processing capability of the client to the sending module;
the sending module is used for sending the graphic parameters selected by the selecting module to the client;
the first receiving module is used for receiving a graph capability negotiation success message sent by the client after receiving the selected graph parameters and transmitting the graph capability negotiation success message to the first determining module;
a first determining module, configured to determine, according to the successful negotiation message of the graphics capability received by the first receiving module, that the selected graphics parameter is a graphics parameter corresponding to the client, where the successful negotiation message of the graphics capability is sent when the client agrees that the server performs graphics processing using the selected graphics parameter.
9. The apparatus of claim 8, wherein the obtaining unit further comprises:
the second receiving module is used for receiving the data channel parameters sent by the client and transmitting the data channel parameters to the second determining module, wherein the data channel parameters comprise data channel port identification information of the client;
and a second determining module, configured to determine that the received data channel parameter is the data channel parameter corresponding to the client if it is determined that the data channel port identification information of the client received by the second receiving module is legal data channel port identification information.
10. An apparatus for implementing a remote user interface, comprising:
the first receiving unit is used for receiving user interface data sent by the server and transmitting the user interface data to the display unit;
the display unit is used for displaying the user interface of the server on a touch screen of a client according to the user interface data received by the first receiving unit, wherein the user interface data is data corresponding to the user interface of the server;
the acquisition unit is used for acquiring operation information generated on a user interface displayed by a touch screen by a user and transmitting the operation information to the first sending unit;
the first sending unit is used for sending the operation information received by the acquisition unit to the server so that the server performs corresponding operation on the currently running service of the server according to the operation information, acquiring changed user interface data when monitoring that the user interface of the server changes, and sending the acquired changed user interface data to the client as new user interface data;
the first receiving unit is further configured to receive new user interface data sent by a server and transmit the new user interface data to the display unit;
the display unit is further used for displaying the changed user interface of the server on the touch screen of the client according to the new user interface data received by the first receiving unit;
wherein, the device still includes: the searching connection unit is used for searching the service terminals and selecting one service terminal from the searched service terminals for connection;
wherein, the device still includes:
the second receiving unit is used for receiving the graphic parameters sent by the server, wherein the graphic parameters are graphic parameters which are selected from the graphic parameter set of the server and are matched with the graphic processing capability of the client according to the graphic capability of the client by the server, and the graphic parameters are transmitted to the first judging unit;
the first judging unit is used for judging whether the server side is allowed to perform graphic processing according to the graphic parameters received by the second receiving unit according to a preset strategy and transmitting a judgment result to the second sending unit;
and the second sending unit is used for sending a successful graphic capability negotiation message to the server when the first judging unit agrees that the server performs graphic processing according to the graphic parameters, so that the server adjusts the user interface data according to the graphic parameters and then sends the user interface data to the first receiving unit, wherein the successful graphic capability negotiation message is used for indicating that the client agrees that the server performs graphic processing according to the graphic parameters.
11. The apparatus of claim 10, further comprising:
the selection unit is used for selecting a data channel used for transmitting user interface data from the current idle data channels;
the third sending unit is used for sending the data channel parameters corresponding to the data channel selected by the selecting unit to the server so that the server sends the user interface data through the selected data channel; the data channel parameters comprise data channel port identification information corresponding to the data channel selected by the selection unit and used for transmitting the user interface data.
12. A system for implementing a remote user interface, comprising: a server and a client; wherein,
the server is used for acquiring user interface data of the server; sending the user interface data to the client; receiving operation information sent by the client, performing corresponding operation on the current running service according to the operation information, and monitoring whether the user interface of the client changes; if the user interface of the client side is monitored to change, acquiring changed user interface data and sending the changed user interface data to the client side;
the server is further configured to obtain a graphic parameter and a data channel parameter corresponding to the client before sending the user interface data to the client, where the graphic parameter corresponding to the client is used to represent a graphic processing capability of the client, and the data channel parameter corresponding to the client is used to identify a transmission channel between the client and the server for transmitting the user interface data;
when the server executes the sending of the user interface data to the client, the server is specifically used for adjusting the user interface data according to the graphic parameters and sending the adjusted user interface data to the client according to the data channel parameters;
the server is specifically configured to adjust the changed user interface data according to the graphical parameter and send the adjusted changed user interface data to the client according to the data channel parameter when executing the sending of the changed user interface data to the client;
the client is used for receiving the user interface data sent by the server and displaying the user interface of the server on a touch screen of the client according to the user interface data; collecting operation information generated on a user interface displayed by the touch screen by a user, and sending the operation information to the server; receiving changed user interface data sent by the server, and displaying the changed user interface of the server on a touch screen of the server according to the changed user interface data;
the client is further used for receiving graphic parameters sent by the server before receiving user interface data sent by the server, wherein the graphic parameters are graphic parameters which are selected by the server from a graphic parameter set of the server according to the graphic capability of the client and are matched with the graphic processing capability of the client; judging whether the server side is allowed to perform graphic processing according to the graphic parameters or not according to a preset strategy; if the server side is allowed to perform the graphic processing according to the graphic parameters, sending a graphic capability negotiation success message to the server side so that the server side adjusts the user interface data according to the graphic parameters and then sends the user interface data to the client side, wherein the graphic capability negotiation success message is used for indicating that the client side is allowed to perform the graphic processing according to the graphic parameters.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210188550.1A CN102694816B (en) | 2012-06-08 | 2012-06-08 | The implementation method of remote subscriber interface, Apparatus and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210188550.1A CN102694816B (en) | 2012-06-08 | 2012-06-08 | The implementation method of remote subscriber interface, Apparatus and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102694816A CN102694816A (en) | 2012-09-26 |
| CN102694816B true CN102694816B (en) | 2015-12-02 |
Family
ID=46860102
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210188550.1A Active CN102694816B (en) | 2012-06-08 | 2012-06-08 | The implementation method of remote subscriber interface, Apparatus and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102694816B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103236002B (en) * | 2013-04-16 | 2016-08-17 | 中国工商银行股份有限公司 | Businessman is to client's B2C messaging device system and method |
| CN108306933A (en) * | 2017-12-27 | 2018-07-20 | 杭州华为数字技术有限公司 | A kind of method, apparatus and system that the input based on desktop virtualization redirects |
| CN111385238B (en) * | 2018-12-27 | 2023-04-18 | 中兴通讯股份有限公司 | Data transmission method and device |
| CN112422868A (en) * | 2020-10-14 | 2021-02-26 | 西安万像电子科技有限公司 | Data processing method, terminal device and server |
| CN116634244A (en) * | 2023-05-30 | 2023-08-22 | 四川卓尔检测技术有限公司 | A method of realizing remote control set-top box through tools |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101155174A (en) * | 2006-09-28 | 2008-04-02 | 深圳Tcl工业研究院有限公司 | Remote subscriber interface service implementing method based on common protocol |
| CN102460410A (en) * | 2009-06-19 | 2012-05-16 | 三星电子株式会社 | Apparatus and method for transmitting and receiving user interface in communication system |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2625591A4 (en) * | 2010-10-05 | 2014-04-30 | Citrix Systems Inc | TOUCH MEDIUM FOR REMOTE APPLICATIONS |
-
2012
- 2012-06-08 CN CN201210188550.1A patent/CN102694816B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101155174A (en) * | 2006-09-28 | 2008-04-02 | 深圳Tcl工业研究院有限公司 | Remote subscriber interface service implementing method based on common protocol |
| CN102460410A (en) * | 2009-06-19 | 2012-05-16 | 三星电子株式会社 | Apparatus and method for transmitting and receiving user interface in communication system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102694816A (en) | 2012-09-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10637894B2 (en) | Real-time placeshifting of media content to paired devices | |
| CN102802048B (en) | A kind of Multi-screen interaction system and method | |
| US9621950B2 (en) | TV program identification method, apparatus, terminal, server and system | |
| TWI512489B (en) | Multi-screen interactive method, center equipment, terminal equipment and systems | |
| EP2858322A1 (en) | Method and terminal for sharing media stream | |
| CN103067403B (en) | A kind of business switch method, system and server | |
| CN102694816B (en) | The implementation method of remote subscriber interface, Apparatus and system | |
| US10944829B2 (en) | Methods, systems, and devices for multiplexing service information from sensor data | |
| CN101848374A (en) | Wireless video monitoring system and wireless video monitoring method thereof | |
| WO2022089088A1 (en) | Display device, mobile terminal, screen-casting data transmission method, and transmission system | |
| CN103067776A (en) | Program-pushing method and system, intelligent display device, cloud server | |
| WO2015062224A1 (en) | Tv program identification method, apparatus, terminal, server and system | |
| US11304247B2 (en) | Method and system for interaction between smart glasses and smart device, and storage medium | |
| CN111741352A (en) | Screen projection control method, screen projection playing method and related device | |
| CN113741762A (en) | A multimedia playback method, device, electronic device and storage medium | |
| CN103856374A (en) | Data transmission method, terminal and home interconnected system | |
| US10404606B2 (en) | Method and apparatus for acquiring video bitstream | |
| KR101880450B1 (en) | Apparatus and method for providing service using a portable terminal in television | |
| WO2015089790A1 (en) | Service processing method, apparatus, and system | |
| CN106792125A (en) | A kind of video broadcasting method and its terminal, system | |
| CN111767271B (en) | Data processing method and device | |
| CN110225395B (en) | Program content display method, set top box terminal and program management system | |
| CN103561239A (en) | On-spot work video monitoring method | |
| WO2014015736A1 (en) | Method and system for terminal service rendering | |
| US9485458B2 (en) | Data processing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20191217 Address after: No.1, floor 3, No.319, zhanggongshan Road, Yuhui District, Bengbu City, Anhui Province Patentee after: Bengbu guijiu Intellectual Property Service Co.,Ltd. Address before: 518129 Bantian HUAWEI headquarters office building, Longgang District, Guangdong, Shenzhen Patentee before: HUAWEI TECHNOLOGIES Co.,Ltd. |
|
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20201116 Address after: Building 2, No. 3, Fuqian Road, Hailing District, Taizhou City, Jiangsu Province Patentee after: Taizhou Haitong Asset Management Co.,Ltd. Address before: No.1, floor 3, No.319, zhanggongshan Road, Yuhui District, Bengbu City, Anhui Province Patentee before: Bengbu guijiu Intellectual Property Service Co.,Ltd. |
|
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20241021 Address after: Building 67, No. 59 Meilan East Road, Hailing District, Taizhou City, Jiangsu Province, 225300 Patentee after: Jiangsu Wanli Cutting Tools Co.,Ltd. Country or region after: China Address before: Building 2, No. 3, Fuqian Road, Hailing District, Taizhou City, Jiangsu Province Patentee before: Taizhou Haitong Asset Management Co.,Ltd. Country or region before: China |
|
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20250124 Address after: No. 618, Jiangzhou North Road, Hailing District, Taizhou City, Jiangsu Province, 225300 Patentee after: Taizhou Haitong Asset Management Co.,Ltd. Country or region after: China Address before: Building 67, No. 59 Meilan East Road, Hailing District, Taizhou City, Jiangsu Province, 225300 Patentee before: Jiangsu Wanli Cutting Tools Co.,Ltd. Country or region before: China |