TWI612465B - System and method for remote interaction - Google Patents

Abstract

A remote interaction method and system, wherein a plurality of user devices are logged into a server host, and the server detects and allocates a connection between the user devices; the server or one of the user devices establishes a shared surface layer, and the shared surface layer establishes a Sharing the object; transmitting the shared object to one or more designated user devices; the user device respectively executing an interactive program to create a virtual surface layer; and when one of the user devices performs an input on the interactive program, through the virtual surface layer The input is captured and objectized; the objectized input is input to one or more designated user devices; the virtual surface of the user device displays the received common object and the objectized input in an overlapping manner. program. To achieve a far-end interaction, reduce the bandwidth load.

Description

Remote interaction method and system

The invention relates to a remote interaction method and system, in particular to a remote interaction method and system capable of reducing bandwidth load.

With the development of the Internet and the development of multiple applications, the remote interactive discussion through the computer system and the network has gradually become a discussion and communication platform commonly used by industry, academia and even individuals. Remote instant interaction technologies such as electronic whiteboards, screen sharing, and video conferencing have become one of the most important applications of computer networks. Coupled with the popularity and popularity of tablet PCs and smart phones in recent years, coupled with the application of mobile networks, the remote interactive technology provides a good and diversified development space.

However, traditional remote interaction technologies, such as video conferencing, electronic whiteboards or online teaching systems, have problems with high bandwidth requirements and dull interaction. The traditional remote interaction technology must capture each user's data, such as images, annotations or input, together with the background, and then transfer it to other users participating in the discussion. The image data captured is generally large, which often requires a large network bandwidth, and also causes a reduction or instability of the interaction quality. The captured images are mostly in dot matrix format, which causes a lot of distortion when scaled.

Moreover, the traditional remote interaction technology adopts the image method, which makes the interactive content and process seem dull and tedious, and the application is very limited.

Different from the traditional remote interaction technology using image mode for transmission and interaction, the present invention proposes a remote interaction method and system, wherein the proposed solution can achieve the purpose of reducing the bandwidth load.

In order to achieve the above objective, an embodiment of the present invention provides a remote interaction method, including: a plurality of user devices logging in to a server host, the server host identifying and allocating a connection between the user devices; the server or one of the user devices Establishing a shared surface layer, the shared surface layer establishing a common object; transmitting the shared object to one or more designated user devices; the user device respectively executing an interactive program to establish a virtual surface layer; and when one of the user devices is configured on the interactive program When an input is made, the input is captured through the virtual surface layer and objectized; the objectized input is input to one or more designated user devices; and the virtual surface of the user device receives the input of the shared object and the objectized object. Displayed in an interactive program in a superimposed manner.

In order to achieve the above objective, an embodiment of the present invention provides a remote interaction system, including: a servo host having a shared layer module; a plurality of user devices having a layer module and an object module, and a user The device is logged into the server, and the server identifies and allocates a connection between the user devices. The shared layer module of the server host or the layer module of one of the user devices establishes a shared surface layer, and the shared surface layer establishes a common connection. An object and a shared object to one or more designated user devices, the user device respectively executing an interactive program and establishing a virtual surface layer through the layer module, when one of the user devices performs an input on the interactive program Inputting and objectifying through the virtual surface layer, and then transferring the objectized input to one or more specified user devices, and then inputting the received common object and object through the virtual surface layer of the user device to The way to superimpose is displayed in the interactive program.

In summary, the remote interaction method and system provided by the embodiments of the present invention can achieve the purpose of reducing the bandwidth load when the remote instant interaction occurs, and can provide more interesting interactive content.

In order to further understand the techniques, methods, and effects of the present invention for achieving the intended purpose, refer to the following detailed description, drawings, and The objects, features, and characteristics of the invention are to be understood as a part of the invention.

10‧‧‧Remote interactive system

101‧‧‧ Input

103‧‧‧Enter

105‧‧‧Enter

11‧‧‧Servo host

111‧‧‧Topology Data Sheet

113‧‧‧Connection Status Analysis Module

115‧‧‧Community level module

12‧‧‧ Peer-to-peer network

13‧‧‧Network

15‧‧‧User device

151‧‧‧ level module

153‧‧‧Objective Module

17‧‧‧User device

171‧‧‧ level module

173‧‧‧Objective Module

19‧‧‧User device

191‧‧‧ level module

193‧‧‧Objective Module

20‧‧‧Remote interactive system

31‧‧‧Common objects

33‧‧‧Enter

35‧‧‧Enter

31’‧‧‧Common objects

33’‧‧ Enter

35’‧‧ Enter

37‧‧‧Display screen

41‧‧‧Common objects

43‧‧‧Enter

45‧‧‧Enter

41’‧‧‧Common objects

43’‧‧‧ Input

45’‧‧ Enter

47‧‧‧Display screen

49‧‧‧ action

501‧‧‧ Login

502‧‧‧ Login

503‧‧‧ Identification

504‧‧‧ Identification

505‧‧‧Distribution connection

506‧‧‧Common objects

507‧‧‧Common objects

508‧‧‧object input

509‧‧‧Objective input

510‧‧‧object input

511‧‧‧object input

601‧‧‧ Login

602‧‧‧ Login

Step S801~S815‧‧‧Remote interaction method flow chart

Step S901~S914‧‧‧ Remote interactive method flow chart

Step S101~S108‧‧‧ Remote interactive method flow chart

603‧‧‧ Identification

604‧‧‧ Identification

605‧‧‧Distribution connection

606‧‧‧Common objects

607‧‧‧Object input

608‧‧‧object input

70‧‧‧Remote interactive system

71‧‧‧First group

73‧‧‧Second group

1 is a schematic diagram of an embodiment of a remote interaction system of the present invention; FIG. 2 is a functional block diagram of an embodiment of the remote interaction system of the present invention; FIG. 3 is a schematic diagram of a superimposed display of an embodiment of the remote interaction system of the present invention; 4 is a schematic diagram showing a 3D object superimposed display according to an embodiment of the remote interactive system of the present invention; FIG. 5 is a schematic diagram of an interactive flow of each end of the remote interactive system of the present invention; FIG. 6 is another remote interactive system of the present invention. FIG. 7 is a schematic diagram of still another embodiment of the remote interaction system of the present invention; FIG. 8 is a flowchart of an embodiment of the remote interaction method of the present invention; FIG. 9 is a remote interaction method of the present invention; A schematic diagram of another embodiment; FIG. 10 is a schematic diagram of still another embodiment of the remote interaction method of the present invention.

Various illustrative embodiments are described more fully hereinafter with reference to the accompanying drawings. However, the inventive concept may be embodied in many different forms and should not be construed as being limited to the illustrative embodiments set forth herein. Rather, these exemplary embodiments are provided so that this invention will be in the In the drawings, the size and relative sizes of layers and regions may be exaggerated for clarity. Similar numbers always indicate similar components.

It should be understood that although the terms first, second, third, etc. may be used herein to describe Various components or signals, etc., but such components or signals are not limited by these terms. These terms are used to distinguish one element from another, or a signal and another. In addition, as used herein, the term "or" may include all combinations of any one or more of the associated listed items.

Please refer to FIG. 1, which is a schematic diagram of an embodiment of a remote interaction system of the present invention. As shown, the remote interaction system 10 includes a server 19, a network 13, and user devices 15, 17, 19.

In the embodiment, three user devices 15, 17, and 19 are taken as an example, but not limited thereto. The user device 15, 17, 19 may be one of a desktop computer, a notebook computer, a smart phone, and a tablet computer, but is not limited thereto. The user devices 15, 17, 19 can log into the server 11 via the network 13, and the server 11 can identify and distribute the connections between the user devices.

One of the servo host 11 or the user devices 15, 17, 19 establishes a common object 101, and the shared object 101 is displayed on the user devices 15, 17, 19, respectively.

The user can view or operate the shared object 101 and can enter on an interactive program of the user device. The user device can enter the input object and transmit the objectized input directly to one or more designated user devices. Alternatively, the input of the object can be transmitted to the servo host 11, and the servo host 11 transmits the input of the object to the designated user device, and displays the input of the object on the user device. For example, as shown in FIG. 1, the user device 15 inputs an input 103, the user device 17 inputs an input 105, and transmits an input 103 and an input 105 to each of the user devices 15, 17, 19 for display, thereby transmitting The input object is turned into a remote interaction to reduce the bandwidth load.

Please refer to FIG. 2, which is a schematic diagram of an embodiment of the remote interaction system of the present invention. As shown, the remote interaction system 20 includes a servo host 11 and user devices 15, 17, 19. The servo host 11 has a topology structure data table 111, a connection state analysis module 113, and a common layer level module 115. User device 15 has a layer of order The module 151 and an objectization module 153. The user device 17 has a layer module 171 and an object module 173. The user device 19 has a layer module 191 and an object module 193.

The user devices 15, 17, 19 can log into the server 11 via the network, and the server 11 recognizes and distributes the connections between the user devices 15, 17, 19. The connection between the user devices 15, 17, 19 may constitute a peer-to-peer (P2P) architecture, but is not limited thereto. The topology data table 111 of the server host 11 can record the connection data between each user device 15, 17, 19, and the server host 111 can allocate the connection between the user devices 15, 17, 19 according to the topology data table 111. line.

In an embodiment of the present invention, the shared layer module 115 of the server host 11 establishes a shared surface layer, and the shared surface layer is a virtual layer level, and a common object can be established. The shared object may be at least one of a static image, a motion image, a 3D object, and a virtual reality object, but is not limited thereto.

The servo host 11 can transmit the shared item to one or more designated user devices 15, 17, 19. The user devices 15, 17, 19 respectively execute an interactive program to create a virtual surface layer. The interactive program can be a web page or an application type, but not limited to this. The virtual surface layer is a virtual layer that covers all the content of the interactive program, and can cover only a specific area for interactive transmission as needed. The virtual surface layer does not need to be displayed on the user device 15, 17, 19 for viewing by the user.

The user can operate the user device 15, 17, 19 to input on the interactive program. In the embodiment, the user device 15 is taken as an example. When the user operating the user device 15 operates the user device 15 to make an input on its interactive program, the user device 15 can retrieve the input through its virtual surface and use the objectization module 153 to object the input. The input may be a revision, a description, a label, or an operation, but is not limited thereto. The input objectization process can be a vectorization action, but not limited thereto. For example, the input image or trajectory can be vectorized, and the vectorized object can have the advantages of storing the minimum file size, arbitrarily scaling without distortion, and facilitating transmission, and can arbitrarily operate its movement, rotation, scaling, and filling operations.

User device 15 transmits the input of the object to one or more designated user devices 17, 19. The user device 15 can directly transmit the input of the object to the designated user device 17 or 19 through the network connection, or can transmit through the servo host 11. The transfer of the input of the object is in accordance with the specifications of the Extensible Markup Language (XML) and the scripting language (SCRIPTING LANGUAGE), but is not limited thereto. The virtual surface layers of the user devices 15, 17, 19 can respectively display the received input of the shared object and the object in a superimposed manner in the interactive program to display the shared object and input to the user for viewing or operation.

Please refer to FIG. 3 , which is a schematic diagram of a superimposed display of an embodiment of the remote interaction system of the present invention. Referring to FIG. 2, the shared layer module 115 of the server host 11 establishes a shared surface layer, and the shared surface layer is a virtual layer. A common object 31 can be created. In this embodiment, the shared object 31 is used as a house image. As an example. The virtual surface layer of the user device 15, 17, 19 can display the received shared object 31 in its interactive program for viewing or manipulation by the user. The user can use the user device 15, 17, 19 to perform actions such as revision, explanation, labeling or operation to achieve the purpose of interactive discussion. For example, the user operates the user device 15 to perform an input 35 on its interactive program. The user device 15 can retrieve the input 35 through its virtual surface and use the objectization module 153 to object the input 35. The user device 15 then transmits the input 35 of the object to the user devices 17, 19. Another user operates the user device 17 to perform an input 33 on its interactive program. The user device 17 can retrieve the input 33 through its virtual surface and use the objectization module 173 to object the input 33. The user device 17 then transmits the input 33 of the object to the user devices 15, 19.

The virtual surface layer of the user devices 15, 17, 19 can respectively display the received common object 31 and the objectized input 33 and 35 in an overlapping manner in the interactive program. As shown in the display screen 37, the shared objects are respectively displayed. 31. The input 35 of the user device 15 and the input 33 of the user device 17 are displayed in a superimposed manner on the shared object 31', the input 33' and the input 35' of the display screen 37. Thus, a remote interactive discussion is reached and the bandwidth load is reduced by objecting the input.

Please refer to FIG. 4 , which is a schematic diagram of a 3D object superimposed display according to an embodiment of the remote interaction system of the present invention. The difference from the embodiment shown in FIG. 3 is that the input of the shared object and the object in this embodiment is a 3D object. The shared object 41 is exemplified by a 3D head object. The user operates the user device 15 to perform an input 45 on its interactive program, the input 45 taking a 3D glasses object as an example. Another user operates the user device 17 to perform an input 43 on its interactive program, the input 43 taking a 3D hair object as an example. The virtual surface layers of the user devices 15, 17, 19 respectively display the received common object 41 and the objectized inputs 43 and 45 in a superimposed manner in their interactive program. As shown on the display screen 47, the shared object 41, the input 45 of the user device 15, and the input 43 of the user device 17 are displayed on the display screen 47 in a superimposed manner on the shared object 41', the input 43', and the input. 45'. The user can operate the common object 41', the input 43' or the input 45' to perform an action 49, wherein the action 49 can be an action such as rotation, movement or zooming, but not limited thereto. Achieve a remote interactive discussion of 3D objects or virtual reality, and reduce the bandwidth load with objectized input.

In an embodiment of the present invention, the shared surface layer may be established by one of the user devices 15, 17, 19, and then the shared object created by the shared surface layer is transmitted to one or more designated user devices 15, 17. 19, and achieve the purpose of remote interactive discussion.

In an embodiment of the invention, the input system is a revision, a description, an annotation, or an operation, wherein the operation may be a composite action of multiple instructions, such as rotation, movement, or scaling, but not limited thereto. .

In an embodiment of the invention, the input of the object can be attached to the shared object. When one of the user devices 15, 17, 19 operates the shared object to perform an action, the input of the object can be changed according to the action.

In an embodiment of the invention, the input of the object can be selected to be attached to the shared object. If the input selection of the object is attached to the shared object, when one of the user devices 15, 17, 19 operates the shared object to operate in an action, the input of the object may change with the action. And if the input selection of the object is not attached to the shared object, then When one of the user devices 15, 17, 19 operates the shared object to operate in an action, the input of the object does not change with the action.

In an embodiment of the present invention, when the user devices 15, 17, 19 log in to the server 11 through the network, and the server 11 recognizes and allocates the connection between the user devices 15, 17, 19, the server 11 can The user devices 15, 17, 19 are assigned to have different rights, such as administrative rights or viewing rights. Among them, the user device having the viewing authority can only view the input of the common object and the object object displayed on the interactive program, and cannot input or operate. The user device with administrative rights can not only watch but also input and operate. Moreover, the user device having the administrative authority can authorize the user device having the viewing authority to perform the input or operation authority, and the user device having the viewing authority can perform the input or operation after obtaining the authorization.

In an embodiment of the present invention, the connection state analysis module 113 of the servo host 11 analyzes the connection state of each user device 15, 17, 19, when the connection state of each user device 15, 17, 19 When all are in a low load state, the servo host 11 controls the user devices 15, 17, 19 to execute in a first mode. The first mode is that the shared surface layer is established by the user device, and the input of the object is directly transmitted to The mode of another user device. One of the user devices 15, 17, 19 establishes a shared surface layer, and the shared surface layer establishes a common object. And transmitting the shared object to one or more designated user devices. When one of the user devices 15, 17, 19 is input on its interactive program, the input of the objectized input is directly transmitted to the designated user device. The virtual surface layer of the user device 15, 17, 19 displays the received input of the shared object and the object in a superimposed manner on the interactive program.

When the connection state analysis module 113 analyzes the connection state of each user device 15, 17, 19, and the connection state of one of the user devices is in a high load state, the servo host 11 controls the user device 15 17 and 19 are executed in a second mode, wherein the shared surface is established by the servo host 11 and the input of the object is transmitted to the other user device through the servo host 11. The servo host 11 establishes a Shared surface layer, shared surface layer to create a common object. And transmitting the shared object to one or more designated user devices 15, 17, 19, when the user device 15, 17, 19 is input on the interactive program, first transferring the objectized input to the servo The host 11, the servo host 11 then transmits the input of the object to one or more designated user devices 15, 17, 19. The virtual surface layer of the user device 15, 17, 19 then displays the received input of the shared object and the object in a superimposed manner on the interactive program.

The connection state analysis module 113 may analyze at least one of the connection bandwidth and the number of connections of each user device 15, 17, 19 to determine the load level of the connection state, but not This is limited. Through the setting of the connection state analysis module 113, the remote interaction system 20 of the present invention can operate in different modes according to the connection state of the user device, thereby making the connection quality of the system better and smooth, and reducing the servo host. 11 bandwidth load.

In an embodiment of the invention, the user can control the user device 15, 17, 19 through the servo host 11 to execute in the first mode or the second mode.

Please refer to FIG. 5 , which is a schematic diagram of the interaction process of each end in an embodiment of the remote interaction system of the present invention. Referring to FIG. 2, the flowchart shows a program in which the shared host layer is created by the server 11 and input by the user devices 15, 17 and the input of the object is transmitted to the other user device through the server 11.

As shown in the figure, the user devices 15 and 17 respectively log in (501, 502) the server 19 through the network, and the server 11 recognizes (503, 504) and performs the distribution connection between the user devices 15 and 17 ( 505).

The shared layer module 115 of the servo host 11 establishes a shared surface layer, and the shared surface layer is a virtual layer level, and a common object can be established. The shared objects (506, 507) are transmitted to the user devices 15, 17 respectively. When the user operates the user device 15 to make an input on its interactive program, the user device 15 can retrieve the input through its virtual surface and use the objectization module 153 to object the input. The user device 15 can first transmit the objectized input (508) to the servo host 11 through the network connection, and the servo Host 11 then transmits the objectized input (509) to user device 17. And when another user operates the user device 17 to make an input on its interactive program. The user device 17 can first transmit the objectized input (511) to the servo host 11 via the network connection, and the servo host 11 transmits the objectized input (510) to the user device 15.

Please refer to FIG. 6, which is a schematic diagram of the interaction process of each end in another embodiment of the remote interaction system of the present invention. Please refer to Figure 2. This flowchart shows a program in which the shared surface layer is created by the user device 15 and input by the user devices 15, 17 and the input of the object is directly transmitted to another user device.

As shown in the figure, the user devices 15 and 17 respectively log in (601, 602) the server 19 through the network, and the server 11 recognizes (603, 604) and performs the distribution connection between the user devices 15 and 17 ( 605).

The layer module 151 of the user device 15 establishes a shared surface layer, and the shared surface layer is a virtual layer level, and a common object can be established. The shared item (606) is transmitted directly to the user device 17. When the user operates the user device 15 to make an input on its interactive program, the user device 15 can retrieve the input through its virtual surface and use the objectization module 153 to object the input. The user device 15 can transmit the objectized input (607) directly to the user device 17 via a network connection. And when another user operates the user device 17 to make an input on its interactive program. The user device 17 can transmit the objectized input (608) directly to the user device 15 via a network connection.

Please refer to FIG. 7, which is a schematic diagram of still another embodiment of the remote interaction system of the present invention. As shown, the remote interaction system 70 includes a servo host 11 and user devices 15, 17, 19.

The difference from the embodiment shown in FIG. 2 is that, in this embodiment, the user devices 15, 17, 19 belong to the same or different groups, and the input of the shared object and the object is only transmitted to the same group. One or more designated user devices. As shown, the user devices 15, 17 belong to a first group 71, and the user devices 15, 19 belong to a second group 73.

The input of the shared object or object created by the user device 17 is only transmitted to the other user device 15 belonging to the first group 71, and is not transmitted to the user device 19 belonging to the second group 73. The input of the shared object or object created by the user device 19 is only transmitted to the other user device 15 of the second group 73, and is not transmitted to the user device 17 belonging to the first group 71. The input of the shared object or object created by the user device 15 is transmitted to another user device 17 belonging to the first group 71 or to another user device 19 belonging to the second group 73. .

Through the group settings, different user devices can be grouped into the same or different groups for remote interactive discussion of different objects, different content or topics. For example, the user devices 15, 17 may be discussion groups between colleagues, and the user devices 15, 19 may be discussion groups with clients. Or the user devices 15, 17 are discussion groups of movie topics, and the user devices 15, 19 are discussion groups of decoration design and the like. To achieve the purpose of multiple discussions.

In an embodiment of the present invention, the user devices 15, 17, 19 belonging to the same group may have different rights, such as hosting rights or viewing rights. Among them, the user device having the viewing authority can only view the input of the shared object and the object of the same group displayed on the interactive program, and cannot input or operate. The user device with the hosting authority can not only view the input of the common object and the object of the same group, but also input and operate. Moreover, the user device having the hosting authority can authorize the user device having the viewing authority in the same group to perform the input or operation authority, and the user device having the viewing authority can perform the input or operation after obtaining the authorization.

Please refer to FIG. 8, which is a flowchart of an embodiment of the remote interaction method of the present invention, and FIG. 2 is also referred to. As shown in step S801, the user devices 15, 17, 19 log in to the server host 11, respectively. Next, in step S803, the servo host 11 recognizes and distributes the connection between the user devices 15, 17, 19. Step S805, one of the server host 11 or the user devices 15, 17, 19 establishes a shared surface layer, and the shared surface layer is a virtual layer. Order, you can create a common object. And transmitting the shared object to one or more designated user devices (step S807). Next, in step S809, the user devices 15, 17, 19 respectively execute an interactive program to establish a virtual surface layer. When one of the user devices 15, 17, 19 inputs on its interactive program, the input is retrieved through its virtual surface and objectized (step S811). And inputting the objectized input to one or more designated user devices 15, 17, 19 (step S813). Next, in step S815, the virtual surface layer of the user devices 15, 17, 19 displays the shared object and the received objectized input in a superimposed manner on the interactive program.

Please refer to FIG. 9, which is a flowchart of another embodiment of the remote interaction method of the present invention, and FIG. 2 is also referred to. As shown in step S901, the user devices 15, 17, 19 log in to the server host 11, respectively. Next, in step S902, the servo host 11 recognizes and allocates the connection between the user devices 15, 17, 19. In step S903, the connection state analysis module 113 of the servo host 11 analyzes the connection state of each user device 15, 17, 19. If the connection states of the user devices 15, 17, and 19 are all in a low load state, step S904 is performed. If not, proceed to step S911. The connection state analysis module 113 may analyze at least one of the connection bandwidth and the number of connections of each user device 15, 17, 19 to determine the load level of the connection state, but not Limited.

In step S904, the server 11 controls the user device to execute in a first mode, where the first mode is a mode in which the shared surface layer is established by the user device and the input of the object is directly transmitted to the other user device. In step S905, one of the user devices 15, 17, 19 establishes a shared surface layer, and the shared surface layer is a virtual layer, and a common object can be established. And transmitting the shared object to one or more designated user devices (step S906). When one of the user devices 15, 17, 19 inputs on its interactive program, the input of the object is directly transferred to one or more designated user devices 15, 17, 19 (step S907). Next, in step S908, the virtual surface layer of the user devices 15, 17, 19 displays the received input of the shared object and the object in a superimposed manner on the interactive program. Next, step S903 is repeated.

In step S911, the server 11 controls the user devices 15, 17, 19 to execute In a second mode, the second mode is a mode in which the shared surface layer is established by the servo host 11 and the input of the object is transmitted to the other user device through the servo host 11. In step S912, the server host 11 establishes a shared surface layer, and the shared surface layer is a virtual layer level, and a common object can be established. And transmitting the shared object to one or more designated user devices (step S913). When one of the user devices 15, 17, 19 inputs on its interactive program, the input of the object is first transmitted to the servo host 11, and the servo host 11 transmits the input of the object to one or more designated User devices 15, 17, 19 (step S914). Then, in step S908, the virtual surface layer of the user devices 15, 17, 19 displays the received input of the shared object and the object in a superimposed manner on the interactive program. Next, step S903 is repeated.

Through the setting of the connection state analysis module 113, the remote interaction system 20 of the present invention can operate in different modes according to the connection state of the user device, thereby making the connection quality of the system better and smooth, and reducing the servo host. 11 bandwidth load.

Please refer to FIG. 10, which is a flowchart of still another embodiment of the remote interaction method of the present invention, and FIG. 7 is also referred to. As shown in step S101, the user devices 15, 17, 19 are respectively logged into the server host 11, wherein the user devices 15, 17, 19 belong to the same or different groups, for example, the user devices 15, 17 belong to the first group. Group 71, user devices 15, 19 belong to a second group 73. Next, in step S102, the servo host 11 recognizes and distributes the connection between the user devices 15, 17, 19. In step S103, one of the server host 11 or the user devices 15, 17, 19 establishes a shared surface layer, and the shared surface layer is a virtual layer, and a common object can be established. And transmitting the shared object to one or a plurality of designated user devices belonging to the same group (step S104). Next, in step S105, the user devices 15, 17, 19 respectively execute an interactive program to establish a virtual surface layer. When one of the user devices 15, 17, 19 inputs on its interactive program, the input is retrieved through its virtual surface and objectized (step S106). And inputting the objectization to one or a plurality of designated user devices belonging to the same group (step S107). Next, in step S108, the virtual surface layer of the user devices 15, 17, 19 displays the received input of the common object and the object in a superimposed manner. Interactive program.

Therefore, through the technology disclosed in the above disclosure, the remote interaction method and system proposed by the present invention can achieve the purpose of reducing the bandwidth load when the remote interaction is instantaneous, and can provide more interesting interactive content.

The above is only a preferred embodiment of the present invention, and all changes and modifications made to the scope of the present invention should be covered by the present invention.

Step S801~S815‧‧‧Remote interaction method flow chart

Claims (10)

A remote interaction method includes: a plurality of user devices logging in to a server, the server identifying and distributing connections between the user devices; wherein analyzing the connection status of each of the user devices, Performing a switching between a first mode or a second mode; the server host or one of the user devices establishing a shared surface layer, the shared surface layer establishing a common object; transmitting the shared object to the one or more specified ones User devices; each of the user devices respectively executing an interactive program to create a virtual surface layer; and when one of the user devices performs an input on the interactive program, the input is captured through the virtual surface layer and is objectized Transmitting the input to one or more of the specified user devices; and the virtual surface of the user devices displays the received common object and the input of the object in a superimposed manner The interactive program. The remote interaction method of claim 1, wherein the server host has a topology data table, and the topology data table records connection data between each of the user devices, and the server is based on the topology. The structure data table assigns connections between the user devices. The remote interaction method of claim 1, wherein the server has a connection state analysis module, and further comprising the following steps: the connection state analysis module analyzes the connection status of each of the user devices. When the connection state of each of the user devices is in a low load state, the server host controls the user devices to execute in the first mode, wherein the user devices establish the shared surface layer, When one of the user devices performs the input on the interactive program, directly inputting the input of the object to the designated user devices; The connection state analysis module analyzes the connection status of each of the user devices. When the connection state of one of the user devices is in a high load state, the server host controls the user devices to Executing in the second mode, the server establishes the shared surface layer, and when one of the user devices performs the input on the interactive program, the input of the object is first transmitted to the server, and the server host The input of the object is transmitted to the designated user devices. The remote interaction method of claim 3, wherein the connection state analysis module analyzes at least one of a connection bandwidth and a number of connections of each of the user devices to determine a connection state thereof. It is in the low load state or the high load state. The remote interaction method of any one of claims 1 to 4, wherein the shared object is at least one of a still image, a motion picture, a 3D object, and a virtual reality object. The remote interaction method of any one of claims 1 to 4, wherein the input is a revision, a description, an annotation, or an operation, wherein the operation is a composite action of the plurality of instructions, and the object is The input is attached to the shared object, and when one of the user devices operates the shared object to operate in an action state, the input of the object is changed according to the action state. The remote interaction method of claim 1, wherein the user devices belong to the same or different groups, and only the input of the object is transferred to one or more specified users belonging to the same group. Device. A remote interactive system includes: a servo host having a shared layer module; and a plurality of user devices having a layer module and an object module, wherein the user devices log in to the server, The server detects and allocates a connection between the user devices; wherein, analyzing a connection state of each of the user devices, performing a switching between a first mode or a second mode; The shared layer module of the server host or the layer module of one of the user devices establishes a shared surface layer, the shared surface layer establishes a common object, and transmits the shared object to one or more specified The user devices respectively execute an interactive program and create a virtual surface layer through the layer module. When one of the user devices performs an input on the interactive program, the user device transmits the The virtual surface layer captures the input and digitizes the object, and then transfers the objectized input to one or more designated user devices, and then the shared object and the shared object received by the virtual surface layer of the user device The input of the object is displayed in the interactive program in a superimposed manner. The remote interactive system of claim 8, wherein the servo host has a connection state analysis module; wherein the connection state analysis module analyzes the connection status of each of the user devices, when each When the connection states of the user devices are all in a low load state, the server host controls the user devices to execute in the first mode, wherein the user devices establish the shared surface layer, and one of the user devices When the user device performs the input on the interactive program, directly transmitting the input of the object to the designated user devices; wherein the connection state analysis module analyzes the connection of each of the user devices a line state, when the connection state of one of the user devices is in a high load state, the server host controls the user devices to execute in the second mode, the server host establishes the shared surface layer, wherein When the user device performs the input on the interactive program, the input of the object is first transmitted to the server, and the server further transmits the input of the object to the designated These user devices. The remote interaction system of claim 8, wherein the user devices belong to the same or different groups, and only the input of the object is transferred to one or more specified users belonging to the same group. Device.