CN102685174B - Man-machine interaction information processing method based on large-scale display system - Google Patents

Abstract

The invention relates to a method for processing human-computer interaction information based on a large-scale display system, including 1) after the local server is started, an interactive module is started, a shared object is created at the remote server, and state monitoring of the shared object is established , once there is any change in the attribute data of the shared object, the shared object will send a synchronization event, which carries all the current attribute information of the shared object; 2) the interactive module in the local server is running Monitor the state of the displayed object at any time in the system, and judge whether it is out of bounds, if yes, then perform step 3), if no, return to step 1); Steps such as broadcasting from the remote server. Compared with the prior art, the present invention has the advantages of solving the integral fusion problem of large interactive display systems and the like.

Description

Human-computer interaction information processing method based on large-scale display system

technical field

The invention relates to a human-computer interaction information processing method, in particular to a human-computer interaction information processing method based on a large display system.

Background technique

In the human-computer interaction method based on a large-scale display system, the interactive technology used to integrate the entire display system as a whole is one of the key technologies. Large-scale display systems generally display images through multiple display devices, and these display devices are controlled by independent hosts. The problem brought about by such a distributed structure is that the entire display interface lacks a basic overall experience.

There are two main directions for the technology to solve the integration problem of the large-scale interactive display system: integration and distribution. The method adopted in the direction of integration is to control multiple display devices with one host, and the interactive media software used for display is also run by the host accordingly. The limitation of this method is that on the one hand, it puts forward higher requirements on the display hardware. At present, considering the cutting-edge status of the corresponding hardware, the limit that this method can achieve in the specific display interface size is also very limited. ; On the other hand, unlike video streaming media, multimedia programs with interactive functions are also limited in size. On the whole, even if the cost limitation is not considered, the human-computer interaction technology in the integration direction does not have the development potential to support the scalability of the display system.

Human-computer interaction technology in the direction of distribution is a widely used technology at present. The characteristic of this technology is that each display device is independently controlled by a host, and the interactive media software used for display is also distributed on each host. The data processing software used to collect data is controlled by another independent host and sends the collected data to the host running the interactive media software respectively, finally realizing the interactive effect.

Disadvantages brought about by distributed technology are obvious. Because each host running interactive media software is independent of each other, media software cannot provide (in time) synchronization, (in space) communication and other overall experience in terms of performance. .

Although the human-computer interaction technology in the distributed direction has such major shortcomings, it will not constitute an insurmountable obstacle in terms of supporting the expansion of display devices and the requirements for the size of interactive media. In terms of overall integration, this problem can also be covered up by adopting some ingenious designs.

Contents of the invention

The object of the present invention is to provide a method for processing human-computer interaction information based on a large display system in order to overcome the above-mentioned defects in the prior art.

The purpose of the present invention can be achieved through the following technical solutions:

A method for processing human-computer interaction information based on a large display system, comprising the following steps:

1) After the local server is started, start the interactive module, create a shared object on the remote server, and establish a status monitor for the shared object. Once the attribute data of the shared object changes, the The shared object will send a synchronization event, which carries all the current attribute information of the shared object;

2) The interactive module in the local server monitors the state of the displayed object at any time during operation, and judges whether it is out of bounds, if yes, then execute step 3), if no, return to step 1);

3) The interactive module that detects cross-border references the shared object on the remote server, and makes the remote server send a broadcast;

4) After receiving the broadcast, the interactive module will decide whether to respond according to the host number in the broadcast information. If no response is required, the interactive module will keep the original state and return to step 2); if a response is required, then Go to step 5);

5) After the judgment, the interactive module creates a display object in the display layer through the transformation of the position according to the information transmitted by the broadcast, and the display object after the coordinate transformation complements the display object on the display device on the other side. Constitutes a "whole" in appearance;

6) After the display object on the other side is created, the display objects on both sides retain the corresponding read and write permissions on the remote shared object; when the status of the display object on one side changes, rewrite the corresponding data information, and when the shared object is rewritten, send a synchronization event to notify the display object on the other side to update its state in time;

7) If the display object begins to break away from the boundary area, the interactive module correspondingly accommodating the display object will notify the shared object at the remote server to delete the corresponding attribute object.

The broadcast information includes the serial number of the host computer that broadcasts, the name of the display object that generated the out-of-bounds, and the relevant attributes at that time.

The relevant attributes include position and color.

The said display object begins to leave the boundary area because the entire display area of the display object is included in a certain side screen.

Compared with the prior art, the present invention solves the integral fusion problem of a large interactive display system, so that the system has a wide expansion space in display size, and at the same time, it does not cause an increase in technical cost.

Description of drawings

Fig. 1 is a flowchart of the present invention;

Fig. 2 is a schematic diagram of the hardware structure of the present invention.

Detailed ways

The present invention will be described in detail below in conjunction with the accompanying drawings and specific embodiments.

Example

The present invention arranges a set of server software on a computer independent of the display system, and adds the host computer to the local area network where the original interactive system is located. The computers participating in the display communicate with each other by accessing the same server. This communication is achieved through remote objects built on the server side. When the display object on one side of the display device exceeds the display boundary, the corresponding host will send a broadcast to other hosts through the shared object on the server side, and other hosts will decide whether to respond to the broadcast according to the corresponding agreement. Generally, only two hosts adjacent to the display device will respond to each other's broadcast. Once the broadcast is allowed to respond, the corresponding two hosts will add object attributes for storing various information of the display object to the shared object on the server side, and at the same time, the state of the display object at the junction of the display area changes in itself The remote object will be notified at any time, so that the remote object will issue a synchronization event to all hosts, and all hosts with remote object references will respond accordingly when receiving the synchronization event to update the information of the displayed object in time. Finally, once the display object leaves the boundary area, the server will delete the corresponding object attribute that stores the object information.

As shown in Figure 1, the specific steps are as follows:

1) After the local server is started, start the interactive module, create a shared object on the remote server, and establish a status monitor for the shared object. Once the attribute data of the shared object changes, the The shared object will send a synchronization event, which carries all the current attribute information of the shared object;

2) The interactive module in the local server monitors the state of the displayed object at any time during operation, and judges whether it is out of bounds, if yes, then execute step 3), if no, return to step 1);

3) The interactive module that detects cross-border references the shared object on the remote server, and makes the remote server send a broadcast;

4) After receiving the broadcast, the interactive module will decide whether to respond according to the host number in the broadcast information. If no response is required, the interactive module will keep the original state and return to step 2); if a response is required, then Go to step 5);

5) After the judgment, the interactive module creates a display object in the display layer through the transformation of the position according to the information transmitted by the broadcast, and the display object after the coordinate transformation complements the display object on the other side of the display device. Constitutes a "whole" in appearance;

6) After the display object on the other side is created, the display objects on both sides retain the corresponding read and write permissions on the remote shared object; when the status of the display object on one side changes, rewrite the corresponding data information, and when the shared object is rewritten, send a synchronization event to notify the display object on the other side to update its state in time;

7) If the display object begins to break away from the boundary area, the interactive module correspondingly accommodating the display object will notify the shared object at the remote server to delete the corresponding attribute object.

As shown in Figure 2, it is the simplest implementation of this technology. In this implementation, only two players 2 are used to run the interactive module and the image capturing and processing module. An image capturing and processing module runs independently on the two players 2 , and these two modules independently control a camera 4 . After the image captured by the camera 4 is processed, relevant information is sent to the local interactive module, so as to realize interaction. The two players 2 each control the two projectors 3, and because of this, the image between the two projectors 3 controlled by the same player 2 is strictly one and therefore does not require any other additional measures. However, when we regard the two projectors 3 controlled by player 2 as a whole, the two wholes are independent of each other. Communication is achieved by accessing the remote server.

Claims (4)

1., based on a human-computer interaction information processing method for large scale display system, it is characterized in that, comprise the following steps:

1) after local service end starts, start interactive module, a shared object is created at remote service end, interactive module sets up the status monitoring to described shared object, once the attribute data of described shared object has any change, then described shared object can send a synchronous event, and this synchronous event carries the current all properties information of shared object;

2) interactive module in local service end monitors the state of display object at any time in running, and judges whether to cross the border, and if yes, then performs step 3), if NO return step 1);

3) monitor the interactive module of crossing the border and quote shared object on remote service end, and make remote service end send broadcast;

4) after receiving broadcast, interactive module can determine whether will make response according to the main frame numbering in broadcast message, if do not need response, then interactive module keeps original state constant, and returns step 2); If need response, then enter step 5);

5) after judging, the information that interactive module is come according to broadcast delivery is through coordinate transform, a display object is created at display layer, display object after coordinate transform makes up mutually with the display object on opposite side display device, phenomenologically forms one " entirety ";

6) after the display object establishment on opposite side display device is complete, this both sides display object all possesses the upper corresponding access limit to teleengineering support object; During change in the display object generation state of side, rewrite corresponding data message on shared object, and after shared object is rewritten, send a synchronous event to notify that the display object of opposite side upgrades in time its state;

7) if display object starts to depart from borderline region, then the interactive module of corresponding this display object of accommodation is by the shared object of notice remote service end, makes it delete corresponding attributes object.

2. a kind of human-computer interaction information processing method based on large scale display system according to claim 1, is characterized in that, the information of described broadcast comprise send broadcast main frame numbering, produce the display object title of crossing the border and association attributes at that time.

3. a kind of human-computer interaction information processing method based on large scale display system according to claim 2, it is characterized in that, described association attributes comprises position and color.

4. a kind of human-computer interaction information processing method based on large scale display system according to claim 1, is characterized in that, it is that whole viewing areas of display object are all comprised in certain side screen that described display object starts to depart from borderline region.