JP2005228228A - Client server system and GUI display method thereof - Google Patents

Abstract

A client server system having a GUI (Graphical User Interface) display function that performs a quick response and a display method thereof in a high-delay and narrow-band communication environment such as a mobile communication network.
When displaying a GUI of an application 13 executed on a server 1 on a client terminal 3, the server 1 actually performs an operation that a user performs next on the GUI displayed on the client terminal 3. Before the user performs the prediction, the result of executing the application 13 in advance based on the prediction is transmitted to the client terminal 3. The client terminal 3 stores the prediction result received from the server 1 and displays a GUI screen based on the stored prediction result when the user actually performs an operation. Even when the client terminal and the server are connected in a narrow bandwidth and high delay communication environment, a prompt GUI response can be realized and work can be performed efficiently.
[Selection] Figure 1

Description

  The present invention relates to a technical field called a client server system or server-based computing in which an application is executed on a server and the application on the server is operated from a client terminal connected to the server and a network. The present invention relates to a technique for speeding up display of a user interface (GUI).

  In recent years, with the spread of mobile phones, the demand for executing applications on mobile phones has increased, but the processing power of mobile phones is poor, and clients that execute applications on other servers and operate them from mobile phones Server systems are attracting attention.

  However, mobile phones are equipped with a communication network that has high delay and narrow bandwidth due to its communication characteristics and is not suitable for a client server system.

  A method for realizing a client-server system in a high-late environment is disclosed in Japanese Patent Laid-Open No. 2003-323402. By accumulating until a series of highly relevant operations are completed, it is transmitted to the server in a lump. It is possible to operate efficiently even in an environment via a high-latency network.

In addition, a method of displaying a GUI on a client terminal by exchanging pixels between a server and a client terminal is also known, such as Terminal Service of Microsoft Corporation and Meta Frame of Citrix Corporation. This is a method in which the screen of an application executed on the server is transmitted to the client terminal in units of pixels, and the client terminal only has to display the pixel information as it is after receiving the pixel information. In addition, the data amount is reduced by transmitting only changed pixels.
JP 2003-323402 A http://www.keyman.or.jp/search/30000031_1.html (server-based computing)

  However, although the prior art disclosed in Patent Document 1 can reduce the number of communications and reduce the influence of communication delay, it is inevitable that the transmission delay is affected by transmission to the server. Further, only the operations such as cursor movement and Japanese conversion are accumulated, and when screen transition occurs, it is affected by communication delay.

  On the other hand, the client-server system using the above-described method for exchanging pixels has a problem that a rapid response cannot be expected in a narrow-band communication environment such as a mobile communication network because the amount of data is very large. It was.

  An object of the present invention is to provide a client server system that realizes a quick response of a GUI and a GUI display method thereof so that a user can always work efficiently even in a high-delay and narrow-band communication environment. is there.

  In order to achieve the above-described object, the present invention performs communication between a server that executes an application and transmits graphic user interface (GUI) information of the application and receives the GUI information. And displaying a GUI based on the information and a client terminal system GUI display method including a client terminal that transmits a response based on a user operation to the GUI to the server. The server displays the GUI on the client terminal. Predicting information received from the client terminal with respect to a user operation on the GUI, and transmitting information of at least one GUI changed based on the prediction to the client terminal, the client terminal receiving the information received from the server Changed based on forecast The UI information is stored, and when the GUI information changed based on the prediction corresponding to the user operation on the displayed GUI is stored, the GUI based on the stored GUI information is displayed. It is characterized by that.

  According to the present invention, the next user operation to be performed on the GUI displayed on the client terminal is predicted in advance, and based on the prediction, the GUI information is transmitted from the server to the client terminal in advance. By storing the information in the terminal, the user interface screen can be displayed immediately without being affected by any communication delay.

  In addition, in the communication between the server and the client terminal, when the attribute of the GUI component is changed by a user operation or the like, the present invention reduces the amount of data necessary for communication by transmitting only the changed part. Reduce.

  Further, according to the present invention, only when there is a description in the application program that some processing is triggered by the operation for a user operation on the GUI component, the client terminal sends a command corresponding to the user operation on the GUI component. Sending data to the server reduces the amount of data required for communication.

  According to the present invention, in a client server system connected in a high-lateness and narrow-band communication environment, the next user operation to be performed on the GUI displayed on the client terminal is predicted, and the execution result is calculated in advance. Therefore, a user interface with a quick response can be realized, and the user can work efficiently.

  Even if the server and the client terminal are connected in a narrow-band communication environment, a command corresponding to the attribute is defined for each GUI component in the communication between the server and the client terminal, and the attribute value of the GUI component is set. Since data is transmitted and received, the amount of data exchanged between the server and the client terminal can be reduced, and even in a narrow-band communication environment, GUI display with quick response can be realized, and the user can work efficiently. it can.

  In addition, when the attribute value of the GUI component is changed due to user operation, etc., only the attribute value of the GUI component that has been changed is exchanged, further reducing the amount of data exchanged between the server and the client terminal Even in a narrow-band communication environment, a GUI display with a quick response can be realized, and the user can work efficiently.

  In addition, when the user performs some operation on the GUI component, the application on the server determines whether or not to perform some processing using the operation as a trigger. Otherwise, the user event is not sent to the server. The number of communications can be reduced, and the amount of data transmitted and received between the server and the client terminal can be reduced.

  Next, an embodiment of the present invention will be described with reference to the drawings.

  FIG. 1 is a schematic configuration diagram showing an embodiment of a client server system according to the present invention. As shown in FIG. 1, in the present client server system, a server 1 on which an application is executed and a client terminal 3 are connected by a high-definition and narrow-band communication network 2.

  The server 1 is mainly composed of known computer devices and operating system programs, and includes a command generation analysis function unit 11, a user event prediction function unit 12, and an application 13 executed on the server 1 including a plurality of GUI components. I have.

  The command generation / analysis function unit 11 stores in advance a table in which properties (attributes) of GUI components are associated with commands for each property. Using this table, the command generation / analysis function unit 11 analyzes a command received from the client terminal 3 via the communication network 2 and transmits the property of the GUI component corresponding to this command to the application 13, as well as the application 13. After the property of the GUI component received from is converted into a command, this command is transmitted to the client terminal 3 via the communication network 2.

  The user event prediction function unit 12 inputs GUI information displayed on the client terminal 3 from the application 13, and the user performs the next operation (hereinafter referred to as “GUI”) currently displayed on the client terminal 3. The operation by the user is referred to as a user event). Further, the execution result of the application when the predicted user event is executed is calculated, and the command generation analysis function unit 11 associates the GUI information as the execution result, that is, the GUI component property with the user event information. To the client terminal 3. Here, the prediction of the user event is a method in which priorities are determined in advance for each of the operations that can be performed by the user, or a method in which a history of operations performed by the user in the past is stored and referred to. Alternatively, a method using both of them can be applied, and in this embodiment, prediction is performed with priority given to an operation with a high probability performed by the user using both of them.

  The application 13 continues to execute based on the properties of the GUI component transmitted from the command generation analysis function unit 11 and also generates and analyzes all the GUI information displayed on the client terminal 3 or only the properties of the changed GUI component. It is sent to the function unit 11.

  The client terminal 3 includes a computer device that does not have a hard disk device or a flexible disk device generally called a thin client terminal, for example, and includes a command generation analysis function unit 31, an event management function unit 32, and a user interface unit 33. The prediction result storage unit 34 is provided.

  The command generation / analysis function unit 31 stores in advance a table similar to the above in which the property (attribute) of each GUI component is associated with the command for each property. Using this table, the command generation / analysis function unit 31 analyzes a command received from the server 1 via the communication network 2 and sets the property of the GUI component corresponding to this command to the event management function unit 32 or the prediction result storage unit. 34, and after converting the property of the GUI component received from the user interface unit 33 through the event management function unit 32 into a command, the command is transmitted to the server 1 through the communication network 2. Here, when the command generation analysis function unit 31 receives the changed GUI information corresponding to the user event information from the server 1, that is, the property of the changed GUI component, the command generation analysis function unit 31 stores them in the prediction result storage unit 34. Remember me.

  The event management function unit 32 sends the GUI component received from the command generation analysis function unit 31 and its properties to the user interface unit 33. Further, based on the user event information received from the user interface unit 33, the event management function unit 32 determines whether the GUI information corresponding to the user event, that is, the property of the GUI component is stored in the prediction result storage unit 34. If it is stored, the stored property of the GUI component is sent to the user interface unit 33. When GUI information corresponding to the user event is not stored in the prediction result storage unit 34, the event management function unit 32 is changed by the user event based on the user event information received from the user interface unit 33. The GUI component property is transmitted to the server 1 via the command generation analysis function unit 31.

  The user interface unit 33 includes an operation unit and a display unit (not shown), displays the GUI on the display unit based on the properties of the GUI component received from the command generation analysis function unit 31 via the event management function unit 32, and Information on operations performed by the user via the operation unit is sent to the event management function unit 32.

  The prediction result storage unit 34 stores the GUI event information associated with the user event information, that is, the properties of the GUI component, together with the user event information from the command generation analysis function unit 31.

  In the above system, the client terminal 3 displays a GUI to the user via the user interface unit 32 based on the property of the GUI component representing the execution result of the application 13 executed on the server 1. In addition, the client terminal 3 receives a user event for the GUI displayed on the display unit of the user interface unit 32 and transmits the operation content to the server 1 via the narrowband communication network 2. Receiving this, the server 1 transmits a user event to the application 13 running on the server 1, and the application 12 is executed based on the user event. Further, the server 1 predicts the next operation performed by the user on the GUI currently displayed on the client terminal 3 by the user event prediction function unit 12, and transmits the prediction result to the client terminal.

  In addition, when the command generation / analysis function unit 11 on the server 1 needs to transmit all the internal states of the applications 13 executed on the server 1 to the client terminal 3, such as when accessed for the first time from the client terminal 3. Transmits the property value of each GUI component 13 existing in the application 12 to the client terminal 3.

  Further, the command generation / analysis function unit 11 needs to transmit only the changed part of the internal state of the application 13 to the client terminal 3 such that the user performs some operation and the state of the application 13 is changed. If there is a GUI component, only the changed property value among the property values of the GUI component is transmitted to the client terminal 3 with respect to only the changed GUI component among the GUI components existing in the application 13.

  On the other hand, when the user performs some operation such as pressing a button, the client terminal 3 only has a description that the application 13 being executed on the server 1 performs some processing with the operation as a trigger. The performed operation is transmitted to the server 1.

  Furthermore, the client terminal 3 stores the prediction result received from the server 1 in the prediction result storage unit 34. In the client terminal 3, when a user actually performs some operation, first, the prediction result stored in the prediction result storage unit 34 of the client terminal 3 is referred to and the operation actually performed by the user is predicted in advance. When the user operation matches, the stored prediction result is taken out, and the GUI is constructed from the prediction result by the user interface unit 33 and displayed on the client terminal 3.

  The prediction on the server 1 is performed at least once within the time until the user's idle time, that is, the user sees and judges the GUI displayed on the user interface unit 33 and takes some action, The result is transmitted to the client terminal 3. As the user's idle time is longer, prediction can be performed for a large number of times, that is, various operations, and the accuracy of prediction can be further increased.

  FIG. 2 is a flowchart showing an example of the prediction process on the server 1 in the present embodiment.

  When prediction of a user event is started in the server 1, first, the state of the GUI currently displayed on the client terminal 3 is analyzed, and operations that can be executed by the user are listed (S11). Subsequently, the list of listed operations is sorted in the order of high priority, that is, the order in which the probability that the user performs is high (S12). Next, it is determined whether or not the list is empty (S13). If the list is not empty, the leading prediction is extracted (S14). The execution result of the application 13 when the user executes the extracted prediction, that is, the operation that is likely to be performed by the user is calculated, and the result is transmitted to the client terminal 3 (S15).

  FIG. 3 is a flowchart showing processing performed by the client terminal 3 when the user performs some operation on the client terminal 3 in the present embodiment.

  When the user performs some operation, that is, a user event, the client terminal 3 first determines whether or not the user event matches the prediction result stored in the prediction result storage unit 34 of the client terminal 3 (S21). ). If they match, the prediction result is extracted from the prediction result storage unit 34 (S22), and the GUI is drawn on the screen of the client terminal 3 (S23). If the user's actual operation does not exist in the prediction result storage unit 34, the contents of the user event are transmitted to the server 1 (S24). As a result, the server 1 executes the application 13 and transmits the execution result to the client terminal 3. The client terminal 3 receives the execution result from the server 1 (S25), and draws a GUI on the screen of the display unit of the user interface unit 33 based on this (S26). Note that all the prediction results in the prediction result storage unit 34 are deleted after the GUI display for the user event is performed on the client terminal 3.

  According to the above-described embodiment, the server 1 predicts in advance the user operation to be performed next on the GUI displayed on the client terminal 3, and the GUI information is transmitted from the server 1 to the client terminal 3 based on this prediction. Since it is transmitted in advance and stored in the client terminal, the GUI screen can be immediately displayed on the display unit of the user interface unit 33 without being affected by the communication delay. As a result, even in a system composed of the server 1 and the client terminal 3 connected in a high-lateness and narrow-band communication environment, a user interface with quick response can be realized, and the user can work efficiently. it can.

  Even if the server 1 and the client terminal 3 are connected in a narrow-band communication environment, a command corresponding to the attribute is defined for each GUI component, and the attribute value of the GUI component is transmitted and received. The amount of data exchanged with each other can be reduced, and even in a narrow-band environment, a GUI having a quick response can be realized, and the user can work efficiently.

  Further, when the attribute value of the GUI component is changed due to a user operation or the like, only the attribute value of the GUI component that has been changed is exchanged, and further exchange is performed between the server 1 and the client terminal 3. The amount of data can be reduced.

  Further, when the user performs any operation on the GUI component in the GUI displayed on the client terminal 3, the application 13 on the server 1 determines whether or not to perform some processing using the operation as a trigger. If not, the user event is not transmitted to the server 1, so the number of communications can be reduced, and the amount of data transmitted and received between the server 1 and the client terminal 3 can be reduced.

  Furthermore, in the above embodiment, in communication between the server 1 and the client terminal 3, by defining a command corresponding to the property in GUI component units and transmitting / receiving the property value of the GUI component, the server 1 and the client terminal The amount of data exchanged with 3 is reduced, and a GUI having a quick response can be realized even in a narrow-band environment, and the user can work efficiently.

  Further, in the communication between the server 1 and the client terminal 3, when the property value of the GUI component is changed by a user operation or the like, only the changed part is transmitted. Can be reduced.

  Furthermore, the client terminal 3 transmits a command corresponding to the user event for the GUI component to the server 1 only when the application 13 has a description of performing some processing triggered by the user event for a user operation on the GUI component. Therefore, the amount of data necessary for communication can be reduced by not transmitting user events for which processing is not described in the application 13.

  In the above embodiment, the command corresponding to the property is defined for each GUI component. However, the communication between the server 1 and the client terminal 3 is performed without performing such command definition, and the client as described above. The server 1 predicts in advance the user's next operation performed on the GUI displayed on the terminal 3, and based on this prediction, the GUI display on the client terminal 3 is performed, thereby providing a quick response. It goes without saying that the user can efficiently perform the work by realizing the GUI.

  FIG. 4 is a diagram showing a system configuration of an example embodying the above embodiment. In the present embodiment, the user operates the application 44 from anytime and anywhere using the mobile phone as the client terminal 41 with respect to the application 44 executed on the server 43 in the user's home 42. The client terminal 41 and the server 43 at home 42 are connected via the Internet 45 and a high-delay and narrow-band mobile communication network 46. Here, the server 43 has the same configuration as the server 1, and the client terminal 41 has the same configuration as the client terminal 3.

  In addition, the server 43 includes the above-described user event prediction function unit 12. While the user is connected to the server 43 using the client terminal 41, the user's next operation is predicted, and the prediction result is displayed. It is transmitted to the client terminal 41.

  Hereinafter, a specific operation example will be described.

  FIG. 5 is a diagram illustrating an example of a screen 51 displayed on the client terminal 3 in a certain scene. The screen 51 shown in the figure prompts the user to confirm whether or not to perform a certain operation.

  The screen 51 is displayed, and the user recognizes the meaning of the screen 51, judges his / her intention, and presses the OK button 52 or the cancel button 53, and predicts the next operation of the user on the server 1. . The user event prediction function unit 12 on the server 1 first lists up operations that can be executed by the user. In the case of the screen 51, there are two operations that the user can perform: pressing the OK button 52 or pressing the cancel button 53. Next, the user event prediction function unit 12 gives priority to these two operations. There are two methods of assigning priorities, such as a static method in which priorities are determined in advance as described above, and a dynamic method in which a history performed by a user in the past is referred to. Here, it is assumed that the probability of pressing the OK button 52 is predicted to be high.

  After sorting in descending order of priority, the user event prediction function unit 12 retrieves an operation of “pressing an OK button” that is a prediction with the highest priority from the prediction list, and the application 13 when the user executes the operation. Calculate the execution result of. Then, the execution result is transmitted to the client terminal 3.

  The client terminal 3 receives the execution result when the “press OK button” operation is executed from the server 1 and stores the prediction result in the prediction result storage unit 34 in the client terminal 3.

  If a user event has not yet occurred when the first prediction is completed, the user event prediction function unit 12 on the server 1 presses the “cancel button, which is the second highest priority prediction from the prediction list. The operation is taken out, and the execution result of the application 13 when the user executes the operation is calculated. Then, the execution result is transmitted to the client terminal 3.

  The client terminal 3 receives the execution result when the “press cancel button” operation is executed from the server 1, and stores the prediction result in the prediction result storage unit 34 in the client terminal 3.

  The user event prediction function unit 12 on the server 1 repeats the prediction until there is no prediction in the prediction list where the execution result is not calculated or the next user event occurs, and the execution result is sent to the client terminal 3. Send.

  The operation when the user selects the “press OK button” operation will be described below. When the user presses the OK button 52, the event management function unit 32 in the client terminal 3 detects this, and first refers to the prediction result stored in the prediction result storage unit 34 in the client terminal 3.

  If there is a prediction result for the operation of “pressing the OK button”, the event management function 32 extracts the prediction result, constructs a GUI for display by the user interface 33 based on the result, and displays the screen of the client terminal 3. To display. Since the display is performed using the prediction result stored in advance in the prediction result storage unit 34 in this way, no communication occurs until the screen is displayed from the user's operation, and the communication is promptly performed without being affected by the communication delay. Response can be realized.

  On the other hand, when there is no prediction result for the operation of “pressing the OK button” in the prediction result storage unit 34, the client terminal 3 transmits information to the server 1 that the user has performed the operation of “pressing the OK button”. In response to this, the server 1 executes the application 13 and transmits the execution result to the client terminal 3. The client terminal 3 receives the execution result from the server 1, builds a GUI for display by the user interface 33 based on the result, and displays the GUI on the screen of the client terminal 3.

  The above operation will be described in detail with reference to FIG.

  After the user performs a certain operation, the application 13 is executed on the server 1, and the execution result is transmitted to the client terminal 3 (S31). However, since the server 1 and the client terminal 3 are connected by the high-delay communication network 2, a large communication delay time 61 exists until the execution result reaches the client terminal 3. As soon as the client terminal 3 receives the execution result from the server 1, the user interface unit 33 constructs a GUI and displays it on the screen of the client terminal 3 (S32). From the point in time when the GUI constructed by the user interface unit 33 is displayed on the client terminal 3 until the user recognizes and determines this and performs some operation, that is, during the user's thinking time 62, The user event prediction function unit 12 predicts the next operation of the user (S33), and transmits the prediction result to the client terminal 3 (S34).

  In the client terminal 3, the prediction result transmitted from the server 1 is stored. If the user event has not yet occurred when the first prediction is completed, the second and subsequent predictions (S35) and the transmission of the prediction results (S36) are repeated.

  When the user actually performs an operation (S37), the client terminal 3 collates the operation performed by the user with the predicted operation (S38), and if they match, extracts the prediction result. The GUI is constructed by the user interface unit 33 and displayed on the screen of the client terminal 3 (S39).

  For this reason, if the predictions match, the server 1 and the client terminal 3 do not perform any operation between the user's operation and the GUI constructed by the user interface unit 33 being displayed. Communication is not performed, so that a quick response is possible without being affected by communication delay. Therefore, even in an environment where communication is performed between the server 1 and the client terminal 3 using the communication network 2 having a high delay and a narrow bandwidth, the user can efficiently use the user interface unit 33 from the client terminal 3. Work can be done.

It is a block diagram which shows the structure of one Example of the client server system of this invention. In the client server system of this invention, it is a flowchart figure showing one Embodiment of prediction on a server. It is a flowchart figure showing one Embodiment on a client terminal in the client server system of this invention. It is a figure which is remote control of the server at home from a mobile telephone which is one Example of the client server system of this invention. It is an example of the screen in the client server system of this invention. It is a figure which shows the effect of the prediction function of the client server system of this invention.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Server, 2 ... High delay and narrow-band communication network, 3 ... Client terminal, 11 ... Command analysis part, 12 ... User event prediction function part, 13 ... Application, 31 ... Command analysis part, 32 ... Event management function part , 33 ... User interface, 34 ... Prediction result storage unit, 41 ... Client terminal, 42 ... Home, 43 ... Server, 44 ... Application, 45 ... Internet, 46 ... Mobile communication network, 51 ... Confirmation screen, 52 ... OK button 53 ... Cancel button, 61 ... Communication delay time, 62 ... User thinking time, 63 ... User experience time.

Claims (11)

The server that executes the application and transmits the graphic user interface (GUI) information of the application communicates with the server, receives the GUI information, displays the GUI based on the information, and displays the GUI In a client server system including a client terminal that transmits information based on a user operation to a GUI to the server,
The server
A predicting means for predicting an operation performed by the user on the GUI displayed on the client terminal;
Means for transmitting information of at least one GUI changed based on the predicted user operation to the client terminal,
The client terminal is
Means for receiving and storing GUI information changed based on the prediction from the server;
Means for inputting a user operation for the displayed GUI;
And a means for displaying a GUI based on the stored GUI information when GUI information changed based on the prediction corresponding to the input user operation is stored. Client server system. The predicting means is a means for predetermining a priority order for each of the operations that can be executed by the user and predicting the user's operation, or by accumulating a history of operations performed by the user in the past. The client server system according to claim 1, further comprising at least one of means for predicting a user operation. The server
Means for converting the attribute of the GUI component into a command defined in component units;
Means for transmitting a command corresponding to the attribute to the client terminal;
Means for executing the application program based on an attribute corresponding to a command received from the client terminal;
The client terminal is
Means for converting the attribute of the GUI component into a command defined for each component;
Means for displaying a GUI based on an attribute corresponding to a command received from the server;
The client server system according to claim 1, further comprising: a unit that transmits a command corresponding to the attribute of the GUI component changed by a user operation to the server. The client server system according to claim 3, wherein the server includes means for transmitting only a command corresponding to the changed attribute of the GUI component to the client terminal. The client terminal transmits a command corresponding to the attribute to the server only when the application program on the server performs a description to perform some processing using the attribute of the GUI component changed by the user's operation as a trigger. 5. The client server system according to claim 3, further comprising: means. The server that executes the application and transmits the graphic user interface (GUI) information of the application communicates with the server, receives the GUI information, displays the GUI based on the information, and displays the GUI A client server system GUI display method including a client terminal that transmits a response based on a user operation to a GUI to the server,
The server predicts an operation performed by the user on the GUI displayed on the client terminal, and transmits information on at least one GUI changed based on the predicted user operation to the client terminal,
The client terminal receives and stores GUI information changed based on the prediction from the server, and has been changed based on the prediction corresponding to an operation performed by the user on the displayed GUI. A GUI display method for a client server system, characterized in that, when GUI information is stored, a GUI based on the stored GUI information is displayed. The server predetermines priorities for each of the operations that the user can perform on the GUI displayed on the client terminal, and predicts user operations according to the priorities. A GUI display method for a client server system according to claim 6. The client server system according to claim 6, wherein the server accumulates history information of operations performed by the user in the past, and predicts user operations based on the accumulated history information. GUI display method. Each of the server and the client terminal stores a command defined in association with an attribute on a GUI component basis,
The server converts the attribute of the GUI component into a command defined in units of components, transmits a command corresponding to the attribute to the client terminal, and converts the attribute to a command received from the client terminal. Based on the application program,
The client terminal converts the attribute of the GUI component into a command defined in each component unit, transmits a command corresponding to the attribute of the GUI component changed by a user operation to the server, and from the server The GUI display method of the client server system according to claim 6, wherein the GUI is displayed based on an attribute corresponding to the received command. The GUI display method of a client server system according to claim 9, wherein the server transmits only a command corresponding to a changed attribute in a changed GUI component to the client terminal. The client terminal transmits the operation information to the server only when the application program on the server describes a process to be performed with the operation as a trigger in response to a user operation on the GUI component. The GUI display method of the client server system according to claim 9 or 10, wherein the GUI is displayed.

Images