JP2016170588A - Terminal combined display system and terminal combined display program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a system including a mechanism contributing to improvement in a user's operability by changing displays according connection positions and directions of terminals in a technique of displaying a content by connecting a plurality of portable communication terminals.SOLUTION: A management server of a terminal-connected display system according to the present invention, acquires connection information including connection positions and connection directions of the portable communication terminals, and generates an instruction of moving a display object on a display in a direction of not being connected (an unconnected direction). Then, the management server determines a terminal that is connected upside down out of the portable communication terminals, and generates an instruction, to the terminal, to turn the display object upside down and display it. The management server causes the currently-connected portable communication terminals to perform the generated display change instructions so as to change the display according to the connection positions and directions of the terminals. This configuration can implement the terminal-connected display in a form operable by the user.SELECTED DRAWING: Figure 10

Description

  The present invention relates to a technique for displaying content on a display portion of a portable communication terminal, and in particular, displays a content by using each of the display portions as one large display device by combining (combining) a plurality of portable communication terminals side by side. Related to technology.

  In general, portable communication terminals such as tablet computers are increasingly used in daily life at home. In recent years, the use of tablet computers has also increased in scenes such as school education and company training. However, when one tablet computer is used by a plurality of people, there is a problem that the display portion is small. For example, in a school lesson, especially in group learning, the display is small in a situation where one tablet-type communication terminal is used for each group, and multiple people collaborately operate content displayed on the display. The problem occurs.

  Also, in the field of school education, by letting learners carry out a collaborative activity called group learning, through that activity, "sharing awareness", "invigorating discussions", " It is required to bring out the effect of learning "interaction". Furthermore, in order to create natural cooperation, it is necessary for each learner to smoothly proceed with a series of flows that bring information, interact, and discuss. Here, in a group study at school, assuming a situation where one tablet-type communication terminal is operated cooperatively in one group, a plurality of learners surround the tablet-type communication terminal from four sides and discuss each other. You can imagine that you would operate your tablet communication terminal with your finger out. In this case, for learners located in a place where they look into the display from the opposite side of the tablet-type communication terminal, the operation is upside down, so the operability is poor, and exchange and discussion The problem that it is not possible to proceed smoothly.

  As means for solving the above problem, in the field of mobile terminals, a split screen obtained by dividing the original screen is displayed on the display of each of the plurality of mobile terminals, and the original screen is displayed in a large size by connecting the split screens. There is a technology. In this technique, means is used in which a combination position of each portable terminal is determined in advance by communication using a non-contact IC attached to the portable terminal, and a divided screen corresponding to the determined combination position is distributed. . As a result, the user of the mobile terminal can view the original screen in a large size. (See Patent Document 1)

  In the field of smartphones and tablet-type communication terminals, multi-displays can be operated easily and without special special hardware by lightly colliding adjacent terminals and performing predetermined connection operations such as touch operations. There is a technology that can be realized. Thereby, since the combination setting of a terminal becomes possible also by the learner himself (for example, an elementary school student), collaborative learning can be advanced more smoothly. (See Patent Document 2)

  In the field of tablet communication terminals, a plurality of tablet communication terminals are combined (combined) and handled as one sheet, and users of each tablet communication terminal cooperate with the sheet. There is a technology that can be edited. In this technology, each tablet communication terminal sets its own combination position in advance with respect to a management server connected to a wireless LAN, so that an image corresponding to the set position is distributed from the management server. Is used. As a result, the editing operation at each terminal is integrated and managed by the management server and distributed to each terminal, so that the user performs collaborative work as if he / she is browsing / editing one large sheet. be able to. (See Non-Patent Document 1)

JP 2009-94775 A JP 2012-133068 A

Eiyuki Suzuki, Hideo Funyu, Yoshihiko Kubota, “Support for Collective Collaborative Learning Using Tablet Devices-XingBoard: Concept and Prototype of Crossing Board”, IEICE Tech. 113, no. 166, The Institute of Electronics, Information and Communication Engineers, July 2013, p. 41-p. 46

  If the technique of patent document 1 is used, the content shown on the display can be displayed in a large size. However, it is necessary to prepare a mobile terminal (or tablet communication terminal) having a special hardware configuration including a plurality of non-contact ICs in the vertical and horizontal directions. For this reason, there is a problem of lack of versatility. For example, in an environment where many workers, such as schools and companies, are expected to work with a large number of tablet communication terminals, a large number of special terminals equipped with a plurality of non-contact ICs are used as described above. It is often difficult to prepare. In the case of such an environment such as a school or a company, it can be said that the technique of Patent Document 1 having poor versatility is not suitable.

  When the technique of Patent Document 2 is used, it is not necessary to prepare a portable terminal (or tablet communication terminal) having a special hardware configuration that has been a problem in Patent Document 1. However, there is a problem when multiple learners bring their respective tablet-type communication terminals together and simultaneously edit the content displayed on the multi-display that combines them (improves operability when operating upside down) Is not mentioned at all.

  Using the technique of Non-Patent Document 1, the content can be displayed in a large size, and the collaborative work can be performed as if one large sheet is being edited. However, for a plurality of combined tablet terminals (in Non-Patent Document 1, four terminals are combined), the system assumes a case where the learner operates by looking at the screen from one direction. For this reason, when a learner located in a place looking into the display from the opposite side operates in an upside down state, a mechanism for further improving operability is required.

  An object of the present invention is to solve the above-mentioned problems of the prior art. Specifically, by arranging (combining) a plurality of portable communication terminals side by side, each display portion is positioned on the opposite side of the terminal orientation in the technology for displaying content as one large display device. It is an object to provide a user with a mechanism that contributes to improving operability.

  In order to solve the above problems, the combined display system of the present invention is configured in a form in which a plurality of portable communication terminals and a management server are connected via a communication network. A combined information acquisition unit that acquires combined information including terminal identification information, combined position information, and combined direction information indicating the direction of the combined side surface in the portable communication terminal, a combined information storage unit that stores the combined information, and combined information Based on the unbound direction determination unit that determines the side surface in the direction that is not coupled in the portable communication terminal, and the display change that moves the display object displayed on the display of the portable communication terminal in the determined unbound direction Based on the movement instruction generation unit that generates the instruction and the combination information, the reverse display target judgment that determines the terminal that requires the reverse display among the portable communication terminals as the reverse display target terminal. A reverse instruction generation unit for generating a display change instruction for reverse display of the display object displayed on the display of the reverse display target terminal, and a display for transmitting the movement instruction and the reverse instruction to the portable communication terminal. And a change instruction unit.

  By adopting the configuration of the present invention, a display object provided for user operation such as a tool bar or an icon is provided in a place where a plurality of terminals are combined so as not to interfere with contents displayed across the displays of each terminal. It can be moved and displayed. Furthermore, in consideration of the operability of the user located on the opposite side to the direction of the portable communication terminal, the display object for user operation such as a toolbar or icon is automatically displayed upside down in a predetermined case. can do. As a result, it is possible to provide a system having a mechanism that contributes to improving operability for users operating from any position.

  The portable communication terminal in the terminal combination display system of the present invention includes the terminal identification information of the portable communication terminal, the combination position information indicating the relative positional relationship with other portable communication terminals, and the direction of the combination side surface. A combination information generation unit that generates combination information including the combination direction information to be transmitted and transmits the combination information to the management server, and a movement display execution unit that changes a display position of a display object to be displayed on the display according to the movement instruction received from the management server; In accordance with the reverse instruction received from the management server, a reverse display execution unit that reverses and displays the display object to be displayed on the display may be provided.

  By adopting the configuration of the present invention, no special setting is required, and the display position change of the display object and the reverse display of the display object are automatically executed in accordance with an instruction from the server. Accordingly, it is possible to provide a system in which a mechanism that contributes to improvement in operability is automatically executed without changing settings on the portable communication terminal.

  The management server according to the present invention further includes an operation information acquisition unit for acquiring operation information including operation information indicating execution of an operation on the coupled portable communication terminal and terminal identification information of the portable communication terminal; Based on the information, a non-operation target determination unit for determining a non-operated terminal among the coupled portable communication terminals as a non-operation target, and an erasure instruction for erasing a display object displayed on the non-operation target display An erasure instruction generation unit, wherein the display change instruction unit transmits an erasure instruction to the portable communication terminal, and the portable communication terminal according to the present invention further includes the portable communication terminal. Terminal identification information that uniquely identifies the operation information, operation information indicating the operation performed on itself, an operation information generation unit that transmits the operation information to the management server, and an erasure received from the management server Follow the instructions, it may be configured that includes a display object erasure execution unit for erasing the display object to be displayed on the display, the.

  By adopting the configuration of the present invention, among the connected portable communication terminals, a terminal that is not operated by the user does not display a display object for user operation such as a toolbar or an icon. As a result, the overall visibility due to the disappearance of unnecessary display objects is improved, and as a result, the operability by the user is further improved.

  Note that the above-described features can be realized by causing the terminal of the present invention to read and execute the program. That is, based on the combined information, the portable information is acquired based on the combined information acquisition function for acquiring the combined information including the terminal identification information, the combined position information, and the combined direction information indicating the direction of the combined side in the combined portable communication terminal. A movement for generating a display change instruction for moving the display object displayed on the display of the portable communication terminal in the determined unbonded direction, and a function for determining the unbonded direction in the communication terminal to determine the side surface in the unbonded direction Displayed on the display of the reverse display target terminal and the reverse display target determination function for determining the terminal that requires the upside down display target among the portable communication terminals based on the instruction generation function and the combination information, and the reverse display target terminal A reverse instruction generation function for generating a display change instruction for displaying the displayed object in reverse, and a movement instruction and the reverse instruction are transmitted to the portable communication terminal. A display change instruction function that may constitute the present invention a program for realizing the management server, as.

  These terminal combination display programs also have the same effects as the above-described terminal combination display system.

  The “portable communication terminal” in the present invention is a portable communication terminal, and is assumed to be a touch panel type communication terminal that can be operated by a user touching the display with his / her finger. Communication terminals generally called “tablet type communication terminals” or “smartphones” are considered as examples.

  The “display” in the present invention is a display device of a portable communication terminal, and particularly a touch panel type display device that can be operated by a user touching it. Hereinafter, for convenience of description, a device having both a display device and an input device in a portable communication terminal will be referred to as a “display”.

  “Coupling” in the present invention refers to combining (pairing) two or more portable communication terminals. Specifically, it means that two or more portable communication terminals are arranged, and each portable communication terminal operates as if it is a single terminal by communication cooperation.

  The “combined display” in the present invention refers to displaying one display object (content) in such a manner as to straddle on the display of two or more portable communication terminals that are combined. Specifically, it is conceivable as an example that one photograph is displayed in a large size by using the screens of two or more tablet communication terminals as if they were one large screen.

  “Combined position” in the present invention refers to information indicating a relative positional relationship of one portable communication terminal relative to another portable communication terminal being coupled. Say. Specifically, for example, when two portable communication terminals are combined, “upper” and “lower”, and when four portable communication terminals are combined, “upper left”, “lower left”, Information indicating relative positional relationship such as “upper right” and “lower right”.

  The “coupling direction” in the present invention refers to a direction indicating which side a portable communication terminal can connect to another portable communication terminal. More specifically, a tablet-type communication terminal (rectangle) has four sides, top, bottom, left, and right. Among them, it refers to a side surface including “sides” in contact with other tablet-type communication terminals. . It should be noted that how to determine the upper, lower, left and right is determined by an arbitrary method. For example, by determining the direction in which the button (home button) in the tablet terminal is located as the bottom, the remaining three directions are determined. In addition, the side where the logo is located may be determined as the top, or the user may determine the top, bottom, left, and right of the terminal in advance.

  The “display object” in the present invention refers to a graphic user interface (including icons and toolbars) touched by the user when operating the portable communication terminal, a pop-up display for notifying the user, and displayed on the display. The character information is not limited to this. In particular, this means content excluding content displayed on a display when combined display is performed on a portable communication terminal.

  The “movement instruction” in the present invention is transmitted from the management server to the portable communication terminal in order to move the display object displayed on the display of the portable communication terminal in the determined uncoupled direction. An instruction (command).

  “Moving display” in the present invention refers to a display change in which a display object displayed on the display of the portable communication terminal is moved in the uncoupled direction. As a result, the display object can be moved out of the content display range or moved toward the end of the content. That is, the display location of the display object can be changed so as not to impair the visibility of the combined display contents.

  The “reverse rotation instruction” in the present invention refers to an instruction (from the management server to the portable communication terminal) for displaying the display object displayed on the display of the portable communication terminal upside down. Command).

  The “reversed display” in the present invention means that the display object displayed on the display of the portable communication terminal is displayed upside down. In particular, when the user looks at the display of the portable communication terminal upside down, it means displaying in a format that is easy to visually recognize. Thereby, the visibility with respect to a user's display thing improves, and it becomes easier to perform operation with respect to a content.

  The “erase instruction” in the present invention is an instruction (command) transmitted from the management server to the portable communication terminal in order to erase the display object displayed on the display of the portable communication terminal. Say. As a result, in the coupled portable communication terminal, it is possible to erase the display object displayed on the display of the portable communication terminal that has not been operated. That is, there is an effect that the visibility of content is further improved by deleting unnecessary display objects.

  The “display change instruction” according to the present invention is an instruction (command) transmitted from the management server to the portable communication terminal being combined, and is an instruction to change the display format of the display object displayed on the display. Say. In the present invention, in particular, a moving instruction, a reverse instruction, or an erasing instruction is included, but not limited thereto.

  The “terminal identification information” in the present invention refers to information for uniquely identifying and specifying a portable communication terminal. Specifically, a MAC address, a terminal serial number, etc. can be considered as an example.

  According to the present invention configured as described above, when a plurality of portable communication terminals are combined, operability is improved for a user who operates the terminal regardless of the direction of the combined portable communication terminals. It is possible to provide a system with a mechanism that contributes to

The conceptual diagram which shows an example of the system configuration | structure of this invention. The conceptual diagram which shows an example of the hardware constitutions of the management server A in this invention. The conceptual diagram which shows an example of the hardware constitutions of the terminal B in this invention. 1 is a functional block diagram illustrating an example of a system configuration in Embodiment 1. FIG. 5 is a flowchart illustrating an example of a processing process (joining information storage) in the first embodiment. 5 is a flowchart illustrating an example of a processing process (display change instruction) in the first embodiment. 5 is a flowchart illustrating an example of a processing process (display change) in the first embodiment. The portable communication terminal after a coupling | bonding and the image figure of the user who operates it. The figure which shows an example of the joint information memorize | stored in the joint information storage part. FIG. 3 is an image diagram of execution of movement display in the first embodiment. FIG. 9 is a diagram illustrating an example of moving display execution according to the first embodiment. FIG. 6 is an image diagram of reverse display execution in the first embodiment. FIG. 6 is a diagram illustrating an example of reverse display execution in the first embodiment. FIG. 9 is a functional block diagram illustrating an example of a system configuration according to a second embodiment. 9 is a flowchart illustrating an example of a processing process (operation information storage) in the second embodiment. 10 is a flowchart illustrating an example of a processing process (erase instruction) in the second embodiment. 9 is a flowchart illustrating an example of a processing process (display change) in the second embodiment. The figure which shows an example of the operation information memorize | stored in the operation information storage part 22. FIG. 10 is an image diagram of execution of display object erasure in Embodiment 2.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. The present invention is implemented in a client-server format. FIG. 1 conceptually shows an example of the overall configuration of the combined display system of the present invention. In the embodiment, as shown in FIG. 1, a terminal management server A (hereinafter referred to as “management server A”) includes a plurality of portable communication terminals B (hereinafter referred to as “terminal B”) and a communication network N (hereinafter referred to as “terminal B”). It is configured to be connected via “network N”).

  FIG. 2 conceptually shows an example of the hardware configuration of the management server A.

  The management server A includes a processing device 1 such as a CPU having an arithmetic device 6 that executes arithmetic processing of a program and a control device 7 that outputs a control instruction to each device based on the arithmetic result, a RAM that stores information, It has at least a storage device 2 such as a hard disk, and a communication device 5 that transmits and receives processing results of the processing device 1 and information stored in the storage device 2 via a network such as the Internet or a LAN. Each function (each unit) executed by the management server A is realized by the processing device 1 reading a program for executing the process.

  The management server A may be configured to include an input device 3 such as a keyboard, mouse, or numeric keypad and a display device 4 such as a monitor (screen) as necessary. In addition, the management server A may have its functions distributed to a plurality of terminals or servers.

  Hereinafter, for convenience of explanation, the processing device 1 constituting the management server A is referred to as “server processing device 1a”, the storage device 2 as “server storage device 2a”, the input device 3 as “server input device 3a”, and the display device 4 as “ The server display device 4a ”and the communication device 5 are referred to as“ server communication device 5a ”.

  FIG. 3 conceptually shows an example of the hardware configuration of the terminal B.

  Similarly to the management server A, the terminal B includes a processing device 1, a storage device 2, and a communication device 5. Since the terminal B is assumed to be a tablet terminal or a smartphone in particular, the terminal B has a display 8 (touch panel type display device that can be operated by the user touching it).

  Hereinafter, for convenience of explanation, the processing device 1 configuring the terminal B will be referred to as “terminal processing device 1b”, the storage device 2 as “terminal storage device 2b”, and the communication device 5 as “terminal communication device 5b”.

  The network N is a network (LAN) that transmits and receives data using a cable, wireless communication, or the like. In the present invention, a wireless LAN system (WLAN) using wireless communication is particularly assumed.

Example 1 Configuration
Hereinafter, a first embodiment of the present invention will be described with reference to the drawings. FIG. 4 shows a functional block diagram of the management server A and terminal B constituting the terminal combined display system of the present invention. Each component and each means in the present invention are only logically distinguished in function, and may be physically or virtually the same area.

  FIG. 3 shows only the minimum equipment, components, means, and the like necessary for the present invention, and the description of the other devices, components, means, etc. is omitted.

  The management server A has a server control interface 10 for transmitting / receiving various information to / from the server input device 3a, the server display device 4a, or the server communication device 5a. Furthermore, the server communication device 5a has a function capable of transmitting and receiving various information to and from the terminal B via the network N.

  The server processing device 1a of the management server A includes a combined information acquisition unit 11 that acquires combined information output from the terminal B, and an unbonded direction determination unit that determines a combined side surface that is not combined with another terminal B based on the combined information. 12. Moving instruction generation unit 13 for generating an instruction to move the display object displayed on the display 8 of the terminal B in the uncombined direction, reverse display target determination for determining the terminal B that requires reverse display based on the combination information Unit 14, a reverse instruction generation unit 15 that generates an instruction to reversely display the display object displayed on the display 8 of terminal B, and a display change instruction unit 16 that transmits a movement instruction and a reverse instruction to terminal B. Yes.

  The server storage device 2 a of the management server A includes a combined information storage unit 21 that stores the combined information of the terminal B acquired by the combined information acquisition unit 11.

  The terminal B has a terminal control interface 30 for transmitting and receiving various information to and from the terminal processing device 1b, the display 8, or the terminal communication device 5b. Further, the terminal communication device 5b has a function capable of transmitting / receiving various information to / from the management server AC via the network N.

  The terminal processing device 1b of the terminal B displays a display on the display 8 according to the movement information received from the management server A and the combined information generating unit 31 that generates combined information including information on the side surface combined with the other terminal B. A moving display execution unit 32 that changes the position of an object, and a reverse display execution unit 33 that reverses and displays a display object to be displayed on the display 8 in accordance with the reverse instruction received from the management server A are provided.

  Hereinafter, based on the functional block diagram which comprises this invention described in FIG. 4, operation | movement of each structure part is demonstrated. First, the components of the management server A that constitute the terminal combined display system of the present invention will be described.

  The combination information acquisition unit 11 acquires the combination information from the terminal B that is executing the combination among the terminals B connected to the network N via the server communication device 5 a and the server control interface 10. Then, the acquired combined information is transmitted to the combined information storage unit 21. It is assumed that the acquired combination information includes at least terminal identification information of terminal B, combination position information, combination direction information, and combination group identification information. Note that the combined group identification information is not included in the combined information and is stored in the combined information storage unit 21 if the process is given when determining the terminal combination on the management server A side. It may be in the form of giving on the side.

  Regarding the above “combined position information”, specifically, “upper” and “lower” if two terminals B are combined, “upper left” if four terminals B are combined. Information indicating relative positional relationships such as “lower left”, “upper right”, and “lower right”. When two terminals B are combined, “1”, “2” from the top, and when four terminals B are combined, “1”, “2”, “3”, “ 4 ”may be determined in advance by associating the relative position with the number.

  As for the above “binding direction information”, specifically, if it is a tablet communication terminal (rectangle), it has four sides on the top, bottom, left and right, so information such as “up”, “down”, “left”, and “right” Is preferable. Note that, as described above, the upper, lower, left, and right determination methods are determined by an arbitrary method.

  The above “joined group identification information” is information indicating which terminal B and which terminal B are being joined, and means information that can identify a plurality of terminals (groups) in a joined relationship. . Specifically, “1”, “2”, and “3” may be identified by numbers, or “A”, “B”, and “C” may be identified by alphabetic characters. In the present embodiment, the combined group identification information is shown in English letters.

  It is preferable that the “binding information” is generated and transmitted to the management server A as soon as there is a change in the terminal coupling state. Regarding the state of terminal combination, specifically, the terminal B to be combined is added, and there is a change in the combination direction information, the terminal B to be combined is changed, or the connection relationship is canceled Cases can be considered.

  The combined information acquired by the combined information acquisition unit 11 is stored in the combined information storage unit 21. It is preferable that the storage format at that time is classified and stored for each group to which the terminal B is combined using the combined group identification information included in the combined information. Further, it is more preferable that the information is updated to the latest information as needed based on the date / time information included in the combined information.

  The unbonded direction determination unit 12 refers to the combined information storage unit 21 and determines a side surface (unbonded direction) that is not combined in the terminal B being combined. For example, if the combined side information of the terminal B is stored as “up” and “right” in the combined side information storage unit 21, the unbound direction of the terminal B is determined as “down” and “left”. .

  The movement instruction generating unit 13 displays display change instruction information transmitted to the terminal B in order to move the display object displayed on the display 8 of the terminal B in the unbonded direction determined by the unbonded direction determining unit 12. Generate. For example, if the unbound direction determination unit 12 determines that the unbound direction is “down” and “left”, it generates control instruction information for moving the display object to “down” or “left”. When a plurality of unbound directions are determined, it is preferable to specify a single unbound direction to be moved in accordance with a predetermined priority order determined in advance. Specifically, a method may be considered in which “up” is set as the highest priority direction, “down”, “right”, and “left” as the lowest priority direction. It is done.

  The reverse display target determination unit 14 refers to the combined information storage unit 21 and determines, in the terminal B being combined, the terminal B that requires reverse display as the reverse display target. Specifically, in the combined group stored in the combined information storage unit 21, “terminal B including“ up ”in the combined position and“ down ”in the combined direction” is reversed. In other words, the fact that the joint position is located at the top of the whole but includes “down” in the joint direction means that it can be judged that the terminal is joined upside down. The above determination conditions are used. In the present invention, it is assumed that two terminals or four terminals are combined. However, in the case of two-terminal combination, “terminal B in which the combination position is“ up ”and the combination direction is“ down ”” In the case of 4-terminal coupling, “terminal B whose coupling position is“ upper left ”or“ upper right ”and includes“ lower ”in the coupling direction” is determined as the coupling target. It will be.

  The reverse instruction generation unit 15 displays a display change instruction to be transmitted to the terminal B in order to reverse display the display object displayed on the display 8 of the terminal B that is the reverse display target determined by the reverse display target determination unit 14. Generate information.

  The display change instruction unit 16 sends display change instruction information including the movement instruction generated by the movement instruction generation unit 13 and the reverse rotation instruction generated by the reverse rotation instruction generation unit 15 to the server communication device 5a to a predetermined terminal B. Send through.

  Next, the component part of the terminal B which comprises the terminal coupling | bonding display system of this invention is demonstrated.

  The combined information generation unit 31 generates information related to the connection with the other terminal B as the combined information, and transmits it to the management server A via the terminal communication device 5b. The combined information includes terminal identification information that can uniquely identify itself, combined position information that indicates a relative positional relationship with another terminal B, and combined direction information that indicates the direction of the side surface that is combined. At least. The combined group identification information that can uniquely identify the group being combined may be included in the combined information or may be given on the server side.

  The movement instruction execution unit 32 executes a process of moving the display object on the display 8 in accordance with the movement instruction included in the display control instruction information received from the management server A. Specifically, control is performed to move a graphic user interface (including icons and toolbars) touched by the user, a pop-up display for notifying the user, and the like in the uncoupled direction.

  The reverse display execution unit 34 executes a process of displaying the display object on the display 8 in reverse according to the reverse instruction included in the display change instruction information received from the management server A. Specifically, control is performed to display a graphic user interface (including icons and toolbars) displayed on the display 8 and a popup display for notifying the user upside down.

  By executing the display control process at the time of terminal combination in the above-described format, when the terminal B is combined in the upside down direction, the user of the terminal B (Let's operate from the position upside down with respect to the reference terminal) For example, a display object provided for a user operation such as a tool bar or an icon is automatically displayed upside down, thereby improving the operability.

Example 1 Treatment Process
Next, an example of a processing process in the terminal combination display system of the present invention will be described with reference to the functional block diagram of FIG. 4 and the flowcharts of FIGS.

  First, processing related to the combined information storage will be described with reference to the flowchart of FIG.

  Terminal combination is executed in a plurality of terminals B (S101). There are various methods for terminal coupling, but the details are not mentioned in the present invention. In this embodiment, a case where four terminals B are combined will be described as an example. FIG. 8 shows an image when each user operates after terminal connection.

  Information relating to the connection with the other terminal B is generated as the connection information and transmitted to the management server A via the terminal communication device 5b (S102). The combination information includes terminal identification information, combination position information, combination direction information, and combination group identification information. In the present invention, it is assumed that combined group identification information is given at the stage where terminal combination is performed and stored in the terminal B. It is assumed that the combined group identification information is also included in the combined information and is transmitted to the management server A as combined information including the date information when the combined information is generated.

  The server communication device 5 a of the management server A receives the connection information output from the terminal B via the network N. Next, the combined information acquisition unit 11 acquires the combined information of the terminal B received by the server communication device 5a via the server control interface 10. Then, the acquired combination information is stored in the combination information storage unit 21 (S103).

  FIG. 9 shows an example of combined information stored in the combined information storage unit 21. As shown in this figure, the combination information acquired in the present embodiment includes “join group ID (identification information)”, “terminal ID (identification information)”, “user ID (identification information)”, “join position”, “ It is assumed that information on mainly five items of “binding direction” is acquired. Further, it is assumed that the information stored in the combined information storage unit 21 is updated each time the combined information acquisition unit 11 acquires new combined information.

  Next, processing related to a display change instruction will be described with reference to the flowchart of FIG.

  The unbonded direction determination unit 12 located in the management server A searches for the combined information stored in the combined information storage unit 21 (S111), and shows the direction of the terminal B that is not combined with other terminals. Is determined (S112). The determination of the unbonded direction in the present embodiment is assumed to be executed for a terminal whose combined group ID in FIG. 9 is “A”, and this case will be described below as an example.

  The processing of the unbonded direction determination unit 12 will be described in detail. In the case of the terminal ID “CLA001”, since the combined direction is “up” and “right”, the unbound direction is determined as “down” and “left”. The When the same determination process is executed for the terminal B belonging to the combined group ID “A”, the unbound directions of the terminal ID “CLA002” are “down” and “right”, and the unbound direction of the terminal ID “CLA003” is “down”. And “right” and the terminal ID “CLA004” are determined to be “unbound” and “left” as unbound directions.

  The movement instruction generation unit 13 first determines which terminal B is a terminal (movement display target) that needs to be moved and displayed (S113). In this embodiment, it is assumed that the graphic user interface (including icons and toolbars) touched by the user is displayed in the “up” direction of the display 8 by default. In this case, there is no need to change the display for the terminal B for which the unbound direction is determined to be “up” in the unbound direction determination unit 12. Therefore, it determines with it not being a movement display object. When this process is executed for the terminal B with the combined group ID “A”, the terminal IDs “CLA001”, “CLA002”, “CLA003”, and “CLA004” are determined to be moving display targets.

  Furthermore, the movement instruction generation unit 13 generates a movement instruction for the terminal B determined to be a movement display target (S114). When a plurality of unbound directions are determined, it is preferable to specify a single unbound direction to be moved in accordance with a predetermined priority order determined in advance. In the present invention, since it is standard to display a display object at “up”, “down” is the direction with the highest priority, “right” is next, and “left” is the direction with the lowest priority. It is assumed that it is predetermined. In the case where “CLA001”, “CLA002”, “CLA003” and “CLA004” are determined as moving display targets, for example, “down” is determined as the uncombined direction for all terminals. A movement instruction to move in the “down” direction of the display 8 is generated.

  Incidentally, when the processes of (S113) and (S114) are executed for the terminal having the combined group ID “B” in FIG. 9, the unbound directions of the terminal ID “CLA005” are “down” and “left”. The unbound direction of terminal ID “CLA006” is “down” and “right”, the unbound direction of terminal ID “CLA007” is “up” and “left”, and the unbound direction of terminal ID “CLA008” is “up”. And “right”. Further, in the present invention, since the initial setting is to display in the “up” direction of the display 8, there is no need to change the display for the terminal B for which the uncoupled direction is determined to be “up”. Therefore, in the case of the combined group ID “B”, the moving display targets are determined as the terminal IDs “CLA005” and “CLA006”.

  The reverse display target determination unit 14 determines which terminal B is the terminal B (reverse display target) that needs to be displayed in reverse (S115). As described above, the reverse display target is a terminal B that includes “upper” in the coupling position and a terminal B that includes “lower” in the coupling direction within the coupling group stored in the coupling information storage unit 21. If the combined group ID “B” in FIG. 9 is determined as a target, it can be understood that the terminal B including “up” in the combined position is two terminals “CLA007” and “CLA008”. Furthermore, since both “CLA007” and “CLA008” include “down” in the coupling direction, “CLA007” and “CLA008” are determined to be reverse display objects.

  Incidentally, when the process of (S115) is executed for the terminal whose combination group ID in FIG. 9 is “A”, “terminal B includes“ up ”in the combination position and“ down ”in the combination direction. Therefore, the reverse display target is determined as “none”.

  The reverse rotation instruction generation unit 15 generates a reverse rotation instruction for the terminal B determined to be the reverse display target (S116). The case where the reverse display target is determined as “CLA007” and “CLA008” according to the above processing will be described as an example. Graphic user interfaces (including icons and toolbars) displayed on the displays of both terminals, An instruction to display the pop-up display for notification and the character information displayed on the display upside down is generated.

  The display change instruction unit 16 sends display change instruction information including the movement instruction generated by the movement instruction generation unit 13 and the reverse rotation instruction generated by the reverse rotation instruction generation unit 16 to the terminal B via the server communication device 5a. (S117). In this case, the display change instruction information is associated with the information in which the terminal identification information of the terminal B that is the movement instruction target and the movement instruction are associated, and the terminal identification information of the terminal B that is the object of reversal and the reverse instruction. Information is included. In the case of the combined group ID “A” in FIG. 9, display change instruction information is generated in a form in which a movement instruction is associated with the terminal IDs “CLA001”, “CLA002”, “CLA003”, and “CLA004”. Further, in the case of the combined group ID “B” in FIG. 8, a movement instruction is associated with the terminal IDs “CLA005” and “CLA006”, and the reverse information for the terminal IDs “CLA007” and “CLA008”. Display change instruction information is generated in a form associated with. Then, the generated display change instruction information is transmitted to terminal B having each terminal ID.

  Next, processing related to display change will be described with reference to the flowchart of FIG.

  The mobile display execution unit 32 located in the terminal B receives the display change instruction information from the management server A via the terminal communication device 5b (S121). Further, it is determined whether or not a movement instruction is included in the received display change instruction information (S122). The processing inside the terminal IDs “CLA001”, “CLA002”, “CLA003”, and “CLA004” in FIG. 9 will be described as an example. The display change instruction information for each terminal includes a movement instruction as described above. The moving display execution process is performed.

  Next, the movement display execution part 33 performs the movement display of the display thing currently displayed on the display 8 according to a movement instruction | indication (S123). Taking the combined group ID “A” in FIG. 9 as an example, an image after execution of moving display is shown in FIG. Further, the moving display can be executed as shown in the image of FIG. 11 by changing the priority order of the display positions when the moving display is performed.

  The reverse display execution unit 33 determines whether or not a reverse instruction is included in the display change instruction information received from the management server A via the terminal communication device 5b (S124). The processing inside the terminal IDs “CLA007” and “CLA008” in FIG. 9 will be described as an example. Since the display change instruction information for the terminal IDs “CLA007” and “CLA008” includes the reverse rotation instruction as described above, the reverse rotation is performed. Display execution processing is performed. Since the display change instruction information for the terminal IDs “CLA005” and “CLA006” includes the movement instruction as described above, the movement display execution process is performed as described for the movement display execution unit 32 described above. It becomes.

  Next, the reverse rotation display execution part 33 performs reverse rotation display of the display thing currently displayed on the display 8 according to a reverse rotation instruction | indication (S125). Taking the terminal group ID “B” in FIG. 9 as an example, an image after execution of reverse display is shown in FIG. FIG. 13 shows an image of reverse display when the display object is a pop-up display.

Example 2 Configuration
The second embodiment of the present invention will be described below with reference to the drawings. In FIG. 14, the functional block diagram of the management server A and the terminal B which comprise the terminal coupling | bonding display system of this invention is shown. Each component and each means in the present invention are only logically distinguished in function, and may be physically or virtually the same area.

  FIG. 14 shows only the minimum equipment, components, means and the like necessary in the present invention, and the description of the other devices, components, means, etc. is omitted. In addition, the same code | symbol is attached | subjected to the same structural part etc. as [Example 1-configuration], and the detailed explanation is omitted when performing the same operation.

  The server processing device 1a in the management server A according to the present embodiment includes an operation information acquisition unit 17 that acquires information regarding the operation content executed on the terminal B, and a non-operation target determination unit that determines the terminal B on which no operation is performed. 18 and an erasure instruction generation unit 19 that generates an erasure instruction for erasing the display object from the display 8, and the server storage device 2 a includes an operation information storage unit 22 that stores operation information acquired from the terminal B. This is different from [Example 1-Configuration].

  The terminal processing device 1b in the terminal B of the present invention includes an operation information generation unit 34 that generates information regarding the contents of the executed operation, and a display object erasure execution that executes display object erasure processing according to display change instruction information received from the management server. It differs from [Example 1-Configuration] in that it includes a portion 35.

  Hereinafter, based on the functional block diagram which comprises this invention described in FIG. 14, operation | movement of each structure part is demonstrated. Detailed descriptions of the same components or operations as those in [Example 1-Configuration] are omitted.

  The operation information acquisition unit 17 acquires operation information of the terminal B connected to the network N via the server communication device 5 a and the server control interface 10. Then, the acquired operation information is transmitted to the operation information storage unit 21. The format of the operation information to be acquired may be in any format as long as the operation content executed by the user of the terminal B can be grasped.

  “Operation information” in the present invention refers to information generated when the user performs various operations on the terminal B. Specifically, the terminal identification information that uniquely identifies the terminal B, the operation target object information that indicates the target that executed the control process, the process content that indicates the content of the control process, and the user who executed the process are uniquely specified. A series of information including user identification information and date / time information indicating the date / time when the process is executed may be considered as an example.

  The operation information storage unit 22 stores the operation information acquired by the operation information acquisition unit 17. The storage format at that time is preferably a format in which the date and time information included in the operation information is used to store in time series.

  The non-operation target determination unit 18 refers to the operation information stored in the operation information storage unit 22 and determines the terminal B that has not been operated for a predetermined time as a non-operation target. Then, the terminal identification information of the determined terminal B is transmitted to the erasure instruction generation unit 19.

  The erasure instruction generation unit 19 transmits an erasure instruction to be transmitted to the terminal B in order to erase the display object displayed on the display 8 of the terminal B determined as the non-operation object determined by the non-operation object determination unit 18. Generate.

  The display change instruction unit 16 transmits display change instruction information including the deletion instruction generated by the deletion instruction generation unit 19 to the predetermined terminal B through the server communication device 5a.

  Next, the components of the terminal B constituting the terminal combined display system of the present invention will be described. Detailed descriptions of the same components or operations as those in [Example 1-Configuration] are omitted.

  The operation information generation unit 34 generates operation information based on an operation performed on the terminal B by the user, and transmits the operation information to the management server A via the terminal communication device 5b.

  The display object erasure executing unit 35 executes a process of erasing the display object on the display 8 in accordance with an erasure instruction included in the display control information received from the management server A.

  By setting it as the above-mentioned structure, the display thing currently displayed on the display 8 of the terminal B in which operation by a user is not performed more than predetermined time can be erase | eliminated automatically. As a result, only the display objects necessary for the user who is actually performing the operation remain, and the other display objects are erased. Therefore, the visibility of the content is improved, and the operability is improved.

Example 2 Treatment Process
Next, an example of a processing process in the terminal combined display system of the present invention will be described with reference to the functional block diagram of FIG. 14 and the flowcharts of FIGS.

  First, processing related to operation information storage will be described with reference to the flowchart of FIG.

  An operation by the user is executed at the terminal B (S201). There are various operations, but details are not mentioned in the present invention.

  It produces | generates as operation information regarding the operation performed with the terminal B, and transmits to the management server A via the terminal communication apparatus 5b (S202). The operation information includes at least terminal identification information, user identification information, date / time information, and processing content.

  The server communication device 5 a of the management server A receives the operation information output from the terminal B via the network N. Next, the operation information acquisition unit 17 acquires the connection information of the terminal B received by the server communication device 5a via the server control interface 10. Then, the acquired operation information is stored in the operation information storage unit 22 (S203).

  FIG. 18 shows an example of the combination information stored in the combination information storage unit 21. As shown in this figure, the operation information acquired in this embodiment includes “joined group ID (identification information)”, “terminal ID (identification information)”, “user ID (identification information)”, “joining position”, “ It is assumed that information on mainly five items of “binding direction” is acquired. Further, it is assumed that the information stored in the combined information storage unit 21 is updated each time the combined information acquisition unit 11 acquires new combined information.

  Next, processing related to the erasure instruction will be described with reference to the flowchart of FIG.

  The non-operation target determination unit 18 located in the management server A searches the operation information stored in the operation information storage unit 22 (S211), and determines that the terminal B that has not been operated for a predetermined time or more is a non-operation terminal ( S212). The determination of the non-operation target in the present embodiment is assumed to be executed for the terminal having the combined group ID “A” in FIG. 9, and this case will be described below as an example.

  The processing of the non-operation target determination unit 12 will be specifically described. In this embodiment, if there is no “10 minutes or more” operation information, it is determined as a non-operation target. In the case of FIG. 18, it can be seen that no operation information is output from the terminal B other than the terminal ID “CLA001” after “2015/1/17 13:05:01”. In this case, terminal IDs “CLA002”, “CLA003”, and “CLA004” are determined as non-operation targets. The terminal identification information of the terminal B determined as the non-operation target is transmitted to the erasure instruction generation unit 19 (S213).

  Next, the erasure instruction generation unit 19 generates an erasure instruction for the terminal B determined as a non-operation target (S214). The generation of the erasure instruction may be performed at a predetermined timing, or may be generated at any time when a predetermined time (in this embodiment, “10 minutes”) has elapsed. In the case of FIG. 18, an erasure instruction is generated in association with a terminal ID determined as a non-operation target (specifically, “CLA002”, “CLA003”, and “CLA004”) and transmitted to the display change instruction unit 16. The

  The display change instruction unit 16 displays display change instruction information including the deletion instruction generated by the deletion instruction generation unit 19 in addition to the movement instruction generated by the movement instruction generation unit 13 and the reverse rotation instruction generated by the reverse rotation instruction generation unit 16. Then, the data is transmitted to the terminal B via the server communication device 5a (S215).

  Next, processing related to display change will be described with reference to the flowchart of FIG. Note that the operations from (S221) to (S225) in the flowchart of FIG. 17 are the same as those in [Example 1-Processing Process], and thus the details thereof are omitted.

  The display object deletion execution unit 35 located in the terminal B receives the display change instruction information from the management server A via the terminal communication device 5b. Furthermore, it is determined whether the received display change instruction information includes an erasure instruction (S226). The processing inside the terminal IDs “CLA002”, “CLA003”, and “CLA004” in FIGS. 9 and 18 will be described as an example. Since the display change instruction information for each terminal includes an erasure instruction as described above, An object erasure execution process is performed.

  Next, the display object erasure executing unit 35 executes the movement display of the display object displayed on the display 8 according to the erasure instruction (S227). FIG. 19 shows an image after execution of display object erasing, taking the combined group ID “A” in FIGS. 9 and 18 as an example.

  By using the present invention configured as described above, it is possible to automatically move the display object so as to improve the visibility of the content displayed across the plurality of coupled portable communication terminals. Furthermore, when a user located so as to surround the portable communication terminal performs an operation on the portable communication terminal closest to each place, the display object is automatically displayed in a form facing the user. Can be displayed upside down. As a result, it is possible to provide a system having a mechanism that contributes to improving operability for a user positioned on the opposite side of the terminal.

A management server B terminal 1 processing device 2 storage device 3 input device 4 display device 5 communication device 6 arithmetic device 7 control device 8 display

A Management server B Terminal
N network 1 processor
1a Server processing device
1b Terminal processing device 2 Storage device
2a Server storage device 3 Input device
3a Server input device 4 Display device
4a Server display device 5 Communication device
5a Server communication device
5b Terminal communication device 6 Arithmetic device 7 Control device 8 Display
10 Server control interface
11 Combined information acquisition unit
12 Unbonded direction determination part
13 Movement instruction generation unit
14 Reverse display target determination unit
15 Reverse rotation instruction generator
16 Display change instruction section
17 Operation information acquisition unit
18 Non-operation target determination unit
19 Erase instruction generator
21 Combined information storage unit
30 Terminal control interface
31 Combined information generation part
32 Movement display execution part
33 Reverse display execution section
34 Operation information generator
35 Display Object Erase Execution Unit

Claims (4)

A plurality of portable communication terminals and a management server are connected via a communication network,
By combining the multiple portable communication terminals,
A terminal combined display system used as one display device,
The management server
A combined information acquisition unit for acquiring combined information including terminal identification information in the portable communication terminal being combined, combined position information, and combined direction information indicating the direction of the combined side surface;
A combined information storage unit for storing the combined information;
Based on the binding information, an unbound direction determination unit that determines a side surface in a direction that is not combined in the portable communication terminal;
A movement instruction generation unit that generates a display change instruction for moving a display object displayed on the display of the portable communication terminal in the determined unbonded direction;
Based on the combination information, a reverse display target determination unit that determines a terminal that requires upside down display among the portable communication terminals as a reverse display target terminal;
A reverse instruction generating unit for generating a display change instruction for displaying the display object displayed on the display of the reverse display target terminal in reverse;
A terminal combination display system comprising: a display change instruction unit that transmits the movement instruction and the reverse rotation instruction to the portable communication terminal. The portable communication terminal in the terminal combined display system is
Generating binding information including terminal identification information of the portable communication terminal, binding position information indicating a relative positional relationship with another portable communication terminal, and binding direction information indicating a direction of a binding side surface; A combined information generation unit to be transmitted to the management server;
In accordance with the movement instruction received from the management server, a movement display execution unit that changes the display position of the display object to be displayed on the display;
The terminal combination display system according to claim 1, further comprising a reverse display execution unit that reverses and displays the display object to be displayed on the display in accordance with the reverse instruction received from the management server. The management server further includes:
An operation information acquisition unit for acquiring operation information including operation information indicating execution of an operation on the portable communication terminal being combined, and terminal identification information of the portable communication terminal;
Based on the operation information, a non-operation target determination unit that determines a non-operated terminal as a non-operation target among the coupled portable communication terminals;
An erasure instruction generation unit for generating an erasure instruction for erasing the display object displayed on the non-operation target display,
The display change instruction unit transmits the erasure instruction to the portable communication terminal,
The portable communication terminal further includes:
Terminal identification information that uniquely identifies the portable communication terminal, operation information indicating operation contents executed on itself, and an operation information generation unit that transmits the operation information to the management server;
The terminal combination display system according to claim 1, further comprising: a display object erasure execution unit that erases the display object displayed on the display in accordance with the erasure instruction received from the management server. . A plurality of portable communication terminals to be combined;
A management server including a combined information storage unit that stores information related to the portable communication terminal being combined is connected via a communication network,
A program used in a terminal combined display system that uses the plurality of portable communication terminals as a single display device,
In the management server,
A combined information acquisition function for acquiring combined information including terminal identification information in the portable communication terminal being combined, combined position information, and combined direction information indicating the direction of the combined side surface;
Based on the combination information, an unbound direction determination function for determining a side surface in a direction that is not combined in the portable communication terminal;
A movement instruction generating function for generating a display change instruction for moving a display object displayed on the display of the portable communication terminal in the determined uncoupled direction;
Based on the combination information, a reverse display target determination function for determining a terminal that requires upside down display among the portable communication terminals as a reverse display target terminal,
A reverse instruction generation function for generating a display change instruction to reversely display a display object displayed on the display of the reverse display target terminal;
A terminal combination display program for executing a display change instruction function for transmitting the movement instruction and the reverse rotation instruction to the portable communication terminal.