JP2008058575A - MULTI-DISPLAY SYSTEM, IMAGE INFORMATION OUTPUT DEVICE FOR MULTI-DISPLAY SYSTEM, IMAGE INFORMATION PROCESSING DEVICE FOR MULTI-DISPLAY SYSTEM, PROGRAM, AND RECORDING MEDIUM - Google Patents

Abstract

To provide a multi-display system capable of suppressing delay of image display even for contents whose images can be updated irregularly.
A multi-display system includes a server PC, a plurality of client PCs, and a plurality of image display devices. The server PC generates application operation information based on the acquired user operation information and transmits it to each client PC. In each client PC, based on the received operation information, the application operation unit operates an application similar to the application being executed on the server PC. Then, each client PC generates a partial image corresponding to the position of the projector of the image generated based on the operation result, and transmits this partial image to the connected projector.
[Selection] Figure 8

Description

  The present invention relates to a multi-display system, an image information output device for a multi-display system, an image information processing device for a multi-display system, a program, and a recording medium.

  In recent years, a server for distributing content, a plurality of projectors assigned projection positions on a screen, and a PC (Personal Computer) provided for each projector and performing image processing of content distributed from the server are provided. A multi-display system that constitutes one large screen by projection of each projector has been proposed (see, for example, Patent Document 1).

  In the multi-display system described in Patent Document 1, the server distributes each frame of the content image and the synchronization signal, and the PC that receives them decodes and decodes the projection position of each projector assigned on the screen. The video corresponding to is configured. When the PC detects that the synchronization signal has been sent from the server, the PC actually updates the content image and displays it on the projector. For this reason, it is possible to synchronize with high accuracy for content such as moving images that the server periodically distributes update timing, and to perform projection at high resolution utilizing the characteristics of a plurality of projectors. .

JP-A-2005-244931

  However, in the multi-display system described in Patent Document 1, for a content that is updated irregularly by a user operation, such as a presentation material, the updated image frame is recognized by the user operation. After that, there is a possibility that a delay occurs between the user operation and the display on the screen is updated, and the usability may be lowered.

  An object of the present invention is to provide a multi-display system, an image information output device for a multi-display system, an image information processing device for a multi-display system, and a program capable of suppressing delay in image display even for content whose images can be updated irregularly. And providing a recording medium.

The multi-display system of the present invention is connected to an image information output apparatus that outputs image information, and the image information output apparatus and the image information transmission means, and processes image information output from the image information output apparatus. A multi-display system comprising a plurality of image information processing devices and a plurality of image display devices connected to each image information processing device and forming an image based on a processing result of image information. Displays a partial image of the display image based on the image information output from the image information output device, and arranges the partial images in parallel to form one display image. The image information output device An operation information acquisition unit that acquires user operation information input during execution of the application on the output device, and the application based on the acquired user operation information. A motion information generating unit that generates the motion information of the application and a motion information transmitting unit that transmits the generated motion information to each image information processing device, and each image information processing device is transmitted from the image information output device. Based on the operation information received by the operation information receiving unit, the application execution processing unit for executing the same application as the application being executed on the image information output device, and the operation information received by the operation information receiving unit An application operation unit that causes the application execution processing unit to operate the application, and a partial image that generates a partial image corresponding to the position of the connected image display device of the image generated based on the operation result of the application operation unit Generation unit and partial image transmission for transmitting generated partial image to connected image display device Characterized in that it comprises and.

According to the present invention as described above, each image information processing device is similar to the one being executed on the image information output device by the application execution processing unit based on the operation information of the application transmitted from the image information output device. Based on the operation information from the image information output device, the application running on each image information processing device also operates to synchronize with the image information output device.
Then, the image information processing apparatus can generate a partial image corresponding to the position of the image display device by dividing and generating an image based on the operation result of the application by the partial image generation unit.
Therefore, the image information output device side only generates a very small amount of information called operation information to each image information processing device, and the image information output device side generates an execution result of the operation on the image information output device side as a partial image. Since a large screen can be displayed, a result being executed by the image information output device can be displayed with high responsiveness on a large screen composed of a plurality of image display devices.

  In the multi-display system of the present invention, it is preferable that the image information output device and each image information processing device include a database having a table structure in which the user operation information and the operation information are associated with each other.

According to the present invention, since the image information output device and each image information processing device include the database having the table structure in which the user operation information and the operation information are associated, the image information output device and each image information processing device. The same recognition of the operation information can be obtained between devices. As a result, the same result can be easily and reliably obtained between the image information processing apparatuses with respect to the operation of the application, so that the calculation load during image display can be reduced.
In addition, since a common table is provided between the image information output apparatus and each image information processing apparatus, a series of operation information can be transmitted as a common short code. The communication burden between them can be greatly reduced.

  The multi-display system of the present invention includes an operation information necessity determination unit that determines whether operation information is necessary in each image information processing apparatus based on the user operation information, and the operation information transmission unit includes the operation information generation It is preferable that the motion information generated by the unit is transmitted to each image information processing device based on the determination result of the motion information necessity determination unit.

  According to the present invention, since it is determined whether or not the operation information in each image information processing apparatus is necessary for user operation information, it is possible to prevent transmission of operation information not related to application processing to the image information processing apparatus. . For this reason, the communication load between the image information output apparatus and the image information processing apparatus can be reduced, and the delay of image display accompanying the increase in the communication load can be suppressed.

The present invention relates to an image information output device for a multi-display system as a sub-combination constituting the above-described multi-display system, an image information processing device for a multi-display system, and a program and a recording medium executed on the image information output device It can also be configured as a program and a recording medium executed on the image information processing apparatus.

  Specifically, the image information output device for a multi-display system is connected to a plurality of image information processing devices each connected to an image display device via an image information transmission means, and the image information is output to each image information processing device. An image information output device for a multi-display system that outputs and displays an image on an image display device connected to each image information processing device, wherein each image display device outputs image information output from the image information output device. A partial image of the display image based on the image information is displayed, and each partial image is arranged in parallel to form one display image. The image information output device is operated by a user operation input during execution of the application on the image information output device. An operation information acquisition unit for acquiring information, an operation information generation unit for generating operation information of the application based on the acquired user operation information, The made the operation information, characterized by comprising an operation information transmitting unit that transmits to the image information processing apparatus.

  An image information processing apparatus for a multi-display system is an image information processing apparatus for a multi-display system that is connected to an image information output apparatus that outputs image information via an image information transmission means and to which an image display apparatus is connected. An operation information receiving unit for receiving operation information transmitted from the image information output device, an application execution processing unit for executing an application similar to an application being executed on the image information output device, and the operation information receiving unit And an application operation unit that causes the application execution processing unit to operate the application based on the operation information received at the position of the image display device connected to the image generated based on the operation result of the application operation unit. A partial image generation unit that generates a corresponding partial image, and A partial image, characterized in that it comprises a partial image transmitting unit that transmits to the image display device connected.

  When configured as a program and a recording medium executed on the image information output device and as a program and a recording medium executed on the image information processing device, for example, a general-purpose PC is used as the above-described multi-display system of the present invention. It is possible to provide an image information output device and an image information processing device suitable for the above.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
[Configuration of multi-display system]
FIG. 1 is a schematic diagram showing the configuration of the multi-display system 1.
As shown in FIG. 1, a multi-display system 1 includes a server PC 2 as an image information output device, a client PC 3 as an image information processing device, a projector 4 as an image display device, and a LAN (image information transmission means). A Local Area Network (USB) cable 5 and a USB (Universal Serial Bus) cable 6 are provided.
For convenience of explanation, the PCs 2 and 3 are referred to as the server PC 2 and the client PC 3, respectively. However, for example, the server PC 2 may not necessarily be commercially available as a server.

The server PC 2 is a PC operated by a user in a presentation or the like, and performs an execution process of an application program (hereinafter referred to as an application) based on user operation information. Then, the server PC 2 transmits information regarding user operation information input during the execution of the application and contents as image information to be processed by the application to the client PC 3.
A plurality of client PCs 3 are provided corresponding to the projectors 4, and are configured to be able to independently execute the same application as the server PC 2 based on information about user operation information received from the server PC 2. Then, the client PC 3 generates a partial image of the image based on the application execution process according to the projection area assigned to the corresponding projector 4, and outputs the image data to the projector 4.

The projector 4 is connected to the corresponding client PC 3 and projects and displays an image based on the image data from the client PC 3 on the screen Sc.
The server PC 2 and the client PC 3 are connected by a LAN cable 5, and the client PC 3 and the projector 4 are connected by a USB cable 6 so that data can be transmitted and received.
As the image information transmission means, any configuration can be adopted as long as it can transmit and receive data. In addition to the LAN cable 5 and the USB cable 6, for example, various standards for transmitting digital signals by wire In addition, it may include a standard for transmitting a signal via a wireless medium (radio wave, sound, infrared ray, etc.).

  In such a multi-display system 1, as shown in FIG. 2, each client PC 3 independently executes an application similar to the application being executed on the server PC 2 on the content transmitted from the server PC 2. Each client PC 3 generates a partial image of the image based on the content transmitted from the server PC 2 and transmits the image data to each projector 4. Each projector 4 projects and displays a partial image based on this image data in a pre-assigned area, thereby arranging each partial image in parallel on the screen Sc to constitute one large screen.

[Configuration of server PC]
FIG. 3 is a block diagram illustrating a schematic configuration of the server PC 2.
As illustrated in FIG. 3, the server PC 2 includes an operation unit 21, a display unit 22, and a control device 23.

The operation unit 21 includes various operation buttons that are input and operated using, for example, a keyboard and a mouse. By performing the input operation of the operation button, the control device 23 is appropriately operated, and for example, the operation content of the control device 23 is set for the information displayed on the display unit 22. Then, a predetermined operation signal is appropriately output from the operation unit 21 to the control device 23 by an input operation of the operation unit 21 by the user.
The operation unit 21 is not limited to the input operation of the operation buttons, and may be configured to input various conditions by, for example, an input operation using a touch panel or an input operation using voice.

  The display unit 22 is controlled by the control device 23 and displays predetermined information. For example, when the information processed by the control device 23 is displayed or the display image is updated by an application, the data in the memory output from the control device 23 is appropriately displayed. For example, liquid crystal, organic EL (Electroluminescence), PDP (Plasma Display Panel), or CRT (Cathode-Ray Tube) is used for the display unit 22.

  The control device 23 includes, for example, a CPU (Central Processing Unit), and executes an OS (Operation System) or a predetermined program in response to an operation signal input from the operation unit 21 to control the entire server PC 2. To do. As shown in FIG. 3, the control device 23 includes a transmission / reception unit 231, a main memory 232, an auxiliary memory 233, a control unit main body 234, and an operation information notification unit 235. These components 231 to 235 are connected by a bus (not shown) so that necessary information can be transmitted.

The transmission / reception unit 231 is a part that performs transmission / reception of data in accordance with standards corresponding to various image information transmission means. In this embodiment, the transmission / reception unit 231 is connected to the client PC 3 through the LAN cable 5 so as to be able to transmit / receive various information. . Operation information generated by an operation information generation unit 2353 described later is also transmitted from the transmission / reception unit 231 using the UDP protocol or the TCP protocol.

The main memory 232 stores various data. Examples of the various data include user operation information output from the operation unit 21 and data input to the transmission / reception unit 231.
The auxiliary memory 233 is a part for storing contents to be displayed by the user, such as an electronic file that is a presentation material, for example, HD (Hard Disc), DVD (Digital Versatile Disc), memory card, etc. Can be illustrated.

The control unit main body 234 is a main body portion that executes an execution process of the OS and a predetermined program, and includes an application execution processing unit 2341 as shown in FIG.
Here, among the functions of the control unit main body 234, application execution processing functions will be mainly described, and descriptions of other functions will be omitted.

  The application execution processing unit 2341 executes various applications using the main memory 232 as a work area. Specifically, the application execution processing unit 2341 acquires user operation information generated by the OS in response to a user operation, and executes a process corresponding to the user operation information according to a program. For example, when the user presses the left button of the mouse to advance the display screen of the content for presentation, the application execution processing unit 2341 generates “the left button of the mouse has been pressed” generated by the OS. Based on the user operation information to that effect, a process of advancing the display screen by one is performed. The application here is not limited to a specific application, and any application can be used.

The operation information notification unit 235 generates application operation information based on the user operation information, and transmits the generated operation information to the client PC 3. Therefore, the operation information notification unit 235 includes an operation information acquisition unit 2351, an operation information necessity determination unit 2352, an operation information generation unit 2353, and an operation information transmission unit 2354, as shown in FIG.
The operation information acquisition unit 2351 acquires user operation information input during execution of the application. Here, the user operation information can be easily obtained by using a so-called message hook function for obtaining user operation information sent to each window from the OS, for example.

  The operation information necessity determination unit 2352 determines whether the operation information in the client PC 3 is necessary based on the acquired user operation information. Specifically, the motion information necessity determination unit 2352 determines whether the motion information is necessary based on whether the user operation information affects the processing of the target application. For example, when the user performs an operation to display the next page of the presentation material, it affects the display screen by the application and determines that operation information is necessary. When a portion not related to the process is clicked, it is determined that the operation information is unnecessary because the application process is not affected.

  The operation information generation unit 2353 generates application operation information based on the determination result of the operation information necessity determination unit 2352. At that time, the motion information generation unit 2353 refers to a database having a table structure that is generated in accordance with an arbitrary signaling protocol and corresponds to user operation information and motion information, for example, as shown in FIG. Generate information. A similar database also has a client PC 3 through which the same recognition of operation information can be obtained between the server PC 2 and the client PC 3.

Here, it is only necessary to generate a signal corresponding to the user's operation for the operation information, and it is not necessary to generate a signal individually corresponding to the application to be used. In other words, it is sufficient to generate a signal corresponding to the information that “the left button of the mouse has been pressed”, and it is necessary to deal with an event that occurs as a result of a mouse operation, such as “advance the presentation screen by one”. Absent.

The operation information transmission unit 2354 transmits the operation information generated by the operation information generation unit 2353 to each client PC 3 via the transmission / reception unit 231. Specifically, the operation information transmission unit 2354 designates the client PC 3 that transmits the operation information, and delivers the operation information to the transmission / reception unit 231.
In addition, it is a simple method to transmit the operation information to the broadcast address using the UDP protocol. Even in this case, the operation information is just via one hub as in communication in a large conference room. For short-distance communication, there is almost no risk of packet loss. On the other hand, when the TCP protocol is used, packet loss can be reliably eliminated, and there is almost no delay as much data is transmitted as in the operation notification signal described above. Therefore, any protocol can be handled without causing packet loss or excessive communication load.

[Configuration of client PC]
FIG. 5 is a block diagram showing a schematic configuration of the client PC 3.
As illustrated in FIG. 5, the client PC 3 includes an operation unit 31, a display unit 32, and a control device 33.
Note that the operation unit 31 and the display unit 32 have the same configuration as that of the server PC 2 and will not be described here.

The control device 33 includes, for example, a CPU, executes an OS and a predetermined program, and controls the entire client PC 3. Therefore, as shown in FIG. 5, the control device 33 includes a transmission / reception unit 331, a main memory 332, an auxiliary memory 333, an application operation unit 334, and a control unit main body 335. These components 331 to 335 are connected by a bus (not shown) so that necessary information can be transmitted.
Here, since the main memory 332 and the auxiliary memory 333 have the same configuration as that of the server PC 2, the description thereof is omitted, and the other components 331, 334, and 335 will be described below.

  The transmission / reception unit 331 is a part that performs transmission / reception of data in accordance with standards corresponding to various image information transmission means. In this embodiment, the transmission / reception unit 331 is connected to the server PC 2 via the LAN cable 5 and the projector 4 via the USB cable 6. These are connected so that various information can be transmitted and received. Such a transmission / reception unit 331 also functions as an operation information reception unit that receives operation information transmitted from the server PC 2.

The application operation unit 334 is a part that causes the application execution processing unit 3351 to operate the application based on the operation information transmitted from the server PC 2. As illustrated in FIG. 5, the operation information recognition unit 3341 and the pseudo signal generation unit 3342 is provided.
The motion information recognition unit 3341 recognizes a user operation based on the motion information received by the transmission / reception unit 331. At this time, the motion information recognition unit 3341 can obtain a common recognition with the server PC 2 regarding the motion information by referring to the same database as that when generating the motion information in the server PC 2.

The fake signal generation unit 3342 generates a fake signal that falsifies user operation information based on the recognition result of the motion information recognition unit 3341, and transmits the generated fake signal to the control unit main body 335.
Here, the forgery signal generation unit 3342 only has to forge a signal generated by the OS in accordance with the recognized user operation, and even if the OS of the client PC 3 is different from the OS of the server PC 2, It can be handled by imitating the signal.

The control unit main body 335 is a main body part that performs execution processing of an OS and a predetermined program, and includes an application execution processing unit 3351, a partial image generation unit 3352, and a partial image transmission unit 3353 as shown in FIG. .
Of the functions of the control unit main body 335, the application execution processing function and the image partial image generation function based on the application execution processing are mainly described here, and descriptions of other functions are omitted.

The application execution processing unit 3351 is a part that executes various applications using the main memory 332 as a work area, and executes the same application as the application being executed on the server PC 2. That is, as with the application execution processing unit 2341 of the server PC 2, the application execution processing unit 3351 acquires user operation information generated by the OS in response to a user operation, and executes processing corresponding to this user operation information in accordance with the program. To do.
Here, the fake signal transmitted from the fake signal generation unit 3342 falsifies the user operation information sent from the OS in response to the user operation. For this reason, the application execution processing unit 3351 executes the same processing as when the user operation information sent from the OS is acquired when the pseudo signal from the pseudo signal generation unit 3342 is acquired.

The partial image generation unit 3352 generates a partial image of an image displayed on the display unit 32 based on the processing of the OS or application. That is, the partial image generation unit 3352 generates a partial image corresponding to the projection area on the screen Sc of the projector 4 of the image generated based on the operation result of the application operation unit 334. The generation of the partial image here does not perform image processing by software, but enlarges the image displayed on the display unit 32 by the client PC 3 in terms of hardware. This is achieved by making the OS recognize the size of 32 screens. In this case, a high-definition image can be obtained because anti-aliasing processing that removes jaggies that occur in the outline of characters and figures when the image is enlarged is performed on the client PC 3 in hardware.
The partial image transmission unit 3353 transmits the partial image generated by the partial image generation unit 3352 to each connected projector 4 via the transmission / reception unit 331.

[Configuration of projector]
FIG. 6 is a block diagram showing a schematic configuration of the projector 4.
As shown in FIG. 6, the projector 4 includes an image projection unit 41 and a control device 42.

The image projection unit 41 forms an optical image and projects it on the screen Sc under the control of the control device 42. As shown in FIG. 6, the image projection unit 41 includes a light source device 411, a liquid crystal light valve 412, and a projection optical device 413.
The light source device 411 emits a light beam toward the liquid crystal light valve 412 under the control of the control device 42. The light source device 411 includes a light source lamp 4111 and a lamp driver 4112.

The light source lamp 4111 is composed of an ultra high pressure mercury lamp. It should be noted that other discharge emission type light source lamps such as a metal halide lamp and a xenon lamp may be employed in addition to the ultra-high pressure mercury lamp. Furthermore, not only a discharge light source lamp, but various self-light emitting elements such as a light emitting diode, a laser diode, an organic EL element, and a silicon light emitting element may be adopted.
The lamp driver 4112 drives the light source lamp 4111 with a predetermined driving voltage under the control of the control device 42.

The liquid crystal light valve 412 is a transmissive liquid crystal panel, and changes the arrangement of liquid crystal molecules enclosed in a liquid crystal cell (not shown) based on a drive signal from the control device 42 and is emitted from a light source lamp 4111. An optical image corresponding to the image data processed by the PC 2 is emitted to the projection optical device 413 by transmitting or blocking the light beam.
The projection optical device 413 enlarges and projects the optical image emitted from the liquid crystal light valve 412 toward the screen Sc.

  Although not shown, the projector 4 includes three liquid crystal light valves 412 corresponding to the three colors RGB. The light source device 411 includes a color light separation optical system that separates light source light into three colors of light. Further, the projection optical device 413 has a combining optical system that combines three color image lights to generate an optical image representing a color image. As for the configuration of such an optical system, various general projector optical system configurations can be used.

  The control device 42 controls the entire projector 4 in accordance with a control command from the client PC 3 side. As shown in FIG. 6, the control device 42 includes a transmission / reception unit 421, an image correction parameter storage unit 422, an image processing unit 423, an image information storage unit 424, and a liquid crystal panel drive control unit 425. Each of these components 421 to 425 is connected by a bus (not shown) so that necessary information can be transmitted.

The transmission / reception unit 421 is a part that performs transmission / reception of data according to standards corresponding to various image information transmission means, and is connected to the client PC 3 via the USB cable 6 so as to be able to transmit / receive various data.
The image correction parameter storage unit 422 stores correction parameters for image correction according to the characteristics of the projector 4. Examples of the correction parameter include various parameters for trapezoidal correction, luminance unevenness, color unevenness, and γ correction.

The image processing unit 423 is configured to include, for example, a GPU (Graphics Processor Unit), and performs the above-described correction processing on the image data of the received partial image. The image processing unit 423 includes a shape conversion processing unit 4231 and a color tone correction processing unit 4232.
The shape conversion processing unit 4231 has a shape conversion process on the received image data of the partial image, that is, trapezoid correction, correction performed according to the shape of the screen Sc when the screen Sc is a curved surface, and built in the projector 4. Correct distortion caused by the lens. Then, the shape conversion processing unit 4231 outputs the image data subjected to the shape conversion processing to the color tone correction processing unit 4232.

  The color tone correction processing unit 4232 converts and corrects the color tone data of the image data corresponding to the color characteristics of the projector 4 with respect to the image data output from the shape conversion processing unit 4231 (color tone correction processing). Examples of the color tone correction process include color conversion, γ correction, VT-γ correction, and color unevenness correction. For example, by performing a color tone correction process, the color tone data that was originally 8 bits is corrected to an accuracy of 10 bits or more.

The image information storage unit 424 sequentially stores the image data from the client PC 3 received by the transmission / reception unit 421. As the image information storage unit 424, for example, a buffer can be employed.
The liquid crystal panel drive control unit 425 outputs a drive signal based on the image data of the partial image processed by the image processing unit 423 to the liquid crystal light valve 412, and forms an optical image based on this image data on the liquid crystal light valve 412. Let

[Operation of multi-display system]
The operation of the multi-display system 1 described above will be described with reference to the drawings. Here, FIG. 7 is a diagram for explaining the operation of the server PC 2, and FIG. 8 is a diagram for explaining the operation of the client PC 3.

First, as illustrated in FIG. 7, when the user operates the operation unit 21 in the server PC 2, the control unit main body 234 of the control device 23 generates user operation information according to the user operation on the OS (step S <b> 1). . Then, the application execution processing unit 2341 of the control unit main body 234 performs an execution process corresponding to the user operation information in the target application (step S2).
When the user operation information here is an operation for starting an application in order to display the content, the control unit main body 234 acquires the content that the user wants to display from the auxiliary memory 233 and transmits / receives the content. The data is transmitted to the client PC 3 via the unit 231.

On the other hand, the operation information notification unit 235 in the server PC 2 acquires user operation information when it is generated (step S11). Then, the motion information necessity determination unit 2352 determines whether the motion information is necessary in the client PC 3 based on the acquired user operation information (step S12).
When it is determined that the motion information is necessary, the motion information generation unit 2353 generates the motion information with reference to the database generated in accordance with the signaling protocol (step S13). Then, the operation information transmission unit 2354 transmits the operation information generated by the operation information generation unit 2353 to the client PC 3 via the transmission / reception unit 231 (step S14).

  On the other hand, as shown in FIG. 8, in the client PC 3, when the transmission / reception unit 331 receives the operation information from the server PC 2 (step S21), the operation information recognition unit 3341 of the application operation unit 334 generates the operation information in the server PC 2 The operation information is recognized with reference to the same database (step S22). Then, the fake signal generation unit 3342 generates a fake signal that falsifies the user operation information based on the recognition result of the motion information recognition unit 3341, and outputs the fake signal to the application execution processing unit 3351 (step S23).

On the other hand, the application execution processing unit 3351 of the control unit main body 234 in the client PC 3 recognizes the user operation based on the fake signal (step S31), and executes an execution process according to the recognized user operation in the target application. It performs (step S32).
Then, the partial image generation unit 3352 generates a partial image corresponding to the projection area on the screen Sc of the projector 4 with respect to the image generated based on the operation result of the application operation unit 334 (step S33). Thereafter, the partial image transmission unit 3353 transmits the processed partial image to each connected projector 4 via the transmission / reception unit 331 (step S34).

  According to the present embodiment as described above, each client PC 3 simultaneously executes application processing for content using operation information based on user operation information as a synchronization signal. Therefore, for example, as shown in FIG. 9, when the user performs an operation to display the next page of content, each projector 4 simultaneously updates the projection display on the screen Sc using this operation information as a synchronization signal. can do.

[Modification of Embodiment]
It should be noted that the present invention is not limited to the above-described embodiments, and modifications, improvements, and the like within the scope that can achieve the object of the present invention are included in the present invention.
In the embodiment, the operation information of the application generated based on the user operation information is transmitted to all the client PCs 3. However, the present invention is not limited to this, and the client PC 3 that generates the affected partial image is set on the server PC 2. The operation information may be transmitted only to the corresponding client PC 3.

In the embodiment, an application similar to the application being executed on the server PC 2 is stored in the client PC 3 in advance. However, the present invention is not limited to this, and the application may be distributed from the server PC 2 to the client PC 3. As an example suitable for this, an application that processes browser-type content can be exemplified.
In the above embodiment, in the client PC 3, the image based on the processing of the application execution processing unit 3351 has been enlarged by the partial image generation unit 3352 in terms of hardware.

Although the best configuration for carrying out the present invention has been disclosed in the above description, the present invention is not limited to this. That is, the invention has been illustrated and described primarily with respect to particular embodiments, but may be configured for the above-described embodiments without departing from the scope and spirit of the invention. Various modifications can be made by those skilled in the art in terms of materials, quantity, and other detailed configurations.
Therefore, the description limited to the shape, material, etc. disclosed above is an example for easy understanding of the present invention, and does not limit the present invention. The description by the name of the member which remove | excluded the limitation of one part or all of such restrictions is included in this invention.

The schematic diagram which shows the structure of the multi-display system which concerns on one Embodiment of this invention. The schematic diagram which shows the display image of the multi-display system in the said embodiment. The block diagram which shows schematic structure of the image information output device in the said embodiment. The figure which shows the signaling protocol in the said embodiment. The block diagram which shows schematic structure of the image information processing apparatus in the said embodiment. The block diagram which shows schematic structure of the image display apparatus in the said embodiment. The figure for demonstrating the effect | action of the image information output device in the said embodiment. The figure for demonstrating the effect | action of the image information processing apparatus which concerns on the said embodiment. The schematic diagram which shows the display image of the multi-display system in the said embodiment.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Multi-display system, 2 ... Server PC (image information output device), 3 ... Client PC (image information processing device), 4 ... Projector (image display device), 5 ... LAN cable (image information transmission means), 331 ... Transmission / reception unit (motion information reception unit), 334 ... application operation unit, 2351 ... operation information acquisition unit, 2352 ... operation information necessity determination unit, 2353 ... operation information generation unit, 2354 ... operation information transmission unit, 3351 ... application execution process Part 3352... Partial image generation part 3353.

Claims (9)

An image information output device that outputs image information, and a plurality of image information processing devices that are connected to the image information output device via an image information transmission unit and that process image information output from the image information output device; A multi-display system including a plurality of image display devices connected to each image information processing device and forming an image based on a processing result of image information;
Each image display device displays a partial image of the display image based on the image information output from the image information output device, and arranges the partial images in parallel to form one display image,
The image information output device includes:
An operation information acquisition unit for acquiring user operation information input during execution of the application on the image information output device;
Based on the acquired user operation information, an operation information generation unit that generates operation information of the application,
An operation information transmission unit that transmits the generated operation information to each image information processing apparatus,
Each image information processing device
An operation information receiving unit for receiving operation information transmitted from the image information output device;
An application execution processing unit for executing an application similar to the application being executed on the image information output device;
An application operation unit that causes the application execution processing unit to operate an application based on the operation information received by the operation information receiving unit;
A partial image generation unit that generates a partial image corresponding to the position of the connected image display device of the image generated based on the operation result of the application operation unit;
A multi-display system, comprising: a partial image transmission unit configured to transmit the generated partial image to the connected image display device. The multi-display system according to claim 1.
The image information output device and each image information processing device include a database having a table structure in which the user operation information and operation information are associated with each other. The multi-display system according to claim 1 or 2,
An operation information necessity determination unit for determining the necessity of operation information in each image information processing device based on the user operation information;
The motion information transmission unit transmits the motion information generated by the motion information generation unit to each image information processing device based on a determination result of the motion information necessity determination unit. . Image display devices connected to a plurality of image information processing devices, each of which is connected to an image display device, via image information transmission means, output image information to each image information processing device, and connected to each image information processing device An image information output device for a multi-display system that displays an image on
Each image display device displays a partial image of the display image based on the image information output from the image information output device, and arranges the partial images in parallel to form one display image,
The image information output device includes:
An operation information acquisition unit for acquiring user operation information input during execution of the application on the image information output device;
Based on the acquired user operation information, an operation information generation unit that generates operation information of the application,
An image information output device for a multi-display system, comprising: an operation information transmission unit that transmits the generated operation information to each image information processing device. Image display devices connected to a plurality of image information processing devices, each of which is connected to an image display device, via image information transmission means, output image information to each image information processing device, and connected to each image information processing device A program executed on an image information output device for a multi-display system that displays an image on
Each image display device displays a partial image of a display image based on the image information output from the image information output device, and forms a single display image by arranging the partial images in parallel.
The multi-display image information output device,
An operation information acquisition unit for acquiring user operation information input during execution of the application on the image information output device;
Based on the acquired user operation information, an operation information generation unit that generates operation information of the application,
A program for causing a function information transmitting unit to transmit the generated motion information to each image information processing apparatus.   6. A recording medium in which the program according to claim 5 is recorded so as to be readable by a computer. An image information processing apparatus for a multi-display system, which is connected to an image information output apparatus for outputting image information via an image information transmission means and to which an image display apparatus is connected
An operation information receiving unit for receiving operation information transmitted from the image information output device;
An application execution processing unit for executing an application similar to the application being executed on the image information output device;
An application operation unit that causes the application execution processing unit to operate an application based on the operation information received by the operation information receiving unit;
A partial image generation unit that generates a partial image corresponding to the position of the connected image display device of the image generated based on the operation result of the application operation unit;
An image information processing apparatus for a multi-display system, comprising: a partial image transmission unit configured to transmit the generated partial image to the connected image display apparatus. A program executed on an image information processing apparatus for a multi-display system connected to an image information output apparatus for outputting image information and an image information transmission means and connected to an image display apparatus,
The multi-display system image information processing apparatus,
An operation information receiving unit for receiving operation information transmitted from the image information output device;
An application execution processing unit for executing an application similar to the application being executed on the image information output device;
An application operation unit that causes the application execution processing unit to operate an application based on the operation information received by the operation information receiving unit;
A partial image generation unit that generates a partial image corresponding to the position of the connected image display device of the image generated based on the operation result of the application operation unit;
A program that causes a generated partial image to function as a partial image transmission unit that transmits the partial image to the connected image display device.   A recording medium in which the program according to claim 8 is recorded so as to be readable by a computer.

Images