JP5042965B2 - Presentation image presentation system, presentation method, presentation program, and recording medium therefor - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To enhance the effect of presentation, by effectively controlling the degree of concentration of a listener with respect to the information presented, as well as, by effectively switching listener's attention point between the information presented and a speaker. <P>SOLUTION: Background image data obtained by imaging a screen and a background portion around the screen are stored, in advance, and image data being data transmitted from a data operation terminal TM1 are aligned and superimposed on the screen image of the background image data so that its center are aligned with the center of the screen image, whereby projection image data are generated. When a zoom-in button 181 or a zoom-out button 182, provided on a screen operation terminal TM2, is operated by a presenter US, the projection image data are processed and are enlarged or reduced at a prescribed time change rate, and the projection image data that are processed enlarged or reduced are supplied to a projector PJ and projected to the screen SC. <P>COPYRIGHT: (C)2010,JPO&amp;INPIT

Description

  The present invention relates to a presentation system, a presentation method, a presentation program, and a recording medium for presenting presentation images such as conference materials to participants using a projector in a conference room, for example.

  In general, in a conference, a form in which a speaker makes a presentation while projecting an image of a conference material or the like on a screen by a projector is often used. In this type of conference, a method of zooming in on the presentation image or pointing on the screen using a laser pointer is often used in order to gather the attention of listeners such as conference participants and audience in the presentation image such as conference materials. . However, since all of these operations cause the listener's attention to be directed to the presentation image, the listener is always strained, which makes it difficult to maintain concentration on the presented information, Is one of the causes of the decline.

  Therefore, recently, the listener uses his / her terminal to send points that he / she does not understand or are interested in to the server device. The server device accumulates information sent from the listener's terminal, and if necessary, the speaker's terminal. Has been proposed (see, for example, Patent Document 1). With this system, the listener can select the topic of interest during the presentation and feed back the information to the speaker. The speaker can change the way the speaker speaks and the content of the presentation based on this information. It becomes possible to enhance the effect.

  However, since the above system always requires the listener to select an interesting topic, it is difficult for the listener to concentrate on the presentation. In addition, since the speaker must always be aware of feedback information from the listener, there arises a problem that the pace of his / her story, the topic he originally wanted to emphasize, and the flow of the scheduled talk are disturbed.

JP 2000-200277 A

  As described above, methods that have been implemented or proposed in the past to improve the efficiency of presentations are devised only in the direction in which the listener is focused on the presentation information, or topics that the listener is interested in during the presentation. The speaker changes the topic with reference to the feedback information. For this reason, there is a problem that the listener is always strained, and it becomes difficult for the listener and the speaker to concentrate on the presentation, and as a result, the expected presentation effect cannot be obtained.

  The present invention has been made paying attention to the above circumstances, and its purpose is to effectively control the degree of concentration of the listener with respect to the presentation information, and to make the listener's attention point effective between the presentation information and the speaker. It is an object to provide a presentation image presentation system, method, program, and recording medium thereof that can enhance the effect of the presentation by switching between them.

  In order to achieve the above object, one aspect of the present invention includes a memory for storing background image data including a screen and its peripheral portion, reads background image data from the memory, and stores the read background image data. Projection image data is generated by superimposing and superimposing the document image data used for the presentation on the screen image area so that the center point thereof coincides with the center point of the screen image. The generated projection image data is enlarged or reduced from the center of the screen image area as a starting point, and the enlarged or reduced projection image data is projected onto the screen.

  Therefore, not only the document image but also the entire background, including the screen and its surroundings, can be perceived by the audience as if they are virtually approaching or moving away, thereby effectively controlling the concentration and relaxation of the audience with respect to the document image. In addition, it is possible to effectively switch the listener's attention point between the presentation information and the speaker, and the presentation effect can be further enhanced.

One aspect of the present invention is characterized by further including various specific modes as follows.
In the first aspect, when the projection image data is enlarged or reduced, a manual enlargement or reduction operation of a presenter who performs the presentation is accepted, and the generated projection is generated according to the accepted enlargement or reduction operation. The image data is enlarged or reduced from the center of the screen image area.
If it does in this way, expansion or reduction processing of the above-mentioned projection image data is controlled by a presenter's manual operation. Therefore, virtual perspective control of the projected image can be realized in a manner that directly reflects the will of the presenter.

In the second aspect, when the projection image data is enlarged or reduced, it is determined whether or not an instruction operation is performed on the screen of the presenter who performs the presentation, and the projection image is determined according to a determination result of the presence or absence of the instruction operation. Data is enlarged or reduced.
In this way, when the presenter performs an instruction operation on the screen, the projection image data is automatically enlarged. On the other hand, if the presenter does not perform an instruction operation on the screen, the projection image data is automatically reduced. For this reason, the presenter does not need to separately perform an operation for enlarging or reducing the projection image data, and this makes it possible to concentrate more on the presentation.

  That is, according to one aspect of the present invention, it is possible to effectively control the degree of concentration of the listener with respect to the presentation information, and it is possible to effectively switch the attention point of the listener between the presentation information and the speaker, Accordingly, it is possible to provide a presentation image presentation system, a presentation method, a presentation program, and a recording medium thereof that can further enhance the effect of the presentation.

Embodiments of the present invention will be described below with reference to the drawings.
(First embodiment)
FIG. 1 is a schematic configuration diagram of a presentation image presentation system according to the first embodiment of the present invention.
The system according to the first embodiment includes a material operation terminal TM1, a screen operation terminal TM2 connected to the material operation terminal TM1 via, for example, a LAN (Local Area Network) cable LC, and the screen operation terminal TM2. A projector PJ connected via a signal cable is provided.

  The material operation terminal TM1 is composed of a personal computer and is installed at a position where the presenter US can operate. In the material operation terminal TM1, materials used for presentation are converted into electronic data and stored in a memory. The material operation terminal TM1 monitors the material selection operation and the page turning operation by the presenter, and reads electronic data of the material selected by the operation from the memory every time this operation is detected. Then, the electronic data (for example, PNG file) of the read material is transmitted to the screen operation terminal TM2 via the LAN cable LC at intervals of 1 second, for example.

  The screen operation terminal TM2 is also composed of a personal computer, and is installed at a position where the presenter US can operate similarly to the material operation terminal TM1. The screen operation terminal TM2 is the core of this system and is configured as follows. FIG. 2 is a block diagram showing the configuration of the hardware and software.

  The screen operation terminal TM2 includes a central processing unit (CPU) 11, a program memory 13 and a data memory 14 are connected to the CPU 11 via a bus 12, and a communication interface 15, a projector interface 16, and the like. The input / output interface 17 is connected.

  The communication interface 15 performs communication processing for receiving material image data from the material operation terminal TM1 under the control of the CPU 11. When the document operation terminal TM1 is connected via the LAN cable LC, for example, TCP / IP (Transmission Control Protocol / Internet Protocol) is used as the communication protocol.

  A projector PJ is connected to the projector interface 16 via a signal cable. The projector interface 16 supplies the generated projection image data to the projector PJ through a signal cable under the control of the CPU 11. The projector PJ generates an optical image corresponding to the projection image data supplied from the projector interface 16, and projects this optical image on the screen SC.

  An input device 18 and a display device 19 are connected to the input / output interface 17. The input device 18 is configured by a keyboard, for example. Among the keys on the keyboard, for example, the up and down keys of the cursor have a function as a zoom-in button 181 operated when zooming in the projected image and a function as a zoom-out button 182 operated when zooming out the projected image, respectively. Assigned. For example, the enter key is assigned a function as a stop button 183 operated when stopping the zoom-in and zoom-out operations. The input / output interface 17 detects the operation of the function buttons 181 to 183 and transmits it to the CPU 11. The display device 19 is used to display the projection image.

  The data memory 14 is provided with a background / screen image storage unit 141 and a material image storage unit 142 as storage areas necessary for carrying out the present invention. The background / screen image storage unit 141 stores background image data including the screen SC previously captured by the camera and the surrounding wall and ceiling. The document image storage unit 142 is used to temporarily store document image data sent from the document operation terminal TM1.

  The program memory 13 stores a projection image generation program 131 and an enlargement / reduction control program 132 as application programs necessary for carrying out the first embodiment of the present invention.

The projection image generation program 131 causes the CPU 11 to execute the following processing.
(1) A process of storing the received document image data in the document image storage area 142 in the data memory 14 every time the document image data transmitted from the document operation terminal TM1 is received by the communication interface 15.

  (2) For example, the background image data including the screen SC and the surrounding wall is read from the background / screen image storage unit 141 at intervals of 2 seconds, and the latest received image is read in the screen image area of the background image data. A process of generating projection image data by superimposing the document image data in a state where the center points of both are coincident.

  (3) The generated projection image data is enlarged / reduced according to the magnification given by the magnification control data from the enlargement / reduction control program 132 described later, and the projection image data after the enlargement / reduction processing is sent from the projector interface 16. Processing to output to the projector PJ.

  When the zoom-in button 181 or the zoom-out button 182 is operated on the input device 18, the enlargement / reduction control program 132 calculates the magnification of the projection image according to the elapsed time from the operation time point until the stop button 183 is operated. The CPU 11 is caused to execute processing for generating magnification control data for variably controlling the image and providing the magnification control data to the projection image generation program 131.

Next, the presentation image presentation operation by the system configured as described above will be described. FIG. 3 is a flowchart showing a processing procedure and processing contents by the material operation terminal TM1 and the screen operation terminal TM2.
The background / screen image storage unit 141 of the screen operation terminal TM2 will be described on the assumption that image data obtained by capturing a background including the screen SC and its surrounding wall and ceiling with a video camera is stored in advance.

  It is assumed that the presenter US performs a presentation start operation or a page turning operation for the material used for the presentation at the material operation terminal TM1. When the material operation terminal TM1 detects the operation in step S31, the material operation terminal TM1 performs an operation process on the material in accordance with the operation in step S32. For example, if the type of operation is a material presentation start operation, the image data of the first page of the material designated by the operation is selectively read from the memory. On the other hand, if the type of operation is a page turning operation, the image data of the next page or previous page of the selected material is read from the memory. In step S33, the material operation terminal TM1 transmits the read material image data to the screen operation terminal TM2 via the LAN cable LC at intervals of 1 second, for example.

  On the other hand, the screen operation terminal TM2 performs the following processing. That is, when the document image data is transmitted from the document operation terminal TM1, the CPU 11 receives the document image data via the communication interface 15 in step S34 and stores it in the document image storage unit 142 in the data memory 14. . Thereafter, each time material image data is sent from the material operation terminal TM1, the material image data stored in the material image storage unit 142 is updated. That is, since the material operation terminal TM1 transmits the material image data at intervals of 1 second as described above, the material image data stored in the material image storage unit 142 is updated at intervals of 1 second.

  In step S44, the CPU 11 reads background image data from the background / screen image storage unit 141 at intervals of 2 seconds. Then, the latest document image data received and stored in step S34 is read from the document image storage unit 142 and superimposed on the screen image area of the read background image data to generate projection image data. At this time, the superimposed position of the document image data on the screen image is adjusted so that the center of the screen image and the center of the document image coincide with each other.

  Subsequently, the CPU 11 enlarges / reduces the generated projection image data according to the magnification specified by the enlargement / reduction control program 132 in step S36. Then, the enlarged / reduced projection image data is output from the projector interface 16 to the projector PJ. At this time, the initial value of the magnification of the projected image is set to a predetermined intermediate value, for example. Therefore, the projection image data is adjusted to a size corresponding to the intermediate magnification and then output to the projector PJ. As a result, the material image set to the intermediate size is projected on the screen SC together with the background image.

  Now, it is assumed that the presenter US presses the zoom-in button 181 in the screen operation terminal TM2 in a state where the document image set to the intermediate size is projected on the screen SC2 as described above. At this time, the CPU 11 of the screen operation terminal TM1 monitors the operations of the zoom-in button 181, the zoom-out button 182 and the stop button 183 in steps S37, S38 and S39, respectively, and detects the operation of the zoom-in button 181. In step S41, magnification control data for expanding the magnification of the projection image data at a predetermined time change rate is generated.

  Then, the CPU 11 enlarges the projection video data generated in steps S44, S34, and S35 in step S36 according to the magnification given by the magnification control data. The projection image data after the enlargement processing is sent from the projector interface 16 to the projector PJ. To output. At this time, the enlargement process is performed starting from the center point of the screen image and the document image. Accordingly, the projected image displayed on the screen SC is zoomed in at a predetermined time change rate starting from the center point of the screen image. Then, when the magnification of the projection image reaches a preset maximum magnification or when the presenter US presses the stop button 183 during the zoom-in, the zoom-in of the projection image is stopped.

  FIG. 4 shows an example of a projected image when the maximum magnification is reached. As shown in the figure, a screen image IM2 and a material image IM1 enlarged to the maximum magnification are projected on the screen SC. That is, an image obtained by projecting the material image IM1 is projected on the virtual screen IM2. Therefore, the audience can perceive as if the screen is approaching (closed) by zooming in, and this makes it possible to emphasize the document image IM1 and draw attention to the audience.

  On the other hand, assume that the presenter US presses the zoom-out button 182 in the screen operation terminal TM2 in this state. Then, when the CPU 11 of the screen operation terminal TM2 detects the operation of the zoom-out button 182 in step 38, the CPU 11 proceeds to step S42, and magnification control data for reducing the magnification of the projection image data at a predetermined time change rate. Is generated.

  Then, the CPU 11 reduces the projection video data generated in steps S44, S34 and S35 in step S36 according to the magnification given by the magnification control data, and the projection image data after the reduction processing is sent from the projector interface 16 to the projector PJ. To output. At this time, the reduction process is performed starting from the center point of the screen image and the document image as in the case of the enlargement process described above. Therefore, the projected image displayed on the screen SC is zoomed out at a predetermined rate of change with the center point of the screen image as a starting point. When the magnification of the projection image reaches a preset minimum magnification or when the presenter US presses the stop button 183 during the zoom-in, the zoom-out of the projection image is stopped.

  FIG. 5 shows an example of a projected image when the minimum magnification is reached. As shown in the figure, a screen image IM2 and a material image IM1 set at the minimum magnification are projected on the center of the screen SC, and an image IM3 representing the background of a wall, ceiling, chair, etc. is further projected on the periphery. Projected. That is, an image in which the document image IM1 is displayed on the virtual screen IM2 is projected with the virtual background IM3 as the back. Therefore, the audience can perceive as if the screen has moved away (pulled) by zooming out, thereby reducing the concentration of the audience on the document image IM1, and naturally attracting the audience's attention to the document image IM1. It can be removed and attention can be directed to the presenter US.

If the color of the background image to be projected is made as close as possible to the surface color of the actual background such as a screen or a wall, the virtual background and the actual background in the projected image will be spatially affected when zooming out. It is possible to make the audience perceive as if they were integrated and connected to each other, thereby making it easier to perceive the movement of the screen in the depth direction, and to increase the audience's immersion in the presentation. In addition, the larger the projection surface of the projected image, the more the audience can perceive that the entire wall moves in the depth direction, thereby further enhancing the immersive feeling.
Further, when the background image IM3 is generated, a three-dimensional virtual display may be realized by a three-dimensional stereoscopic display technique of computer graphics, or a picture taken indoors is enlarged / reduced two-dimensionally. Thus, pseudo three-dimensional expression may be realized.

  It is assumed that the presenter US presses the zoom-in button 181 again in a state where the projection image is zoomed out. Then, the CPU 11 proceeds from step S37 to step S41, and generates magnification control data for enlarging the magnification of the projection image data at a predetermined time change rate. Then, the CPU 11 enlarges the projection video data generated in steps S44, S34, and S35 in step S36 in accordance with the magnification given by the magnification control data in accordance with the projection image generation program 131, and the projection image data after this enlargement processing. Is output from the projector interface 16 to the projector PJ.

  Therefore, the projected image displayed on the screen SC is zoomed in again at a predetermined rate of change from the center point of the screen image. Then, when the magnification of the projection image reaches a preset maximum magnification or when the presenter US presses the stop button 183 during the zoom-in, the zoom-in of the projection image is stopped.

  As described above, in the first embodiment, in the screen operation terminal TM2, background image data obtained by imaging the screen and the surrounding background portion is stored in the background / screen image storage unit 141 in advance, and this background image data is stored. Projection image data is generated by aligning and superimposing the material image data sent from the material operation terminal TM1 on the screen image area so that the center point thereof coincides with the center point of the screen image. When the zoom-in button 181 or the zoom-out button 182 provided on the screen operation terminal TM2 is operated by the presenter US, the projection image data is enlarged or reduced at a predetermined time change rate, and this enlargement or reduction process is performed. The projected image data is supplied to the projector PJ and projected onto the screen SC.

  Therefore, according to the zoom operation of the presenter US, it is possible to make the audience perceive not only the document image but also the entire screen and the surrounding background to approach or move away from the audience image. It is possible to effectively control the concentration and relaxation of the listener, and it is possible to effectively switch the listener's attention point between the presentation information and the speaker. Further, since the enlargement / reduction processing of the projection image data is controlled by the manual operation of the presenter US, the control that directly reflects the will of the presenter US can be realized.

(Second Embodiment)
In the second embodiment of the present invention, the behavior of a presenter during a presentation is captured by a video camera, the presence / absence of an instruction operation of the presenter on the screen is determined from the captured image, and the determination result of the presence / absence of the instruction operation The enlargement / reduction process of the projection image data is controlled according to the above.

FIG. 6 is a schematic configuration diagram of a presentation image presentation system according to the second embodiment of the present invention. In the figure, the same parts as those in FIG.
In the system according to the second embodiment, the video camera CM is arranged at a position vertically above the presenter US. This video camera CM captures the behavior of the presenter US during the presentation from above, and sends the captured image data to the screen operation terminal TM2 at regular time intervals (for example, 1 second). The video camera CM and the screen operation terminal TM2 may be connected via a LAN cable, or may be connected using a general image signal cable.

  The screen operation terminal TM2 is configured as follows. FIG. 7 is a block diagram showing the configuration of the hardware and software. In the figure, the same parts as those in FIG.

  The screen operation terminal TM2 includes a camera interface 20 in addition to the communication interface 15 and the projector interface 16 described above. The video camera CM is connected to the camera interface 20. The camera interface 20 receives the captured image data of the presenter US output from the video camera CM.

  The program memory 13 includes an instruction operation determination program in addition to the projection image generation program 131 and the enlargement / reduction control program 132 described above as application programs necessary for carrying out the second embodiment of the present invention. 133 is stored.

The instruction operation determination program 133 causes the CPU 11 to execute the following processing.
(1) Processing for storing captured image data of the presenter US received by the camera interface 20 in a captured image storage unit (not shown) provided in the data memory 14.
(2) An image recognition process is performed on the stored captured image data, and an image region representing the outline of the presenter US is recognized from the captured image data. Then, a minimum rectangle (bounding box) surrounding the recognized image area is obtained, and the presenter US indicates the screen SC based on the area of the bounding box and the position of the center of gravity of the image area in the bounding box. Processing to determine whether or not. The image recognition process can be realized by an image processing LSI such as a DSP (Digital Signal Processor) in addition to the software process of the CPU 11.

The enlargement / reduction control program 132 causes the CPU 11 to execute the following processing based on the determination result by the instruction operation determination program 133.
(1) When it is determined by the instruction operation determination program 133 that the presenter US indicates the screen SC, magnification control data is generated to enlarge the size of the projected image to a preset maximum value. Processing given to the projection image generation program 131.

  (2) When the presenter US does not indicate the screen SC for 20 seconds by the instruction operation determination program 133, it is determined whether the size of the projected image being projected is the maximum size or a size of 3/4 thereof. To do.

  (3) When it is determined by the determination process of (2) that the projected image size being projected is the maximum size, magnification control data for reducing the size of the projected image to 3/4 is generated to generate the projected image. Processing given to the generation program 131.

  (4) If it is determined by the determination process of (2) that the projected image size during projection is 3/4, the magnification control data for further reducing the size of the projected image to 2/4 is generated. Processing given to the projection image generation program 131.

  The projection image generation program 131 is provided with projection image data generated by superimposing the latest document image data at that time on the screen image area of the background image data from the enlargement / reduction control program 132 as magnification control data. Enlarge / reduce according to the magnification. Then, the CPU 11 is caused to execute a process of outputting the projection image data after the enlargement / reduction process from the projector interface 16 to the projector PJ.

  Next, the presentation image presentation operation by the system configured as described above will be described. FIG. 8 is a flowchart showing a processing procedure and processing contents by the material operation terminal TM1 and the screen operation terminal TM2. In the figure, the same parts as those in FIG.

  When the document image data is transmitted from the document operation terminal TM1, the CPU 11 receives the document image data via the communication interface 15 in step S34 and stores it in the document image storage unit 142 in the data memory 14. Thereafter, each time material image data is sent from the material operation terminal TM1, the material image data stored in the material image storage unit 142 is updated.

  In step S44, the CPU 11 reads background image data from the background / screen image storage unit 141 at intervals of 2 seconds. Then, the latest document image data received and stored in step S34 is read from the document image storage unit 142 and superimposed on the screen image area of the read background image data to generate projection image data. At this time, the superimposed position of the document image data on the screen image is adjusted so that the center point of the screen image and the center point of the document image coincide with each other.

  Subsequently, the CPU 11 enlarges / reduces the generated projection image data according to the magnification specified by the enlargement / reduction control program 132 in step S36. Then, the enlarged / reduced projection image data is output from the projector interface 16 to the projector PJ. At this time, the initial value of the magnification of the projected image is set to a predetermined intermediate value, for example. Therefore, the projection image data is adjusted to a size corresponding to the intermediate magnification and then output to the projector PJ. As a result, the material image set to the intermediate size is projected on the screen SC together with the background image.

Now, with the document image being projected onto the screen SC as described above, the CPU 11 executes the following processing according to the instruction operation determination program 133.
That is, the behavior of the presenter US during the presentation is picked up by the video camera CM2 vertically above, and the picked-up image data is sent to the screen operation terminal TM2 at intervals of one second. The CPU 11 of the screen operation terminal TM2 receives the captured image data of the presenter US sent from the video camera CM by the camera interface 20 and receives the captured image data provided in the data memory 14 every time. Save to storage.

  Next, in step 81, the CPU 11 performs image recognition processing on the stored captured image data, recognizes an image area representing the contour of the presenter US from the captured image data, and selects the recognized image area. Find the smallest bounding rectangle (bounding box). For example, if an image area E1 representing the outline of the presenter US is detected as shown in FIG. 9, the CPU 11 sets a minimum bounding box BB surrounding the detected image area E1.

  Subsequently, the CPU 11 calculates the area of the bounding box BB, and sets the calculated area to a preset threshold value (for example, set to 1.5 times the area when the presenter US is not performing an instruction operation). Compare with Then, when the calculated area of the bounding box BB exceeds the threshold value, the presenter US determines that some instruction operation has been performed, and if not, the presenter US has not performed the instruction operation. Is determined.

Further, the CPU 11 determines whether or not the instruction operation of the presenter US is for the screen SC as follows.
That is, as shown in FIG. 11, first, the center of gravity G of the image area E1 of the presenter US is detected. Next, out of the four corner regions A to D of the bounding box BB, first, a region including the image region E1 of the presenter US is selected, and then the detected center of gravity G is selected from the selected corner regions. Is selected as the hand position of the presenter US. Subsequently, a straight line passing through the selected corner area A is drawn from the center point E of the bounding box BB, and it is determined whether or not a point P at which the straight line intersects the projection plane of the screen SC is detected. If the intersection P is found as shown in FIG. 11 as a result of this determination, it is determined that the presenter US indicates the screen SC. On the other hand, if the intersection P is not found as shown in FIG. It is determined that the SC is not instructed.

  If it is determined by the above determination processing that the presenter US indicates the screen SC, the CPU 11 proceeds to step S85 to increase the size of the projected image to a preset maximum value (4/4). Magnification control data is generated and provided to the projection image generation program 131. Then, according to the projection image generation program 131, the CPU 11 enlarges the projection video data generated in steps S44, S34 and S35 in step S36 according to the magnification given by the magnification control data, and the projection image data after this enlargement processing. Is output from the projector interface 16 to the projector PJ. At this time, the enlargement process is performed starting from the center point of the screen image and the document image. Therefore, the projected image displayed on the screen SC is zoomed in to the maximum size starting from the center point of the screen image.

  Therefore, in this case, as shown in FIG. 4, the screen image IM2 and the material image IM1 enlarged to the maximum size are projected onto the screen SC. That is, an image obtained by projecting the material image IM1 is projected on the virtual screen IM2. Therefore, the audience can perceive as if the screen is approaching (closed) by zooming in, and it is possible to emphasize the document image IM1 to the audience.

  On the other hand, it is determined by the determination process in step S81 that the presenter US has not instructed the screen SC, and this state continues for 20 seconds. In this case, the CPU 11 proceeds from step S82 to step S83, and determines whether or not the size of the projection image being projected is the maximum size. As a result of this determination, if it is determined that the projected image size during projection is the maximum size, magnification control data for reducing the size of the projected image to 3/4 is generated in step S86.

  Then, the CPU 11 performs a process of reducing the projection video data generated in steps S44, S34, and S35 to 3/4 in step S36 according to the magnification given by the magnification control data, and the projection image data after the reduction process is obtained. Output from the projector interface 16 to the projector PJ. At this time, the reduction process is performed starting from the center point of the screen image and the document image as in the case of the enlargement process described above. Therefore, the projected image displayed on the screen SC is zoomed out to 3/4 size starting from the center point of the screen image.

  Further, it is assumed that the state in which the presenter US does not indicate the screen SC continues for another 20 seconds after being reduced to the 3/4 size. In this case, the CPU 11 proceeds from step S82 to step S84 via step S83, and determines whether or not the size of the projected image being projected is 3/4 of the maximum size. As a result of this determination, if it is determined that the projected image size during projection is 3/4 of the maximum size, magnification control data for reducing the size of the projected image to 2/4 is generated in step S87.

  Then, the CPU 11 performs a process of reducing the projection video data generated in steps S44, S34, and S35 to 2/4 in step S36 according to the magnification given by the magnification control data, and the projection image data after the reduction process is obtained. Output from the projector interface 16 to the projector PJ. At this time, the reduction process is performed starting from the center point of the screen image and the document image as in the case of the enlargement process described above. Therefore, the projected image displayed on the screen SC is further zoomed out to 2/4 size starting from the center point of the screen image.

  That is, if the presenter US does not perform an instruction operation on the screen SC during the presentation, the projected image displayed on the screen SC is zoomed in steps of 3/4 and 2/4 every 20 seconds. Be out. When zoomed out, for example, as shown in FIG. 5, the screen image IM2 and the material image IM1 set to the minimum magnification are projected on the center portion of the screen SC, and further on the periphery thereof, a wall, ceiling, chair, etc. An image IM1 representing the background is projected.

  That is, an image in which the document image IM1 is displayed on the virtual screen IM2 is projected with the virtual background IM3 as the back. Therefore, the audience can perceive as if the screen has been moved away (pulled) by zooming out, thereby reducing the concentration of the audience with respect to the material image IM1.

  When the presenter US performs an instruction operation on the screen SC again in a state where the projection image size is reduced to 3/4 or 2/4, the CPU 11 proceeds from step S81 to step S85, and the projection image is displayed. Magnification control data for expanding the size of the image to the maximum value (4/4) is generated. Then, according to the projection image generation program 131, the projection video data generated in steps S44, S34, and S35 is enlarged in step S36 according to the magnification given by the magnification control data, and the projection image data after the enlargement processing is used as the projector interface. 16 to the projector PJ. Therefore, the projected image displayed on the screen SC is zoomed in to the maximum size starting from the center point of the screen image.

  As described above, in the second embodiment, the behavior of the presenter US during the presentation is imaged by the video camera CM from the vertically upper side, and the presence / absence of the instruction operation of the presenter US with respect to the screen SC is determined from the captured image. The projection image data is enlarged / reduced according to the determination result of the presence / absence of the instruction operation.

  Therefore, according to the instruction operation of the presenter US with respect to the screen SC, it is possible to make the audience perceive that not only the document image but also the entire screen and its surrounding background are approaching or moving away virtually. It is possible to effectively control the concentration and relaxation of the audience with respect to the image, and it is possible to effectively switch the attention point of the listener between the presentation information and the speaker. In addition, since the enlargement / reduction processing of the projection image data is automatically controlled according to the instruction operation of the presenter US with respect to the screen SC, the presenter US separately performs the enlargement or reduction operation of the projection image data. This eliminates the need to do so and allows more focus on the presentation.

(Other embodiments)
In the second embodiment, the presenter US is imaged by the video camera CM, and the presence / absence of an instruction operation on the screen SC is determined based on the captured image. However, the present invention is not limited to this. In addition, when the presenter US performs an instruction operation on the screen SC using the laser pointer, whether or not the laser pointer is irradiated on the screen SC is determined using a video camera or the like. You may make it determine.

  In the first and second embodiments, the case where the material operation terminal TM1 and the screen operation terminal TM2 are connected via the LAN cable LC has been described as an example. However, a wireless LAN is used instead of the LAN cable. Alternatively, a wireless communication system to which a low-power wireless data communication standard such as Bluetooth (registered trademark) or UWB (Ultra Wideband) is applied may be applied.

  Further, in each of the above embodiments, the case where the operation of the material is performed by the material operation terminal TM1 and the operation of the screen by the screen operation terminal TM2 has been described as an example. You may comprise so that both of these may be performed collectively. In this way, the system configuration can be simplified.

In addition, the type and configuration of the operation terminal, the projection image data generation process, and the procedure and contents of the enlargement / reduction process can be variously modified without departing from the scope of the present invention.
In short, the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. Further, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, you may combine suitably the component covering different embodiment.

1 is a schematic configuration diagram of a presentation image presentation system according to a first embodiment of the present invention. It is a block diagram which shows the structure of the hardware and software of the screen operation terminal in the system shown in FIG. It is a flowchart which shows the process sequence and process content by the material operation terminal and screen operation terminal in the system shown in FIG. It is a figure which shows an example of the image when it zooms in on the screen of the system shown in FIG. It is a figure which shows an example of the image when it zooms out projected on the screen of the system shown in FIG. It is a schematic block diagram of the presentation image presentation system concerning the 2nd Embodiment of this invention. It is a flowchart which shows the process sequence and process content by the material operation terminal and screen operation terminal in the system shown in FIG. It is a flowchart which shows the process sequence and process content by the material operation terminal and screen operation terminal in the system shown in FIG. It is a figure which shows the image area | region detected when the presenter is not giving the instruction | indication with respect to a presentation image | video. It is a figure which shows the image area | region detected when the presenter is giving the instruction | indication with respect to a presentation image | video. It is a figure for demonstrating the determination method of instruction | indication operation by a presenter.

Explanation of symbols

  TM1 ... material operation terminal, TM2 ... screen operation terminal, LC ... LAN cable, PJ ... projector, SC ... screen, CM ... video camera, US ... user, BB ... bounding box, E1 ... presenter's video area, IM1 ... announcement Document image, IM2 ... screen image, IM3 ... background image, 11 ... CPU, 12 ... bus, 13 ... program memory, 14 ... data memory, 15 ... communication interface, 16 ... projector interface, 17 ... input / output interface, 18 ... input Device 19: Display device 20 ... Camera interface 131 Projection image generation program 132 ... Enlargement / reduction control program 133 ... Instruction operation determination program 141 ... Background / screen image storage unit 142 ... Document image storage unit 181 ... Zoom in button Down, 182 ... zoom out button, 183 ... stop button.

Claims (10)

A memory for storing background image data including a screen and its peripheral portion;
The background image data is read from the memory, and the document image data used for the presentation is aligned with the screen image area of the read background image data so that the center point thereof coincides with the center point of the screen image. Means for generating projection image data by superimposing;
Means for enlarging or reducing the generated projection image data starting from the center of the screen image area;
And a means for projecting the enlarged or reduced projection image data onto the screen. The means for enlarging or reducing the projection image data includes:
Means for accepting a manual enlargement or reduction operation of a presenter who makes the presentation;
2. The presentation image presentation according to claim 1, further comprising means for enlarging or reducing the generated projection image data starting from the center of the screen image area in accordance with the accepted enlargement or reduction operation. system. The means for enlarging or reducing the projection image data includes:
Means for determining presence / absence of an instruction operation on the screen of a presenter who performs the presentation;
The presentation image presentation system according to claim 1, further comprising means for enlarging or reducing the projection image data in accordance with a determination result of the presence / absence of the instruction operation. When projecting the document image data used for the presentation on the screen,
The background image data including the screen and its peripheral part is read from the memory, the document image data used for the presentation is stored in the screen image area of the read background image data, and the center point is the center point of the screen image. A process of generating projection image data by aligning and superimposing to match
Enlarging or reducing the generated projection image data starting from the center of the screen image area;
And a method of projecting the enlarged or reduced projection image data onto the screen. The process of enlarging or reducing the projection image data includes:
Accepting a manual enlargement or reduction operation of a presenter who makes the presentation;
5. A presentation image presentation according to claim 4, further comprising a step of enlarging or reducing the generated projection image data starting from the center of the screen image area in accordance with the accepted enlargement or reduction operation. Method. The process of enlarging or reducing the projection image data includes:
Determining whether or not there is an instruction operation on the screen of the presenter who makes the presentation;
The presentation image presentation method according to claim 4, further comprising a step of enlarging or reducing the projection image data according to a determination result of the presence / absence of the instruction operation. A program used in an apparatus for projecting document image data used for a presentation onto a screen under the control of a computer,
The background image data including the screen and its peripheral part is read from the memory, the document image data used for the presentation is stored in the screen image area of the read background image data, and the center point is the center point of the screen image. Processing to generate projection image data by aligning and superimposing to match,
A process of enlarging or reducing the generated projection image data starting from the center of the screen image area;
A program for causing the computer to execute a process of projecting the enlarged or reduced projection image data on the screen. The process of enlarging or reducing the projection image data includes:
A process of accepting a manual enlargement or reduction operation of a presenter who makes the presentation;
8. The computer according to claim 7, wherein the computer executes a process of enlarging or reducing the generated projection image data starting from a center of the screen image area in accordance with the accepted enlargement or reduction operation. Program. The process of enlarging or reducing the projection image data includes:
A process for determining the presence or absence of an instruction operation on the screen of the presenter who makes the presentation;
8. The program according to claim 7, causing the computer to execute a process of enlarging or reducing the projection image data according to a determination result of the presence / absence of the instruction operation.   A recording medium storing the program according to any one of claims 7 to 9 in a readable manner.

Images