JP2016102880A - Image projection device and control method of image projection device - Google Patents

Abstract

An image projection apparatus capable of maintaining a shadow state of a projection surface without continuing a user's gesture operation on the projection surface.
An image projection apparatus projects an imaging image on a projection unit, causes the imaging unit to capture an image of the projection plane, obtains a projection plane image, and displays the projection plane image on a display image input from the outside. Projection images that appear to overlap are generated, and projection is performed using the projection images. This maintains a desired state even if the user does not continue the gesture operation on the projection plane.
[Selection] Figure 4

Description

  The present invention relates to an image projection apparatus and a control method for the image projection apparatus.

  In recent years, a conference format in which a presentation is performed using a projector has been widely performed, but there is a demand for an environment in which a presenter can easily operate a presentation material.

  As an example of a technique for improving such operability, Patent Document 1 discloses that when a user holds his / her hand on a projected screen, a hand region is detected and an image is selected based on the instruction content from the hand region. And the ability to change the image.

JP 2012-58434 A

  By the way, in a conference format in which a presentation is performed using a projector, there may be a situation where an inadequate projection content is found and the projection image is desired to be hidden instantaneously or a portion of the projection surface is desired to be pointed. In such a case, the user can respond by holding the hand over the projection light and applying a shadow to the projection image on the projection surface, but it is difficult to continue such a gesture for a long time, There is a need for a technique that can continue to cope with the above situation without continuing the gesture.

  As in the method disclosed in Patent Document 1, it is conceivable to detect a hand region and add a shadow on the screen according to the instruction content from the hand region. However, a large number of shadow positions and the like according to the instruction content are set. It is necessary and not realistic.

  SUMMARY OF THE INVENTION The present invention has been made in view of the above problems, and an object thereof is to provide an image projection apparatus that can maintain the shadow state of the projection plane without continuing the user's gesture operation on the projection plane. Yes.

  In order to achieve the above object, an image projection apparatus comprising: a projection unit that projects an image of the present invention onto a projection plane; and an imaging unit that images the projection plane. The projection unit projects an image for imaging. In this state, the imaging unit captures the projection plane and obtains a projection plane image, and generation that generates a projection image in which the projection plane image appears to overlap an externally input display image And means.

  By generating a projection image so that the projection surface image reflecting the state of the projection surface by the user's gesture operation is superimposed on the display screen input from the outside, and projecting it as a projection image by the projection unit, Even if the user does not continue the gesture operation on the projection plane, the shadow state of the projection plane can be maintained.

It is a figure explaining a user hiding the content projected on the screen (projection surface) with the projector (image projector). It is a block diagram for demonstrating the hardware constitutions of the projector (image projection apparatus) in this embodiment. It is a block diagram for demonstrating the functional structure of the projector (image projection apparatus) in this embodiment. It is a flowchart for demonstrating the flow which produces | generates a projection image in this embodiment. (A) It is a figure which shows an example of the display image in this embodiment. (B) It is a figure which shows an example of the projection surface image in this embodiment. (C) It is a figure which shows an example of the projection image produced | generated by superimposing the projection surface image shown in FIG.5 (b) on the display image shown to Fig.5 (a). (A) It is a figure which shows an example of the projection surface image in this embodiment. (B) It is a figure which shows an example of the projection image produced | generated by superimposing the projection surface image shown to Fig.6 (a) on the display image shown to Fig.5 (a). (A) It is an example of the selection screen which selects the color of the shadow part of a projection surface image. (B) It is a figure which shows the area | region provided in order to reset the projection surface image memorize | stored in the memory | storage means.

  FIG. 1 is a diagram illustrating a state in which a user hides contents projected on a screen (projection surface) by a projector (image projection apparatus) with a hand.

  In recent years, projectors such as liquid crystal projectors have been widely used for presentations, and can project a display image on a screen based on image data of materials on a personal computer. The contents of such a display image can be changed by modifying the data on the personal computer. However, during the presentation, if there is a defect in the projection content and you want to hide the projection image instantaneously or the projection surface It may happen that the user wants to point to a part of

  In such a case, the user can respond by putting a hand between the projection unit and the screen and blocking the projection light by applying a shadow to the projection surface. Since it is displayed on the projection surface only during the period of time and it is difficult to continue such a gesture for a long time, it has been difficult to display a shadow until now.

  In FIG. 1, among “A”, “B”, and “C” projected by the projection unit 102 of the projector, the user blocks the projection light of “C” with the shadow 104 of the hand 103, and creates the shadow 104 on the projection surface 101. It is generated and hidden.

  On the other hand, in the present embodiment, the imaging unit 212 acquires the state of the projection plane 101 on which the shadow generated by the user's operation is displayed, and projects the shadow state of the projection plane 101 so as to be superimposed on the display image. By generating and projecting an image, the shadow state of the projection plane is maintained without continuing the user's gesture operation on the projection plane.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 2 is a block diagram for explaining a hardware configuration of the projector 100 (image projection apparatus) according to the present embodiment.

  The CPU 201 comprehensively controls each device and controller connected to the system bus 204.

  Further, the ROM 202 or the external memory 207 (storage means) is necessary to realize a BIOS (Basic Input / Output System) that is a control program of the CPU 201, an operating system program (hereinafter referred to as OS), and a function executed by the projector 100. Various programs to be described later are stored. The RAM 203 functions as a main memory, work area, and the like for the CPU 201.

  The CPU 201 implements various operations by loading a program necessary for execution of processing into the RAM 203 and executing the program.

  An input controller (input C) 205 controls an input from an input unit 209 such as a pointing device (not shown) such as a keyboard and a mouse, a remote controller, and an input from an imaging unit 212 (imaging unit).

  The output controller (VC) 206 controls the projection unit 210 that projects an image on a screen or a wall surface.

  A communication I / F controller (communication I / FC) 208 is connected to and communicates with an external device via a network, and executes communication control processing in the network. For example, Internet communication using TCP / IP is possible.

  Note that the CPU 201 can perform display on the projection unit 210 (projection unit) by executing, for example, an outline font rasterization process on a display information area in the RAM 203.

  A program for realizing the present invention is recorded in the external memory 207, and is executed by the CPU 201 by being loaded into the RAM 203 as necessary. Furthermore, the program generated by the present invention, the proxy class file, the definition file used by the program, and various information tables are stored in the external memory 207, and a detailed description thereof will be described later.

  FIG. 3 is a block diagram for explaining a functional configuration of the projector (image projection apparatus) in the present embodiment.

  The projector 100 receives image data to be a display image from an external personal computer or the like through the input unit 209. The image data input from the input unit is temporarily stored as a display image in the display image memory 301 such as the external memory 207, and this display image is set as a layer 1-302.

  The captured image memory 303 stores a projection plane image captured by the imaging unit 212, and this projection plane image is set as a layer 2-304.

  The image processing unit 305 performs a synthesis process so that the image of the layer 2-304 overlaps the image of the layer 1-302, and generates a projection image. Note that when nothing is stored as a projection plane image in the captured image memory 303, the layer 2-304 is subjected to superimposition processing on the assumption that the entire surface is a non-image such as white light. As long as the irradiation light is uniform over the entire projection surface as well as white light, the irradiation light may be monochromatic light or a mixed color of a plurality of colors.

  The projection image switching processing unit 306 uses the image projected by the projection unit 210 as the projection image generated by the image processing unit 305 or the projection plane image set as layer 2 (or the entire white color treated as layer 2). A switching process is performed to determine whether to use an image for imaging using a non-image such as light). Specifically, the switching process is controlled so that the imaged image is projected at a fixed interval. In other words, the imaged image is projected on the projection plane 101 by projecting the image generated by the image processing unit 305. The switching process is performed so as to be in the interval. Note that the projection operation and the imaging operation of the imaging image are performed in a very short time, so that the viewer who is viewing the presentation or the like is not aware that such a process is being performed.

  The simultaneous control unit 307 synchronizes with the timing of projecting the imaging image set as layer 2 by the projection image switching processing unit 306 (or no image such as full white light treated as layer 2) by the imaging unit 212. Control is performed so that a projection plane image is captured.

  That is, when an imaging operation is first performed in the imaging unit, a projection plane image is captured in a state where a non-image such as white light is projected as an imaging image, and the projection plane image is already once. When the image is captured, the projection plane image is captured in a state where the projection plane image captured in the imaging operation immediately before the current imaging is projected as the image for imaging. By doing so, it is possible to control so that the shadow portion of the projection plane image (that is, the shadow portion to be combined with the display image) gradually increases as the number of imaging increases.

  The color arrangement memory 308 is a storage unit that stores color arrangement data for changing the color of the shadow area of the captured image, that is, the black portion. That is, the color of the shadow area of the projection plane image set as layer 2 is adjusted by the stored color, and is used for the synthesis processing by the image processing unit 305. Such setting in the color arrangement memory 308 can be used by displaying a color arrangement screen 700 on the projection plane 101 as shown in FIG.

  As a color to be selected on the color arrangement screen, not only a method of selecting from a plurality of candidates as described above but also a ratio setting of R / G / B may be used.

  FIG. 4 is a flowchart for explaining a flow of generating a projection image in the present embodiment. The process shown in the flowchart of FIG. 4 is realized by reading and executing a control program stored in the CPU 201 of the projector 100.

  In step S <b> 401, the CPU 201 of the projector 100 acquires a display image registered as a layer 1 image and a projection plane image registered as a layer 2 image. When the projection plane image is not registered as layer 2, no image such as full white light is acquired as layer 2.

  In S <b> 402, the CPU 201 of the projector 100 functions as the image processing unit 305, and performs a process of generating a projection image by superimposing the display image acquired as layer 1 and the projection plane image acquired as layer 2. In step S403, the CPU 201 of the projector 100 causes the projection unit 210 to project the projection image generated in step S402. As a result, a projection plane image acquired as layer 2, that is, a projection image in which an image including, for example, the shadow of the user's hand, is seen to overlap the display image is projected.

  In S <b> 404, the CPU 201 of the projector 100 functions as the projection image switching processing unit 306, and the image to be projected on the projection unit 210 is changed from the projection image generated in S <b> 402 to an imaging image to be projected when the imaging unit 212 captures the image. Switching is performed, and the imaging unit 212 performs imaging processing of the projection plane 101 to acquire a projection plane image. That is, the imaging unit 212 is made to image the projection plane 101 in synchronization with the projection of the imaging image.

  In step S <b> 405, the CPU 201 of the projector 100 stores the projection plane image captured in step S <b> 404 in the captured image memory 303.

  In step S406, the CPU 201 of the projector 100 determines whether the input from the input unit 209 has been completed. When the input from the input unit 209 is continued, the process proceeds to S408, and when the input from the input unit 209 is finished, the projection operation of the image by the projection unit 210 is stopped and finished.

  In step S407, the CPU 201 of the projector 100 determines whether the page of the display image has been changed. Specifically, the determination can be made based on whether or not the image stored in the display image memory 301 has been changed. If it is determined that the page of the display image has been changed, the process proceeds to S408 and the captured image is displayed. An operation of resetting the projection plane image registered in the memory 303 is performed. This is because, when the display image is changed, it is preferable that the shadow state by the user's gesture is also reset. Thereafter, the process returns to S401, and the image superimposition process (S402), the image projection process (S403), and the (projection plane imaging process) are repeated.

  In the captured image memory 303, a projection plane image is stored so as to correspond to the page of the display image, and when it is determined that the page of the display image has been changed to a page that has already been displayed, the page is displayed. The imaging image may be changed so that the projection plane image corresponding to is the imaging image.

  On the other hand, if it is not determined in S407 that the page of the display image has been changed, the process returns to S401 to repeat the image superimposition processing (S402), the image projection processing (S403), and (projection plane imaging processing). become.

  When such an iterative process is performed, the image for imaging used in S404 is a projection plane image captured in the previous projection plane imaging process, so that the shadow portion ( That is, the shadow portion to be combined with the display image is gradually increased. As a result, the user moves his / her hand so that a shadow is formed on the part to be hidden, so that the shadow area generated by the movement is combined with the display image. can do.

  Next, FIG. 5 and FIG. 6 are used to show a projection image generated by superimposing the display image acquired as the layer 1 described with reference to FIG. 4 and the projection plane image acquired as the layer 2.

  5A is a diagram showing a display image 501 on which “A”, “B”, and “C” are displayed, and FIG. 5B is a diagram in which the shadow 104 of the user's hand 103 shown in FIG. FIG. 6 is a diagram showing a projection plane image 502 captured in the state “”. FIG. 5C is a diagram showing an example of a projection image 503 generated by superimposing the projection plane image 502 shown in FIG. 5B on the display image 501 shown in FIG. In this way, it can be seen that the projection plane image 502 including the shadow 104 of the user's hand 103 shown in FIG. 1 is superimposed, and a projection image 503 in which the display of “C” is obscured is generated.

  FIG. 6A is a diagram illustrating a state of the projection plane image 502 when the number of imaging is performed three times while the user is moving his / her hand. The third imaging is performed in a state where an imaging image including a shadow 601 at the first imaging and a shadow 602 at the second imaging is projected, and when the imaging operation is performed, the first imaging is performed. An image in which the shadow 601 at the time of shooting, the shadow 602 at the time of the second shooting, and the shadow 603 at the time of the third shooting overlap is stored as the projection plane image 502.

  In the subsequent projection operation, a superimposition process is performed using the projection plane image 502 in FIG. 6A, and thus a projection image 503 as shown in FIG. 6B is generated.

  Note that the color of the user's shadow on the projection plane image 502 may be the same color even if the number of times of imaging is overlapped, or the color may be changed as the number of times of imaging is increased.

  In this way, a projection image is generated so that the projection screen image reflecting the state of the projection surface by the user's gesture operation is superimposed on the display screen based on the image data input from the outside, and is used as the projection image. By projecting by the projecting means, it is possible to maintain the shadow state of the projection plane without continuing the user's gesture operation on the projection plane.

  Further, the projection plane image registered in the captured image memory 303 can be reset as appropriate not only when the display image page is changed but also when the user (presenter) wants to reset it. Specifically, as shown in FIG. 7B, a reset area 703 is provided on the projection plane 101, and when the shadow of the user's hand is held on the reset area 703 for a predetermined time, the reset area 703 is reset. Also good. Such a reset region 703 may be anywhere outside the projection area 701 that can be projected by the projection unit 210 on the projection plane 101 and inside the imaging area 702 that can be imaged by the imaging unit 212. Further, the projector 100 may be provided with a reset button (not shown).

  The present invention described above can be implemented as, for example, a system, apparatus, method, program, storage medium, or the like. Specifically, the present invention may be applied to a system including a plurality of devices. Alternatively, the present invention may be applied to an apparatus composed of one device.

  Note that the present invention includes a software program that implements the functions of the above-described embodiments directly or remotely from a system or apparatus. The present invention also includes a case where the information processing apparatus of the system or apparatus is achieved by reading and executing the supplied program code.

  Therefore, the program code itself installed in the information processing apparatus in order to realize the functional processing of the present invention with the information processing apparatus also realizes the present invention. In other words, the present invention includes a computer program itself for realizing the functional processing of the present invention.

  In that case, as long as it has the function of a program, it may be in the form of object code, a program executed by an interpreter, script data supplied to the OS, and the like.

  Examples of the recording medium for supplying the program include a flexible disk, hard disk, optical disk, magneto-optical disk, MO, CD-ROM, CD-R, and CD-RW. In addition, there are magnetic tape, nonvolatile memory card, ROM, DVD (DVD-ROM, DVD-R), and the like.

  As another program supply method, a browser on a client computer is used to connect to an Internet home page. The computer program itself of the present invention or a compressed file including an automatic installation function can be downloaded from the homepage by downloading it to a recording medium such as a hard disk.

  It can also be realized by dividing the program code constituting the program of the present invention into a plurality of files and downloading each file from a different homepage. That is, the present invention also includes a WWW server that allows a plurality of users to download a program file for realizing the functional processing of the present invention with an information processing apparatus.

  In addition, the program of the present invention is encrypted, stored in a storage medium such as a CD-ROM, distributed to users, and key information for decryption is downloaded from a homepage via the Internet to users who have cleared predetermined conditions. Let The downloaded key information can be used to execute the encrypted program and install it in the information processing apparatus.

  Further, the functions of the above-described embodiment are realized by the information processing apparatus executing the read program. In addition, based on the instructions of the program, the OS or the like operating on the information processing apparatus performs part or all of the actual processing, and the functions of the above-described embodiments can be realized by the processing.

  Further, the program read from the recording medium is written in a memory provided in a function expansion board inserted into the information processing apparatus or a function expansion unit connected to the information processing apparatus. Thereafter, the CPU of the function expansion board or function expansion unit performs part or all of the actual processing based on the instructions of the program, and the functions of the above-described embodiments are realized by the processing.

  Note that the above-described embodiments are merely examples of implementation in carrying out the present invention, and the technical scope of the present invention should not be construed in a limited manner. That is, the present invention can be implemented in various forms without departing from the technical idea or the main features thereof.

100 Projector (image projection device)
101 Projection surface 104 Shadow 210 Imaging unit (imaging means)
212 Projection unit (projection means)

Claims (8)

An image projection apparatus comprising: a projection unit that projects an image onto a projection plane; and an imaging unit that images the projection plane,
An acquisition unit that causes the projection unit to capture an image of the projection plane and obtain a projection plane image in a state where the projection unit projects an image for imaging.
Generation means for generating a projection image, the projection plane image appearing to overlap an externally input display image;
An image projection apparatus comprising: An image projected on the projection plane by the projection means, further comprising a switching means for switching between the imaging image and the projection image;
The image projection apparatus according to claim 1, wherein the acquisition unit acquires the projection plane image when the switching unit switches to the imaging image.   The image projecting apparatus according to claim 2, wherein the switching unit performs switching so that the imaging image is projected while the projection image is being projected.   4. The image projection apparatus according to claim 1, wherein the image for imaging is an imageless image or the projection plane image captured in a previous imaging operation. 5. Determining means for determining that a page of a display image input from the outside has been changed;
And changing means for changing the imaging image used when the projection means image is picked up by the generating means when the determining means determines that the page of the display image has been changed. The image projection apparatus according to claim 4. A storage unit for storing the projection plane image;
The changing unit is configured to change the imaging image by resetting the projection plane image stored in the storage unit when it is determined that the page of the display image has been changed to a new page. The image projection apparatus according to claim 5. The storage means can store the projection plane image so as to correspond to the page of the display image,
When it is determined that the page of the display image has been changed to a page that has already been displayed, the changing unit is configured to cause the projection plane image corresponding to the page to be the imaging image. The image projection device according to claim 6, wherein: A control method for an image projection apparatus, comprising: a projection unit that projects an image onto a projection plane; and an imaging unit that images the projection plane,
In the state where the image for imaging is projected on the projection unit, the acquisition step of capturing the projection plane with the imaging unit and acquiring the projection plane image;
A generation step of generating a projection image in which the projection plane image appears to overlap the display image input from the outside;
And a projecting step of projecting the generated image by the projecting means.