JP2011197381A - Display device, display system, and display method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a display device or the like capable of displaying more easily when a plurality of images are superimposed and displayed.
An input unit 110 to which a projector 100 receives a transmission instruction target image that is a target image of a transmission instruction and a composition target image that is a target image to be combined with the transmission instruction target image; A display side reception unit 120 that receives a transmission instruction for the instruction target image, a transmission image generation unit 130 that generates a transmission image in which the background area of the transmission instruction target image is displayed in response to the transmission instruction, and a front surface of the composition target image The image forming apparatus includes a composite image generation unit 140 that generates a composite image in which a transparent image is arranged, and a projection unit 190 that projects the composite image.
[Selection] Figure 2

Description

  The present invention relates to a display device, a display system, and a display method.

  For example, as described in Japanese Patent Laid-Open No. 2000-115603, a projection system is provided in which a document camera captures an imaged object and generates a captured image, and a projector projects the captured image. For example, in a school, a calligraphy teacher may place a paper on which a model character is written on a stage of a document camera, and a projector may be used to enlarge and project a captured image of the paper.

  In this situation, when comparing the text written by the teacher with the text written by the student, the projection system placed the paper on which the teacher wrote the text and the paper on which the student wrote the text side by side on the document camera. The captured image is projected in the state.

JP 2000-115603 A

  However, in such a projection method, it is difficult to understand the difference between the letters written by the teacher and the letters written by the students. In addition, teachers may write letters on transparent sheets, but in calligraphy, ink and brush are used, so it is difficult for teachers to write letters on transparent sheets as well as on paper. It is also difficult to align the text written by the teacher with the text written by the students.

  Furthermore, the teacher once captures the captured image of the paper on which the character is written and the captured image of the paper on which the student has written the character into a PC (Personal Computer), edits the image on the PC, and then projects the edited image on the projector. Although a method can be considered, it takes time and effort.

  Some aspects according to the present invention provide a display device, a display system, and a display method capable of displaying a plurality of images in a more easily viewable manner by solving the above-described problems.

  The display device according to one aspect of the present invention receives an input of a transmission instruction target image that is a transmission instruction target image and a synthesis target image that is a target image to be combined with the transmission instruction target image. A display side receiving unit that receives a transmission instruction for the transmission instruction target image, and a transmission image generation unit that generates a transmission image in which a background area of the transmission instruction target image is displayed in response to the transmission instruction, It includes a composite image generation unit that generates a composite image in which the transparent image is arranged in front of the synthesis target image, and a display unit that displays the composite image.

  A display system according to one aspect of the present invention includes the display device and an imaging device, and the imaging device receives an imaging start instruction and an imaging end instruction. By performing imaging from an imaging start instruction to the imaging end instruction, an imaging unit that generates the transmission instruction target image or the synthesis target image as a moving image, and the transmission instruction target image or the synthesis target image on the display device And an output unit for outputting.

  A display system that is one aspect of the present invention includes the display device and an imaging device, and the imaging device captures an image in accordance with the imaging instruction, an imaging-side reception unit that receives an imaging instruction. An imaging unit that generates the transmission instruction target image or the compositing target image as a still image, and an output unit that outputs the transmission instruction target image or the compositing target image to the display device. And

  In addition, the display method according to one aspect of the present invention includes a transparent instruction target image, which is a target image for transmission instruction, and a composition target image, which is a target image to be combined with the transmission instruction target image. Is received, a transmission instruction for the transmission instruction target image is received, a transmission image in which a background area of the transmission instruction target image is displayed transparently is generated according to the transmission instruction, and the transmission image is displayed in front of the synthesis target image. A composite image in which images are arranged is generated, and the composite image is displayed.

  According to the present invention, a display device or the like can display a composite image in which a transparent image in which a background area of an image to be instructed to transmit is transparently displayed is arranged in front. This makes it possible to display more easily.

  The composite image generation unit may generate the composite image adjusted so that the position of the foreground region in the transmission instruction target image matches the position of the foreground region in the composition target image. According to this, since the display device or the like can adapt the position of the foreground area of each image constituting the composite image, it can be displayed more easily.

  The composite image generation unit may generate the composite image adjusted so that the size of the foreground region in the transmission instruction target image matches the size of the foreground region in the composition target image. According to this, the display device or the like can adapt the size of the foreground area of each image constituting the composite image, so that it can be displayed more easily.

It is a figure which shows the projection condition in a 1st Example. It is a figure which shows the functional block of the projector and document camera in a 1st Example. It is a flowchart which shows the projection procedure of the synthesized image in 1st Example. It is a figure which shows an example of the captured image in a 1st Example. It is a figure which shows an example of the non-captured image in a 1st Example. It is a figure which shows an example of a synthesized image. It is a figure which shows an example of the permeation | transmission image in a 1st Example. It is a figure which shows an example of the synthesized image in a 1st Example. It is a flowchart which shows the projection procedure of the synthesized image in 2nd Example. It is a figure which shows an example of the captured image in a 2nd Example. It is a figure which shows another example of the captured image in a 2nd Example. It is a figure which shows an example of the synthesized image in a 2nd Example. It is a figure which shows an example of the permeation | transmission image in a 2nd Example. It is a figure which shows another example of the synthesized image in a 2nd Example.

  Embodiments in which the present invention is applied to a projector will be described below with reference to the drawings. In addition, the Example shown below does not limit the content of the invention described in the claim at all. In addition, all the configurations shown in the following embodiments are not necessarily essential as means for solving the invention described in the claims.

(First embodiment)
FIG. 1 is a diagram showing a projection situation in the first embodiment. FIG. 2 is a diagram showing functional blocks of the projector 100 and the document camera 200 in the first embodiment. A projector 100, which is a type of display device, includes an input unit 110 to which a transmission instruction target image that is a target image of a transmission instruction and a synthesis target image that is a target image to be combined with the transmission instruction target image are input. A display-side receiving unit 120 that receives a transmission instruction for the transmission instruction target image, a transmission image generation unit 130 that generates a transmission image in which the background area of the transmission instruction target image is displayed in response to the transmission instruction, and a composition target image The image forming apparatus includes a composite image generation unit 140 that generates a composite image in which a transparent image is arranged on the front surface, a storage unit 150 that stores various data, and a projection unit (display unit) 190 that projects the composite image. The transparent image generation unit 130 may generate a transparent image in which a region other than the background region of the transparent instruction target image is also displayed in a transparent manner.

  The storage unit 150 also includes a non-captured data 152 indicating a non-captured image based on image information from the PC 300, a captured data 154 indicating a captured image based on captured information from the document camera 200, and a compositing target indicating information related to the compositing target image. Image data 156, transmission target image data 158 indicating information on the transmission target image, and the like are stored. The document camera 200, which is a type of imaging device, captures a captured image (a transparent instruction target image or a synthesis target image) by taking an image in accordance with the imaging side reception unit 210 that receives an imaging instruction and the imaging instruction. And an output unit 230 that outputs a captured image to the projector 100.

  The projector 100 may function as each of these units using the following hardware. For example, in the projector 100, the input unit 110 is an image input terminal, a USB interface, the display side receiving unit 120 is a USB interface, the transparent image generation unit 130, the image generation unit 140 is a CPU, an image processing circuit, etc., and the storage unit 150 is The projection unit 190 such as a RAM may use a lamp, a liquid crystal panel, a liquid crystal driving circuit, a lens, or the like. Further, the imaging side reception unit 210 of the document camera 200 may be a button, a CPU, the imaging unit 220 may be a CCD camera, and the output unit 230 may be a USB interface.

  Next, a procedure for projecting a composite image in the present embodiment will be described. FIG. 3 is a flowchart showing a procedure for projecting a composite image in the first embodiment. The teacher stores image data of characters drawn by the students in the PC 300, and the teacher uses the document camera 200 to image paper on which the characters are drawn in black. The PC 300 outputs image information to the projector 100, and the document camera 200 outputs imaging information.

  As a result, image information is input from the PC 300 to the input unit 110, and the transmission image generation unit 130 stores non-imaging data 152 indicating a non-captured image (composition target image) in the storage unit 150 based on the image information ( Step S1). In addition, imaging information indicating a still image captured from the document camera 200 is input to the input unit 110, and the transmission image generation unit 130 generates imaging data 154 indicating a captured image (transmission instruction target image) based on the imaging information. It memorize | stores in the memory | storage part 150 (step S2).

  FIG. 4 is a diagram illustrating an example of the captured image 400 in the first embodiment. FIG. 5 is a diagram illustrating an example of the non-captured image 410 in the first embodiment. Here, it is assumed that the character “sky” is drawn. The transmission image generation unit 130 performs edge detection on the non-imaging data 152 to generate the composition target image data 156 and stores it in the storage unit 150 (step S3). In addition, the transmission image generation unit 130 performs edge detection on the imaging data 154 to generate transmission target image data 158 and stores it in the storage unit 150 (step S4). For example, the transparent image generation unit 130 detects a foreground region composed of characters and a background region other than characters by edge detection, and uses information indicating the coordinates and size of each region as synthesis target image data 156 The target image data 158 is stored in the storage unit 150.

  The display side reception unit 120 determines whether there is a transmission instruction based on the instruction information from the document camera 200 (step S5). For example, the teacher presses a button for instructing transparency of the document camera 200. Thereby, the imaging-side receiving unit 210 receives a transmission instruction, and the output unit 230 outputs instruction information indicating the transmission instruction to the projector 100 according to the transmission instruction. When there is a transmission instruction, the transmission image generation unit 130 generates a transmission image in which the position of the transmission target image with respect to the synthesis target image is adjusted based on the imaging data 154, the transmission target image data 158, and the synthesis target image data 156 ( Step S6). In addition, the composite image generation unit 140 generates a composite image in which a transmission image is arranged in front of the composition target image based on the non-imaging data 152, and the projection unit 190 projects the composite image (step S7).

  FIG. 6 is a diagram illustrating an example of the composite image 500. FIG. 7 is a diagram illustrating an example of the transparent image 420 in the first embodiment. FIG. 8 is a diagram illustrating an example of the composite image 501 in the first embodiment.

  For example, if only the background of the captured image 400 is transmitted, the character drawn by the teacher and the character drawn by the student are shifted as in the composite image 500 of FIG. On the other hand, the transmission image generation unit 130 can grasp the positions of the characters drawn by the teacher and the characters drawn by the student by generating the composition target image data 156 and the transmission target image data 158 in advance. When the transparent image 420 showing the character drawn by the teacher is generated, it matches the position of the character drawn by the student (for example, the position of the center is matched, the position of the center is matched, the position of the center is matched) And so on). Thereby, as shown in FIG. 8, the projector 100 can project a composite image 501 in a state in which the character drawn by the teacher and the character drawn by the student are not shifted.

  The projector 100 determines whether or not there is an end instruction (step S8). If there is an end instruction, the series of processes (steps S1 to S8) described above is ended. If not, the series of processes is continued. .

  As described above, according to the present embodiment, the projector 100 can display the composite image 501 in which the transparent image in which the background region of the image to be instructed to be transparent is displayed in front is arranged. The images can be displayed more easily when they are displayed in a superimposed manner. As a result, the user can easily perform a visual presentation using the projector 100.

  Further, according to the present embodiment, the projector 100 can adapt the position of the foreground area of each image constituting the composite image 501, and thus can display the image more easily.

  According to the present embodiment, the projector 100 can repeatedly project the captured image 400, the non-captured image 410, and the composite image 501 by storing the captured data 154 and the like.

(Second embodiment)
In the first embodiment, image information is input from the document camera 200 and the PC 300. However, the projector 100 may receive a plurality of pieces of image information and imaging information from the same device. The target transmission instruction target image and the composition target image to be combined with the transmission instruction target image may be input. Further, it is not essential to store the non-imaging data 152 or the like and adjust the position of the transparent image.

  FIG. 9 is a flowchart showing a procedure for projecting a composite image in the second embodiment. FIG. 10 is a diagram illustrating an example of a captured image 401 in the second embodiment. FIG. 11 is a diagram illustrating another example of the captured image 402 in the second embodiment. FIG. 12 is a diagram illustrating an example of the composite image 502 in the second embodiment.

  In the flowchart of FIG. 9, the composite image generation unit 140 generates a composite image based on two pieces of imaging information input from the document camera 200, and the projection unit 190 projects the composite image (step S11). For example, the projector 100 first inputs imaging information of a captured image 401 (first image) indicating an answer, and then inputs imaging information of a captured image 402 (second image) indicating a problem. Then, the projecting unit 190 projects a composite image 502 in which the non-transparent captured image 402 is superimposed on the front surface of the captured image 401. Thereby, as shown in FIG. 12, in the synthesized image 502, only the question is displayed and the answer is not displayed. When displaying the answer, the teacher presses the button of the document camera 200 to give a transmission start instruction. The transmission image generation unit 130 determines whether or not there is a transmission start instruction based on the information from the display side reception unit 120 (step S12). When there is a transmission start instruction, the transmission image generation unit 130 performs edge detection on the latest captured image to grasp the foreground region and the background region, and generates a transmission image in a state in which the background region is transmitted ( Step S13). The composite image generation unit 140 generates a composite image in which the transmission image is arranged in front of the previous captured image, and the projection unit 190 projects the composite image (step S14). Note that the projector 100 does not have to generate a composite image of two images in step S11. That is, when there is no transmission start instruction, the projector 100 may project the latest captured image.

  FIG. 13 is a diagram illustrating an example of the transparent image 421 in the second embodiment. FIG. 14 is a diagram illustrating another example of the composite image 503 in the second embodiment. For example, in the transparent image 421, the background area of the question sentence is transparent. Thereby, in the composite image 503, the answer column is transparent, and the answer of the previous captured image arranged in the answer column portion is displayed. Here, it is assumed that the teacher arranges the sheet so that the answer of the captured image 401 is positioned in the answer column portion of the captured image 402. When displaying the problem again, the teacher presses the button of the document camera 200 to give an instruction to end transmission. The transmission image generation unit 130 determines whether or not there is a transmission end instruction based on information from the display side reception unit 120 (step S15). The projector 100 determines whether or not there has been an end instruction (step S16). If there is an end instruction, the series of processes (steps S11 to S16) described above is ended. If not, the series of processes is continued. .

  As described above, also according to the present embodiment, the projector 100 has the same function and effect as the first embodiment.

(Other examples)
In addition, application of this invention is not limited to the Example mentioned above, A various deformation | transformation is possible. For example, the imaging side reception unit 210 of the document camera 200 receives an imaging start instruction and an imaging end instruction, and the imaging unit 220 performs imaging from the imaging start instruction to the imaging end instruction, thereby performing a transmission instruction target image or a synthesis target. The image may be generated as a moving image, and the output unit 230 may output the transmission instruction target image or the synthesis target image to the display device.

  That is, the image that is the basis of the transparent images 420 and 421 is not limited to a still image, and may be a moving image. Specifically, for example, the projector 100 can project a composite image indicating the kanji writing order by transmitting a moving image.

  In addition, the area that is the target of the transmission instruction in the transmission instruction target image is not limited to the background area, and may be a partial area of the foreground area, and the foreground area is transmitted for each part as time elapses. May be.

  The adjustment of the transparent image 420 by the transparent image generation unit 130 is not limited to the adjustment of the character position, and may be, for example, the adjustment of the character size. Further, the method for the transparent image generation unit 130 to grasp the background region or the like is not limited to edge detection, and may be color distribution detection or the like, for example.

  Further, the display side reception unit 120 may include an operation button, a remote controller, and the like, and may directly receive a transmission instruction or the like from the user.

  Further, the display device is not limited to the projector 100, and may be an electronic device such as a television, a liquid crystal monitor, and a mobile phone having a projection function. The imaging device is not limited to the document camera 200, and may be a digital camera, a video camera, or the like, for example.

  The computer included in the projector 100 may function as the transmission image generation unit 130 by reading a program stored in the information storage medium. As such an information storage medium, for example, a CD-ROM, DVD-ROM, ROM, RAM, HDD, or the like can be applied.

  The projector 100 is not limited to a liquid crystal projector (transmission type, reflection type such as LCOS), and may be a projector using a digital micromirror device, for example. Further, the function of the projector 100 may be distributed to a plurality of devices (for example, a PC and a projector).

  DESCRIPTION OF SYMBOLS 100 Projector (display apparatus), 110 Input part, 120 Display side reception part, 130 Transparent image generation part, 140 Composite image generation part, 150 Storage part, 152 Non-imaging data, 154 Imaging data, 156 Synthesis target image data, 158 Transmission Target image data, 200 document camera (imaging device), 210 imaging side reception unit, 220 imaging unit, 230 output unit, 300 PC, 400 to 402 captured image, 410 non-captured image, 420, 421 transmission image, 500 to 503 synthesis image

Claims (6)

An input unit to which a transmission instruction target image that is a target image for transmission instruction and a synthesis target image that is a target image to be combined with the transmission instruction target image;
A display-side receiving unit that receives a transmission instruction for the transmission instruction target image;
In response to the transmission instruction, a transmission image generation unit that generates a transmission image in which a background area of the transmission instruction target image is displayed transparently;
A synthesized image generating unit that generates a synthesized image in which the transparent image is arranged in front of the synthesis target image;
A display unit for displaying the composite image;
Display device. The display device according to claim 1,
The composite image generation unit generates the composite image adjusted so that the position of the foreground region in the transmission instruction target image matches the position of the foreground region in the composite target image.
Display device. The display device according to any one of claims 1 and 2,
The composite image generation unit generates the composite image adjusted so that the size of the foreground region in the transmission instruction target image matches the size of the foreground region in the composition target image.
Display device. A display device according to any one of claims 1 to 3,
An imaging device;
Including
The imaging device
An imaging side reception unit that receives an imaging start instruction and an imaging end instruction;
An imaging unit that generates the transmission instruction target image or the synthesis target image as a moving image by performing imaging from the imaging start instruction to the imaging end instruction;
An output unit that outputs the transmission instruction target image or the synthesis target image to the display device;
including,
Display system. A display device according to any one of claims 1 to 3,
An imaging device;
Including
The imaging device
An imaging side reception unit for receiving an imaging instruction;
An imaging unit configured to generate the transmission instruction target image or the synthesis target image as a still image by performing imaging in accordance with the imaging instruction;
An output unit that outputs the transmission instruction target image or the synthesis target image to the display device;
including,
Display system. Display device
A transmission instruction target image that is a target image for transmission instruction and a synthesis target image that is a target image to be combined with the transmission instruction target image are input.
Receiving a transmission instruction for the transmission instruction target image;
In response to the transmission instruction, generate a transmission image in which the background area of the transmission instruction target image is displayed in a transparent manner,
Generating a synthesized image in which the transparent image is arranged in front of the synthesis target image;
Displaying the composite image;
Display method.