JP2011217304A - Image processor, projector, multi-projection system and image processing method - Google Patents

Abstract

An image processing apparatus and the like that can easily suppress coloring of an image without being limited to the configuration of a projector.
An image processing apparatus that corrects a first projection image displayed on a projection surface and a second projection image that is displayed side by side with a superposition region is provided in the superposition region of the second projection image. Colorimetric value acquisition for acquiring the first colorimetric value at the first colorimetric position and the second colorimetric value at the second colorimetric position outside the superimposed region of the second projection image And a color adjustment processing unit that adjusts the color of the second projection image in the superposition region based on the first colorimetric value and the second colorimetric value.
[Selection] Figure 3

Description

  The present invention relates to an image processing apparatus, a projector, a multi-projection system, an image processing method, and the like.

  Conventionally, there is a known multi-projection system that can generate images with high resolution and high brightness that cannot be realized with a single projector by displaying images projected from a plurality of projectors side by side on a screen that is a projection surface. It has been. An image formed by arranging a plurality of projection images on the screen in this way is called a tiling image. In such a multi-projection system, it is common to make the boundary region of the projected image inconspicuous by providing a superimposed region and arranging adjacent projection images side by side.

  However, when a superimposed region is provided and the projected images are arranged on the screen, this superimposed region becomes brighter than other regions. In view of this, the brightness of the superposed region is set to be comparable to the brightness of other regions by a method using image processing or a method using optical shading.

  For example, Patent Document 1 discloses an image processing apparatus that performs image processing so that the brightness of a superimposed region is less noticeable when a superimposed region is provided and a plurality of projection images are displayed side by side. This image processing apparatus randomly performs digital mask processing on the pixels in the overlapping area so that the signal values of some pixels are set to 0 and are not displayed on the screen.

  FIG. 19 is an explanatory diagram of the overlapping area in the multi-projection system. FIG. 19 schematically illustrates an example of a tiling image in which the superimposed images BR are provided and the projection images IMG1 and IMG2 are displayed side by side. FIG. 19 schematically illustrates an example of a change in brightness in the horizontal direction of the tiling image.

  As shown in FIG. 19, the first projector projects an image on a screen SCR and displays a projected image IMG1. Further, the second projector projects an image on the screen SCR and displays a projection image IMG2. At this time, the projection image IMG2 on the screen SCR is displayed so as to overlap with a part of the projection image IMG1 and to provide an overlapping region BR. Since the superimposed region BR is a region where the projection images IMG1 and IMG2 overlap, the brightness of the superimposed region BR becomes brighter than other regions. In the technique disclosed in Patent Document 1, the brightness is adjusted by mixing the signal value 0 by image processing with respect to the brightness of such a superimposed region BR.

  Further, for example, Patent Document 2 discloses a multi-projection system or the like that makes the brightness of the overlapping region inconspicuous by shielding light with an optical light shielding plate in a liquid crystal projector configured using a dichroic mirror, a dichroic prism, or the like. ing.

  FIG. 20 is an explanatory diagram of a multi-projection system using an optical light shielding plate. FIG. 20 schematically shows the projection images IMG1 and IMG2 constituting the tiling image.

  An optical light shielding plate LS1 is installed between the first projector and the screen SCR, and a part of the optical path of the first projector is shielded. As a result, the projection image IMG1 is provided with a light shielding region SR1. Similarly, an optical light shielding plate LS2 is installed between the second projector and the screen SCR, and a part of the optical path of the second projector is shielded. As a result, the projection image IMG2 is provided with a light shielding region SR2. In the projection image IMG1, the light shielding region SR1 is darker than the other regions. In the projection image IMG2, the light shielding region SR2 is darker than the other regions.

  As described above, according to the technique disclosed in Patent Document 2, the tiling image can be displayed so that the light shielding area SR1 of the projection image IMG1 and the light shielding area SR2 of the projection image IMG2 are overlapped to form the overlapping area BR. it can. Thereby, the brightness in the superimposed region BR can be made comparable to the brightness in the other regions.

JP 2006-14146 A JP 2009-14951 A

  However, in the technique disclosed in Patent Document 1, black is also brightened as shown in FIG. Therefore, when a tiling image is displayed by configuring a multi-projection system with a liquid crystal projector, there is a problem in that it is not possible to eliminate black floating in which black appears bright. In addition, since the brightness of the superimposed region is adjusted in relation to image processing on other projection images, sufficient brightness adjustment may not be performed depending on the result of image processing of other projection images. There is a problem that the processing becomes complicated by considering the image processing of the projected image.

  On the other hand, since the technique disclosed in Patent Document 2 uses an optical light shielding plate, it can be applied to a multi-projection system configured by a liquid crystal projector without considering black floating or the like. However, when part of the projection light from the liquid crystal projector is blocked, for example, unnecessary shades such as red and blue may appear in the light blocking areas SR1 and SR2 in FIG.

  FIG. 21 is an explanatory diagram of the colors that appear in the projection image IMG2. FIG. 21 shows an example of a change in brightness in the horizontal direction of the projection image IMG2.

  For example, when a white solid image is displayed as the projection image IMG2, as a result of being shielded from light by the optical light shielding plate LS2, the white balance is changed in the light shielding region SR2 of the projection image IMG2, and a color appears. As shown in FIG. 21, the change in brightness in the light shielding region SR2 differs for each color component. This is considered to be caused by various factors such as adjustment errors of optical parts such as a dichroic mirror, a dichroic prism, and a liquid crystal panel, and incident angle dependency such as light modulation characteristics of the optical parts.

  Therefore, Patent Document 2 removes the color that appears due to the light shielding by RGB processing. However, the technique disclosed in Patent Document 2 has a problem that it is difficult to change the color without changing the brightness because of RGB processing.

  The coloring in a predetermined region in the projection image constituting the tiling image as described above is not limited to light shielding, and may appear due to various factors. Therefore, it is desirable that coloring of a predetermined area in the projection image can be suppressed as easily as possible.

  The present invention has been made in view of the above technical problems. According to some aspects of the present invention, it is possible to provide an image processing device, a projector, a multi-projection system, an image processing method, and the like that can easily suppress coloring of a projection image without being limited to the configuration of the projector. .

  (1) According to one aspect of the present invention, an image processing device that corrects a first projection image displayed on a projection surface and a second projection image that is displayed side by side with an overlap region is provided with the second projection. A first colorimetric value at a first colorimetric position within the superimposed region of the image and a second colorimetric value at a second colorimetric position outside the superimposed region of the second projection image. A colorimetric value acquisition unit to be acquired; and a color adjustment processing unit that adjusts the color of the second projection image in the superimposed region based on the first colorimetric value and the second colorimetric value. Including.

  In this aspect, the overlapping area is provided and the first projection image and the second projection image are tiling-displayed. At this time, the image processing apparatus performs the first colorimetric value at the first colorimetric position within the superimposed region of the second projection image and the second colorimetric value at the second colorimetric position outside the superimposed region. Based on the value, the color of the second projection image in the overlapping region is adjusted. Thereby, it becomes possible to remove the coloration of the superimposed region of the second projection image without being limited to the configuration of the projector. Therefore, it is possible to improve the image quality of the tiling image configured to include the first projection image and the second projection image. Furthermore, since the processing of a single projector that projects the second projection image is sufficient, coloring can be easily removed. In particular, when tiling images are displayed by a plurality of projectors, the processing can be performed for each projector.

  (2) In the image processing apparatus according to another aspect of the present invention, the color adjustment processing unit has a color corresponding to at least the colorimetric value at the first colorimetric position corresponding to the second colorimetric value. The color of the second projection image in the superposition region is adjusted so as to match the color.

  According to this aspect, since the color of the second projection image in the superimposed region is adjusted so that at least the color at the first colorimetric position matches the color at the second colorimetric position, the superimposed region The coloration of can be removed with a simple process.

  (3) In the image processing apparatus according to another aspect of the present invention, the color adjustment processing unit adjusts the color of the second projection image in the superposition region by adjusting a color difference.

  According to this aspect, since the color of the second projection image in the superimposed region is adjusted by adjusting the color difference, the coloring of the superimposed region can be removed with a simple process without changing the brightness. Become.

  (4) An image processing apparatus according to another aspect of the present invention calculates a color difference coefficient obtained by a ratio of a color difference corresponding to the second colorimetric value to a color difference corresponding to the first colorimetric value. The color adjustment processing unit includes a coefficient calculation unit, and adjusts the color difference of the second projection image in the overlapping region using the color difference coefficient.

  In this aspect, a color difference coefficient is calculated by (color difference corresponding to the second colorimetric value) / (color difference corresponding to the first colorimetric value), and the second color difference coefficient in the overlap region is calculated using this color difference coefficient. Adjust the color difference of the projected image. By doing so, the color difference adjustment corresponding to the first color measurement value and the second color measurement value is not limited to the first color measurement position in the superimposition area, but also in other positions in the superimposition area. It becomes easy.

  (5) In the image processing apparatus according to another aspect of the present invention, the color adjustment processing unit uses the color difference coefficient and a position coefficient corresponding to the position of each pixel in the superposition area. The color difference of the second projection image at is adjusted.

  According to this aspect, the position coefficient corresponding to the position of the pixel of the second projection image in the overlapping region is adopted, and the correction degree of the color difference by the color difference coefficient can be changed according to the position coefficient. This makes it possible to correct the color difference of the second projection image in the superimposition area according to the coloration of the superimposition area and the shape of the superimposition area, thereby enabling more accurate color adjustment. .

  (6) In the image processing apparatus according to another aspect of the present invention, the position coefficient is 1 at the first colorimetric position, and is 0 at a boundary position between the overlap region and the outside of the overlap region. The color adjustment processing unit multiplies the color difference component of each pixel in the superimposition area by the color difference coefficient and the position coefficient to thereby calculate each pixel of the second projection image in the superimposition area. Adjust the color difference.

  In this aspect, the position of the second projection image in the superimposition area is calculated using a position coefficient that changes to 1 at the first colorimetric position and 0 at the boundary position between the superimposition area and the outside of the superimposition area. Adjust the color difference. As a result, the color difference coefficient is reflected as it is at the first colorimetric position, and the degree of correction of the color difference by the color difference coefficient disappears at the boundary position. As a result, while realizing the intended color difference at a specific position, the process of adjusting the color difference of the second projected image in the overlap region by the position coefficient and the color difference coefficient can be greatly simplified.

  (7) In the image processing device according to another aspect of the present invention, the position coefficient changes linearly within the overlap region.

  According to this aspect, since the position coefficient is linearly changed in the overlapping area, the color difference of the second projection image in the overlapping area can be adjusted using the position coefficient and the color difference coefficient with a simple process. It becomes like this.

  (8) In the image processing device according to another aspect of the present invention, the colorimetric value acquisition unit performs a third color measurement at a third colorimetric position different from the first colorimetric position within the overlap region. The color adjustment processing unit obtains a color value, and the color adjustment processing unit, based on the first colorimetric value, the second colorimetric value, and the third colorimetric value, the color of the second projection image in the superimposed region Adjust.

  According to this aspect, the third colorimetric position is provided in the overlapping region, the first colorimetric value at the first colorimetric position, the second colorimetric value at the second colorimetric position, and the third colorimetric value. Since the color of the second projected image in the superimposed region is adjusted based on the third colorimetric value at the colorimetric position, the color of the second projected image in the superimposed region is further adjusted. It becomes possible to carry out with high precision.

  (9) In the image processing device according to another aspect of the present invention, when the second projection image is displayed side by side with another projection image provided with the first superimposed region and the second superimposed region, The color adjustment processing unit adjusts the color of the second projection image in each area of the first overlapping area and the second overlapping area.

  According to this aspect, since the color of the second projection image in the superimposed region is adjusted as described above using the colorimetric values at the colorimetric positions inside and outside each superimposed region for each superimposed region, It is possible to easily remove the coloring in the superimposed region by the processing of the projector alone that projects the projection image.

  (10) In the image processing apparatus according to another aspect of the present invention, a part of the projection light corresponding to the superposition region is shielded from the projection light of the projector that projects the second projection image.

  According to this aspect, even when the tiling display is performed so that the light shielding area generated by shielding a part of the projection light of the projector is overlapped with the adjacent projection image, It becomes possible to remove the coloration of the overlapping area. In addition, since it is sufficient to process the projector alone, coloring can be easily removed.

  (11) In another aspect of the present invention, a projector that projects the second projection image on the projection surface includes any of the image processing apparatuses described above.

  According to this aspect, without being limited to the configuration, it is possible to provide a projector that can easily suppress coloring of a superimposed region of a projection image.

  (12) In another aspect of the present invention, a multi-projection system displays a first projector that projects the first projection image on the projection surface, and a side-by-side display of the first projection image by providing the overlapping region. A second projector that projects the second projection image to be projected onto the projection surface, the first colorimetric position within the superposition region, and the second outside the superposition region of the second projection image. A colorimeter that measures the color of the second projection image at the colorimetric position, and the image processing apparatus according to any one of the above.

  According to this aspect, without being limited to the configuration of the projector, it is possible to provide a multi-projection system that can easily suppress the coloring of the superimposed region of the projection image.

  (13) In another aspect of the present invention, a multi-projection system includes a first projector that projects the first projection image onto the projection surface, and a projection light of the first projector in the overlapping region. A first optical light shielding plate that shields a part of the corresponding projection light, and a second projection image that is provided side by side with the first projection image by providing the overlapping region is projected onto the projection surface. Two projectors, a second optical light shielding plate for shielding a part of the projection light corresponding to the superimposition area among the projection light of the second projector, and the first colorimetry in the superposition area A colorimeter that measures the color of the second projection image at a position and the second colorimetric position outside the overlapping region of the second projection image, and the image processing apparatus described above.

  In this aspect, the multi-projection system performs tiling display so that the light shielding area generated by shielding a part of the projection light of the projector is an overlapping area with the adjacent projection image. Even in this case, according to this aspect, it is possible to remove the coloring of the superimposed region of the projection image without being limited to the configuration of the projector. In addition, since the processing of a single projector is sufficient, a multi-projection system that can easily remove coloring can be provided.

  (14) According to another aspect of the present invention, there is provided an image processing method for correcting a second projection image displayed side by side by providing a first projection image displayed on a projection surface and an overlapping region. A first colorimetric value at a first colorimetric position within the superimposed region of the projected image, and a second colorimetric value at a second colorimetric position outside the superimposed region of the second projected image; A colorimetric value obtaining step for obtaining the colorimetric value, and a color adjustment processing step for adjusting the color of the second projected image in the superimposition region based on the first colorimetric value and the second colorimetric value. including.

  In this aspect, the overlapping area is provided and the first projection image and the second projection image are tiling-displayed. At this time, based on the first colorimetric value at the first colorimetric position within the superimposed region of the second projection image and the second colorimetric value at the second colorimetric position outside this superimposed region. Then, the color of the second projection image in the overlapping area is adjusted. Thereby, it becomes possible to remove the coloration of the superimposed region of the second projection image without being limited to the configuration of the projector. Therefore, it is possible to improve the image quality of the tiling image configured to include the first projection image and the second projection image. Furthermore, since the processing of a single projector that projects the second projection image is sufficient, coloring can be easily removed. In particular, when tiling images are displayed by a plurality of projectors, the processing can be performed for each projector.

  (15) In the image processing method according to another aspect of the present invention, among the projection light of the projector that projects the second projection image, a part of the projection light corresponding to the overlap region is shielded.

  According to this aspect, even when the tiling display is performed so that the light shielding area generated by shielding a part of the projection light of the projector is overlapped with the adjacent projection image, It becomes possible to remove the coloration of the overlapping area. In addition, since it is sufficient to process the projector alone, coloring can be easily removed.

1 is a block diagram of a configuration example of a multi-projection system in Embodiment 1. FIG. The figure which shows the outline | summary of a structure of a 1st projector. 3A and 3B are explanatory diagrams of processing of the image processing apparatus. FIG. 2 is a block diagram of a configuration example of the image processing apparatus in FIG. 1. Explanatory drawing of an example of the position coefficient memorize | stored in a position coefficient memory | storage part. Explanatory drawing of the other example of the position coefficient memorize | stored in a position coefficient memory | storage part. FIG. 5 is a flowchart of an operation example of the image processing apparatus in FIG. 4. The figure which shows typically an example of the tiling image in the case of not performing the process of FIG. The figure which shows typically an example of the tiling image in the case of performing the process of FIG. FIG. 6 is a block diagram of a configuration example of a multi-projection system in a second embodiment. FIG. 10 is a flowchart of an operation example of the image processing apparatus according to the second embodiment. The figure which shows the projection image of FIG. 10 typically. FIG. 10 is a diagram schematically illustrating an example of a tiling image in a modification of the second embodiment. FIG. 10 is an explanatory diagram illustrating an example of a colorimetric position of a projection image according to a third embodiment. FIG. 10 is an explanatory diagram of color adjustment processing in the third embodiment. FIG. 10 is an explanatory diagram of an example of a color difference coefficient in the third embodiment. FIG. 10 is an explanatory diagram of another example of the color difference coefficient in the third embodiment. FIG. 10 is a block diagram of a configuration example of an image processing apparatus according to a fourth embodiment. Explanatory drawing of the superimposition area | region in a multi-projection system. An explanatory view of a multi-projection system using an optical shading plate. Explanatory drawing of the color which appears in a projection image.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. The embodiments described below do not unduly limit the contents of the present invention described in the claims. In addition, all of the configurations described below are not necessarily indispensable configuration requirements for solving the problems of the present invention.

  In the following embodiments, a tiling image is displayed by configuring a superimposition region by overlapping a light shielding region of a projection image generated by shielding a part of the projection light of a projector with a light shielding region of another projection image. A multi-projection system will be described as an example. Therefore, an example will be described in which the overlapping area of two projection images matches the light-shielding area of each projection image that constitutes the overlapping area. However, the present invention is not limited to this.

[Embodiment 1]
FIG. 1 shows a block diagram of a configuration example of a multi-projection system according to the first embodiment of the present invention.

  The multi-projection system 10 includes a first projector 100, a second projector 200, a colorimeter 300, an image processing device 400, and an image signal supply device 500.

  The first projector 100 projects an image on a screen SCR that is a projection surface to display a projection image IMG1. An optical light shielding plate LS1 is installed between the first projector 100 and the screen SCR, and a part of the optical path of the first projector 100 is shielded. As a result, the projection image IMG1 is provided with a light shielding region SR1.

  The second projector 200 projects an image on the screen SCR and displays a projection image IMG2. An optical light shielding plate LS2 is installed between the second projector 200 and the screen SCR, and a part of the optical path of the second projector 200 is shielded. As a result, the projection image IMG2 is provided with a light shielding region SR2.

  The projected image IMG2 on the screen SCR is displayed so as to overlap with a part of the projected image IMG1 and to provide a superimposed region BR. At this time, the projection images IMG1 and IMG2 are displayed side by side on the screen SCR so that the light-shielding region SR1 of the projection image IMG1 and the light-shielding region SR2 of the projection image IMG2 are overlapped to form the overlapping region BR. That is, the optical light shielding plate LS1 shields a part of the projection light corresponding to the overlapping region BR among the projection light of the first projector 100. Further, the optical light shielding plate LS2 shields a part of the projection light corresponding to the overlapping region BR among the projection light of the second projector 200. In FIG. 1, the optical light shielding plates LS1 and LS2 are provided independently, but the optical light shielding plates LS1 and LS2 may be integrally formed.

  FIG. 2 shows an outline of the configuration of the first projector 100. FIG. 2 shows an outline of the configuration of the first projector 100, but the configuration of the second projector 200 is the same as that of FIG.

  The first projector 100 and the second projector 200 are so-called three-plate liquid crystal projectors, and a liquid crystal panel is provided for each color component as a light modulation device. The first projector 100 shown in FIG. 2 has an image projection unit. The image projection unit includes a light source device 110, an image forming unit 120, and a projection optical system 140.

  The light source device 110 includes a light source 112, a lens array 114, and a superimposing lens 116. The image forming unit 120 includes dichroic mirrors 122 and 124, reflection mirrors 126, 128, and 130, relay lenses 132 and 134, liquid crystal panels 136R, 136G, and 136B as light modulation devices, and a cross dichroic prism 138.

  Each of the liquid crystal panels 136R, 136G, and 136B is a transmissive liquid crystal panel in which a liquid crystal that is an electro-optical material is hermetically sealed in a pair of transparent glass substrates. For example, incident light is incident on a polysilicon thin film transistor as a switching element. Modulate.

  The dichroic mirror 122 separates light from the light source device 110 into red light (R) and light of other color components (green light (G) and blue light (B)). The red light separated by the dichroic mirror 122 is guided to the incident surface of the liquid crystal panel 136R by the reflection mirror 126. The green light and blue light separated by the dichroic mirror 122 are separated into green light and blue light by the dichroic mirror 124. The green light separated by the dichroic mirror 124 is incident on the incident surface of the liquid crystal panel 136G. The blue light separated by the dichroic mirror 124 is guided to the incident surface of the liquid crystal panel 136B by the reflecting mirrors 128 and 130 via the relay lenses 132 and 134.

  The liquid crystal panel 136R modulates red light. The liquid crystal panel 136G modulates green light. The liquid crystal panel 136B modulates blue light. The color lights modulated by these liquid crystal panels 136R, 136G, and 136B are combined by a cross dichroic prism 138.

  The projection optical system 140 enlarges an image formed by the light combined by the cross dichroic prism 138 and forms an image on the screen SCR.

  In such a first projector 100, when a part of the projection light projected from the projection optical system 140 is shielded, a color may appear at the display area end of the projection image IMG1. This is considered to be caused by various factors such as adjustment errors of the optical components shown in FIG. 2 and incident angle dependency such as light modulation characteristics of these optical components. The optical components include dichroic mirrors 122 and 124, a cross dichroic prism 138, and liquid crystal panels 136R, 136G, and 136B. Therefore, in the first embodiment, the image processing apparatus 400 performs color measurement on the pixels at the color measurement positions inside and outside the light shielding area. Then, based on the colorimetric value at the colorimetric position, the color difference component (Cb component and Cr component of the Y component, Cb component, and Cr component) is adjusted without changing the brightness of the pixels in the light shielding region. Remove the color.

  Therefore, in FIG. 1, the colorimeter 300 measures the colorimetric values at at least two colorimetric positions inside and outside the light shielding area near the light shielding area boundary for each light shielding area of each projection image. The colorimetric values measured by the colorimeter 300 are sent to the image processing apparatus 400.

  The image processing apparatus 400 performs given image processing using the image signal from the image signal supply apparatus 500 as an input image signal, and synchronizes the image signal after the image processing with the first projector 100 and the second projector 200. Output while taking. More specifically, the image processing apparatus 400 receives the colorimetric values at the colorimetric positions provided in the projection images IMG1 and IMG2 displayed on the screen SCR from the colorimeter 300, and uses the colorimetric values to perform each measurement. Color adjustment by color difference is performed for each light shielding area of the projection area.

  3A and 3B are explanatory diagrams of processing of the image processing apparatus 400. FIG. FIG. 3A shows an example of a colorimetric position in the projection image IMG2. FIG. 3B shows an example of the projection image IMG2 after being processed by the image processing apparatus 400. In FIGS. 3A and 3B, there is a limit to the expression of color according to the drawings, and the color is expressed by gradation.

  For example, the colorimeter 300 determines the pixel P1 at the colorimetric position (first colorimetric position) in the light-shielding region SR2 and the pixel P2 at the colorimetric position (second colorimetric position) outside the light-shielding region SR2. Measure the color. Thereby, the colorimeter 300 obtains a colorimetric value (first colorimetric value) in the pixel P1 and a colorimetric value (second colorimetric value) in the pixel P2. When the image processing apparatus 400 acquires the colorimetric values at the pixels P1 and P2 from the colorimeter 300, the color difference of the pixel P1 (for example, the Cb component and the Cr component; the same applies below) is set so that the color difference of the pixel P2 matches. Make adjustments. In other words, the image processing apparatus 400 corrects the color difference of the pixel at the colorimetric position within the light shielding region so as to match the color difference of the pixel at the colorimetric position outside the light shielding region. The image processing apparatus 400 performs the correction based on the color difference in the same manner for each light shielding area of the projection image by each projector. Thereby, coloring is suppressed without changing the brightness of the light shielding area (superimposed area, colored area by light shielding).

  In FIG. 1, an image signal supply device 500 generates an image signal corresponding to an image projected on a screen SCR that is a projection surface, and supplies the image signal to the image processing device 400. Such a function of the image signal supply device 500 is realized by a DVD (Digital Versatile Disc) device, a personal computer (PC), or the like.

  According to the multi-projection system 10 as described above, it is possible to remove the coloring in the light shielding region by the optical light shielding plate without changing the brightness, so that the image quality of the tiling image can be improved. Further, since the processing can be performed for each projector, it is simple.

  The image processing apparatus 400 in FIG. 1 is provided outside the first projector 100 and the second projector 200, but may be incorporated in one of the first projector 100 and the second projector 200. Good. Also, the image signal supply device 500 in FIG. 1 may be built in the image processing device 400. One of the first projector 100 and the second projector 200 may incorporate an image processing apparatus 400 having the function of the image signal supply apparatus 500.

  Details of the image processing apparatus 400 of FIG. 1 will be described below.

  FIG. 4 shows a block diagram of a configuration example of the image processing apparatus 400 of FIG.

  The image processing apparatus 400 includes an image dividing unit 410, a color adjustment processing unit 420, a color difference coefficient calculating unit 430, a position coefficient storage unit 440, and an image display control unit 450.

  The image dividing unit 410 divides an image represented by an input image signal from the image signal supply device 500 according to the number of projectors constituting the multi-projection system 10 and the resolution of an image to be displayed. Then, the image dividing unit 410 performs processing for generating an image signal corresponding to each projector that projects the divided images. The image signal divided by the image dividing unit 410 is input to the color adjustment processing unit 420.

The color adjustment processing unit 420 performs a process of adjusting the color by correcting the color difference of the pixel in the light shielding region with respect to the corresponding image signal for each projector. For example, the color adjustment processing unit 420 uses the color difference coefficient based on the colorimetric value from the colorimeter 300 and the position coefficient indicating the dependency of the pixel position in the light-shielding area to determine the color of the pixel in the light-shielding area ( The color difference component is adjusted. More specifically, the color adjustment processing unit 420 performs color adjustment based on the color difference on the pixels in the light shielding area according to the following expression. In the following, pixel values are defined in a YCbCr color space represented by a luminance signal Y and two color difference signals Cb and Cr.

Expression (1) is a process performed by the color adjustment processing unit 420 when the pixel position at the edge of the display area, which is the boundary between the light-shielding area and the non-light-shielding area, is 0, and the pixel position at the light-shielding end, which is the end of the light-shielding area Represents the contents of In the formula _(1), Cb _in, the _{Cr in} a color difference of a pixel to be processed in the horizontal pixel position x of the light blocking region. _Moreover, Cb ou _t, chrominance of the pixel after _{Cr out} the color adjustment _processing, Coef _Cb, Coef _Cr color difference coefficients, Coef (x) indicates the position coefficient corresponding to the pixel position x.

The color difference coefficient calculation unit 430 functions as a colorimetric value acquisition unit that acquires a colorimetric value from the colorimeter 300, calculates a color difference coefficient based on the colorimetric values inside and outside the light-shielding region, and uses the color difference coefficient as a color The result is output to the adjustment processing unit 420. More specifically, the color difference coefficient calculation unit 430 once obtains the color difference corresponding to the colorimetric values inside and outside the light shielding area, and then, according to the following formula, the color difference coefficients Coef _Cb and Coef corresponding to the colorimetric values inside and outside the light shielding area. Calculate _Cr .

In the formula (2), Equation _(3), Cb m, Cr _m is colorimetric values in colorimetric position of the light blocking region, Cbt, color difference Crt is to a colorimetric values in colorimetric position outside the light shielding area target Is a value corresponding to. The color measurement position outside the light shielding area is desirably a position as close as possible to the boundary inside and outside the light shielding area. Thus, the color difference coefficient is calculated as the ratio of the colorimetric value at the colorimetric position outside the light-shielding region to the colorimetric value at the colorimetric position within the light-shielding region. For example, it is desirable that the colorimetric position in the light shielding area is an intermediate position between the display area end and the light shielding end. At this time, the color differences corresponding to the colorimetric values of the pixel P1 are Cb _m and Cr _m , and the color differences corresponding to the colorimetric values of the pixel P2 are Cb _t and Cr _t .

  In the position coefficient storage unit 440, coefficients corresponding to the horizontal pixel positions x in the light-shielding region are stored in a table in advance, and the color adjustment processing unit 420 stores coefficients corresponding to the positions of the pixels to be processed. Is read out from the position coefficient storage unit 440 and color adjustment processing is performed. More specifically, the position coefficient storage unit 440 has a given position coefficient of 1 at the colorimetric position in the light shielding area, where 0 is the pixel position at the end of the display area and 1 is the pixel position at the light shielding end. A position coefficient corresponding to each pixel position is stored according to the function. The position coefficient is 0 at the boundary position between the light shielding area and the outside of the light shielding area.

  FIG. 5 is an explanatory diagram illustrating an example of the position coefficient stored in the position coefficient storage unit 440. In FIG. 5, the horizontal axis represents the pixel position x and the vertical axis represents Coef (x).

As shown in FIG. 5, when the pixel position at the edge of the display area is 0, the pixel position at the light shielding end is 1, and the pixel position of the colorimetric position, which is the central part in the light shielding area, is 0.5, the position coefficient is It is stored in the position coefficient storage unit 440 corresponding to each pixel position according to the function of the equation.

  Formula (4) is applied in the range of 0 ≦ x ≦ 1. As shown in Expression (4), the position coefficient is a coefficient that adjusts the intensity of application of the color difference coefficient according to the position in the light shielding area, and is a coefficient that changes according to the distance from the display area edge to the light shielding end. . In Equation (4), the colorimetric position is set to x = 0.5. However, the colorimetric position is not limited to this, and the value (intercept) of Coef (x) at the display end point depends on the colorimetric position. Changes. As described above, the position coefficient storage unit 440 stores a position coefficient corresponding to each pixel position according to a given function in which the position coefficient at the colorimetric position in the light-shielding region is 1. The position coefficient is not limited to one that changes according to the linear function shown in FIG.

  FIG. 6 is an explanatory diagram of another example of the position coefficient stored in the position coefficient storage unit 440. In FIG. 6, similarly to FIG. 5, the horizontal axis represents the pixel position x, and the vertical axis represents Coef (x).

  As shown in FIG. 6, assuming that the pixel position at the edge of the display area is 0, the pixel position at the light shielding end is 1, and the pixel position at the colorimetric position at the center in the light shielding area is 0.5, the position shown in FIG. The coefficient is also set so that the position coefficient at the colorimetric position in the light shielding area is 1. In this way, not only the linear function shown in FIG. 5, but corresponding to each pixel position according to an upward convex function such that the position coefficient at the light shielding end is 0 and the position coefficient at the colorimetric position in the light shielding area is 1. The position coefficient may be stored in the position coefficient storage unit 440.

  Using the position coefficient as described above, the degree of color adjustment by the color difference coefficient can be changed. As a result, the color difference in the light shielding area can be corrected according to the coloration of the light shielding area and the shape of the light shielding area, so that the color can be adjusted with higher accuracy. When the light-shielding region and the superimposition region match, it is possible to adjust the color difference in the superimposition region with high accuracy in accordance with the coloration of the superimposition region and the shape of the superimposition region.

  The color adjustment processing unit 420 performs the above color adjustment processing by measuring colors at the colorimetric positions inside and outside the light shielding area for each light shielding area of the projection image projected by the projector. The image display control unit 450 outputs the image signal that has been color-adjusted as described above for each light-shielding region of the projection image of the projector to each of the first projector 100 and the second projector 200 while synchronizing them. To do.

  FIG. 7 shows a flowchart of an operation example of the image processing apparatus 400 of FIG. FIG. 7 shows the processing contents that the image processing apparatus 400 performs when adjusting the color of the light shielding area.

  The image processing apparatus 400 is configured by an application specific integrated circuit (ASIC) or dedicated hardware, and hardware corresponding to each unit in FIG. 4 can execute processing corresponding to each step in FIG. 7. Alternatively, the image processing apparatus 400 includes a central processing unit (hereinafter referred to as “CPU”), a read only memory (hereinafter referred to as “ROM”), or a random access memory (hereinafter referred to as “RAM”). May be. In this case, the CPU that has read the program stored in the ROM or RAM can execute the processing corresponding to each step in FIG. 7 by executing the processing corresponding to the program.

  The image processing apparatus 400 calculates the colorimetric values at the colorimetric positions inside and outside the light-shielded area for each light-shielded area of the projected image by each projector provided when tiling the image divided by the image dividing unit 410. Obtained from 300 (step S10).

Subsequently, in the color difference coefficient calculation unit 430, the image processing apparatus 400 calculates the color difference coefficients Coef _Cb and Coef _Cr as described above (step S12). The color difference coefficients Coef _Cb and Coef _Cr calculated by the color difference coefficient calculation unit 430 are sent to the color adjustment processing unit 420.

In the image processing apparatus 400, the color adjustment processing unit 420 performs a process of adjusting the color of each pixel in the light shielding area. That is, the color adjustment processing unit 420 first reads a position coefficient corresponding to the pixel position to be processed from the position coefficient storage unit 440. Then, the color adjustment processing unit 420 adjusts the color of each pixel in the light shielding region using the position coefficient and the color difference coefficients Coef _Cb and Coef _Cr calculated by the color difference coefficient calculation unit 430 (step S14). .

  Thereafter, in the image display control unit 450, the image processing apparatus 400 supplies the image signal whose color has been adjusted in step S14 to each projector (step S16), and ends a series of processes (end). In step S <b> 16, the image division unit 410 that has received the image signal from the image signal supply device 500 uses an image signal corresponding to an image obtained by dividing the image represented by the image signal for each projector.

  Thereby, for example, the color difference of the pixel at the colorimetric position within the light shielding area matches the color difference of the pixel at the colorimetric position outside the light shielding area. For other pixel positions, coloring is suppressed without changing the brightness according to the equation (1) for each light-shielding region of the projection image by each projector.

  FIG. 8 schematically shows an example of a tiling image when the process of FIG. 7 is not performed. FIG. 8 shows an example of an image in the case where each of the light-shielding region SR1 of the projection image IMG1 and the light-shielding region SR2 of the projection image IMG2 has a tint and is simply tiled by providing an overlapping region.

  As shown in FIG. 8, when the light-shielding region SR1 of the projection image IMG1 and the light-shielding region SR2 of the projection image IMG2 are overlapped and the projection images IMG1 and IMG2 are arranged side by side as overlapping regions, different colors are obtained in the superimposition region and the non-superimposition region Remains. On the other hand, in the process of FIG. 7, coloring of the light shielding area is suppressed for each projection image.

  FIG. 9 schematically shows an example of a tiling image when the processing of FIG. 7 is performed. FIG. 9 shows an example of an image in the case where each of the light-shielding region SR1 of the projection image IMG1 and the light-shielding region SR2 of the projection image IMG2 has a tint and is tiled by providing an overlapping region after the processing of FIG.

  As shown in FIG. 9, in the light shielding region SR1 of the projection image IMG1, the color difference of the pixel P11 at the colorimetric position in the light shielding region SR1 is adjusted to match the color difference of the pixel P12 at the colorimetric position outside the light shielding region SR1. The other pixels are adjusted according to, for example, the equation (1). Similarly, in the light shielding region SR2 of the projection image IMG2, the color difference of the pixel P21 at the colorimetric position in the light shielding region SR2 is adjusted to match the color difference of the pixel P22 at the colorimetric position outside the light shielding region SR2. Are adjusted according to, for example, equation (1). Even if the projection images IMG1 and IMG2 are arranged side by side by overlapping the light shielding region SR1 of the projection image IMG1 after color adjustment and the light shielding region SR2 of the projection image IMG2 after color adjustment, the superposition region and the non-superimposition region are arranged. And no color remains.

  As described above, in the first embodiment, when a tiling image is displayed by overlapping the light shielding regions provided by the optical light shielding plate, color adjustment based on the color difference is performed for each light shielding region of each projection image. . As a result, it is possible to remove the coloring in the light shielding region by the optical light shielding plate without changing the brightness. Moreover, since processing can be performed for each projector, it can be realized by a simple method.

[Embodiment 2]
In the first embodiment, an example in which tiling images are displayed by two projectors has been described. However, when tiling images are displayed by three or more projectors, an overlapping area of adjacent projection images is also provided. Applicable.

  FIG. 10 is a block diagram showing a configuration example of the multi-projection system according to the second embodiment of the present invention. 10, parts that are the same as those in FIG. 1 are given the same reference numerals, and descriptions thereof are omitted as appropriate.

  The multi-projection system 10a according to the second embodiment includes a first projector 100, a second projector 200, and a third projector 600. Further, the multi-projection system 10a includes optical light shielding plates LS1, LS2, LS3, LS4, a colorimeter 300, an image processing device 400a, and an image signal supply device 500. The main difference between the multi-projection system 10a and the multi-projection system 10 shown in FIG. 1 is that the third projector 600 projects an image on the screen SCR, and provides a projected image IMG2 and a superimposed region to display the projected image IMG3. It is a point to do.

  More specifically, the projection images IMG1, IMG2, and IMG3 are displayed side by side in order in the horizontal direction of the screen SCR. For this reason, part of the projection light from the second projector 200 is shielded by the optical shielding plate LS3, and the projection image IMG2 is provided with the shielding region SR3 in addition to the shielding region SR2. The light shielding regions SR2 and SR3 are respectively provided at both ends in the horizontal direction of the projection image IMG2. Further, part of the projection light from the third projector 600 is shielded by the optical shielding plate LS4, and the projection image IMG3 is provided with a shielding region SR4. Then, the projection images IMG2 and IMG3 are displayed side by side so that the light shielding regions SR3 and SR4 constitute the overlapping region.

  The colorimeter 300 measures colors at the colorimetric positions inside and outside the light-shielding areas of the projection images IMG1, IMG2, and IMG3, and sends the colorimetric values of the pixels at the colorimetric positions to the image processing apparatus 400a. The image processing apparatus 400a performs the color adjustment as described above for each light-shielding region of each projection image, and outputs the color-adjusted image signal to each of the first projector 100, the second projector 200, and the third projector 600. , Output while synchronizing with each other. The configuration of the image processing apparatus 400a is the same as the configuration of the image processing apparatus shown in FIG.

  FIG. 11 is a flowchart illustrating an operation example of the image processing apparatus 400a according to the second embodiment. FIG. 11 shows the contents of processing performed by the image processing apparatus 400a when adjusting the color of the light shielding area.

  Similar to the image processing apparatus 400, the image processing apparatus 400a is configured by an ASIC or dedicated hardware, and hardware corresponding to each unit in FIG. 4 can execute processing corresponding to each step in FIG. Alternatively, the image processing apparatus 400a may be configured by a CPU, ROM, or RAM. In this case, the CPU that has read the program stored in the ROM or RAM can execute the process corresponding to each step in FIG. 11 by executing the process corresponding to the program.

  The image processing apparatus 400a calculates the colorimetric values at the colorimetric positions inside and outside the light shielding area for each light shielding area of the projection image of each projector provided when tiling the image divided by the image dividing unit 410. (Step S30, Step S32). Specifically, the colorimetric values at the colorimetric positions inside and outside the light shielding region SR1 of the projection image IMG1 and the colorimetric values at the colorimetric positions within the light shielding region SR2 of the projection image IMG2 are acquired (step S30). Thereafter, the colorimetric values at the colorimetric positions inside and outside the light shielding region SR3 of the projection image IMG2 and the colorimetric values at the colorimetric positions within the light shielding region SR4 of the projection image IMG3 are acquired (step S32).

  FIG. 12 schematically shows the projection images IMG1, IMG2, and IMG3 of FIG. 12, parts similar to those in FIG. 8 are given the same reference numerals, and description thereof will be omitted as appropriate.

  In step S30 and step S32 in FIG. 11, the colorimetric values at the colorimetric positions inside and outside the light-shielding area are acquired for each light-shielding area of the projected images displayed side by side. That is, the colorimeter 300 performs colorimetry on the pixels P11 and P12 with the pixel P11 in the light-shielding region SR1 of the projection image IMG1 as one colorimetric position and the pixel P12 outside the light-shielded region SR1 as the other colorimetric position. . Further, the colorimeter 300 performs colorimetry on the pixels P21 and P22 with the pixel P21 in the light shielding region SR2 of the projection image IMG2 as one colorimetric position and the pixel P22 outside the light shielding region SR2 as the other colorimetric position. . Further, for the projection image IMG2, the colorimeter 300 uses the pixel P31 in the light shielding region SR3 as one colorimetric position and the pixel P32 outside the light shielding region SR3 as the other colorimetric position, and the colorimeter 300 performs colorimetry on the pixels P31 and P32. To do. Then, the colorimeter 300 performs colorimetry on the pixels P41 and P42 with the pixel P41 in the light shielding region SR4 of the projection image IMG3 as one colorimetric position and the pixel P42 outside the light shielding region SR4 as the other colorimetric position. .

Subsequently, in the color difference coefficient calculation unit 430, the image processing apparatus 400a uses the colorimetric values acquired in step S30 and step S32 for each light shielding area, and the color difference coefficients Coef _Cb and Coef _Cr as in the first embodiment. Is calculated (step S34). The color difference coefficients Coef _Cb and Coef _Cr corresponding to each light shielding area calculated by the color difference coefficient calculation unit 430 are sent to the color adjustment processing unit 420.

In the image processing apparatus 400 a, the color adjustment processing unit 420 reads a position coefficient corresponding to the pixel position to be processed from the position coefficient storage unit 440. The color adjustment processing unit 420 adjusts the color of each pixel in the light shielding region using the position coefficient and the color difference coefficients Coef _Cb and Coef _{Cr of} each light shielding region calculated by the color difference coefficient calculating unit 430 (step S36).

  Thereafter, in the image display control unit 450, the image processing apparatus 400a supplies the image signal whose color is adjusted in step S36 to each projector (step S38), and ends a series of processes (end). In step S38, an image signal corresponding to an image obtained by dividing the image represented by the image signal for each projector by the image dividing unit 410 that has received the image signal from the image signal supply device 500 is used.

  As described above, for each light shielding region of the projection image, coloring is suppressed without changing the brightness of the pixels in the light shielding region according to the equation (1). As a result, even when the left and right colors of the light-shielding region are different in the projector alone, coloring can be suppressed without changing the brightness, and deterioration of the image quality of the tiling image can be prevented. Even when tiling images using projection images of three or more projectors are displayed, the processing can be simplified because the processing of a single projector is sufficient.

  In the second embodiment, an example in which a tiling image including three projection images in the horizontal direction and one projection image in the vertical direction is displayed has been described. However, the present invention is not limited to this.

  FIG. 13 schematically shows an example of a tiling image in a modification of the second embodiment.

  In FIG. 13, the projection image IMG1, the projection image IMG2, the projection image IMG3, and the projection image IMG4 are displayed side by side in the horizontal direction. Further, in FIG. 13, the projection image IMG1, the projection image IMG3, the projection image IMG2, and the projection image IMG4 are displayed side by side in the vertical direction. Each projection image is provided with a light shielding area so as to coincide with the overlapping area with the adjacent projection image. For example, the projection image IMG1 is provided with a light shielding region so as to coincide with the overlapping regions SR10 and SR11 of the adjacent projection images IMG2 and IMG3. Similarly, the projection image IMG2 is provided with a light shielding region so as to coincide with the overlapping regions SR10 and SR12 with the adjacent projection images IMG1 and IMG4.

  The image processing apparatus according to the modification of the second embodiment suppresses coloring without changing the brightness in accordance with the formula (1) for each light-shielding region of the projection image. For example, for the projection image IMG1, the color adjustment is performed without changing the brightness in accordance with the equation (1) in each of the light-shielding region constituting the superimposition region SR10 and the light-shielding region constituting the superposition region SR11.

[Embodiment 3]
In the first embodiment or the second embodiment, the pixels in the light shielding region are based on the colorimetric values of the pixels at one colorimetric position within the light shielding region and the colorimetric values of the pixels at one colorimetric position outside the light shielding region. However, the present invention is not limited to this. In Embodiment 3 according to the present invention, a plurality of colorimetric positions are provided in the light shielding area, and the colorimetric values of the pixels at each colorimetric position in the light shielding area and the colorimetric values of the pixels at the colorimetric positions outside the light shielding area. Based on the above, the color of the pixel in the light shielding area is adjusted.

  FIG. 14 is an explanatory diagram showing an example of the colorimetric position of the projection image IMG2 in the third embodiment. FIG. 14 illustrates the projection image IMG2 as an example, but the same applies to other projection images.

  In the third embodiment, for example, the colorimetric values of the pixels P2a, P2b, and P2c at three colorimetric positions in the light shielding region SR2 and the colorimetric values of the pixel P2d at one colorimetric position outside the light shielding region SR2 are acquired. The Pixels P2a, P2b, P2c, and P2d are images arranged in the horizontal direction. At this time, the color of the pixels in the light shielding region SR2 is adjusted so that at least the color differences of the pixels P2a, P2b, and P2c in the light shielding region SR2 coincide with the color differences of the pixel P2d.

  Of the three colorimetric positions in the light shielding region SR2, the colorimetric position in the pixel P2b is the central portion in the light shielding region. The color measurement position in the pixel P2a is provided between the color measurement position in the pixel 2b and the display area end, and the color measurement position in the pixel P2c is provided between the color measurement position in the pixel P2b and the light shielding area end. It is done.

  Here, for example, if the pixel position of the pixel P2a is the first colorimetric position, the pixel position of the pixel P2d is the second colorimetric position, and the pixel position of the pixel P2b or pixel P2c is the third colorimetric position, In the third embodiment, color adjustment can be performed as follows. First, the first colorimetric value at the first colorimetric position, the second colorimetric value at the second colorimetric position, and the third colorimetric position at a third colorimetric position different from the first colorimetric position. Colorimetric values are acquired. Then, based on the first colorimetric value, the second colorimetric value, and the third colorimetric value, the color difference in the light-shielding region SR2 that constitutes the overlapping region is adjusted.

  Note that a line scanner, a digital camera, or the like that performs line scanning on the screen SCR can be employed as a colorimeter that performs colorimetry on the colorimetric position as shown in FIG.

  FIG. 15 is an explanatory diagram of color adjustment processing in the third embodiment. FIG. 15 illustrates the projection image IMG2 as an example, but the same applies to other projection images.

  In the third embodiment, the image processing apparatus calculates a color difference coefficient for each section divided according to the colorimetric position in the light shielding area. The color difference coefficient is obtained for each section as the ratio of the color difference of the pixel P2a to the color difference of the pixel P2d, the ratio of the color difference of the pixel P2b to the color difference of the pixel P2d, and the ratio of the color difference of the pixel P2c to the color difference of the pixel P2d. Then, for each section in the light shielding area, the color of each section is adjusted using the color difference coefficient of each section.

FIG. 16 illustrates an example of color difference coefficients according to the third embodiment. FIG. 16 shows the pixel position x on the horizontal axis and the Coef _Cb on the vertical axis for the light shielding region SR2 of the projection image IMG2, but the same applies to the color difference coefficients in the light shielding regions of Coef _Cr and other projection images.

  As shown in FIG. 16, assuming that the pixel position at the edge of the display area is 0 and the pixel position at the light shielding end is 1, the color difference coefficient is calculated for each section divided at the colorimetric position provided in the light shielding area ( It is calculated according to 2). For example, as shown in FIG. 16, the color of the pixels in the light shielding region can be adjusted using a color difference coefficient that changes stepwise for each section.

  Note that the color difference coefficient used for adjusting the color of the pixel in the light shielding region is not limited to that shown in FIG.

FIG. 17 is an explanatory diagram of another example of the color difference coefficient in the third embodiment. FIG. 17 shows the pixel position x on the horizontal axis and Coef _Cb on the vertical axis for the light shielding region SR2 of the projection image IMG2 as in FIG. 16, but the color difference coefficients in the light shielding regions of Coef _Cr and other projection images are also shown. It is the same.

  As shown in FIG. 17, assuming that the pixel position at the edge of the display area is 0 and the pixel position at the light shielding end is 1, the color difference coefficient at the representative point of each section is expressed by the equation (2) at the colorimetric position provided in the light shielding area. ). Then, the color difference coefficient of each pixel position in the light shielding area is obtained by linear interpolation, passing through the color difference coefficient of each section and changing linearly according to the pixel position x, and using this color difference coefficient, The color of the pixel can be adjusted.

  In the third embodiment, it is desirable to use the same position coefficient as in the first embodiment. As a result, the color of the pixels in the light shielding region can be adjusted in the same manner as Equation (1) while varying the color difference coefficient for each section in the light shielding region.

  In the third embodiment, an example in which a plurality of colorimetric positions are provided and the color difference coefficient is calculated for each colorimetric position has been described. However, the color difference coefficient is calculated for each pixel in the light shielding area as described above, and linear interpolation is performed. The color in the light shielding area may be adjusted using the calculated color difference coefficient without performing the above.

[Embodiment 4]
Although Embodiment 1-Embodiment 3 demonstrated as what applies one type of position coefficient, this invention is not limited to this.

  FIG. 18 is a block diagram showing a configuration example of the image processing apparatus according to the fourth embodiment of the present invention. 18, the same parts as those in FIG. 4 are denoted by the same reference numerals, and description thereof will be omitted as appropriate.

The image processing apparatus 400b according to the fourth embodiment includes an image dividing unit 410, a color adjustment processing unit 420b, a color difference coefficient calculating unit 430, position coefficient storage units 440 _{1 to} 440 _n (n is an integer of 2 or more), and an image display control unit 450. including. The image processing apparatus 400b is different from the image processing apparatus 400 shown in FIG. 4 in that n types of position coefficients are stored, and the color adjustment processing unit 420b uses one type of position coefficients among the n types of position coefficients. The point is to adjust the color of the pixels in the light shielding area according to the equation (1).

  In this way, when a plurality of light shielding regions are provided in one projection image, the color of the pixels in the light shielding regions can be adjusted using different position coefficients for each light shielding region. Alternatively, even when the area of the light-shielding region is different for each projector that projects the projection image, the color of the pixels in the light-shielding region of the projection image can be adjusted using the position coefficient corresponding to the projection image. Become.

The position coefficient stored in each of the position coefficient storage units 440 _{1 to} 440 _n may be stored so as to change linearly with respect to the pixel position x as shown in FIG. 5, or as shown in FIG. The pixel position x may be stored so as to change according to a given function.

  According to the fourth embodiment, the color difference of the pixels in the light shielding area can be accurately adjusted according to the light shielding area of the projection image, and the image quality of the tiling image can be improved with simple processing.

  As described above, according to any one of the first to fourth embodiments, it is possible to suppress coloring of the light shielding region provided in the projection image by shielding part of the projection light of the projector. In addition, since processing by a single projector is sufficient, even when a tiling image is displayed side by side with other projection images, it can be realized by simple processing. Further, even when a projector that projects other projected images does not cause coloring with a laser light source or the like, coloring can be removed regardless of the projector.

  The image processing apparatus, the projector, the multi-projection system, the image processing method, and the like according to the present invention have been described above based on any one of the above-described embodiments or modifications thereof. It is not limited to the modification. The present invention can be implemented in various modes without departing from the gist thereof, and for example, the following modifications are possible.

  (1) In any one of the above-described embodiments or modifications thereof, an example in which the color of a pixel in a light-shielding region provided in a projection image is adjusted by shielding part of the projection light of the projector has been described. Is not limited to this. The present invention can be applied to the case where the color appearing in the overlapping region with another projection image is adjusted due to a factor other than light shielding. That is, the present invention can be applied to an apparatus that adjusts the color of a pixel in a superimposed area of a projection image provided when a tiling image is displayed.

  (2) In any of the above-described embodiments or modifications thereof, an example has been described in which the ratio of colorimetric values inside and outside the light-shielding region is adopted as the color difference coefficient, but the present invention is not limited to this, It is not limited to the method for calculating the color difference coefficient.

  (3) In any of the above embodiments or modifications thereof, an example in which the projector is configured by a light modulation device using a so-called three-plate transmissive liquid crystal panel has been described. However, a light modulation device using a single-plate liquid crystal panel or a transmissive liquid crystal panel of two or four plates or more can be employed. Further, as a light modulation device that constitutes the projector, for example, DLP (Digital Light Processing) (registered trademark), LCOS (Liquid Crystal On Silicon), or the like may be employed.

  (4) In any of the above-described embodiments or modifications thereof, a multi-projection system including two or more liquid crystal projectors has been described as an example, but the present invention is not limited to this. The multi-projection system according to the present invention may be composed of a liquid crystal projector and other projectors, or may be composed of a plurality of projectors other than the liquid crystal projector.

  (5) In any of the above-described embodiments or modifications thereof, the present invention has been described as an image processing device, a projector, a multi-projection system, an image processing method, and the like, but the present invention is not limited to this. . For example, it may be a program in which the processing procedure of the image processing method according to the present invention is described, or a recording medium on which the program is recorded.

  (6) In any of the above-described embodiments or modifications thereof, an example has been described in which the color difference is adjusted for all projectors included in the multi-projection system, but the present invention is not limited to this. For example, the color difference may be adjusted for at least one projector among all the projectors included in the multi-projection system. That is, when the multi-projection system includes M (M is a natural number of 2 or more) projectors, the present invention includes a case where the color difference is adjusted for N (N <M, N is a natural number) projectors. Thereby, when coloring occurs in N projectors out of M projectors and coloring does not occur in other projectors, coloring can be suppressed by performing such adjustment. .

10 ... multi-projection system, 100 ... first projector,
200 ... second projector, 300 ... colorimeter,
400, 400a, 400b ... image processing apparatus, 410 ... image dividing unit,
420, 420b ... color adjustment processing unit, 430 ... color difference coefficient calculation unit,
440, 440 _{1 to} 440 _n ... position coefficient storage unit, 450 ... image display control unit,
500 ... Image signal supply device 600 ... Third projector,
IMG1, IMG2, IMG3, IMG4 ... projected image,
LS1, LS2, LS3, LS4 ... optical shading plate, SCR ... screen,
SR1, SR2, SR3, SR4...
SR10, SR11, SR12, SR13 ... Superimposition region

Claims (15)

An image processing device that corrects a first projection image displayed on a projection surface and a second projection image that is displayed side by side with a superimposed region,
The first colorimetric value at the first colorimetric position in the superimposition region of the second projection image and the second colorimetry at the second colorimetry position outside the superposition region of the second projection image. A colorimetric value acquisition unit for acquiring color values;
An image processing apparatus comprising: a color adjustment processing unit configured to adjust a color of the second projection image in the superposition region based on the first color measurement value and the second color measurement value. . In claim 1,
The color adjustment processing unit
The color of the second projection image in the superimposed region is adjusted so that at least the color corresponding to the colorimetric value at the first colorimetric position matches the color corresponding to the second colorimetric value. An image processing apparatus. In claim 1 or 2,
The color adjustment processing unit
An image processing apparatus that adjusts a color of the second projection image in the superimposed region by adjusting a color difference. In claim 3,
A color difference coefficient calculating unit that calculates a color difference coefficient obtained by a ratio of a color difference corresponding to the second colorimetric value with respect to a color difference corresponding to the first colorimetric value;
The color adjustment processing unit
An image processing apparatus that adjusts a color difference of the second projection image in the superimposed region using the color difference coefficient. In claim 4,
The color adjustment processing unit
An image processing apparatus that adjusts a color difference of the second projection image in the superimposition area using the color difference coefficient and a position coefficient corresponding to the position of each pixel in the superposition area. In claim 5,
The position coefficient changes to be 1 at the first colorimetric position and to be 0 at a boundary position between the superposition area and the superposition area,
The color adjustment processing unit
Image processing for adjusting the color difference of each pixel of the second projection image in the superimposition region by multiplying the color difference component of each pixel in the superimposition region by the color difference coefficient and the position coefficient apparatus. In claim 6,
The image processing apparatus according to claim 1, wherein the position coefficient changes linearly within the overlap region. In any one of Claims 1 thru | or 7,
The colorimetric value acquisition unit
Obtaining a third colorimetric value at a third colorimetric position different from the first colorimetric position within the superimposed region;
The color adjustment processing unit
An image processing apparatus that adjusts the color of the second projection image in the superposition region based on the first color measurement value, the second color measurement value, and the third color measurement value. In any one of Claims 1 thru | or 8.
When the second projection image is displayed side by side with another projection image by providing a first superimposition region and a second superimposition region, the color adjustment processing unit is configured to display the first superimposition region and the second superimposition region. An image processing apparatus that adjusts the color of the second projection image in each of the overlapping regions. In any one of Claims 1 thru | or 8.
An image processing apparatus, wherein a part of the projection light corresponding to the superimposed region is shielded from the projection light of the projector that projects the second projection image. A projector that projects the second projection image on the projection surface,
A projector comprising the image processing apparatus according to claim 1. A first projector that projects the first projection image onto the projection surface;
A second projector for projecting the second projection image, which is provided side by side with the first projection image by providing the overlapping region, on the projection surface;
A colorimeter that measures the color of the second projected image at the first colorimetric position within the superimposed region and the second colorimetric position outside the superimposed region of the second projected image;
A multi-projection system comprising: the image processing apparatus according to claim 1. A first projector that projects the first projection image onto the projection surface;
A first optical light shielding plate for shielding a part of the projection light corresponding to the superimposition region among the projection light of the first projector;
A second projector for projecting the second projection image, which is provided side by side with the first projection image by providing the overlapping region, on the projection surface;
A second optical light shielding plate for shielding a part of the projection light corresponding to the superimposition region among the projection light of the second projector;
A colorimeter that measures the color of the second projected image at the first colorimetric position within the superimposed region and the second colorimetric position outside the superimposed region of the second projected image;
A multi-projection system comprising: the image processing apparatus according to claim 10. An image processing method for correcting a first projection image displayed on a projection surface and a second projection image displayed side by side by providing a superimposed region,
The first colorimetric value at the first colorimetric position in the superimposition region of the second projection image and the second colorimetry at the second colorimetry position outside the superposition region of the second projection image. A colorimetric value acquisition step for acquiring a color value;
A color adjustment processing step of adjusting a color of the second projection image in the superposition region based on the first color measurement value and the second color measurement value. . In claim 14,
An image processing method, wherein a part of the projection light corresponding to the superimposed region is shielded from the projection light of the projector that projects the second projection image.