JP5320558B2 - Imaging system and imaging method - Google Patents

Description

  The present invention relates to a method for extracting a partial image of a subject.

For example, Patent Document 1 discloses an apparatus that captures a subject with a camera, combines a frame image with the captured image, and prints the combined image as a photographic print.
JP 2000-32249 A

  The present invention has been made based on the above-described background, and an object thereof is to provide a photographing system that extracts a partial image of a subject from a photographed subject image.

  In order to achieve the above object, a photographing system according to the present invention includes a photographing means for photographing a subject, a first coloring member that develops a predetermined color, and a second coloring member that develops a predetermined color. Image extraction for extracting an image of a part of a subject from an image photographed by the photographing means based on the color developing member, the color of the first color developing member, and the color of the second color developing member And the first coloring member is disposed between the subject and the photographing unit, and the second coloring member is disposed in a background area of the subject.

  Preferably, the first coloring member is held so as not to be wrinkled at least during photographing.

  Preferably, the first coloring member is held in a state of being fixed to a predetermined width at least at the time of photographing, and an image of a part of the subject extracted by the image extracting means and another image And an image composition means for composing the image, and at least one of a part of the image of the subject synthesized by the image composition means and another image is set to an amount of protrusion of the subject protruding in the width direction from the first coloring member. And a correction means for correcting based on.

  Preferably, the first color forming member is held in a fixed state at a predetermined width at least during photographing, and is based on the amount of protrusion of the subject that protrudes in the width direction from the first color developing member. An image selecting means for selecting another image to be combined, an image combining means for combining a part of the image of the subject extracted by the image extracting means and the other image selected by the image selecting means, It has further.

  A photographing method according to the present invention is a photographing method using a photographing device, and a coloring member that develops a predetermined color is disposed between the subject and the photographing device and in a background region of the subject. In such a state, a photographing step for photographing the subject by the photographing device, and an extraction step for extracting a partial image of the subject from the images photographed by the photographing device based on the color of the coloring member. And have.

  According to the present invention, it is possible to extract a partial image of a subject from a photographed subject image.

[System configuration]
First, the overall configuration of the fitting system 1 will be described. The try-on system 1 is an example of an imaging system.
FIG. 1 is a diagram schematically illustrating the configuration of the fitting system 1.
As illustrated in FIG. 1, the try-on system 1 includes a camera 10, a foreground member 20, a background member 22, and an image processing device 30.
The camera 10 (photographing means) captures the subject 9 between the foreground member 20 and the background member 22. The camera 10 of this example is a digital camera that generates digital image data, and photographs a person as a subject 9 in accordance with a photographer's operation. In the present application, the direction in which the camera 10 captures an image is referred to as an imaging direction.

  The foreground member 20 has a coloring portion that develops a predetermined color in a front portion viewed from the photographing direction, and is disposed between the subject 9 and the camera 10. The color of the colored portion may be any color as long as it can be distinguished from the color of the subject, but green is preferable from the viewpoint of ease of separation from a human image.

  The background member 22 has a coloring portion that develops a predetermined color in the front portion viewed from the photographing direction, and is disposed in the background area of the subject 9 (that is, behind the subject 9 viewed from the photographing direction). The colored portion of the background member 22 may be any color as long as it can be distinguished from the color of the subject, and may be a color different from the foreground member 20, but from the viewpoint of ease of image extraction processing, the foreground member 20 Are preferably the same color.

  The image processing apparatus 30 is a computer terminal that is connected to the camera 10 via the communication line 40 and performs image processing on an image captured by the camera 10. The image processing apparatus 30 of the present example extracts a part of the subject 9 (an image of a person's face and hair) from an image photographed by the camera 10, Is combined with the image. In this example, the image data is transferred from the camera 10 to the image processing device 30 via the communication line 40, but the image data is transferred via a removable recording device or recording medium such as a USB memory. May be transferred from the camera 10 to the image processing apparatus 30.

FIG. 2 is a diagram illustrating the subject 9, the foreground member 20, and the background member 22 as viewed from the camera 10.
As illustrated in FIG. 2, the foreground member 20 hides a part of the subject 9 (a part below the person's neck). When the hair of the person who is the subject 9 hangs down below the chin on the front of the person, the subject 9 is photographed with the hair in front of the foreground member 20.
The subject 9 is in a background area constituted by the background member 22.
Since the front part of the foreground member 20 (first coloring member 202) and the front part of the background member 22 (second coloring member 222) are the same green, a part of the subject 9 (person's face and hair) ) Appears to float in the green space.

Further, as illustrated in FIG. 2, the size of the foreground member 20 in the width direction is held so as to be substantially constant. Here, the width direction of the foreground member 20 refers to the horizontal direction when viewed from the shooting direction.
When the width of the subject 9 is wider than the width of the foreground member 20, a part of the subject 9 protrudes from the left and right sides of the foreground member 20. The amount of protrusion in this case is called the amount of protrusion. The amount of protrusion is preferably measured at a predetermined height position on the foreground member 20. In this example, as shown in FIG. 2, the shoulder of the person is positioned near the upper end of the foreground member 20 so that only the face portion of the person (subject 9) is projected from the foreground member 20. Therefore, the amount of protrusion is measured at the shoulder portion of the person (that is, near the upper end of the foreground member 20).

FIG. 3 is a diagram illustrating the foreground member 20 in more detail.
FIG. 3A is a schematic diagram (front surface) of the foreground member 20 as viewed from slightly above the shooting direction. As shown in FIG. 3A, the foreground member 20 has a shape that gently protrudes in the direction of the camera 10. The foreground member 20 of this example includes a support member 200 for holding the shape and a first coloring member 202 held by the support member 200. The support member 200 is, for example, a frame made of metal, a metal plate having a smooth surface, or the like. The first coloring member 202 is a member that develops a predetermined color (in this example, green). For example, the first coloring member 202 is a cloth attached to the supporting member 202 or a coating applied to the surface of the supporting member 202. Agents. The coloring member 202 is held by the support member 200 so that the surface of the coloring member 202 is not wrinkled.
Note that the support member 200 and the coloring member 202 may be integrally formed.

FIG. 3B is a diagram schematically showing the back surface of the foreground member 20.
As shown in FIG. 3B, a handle 206 is provided on the back surface of the foreground member 20. The person who is the subject 9 is photographed while holding the handle 206. Thereby, the amount of protrusion of the arm of the person who is the subject is suppressed to a certain level, and the amount of protrusion of the shoulder of the person is appropriately measured. Furthermore, the person who becomes the subject may bend in order to match the upper end of the foreground member 20 and the position of his / her chin, but the posture in this case can be easily maintained.

FIG. 4A illustrates the functional configuration of the image processing program 5 installed in the image processing apparatus 30, and FIG. 4B illustrates the correction amount determination table.
As illustrated in FIG. 4A, the image processing program 5 includes an image extraction unit 500, a component image database 510 (component image DB 510), a selection unit 520, a protrusion specifying unit 530, an image correction unit 540, and an image composition unit. 550.
Note that part or all of the image processing program 5 may be realized by hardware such as an ASIC.

  In the image processing program 5, the image extraction unit 500 extracts a partial image of the subject from the image data received from the camera 10 based on the colors of the front portions (coloring members) of the foreground member 20 and the background member 22. The extracted partial image data is output to the protrusion specifying unit 530 and the image composition unit 550. The image extraction unit 500 of the present example extracts an image area having a color different from that of the foreground member 20 and the background member 22 from the captured image data, and based on the shape or position of the extracted image area A portion corresponding to the face and head hair and a portion corresponding to the upper arm of the person are specified.

  The component image DB 510 stores and manages other images to be combined with the image extracted by the image extraction unit 500. The component image DB 510 of this example manages limb images, costume images, and background images as component images. Note that the limb image and the costume image may be collectively referred to as a dress-up image.

  The selection unit 520 selects a component image to be used for image composition from the component images managed by the component image DB 510 in response to a user request, and reads the selected component image from the component image DB 510. To the image correction unit 540.

The protrusion specifying unit 530 specifies the amount of protrusion of the subject 9 that protrudes in the width direction from the foreground member 20, and outputs the specified amount of protrusion to the image correction unit 540. Based on the partial image data input from the image extraction unit 500, the protrusion specifying unit 530 of the present example, the width of the portion corresponding to the upper arm and the width of the portion corresponding to the foreground member 20 (interval between the left and right upper arm portions) And the amount of protrusion is measured. In this example, the ratio (%) of the width of the protruding image to the width of the image corresponding to the foreground member 20 is calculated as the amount of protrusion.
As described above, the width of the foreground member 20 is a reference for evaluating the width of the subject 9.

The image correction unit 540 corrects the component image input from the selection unit 520 based on the amount of protrusion specified by the protrusion specifying unit 530 and outputs the corrected component image to the image composition unit 550. The image correction unit 540 of this example specifies the correction amount (%) corresponding to the protrusion amount (%) input from the protrusion specifying unit 530 with reference to the correction amount determination table illustrated in FIG. The dress-up image input from the selection unit 520 is enlarged or reduced in the width direction by the specified correction amount.
As illustrated in FIG. 4B, the image correction unit 540 of this example determines the correction amount so that the lateral width of the component image increases as the protrusion amount increases. As a result, the horizontal width of the component image (such as a limb or a costume) can be matched with the horizontal width of the subject 9.
In the present embodiment, the size in the width direction of the component image is corrected so as to match the photographed subject. However, the photographed subject may be corrected so as to match the component image.

  The image composition unit 550 synthesizes the partial image (portion corresponding to the face and hair) input from the image extraction unit 500 and the component image input from the image correction unit 540, and the composite image is output to the image output unit 560. Output to. For example, the image composition unit 560 generates a composite image by superimposing a background image, a dress-up image (costume and limbs), and a partial image (face and hair) in this order.

  The image output unit 560 outputs the composite image input from the image composition unit 550. For example, the image output unit 560 displays the composite image on the monitor. Note that the image output unit 560 may transmit the composite image data to an external terminal or may write it out on a recording medium.

  As described above, according to the try-on system 1 of the present embodiment, an image of a portion corresponding to a person's face and hair is extracted from the photographed image, and the extracted partial image (corresponding to the face and hair), A dress-up image corresponding to the person's physique can be synthesized and presented to the user.

[Modification 1]
Next, a modification of the above embodiment will be described. First, as a first modification, a modification of the foreground member 20 will be described.
FIG. 5 is a diagram illustrating a modified example of the foreground member 20. FIG. 5A illustrates the front surface of the foreground member 20 in the modified example, and FIG. 5B illustrates the side surface of the foreground member 20 in the modified example.
As illustrated in FIG. 5A, shoulder support members 208 </ b> A and 208 </ b> B may be provided on the upper portion of the support member 200. The shoulder abutting member 208A and the shoulder abutting member 208B are installed at an interval that allows a person's neck to enter. The surfaces of the shoulder abutting members 208A and 208B develop substantially the same color as the coloring member 202 of the foreground member 20.
Further, the shoulder abutting member 208 has a property of bending due to its own weight while having elasticity that does not cause wrinkles. That is, as illustrated in FIG. 5B, when the shoulder abutting member 208A and the shoulder abutting member 208B are respectively placed on both shoulders of the person who is the subject 9, the leading end portions thereof are bent downward by their own weights, and the shoulder of the person is It comes to wrap up.
By providing such a shoulder contact member 208, it becomes easy to deal with people of various body shapes.

[Modification 2]
Next, as a second modification, a modification of the image processing device 30 will be described.
FIG. 6A illustrates a functional configuration of the image processing program 52 in the modification, and FIG. 6B illustrates a part group determination table. Note that, among the components of the image processing program 52 illustrated in FIG. 6A, the same components as those illustrated in FIG. 4 are denoted by the same reference numerals.
As illustrated in FIG. 6A, the image processing program 52 in the present modification includes the component image DB 510 and the selection unit 520 of the image processing program 5 in FIG. 4A, the second component image DB 512, and the second component image DB 512. The selection unit 522 is replaced, and the image correction unit 540 is deleted.

  In the image processing program 52, the second component image DB 512 stores component images in association with the amount of protrusion. More specifically, as illustrated in FIG. 6B, the second component image DB 512 stores a component group determination table that associates a group of component images with an amount of protrusion. For example, a dress-up image subjected to correction corresponding to the amount of protrusion is assigned to each group of component images. In addition, you may assign the image of the costume recommended to the person of each body shape to each group of part images.

The second selection unit 522 specifies a part image group based on the amount of protrusion input from the protrusion specifying unit 530, and the dressing image requested by the user from the part images belonging to the specified group. Is output to the image composition unit 550.
In this way, by preparing component images corresponding to each amount of protrusion in advance and reading out and using the component images corresponding to the amount of protrusion, it is possible to expect an increase in processing speed.

[Other variations]
The image correction unit 540 (FIG. 4) may correct not only the width of the component image but also the color of the component image. For example, the image correction unit 540 performs color correction on the skin color portion of the component image to be applied based on the color (skin color) of the face portion of the image area extracted by the image extraction unit 500. As a result, the skin color portion (for example, the limb portion) of the component image becomes close to the skin color of the person (subject 9), and the uncomfortable feeling caused by the image composition can be suppressed.

  In addition to the limb image, the component image DB 510 may also manage an image of another portion exposed from the costume, such as a waist portion, as a component image. In particular, when the costume image is a swimsuit or the like, since there are many portions exposed from the costume, a part image representing a part of a person's body occupies most of the composite image, and the importance in the composite image increases. Accordingly, a component image representing a part of a person's body is also subject to lateral width correction and color correction by the image correction unit 540 described above.

1 is a diagram schematically illustrating a configuration of a try-on system 1. FIG. 3 is a diagram illustrating a subject 9, a foreground member 20, and a background member 22 as viewed from the camera 10. FIG. It is a figure explaining the foreground member 20 in detail. (A) illustrates a functional configuration of the image processing program 5 installed in the image processing apparatus 30, and (B) illustrates a correction amount determination table. It is a figure which illustrates the modification of the foreground member. (A) illustrates a functional configuration of the image processing program 52 in the modification, and (B) illustrates a part group determination table.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Try-on system 10 ... Camera 20 ... Foreground member 200 ... Support member 202 ... Coloring member 206 ... Handle 208 ... Shoulder contact member 22 ... Background member 30 ... Image processing device 5, 52 ... Image processing program 500 ... Image extraction unit 510, 512 ... Component image database 520, 522 ... Selection unit 530 ... Projection specifying unit 540 ... Image correction unit 550 ... Image composition unit 560 ... Image output unit

Claims (5)

Photographing means for photographing the subject;
A first coloring member that is disposed between the subject and the photographing means and that develops a predetermined color;
A second color forming member arranged in a background area of the subject and generating a predetermined color;
Image extracting means for extracting an image of a part of the subject from the images photographed by the photographing means based on the color of the first coloring member and the color of the second coloring member;
Based on a partial image of the subject extracted by the image extraction means, a protrusion specifying means for specifying the amount of protrusion of the subject that protrudes in the width direction from the first coloring member;
Correction means for correcting at least one of a partial image of the subject and another image based on the protrusion amount specified by the protrusion specifying means;
Image combining means for combining a part of the image of the subject extracted by the image extracting means and another image;
The first coloring member is held in a fixed state at a predetermined width at least during photographing. Photographing means for photographing the subject;
A first coloring member that is disposed between the subject and the photographing means and that develops a predetermined color;
A second color forming member arranged in a background area of the subject and generating a predetermined color;
Image extracting means for extracting an image of a part of the subject from the images photographed by the photographing means based on the color of the first coloring member and the color of the second coloring member;
Based on a partial image of the subject extracted by the image extraction means, a protrusion specifying means for specifying the amount of protrusion of the subject that protrudes in the width direction from the first coloring member;
Image selecting means for selecting another image to be synthesized based on the amount of protrusion of the subject that protrudes in the width direction from the first coloring member;
Image synthesizing means for synthesizing a partial image of the subject extracted by the image extracting means and another image selected by the image selecting means;
The first coloring member is held in a fixed state at a predetermined width at least during photographing. The photographing system according to claim 1, further comprising: an image color correction unit that corrects a color of a part of another image to be synthesized based on the color of the subject extracted by the image extraction unit. A shooting method using a shooting device,
A photographing step of photographing the subject with the photographing device in a state where a coloring member that develops a predetermined color is disposed between the subject and the photographing device and in a background region of the subject;
Based on the color of the color developing member, an extraction step for extracting a partial image of the subject from the images photographed by the photographing device, and based on the extracted partial image of the subject, A specifying step of specifying the amount of protrusion of the subject that protrudes in the width direction from the color forming member arranged between the photographing device;
A correction step of correcting at least one of a part of the image of the subject and another image based on the specified amount of protrusion;
An imaging method comprising: a combining step of combining a part of the extracted image of the subject and another image. A shooting method using a shooting device,
A photographing step of photographing the subject with the photographing device in a state where a coloring member that develops a predetermined color is disposed between the subject and the photographing device and in a background region of the subject;
An extraction step of extracting a partial image of the subject from the images photographed by the photographing device based on the color of the coloring member;
A specifying step for identifying an amount of protrusion of the subject that protrudes in a width direction from the color forming member disposed between the subject and the photographing device, based on a part of the extracted image of the subject;
A selection step of selecting another image to be synthesized based on the specified amount of protrusion;
An image capturing method comprising: a combining step of combining a part of the extracted image of the subject and another selected image.

Images