JP2010199772A - Image display apparatus, image display method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image display device, an image display method, and a program capable of reproducing and displaying an image with such a rich variation as promoting communication. <P>SOLUTION: The image display device includes a recording section 4 storing photographed images, a face detection section 3 detecting the face of a person from a photographed image, a pattern/color decision section 1f deciding colors and patterns of clothes from the image including the person detected by the face detection section, an image retrieval section 1d retrieving an image in which the same person wears different clothes, and a display section 8a displaying the retrieved images together when the image retrieval section 1d retrieves a predetermined number of images. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an image display device, an image display method, and a program. More specifically, the present invention relates to an image display device, an image display method, and a program that reproduce and display image data shot by a shooting device.

  In recent years, the capacity and cost of a memory have been increased, and it has become possible to store a large amount of image data in a photographing apparatus such as a camera. In addition, a display panel such as a liquid crystal provided on the back surface of a camera or the like has been increased in size, and a stored image is displayed on the display panel and viewed. In addition to photographing devices such as cameras, it has been increasingly seen that images stored on a personal computer or a television connected to the photographing device are displayed and enjoyed together.

  When displaying an image on a display panel or the like, it is difficult to find a target image from a large number of images. Therefore, various image display apparatuses that can easily classify images have been proposed. For example, Patent Document 1 records image data together with incidental information such as shooting date / time, shooting posture, shooting location, photographer, etc., and uses this incidental information to organize and store images for classification search. Thus, an image display device is disclosed in which a target image can be viewed.

Japanese Patent No. 3528214

  The image display device disclosed in Patent Document 1 performs logical search using supplementary information recorded together at the time of shooting, and reproduces a variety of images that encourage communication during viewing. is not. That is, for the viewer, only an image imagined from the incidental information is displayed, and it is not enjoyed without getting tired.

  The present invention has been made in view of such circumstances, and an object of the present invention is to provide an image display device, an image display method, and a program that can reproduce and display a variety of images that promote communication. And

  In order to achieve the above object, an image display device according to a first invention includes a face detection unit that detects a face image in a captured image, the captured image, a pattern of the face image, a color under the face image, or A classification unit that classifies by pattern, and a display control unit that displays images of different colors or patterns on the same face according to the classification result by the classification unit.

In the image display device according to a second invention, in the first invention, the face detection unit can detect the size and position of the face image, and the display control unit can detect the size of the face image and Change the position.
According to a third aspect of the present invention, in the first aspect of the present invention, in the display of the display control unit, the portion of the person is displayed simultaneously or sequentially from the plurality of images classified by the classification unit. To do.

According to a fourth aspect of the present invention, in the first aspect, the composite image obtained by combining the two images is displayed between the two images at the time of display by the display control unit.
In the image display device according to a fifth aspect based on the first aspect, the display control unit extracts a person part based on the face image and displays the person part.

  An image display apparatus according to a sixth aspect of the invention includes a storage unit that stores a captured image, a person determination unit that determines whether or not the image includes the same person as the person specified on the captured image, and the imaging A search for searching for an image determined by the clothes determination unit to wear different clothes for an image determined to be the same person by the clothes determination unit and the person determination unit for determining a clothes part of a person on the image And a display unit that collectively displays the retrieved images when a predetermined number of images are retrieved by the retrieval unit.

According to a seventh aspect of the present invention, in the sixth aspect, in the collective display on the display unit, a predetermined number of images searched by the search unit are displayed simultaneously or sequentially.
In the image display apparatus according to the eighth invention, in the sixth invention, the size and / or position of the face in the image searched by the search unit is aligned in the collective display in the display unit.

  An image display device according to a ninth aspect of the present invention is a storage unit that stores a captured image, a person determination unit that determines whether or not the image shows the same person as the person specified on the captured image, and the imaging A search for searching for an image determined by the clothes determination unit to wear different clothes for an image determined to be the same person by the clothes determination unit and the person determination unit for determining a clothes part of a person on the image A person extracting unit that extracts a person portion from the image searched by the searching unit, and a display unit that displays the person extracted by the person extracting unit.

In the image display device according to the tenth aspect, the display unit aligns the sizes and / or positions of a plurality of persons searched by the search unit.
In an image display apparatus according to an eleventh aspect based on the ninth aspect, the display unit displays a plurality of persons searched by the search unit simultaneously or sequentially.

An image display method according to a twelfth aspect of the invention detects a face image in a photographed image, classifies the photographed image by a pattern of the face image and a color or pattern below the face image, and the classification result Depending on, images of different colors or patterns with the same face are collectively displayed.
According to a thirteenth aspect of the present invention, an image display method according to a thirteenth aspect of the present invention stores a photographed image, determines whether or not the image shows the same person as the person designated on the photographed image. When an image determined to be wearing different clothes is searched and a predetermined number of images are searched by the above search, the searched images are collectively displayed.
According to a fourteenth aspect of the present invention, there is provided an image display method for storing a photographed image, determining whether or not the image includes the same person as the person designated on the photographed image, and determining a clothing portion of the person on the photographed image. The image determined to be the same person is searched for an image determined to be wearing different clothes, and the person portion is extracted from the searched image and the extracted person is displayed. To do.

A program according to a fifteenth invention detects a face image in a photographed image, classifies the photographed image by a pattern of the face image and a color or pattern below the face image, and according to the classification result. Display images of the same face in different colors or patterns.
A program according to a sixteenth aspect of the present invention stores a photographed image, determines whether or not the image shows the same person as the person designated on the photographed image, and applies different clothes to the image determined to be the same person. When an image determined to be worn is searched, and a predetermined number of images are searched by the above search, the searched images are collectively displayed.
A program according to a seventeenth aspect of the present invention stores a photographed image, determines whether or not the image shows the same person as the person designated on the photographed image, and determines a clothing portion of the person on the photographed image. Then, with respect to the image determined to be the same person, an image determined to be wearing different clothes is searched, a person portion is extracted from the searched image, and the extracted person is displayed.

  According to the present invention, it is possible to provide an image display device, an image display method, and a program capable of reproducing and displaying an image rich in change that promotes communication.

It is a block diagram which shows the electric circuit in the camera concerning one Embodiment of this invention. It is a figure which shows the mode of many images image | photographed with the camera which concerns on one Embodiment of this invention. In the camera concerning one Embodiment of this invention, it is a figure which shows the mode of the image which extracted only the image which has shown himself. FIG. 4 is a diagram illustrating a state in which only an image in which the subject is photographed is sequentially displayed by dividing one screen in the camera according to the embodiment of the present invention. It is a flowchart which shows the operation | movement of the camera control in the camera in one Embodiment of this invention. It is a flowchart which shows the operation | movement of the image classification in the camera in one Embodiment of this invention. It is a figure explaining the relevant information used when performing image classification in the camera concerning one embodiment of the present invention. It is a flowchart which shows the operation | movement of the dress-up reproduction | regeneration in the camera in one Embodiment of this invention. It is a figure which shows the modification of the dress-up display in the camera in one Embodiment of this invention. It is a figure which shows another modification of the dress-up display in the camera in one Embodiment of this invention.

  Hereinafter, a preferred embodiment will be described using a camera to which the present invention is applied according to the drawings. FIG. 1 is a block diagram showing an electric circuit of a camera 10 according to an embodiment of the present invention. The camera 10 is a digital camera, and includes an image processing and control unit 1, an imaging unit 2, a face detection unit 3, a recording unit 4, an operation determination unit 6, a GPS 7, a display unit 8a, a touch panel 8b, a clock unit 9, and a communication unit 12. Etc.

  The imaging unit 2 includes an imaging device, an imaging lens 2, an exposure control unit such as a shutter, a driving and reading circuit for the imaging device, and the like, and converts a subject image formed by the imaging lens into image data by the imaging device. The face detection unit 3 inputs image data from the imaging unit 2 and detects whether or not a face image is included in the subject image.

  The image processing and control unit 1 controls the entire sequence of the camera 10 according to a stored program. In addition, the image signal output from the imaging unit 2 is captured, and various image processing such as thinning processing, edge enhancement, color correction, image compression, moving image processing, contrast adjustment, white balance, and the like is performed. 4 for image processing such as recording to 4 and playback display. In the image processing and control unit 1, a face feature extraction unit 1b, a face position / size determination unit 1c, an image search unit 1d, an image classification unit 1e, a pattern / color determination unit 1f under the face, and a display control unit 8 is included.

  When the face detection unit 3 detects that a face image is included, the face position / size determination unit 1c determines the position and size of the face. The facial feature extraction unit 1b extracts facial features from the positions of the eyes, nose and mouth. Using the extracted facial features, it can be determined whether the person is the same as the registered person. When the face position / size determination unit 1c detects the face position, the pattern / color determination unit 1f under the face detects a pattern of clothes under the face, such as a vertical stripe pattern, a black circle pattern, and the like. The color of the lower clothes, for example, red, blue, yellow, etc. is determined.

  The image classification unit 1e classifies images into snapshots, portrait photos, landscape photos, and the like. The image search unit 1e searches for an image using related information recorded in the related information unit 4b described later. The related information includes image classification, shooting date and time, pattern / color information under the face, and the like. The display control unit 8 controls live view display based on the image signal from the imaging unit 2 during shooting, and performs playback control of the image recorded in the recording unit 4 during playback mode. Further, the display is switched according to a touch operation on the touch panel 8b.

  The image processing and control unit 1 enlarges or reduces the image so that the size of the face detected by the face detection unit 3 is aligned with the size of the face of another image. The image is also moved so as to be located at Furthermore, image processing for cutting out only the person portion of the person including the face detected by the face detection unit 3 and separating it from the background is also performed.

  The recording unit 4 records the image data acquired by the imaging unit 2 and subjected to the image processing by the image processing and control unit 1 when an instruction for shooting is given by the release button. Also, when recording image data, it is associated with information such as the shooting date and time, and this related information is stored. In addition, a related information unit 4b is provided in the recording unit 4, and in association with image data recorded in the recording unit 4, the shooting date and time, the image classification, the number of faces, the position of the face, Information such as clothing color and clothing pattern is stored. This related information will be described later with reference to FIG.

  The operation determination unit 6 includes various operation members such as a release button, a power switch, a playback mode button, a thumbnail button, a feed button, a return button, and a dress-up button. The operation determination unit 6 determines the operation state of these operation members and performs image processing. The determination result is sent to the control unit 1. The image processing and control unit 1 controls photographing and reproduction in a predetermined sequence according to the operation state of the operation member. The GPS 7 is a global positioning system, measures the position at the time of shooting, and stores the measurement result as related information in the related information unit 4b.

  The display unit 8a includes a liquid crystal panel and the like, and performs live view display before shooting and reproduction display of recorded shot images. In addition, a touch panel 8 b is provided on the front surface of the display unit 8 a, and information such as a touch position by a photographer is sent to the image processing and control unit 1. The touch position on the touch panel 8b is determined by the image processing and control unit 1. As will be described later, when the change-of-dress mode is touched during playback display, images of the same person and different clothes are sequentially displayed.

  The clock unit 9 has a calendar function and a clock function, and outputs shooting date / time information during shooting as described above. The shooting date / time information can be used for image organization and image search. The communication unit 12 transmits the image data converted into the digital signal to an external device such as a television or a personal computer. The communication means may be wired communication or wireless communication using infrared rays or radio waves.

  Next, functions of the electronic album of the camera according to the present embodiment will be described with reference to FIGS. A large number of image data is recorded in the recording unit 4, and the image data is photographed at various occasions, organized by photographing date, and image classification information is recorded together as related information. This image classification will be described later in detail with reference to FIGS. 2A to 2D show a group of images that are organized and recorded for each shooting date.

  There may be many photographs that are not of interest in the organized image group, and in this case, in this embodiment, the images can be viewed as a digest. For example, there are cases where it is desired to see or show only the photograph in which the subject is photographed. In this case, as shown in FIGS. 3A to 3D, the photograph in which the subject is photographed is extracted, These can be reproduced and displayed. In particular, female users may be interested in what kind of clothes they are wearing and may want to see or show pictures of different clothes.

  Therefore, in the present embodiment, when a person is specified, it is possible to easily create a photo book such as a photo collection in which only the clothes are different for the same person (including one's own) with the sense of changing clothes. Is increasing. Because the clothes of interested people change, the images in the photo collection are rich in changes, and you can enjoy various scenes depending on the clothes.

  Further, in the present embodiment, images in which the clothes of the same person have changed as if they were dressed are collected and displayed. At this time, the size and position of the face are aligned, and the composition is also aligned. For this reason, the effect that only clothes change can be emphasized. In displaying, as shown in FIG. 3, a slide show format in which individual images are sequentially switched one by one may be used. 3 (a) to 3 (d) are photographic images of the same person and different clothes, and the size and position of the face are aligned when displayed, and the face appears between the vertical dashed lines in the figure. It is adjusted to.

  Also, as shown in FIG. 4, the same screen may be divided and displayed side by side on this screen so that comparison can be made. In this case, one image is displayed on the upper left as shown in FIG. 4 (a), then one additional image is displayed on the upper right as shown in FIG. 4 (b), and then the lower left as shown in FIG. 4 (c). It is also possible to display one image at a time and finally display all four images as shown in FIG. Further, instead of displaying sequentially, four sheets may be displayed simultaneously from the beginning as shown in FIG. 4 (d). Although it may be displayed at a time in this way, by sequentially displaying it, the expectation of the viewer can be increased and each image can be viewed slowly.

  Next, the operation of the camera 10 that can enjoy the electronic album as described above will be described with reference to FIGS. If the camera control flow shown in FIG. 5 is entered, it is first determined whether or not the power is on (S100). In this step, the operation determination unit 6 determines whether or not the power switch as the operation member of the camera 10 is on. If the power switch is off, the camera control flow ends. Even when the camera control flow ends, the state of the power switch is detected, and when the power switch is turned on, the operation starts from step S100.

  If the result of determination in step S100 is that the power supply is on, it is next determined whether or not it is in shooting mode (S101). If the result of this determination is that the camera is in shooting mode, then face detection is performed (S102). Here, based on the image data from the imaging unit 2, the face detection unit 3 determines whether a face is included. Subsequently, an exposure calculation is performed (S103). Here, for the face portion detected in step S102, the image data acquired by the imaging unit 2 is used to calculate the shutter speed, aperture value, and the like for proper exposure. Further, based on the contrast signal of the image data, focus adjustment is performed so that the face portion is in focus.

  Once the exposure calculation is performed, next, live view display is performed (S104). Here, based on the image data acquired by the imaging unit 2, a subject image is displayed in live view on the display unit 8 at about 30 frames per second. The user can determine the composition or the photo opportunity based on the live view display and perform the release operation.

  Once live view display has been performed, it is next determined whether or not to release (S105). Here, the operation determination unit 6 determines whether or not the release button has been operated. If the result of this determination is not release, processing returns to step S100. On the other hand, if the result of determination in step S105 is release, shooting and recording are next performed (S131). In this shooting / recording, the image data acquired by the imaging unit 2 is subjected to image processing by the image processing and control unit 1, and the image processed image data is recorded in the recording unit 4.

  Once shooting / recording is performed, image classification is performed (S132). Here, the shot images are classified according to shooting subjects such as snap, portrait, landscape, etc., and the number, position, size, features, etc. of the faces in the shot images are detected. Image classification is performed so that various information such as the color and pattern under the face can be obtained. This image classification subroutine will be described later with reference to FIG. When image classification is performed, the classification result is recorded (S133). In step S131, the image data is recorded. In step S133, the image data is recorded in the related information section 4b in a table format as shown in FIG. 7A described later in association with the recorded image data. Further, in this step, related information such as shooting position information detected by the GPS 7 is recorded in addition to the above information. When the classification result is recorded, the process returns to step S100.

  If the result of determination in step S101 is not shooting mode, it is determined whether or not playback mode is in effect (S111). If the result of this determination is not playback mode, processing returns to step S100. On the other hand, if it is the playback mode, it is determined whether or not it is the first playback display (S120). If the result of this determination is the first playback, the last captured image is played back (S121). Here, the last photographed image taken most recently is reproduced and displayed on the display unit 8a.

  If the last captured image is reproduced and displayed, or if the result of determination in step S120 is not the first reproduction, it is next determined whether or not a switching operation has been performed (S122). Here, the operation determination unit 6 determines whether or not an operation of a feed button or a return button of an image being reproduced and displayed or a thumbnail button for displaying a thumbnail has been performed. If these operations have been performed as a result of this determination, it is next determined whether or not the operation has been a thumbnail button (S124).

  If the result of determination in step S124 is that the thumbnail button has been operated, thumbnail display is performed (S125). The thumbnail display is a format in which a plurality of photographed images recorded in the recording unit 4 are displayed on the display unit 8a in a list format. When the thumbnails are displayed, it is determined whether an image is selected from the thumbnails (S126). Since the user selects an image to be enlarged from the thumbnail display by touching the touch panel 8b or the like, in this step, it is determined whether or not the selection has been made based on the touch state on the touch panel 8b.

  If the result of determination in step S126 is that it has not been selected, processing returns to step S120. On the other hand, if it is selected as a result of the determination, the selected image is enlarged and displayed on the display unit 8a (S127).

  If the result of determination in step S124 is that the thumbnail button has not been operated, the next image is displayed (S128). In this step, the next image corresponding to the operation of the playback image feed button or the return button is read from the recording unit 4 and displayed on the display unit 8a.

  As a result of the determination in step S122, if the switching operation has not been performed, or if the next image display is performed in step S128, or if the selected image is enlarged and displayed in step S127, it is next determined whether or not the mode is the dressing mode. Perform (S129). Since the user operates the dress button when the user desires reproduction display in the dress mode described with reference to FIGS. 3 and 4, the operation determination unit 6 determines whether or not the dress button has been operated. Determine by.

  If the result of determination in step S129 is the dress-up mode, dress-up playback is performed (S130). Here, reproduction display is performed in the dress-up mode described with reference to FIGS. The subroutine of the dressing mode will be described later with reference to FIG. When dressing reproduction is performed, the process returns to step S100. If the result of determination in step S129 is not dressing mode, processing returns to step S120.

  Next, the image classification subroutine in step S132 will be described with reference to FIGS. In the present embodiment, when performing dress-up display in step S130, photographs of different clothes by the same person are searched from the snapshots and portrait photographs. In order to facilitate this search, the image classification unit 1e classifies the captured images. Image classification is based on image data obtained at the time of shooting and other information, and is associated with each image in a table format as shown in FIG. 7, and the result is recorded in the related information section 4b. . By recording together with the image data at the time of shooting, the search can be quickly performed at the time of reproduction. Of course, it may be performed not only at the time of shooting but also at the time of reproduction.

  In the image classification sub-routine shown in FIG. 6, a person is moved to the whole body according to information such as whether or not a face portion is included in the image based on the face detection result by the face detection unit 3, the size and number of faces, and facial features. It is categorized into snapshots with many backgrounds and portraits with a focus on facial expressions. Also, using the image data from the image pickup unit 2, the color information and saturation information of the image, the signal for focusing, etc. are used to determine the photograph of the flower, the photograph of the accessory, the photograph of the pet, the landscape photograph, etc. Yes.

  When the image classification subroutine shown in FIG. 6 is entered, it is first determined whether or not there is a face in the image (S301). This determination is performed by the face detection unit 3. If the result of this determination is that there is a face, then the color or pattern of the portion under the face of the central person is determined and recorded (S302). The reason for looking at the color of the lower part of the face is to detect it as the color of the clothes, and also detects the pattern of the clothes and records this information in the related information section 4b.

  Next, it is determined whether or not the face size is large (S303). If the result of this determination is that the image is larger than a predetermined size, the photo is taken as a portrait (S305). Accordingly, the determination value in step S303 is a value suitable for classification.

  Once classification is performed in steps S304 and S305, the number, position, size, and features of the face are detected and determined (S306). Here, the number, position, and size of faces are detected based on the determination result by the face position / size determination unit 1c. Further, the facial feature extraction unit 1b extracts facial features. The features of a person's face that may be photographed, such as a family member or friend, are registered in advance in the face feature extraction unit 1b, such as PA, P-B, and the registered facial features It is determined whether or not they match. These detected results are recorded in the related information part 4b.

  If the result of determination in step S <b> 301 is that there is no face, next, the main color is determined (S <b> 310). Here, the main color of the screen is determined at the center of the screen or the like. Subsequently, it is determined whether or not it is a long distance (S311). This determination is made based on the focus position when the imaging unit 2 performs focusing. If the result of this determination is that it is a long distance, the image is determined to be a landscape photograph (S317).

  If the result of determination in step S311 is that it is not a long distance, it is next determined whether or not it is the closest side (S312). Also in this determination, it is determined whether or not the photographing is performed in the macro area on the short distance side based on the focus position when the imaging unit 2 performs the focusing. If the result of this determination is that the image was not taken in the close-up region, it is determined that the photo is a pet (S316). In this case, it is neither a long distance nor a close distance, and various photographs may be included, but here it is classified as a pet. When searching for a photo of a pet, it is possible to quickly find it by searching with this classification.

  If the result of determination in step S312 is the near side, it is next determined whether or not the saturation is high (S313). Here, the saturation of the image data is determined. If the saturation is higher than a predetermined value, the image is determined to be a flower photograph (S314). If the saturation is lower than the predetermined value, the image is determined to be an accessory. (S315). This is because, in general, flowers are more saturated than small items.

  FIG. 7A shows an example of information classified in the image classification flow and recorded in the related information section 4b. FIG. 7B shows an example of screen division. In the present embodiment, the screen is divided into nine areas A1 to A9. In each of the areas A1 to A9, the face size is divided into three levels D1 to D3. In the figure, image 1 is a snapshot, the number of faces is two, a person PA registered in the area A4 is shown with the face size D2, and an unknown person P- is shown in the area A6. X appears in the face size D3. Also, the color under the face is blue, the pattern of clothes is a vertical white stripe pattern, and the shooting date is September 15th. Although two people are shown in the image 1, the color and pattern under the face of a person with a large face (here, PA) are detected.

  Information associated with the images is also recorded in the images 2 to 5 as shown in FIG. In the image 2, three people are shown, and the size of the face is D3 and the same size. In this case, the color and pattern under the face of the middle person are detected and recorded. Also, in the image 5, two people are shown, and the size of the face is D2 and the same size. In this case, since superiority or inferiority cannot be attached, both the color and pattern under the face are recorded. In the example of image 5, one person wears a white, black-circle pattern under the face, and the other person wears a white, unpatterned clothes under the face. Persons PA, PB, PX, and the like are determined by the face feature extraction unit 1b. Here, PA and PB are pre-registered persons such as family members and friends, and PX is given when the person is not a registered person.

  When such image classification is performed, image search can be performed quickly and efficiently. For example, when searching for a face image, the images classified in S314 to S317 can be excluded from the search target, and the search can be performed quickly and efficiently. Further, the face feature extraction unit 1b distinguishes and records persons such as PA and PB, and further records colors and patterns for each image of the lower part of the face, that is, the clothes part. Therefore, it is possible to quickly and efficiently search for images of different clothes for the same person.

  Next, the dress-up reproduction subroutine in step S130 will be described with reference to the flowchart shown in FIG. In this dress-up playback subroutine, as described with reference to FIG. 4, the screen of the display unit 8a is divided into four and displayed side by side or displayed side by side at the same time, or as shown in FIG. Without splitting the screen, photographic images of the same person and different clothes are displayed one by one.

  When the flow for dressing reproduction is entered, first the face pattern and the image under the face are determined (S181). Here, for the image selected and displayed in step S121, S128, or S127, the color and pattern of the face pattern and the image under the face are determined. In this determination, determination may be made using related information as shown in FIG. 7A, or pattern analysis may be performed using image data. It can be determined quickly by using related information.

  Once the determination in step S181 is made, the search is then started (S182). Here, in step S183 to S191, an image having the same color or pattern as the face pattern determined in step S181 and different under the face is searched. First, it is determined whether there is a search target (S183). Here, it is determined whether or not there is an image recorded in the recording unit 4 that has not been searched in steps S183 to S191.

  If the result of determination in step S83 is that there is a search target, it is next determined whether or not there is the same face for the one image selected in step S121, S128, or S127 (S184). Here, it is determined whether or not the face is the same as the face of the selected image, that is, the face of the same person. For the determination, the face pattern determined in step S181 is used.

  If the result of determination in step S184 is the same face, it is next determined whether or not different clothes are being worn (S185). Here, it is determined whether the color and pattern under the face are different for the images determined to be the same face in step S184. For the determination, the image determination under the face determined in step S181 is used.

  If the result of determination in step S185 is that different clothes have been worn, it is next determined whether or not the image is an image in which only one person is shown (S186). Here, it is determined whether or not a photograph image of the same person and different clothes is taken alone. The purpose of judging whether or not it is one person's image is that it may be shown to many people in the dress-up playback, and if there are people who are shown together, it is for consideration of privacy issues. is there. When this image is used when it is not photographed alone, only one person is cut out and used as will be described later.

  As a result of the determination in step S186, if it is not photographed alone, it is temporarily stored as a preliminary image (S188). On the other hand, as a result of the determination, if it was taken alone, it is temporarily stored as a candidate image (S187). Once the candidates are made, it is next determined whether or not four sheets have been completed (S191). As described above, in the present embodiment, the display screen is divided into four to display images, and therefore it is determined here whether or not four images have been prepared.

  If the result of determination in step S191 is that four images have not been completed, or if the image has been temporarily stored as a preliminary image in step S188, or if the result of determination in step S185 is that no different clothes have been worn, or determination in step S184. As a result, if the faces are not the same, the next image is next selected (S189), and the process returns to step S183. That is, the next image is selected, and the determination and processing in steps S183 to S191 are performed on the selected image.

  If the result of determination in step S183 is that there is no search target, it is determined whether or not there are a plurality of images to be displayed by changing the dress by adding a spare (S201). In the determination in step S183, the search target disappears when all the images recorded in the recording unit 4 have been determined and processed in steps S184 to S191. In this state, if there are not two or more photographic images with the same face and different clothes, it is impossible to change the dress. Therefore, if the result of determination in step S201 is that there are no plural photographic images, a dress-up reproduction cannot be performed, so a warning is displayed (S202).

  On the other hand, if the result of determination in step S201 is that there are a plurality of photographic images by adding a preliminary image, only one person is extracted in the case of a preliminary image (S203). If there are four images candidated in step S187, the four are used for dress-up display. If there are no four candidated images, a plurality of persons are shown in this step. An image of the same person is extracted (trimmed) from the preliminary image.

  If only one person is taken out in step S203, or if the result of determination in step S191 is four, then enlargement is performed with the largest face aligned (S192). Here, as described with reference to FIG. 3, the face is adjusted to the largest face in order to make the face size uniform. In addition to matching with the largest face, for example, it may be set to an intermediate size, or may be a preset size (for example, 1/5 of the screen size).

  Subsequently, the face position is aligned at the center (S193). By always displaying the face at the same position, it becomes easier to see. Of course, the left side and the right side are not limited to the center. When the positions are aligned, the four retrieved photographic images are displayed side by side or sequentially (S194). Here, “display side by side” is to display the photographic images of different clothes for the same person simultaneously or sequentially by dividing the screen of the display unit 8a into four as described in FIG. Further, “sequentially display” is to sequentially display photographic images of different clothes for the same person without dividing the screen of the display unit 8a as described in FIG. Note that whether the images are displayed side by side or sequentially may be selected by the user on a menu screen or the like, or only one of them may be displayed.

  If the dress change display is performed in step S194 or the warning display is performed in step S202, it is next determined whether or not to end (S195). When ending the dress-up mode, the user operates the dress-up button again, so here the operating state of the dress-up button is determined. If the result of this determination is not end, processing proceeds to step S189, the next image is selected, and processing returns to step S183. On the other hand, as a result of the determination, if it is the end, the dress-up playback operation is ended and the process returns to the original flow.

  As described above, in this embodiment, based on the pattern of the face image and the color and pattern under the face, photographic images with the same person wearing different clothes are retrieved and displayed. For this reason, since the clothes are different even though they are the same person, it is possible to reproduce and display an image that encourages a variety of communication. In this embodiment, the face size and position are aligned when displaying the search results. For this reason, it becomes easy to see and it becomes easier to compare.

  In the present embodiment, the number of screen divisions is set to 4 for ease of arrangement. However, the number of screen divisions may be changed as appropriate, such as 2, 3, 6, 8, 9, etc., in addition to four. In this embodiment, only when a plurality of persons are shown, a preliminary image is used, and one person is extracted in step S203. However, steps S186 and S188 may be omitted and one person may be taken out for all images.

  Next, a modified example of the display method for dressing display will be described with reference to FIG. In addition to the display methods as shown in FIGS. 3 and 4, for example, as shown in FIG. 9, only the figure of the dressed person may be displayed. That is, first, the person part 31a of the photographic image shown in FIG. 9A is displayed on the display unit 8a, and then the person part 31b is displayed in addition to the person part 31a as shown in FIG. 9B.

  Then, the person portion 31c as shown in FIG. 9C is additionally displayed, and then the person portion 31d is additionally displayed as shown in FIG. 9D. In FIG. 9D, four photographic images with the same person and different clothes are displayed so as to be displayed on the display unit 8a. In such a modification, step S193 may be skipped in the flow of FIG. 8, and the extracted portions of the person may be sequentially displayed in step S194.

  Next, FIG. 10 shows another modification of the display method for dressing display. This display method is a modification in which photographic images of dressed persons are sequentially displayed as shown in FIG. In this modification, the images shown in FIGS. 10A and 10C are photographic images actually taken and searched in the flow of dressing reproduction. In the example of FIG. 3, the photographic image of (c) is displayed after (a). In this modification, the morphed image of FIG. 10 (b) is inserted between two photographic images. .

  In the morphing process, the arm portion 32a of the person portion 32 shown in FIG. 10A and the torso portion 33a of the person portion 33 shown in FIG. 10C are combined to form a composite image as shown in FIG. Is generated. Next to the photographic image in FIG. 10A, this composite image is displayed, and subsequently, the photographic image in FIG. 10C is displayed. In this modification, since a composite image is inserted between a photographic image and a photographic image, there is an advantage that the change of the photographic image changes smoothly. In this modified example, when the images are sequentially displayed in step S194 in the flow of FIG. 8, the image may be displayed while performing the morphing process.

  In one embodiment or modification of the present invention, a person image is extracted from a background photographic image. As an extraction method, stereo shooting is performed with a camera having two imaging systems, and a portion without parallax may be cut out as a background. Further, it is possible to irradiate a strong strobe light, extract a portion with a lot of reflected light, and use that portion as a human image. Furthermore, a person photograph may be taken and used. Of course, the face portion may be detected and the portion connected to the contour may be regarded as a person. In any case, any method that extracts a person from an image can be used in the present embodiment.

  As described above, in the embodiment of the present invention, an image in which different clothes are worn for the same person is searched and displayed. For this reason, it is possible to reproduce and display an image rich in changes that promotes communication.

  Further, in the embodiment of the present invention, when a predetermined number of images are searched (in the example of FIG. 8, when four images are reached in step S191), the images are displayed collectively. For this reason, images of different clothes by the same person can be enjoyed together simultaneously or sequentially. Furthermore, in the embodiment of the present invention, the display is performed by aligning the position and size of the face. For this reason, the images are easy to see and can be easily compared.

  Furthermore, in the embodiment of the present invention, only the person portion may be extracted and displayed. By displaying only the person portion, there is no need to worry about the privacy of the people who are together, and it is easy to compare clothes.

  In the present embodiment, when it is determined that the image is a single person in step S186, the background is displayed without being separated from the person portion. However, the present invention is not limited to this. For all images, the background may be separated from the person portion and only the person portion may be displayed.

  Further, in the present embodiment, the size of the face is aligned and the position of the face is also aligned. However, the present invention is not limited to this, and only one of them may be prepared.

  Furthermore, in the embodiment of the present invention, the face detection unit is used for detecting the human image. However, the present invention is not limited to this, and other detection methods such as pattern analysis of the eyes, nose and limbs may be used. . Further, although the color and pattern under the face are used for detecting the clothes, other image analysis may be used.

  Furthermore, in the embodiment of the present invention, the digital camera is used as the photographing device. However, the camera may be a digital single-lens reflex camera or a compact digital camera, and a moving image such as a video camera or a movie camera. For example, a camera built in a mobile phone, a personal digital assistant (PDA), a game machine, or the like.

  Furthermore, in the embodiment of the present invention, the photographing device has the function of the image display device. However, the present invention is not limited to this, and a device having no photographing function such as a television or a personal computer may of course be used. In this case, the image data photographed by the photographing apparatus may be temporarily stored in the storage unit of these devices. In this embodiment, image classification is performed at the time of shooting. However, in the case of these devices, when an image that has not been previously attached with related information such as image classification is stored in the storage unit, related information such as image classification is displayed. Just give it. In addition, a monitor device such as a television and a photographing device such as a camera may be linked to display an image.

  The present invention is not limited to the above-described embodiments as they are, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of components disclosed in the embodiment. For example, you may delete some components of all the components shown by embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

DESCRIPTION OF SYMBOLS 1 ... Image processing and control part, 1b ... Face feature extraction part, 1c ... Face position / size determination part, 1d ... Image search part, 1e ... Image classification part, 2 .... Image pickup unit, 3 ... face detection unit, 4 ... recording unit, 4b ... related information unit, 6 ... operation determination unit, 7 ... GPS, 8 ... display control unit, 8a ... Display part, 8b ... Touch panel, 9 ... Clock part, 10 ... Camera, 11a ... User's finger, 12 ... Communication part, 31a ... Personal part, 31b ... -Person part, 31c ... person part, 31d ... person part, 32 ... person part, 32a ... arm part, 33 ... person part, 33a ... body part

Claims (17)

A face detection unit for detecting a face image in the captured image;
A classification unit for classifying the captured image into a pattern of a face image and a color or pattern under the face image;
A display control unit that displays images of different colors or patterns on the same face according to the classification result by the classification unit;
An image display device comprising: The face detection unit can detect the size and position of the face image,
The display control unit changes the size and / or position of the face image.
The image display apparatus according to claim 1.   The image display apparatus according to claim 1, wherein in the display in the display control unit, a person portion is displayed simultaneously or sequentially from a plurality of images classified by classification by the classification unit.   The image display device according to claim 1, wherein a composite image obtained by synthesizing the two images is displayed between the two images at the time of display by the display control unit.   The image display apparatus according to claim 1, wherein the display control unit extracts a human part based on the face image and displays the human part. A storage unit for storing captured images;
A person determination unit that determines whether or not the image includes the same person as the person specified on the captured image;
A clothing determination unit for determining a clothing part of a person on the photographed image;
A search unit for searching for an image determined to be worn by the clothing determination unit as to the image determined to be the same person by the person determination unit;
When a predetermined number of images are searched by the search unit, a display unit that collectively displays the searched images;
An image display device comprising:   The image display device according to claim 6, wherein in the batch display in the display unit, a predetermined number of images searched by the search unit are displayed simultaneously or sequentially.   The image display device according to claim 6, wherein in the collective display in the display unit, the size and / or position of the face in the image searched by the search unit is aligned. A storage unit for storing captured images;
A person determination unit that determines whether or not the image includes the same person as the person specified on the captured image;
A clothing determination unit for determining a clothing part of a person on the photographed image;
A search unit for searching for an image determined to be worn by the clothing determination unit as to the image determined to be the same person by the person determination unit;
A person extraction unit that extracts a person part from the image searched by the search unit;
A display unit for displaying the person extracted by the person extraction unit;
An image display device comprising:   The image display device according to claim 9, wherein the display unit aligns the sizes and / or positions of a plurality of persons searched by the search unit.   The image display device according to claim 9, wherein the display unit displays a plurality of persons searched by the search unit simultaneously or sequentially. Detect the face image in the shot image,
The above shot images are classified by the face image pattern and the color or pattern under the face image,
Depending on the classification result, images of the same face with different colors or patterns are displayed at once.
An image display method characterized by the above. Memorize the shot image,
It is determined whether or not the image shows the same person as the person specified on the captured image,
For images determined to be the same person, search for images determined to be wearing different clothes,
When a predetermined number of images are searched by the above search, the searched images are collectively displayed.
An image display method characterized by the above. Memorize the shot image,
It is determined whether or not the image shows the same person as the person specified on the captured image,
Determine the person's dressed part on the above image,
For images determined to be the same person, search for images determined to be wearing different clothes,
Extract the human part from the searched image,
Display this extracted person,
An image display method characterized by the above. Detect the face image in the shot image,
The above shot images are classified by the face image pattern and the color or pattern under the face image,
Depending on the classification result, images of the same face with different colors or patterns are displayed at once.
A program that causes a computer to execute. Memorize the shot image,
It is determined whether or not the image shows the same person as the person specified on the captured image,
For images determined to be the same person, search for images determined to be wearing different clothes,
When a predetermined number of images are searched by the above search, the searched images are collectively displayed.
A program that causes a computer to execute. Memorize the shot image,
It is determined whether or not the image shows the same person as the person specified on the captured image,
Determine the person's dressed part on the above image,
For images determined to be the same person, search for images determined to be wearing different clothes,
Extract the human part from the searched image,
Display this extracted person,
A program that causes a computer to execute.