JP2012244245A - Imaging apparatus, control method of imaging apparatus, image display apparatus, image display method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an imaging apparatus, a control method of the imaging apparatus, an image display apparatus, an image display method, and a program, which make it easier to express a situation where a photographer keeps moving, and a situation where the photographer performs imaging from a remote position, instead of only recording states of the photographer, in a scene in which the photographer carrying imaging equipment performs imaging while moving.SOLUTION: Imaging equipment 10 performs imaging a plurality of times in an opposite direction to a direction of movement. The imaging equipment 10 includes: an imaging section 5 to perform in order the plurality of imaging; and a combinability determination section 1f to determine whether or not a previously taken image among the plurality of imaging results can be combined with a later taken image by reducing the previously taken image by a reduction section 1c.

Description

  The present invention relates to a photographing device, a photographing device control method, and a program, and more particularly, a photographing device that reproduces and displays a moving image or a continuous-shot digital image photographed by a photographing device such as a digital camera or a video camera as a slide show or a moving image. The present invention relates to an imaging device control method, an image display device, an image display method, and a program.

  In recent years, techniques for taking digital images and image processing have been improved, the boundaries between digital cameras and video cameras have been eliminated, and it has become easier to handle a large number of images. Conventionally, a photographing apparatus such as a camera, which has been a simple photographing tool, has digitized image signals, and it has become easy to exchange data with many devices such as personal computers and televisions.

  Assuming such a state of being played back by various playback devices, effective playback suitable for each playback device is required, but conventional devices usually play back the captured images as they are. For this reason, it tends to be a monotonous image, and it has not always been suitable for reproduction by a reproduction device such as a television in front of many viewers. As a result, there was a situation in which the photographed image was not viewed while the image remained in the photographing apparatus.

JP 2004-147046 A

  Therefore, there is a proposal to enrich the image expression by using various auxiliary information during viewing. In Japanese Patent Application Laid-Open No. 2004-147046, it is possible to take a picture of one's face with a first camera, to take a picture of a landscape that he is looking at with a second camera, and to take both pictures simultaneously. There is also a proposal for combining the images taken by the first camera and the second camera.

  However, according to the above-mentioned patent document, the photographer's own image photographed by the first camera is merely a photograph of himself / herself with the camera, and has little change and realism.

  The present invention has been made in view of such circumstances, and in a scene where a photographer is holding and photographing while moving, the state of the photographer is not simply recorded, but the photographer moves. It is an object of the present invention to provide a photographing apparatus, a photographing apparatus control method, an image display apparatus, an image display method, and a program capable of easily expressing a state of shooting and a state of photographing from a distant position.

  In order to achieve the above object, an imaging apparatus according to a first invention includes: an imaging unit that performs imaging in a direction opposite to a moving direction a plurality of times, and sequentially performs the plurality of imaging operations; And a compositability determination unit that determines whether or not the image captured can be combined with an image captured later.

  In order to achieve the above object, a photographing apparatus according to a second aspect of the present invention provides a face detection unit that detects a face position in a photographing screen acquired by the imaging unit, and the photographing device is appropriate according to the detection result of the face detection unit. It is characterized by having a warning section that gives a warning so that it can be held at a proper position.

  In order to achieve the above object, in the photographing apparatus according to the third aspect of the present invention, the warning unit determines an appropriate position of the photographing apparatus according to a photographing interval performed during the movement.

  In order to achieve the above object, the photographing apparatus according to the fourth invention is characterized in that the warning unit determines an appropriate position of the photographing apparatus according to the reduced image.

  In order to achieve the above object, a photographing method according to a fifth aspect of the present invention sequentially performs a plurality of times of photographing, reduces a previously photographed image among the plurality of times of photographing results, and converts it into an image photographed later. It is characterized in that it is determined whether or not composition is possible, and photographing in the direction opposite to the moving direction is performed a plurality of times.

  In order to achieve the above object, a program according to a sixth aspect of the present invention includes a shooting step for sequentially performing a plurality of shootings, and reducing a previously shot image out of the plurality of shooting results, and then shooting after that. And a composition feasibility judgment step for judging whether or not the image can be synthesized.

  In order to achieve the above object, a display device according to a seventh aspect of the present invention reduces the previously captured image out of the captured images captured at a plurality of times in the direction opposite to the moving direction, and captures it later. A compositability determination unit that determines whether the image can be combined.

  In order to achieve the above object, an image composition display method according to an eighth aspect of the present invention is to reduce a previously captured image out of a plurality of captured images captured at a timing opposite to the moving direction, and to capture a subsequent image. It is characterized in that it is determined whether or not it is possible to synthesize the image.

  According to the present invention, it is possible to provide a photographing apparatus, a photographing apparatus control method, an image display apparatus, an image display method, and a program capable of easily expressing changes in rear photographing such as a moving state. Can do.

  Hereinafter, a preferred embodiment will be described using a camera to which the present invention is applied according to the drawings. The camera of the present invention has an imaging unit capable of imaging the rear of the camera for acquiring a photographer's image, and starts acquiring the image data of the shooting in response to an operation of a release button or the like. Provisionally record. There is a photographer's face at the center of the temporarily recorded photographed image, and it can be determined whether it can be combined with the background part of the preceding and following images. By synthesizing the background portion, the photographer can obtain an image as if the photographer is moving in the background image.

  FIG. 1 is a block diagram showing the configuration of a camera according to the first embodiment of the present invention. A camera 10 is a digital camera that captures an image of a subject. In addition to the front imaging unit 2, the camera 10 includes a rear imaging unit 5 that performs rear imaging, a captured image recording unit 4, and a display unit 8 that displays captured images. In addition, an acceleration sensor for detecting acceleration applied to the camera and a timepiece 7 for acquiring date / time information are provided to classify captured image data and determine conditions at the time of shooting. The image signals obtained from the imaging units 2 and 5 are subjected to image processing by a signal processing unit in the control unit 1 that executes the processing sequence, and can be displayed and recorded. As this signal processing, there are a face detection unit 1a, a reduction unit 1c, a temporary recording unit 1d, a combining unit 1e, a combining possibility determining unit (combining determining unit) 1f, and the like. In addition, the warning unit 1b is configured in the control unit, and warns the photographer such as displaying a warning on the display unit 8 as necessary.

  The image capturing unit 2 and the rear image capturing unit 5 are assumed to be composed of a photographing lens and an image sensor, and convert a subject image into an electrical signal, which is processed by a signal processing unit to become image data. It is assumed that the imaging unit 2 is disposed on the front surface of the main body of the camera 10 and the rear imaging unit 5 is disposed on the opposite back surface. Of course, this does not limit the arrangement position, such as rotating. Instead of preparing two imaging units, one imaging unit may be rotatable forward and backward of the main body of the camera 10. In this case, it is possible to photograph mainly a subject when the imaging unit is directed forward and mainly a photographer's face when the imaging unit is directed backward. Note that the photographing lens of the imaging unit 5 on the back surface can capture only a part of the person being photographed when the angle of view is narrow.

  A control unit 1 having a signal processing unit performs overall control of the camera 10 in accordance with a stored program, and processes image data obtained by processing image signals output from the imaging units 2 and 5 into a memory card or the like. Record in the recording unit 4. The face detection unit 1a inputs captured images from the imaging units 2 and 5, determines whether or not a person's face exists in the captured images, and if a person's face exists, And detect face size.

  The operation unit 6 is an operation member such as a release button 6a or a zoom button provided in the camera 10. The user can set various modes using the cross key or touch panel.

  As shown in FIG. 2A, the release button 6a is arranged on the upper surface of the main body of the camera 10, and when the release button 6a is operated, the camera 10 starts shooting and is in a moving image or continuous shooting mode. When the release button is operated again, shooting is stopped.

  As shown in FIG. 2B, the display unit 8 includes a liquid crystal monitor and a display device such as an organic EL arranged on the back surface of the camera 10, and an image from the imaging unit or an image recorded in the recording unit 4. Playback display or warning message display.

  The image processing unit 7 adjusts the brightness, gradation, color, and the like of the image signals acquired by the imaging units 2 and 5, compresses them for easy recording, records them in a predetermined format, and records them in the recording unit 4. Such image processing includes processing for changing (resizing) the size of the image. Since reduction processing is important in the present invention, the reduction unit 1c is particularly illustrated in the drawing.

  The image signal may be temporarily recorded in the temporary recording unit 1d until it is actually recorded, and the image composition unit 1e and the composition determination unit 1f are also part of the signal processing so that a plurality of images can be recorded and displayed. Are incorporated in the control unit 1 having a signal processing unit.

  The face detection unit 1a detects a person's face image included in the image according to the image feature obtained from the person's face part, and performs synthesis and warning in consideration of the detection result. Incidentally, even when the composition determination unit 1f determines whether the composition is successful, a warning is given as necessary.

  The synthesized image generated by the image synthesizing unit 7 is displayed on the display unit 8. However, when the captured image is read out from the recording unit 4 and used for synthesizing display, the present invention is also applied to the display device. The invention is available.

  Next, the operation in the present embodiment will be described. First, a method for photographing a back composite image, which is a feature of the present invention, will be described with reference to FIG. When this photographing device 10 is used, as shown in FIG. 3, when the photographer 11 walks while photographing while holding the camera 10 and checking the photographing state on the display unit on the back of the photographer's camera, the subject seen forward is photographed. At the same time, the photographer can record his face and background.

  When shooting regularly or taking a video in this way, the image taken by the front imaging unit 2 changes with the movement, but the image obtained by the rear imaging unit 5 is the same as the photographer 11. The positional relationship of the camera 10 is determined when the camera is held, and hardly changes.

  That is, as shown in FIG. 3, when the photographer walks while holding the photographing device and periodically takes a picture of the back, an image as shown in FIGS. 4 (a) to 4 (e). Is obtained. The photographer's image is taken at almost the same size because the distance between the holding position and the face does not change greatly, but the background changes one after the other so that it passes away.

  By synthesizing such an image as shown in FIG. 5, the photographer's image can be made to be an image as if it was photographed farther than the actual photographed image. That is, since the image taken immediately before the image of FIG. 5B and the background portion of FIG. 5A are part of the image of FIG. 5B as shown in FIG. 5, the image of FIG. The image shown in FIG. 5A is inserted into the corresponding portion, and can be expressed as a single image without a joint on the background as shown in FIG. The person portion of this image and the image portion above it (see FIG. 5 (d)) are images taken from a distance away from the photographer even though the photographer photographed himself / herself. looks like. It is equivalent to an expression in which the person at the position (a) is photographed from the position at which the photograph (b) was photographed.

  In order to enable such composition, it is preferable that the image of (a) is an image that covers the head of the person portion of the image of (b). Otherwise, the head of the image (b) protrudes from the image synthesizing unit (c) and becomes unnatural.

  Therefore, in the present invention, the photographing intervals of the images (a) and (b) are appropriately controlled so as to prevent such unnaturalness at the time of synthesis.

  Thus, by having such a compositing function, this imaging device can reproduce not only the change of the front image but also the change of the rear image. You can entertain the viewer with a timeless image expression. It can be played back as a slide show or video so that a person approaches the scene. By adopting such an expression format, the image can be changed and enjoyed.

  For example, if the image of FIG. 5A is displayed after the image of FIG. 5D is displayed, it is possible to express the photographer as approaching from a distance. That is, it is only necessary to stop the synthesis of the reduced and synthesized image.

  Here, only two images are combined, but if the image of (d) is reduced and combined as shown in (c) of FIG. 4, it is possible to express the photographer further away. If these composites are overlapped, and the composites are stopped sequentially from the image that has been reduced the most, the photographer approaches more and more. Furthermore, it goes without saying that if this is done in more detail, it can be animated.

  Next, points to be noted when photographing in order to take measures against unnaturalness at the time of composite display will be described.

  FIG. 6 shows the positional relationship between the photographing device 10 and the photographer's face 11 as seen from above. As is clear from this figure, for example, when the half angle of view of the photographing device 10 is Θ, the distance from the photographing device 10 to the face 11 is D1, and the face width is Wf, the screen Since the width W1 of the face is expressed as Expression 1, the ratio R of the face to the width W1 is expressed as Expression 2.

W1 = 2 · D1 · tanΘ ·· (Formula 1)
R = Wf / (2.D1.tan.THETA.) (Equation 2)
For example, if Θ is 45 °, D1 is 45 cm and the face width is 15 cm from the position of the hand when holding the device, the result of Equation 2 is 1/6. However, in general, the vertical direction of the screen is shorter than the horizontal direction shown here, and conversely the height of the face in the vertical direction is longer than the width direction, so that the face occupies nearly 1/3 of the vertical direction in the screen. become. Therefore, in such a condition, it is preferable that (a) in FIG. 5 is synthesized at about 1/3 of (b).

  However, it is important that these conditions change depending on the focal length of the taking lens, which determines the angle Θ which is half of the angle of view. That is, when the focal length is short, the ratio occupying the face is reduced by increasing this Θ, so that the background portion is increased and it is easy to combine the backgrounds as shown in FIG.

  Further, as described above, when the angle of half of the angle of view of the photographing apparatus 10 is Θ, when it is moved in the direction of the arrow 12 in FIG. Considering, the range of W1 is photographed, and this is expressed by the above-described equation 1.

  When the camera advances by D3 and reaches the position P2, if the angle of view is the same, the range to be captured is the range of W2 represented by Equation 3 by the distance D2 to the plane 21. W1 is included in W2, but the ratio W1 / W2 is represented by Equation 4 by Equation 1 and Equation 2.

W2 = 2 · D2 · tanΘ ·· (Formula 3)
W1 / W2 = D1 / D2 (Equation 4)
That is, in the condition described with reference to FIG. 6, D1 / D2 is preferably 1/3. If D1 is 45 cm as described above, D2 is 45 cm × 3 = 135 cm.

  Accordingly, if the image is taken at a distance of D2 or more, when the image shown in FIG. 5A is superimposed on the image shown in FIG. 5B, the reduction ratio becomes too large to hide the face of FIG. Thus, in such image composition, attention must be paid to the position and size of the face.

  If D2 is 135 cm, it corresponds to two steps of an adult's stride. Therefore, the acceleration sensor 3 detects the vibration applied to the camera like a pedometer and takes a picture once every two steps. It may be devised to perform continuous shooting. Of course, if Θ is large, the ratio of the face to the screen becomes small according to Equation 2, so that continuous shooting at coarser timing may be used. For example, when the focal length is halved and the angle of view is doubled, R becomes 1/6, W1 / W2 in Equation 4 becomes 1/6, and D2 becomes 45 cm × 6 = 270 cm.

  For example, in the case of a system in which the angle of view of the imaging unit on the back side can be changed, such switching may be performed, and the invention includes such switching, but here it is simplified and Θ is 45 °. Continue to explain in case.

  FIG. 8 shows a flowchart executed by the photographing apparatus that performs the screen composition processing as shown in FIG. 5 using the rear photographing unit as described above at the time of rear photographing. Here, in particular, a description will be given by referring to such a shooting involving synthesis as “backside composite shooting”. Actually, the frontal shooting is also performed at the same time, and sometimes the frontal shooting results and the backside shooting results are used for playback display to enrich the change in the image, but here it is simplified and the backside shooting I will focus on shooting in the club. When the user performs shooting as shown in FIG. 3, the user selects “rear composite shooting mode” according to the mode setting of the shooting device, and the shooting operation has already started by pressing the release SW (6a in FIG. 2). And Since a plurality of back images are combined as shown in FIG. 5C, a variable N is initialized (0) in step S101 in order to manage the plurality of images. If the shooting operation is finished after the release SW (6a in FIG. 2) has been pushed in, S102 branches to Y and goes to S109. First, assuming that shooting is in progress, S102 is branched to N. S103 will be described.

  In S103, a back synthesis candidate image creation subroutine, which will be described later, is executed. Here, images are continuously acquired, and among the acquired images, the one suitable for composite display (composite candidate image) is determined by the combination determination unit 1f in FIG. 1, and the temporary recording unit (FIG. 1) is determined as Im. 1d) is temporarily recorded.

  Since it is not known whether or not the back-side composition candidate image obtained in this way is suitable for composition alone, it is first determined in S104 whether or not the first basic image has been obtained. If the first image is not acquired, it cannot be compared with the next image. Therefore, the process branches to N and waits until a candidate image is obtained in S103.

  When the first candidate image is obtained, S104 is branched to Y, and in S105, the image as shown in FIG. 5A is reduced so as to fit within the dotted line part of (b) (by the reduction part 1c of FIG. 1). Compare with the center of the next image. Here, the reduction ratio is assumed to be 1/3.

  This is determined under conditions such as those described in S114 of FIG. 9, and is determined by the angle of view, the image to be taken next during continuous shooting, and the balance of computing power and power consumption of this camera. If images are frequently acquired or combined, the recording capacity and power consumption are wasted and unreasonable, and here, the example is shown as an example of connecting with as few photographing as possible. When the numerical values described with reference to FIGS. 6 and 7 are used, it is a reasonable design to create a composite image by superimposing images reduced to 1/3. This is the pace at which one image is taken every two steps, but the number of combined images may be increased if a faster processing circuit or energy saving design is possible. If the number of shots is increased and the number of combined images is increased, it can be approximated to a moving image expression. When the angle of view is wide, it is possible to combine with a reduced number of shots.

  As shown in FIG. 5B, whether or not the result of reducing the previous image is synthesized so that the background is connected in such a manner that the face is hidden on the face portion of the next image. It is determined whether the contrast and edge match (by the combination determination unit 1f). The synthesis determination unit is a function executed by the program of the control unit 1, but may be designed by hardware. The upper part (over the head) of the face is usually a part of the ceiling or landscape, and the background changes as you move along the optical axis with the camera. . Since the shooting range changes as shown in FIG. 7 with respect to the position change or movement, a plurality of images can be combined by processing such as reduction. However, there is a body under the face part and under the face, and these parts do not change. Therefore, when it is reduced, continuous composition is not successful as is apparent in FIG. In this way, when compositing multiple images according to the concept of the present invention, the lower part of the face cannot be effectively used because it is difficult to compose and conceal an image captured later with a reduced image of the image captured earlier, It is better to be as low as possible from the center. However, if it goes too far down, the chin will be missing and it will become unnatural, so the explanation will continue assuming that the face is almost in the center of the screen.

  Therefore, in S105, the background portion (here, the upper half of the screen) of the image having no part of the person is compared, and in S106, it is determined whether or not they match. Such a determination is performed by the combination determination unit (1f in FIG. 1). If they match, the variable N is incremented (S107) because these images compared in S105 can be used as the image for use, and the candidate image Im is set as the recorded image Im (N).

  Such image determination is repeated until the shooting operation is completed (S102 → Y), and the background portion of the reduced image is compared with the center portion of the next obtained image, thereby moving the image taken while moving. Then, the composition determination unit 1f in FIG. 1 determines that an image that can be combined is obtained.

  In other words, in a photographic device that shoots multiple times in the direction opposite to the moving direction, whether the rear imaging unit can shoot multiple times sequentially, reduce the previously captured image, and combine it with the later captured image It is a feature of the present invention that the determination of whether or not composition is possible is performed.

  Of course, comparing this reduced image with a predetermined portion of the next image, whether or not it can be combined is an idea that can be applied to, for example, a display device in addition to a photographing device. Here, the continuity between the center of the screen and the reduced image is compared (the combination determining unit 1f determines whether the edge direction, the contrast changing unit, and the color distribution are continuous at the joint of the image). In hand-held shooting, the photographer cannot always go straight or hold the camera in the same position. Therefore, the image portion to be compared in S105 is not exactly the center, and is shifted by about 20% vertically and horizontally. May be. Of course, this value also has a larger margin as the angle of view increases.

  In S109, the temporarily recorded image is moved to the recording unit 4 and recorded. At this time, the date and time when the image was taken in order to manage the context of each image, acceleration information indicating whether the camera was properly held and moved, and the like are also recorded in association with each image (S110).

  For example, if the acceleration sensor has three axes, the gravitational acceleration will only be applied in the vertical direction if the camera is correctly positioned up and down, and when walking, the acceleration is periodically applied in the optical axis direction. Therefore, it is possible to record whether or not the image is suitable for the composition by taking a picture for the back composition by such information. Of course, the variable N may be recorded in association with each image. With such information, it is possible to correctly combine a plurality of images and change the sense of distance of the person by combining as shown in FIG.

  Note that the image as shown in FIG. 5D is further reduced and synthesized on the next image. In other words, if an image with a small N is reduced and combined on an image with a large N, an image as if the photographer was photographed from a distance can be obtained despite hand-held shooting. It is possible to change by.

  Next, the subroutine of S103 of FIG. 8 will be described using the flowchart of FIG.

  As described above, this is a program for making a candidate image and temporarily recording it while determining whether or not the result of repeated imaging by the rear imaging unit 5 is suitable for use as a composite image.

  In S111, continuous shooting is started, and in S112, it is determined whether the image obtained in S111 has a peculiar shadow caused by facial parts, and face detection is performed.

  If this face position is not at the center of the screen or at the bottom of the screen, as described above in S105 of FIG. 8, image composition by superimposing, which is a feature of the present invention, is not successful, so that determination is made in S113. What is important is that the background above the photographer is clearly visible. If this condition is not satisfied, the control unit 1 determines it and issues a warning with a display image or sound via the warning unit 1b (S121). Specifically, display the words "Please hold the camera so that the photographer's face is in the center of the screen", or display the resulting image along with the frame and put the face in the frame You may instruct.

  As described above, when the face comes to the center of the screen, it is determined whether the size of the face is 1/3 or less of the vertical size of the screen in order to secure a space where the background is reflected above the photographer. (S114).

  Of course, this may be adjustable by the length of the photographer's hand and the size of the face. Furthermore, the face size may be large if an image to be photographed next is obtained immediately during continuous shooting. This is because the previous image is reduced and superimposed on the face portion in the screen, so that when the image with a small background change is synthesized, the background is easily connected. However, if images are acquired or combined too frequently, uselessness or impossibility occurs in terms of recording capacity and power consumption. Therefore, here, an example in which as few images as possible are connected is shown. When the numerical values described in FIGS. 6 and 7 are used, it is possible to perform comfortable shooting and composition at the pace of shooting one image every two steps. Of course, the number of composites may be increased if a faster processing circuit or energy saving design is possible. If the number of shots is increased and the number of combined images is increased, it can be approximated to a moving image expression.

  Further, it can be changed depending on the angle of view of the rear imaging unit. If the angle of view is wide, the range in which the background appears is expanded, so the number of composites can be further reduced. In this case, it becomes an expression that a person approaches in a slide show.

  Thus, if this condition is not satisfied, the control unit 1 determines it and issues a warning with a display image or voice via the warning unit 1b (S122). Specifically, display the words “Please hold the camera so that the size of the photographer's face is appropriate”, or display the resulting image with a frame that is 1/3 the size of the screen. , It may be instructed to put a face in the frame.

  Even if these warnings are issued, for example, if the condition is not satisfied for 1 minute or longer, the combination determination unit 1f determines that in S123, and branches to S124 to cause the warning unit 1b to issue a warning indicating that the combination is not possible.

  In this way, an image satisfying the conditions of S113 and S114 is set as a candidate image, but S115 is branched depending on whether it is the first image, and classification at the time of temporary recording is performed. Since the first image is the reference, this is handled separately, and Im (0) is set in S117. Others are selected in the flow of FIG. 8, and only the selected ones are recorded in S109. Therefore, in S116, they are temporarily recorded as Im.

  In S118, as described above, shooting time information, acceleration information indicating the posture of the camera, the traveling direction, and the like are also written. In the case of such an image with information, such a plurality of images are taken by a camera, and a display device such as a PC or a TV performs image processing as described with reference to FIG. 5 according to the plurality of images obtained from the camera. To change the display. Of course, the display unit of the camera may perform such composite display during image reproduction.

  That is, a display device such as a PC, a TV, or a mobile phone including a display unit of a camera also uses a captured image captured at a plurality of times in the direction opposite to the moving direction, and is a feature of the present invention. It is possible to reduce the size of the captured image and determine whether it can be combined with the image captured later. Whether or not it is possible to reproduce a continually captured image with a change can be determined by determining whether or not the image can be combined.

  An example of such display control will be described with reference to the flowchart of FIG.

  S131 is a step of selecting an image to be reproduced and displayed. In this case, a specific image may be manually selected from thumbnails, and when another image (for example, one taken by the imaging unit 2 on the front) is reproduced, a corresponding back image is selected. You may do it.

  Whether or not there is an image immediately before and after this image, or whether or not the moving image is taken, is determined in S132 or S133. The auxiliary information (time and acceleration) attached in S110 of FIG. 8 attached to each image. Information, variable N, etc.).

  If there is such an image, the previous image (corresponding to (a) in FIG. 4 and FIG. 5) is reduced in S134, and the pattern of the upper peripheral portion is changed to the subsequent image ((b) in FIG. 4 and FIG. 5). The degree of coincidence is checked and if it is continuous, it is synthesized in an overlapped state. As a result, an image as shown in FIG. 5C is obtained. If the non-matching portion is deleted in the lower part of the screen, an image as shown in FIG. 5D is obtained, and an image of an expression taken from a distance is obtained despite being held. If you stop this composition, you can get a series of images that gradually get closer.

  Here, as described above, the reduction in S134 is assumed to be 1/3.

  This is determined under conditions such as those described in S114 of FIG. 9, and is determined by the angle of view, the image to be taken next during continuous shooting, and the balance of computing power and power consumption of this camera. If images are frequently acquired or combined, the recording capacity and power consumption are wasted and unreasonable, and here, the example is shown as an example of connecting with as few photographing as possible. When the numerical values described with reference to FIGS. 6 and 7 are used, it is a reasonable design to create a composite image by superimposing images reduced to 1/3. This is the pace at which one image is taken every two steps, but the number of combined images may be increased if a faster processing circuit or energy saving design is possible. If the number of shots is increased and the number of combined images is increased, it can be approximated to a moving image expression. When the angle of view is wide, it is possible to combine with a reduced number of shots.

  In the present embodiment, the front photographing unit 2 and the rear photographing unit 5 are provided integrally with the camera 10. However, the present invention is not limited to this, and two cameras having one photographing unit are prepared. You may make it cooperate a camera. In this case, the imaging unit of the first camera is used as the front imaging unit 2, the imaging unit of the second camera is used as the rear imaging unit 5, and the control unit (control unit 1) of one camera is The imaging unit of the other camera is configured to be controlled. The control communication in this case may be wired or wireless.

  In addition, although the person in the image photographed by the rear imaging unit is expressed as “photographer”, for example, the camera can be attached to the handle of a child's bicycle to synthesize the running state. In this case, the photographer is the parent of the child, and the child is the subject, but in order to simplify the explanation, the person photographed on the rear imaging unit is expressed as the photographer.

  As described above, according to the embodiment of the present invention, based on the image data, the change in the background image that changes as the shooting position moves is determined, and the size of the continuous image is determined based on this determination. The image processing that changes is performed. For this reason, it is possible to obtain an effect as if the photographer was photographed from a distance, or to easily express the state of moving by sequentially stopping the synthesis of the synthesized image. For example, it is possible to express the excitement when visiting a certain historic site for the first time based on the positional relationship between the historic site and the state of movement, and the like.

  In each embodiment of the present invention, an example is shown in which shooting is performed with the camera 10 and playback is performed. However, the present invention is not limited thereto, and playback can also be performed on a personal computer, a television, or the like. In the case of enjoying with a personal computer, a TV, or the like, image data of a moving image taken with the camera 10 may be stored.

  In each embodiment of the present invention, the camera 10 was shot and played back by continuous shooting. However, like a video camera, the camera 10 is applied to each frame of moving image shooting and has a playback display function as a moving image. Of course, it is also good.

  Furthermore, in each embodiment of the present invention, a digital camera has been described as an apparatus for photographing. However, the camera may be a digital single lens reflex camera or a compact digital camera, such as a video camera or a movie camera. A camera for moving images may be used, and a camera built in a mobile phone, a personal digital assistant (PDA), or the like may of course be used.

The present invention is not limited to the above-described embodiments as they are, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. Moreover, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the above embodiments. For example, you may delete some components of all the components shown by embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

It is a block diagram which shows the structure of the imaging device concerning this invention. The external view of the imaging device concerning this invention is shown, (a) is the external appearance perspective view seen from the front, (b) is the external appearance perspective view seen from the back surface. It is a figure which shows the imaging | photography method of this invention. It is the figure which showed the continuous image obtained in the back surface imaging | photography part of the imaging device of this invention. It is explanatory drawing when processing the continuous image obtained in the back surface imaging | photography part of the imaging device of this invention. It is a figure for demonstrating the positional relationship of the imaging device and photographer of this invention with an imaging | photography angle of view. It is a figure for demonstrating the change of the imaging | photography range at the time of imaging | photography while moving with the imaging device of this invention. It is an example of the flowchart which the imaging device of this invention performs at the time of back surface photography. It is the flowchart example which showed the subroutine of the flow which the imaging device of this invention performs at the time of back surface photography. It is the example of the flowchart which showed the subroutine which the display apparatus of this invention performs at the time of a composite display.

DESCRIPTION OF SYMBOLS 1 ... Signal processing, control part, 1a ... Face detection part, 1b ... Warning part, 1c ... Image reduction part, 1d ... Temporary recording part, 1e ... Composition part, 1f. ..Synthesis determination unit, 2... Imaging unit, 3... Acceleration sensor, 4... Recording unit, 5. ... Shooting equipment, 11 ... Photographer

Claims (8)

In a photographic device that shoots multiple times in the direction opposite to the moving direction,
An imaging unit that sequentially performs the plurality of times of imaging,
Among the plurality of shooting results, a composite possibility determination unit that determines whether a previously captured image is reduced and can be combined with an image captured later;
An imaging apparatus comprising: A face detection unit for detecting a face position in a shooting screen acquired by the imaging unit;
The imaging apparatus according to claim 1, further comprising a warning unit that issues a warning so that the imaging device is held at an appropriate position according to a detection result of the face detection unit. The warning unit is in accordance with the interval of shooting performed during the movement.
The photographing apparatus according to claim 2, wherein an appropriate position of the photographing apparatus is determined. The warning section is in accordance with the reduced image.
The photographing apparatus according to claim 2, wherein an appropriate position of the photographing apparatus is determined. Take multiple shots sequentially,
Of the above multiple shooting results, reduce the previously shot image and determine whether it can be combined with the later shot image,
A shooting method in which shooting in the direction opposite to the moving direction is performed multiple times. A shooting step for sequentially performing the plurality of shootings;
Among the plurality of shooting results, a composite image determination step for determining whether or not a previously captured image is reduced and can be combined with an image captured later;
A program that causes a computer to execute. Among the captured images captured at a plurality of times in the direction opposite to the moving direction, a compositability determination unit that determines whether the previously captured image is reduced and can be combined with an image captured later,
An image composition display device comprising:   Image composition characterized in that, among captured images taken at a plurality of times in the direction opposite to the moving direction, a previously taken image is reduced and it is determined whether or not it can be combined with an image taken later. Display method.

Images