JP2006279894A - Image processing apparatus, image processing method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image processing apparatus, an image processing method, and a program capable of easily creating a zoomed-up moving image by extracting a part of the moving image.
A control unit detects, for each frame, a portion changed from the previous frame in the vicinity of the previous rectangular frame, and sets a rectangular frame surrounding the detected changed portion. When the rectangular frame is set for all frames, the image within the set rectangular frame is cut out and enlarged to the normal size, and this is joined along the time axis to Reconfigure. As a result, the control unit can easily extract a subject image that moves within the frame from the captured moving image, and easily create a zoomed-in moving image.
[Selection] Figure 2

Description

  The present invention relates to an image processing device, an image processing method, and a program, and in particular, an image processing device, an image processing method, and a program capable of easily creating a zoomed-up moving image by extracting a part of the moving image. About.

In recent years, digital cameras that can shoot not only still images but also moving images have become mainstream. As an example of such a digital camera, a space portion (a part of a frame) centered on the subject of interest is cut out from the temporal frame of interest of continuously captured moving image data, and the subject of interest of the extracted still image is made larger. A digital camera provided with an image processing device for obtaining an easy-to-view image is disclosed (see, for example, Patent Document 1).
JP 2004-178368 A

  However, the technique disclosed in Patent Document 1 acquires still images of the subject of interest from the captured moving images and combines them as divided photographs, and acquires and combines the moving images of the subject of interest. I can't.

  The present invention has been made in view of the above circumstances, and provides an image processing apparatus, an image processing method, and a program capable of easily creating a zoomed-up moving image by extracting a part of the moving image. For the purpose.

  In order to achieve the above object, an image processing apparatus according to a first aspect of the present invention is a frame setting for setting a frame surrounding a subject image specified in advance in each of a plurality of frame images constituting a moving image. Means for cutting out an image included in the frame set by the frame setting means and enlarging the image to the size of the frame image, and the image enlarged by the image enlarging means. Moving image creating means for creating a moving image centered on the subject image by joining them according to the order of the frame images.

  In the image processing apparatus, the frame setting unit includes a change portion detection unit that detects a portion changed from the immediately preceding frame image in each of the plurality of frame images, and is detected by the change portion detection unit. A frame surrounding the portion may be set in each of the plurality of frame images as a frame surrounding the subject image.

  Furthermore, in the image processing apparatus, the frame setting unit includes a unit that sets the frame whose size is sequentially enlarged or reduced in accordance with the order of the frame images in each of the plurality of frame images. You may do it.

  In the image processing apparatus, the frame body setting means includes means for sequentially setting the frame body in each of the plurality of frame images according to a movement direction and a movement amount designated in advance. May be.

  Further, in the image processing apparatus, the frame setting unit includes a plurality of frames based on a distance between the measurement unit that measures the distance to the subject specified in advance and the subject measured by the measurement unit. Subject image detection means for detecting the subject image from each of the images, and a frame surrounding the subject image detected by the subject image detection means is set for each of the plurality of frame images. May be.

  Furthermore, in the image processing apparatus, when the subject image detection unit detects a plurality of target object images that are candidates for the subject image, the target object is located closest to the frame set as the immediately preceding frame image. May be acquired as the subject image.

  Further, in the image processing apparatus, the frame setting unit may include a focusing unit that focuses on a substantially center position of the frame set in each of the plurality of frame images.

  An image processing apparatus according to a second aspect of the present invention includes: a focusing unit that focuses on an object at a closest position among a plurality of objects captured by capturing a moving image; Frame body setting means for setting a frame of a predetermined size surrounding the image of the object focused by the focusing means on each of a plurality of frame images constituting the frame, and the frame set by the frame body setting means An image enlarging unit that cuts out an image included in a body and expands it to the size of the frame image, and an image enlarged by the image enlarging unit are connected in accordance with the order of the frame images from which the image is extracted, Moving image creating means for creating a moving image centered on the subject image.

  An image processing method according to a third aspect of the present invention includes a frame setting step for setting a frame surrounding a subject image specified in advance in each of a plurality of frame images constituting a moving image, and the frame setting An image enlargement step for cutting out an image included in the frame set in the step and enlarging it to the size of the frame image, and an image enlarged by the image enlargement step according to the order of the frame image from which the image was cut out A moving image creation step of creating a moving image centered on the subject image by joining together.

  An image processing method according to a fourth aspect of the present invention includes a focusing step of focusing on an object at the closest position among a plurality of objects captured by capturing a moving image; A frame setting step for setting a frame of a predetermined size surrounding an object image focused by the focusing step on each of a plurality of frame images constituting the frame, and a frame set by the frame setting step An image enlargement step for cutting out an image included in a body and enlarging it to the size of the frame image, and connecting the images enlarged by the image enlargement step according to the order of the frame images from which the image is cut out, A moving image creation step of creating a moving image centered on the subject image.

  According to a fifth aspect of the present invention, there is provided a program for setting a frame surrounding a predetermined subject image in each of a plurality of frame images constituting a moving image on a computer, and the frame An image enlargement procedure for cutting out an image included in the frame set by the setting procedure and enlarging it to the size of the frame image, and an image enlarged by the image enlargement procedure in the order of the frame images from which the image was cut out And a moving image creation procedure for creating a moving image centered on the subject image.

  A program according to a sixth aspect of the present invention includes a focusing procedure for focusing on an object at a closest position among a plurality of objects captured by capturing a moving image on a computer, and the moving image A frame setting procedure for setting a frame of a predetermined size surrounding an image of the object focused by the focusing procedure, and a frame setting procedure set for each of the plurality of frame images constituting An image enlargement procedure that cuts out an image included in a frame and enlarges it to the size of the frame image, and an image enlarged by the image enlargement procedure are connected according to the order of the frame images from which the image is cut out, And a moving image creating procedure for creating a moving image centered on the subject image.

  According to the present invention, it is possible to provide an image processing apparatus, an image processing method, and a program that can easily create a zoomed-up moving image by extracting a part of the moving image.

Hereinafter, the best mode for carrying out the present invention will be described in detail.
[Embodiment 1]

  First, a specific configuration of the digital camera according to Embodiment 1 of the present invention will be described.

  FIG. 1 is a block diagram illustrating a configuration example of a digital camera according to the present embodiment. As shown in FIG. 1, the digital camera 1 includes a lens optical system 2, an image sensor 3, an A / D (Analog / Digital) converter 4, an image processing unit 5, and a DRAM (Dynamic Random Access Memory) 6. A CODEC (Coder Decoder) 7, a display unit 8, a VRAM (Video Random Access Memory) 9, a control unit 10, a lens driving motor unit 11, an operation unit 12, and a flash memory 13. ing.

  The lens optical system 2 includes an imaging lens, a focus lens that performs focusing (focusing), a diaphragm mechanism that adjusts the amount of light of a subject image incident on the imaging element 3, and the like. An optical image (subject image) of the subject condensed through the lens optical system 2 is formed on the image sensor 3.

  The imaging device 3 is composed of, for example, a CCD (Charge Coupled Device) or the like, and converts a subject image formed through the lens optical system 2 into a charge having a magnitude corresponding to the brightness (photoelectric conversion). And accumulate. The image pickup device 3 is scanned and driven by a timing generator (not shown) or a V (Vertical) driver, and outputs the accumulated charges as an image pickup signal (analog signal).

  The image pickup signal output from the image pickup device 3 is subjected to A / D conversion after noise is removed by a double correlation sampling (CDS) circuit (not shown), amplified by an AGC (Automatic Gain Control) amplifier (not shown). The digital image pickup signal is converted by the device 4.

  The image processing unit 5 includes a color process circuit, a DMA (Direct Memory Access) controller, and the like. The image processing unit 5 is a color process circuit, and performs color process processing on the digital imaging signal supplied from the A / D converter 4 to generate YUV data. Then, the image processing unit 5 DMA-transfers the YUV data generated by the color process circuit to the DRAM 6 as a YUV signal using the DMA controller.

  The DRAM 6 is used as a work memory when the CODEC 7 compresses and decompresses YUV data.

  The CODEC 7 compresses the YUV data DMA-transferred to the DRAM 6 to generate compressed data of still images and moving images, or decompresses the compressed still image and moving image data read out from the flash memory 13 and stores them on the DRAM 6. YUV data is reproduced.

  In this embodiment, still image compression and decompression are performed by the JPEG (Joint Photographic Experts Group) method, and moving image compression and decompression are performed by the MPEG (Moving Picture Experts Group) method.

  The display unit 8 is configured by, for example, a liquid crystal display (LCD) or the like, and displays a through image, a captured image, a reproduced image, and the like based on a video signal supplied from the control unit 10. It is.

  The VRAM 9 is used as a work memory when displaying an image on the display unit 8.

  The control unit 10 includes, for example, a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and the like, and the CPU appropriately executes various programs stored in the ROM or the like. Thus, the operation of each part of the digital camera 1 is controlled. The RAM is used as a work memory when the CPU executes a program.

  In the present embodiment, the control unit 10 writes the YUV data held in the DRAM 6 to the VRAM 9, periodically reads the YUV data from the VRAM 9, generates a video signal, and supplies this to the display unit 8. Thereby, a through image, a captured image, a reproduced image, and the like are displayed on the display unit 8.

  Further, the control unit 10 creates an image file by adding header information to the compressed data generated by the CODEC 7 and stores the image file in the flash memory 13.

  Further, the control unit 10 adjusts the position of the focus lens in a predetermined step unit by step driving the lens drive motor unit 11 based on the contrast value obtained from the YUV data, thereby focusing (focusing). I do.

  The lens drive motor unit 11 is composed of, for example, a stepping motor or the like, and moves the focus lens to the in-focus position by step driving in accordance with a step drive command or a motor forward / reverse rotation command supplied from the control unit 10. It is.

  The operation unit 12 includes various operation keys such as a power key, a release button, a mode switching key for switching between the through mode, the shooting mode, and the playback mode, and supplies a detection signal corresponding to the key operation to the control unit 10. To do.

  The flash memory 13 is composed of an SD (Secure Digital) memory card, for example, and stores an image file created by the control unit 10.

  Next, a moving image reconstruction process according to the first embodiment of the digital camera having the above configuration will be described.

FIG. 2 is a flowchart showing the contents of a moving image reconstruction process in which a part of a moving image is cut out from the flash memory 13 in which the captured moving image is stored to reconstruct a new moving image.
First, the control unit 10 causes the display unit 8 to display a screen in which a reference rectangular frame is added to the first image frame image among a plurality of frames constituting the moving image.

  Subsequently, as shown in FIG. 3A, a rectangular shape so that the subject image of interest fits within a reference rectangular frame that is added and displayed on the first displayed frame image displayed on the display unit 8. When the position and size of the frame are specified by the user (step S101), the control unit 10 is in a mode for fixing the size (size) of the reference rectangular frame, or a mode for scaling up or down. A rectangular frame scaling mode selection screen for selecting any of the rectangular frame scaling modes is displayed on the display unit 8.

  In response to this, when the user designates a mode for scaling the rectangular frame size, the control unit 10 sets a rectangular frame scaling mode flag provided in the RAM or the like (step S102). Then, the next image frame is acquired (step S103), the difference between the previous frame image and the next frame image is extracted as the target subject image, and the image portion corresponding to the difference is detected (step S104). .

  The control unit 10 temporarily sets and displays a rectangular frame in which the rectangular frame size has been enlarged or reduced so as to surround the image portion of the change detected in the detection process of step S104 described above (step S105). Then, whether or not to further change the rectangular frame size temporarily set in step S105 described above is determined based on whether or not the rectangular frame size scaling flag is set in the processing in step S102 described above (step S106). .

  When the user selects the rectangular frame size fixed mode in the processing of step S102 described above and the scaling mode flag is not set (step S106; No), the center is set at the same position as the temporarily set rectangular frame. And a rectangular frame having the same size as the previous rectangular frame is reset (step S107).

  On the other hand, when the rectangular frame size scaling mode for changing the rectangular frame size so that it fits in the target subject image is selected in the processing of step S102 described above (step S106; Yes), FIG. As shown in FIG. 2C, a rectangular frame having a size obtained by enlarging or reducing the size of the previous rectangular frame so as to fit the subject image of interest is reset (step S108 in FIG. 2).

  When the rectangular frame size scaling process in either step S107 or S108 is completed, an image in the rectangular frame region that has been reset so as to fit the subject image is acquired, and the acquired image is stored in an internal memory (not shown). (Step S109). When the image acquisition process in step S109 described above is performed, the control unit 10 confirms whether or not there is an image frame for which a rectangular frame has not been set (step S110). If there is still a frame for which the rectangular frame has not been set (step S110; Yes), the process returns to step S103, and the processes from step S103 to S109 are repeated until the determination process in step S109 becomes Yes.

On the other hand, when the rectangular frame is set for all image frames (step S110; No), the images in the rectangular frame cut out and stored by the image acquisition process of S109 are read out in the order of storage. A moving image is reconstructed by enlarging the image to a size and sequentially joining them along the time axis. Then, it is stored in the flash memory 13 as a new moving image file (step S111). As a result, the control unit 10 can create a moving image as shown in FIGS.
The above processing is the moving image reconstruction processing in the first embodiment.

As described above, according to the moving image reconstruction process in the first embodiment, the image of the subject of interest moving in the rectangular frame size set in the moving image after shooting is gradually enlarged or reduced in one direction. You can perform sequential extraction of partial images within a rectangular frame and zoom up each extracted target subject image, so you can easily create new continuous video images that focus on the target subject image from continuously captured moving images Can be created.
[Embodiment 2]

  Next, Embodiment 2 of the present invention will be described. Note that the configuration of the digital camera of the present embodiment is the same as that of the first embodiment, and a description thereof will be omitted.

FIG. 5 is a flowchart showing the processing contents of the moving image reconstruction processing in the present embodiment.
First, the control unit 10 causes the display unit 8 to display an image of the first frame among a plurality of frames constituting the moving image.

  Subsequently, as shown in FIG. 6A, the position of the reference rectangular frame and the position of the reference rectangular frame so that the target object image fits within the reference rectangle added and displayed in the first frame image displayed on the display unit 8. When the size is designated by the user (step S201), the control unit 10 causes the display unit 8 to display a designation screen that allows the user to designate the moving direction and the moving amount of the rectangular frame for tracking the target subject image. .

  In response to this, when the user specifies the moving direction and moving amount of the rectangular frame (step S202), the control unit 10 displays the next image frame (step S203), and FIG. As shown in (c), the movement destination position of the rectangular frame is set according to the movement direction and the movement amount designated by the processing in step S202 described above (step S204). Then, an image portion corresponding to the rectangular frame at the set position is cut out, and is temporarily stored in an internal memory (not shown) following the image portion cut out immediately before (step S205).

  After the process of step S205, the control unit 10 checks whether there is still a frame for which a rectangular frame has not been set (step S206). If there is still a frame part for which the rectangular frame has not been set (step S206; Yes), the process returns to step S203, and the rectangular frame setting is continuously executed.

On the other hand, when the rectangular frame is set for all the frames (step S206; No), the image portion in the rectangular frame set to the movement position is cut out and enlarged to the normal size, and this is displayed on the time axis. Are connected together to reconstruct a new moving image (step S206). As a result, the control unit 10 can create a moving image as shown in FIGS.
The above processing is the moving image reconstruction processing in the second embodiment.

As described above, according to the moving image reconstruction process in the second embodiment, a rectangular frame for storing a subject image to be noticed that moves within a plurality of frames of a moving image after shooting is designated, and the subject image After specifying the movement direction, you can move the rectangular frame in the specified direction at regular time intervals, extract partial images continuously, and zoom up each extracted object image of interest, so you can shoot continuously captured moving images Therefore, it is possible to easily create a new continuous moving image with the focused subject image in focus.
[Embodiment 3]

  Next, a third embodiment of the present invention will be described. Note that the configuration of the digital camera of the present embodiment is the same as that of the first embodiment, and a description thereof will be omitted.

FIG. 8 is a flowchart showing the contents of a moving image reconstruction process for extracting a capture target designated at the start of shooting from a moving image and reconstructing a new moving image.
First, the control unit 10 displays an image captured by the image sensor 3 on the display unit 8 as a through image.

  Then, as shown in FIG. 9A, when the user designates the position of the subject image of interest to be captured before the start of shooting and recording (step S301), the control unit 10 The distance A is measured using a TTL metering method or the like, and is temporarily stored in a work memory provided in the RAM (step S302). A rectangular frame centered on the position of the subject image of interest designated in the processing of step S301 described above is provisionally set (step S303).

  Subsequently, the control unit 10 determines whether the rectangular frame provisionally set in the process of step S303 is within the image frame displayed on the display unit 8 (step S304). If it is determined that the rectangular frame is not within the frame (step S304; No), the rectangular frame is shifted to a position that fits within the frame (step S305). On the other hand, if it is determined that the rectangular frame is within the frame (step S304; Yes), the process proceeds to step S306.

  In step 306, the control unit 10 acquires the YUV data of the next frame of the moving image from the DRAM 6 temporarily stored, and the digital camera 1 and the subject are separated in the acquired frame. A position where the distance is equal to the distance A measured in the process of step S302 described above is detected (step S307).

  Here, if a plurality of positions where the distance between the digital camera 1 and the subject is equal to the distance A are detected in the process of step S307, the position within the current frame closest to the position of the immediately preceding rectangular frame is captured. Is extracted as the position of the subject (step S308). Then, as shown in FIGS. 9B and 9C, the control unit 10 provisionally sets a rectangular frame centered on the position of the subject acquired in the process of step S307 or S308 in FIG. Step S309).

  Subsequently, the control unit 10 determines whether or not all parts of the rectangular frame provisionally set in the process of step S309 are within the frame displayed on the display unit 8 (step S310). If all the parts of the rectangular frame do not fit within the frame according to the determination result (step S310; No), the rectangular frame is sequentially moved to a position that fits within the frame (step S311). On the other hand, when all the parts of the rectangular frame are within the frame (step S310; Yes), the process proceeds to step S312.

  When either of the processes in step S310 or S311 described above is completed, the control unit 10 cuts out the partial image in the rectangular frame and stores it in the work memory (not shown) following the partial image cut out immediately before. (Step S312). Each time a partial image is stored in the work memory, it is checked whether there is a next frame of the moving image (step S313). If the next frame of the moving image still exists (step S313; Yes), the process returns to step S306, and the processes of steps S306 to S312 are repeated until the final frame of the moving image.

On the other hand, when there is no next frame of the moving image, that is, when the partial image of the rectangular frame has been cut out until the final frame (step S313; No), the cut partial image within the set rectangular frame is stored. The moving image is reconstructed by sequentially reading from the work memory, expanding to the normal size, and connecting them along the time axis (step S314). As a result, the control unit 10 can create a moving image as shown in FIGS.
The above processing is the moving image reconstruction processing in the third embodiment.

As described above, according to the moving image reconstruction process in the third embodiment, when the subject specified on the moving image before the start of shooting is at the same distance from the digital camera 1, the subject image is obtained from a plurality of subjects. Since a partial image within a predetermined rectangular frame can be sequentially cut out from a moving image and stored, and each stored partial image can be zoomed up, a new moving image focused on a specified subject can be easily created. be able to.
[Embodiment 4]

  Next, a fourth embodiment of the present invention will be described. Note that the configuration of the digital camera of the present embodiment is the same as that of the first embodiment, and a description thereof will be omitted.

11 and 12 are flowcharts showing the contents of the moving image reconstruction process in the present embodiment.
First, the control unit 10 displays an image captured by the image sensor 3 on the display unit 8 as a through image.

  Then, as shown in FIG. 13 (a), when the user designates the in-focus point and the size of the rectangular frame surrounding it before the start of shooting (step S401), the control unit 10 determines the next moving image. The YUV data of the frame is acquired from the DRAM 6 temporarily stored (step S402), and the acquired YUV data is compared with the YUV data of the immediately preceding frame, whereby the current frame and the immediately preceding frame are compared. A changed portion is detected (step S403).

  Then, it is determined whether or not a changed portion is detected at a location close to the rectangular frame set in the immediately preceding frame in the process of step S403 (step S404). If a changed portion is not detected at a location close to the rectangular frame set in the immediately preceding moving image frame (step S404; No), the position and focus of the rectangular frame are left as they are (step S405).

  On the other hand, when a changed portion is detected at a location close to the rectangular frame set in the immediately preceding moving image frame (step S404; Yes), as shown in FIGS. 13B and 13C, this changed portion is displayed. A rectangular frame is temporarily set so as to surround (step S406 in FIG. 11) and focused at the center or the closest location in the rectangular frame (step S407).

  After the process of step S405 or S407, the control unit 10 checks whether there is a next frame of the moving image (step S408). If there is still a next frame of the moving image (step S408; Yes), the process returns to step S402, and the rectangle setting is continued.

  On the other hand, if there is no next frame of the moving image (step S408; No), after shooting is finished (step S409), all rectangular frames from the initially set rectangular frame to a certain range are extracted (step S410). .

  Subsequently, the control unit 10 calculates an average value of the center position and size of the rectangular frame extracted in the process of step S410 (step S411), and provisionally determines the calculated average value and the process of step S406. An intermediate value between the position and size of the rectangular frame set in (2) is calculated (step S412).

  And the control part 10 discriminate | determines whether the intermediate value calculated by the process of step S412 has left | separated from the average value calculated by the process of step S411 more than fixed value (step S413), and fixed value When the distance is more than the above (step S413; Yes), the position and size of the rectangular frame immediately before or immediately after is adopted (step S414).

  On the other hand, if the intermediate value calculated in step S412 is within a certain range from the average value calculated in step S411 (step S413; No), the process proceeds to step S415.

  Then, as illustrated in FIGS. 14A to 14C, the control unit 10 determines the position and size of the rectangular frame formed based on the intermediate value calculated in the process of step S412 (step S415). Thereafter, the control unit 10 checks whether there is a next frame of the moving image (step S416). If there is still a next frame of the moving image based on the determination result (step S416; Yes), it is determined whether or not the next unprocessed rectangular frame group can be acquired (step S417).

  If these unprocessed rectangular frame groups can be acquired (step S417; Yes), the rectangular frame group is taken out from the DRAM 6 (step S418), and the process returns to step S411 to set the rectangular frame in step S416. Or it repeats until the process of S417 becomes No.

On the other hand, when there is no next frame (step S416; No), or when it is impossible to acquire an unprocessed rectangular frame group (step S417; No), a partial image within the set rectangular frame is cut out, and normal A moving image is reconstructed by enlarging the image to a size and connecting them along the time axis (step S419). As a result, the control unit 10 can create a moving image as shown in FIGS.
The above processing is the moving image reconstruction processing in the fourth embodiment.

As described above, according to the moving image reconstruction process in the fourth embodiment, the moving subject is automatically focused on the moving subject, the subject image is extracted from the moving image, and a moving image obtained by zooming up the subject image can be easily obtained. Can be created.
[Embodiment 5]

  Next, a fifth embodiment of the present invention will be described. Note that the configuration of the digital camera of the present embodiment is the same as that of the first embodiment, and a description thereof will be omitted.

  FIG. 16 is a flowchart showing the contents of the moving image reconstruction process in the present embodiment. First, the control unit 10 acquires YUV data of the first frame from the DRAM 6 (step S501), and focuses the closest point in the frame (step S502). Subsequently, as shown in FIGS. 17A to 17C, the control unit 10 sets a rectangular frame having a predetermined size so that the in-focus position is as centered as possible (step S503).

  Thereafter, the control unit 10 checks whether or not there is a next frame of the moving image (step S504). If the next frame of the moving image still remains (step S504; Yes), after obtaining the YUV data of the next frame of the moving image from the DRAM 6 (step S505), the process returns to step S502, and step S504 is performed. Each process of S502 to S505, which is a rectangular frame setting process, is repeated until the determination process of “Yes” is Yes.

On the other hand, if there is no next frame of the moving image, that is, the last frame (step S504; No), the partial image within the set rectangular frame is cut out and enlarged to the normal size, and this is connected along the time axis. By matching, the moving image is reconstructed (step S506). As a result, the control unit 10 can create a moving image as shown in FIGS.
The above processing is the moving image reconstruction processing in the fifth embodiment.

  As described above, according to the moving image reconstruction process according to the fifth embodiment, a moving image obtained by automatically focusing on an adjacent subject, extracting the subject image from the moving image, and zooming up the subject image can be easily obtained. Can be created.

  In addition, this invention is not limited to the said embodiment, A various deformation | transformation and application are possible. Hereinafter, modifications of the above-described embodiment applicable to the present invention will be described.

  In the above embodiment, the image processing apparatus of the present invention is applied to a digital camera. However, the present invention is not limited to this, and may be applied to, for example, a mobile communication terminal having a camera function. .

  Moreover, in the said embodiment, the program which CPU of the control part 10 performs was previously memorize | stored in ROM etc. However, the present invention is not limited to this, and the program for executing the above-described processing may be applied to an existing mobile communication terminal so as to function as the digital camera 1 according to the above embodiment. Good.

  The method for providing such a program is arbitrary. For example, the program may be provided via a communication medium such as the Internet, or may be stored and distributed in a recording medium such as a memory card.

It is a block diagram which shows the structural example of a digital camera. 4 is a flowchart showing the contents of a moving image reconstruction process according to the first embodiment. It is a figure which illustrates the rectangular frame set in Embodiment 1. FIG. It is a figure which illustrates the moving image produced in Embodiment 1. FIG. 10 is a flowchart illustrating the contents of a moving image reconstruction process according to the second embodiment. It is a figure which illustrates the rectangular frame set in Embodiment 2. FIG. It is a figure which illustrates the moving image created in Embodiment 2. 10 is a flowchart illustrating the contents of a moving image reconstruction process according to the third embodiment. It is a figure which illustrates the rectangular frame set in Embodiment 3. It is a figure which illustrates the moving image created in Embodiment 3. 10 is a flowchart illustrating the contents of a moving image reconstruction process according to the fourth embodiment. 10 is a flowchart illustrating the contents of a moving image reconstruction process according to the fourth embodiment. It is a figure which illustrates the rectangular frame set in Embodiment 4. FIG. 10 is a diagram for explaining setting of a rectangular frame in a fourth embodiment. It is a figure which illustrates the moving image created in Embodiment 4. 10 is a flowchart illustrating the contents of a moving image reconstruction process according to the fifth embodiment. It is a figure which illustrates the rectangular frame set in Embodiment 5. It is a figure which illustrates the moving image created in Embodiment 5.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Digital camera, 2 ... Lens optical system, 3 ... Image sensor, 4 ... A / D converter, 5 ... Image processing part, 6 ... DRAM, 7 ... CODEC, 8 ... Display part, 9 ... VRAM, 10 ... Control 11, lens drive motor unit 12, operation unit 13, flash memory

Claims (12)

Frame setting means for setting a frame surrounding a subject image designated in advance in each of a plurality of frame images constituting the moving image;
Image enlarging means for cutting out an image included in the frame set by the frame setting means and enlarging it to the size of the frame image;
A moving image creating means for creating a moving image centered on the subject image by joining the images magnified by the image enlarging means in accordance with the order of frame images from which the images were cut out;
An image processing apparatus comprising: The frame setting means includes:
In each of the plurality of frame images, including a changed part detecting means for detecting a changed part from the immediately preceding frame image,
A frame that surrounds the portion detected by the change portion detector is set in each of the plurality of frame images as a frame that surrounds the subject image;
The image processing apparatus according to claim 1. The frame setting means includes:
Each of the plurality of frame images includes means for setting the frame body that is sequentially enlarged or reduced in size according to the order of the frame images.
The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus. The frame setting means includes:
Means for sequentially setting the frame body in each of the plurality of frame images according to a movement direction and a movement amount designated in advance;
The image processing apparatus according to claim 1. The frame setting means includes:
Measuring means for measuring a distance from the previously designated subject;
Subject image detection means for detecting the subject image from each of the plurality of frame images based on a distance from the subject measured by the measurement means;
Including
Setting a frame surrounding the subject image detected by the subject image detection means in each of the plurality of frame images;
The image processing apparatus according to claim 1. The subject image detection means includes
When a plurality of target object images that are candidates for the subject image are detected, an image of the target object that is closest to the frame set in the immediately preceding frame image is acquired as the subject image.
The image processing apparatus according to claim 5. The frame setting means includes:
Focusing means for focusing on a substantially center position of the frame set in each of the plurality of frame images;
The image processing apparatus according to claim 2. Among a plurality of objects captured by moving image shooting, focusing means for focusing on the object at the closest position;
Frame setting means for setting a frame of a predetermined size surrounding an image of the object focused by the focusing means on each of a plurality of frame images constituting the moving image;
Image enlarging means for cutting out an image included in the frame set by the frame setting means and enlarging it to the size of the frame image;
A moving image creating means for creating a moving image centered on the subject image by joining the images magnified by the image enlarging means in accordance with the order of frame images from which the images were cut out;
An image processing apparatus comprising: A frame setting step for setting a frame surrounding a predetermined subject image in each of the plurality of frame images constituting the moving image;
An image enlarging step of cutting out an image included in the frame set by the frame setting step and enlarging it to the size of the frame image;
A moving image creating step for creating a moving image centered on the subject image by joining the images magnified by the image enlarging step according to the order of the frame images from which the images were cut;
An image processing method comprising: A focusing step of focusing on an object at the closest position among a plurality of objects captured by capturing a moving image;
A frame setting step for setting a frame of a predetermined size surrounding the image of the object focused by the focusing step on each of a plurality of frame images constituting the moving image;
An image enlarging step of cutting out an image included in the frame set by the frame setting step and enlarging it to the size of the frame image;
A moving image creating step for creating a moving image centered on the subject image by joining the images magnified by the image enlarging step according to the order of the frame images from which the images were cut;
An image processing method comprising: On the computer,
A frame setting procedure for setting a frame surrounding a predetermined subject image in each of a plurality of frame images constituting the moving image;
An image enlargement procedure for cutting out an image included in the frame set by the frame setting procedure and enlarging it to the size of the frame image;
A moving image creating procedure for creating a moving image centered on the subject image by joining the images enlarged by the image enlarging procedure in accordance with the order of the frame images from which the images were cut;
A program for running On the computer,
A focusing procedure for focusing on the closest object among the plurality of objects captured by moving image shooting,
A frame setting procedure for setting a frame of a predetermined size surrounding an image of an object focused by the focusing procedure on each of a plurality of frame images constituting the moving image;
An image enlargement procedure for cutting out an image included in the frame set by the frame setting procedure and enlarging it to the size of the frame image;
A moving image creating procedure for creating a moving image centered on the subject image by joining the images enlarged by the image enlarging procedure in accordance with the order of the frame images from which the images were cut;
A program for running

Images