JP2004086592A - Moving image generating method and moving image generating program - Google Patents

Abstract

A desired object in a still image is moved while minimizing the operation of an operator (observer).
An input unit extracts image data corresponding to a specific still image from an image DB. The editing control unit 16 specifies at least one object to be operated in the still image, the type and the operation of the object, and refers to the motion DB storing the operation pattern of the object of the specific type, and It is determined whether an operation exists in the operation pattern. If a motion pattern exists, motion data of the object is generated based on the motion pattern. If no motion pattern exists, the modeling processing unit 20 generates motion data of the object. The editing unit 14 generates moving image data such that the specified object operates based on the still image data and the operation data.
[Selection diagram] Fig. 1

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to generation of a moving image, and more particularly, to a technique for generating a fixed moving image from a still image.
[0002]
[Prior art]
With the development of so-called CG (Computer Graphics), it has become possible to create moving images based on still images. For example, based on the still images before and after the change, morphing to create a plurality of frame images showing the process of the change, photographing an object from various directions, joining these, and obtaining an image of the object from any direction That is, a QTVR (QuickTime (registered trademark) Virtual) that can obtain a moving image in which an object is arbitrarily rotated.
Reality) has been put to practical use.
[0003]
In addition, a technique of creating a plurality of frame images by forming a way of movement of a selected object including an original still image for each frame and thereby creating a moving image is also used in movies and the like.
[0004]
[Problems to be solved by the invention]
In morphing and the like, there is a problem in that a plurality of still images before and after the change or in the process of the change are required, and the movement is restricted. That is, there is a problem that the motion object can be operated only within the range of the still image indicating before and after the change.
[0005]
On the other hand, in a large-scale CG used in a movie or the like, a still image is generated for each frame. However, this requires the use of a very high performance image processing system, creates still images for each frame, and requires a large number of still images, thus requiring a medium that requires digital recording and communication. Requires a remarkably large data capacity. In addition, there is a problem that information performance is poor in transmitting and recording adjacent frame data.
[0006]
On the other hand, a wireframe is created at the part to be moved, such as the mouth and eyes of an object (for example, a person or animal) in a still image, and by moving it, the effect is as if the object is talking. Technology has been proposed. However, in this technique, the operator needs to make various inputs to create a wire frame connecting the facial feature points. On the other hand, the movable range is limited to the face and the like.
[0007]
An object of the present invention is to provide a system capable of operating a desired object in a still image while minimizing the operation of an operator (observer). Another object of the present invention is to provide a system for generating a moving image in which each of a plurality of objects in the same still image is selected in a multi-user environment. A further object of the present invention is to provide a system for realizing the reproduction of a moving image without significantly increasing the data amount.
[0008]
[Means for Solving the Problems]
An object of the present invention is to provide, from image data corresponding to a still image, an input unit that extracts a predetermined still image from an image DB to generate moving image data in which an object in the still image operates, A moving image generating method that uses a moving image generating unit that generates a moving image based on the moving image data, and an output unit that converts the generated moving image data into a predetermined output form. Extracting image data corresponding to an image; identifying at least one object to be operated in the still image, a type and an operation of the object in the moving image generating unit; Referring to the motion DB storing the pattern, it is determined whether the type and the motion of the object are present in the motion pattern. Disconnecting, and when there is a motion pattern in the motion DB, reading the motion pattern and generating motion data of the object based on the motion pattern; and there is no motion pattern in the motion DB. A step of generating motion data of the specified object by a modeling process; a step of generating moving image data such that the specified object operates based on the still image data and the motion data; And a step of converting the moving image data according to a selected output mode.
[0009]
According to the present invention, the motion data of the selected object is generated from the motion pattern in the motion DB or by the modeling process, and the motion data is generated by adding the motion data to the still image data. Therefore, when the user inputs a necessary minimum instruction such as designation of an object, it is possible to obtain a moving image in which a desired object is operated. That is, complicated input such as setting of a wire frame can be omitted.
Further, according to the present invention, the motion data corresponding to the motion pattern in the motion DB is generated based on the motion pattern. Thereby, the load for generating the operation data can be reduced.
[0010]
The generated moving image data is preferably formed not as an aggregate of still image data for each frame but as an aggregate of still image data and motion data. As a result, the data amount can be remarkably reduced as compared with the case where moving image data is included as an aggregate of still data, and data generation and data processing by a small-scale personal computer become possible.
[0011]
In a preferred embodiment, the step of determining whether or not the object exists in the motion pattern includes comparing a position of a predetermined feature point in the object with a position of a related feature point in the motion pattern, Determining whether there is a motion pattern suitable for the motion of the object based on the comparison and selecting a suitable motion pattern. According to this embodiment, it is possible to select a more appropriate movement pattern and generate movement data that allows the object to move smoothly.
[0012]
In a preferred embodiment, the step of generating the motion data by the modeling process is configured to generate motion data of the selected object by fractal modeling. Of course, the motion data may be generated using other modeling.
[0013]
In another preferred embodiment, the method further includes a step of receiving, from a user, a designation of an object in a still image, a designation of a type of the object, and information indicating an operation of the object via a user interface. , Based on the received information, it is configured to determine whether or not it exists in the operation pattern.
[0014]
In a more preferred embodiment, from a plurality of users, the designation of an object in a single still image, the designation of the type of the object, and receiving information indicating the operation of the object, for each information, Determining whether or not the motion data is present in the motion pattern, generating motion data based on the motion pattern in the motion DB, and performing one of generation of motion data by a modeling process, It is configured to generate moving image data in which each object operates using each operation data of the designated object.
[0015]
According to the above embodiment, even in a multi-user environment, motion data of an object is generated in response to each designation of an object or the like by a user, and a moving image in which each object operates can be created. It becomes. It goes without saying that a single user can designate a plurality of objects and create a moving image in which each of the objects operates based on the designated objects.
In another preferred embodiment, the step of generating the moving image data includes a step of adding operation data such that each of the objects specified after the next frame of the still image operates.
[0016]
In still another preferred embodiment, the step of converting the moving image data in accordance with the selected output form is based on a state of an information processing device that displays a moving image and / or a data transmission path to the information processing device, Generating and outputting data in a predetermined format selected from a plurality of hierarchical output formats.
[0017]
Another object of the present invention is to provide an input unit for extracting a predetermined still image from an image DB in order to generate moving image data in which an object in the still image operates from image data corresponding to the still image, A computer-readable program for generating a moving image by using a moving image generating unit that generates a moving image based on an image and an output unit that converts the generated moving image data into a predetermined output form; Extracting, from the image DB, image data corresponding to a specific still image in the input unit; and at least one object to be operated in the still image, a type and an operation of the object in the still image in the moving image generating unit. And referring to a motion DB that stores a motion pattern of an object of a specific type, Determining whether the type and the motion of the object are present in the motion pattern; and, when the motion pattern is present in the motion DB, reading the motion pattern and, based on the read motion pattern, the motion of the object. A step of generating data; a step of generating motion data of the specified object by a modeling process when no motion pattern exists in the motion DB; and a step of generating the motion data based on the still image data and the motion data. A program for causing the computer to execute a step of generating moving image data such that the object operates and a step of converting the moving image data in the output unit according to a selected output form. Achieved.
[0018]
In a preferred embodiment, in the step of determining whether or not the object is present in the motion pattern, a position of a predetermined feature point in the object is compared with a position of a related feature point in the motion pattern, Based on the comparison, the computer is caused to determine whether there is a motion pattern suitable for the motion of the object and to select a suitable motion pattern.
Further, in a preferred embodiment, in the step of generating the operation data by the modeling process, the computer is caused to execute a step of generating operation data by operating the selected object by fractal modeling.
[0019]
In a more preferred embodiment, the step of, via a user interface, specifying the object in the still image from the user, specifying the type of the object, and receiving information indicating the operation of the object, The program is executed by the computer, and the computer is operated so as to determine whether or not the operation pattern exists in the operation pattern based on the received information.
[0020]
Receiving, from a plurality of users, designation of an object in a single still image, designation of the type of the object, and information indicating the operation of the object; and for each of the information, Judging whether or not the motion data exists, generating the motion data based on the motion pattern in the motion DB, and executing one of the generation of motion data by modeling processing, the computer executes the It is desirable to operate the computer so as to generate moving image data in which each object operates using each operation data of the designated object.
[0021]
In another preferred embodiment, in the step of generating the moving image data, the computer is caused to execute a step of adding operation data such that each of the objects specified after the next frame of the still image operates.
Further, in the step of converting the moving image data according to a selected output mode, a plurality of hierarchical output formats are displayed based on an information processing device displaying a moving image and / or a state of a data transmission path to the information processing device. And a step of generating and outputting data in a predetermined format selected from the above.
[0022]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. FIG. 1 is a block diagram schematically showing a moving image generation system according to the present embodiment. The moving image generation system 10 according to the present embodiment generates a moving image by giving an operation to a predetermined object based on an arbitrary still image such as a photograph, a painting, a line drawing, or a character by a process described later. Here, the object includes a person, an animal (eg, a dog, a cat, etc.), a plant (eg, a flower, a leaf, etc.) and an inanimate object such as a car in the image. In addition, objects that do not seem to move in the real world (for example, trees, mountains, and buildings) are also included in the objects in the present embodiment.
[0023]
As shown in FIG. 1, a moving image generating system 10 according to the present embodiment generates an input unit 12 for extracting still image data to be processed from moving images and various image data, and creates moving image data from the still image data. An editing unit 14 that controls the editing unit 14 and the like according to input data and the like for creating moving image data, a motion DB 18 that stores a data group indicating the movement of various objects, A modeling processing unit 20 for giving a motion to a predetermined object and generating predetermined motion data; an output unit 22 for generating and outputting data in a predetermined format according to moving image data provided from the editing unit 14; User interface (e.g., the edit control unit 16) after receiving an input from the / F) and a 24. Here, the editing unit 14, the editing control unit 16, the motion DB 18, and the modeling processing unit 20 form a moving image generation unit.
[0024]
As shown in FIG. 2A, the input unit 12 is provided from the image DB 30 storing various moving image data and still image data, and from the image DB 30 according to a user instruction given via the user I / F 24. An input data processing section 32 for extracting predetermined still image data and an analog / digital processing section 33 are provided. For example, the user reproduces a moving image based on moving image data, or sequentially reproduces still images based on still image data. Next, the user selects a desired frame image in the moving image or a desired image in the sequentially reproduced still images. This selection is given to the input data processing unit 32 via the user I / F 24. The input data processing unit 32 may acquire the information of the still image corresponding to the selected image from the image DB 30 in response to the selection. The image information thus obtained is A / D-converted by the analog / digital signal processing unit 33, and digital image data is transmitted to the editing unit 14 and the editing control unit 16.
[0025]
FIG. 3 is a flowchart illustrating processing executed by the editing unit 14 and the editing control unit 16. When image data (still image data) is received from the input unit 12 (input data processing unit 22), an object to be operated in a still image is determined according to information from the user given via the user I / F 24. At the same time as the selection (step 302), the operation of the object is specified (step 303).
[0026]
In the present embodiment, various motions of a person or some animals are patterned and stored as motion patterns in the motion DB 18. For an object that has not been patterned, the modeling processor 20 creates its operation data. When the edit control unit 16 determines that the motion of the designated object exists in the motion DB 18 (Yes in step 304), the edit control unit 16 extracts a motion pattern from the motion DB 18 This is transmitted to the editing unit 14 (step 305). On the other hand, when it is determined that the motion of the specified object does not exist in the motion DB 18 (No in step 304), the modeling processing unit 20 is activated to generate motion data of the object. (Step 306).
[0027]
The editing unit 14 generates moving image data using the motion data extracted from the motion DB 18, the motion data generated by the modeling processing unit 20, and the still image data (step 307). The moving image data generated in this manner is output to the output unit 22.
[0028]
In the present embodiment, a plurality of users simultaneously use the moving image creation system, refer to a certain still image, specify a desired object, and create a moving image in which the specified object operates. It is possible to create. As shown in FIG. 4, the user A and the user B can simultaneously refer to a certain still image and operate an input device such as a mouse to select a desired object and its operation. For example, user B tries to cause a person in a still image to perform a certain action (for example, walk), while user A tries to move something in a still image (for example, a leaf) (dropping). I thought). In this case, when schematically considered according to the instruction of the user B (see reference numeral 401), the editing control unit 16 connects the switch 50 to the motion DB 18 side (see reference numeral 403), and performs a predetermined operation in the motion DB 18. The pattern is passed to the editing unit 14. On the other hand, in response to an instruction from the user A (see reference numeral 402), the switch 50 is connected to the modeling processing unit 20 (see reference numeral 404), and necessary data and instructions are given to the modeling processing unit 20. That is, in the present embodiment, the editing control unit 16 functions as a switcher, operates to acquire an operation pattern from the motion DB 18 in response to an instruction of a certain user, and performs modeling in response to an instruction of another user. The processing unit 20 can be started. That is, in the present embodiment, a plurality of users can create a moving image by selecting desired objects and operating them by referring to the same still image.
[0029]
Next, a description will be given of the designation of an object or an operation by the user. As shown in FIG. 6A, based on the type of the object and its operation, the edit control unit 16 matches the motion pattern of the object of the type with the object in the still image, and specifies the optimal pattern. (Step 601). For example, it is assumed that the motion DB 18 stores, for a certain motion pattern of an object of a certain type, the coordinates of a plurality of feature points (for example, joints of the object) and the temporal change of the object. In this case, based on the position of each feature point at a certain timing and the position of each feature point extracted from the object in the still image, the most preferable pattern (for example, the one with the smallest error or the one with the largest correlation) ) Can be selected.
[0030]
Next, data relating to the operation pattern specified by the matching is read out from the pattern DB 18, and these data are provided to the editing unit 14 (Step 602). The editing unit 14 generates motion data representing the motion of the object for a predetermined frame according to the motion data. For example, if the data provided from the motion DB 18 indicates the movement of the feature point of the object over time, the point of the object to be moved corresponding to the feature point is moved, and the movement of the point is performed. Motion data is generated that changes the position of other parts of the object to match. In this way, as shown in FIG. 6B, a data group (see reference numeral 611) having motion data such that a selected object in a single still image 610 moves can be generated. .
[0031]
Next, the processing will be described by the modeling processing unit 20. The modeling processing unit 20 uses a still image including data of the designated object as a first frame image, and sequentially generates frame images similar to the first frame image and in which the object is partially changed. For example, a frame image as described above can be generated by using fractal modeling. For example, if a leaf is an object to be moved, a group of movement data can be generated in which the direction and shape of the leaf are slightly changed. Of course, instead of a single small object such as a leaf or flower, an object that should operate a tree or plant that can contain many leaves or flowers, and an object that should operate a group of multiple trees or plants It can be.
[0032]
For example, in the example of FIG. 5A, a still image acquired by the input unit 12 is displayed in an area 501 on the left side of the screen 500 of the display device. In this still image, a person 510, 511, an animal 512, and a tree 515 having some leaves (for example, reference numeral 516) are displayed. On the right side of the screen 500, an area 502 for selecting the type of the object is provided. Here, the type corresponding to the object selected by the user in the area 501, such as a person, a dog, a cat, and a car, can be selected. For example, when the user operates the mouse to select the person 510 and the button 513 displayed as “person”, the object and its type can be specified as “person”. it can.
[0033]
When the object to be operated and its type are selected, as shown in FIG. 5B, in the area 521 of the screen 520, the selected object 530 is displayed in a specific display form (for example, the outline is indicated by a bold line). In addition, an area 522 for selecting an operation is provided on the right side of the screen 520 while the outline is displayed in a specific color. The user operates a mouse or the like to select a button in the area 522 in which a desired operation is described, for example, a “slow walking” button 522. Thereby, the action to be performed by the object can be specified.
[0034]
Even when the tree 515 and the leaves 516 therein are selected as objects to be operated, it is desirable that the type of the object and, if possible, the operation can be selected. In accordance with the object selected using FIGS. 5A and 5B, the type and the motion, motion data is obtained from the motion DB 18 or motion data is generated by the modeling processing unit 20. In the present embodiment, the “user” may be a movie creator or a movie viewer.
[0035]
As described above, when the motion data from the motion DB 18 and the motion data generated by the modeling processing unit 20 are received, the editing unit 14 generates the moving image data based on the still image data and the motion data as the original images. Generate FIG. 7 is a diagram schematically showing generation of moving image data. 7, a certain object 711 in the image data of the still image 700 cut out by the input unit 12 is processed by the modeling processing unit 20 to generate a group of motion data 702, and on the other hand, another object 711 is generated. As for 712, data is obtained from the motion DB 18 and a group of motion data 701 is generated based on the data.
[0036]
The editing unit 14 uses the group of operation data 702 and the other group of operation data 701 and the image data 700 of the still image, and uses the same data as the image data 700 except for the selected object in the image data 700. For each of the selected objects, the image data group 710 (moving image data) is generated based on the operation data. For example, the editing unit 14 may generate moving image data to which motion data for causing each of the specified objects to operate is added after the frame following the still image passed from the input unit 12.
[0037]
The data format of the moving image data generated by the editing unit 14 is not an aggregate of a plurality of still image data for each frame, but an aggregate of still image data and motion data of a specific object. It is desirable to have. This makes it possible to significantly reduce the data amount of the entire moving image data as compared with the case where moving image data is included as an aggregate of still image data for each frame. In addition, by providing the output unit with an operation of combining the image data of the still image and the operation data, a moving image having the same quality as the aggregate of the still image data can be obtained. Since the data amount is extremely small, a personal computer can generate moving image data and perform image compression and conversion into a predetermined format in the output unit 22 described later without using a computer dedicated to image processing.
[0038]
The moving image data generated by the editing unit 14 is provided to the output unit 22. As shown in FIG. 2B, the output unit 22 includes a data buffer 40 that stores the received moving image data and data that has been subjected to format conversion described later, a data compression unit 42, and a format processing unit 44. Have. The data compression unit 42 converts the received moving image data (still image data and operation data of the selected object may be in the form of still image data and still image data) in accordance with a standard such as MPEG. Compress and format the motion data separately. Next, the format processing unit 44 generates data in a predetermined format according to an output form, for example, mobile communication, DVD, CD-ROM, TV broadcast, or the like, based on the compressed data. In this way, a moving image created from a still image can be viewed on various devices such as a mobile terminal, a personal computer, and a TV receiver. That is, the state of the data transmission path from the output unit 22 to the information processing device that displays moving images and the information processing device, such as the size of the display of the device to be played back, the storage capacity of the device, and the capacity of the network used for communication. , A plurality of hierarchical output formats are formed, and a signal (data) is output in one of the output formats.
[0039]
According to the present embodiment, based on the type of the selected object and its motion, the motion data of the selected object is obtained by acquiring a motion pattern from the motion DB 18 or by the processing in the modeling processing unit 20. Motion data can be acquired and the selected object in the still image can be moved.
[0040]
Further, according to the present embodiment, the editing control unit 16 accesses the motion DB by a switcher function according to a user's instruction, and activates the modeling processing unit 20 according to another user's instruction. For example, for the same still image, a plurality of users can each select a desired object and use the switcher function of the edit control unit 16 to create motion data of each object. Thus, it is possible to create a moving image in which objects selected by a plurality of users operate.
[0041]
The present invention is not limited to the above embodiments, and various modifications can be made within the scope of the invention described in the claims, which are also included in the scope of the present invention. Needless to say,
For example, in the above-described embodiment, the modeling processing unit uses the fractal model to generate the motion data of the object. However, the present invention is not limited to this, and other methods suitable for the object (for example, Needless to say, a particle system may be used.
[0042]
In the above-described embodiment, various instructions in response to the user operating the input device are given via the user I / F, and the output unit outputs image data in a predetermined format. The user's instructions are not limited to those input from an input device of a computer that implements the image editing system. For example, an image editing system is connected to the Internet, and instructions from a client machine, for example, designation of still images, objects, and actions are provided to the image editing system via the Internet, and moving image data is transmitted to the client via the Internet. It may be delivered to the machine. Needless to say, there may be a plurality of client machines.
[0043]
【The invention's effect】
According to the present invention, it is possible to provide a system capable of operating a desired object in a still image while minimizing the operation of an operator (observer). Further, according to the present invention, it is possible to provide a system that generates a moving image in which each of a plurality of objects in the same still image is operated when a plurality of objects in the same still image are selected in a multi-user environment. .
[Brief description of the drawings]
FIG. 1 is a block diagram schematically illustrating a moving image generation system according to an embodiment;
FIG. 2 is a block diagram illustrating a configuration of an input unit and an output unit according to the embodiment;
FIG. 3 is a flowchart illustrating processing executed by an editing unit and an editing control unit according to the present embodiment.
FIG. 4 is a diagram schematically illustrating that selection of an object and generation of its operation data according to the present embodiment are realized by a multi-user;
FIG. 5 is a diagram showing an example of an image displayed on a screen of a display device for selecting an object, its type, and the like in the present embodiment.
FIG. 6 is a flowchart schematically illustrating a processing example in an editing processing unit according to the embodiment and a diagram schematically illustrating generated operation data;
FIG. 7 is a diagram schematically illustrating generation of moving image data according to the present embodiment;
[Explanation of symbols]
12 Input section
14 Editorial Department
16 Edit control unit
18 Motion DB
20 Modeling processing unit
22 Output section
24 User I / F
30 Image DB
32 input data processing unit
33 Analog / Digital Processing Unit
40 data buffer
42 Image compression unit
44 Format processing unit

Claims (14)

An input unit for extracting a predetermined still image from the image DB and a moving image based on the extracted still image to generate moving image data in which an object in the still image operates from image data corresponding to the still image. A moving image generation method using a moving image generation unit and an output unit that converts the generated moving image data into a predetermined output form,
In the input unit, extracting image data corresponding to a specific still image from an image DB;
In the moving image generation unit, identifying at least one object to be operated in the still image, a type and an operation of the object;
Referring to a motion DB that stores a motion pattern of an object of a specific type, determining whether the type and motion of the object are present in the motion pattern;
Reading out the motion pattern when there is a motion pattern in the motion DB and generating motion data of the object based on the motion pattern;
Generating a motion data of the specified object by a modeling process when no motion pattern exists in the motion DB;
Based on the still image data and the operation data, generating moving image data such that the specified object operates,
A step of converting the moving image data in the output unit in accordance with a selected output mode. The step of determining whether or not there is in the motion pattern, comparing the position of a predetermined feature point in the object with the position of a related feature point in the motion pattern, based on the comparison, The method according to claim 1, further comprising determining whether there is a motion pattern suitable for the motion of the object and selecting a suitable motion pattern. The method according to claim 1, wherein the step of generating the motion data by the modeling process is configured to generate, by fractal modeling, motion data for operating the selected object. Further, via a user interface, from the user, the designation of the object in the still image, the designation of the type of the object, and receiving information indicating the operation of the object,
The method according to any one of claims 1 to 3, wherein the method is configured to determine whether or not the motion pattern is present based on the received information. Receiving, from a plurality of users, designation of an object in a single still image, designation of the type of the object, and information indicating an operation of the object;
A step of, for each of the information, determining whether or not the information is present in the motion pattern, and performing one of generation of motion data based on the motion pattern in the motion DB and generation of motion data by modeling processing With
The method according to claim 4, wherein the motion data of each of the designated objects is used to generate moving image data such that each of the objects moves. Generating the moving image data,
The method according to any one of claims 1 to 5, further comprising a step of adding motion data such that each of the objects specified after the next frame of the still image moves. Converting the moving image data according to the selected output form,
A step of generating and outputting data in a predetermined format selected from a plurality of hierarchical output formats based on a state of an information processing apparatus for displaying a moving image and / or a data transmission path to the information processing apparatus. The method according to any one of claims 1 to 6, characterized in that: An input unit for extracting a predetermined still image from the image DB and a moving image based on the extracted still image to generate moving image data in which an object in the still image operates from image data corresponding to the still image. A moving image generation unit and a computer-readable program to generate a moving image using the output unit that converts the generated moving image data into a predetermined output form,
In the input unit, extracting image data corresponding to a specific still image from an image DB;
In the moving image generation unit, identifying at least one object to be operated in the still image, a type and an operation of the object;
Referring to a motion DB that stores a motion pattern of an object of a specific type, determining whether the type and motion of the object are present in the motion pattern;
Reading out the motion pattern when there is a motion pattern in the motion DB and generating motion data of the object based on the motion pattern;
Generating a motion data of the specified object by a modeling process when no motion pattern exists in the motion DB;
Based on the still image data and the operation data, generating moving image data such that the specified object operates,
Converting the moving image data according to a selected output form in the output unit. In the step of determining whether there is in the operation pattern,
The position of a predetermined feature point in the object is compared with the position of a related feature point in the motion pattern, and based on the comparison, the presence or absence of a motion pattern suitable for the motion of the object is determined. The program according to claim 8, wherein the program causes the computer to execute the step of selecting the operation pattern. 10. The computer according to claim 8, wherein in the step of generating the operation data by the modeling process, the computer is caused to execute a step of generating operation data by operating the selected object by fractal modeling. program. Further, through the user interface, from the user, the designation of the object in the still image, the designation of the type of the object, and the step of receiving information indicating the operation of the object, the computer, the computer,
The program according to any one of claims 8 to 10, wherein the computer is operated to determine whether or not the operation pattern exists in the operation pattern based on the received information. Receiving, from a plurality of users, designation of an object in a single still image, designation of the type of the object, and information indicating an operation of the object;
A step of, for each of the information, determining whether or not the information is present in the motion pattern, and performing one of generation of motion data based on the motion pattern in the motion DB and generation of motion data by modeling processing And causing the computer to execute
12. The program according to claim 11, wherein the computer is operated so as to generate moving image data such that each object operates using each operation data of the specified object. In the step of generating the moving image data,
The program according to any one of claims 8 to 12, wherein the program causes the computer to execute a step of adding operation data such that each of the objects specified after the next frame of the still image operates. . In the step of converting the moving image data according to the selected output mode,
The step of generating and outputting data in a predetermined format selected from a plurality of hierarchical output formats, based on a state of an information processing apparatus for displaying a moving image and / or a data transmission path to the information processing apparatus; 14. The program according to claim 8, wherein the program is executed by a computer.

Images