JPH11110577A - Image data processing apparatus and method, and transmission medium - Google Patents

Abstract

(57) [Summary] [Problem] To enable rapid creation of an animation color image. SOLUTION: In step S11, a moving image of a trace line created in step S4 is captured by a camera, a scanner, or the like, and a line image is generated. The line image is thinned, and a closed region is formed by the thinned line. In step S12, the pixels in the closed area are painted in a predetermined color. The trace line is thickened, and the pixels of the thick line are colored with a predetermined color. The image in which the pixels in the closed region are colored and the image in which the pixels with thick lines are colored are synthesized. In step S13, a moving image of the synthesized image is checked.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image data processing apparatus and method, and a transmission medium, and more particularly, to an image data processing apparatus and method capable of quickly generating animation image data, and transmission. Regarding the medium.

[0002]

2. Description of the Related Art FIG. 36 shows the flow of a process for producing a conventional animation. First, in step S1, animation production planning is performed. Based on this plan, a scenario is created in step S2. Next, in step S3, an original image is created. This original picture is drawn on paper using a pencil or a pen.

Next, in step S4, step S
A moving image is created based on the original image created in Step 3. This moving image is interpolated so that one original image created in step S3 and the next original image can be seen as a moving image.

[0004] In step S5, the moving image thus created is copied on a transparent film to create a cell image. At this time, the image of one frame is
It is composed of images of a plurality of layers.

For example, as shown in FIG. 37, a moving image including three frames in which a person and a dog walk toward a house is composed of three layers for each frame. That is, in this example, a cell image C in which a house image is drawn is prepared as a background layer. Then, the human and the dog are drawn on layer A and layer B, respectively. In the layer A, in the cell image A2 of the frame F2, the frame F1
Is drawn at a position slightly shifted from the position in the cell image A1. Similarly, in the cell image A3 of the frame F3, a person is drawn at a position slightly shifted from the position of the cell image A2 of the frame F2.

Further, in the layer B, the frame F
The position of the dog in the second cell image B2 is slightly shifted from the position of the cell image B1 in the frame F1. The position of the dog in the cell image B3 of the frame F3 is a position slightly shifted from the position of the cell image B2 in the frame F2.

[0007] After the cell images of a plurality of layers are created in this way, a paint process (coloring process) is performed on these cell images in step S6. That is, coloring processing is performed on each cell image using a paint or the like. Next, in step S7, a plurality of colored cell images are photographed in a superimposed manner to form one frame.

For example, as shown in FIG. 38, a layer A and a layer B are superimposed on a layer C to form an image of one frame (one frame). Such processing is sequentially performed over a plurality of frames, and data of a moving image of a plurality of frames is created.

Next, in step S8, the moving image created as described above is reproduced and checked.
Thereafter, in step S9, an audio signal corresponding to the moving image is recorded, and in step S10, it is broadcast.

As described above, if a human is manually coloring a cell image, a great deal of labor and time are required to generate an animation image. Therefore, it is conceivable that these operations are computerized. in this case,
An already colored image and an image that has not been colored can be confirmed by creating α key data and displaying an image corresponding to the α key data.

[0011]

As described above, when an animation is produced, the creation of a moving image, the creation of a cell image, the painting process, the photographing process, and the like are all performed manually. There was a problem that required a long time and effort to create.

When the original image itself is drawn using a computer, it becomes difficult to express a subtle touch of trace lines constituting the image, and an image having an atmosphere intended by the animation creator is drawn accurately. It becomes difficult.

[0013] If a moving image composed of a plurality of frames is generated by repeating the operation of manually photographing a plurality of cell images in layers for each layer, it becomes difficult to change the frame images. there were.

It is conceivable that the coloring process is computerized. However, when a coloring process is performed by a computer, there has been a problem that it is difficult for the author to express a delicate touch drawn by hand with a pencil or a pen.

If a person manually colors a cell image and shoots it, there is a problem that it takes a lot of labor and time to produce one animation.

A process for coloring an image into a predetermined color is computerized, and a mouse is operated on a display on which the image of the computer is displayed, and a cursor is moved on the display like a brush to paint the color. In this case, there is a possibility that a portion where the color is left unpainted may occur in a small area.

It is necessary to switch the mode between displaying the image of the α key data and displaying the colored image. The position of the unpainted area in the image corresponding to the α key data is determined by the user. It is necessary to repeat the operation of storing the image, switching the mode, displaying the color image, and applying the coloring process to the area at the stored position. As a result, it is necessary to store the unpainted position and repeat the operation of switching the mode, and there is a problem that the operability is poor.

Even when the coloring process is computerized, it is troublesome to perform an operation of coloring each cell image one by one on a computer, and further improvement in operability has been desired.

If the cell image is colored by hand, it takes a lot of labor and time to create an animation image. Therefore, the image once created is converted into a more varied image. There was a problem that was difficult to change.

A first aspect of the present invention is to quickly and easily create an animation image.

A second aspect of the present invention is to enable quick and reliable generation of animation image data based on an image having an atmosphere intended by the author.

A third aspect of the present invention is to easily change a frame image so that a desired frame image can be created.

A fourth aspect of the present invention is to make it possible to accurately represent a touch intended by an author.

According to a fifth aspect of the present invention, a color animation image can be generated quickly and reliably.

According to a sixth aspect of the present invention, an image is prevented from being left unpainted, and an image can be quickly and reliably colored to a desired color.

A seventh aspect of the present invention is to improve operability so that unpainted portions can be found and corrected quickly and reliably.

An eighth aspect of the present invention is to improve the operability and to quickly and surely generate a color image.

A ninth aspect of the present invention is to make it possible to easily and surely create a variety of images.

[0029]

According to a first aspect of the present invention, there is provided an image data processing apparatus comprising: a line image generating unit configured to generate an image composed of lines from a captured image; A region coloring means for coloring the pixels of the region, and a combining means for combining an image in which the pixels of the region are colored by the region coloring means and an image of a line constituting the image.

According to a fifth aspect of the present invention, there is provided an image data processing method comprising:
A line image generating step of generating an image composed of lines from the captured image; an area coloring step of coloring pixels of an area surrounded by the lines forming the image; and a pixel of the area being colored by the area coloring step And a synthesizing step of synthesizing the obtained image and an image of a line constituting the image.

According to a sixth aspect of the present invention, in the transmission medium, a line image generating step of generating a line image from the captured image, and an area for coloring pixels in an area surrounded by the line forming the image A program including a coloring step, and a combining step of combining an image in which pixels of a region are colored by the region coloring step and a line image forming the image is transmitted.

An image data processing apparatus according to claim 7 is
Cell number specifying means for specifying a cell number of a cell image to be captured, layer number specifying means for specifying a layer number of a cell image to be captured, and display control for displaying a cell number and a layer number of a cell image already captured Means.

According to a tenth aspect of the present invention, in the image data processing method, a cell number specifying step for specifying a cell number of a cell image to be captured, a layer number specifying step for specifying a layer number of a cell image to be captured, And a display control step of displaying a cell number and a layer number of the cell image being displayed.

In the transmission medium according to the present invention, a cell number designating step for designating a cell number of a cell image to be captured, a layer number designating step for designating a layer number of a cell image to be captured, have already been captured. A program including a display control step of displaying a cell number and a layer number of a cell image is transmitted.

According to a twelfth aspect of the present invention, there is provided an image data processing apparatus, comprising: a time sheet display control means for displaying a time sheet defined by a frame number corresponding to a time series of frames of a moving image and a layer number; And a cell number input means for inputting a cell number of a fetched cell image at a predetermined position.

A time sheet display control step of displaying a time sheet defined by a frame number corresponding to a time series of a frame of a moving image and a layer number; And a cell number input step of inputting a cell number of the fetched cell image at a predetermined position.

In the transmission medium according to the present invention, a time sheet display control step of displaying a time sheet defined by a frame number corresponding to a time series of frames of a moving image and a layer number; At the position
A cell number input step of inputting a cell number of the fetched cell image.

The image data processing apparatus according to claim 22, wherein the detecting means for detecting the density of the trace lines constituting the captured image, the area coloring means for coloring an area surrounded by the trace lines, Determining means for determining a color in the vicinity of the trace line in a region surrounded by the mark in accordance with the density of the trace line.

The image data processing method according to claim 28, wherein a detecting step of detecting the density of a trace line constituting the captured image, an area coloring step of coloring an area surrounded by the trace line, And determining a color in the vicinity of the trace line in a region surrounded by the symbol in accordance with the density of the trace line.

A transmission medium according to claim 29, wherein a detecting step of detecting the density of a trace line constituting a captured image, an area coloring step of coloring an area surrounded by the trace line, And a determining step of determining a color near the trace line in the specified area in accordance with the density of the trace line.

An image data processing apparatus according to claim 30 is an identification means for identifying an original color of a trace line constituting a captured image, an area coloring means for coloring an area surrounded by the trace line, The color of the boundary between the trace line and the area surrounded by the trace line, or the color of the boundary between the area on one side of the trace line and the area on the other side,
Determining means for determining a color when the trace line is omitted in accordance with the identification result of the identification means.

An image data processing method according to claim 33, wherein: an identification step of identifying an original color of a trace line constituting the captured image; an area coloring step of coloring an area surrounded by the trace line; The color of the border between the trace lines and the area surrounded by the trace lines, or the color of the border between the area on one side of the trace lines and the area on the other side, when the trace lines are omitted. And a determining step of determining in accordance with the identification result of the identifying step.

The transmission medium according to the thirty-fourth aspect includes an identification step of identifying an original color of a trace line constituting a captured image, an area coloring step of coloring an area surrounded by the trace line, and a trace line. And the color of the border between the area surrounded by the trace line and the color of the border between the area on one side of the trace line and the area on the other side, if the trace line is omitted. And a determining step of determining in accordance with the step identification result.

According to a thirty-fifth aspect of the present invention, in the image data processing apparatus, a binarizing means for binarizing each pixel of the captured trace line into a color pixel and a colorless pixel, and forming the trace line with a color having a width of one pixel. Conversion means for converting into a line composed of pixels.

The image data processing method according to claim 40, wherein a binarizing step of binarizing each pixel of the fetched trace line into a color pixel and a colorless pixel;
A conversion step of converting into a line composed of colored pixels having a pixel width.

The transmission medium according to claim 41, wherein a binarizing step of binarizing each pixel of the captured trace line into a color pixel and a colorless pixel, and converting the trace line from a color pixel having a width of one pixel. And a conversion step of converting into a line.

The image data processing device according to claim 42, wherein the binarizing means for binarizing the captured trace line pixel into a color pixel and a colorless pixel, and a color binarized by the binarizing means. And a confirmation unit for confirming whether or not the trace line composed of pixels is closed.

The image data processing method according to the forty-sixth aspect includes a binarization step of binarizing the captured trace line pixel into a color pixel and a colorless pixel, and a binarization step.
And a confirmation step of confirming whether or not the trace line composed of the coded color pixels is closed.

The transmission medium according to claim 47, further comprising: a binarization step of binarizing the captured trace line pixel into a color pixel and a colorless pixel; and a color pixel binarized in the binarization step. And confirming whether or not the trace line is closed.

The image data processing apparatus according to claim 48 is characterized in that a colored image generating means for generating a colored image in which a predetermined area of the line image is colored, and a colored area and a non-colored area of the colored image. It is characterized by comprising identification image generating means for generating an identification image to be identified, and display control means for displaying a colored image on the identification image.

According to a fifty-fifth aspect of the present invention, in the image data processing method, a colored image generating step of generating a colored image in which a predetermined area of the line image is colored, An identification image generating step of generating an identification image to be identified and a display control step of displaying a colored image on the identification image are provided.

A transmission medium according to claim 56, wherein a colored image generating step of generating a colored image in which a predetermined area of a line image is colored is distinguished between a colored area and a non-colored area of the colored image. A program including an identification image generating step of generating an identification image and a display control step of displaying a colored image on the identification image is transmitted.

The image data processing device according to claim 57, wherein a judging means for judging a correspondence between the first image of the first frame and the second image of the second frame, and a color of the first image And a coloring means for coloring the second image with the color detected by the detecting means in accordance with the determination result of the determining means.

The image data processing method according to claim 64, wherein a judging step of judging the correspondence between the first image of the first frame and the second image of the second frame, and the color of the first image Detecting the color detected in the detection step according to the determination result of the determination step,
And a coloring step of coloring the image.

A transmission medium according to claim 65, wherein a judging step of judging a correspondence between a first image of a first frame and a second image of a second frame, and detecting a color of the first image And transmitting a program including a coloring step of coloring the second image with the color detected in the detecting step in accordance with the determination result of the determining step.

The image data processing apparatus according to claim 66, wherein a colored image generating means for generating a colored image by coloring a predetermined color on the colorless pixels in the area surrounded by the trace lines of the fetched cell image. Corresponding to the coloring process by the colored image generating means, a colored region colored the color of the colored image,
Key data generating means for generating key data for identifying an uncolored uncolored area; parameter setting means for setting a parameter that defines a priority when combining colored images of a plurality of layers; and parameter setting means And a synthesizing unit for synthesizing the colored images of the plurality of layers in accordance with the parameters set by the above and the key data generated by the key data generating unit.

The image data processing method according to claim 68, further comprising a colored image generating step of coloring a colorless pixel in a region surrounded by a trace line of the captured cell image with a predetermined color to generate a colored image. A key data generating step of generating key data for identifying a colored area colored with the color of the colored image and an uncolored uncolored area in correspondence with the coloring processing in the colored image generating step; A parameter setting step for setting a parameter that defines a priority when a colored image is synthesized; a parameter set in the parameter setting step; and a plurality of layers corresponding to the key data generated in the key data generation step. And a combining step of combining the colored images.

The transmission medium according to claim 69, wherein a colored image generating step of generating a colored image by coloring a predetermined color to a colorless pixel in an area surrounded by a trace line of a fetched cell image; A key data generating step of generating key data for identifying a colored region in which the color of the colored image is colored and an uncolored uncolored region corresponding to the coloring process in the image generating step; and a colored image of a plurality of layers. A parameter setting step for setting a parameter that defines a priority when synthesizing a plurality of layers, coloring of a plurality of layers corresponding to the parameter set in the parameter setting step and the key data generated in the key data generation step. And transmitting a program including a combining step of combining images.

In the image data processing apparatus according to the first aspect, the image data processing method according to the fifth aspect, and the transmission medium according to the sixth aspect, a line image is generated from the captured image and colored. The combined image and the line image are combined.

An image data processing apparatus according to claim 7, an image data processing method according to claim 10, and an image data processing method according to claim 10.
In the transmission medium described in 1, the cell number and the layer number of the cell image to be captured are designated, and the cell number and the layer number of the captured cell image are displayed.

An image data processing apparatus according to claim 12,
In the image data processing method according to the twentieth aspect and the transmission medium according to the twenty-first aspect, a time sheet defined by a frame number and a layer number is displayed, and is captured at a predetermined position on the time sheet. Since the cell number of the cell image is input, it is possible to easily and reliably configure and change the image of each frame.

The image data processing apparatus according to claim 22,
In the image data processing method according to the twenty-eighth aspect and the transmission medium according to the twenty-ninth aspect, the density of the trace line is detected, and the color near the trace line in an area surrounded by the trace line is set to the density. Determined accordingly.

The image data processing apparatus according to claim 30,
In the image data processing method according to claim 33 and the transmission medium according to claim 34, a boundary portion between the trace lines and an area surrounded by the trace lines corresponding to a result of identifying the original color of the trace lines. Or the color of the border between the area on one side of the trace line and the area on the other side, and the color when the trace line is omitted is determined.

An image data processing apparatus according to claim 35,
In the image data processing method according to claim 40 and the transmission medium according to claim 41, after the captured trace line is binarized, the trace line is converted into a line composed of colored pixels having a width of one pixel. .

An image data processing apparatus according to claim 42,
In the image data processing method according to claim 46 and the transmission medium according to claim 47, the captured trace line pixel is binarized into a color pixel and a colorless pixel, and the binarized color pixel is It is checked whether the trace line is closed.

An image data processing apparatus according to claim 48,
In the image data processing method according to claim 55 and the transmission medium according to claim 56, a colored image is displayed on an identification image for identifying a colored region and a non-colored region of a colored image. You.

An image data processing apparatus according to claim 57,
In the image data processing method according to claim 64 and the transmission medium according to claim 65, the correspondence between the first image of the first frame and the second image of the second frame is determined. The color of one image is detected. Then, the detected color is colored in the second image according to the determination result.

An image data processing apparatus according to claim 66,
In the image data processing method according to claim 68 and the transmission medium according to claim 69, a colored image of a plurality of layers is synthesized according to the parameter and the key data.

[0069]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Embodiments of the present invention will be described below. In order to clarify the correspondence between each means of the invention described in the claims and the following embodiments, each means is described. When the features of the present invention are described by adding the corresponding embodiment (however, an example) in parentheses after the parentheses, the result is as follows. However, of course, this description does not mean that each means is limited to those described.

The image data processing device according to claim 1 is
A line image generating means (for example, step S45 in FIG. 5) for generating an image composed of lines from the captured image, and an area coloring means (for example, FIG. 5) for coloring pixels in an area surrounded by lines constituting the image. 5, step S47), and a synthesizing unit (for example, step S57 in FIG. 5) for synthesizing an image in which the pixels of the region are colored by the region coloring unit and an image of a line constituting the image. .

An image data processing apparatus according to a second aspect is
It is characterized by further comprising a line coloring means (for example, step S53 in FIG. 5) for coloring pixels of lines constituting the image.

The image data processing apparatus according to claim 3 is
It is characterized by further including a capturing means (for example, step S41 in FIG. 5) for capturing an image for generating an image composed of lines.

The image data processing device according to claim 7 is
A cell number designating unit (for example, step S74 in FIG. 7) for designating a cell number of a cell image to be captured; a layer number designating unit (for example, step S73 in FIG. 7) for designating a layer number of a cell image to be captured; A display control means (for example, step S77 in FIG. 7) for displaying a cell number and a layer number of a cell image which has already been taken in is provided.

The image data processing device according to claim 9 is
A cell image display control means (for example, step S76 in FIG. 7) for displaying the captured cell image is further provided.

According to a twelfth aspect of the present invention, there is provided an image data processing apparatus comprising: a time sheet display control means for displaying a time sheet defined by a frame number corresponding to a time series of a moving image frame and a layer number (for example, FIG. 33, and a cell number input means (for example, step S226 in FIG. 33) for inputting the cell number of the captured cell image at a predetermined position on the time sheet.

The image data processing apparatus according to the thirteenth aspect of the present invention provides a registration means for registering a fetched cell image in an entry list for each layer (for example, step S in FIG. 33).
223), and the cell number input means inputs a cell number registered in the entry list.

The image data processing apparatus according to claim 14 is a registered image display control means for displaying the cell images registered in the entry list in order of cell number for each layer (for example, step S224 in FIG. 33). ) Is further provided.

The image data processing apparatus according to the fifteenth aspect is a special effect setting means for setting a special effect for each layer, cell, or frame (for example, step S in FIG. 33).
230).

The image data processing apparatus according to claim 18 is a synthesizing means for synthesizing a cell image of each layer number input on the time sheet for each frame (for example, FIG. 33).
Step S227) is further provided.

The image data processing apparatus according to the nineteenth aspect further comprises a moving image display control means (for example, step S234 in FIG. 34) for displaying an image synthesized by the synthesizing means as a moving image on a trial basis. Features.

The image data processing apparatus according to the present invention comprises a detecting means (for example, step S55 in FIG. 5) for detecting the density of the trace lines constituting the captured image.
A region coloring means (for example, step S47 in FIG. 5) for coloring a region surrounded by the trace line, and a color near the trace line in the region surrounded by the trace line are determined according to the density of the trace line. And a determination unit (for example, steps S205 to S207 in FIG. 30).

The image data processing apparatus according to the twenty-third aspect further comprises a line coloring means (for example, step S53 in FIG. 5) for coloring the trace line, and the determining means is surrounded by the trace line and the trace line. It is characterized in that the color of the boundary portion of the area is gradationally represented by the color of the trace line and the color of the area surrounded by the trace line in accordance with the density of the trace line.

The image data processing apparatus according to the twenty-fifth aspect further includes identification means for identifying the original color of the trace line (for example, steps S202 to S204 in FIG. 30), and the determination means determines the identification result of the identification means. The color is determined according to

The image data processing apparatus according to the twenty-seventh aspect is characterized by further comprising a thickening means (for example, step S52 in FIG. 5) for making the trace line thicker by a predetermined pixel.

The image data processing apparatus according to claim 30 is an identification means for identifying the original color of the trace line constituting the captured image (for example, steps S202 to S204 in FIG. 30), and is surrounded by the trace line. Area coloring means (eg, step S4 in FIG. 5)
7) and the color of the boundary between the trace line and the area surrounded by the trace line, or the color of the boundary between the area on one side of the trace line and the area on the other side, and the trace line is omitted. Determining means for determining the color of the case in accordance with the identification result of the identifying means (for example, steps S205 to S20 in FIG. 30)
7).

The image data processing apparatus according to the thirty-fifth aspect includes a binarizing means (for example, step S44 in FIG. 5) for binarizing each pixel of the fetched trace line into a color pixel and a colorless pixel; Conversion means for converting a line into a line composed of colored pixels having a width of one pixel (for example, step S in FIG. 5)
45).

The image data processing apparatus according to claim 36 is a coloring means for coloring a colorless pixel in a region surrounded by a line having a width of one pixel into a predetermined color (for example, step S4 in FIG. 5).
7) is further provided.

The image data processing device according to claim 42 is a means for binarizing pixels of a fetched trace line into color pixels and colorless pixels (for example, step S in FIG. 5).
44), and a confirmation unit (for example, step S132 in FIG. 17) for confirming whether or not the trace line composed of the color pixels binarized by the binarization unit is closed.

The image data processing apparatus according to claim 44 is a conversion means for converting a trace line composed of colored pixels into a trace line having a width of one pixel (for example, step S in FIG. 5).
45), wherein the confirming means confirms that the trace line having a width of one pixel is closed.

In the image data processing apparatus according to the present invention, when the confirmation means confirms that a part of the trace line is open, the trace line is opened so as to form a closed area. It is characterized by further comprising a correcting means (for example, step S134 in FIG. 17) for correcting the part where the data is present.

The image data processing apparatus according to claim 48 is a colored image generating means for generating a colored image in which a predetermined area of a line image is colored (for example, step S47 in FIG. 5).
An identification image generating means (for example, step S51 in FIG. 5) for generating an identification image for identifying a colored region and a non-colored region of a colored image, and a display for displaying the colored image on the identification image Control means (for example, step S164 in FIG. 26).

An image data processing apparatus according to claim 50 is an extracting means for extracting a color of a predetermined area of a colored image displayed on an identification image (for example, step S16 in FIG. 26).
8) and a coloring means for coloring an uncolored area of the colored image with the color extracted by the extracting means (for example, FIG.
6, step S169).

The image data processing apparatus according to claim 57 determines the correspondence between the first image of the first frame and the second image of the second frame (for example, FIG.
9, step S153), detecting means for detecting the color of the first image (for example, step S153 in FIG. 19), and the color detected by the detecting means corresponding to the result of the determination by the second means. Coloring means for coloring an image (for example, FIG.
Step S154).

The image data processing apparatus according to claim 63 is a selection means for selecting whether to color only a designated area or to color all of a plurality of corresponding areas (for example, the step shown in FIG. 19). S151) is further provided.

The image data processing device according to claim 66, wherein a colored image generating means (colored image generating means for generating a colored image by coloring a predetermined color to a colorless pixel in an area surrounded by a trace line of a fetched cell image. For example, step S4 in FIG.
7) and corresponding to the coloring process by the coloring image generating means,
Key data generating means (for example, step S51 in FIG. 5) for generating key data for identifying a colored region in which the color of the colored image is colored and a non-colored uncolored region; Parameter setting means (for example, FIG. 3)
(Step S230 of FIG. 3), a synthesizing unit for synthesizing a colored image of a plurality of layers corresponding to the parameter set by the parameter setting unit and the key data generated by the key data generating unit (for example, FIG. 35). Step S
253).

FIG. 1 shows a configuration example of a personal computer to which the present invention is applied. In this configuration example,
The personal computer 17 executes various processes.
A CPU 1 is provided. The ROM 2 stores programs necessary for the CPU 1 to execute various processes, and the RAM 3 appropriately stores data, programs, and the like necessary for the CPU 1 to execute various processes.

[0097] The CRT controller 4 is controlled by the CPU 1 and causes the CRT 5 to display a predetermined image. When the user operates the joystick 7, the joystick controller 6 outputs an operation signal to the CPU 1. When the user operates the mouse 9, the mouse controller 8
The operation signal is output to the CPU 1.

The floppy disk (FD) controller 10 performs a process of recording or reproducing data on the floppy disk 11. Similarly, the hard disk (HD) controller 12 executes a process of recording or reproducing data on the hard disk 13. The keyboard controller 15 inputs data from the keyboard 16 to the CPU.
Output to 1.

The personal computer 17 has a video camera 21,
A scanner 22, a video tape recorder 23, and a disk recorder 24 are connected.

FIG. 2 is a diagram showing a flow of animation production according to the present invention, and the processes corresponding to those shown in FIG. 36 are denoted by the same reference numerals. That is, also in the present invention, the processes from planning to creation of a moving image in steps S1 to S4 and the sound insertion and broadcasting processes in steps S9 and S10 are performed in the same manner as in FIG.

That is, in the case of the embodiment of the present invention,
Step S1 is performed after the moving image is created in step S4 and before the sound insertion processing is performed in step S9.
The processing from 1 to S13 is different from the conventional case. These processes are all performed on a computer.

In step S11, the moving image created in step S4 is transferred to the video camera 21 or the scanner 22.
For example, the capturing process is performed. Then, in step S12, a paint process is performed on the image captured in step S11. This painting process is performed on a computer, and is not manually performed using paints or the like. Then, a process of reproducing and checking the painted image along the time sheet is performed in step S13. After the moving image check is performed in step S13, a sound insertion process is performed in step S9, and the broadcast is performed in step S10.

FIG. 3 shows the processing of steps S11 to S13 shown in FIG. 2 in more detail. First, in step S21, a process of capturing the created moving image using the scanner 22 or the video camera 21 is performed. This import processing is performed for each layer of the moving image and for each cut, and each is registered in a file.

In step S22, step S2
The image captured in step 1 is subjected to line drawing processing. The image captured by this line drawing processing is binarized for painting. Although the details will be described later, at this time, the line drawing is thinned so that the trace line is represented by the width of one pixel. Then, it is checked whether or not a closed region is formed by a line having a width of one pixel. The paint processing in step S24 described later is performed in units of the closed area.

Next, the process proceeds to step S23, in which a process for creating a color necessary for painting on a palette is performed, and in step S24, a process for coloring a line drawing with the palette is performed. When one area closed by a line having a width of one pixel is specified and a color for coloring the area is specified, pixels inside the area are automatically colored with the specified color.

In step S25, of each area,
It is checked whether there are any areas that have not yet been colored. Then, when there is a region that has not been colored yet (when there is an unpainted region), a process of coloring that region is further performed.

Next, in step S26, a process of coloring a predetermined color on the trace line of the original color is performed. The color of the original trace line forms a kind of command, as described later, and does not always match the color displayed as an animation image. Here, a process of coloring the trace line to a color to be displayed as an animation image is performed.

Next, in step S27, a process of synthesizing the image obtained as a result of the painting process in step S24 with the image of the trace line obtained in the coloring process in step S26 is performed. The image synthesized in this way is stored as a file in cell image units in step S28.

As described above, when an image of a plurality of cells is stored, a time sheet process is performed in steps S29 to S31. In this time sheet process, first, a process of registering the saved cell image on the entry list is performed. Then, after registration in the entry list, the cell images are arranged on the time sheet using the cell numbers on the entry list. Thereby, the image of each frame can be defined by the image of the desired number of layers. Further, in this time sheet processing, special effects and the like can be set as necessary.

In this manner, the frame specified on the time sheet can be previewed and confirmed as a moving image (displayed as a moving image on a trial basis).

Here, the configuration of a file generated by performing the above-described processes will be described with reference to FIG. The animation data is composed of a plurality of cut data. Here, the cut means a group of continuous images.

Each cut has a .T
Management file with TT extension added, bitmap file with .BMP extension added to layer and cell numbers, layer and cell numbers created as appropriate during processing , And a work file represented by adding a .WIG extension. In addition, TARGA, which is represented by adding the extension of .TGA to the layer and cell number,
It has a file, a cut name and a cut number, a time shift file with a .TSH extension added, and a cut name and a cut number with an .AVI extension added to an animation file. ing.

The management file having the extension of .TTT includes list number data, file name list data, and color pallet data. The file name list data has an extension of .BMP, and when the number is n, the list number data is set to n. The color pallet data can represent 256 colors.

A color palette file is represented by adding a .PAL extension to a layer and cell number. In this color palette, up to 256 color components and color names are stored.

A work file having a .WIG extension is
The width and height information of the image representing the content of the special effect, a 24-bit original image that is a corrected image of the scanner image,
A line drawing image which is an image recognized as an 8-bit line drawing,
An 8-bit paint image that is a colored image, an 8-bit alpha image that identifies a colored portion, an 8-bit trace image that is an image in which trace lines are colored, and a 24-bit final image that is a composite image Has images.

A TARGA file represented by an extension of .TGA is composed of 24-bit final image data and 8-bit final alpha key data.
It is 2-bit data.

The timesheet file represented by the extension of .TSH includes the number of registered images, the number of frames, the maximum number of layers, the resolution of rendering, the registered image list name, and timesheet data. The time sheet data is data indicating which layer is to be overlapped at which time.

Note that the background image is also an image of one layer.

FIG. 5 shows a flow of data generated when various processes are executed. Hereinafter, each process will be described with reference to this flowchart. Step S41
In the process, the scanner 22 takes in a moving image drawn on paper by the author using a pencil or a pen.
For example, when the mouse 9 is operated to input a scan processing command, the CPU 1 causes the CRT 5 to display an image as shown in FIG. 6 as a GUI for the scan processing. Then, according to this GUI, the user performs a scanning process as shown in the flowchart of FIG.

First, in step S71, the user inputs a cut name to the GUI display section 71 of FIG. The input of this name is performed by operating the keyboard 16. Next, proceeding to step S72, the user determines whether or not to specify a layer number and a cell number with a cursor,
If the cursor is not specified, the process proceeds to step S73, in which the layer number is displayed on the GUI display unit 702 shown in FIG. 6, and the cell number is displayed on the GUI display unit 703 in step S74. To enter and display.

If it is determined in step S72 that the layer number and the cell number are designated by the cursor, the process proceeds to step S75, where the user operates the cursor keys of the keyboard 16 or the mouse 9 to read the GUI reading confirmation window of FIG. The cursor 709 displayed at 708 is moved to a predetermined position. That is, a cell number represented by a numeral is shown in the horizontal axis direction of the reading confirmation window 708, and a layer number represented by alphabetical characters is shown in the vertical axis direction. Therefore, the cursor 709
Is moved to a predetermined position defined by the cell number and the layer number, whereby the layer number and the cell number can be designated. In this example, alphabetic characters are used as layer numbers, but such characters will be described as numbers for convenience of explanation. Of course, the layer number may be represented by a number instead of an alphabetical character.

After the cut name, the layer number, and the cell number are specified as described above, in step S76, the user turns on the button 704, and the CPU 1
Is connected to the scanner 22 via the input / output interface 14.
To output a control signal to execute a scanning process. Then, when the scanner 22 receives an image captured by scanning one cell image, the CPU 1 outputs this to the image display window 707 and displays it. In step S77, the CPU 1 displays a mark 710 at a position specified by the layer number and the cell number in the read confirmation window 708. As a result, the user can change the layer number and cell number of the captured image,
Can be quickly recognized.

The scan may be executed before the input of the cut name, the layer number, and the layer number.

Next, the process proceeds to step S78, where it is determined whether or not all necessary moving images have been fetched. If there are moving images that have not been fetched yet, the process returns to step S71 to execute the subsequent processing. Execute repeatedly. When the capture of all the moving images has been completed, the process ends.

Note that, as shown in the GUI of FIG.
It can be rotated 0 degrees or minus 90 degrees. In addition, by appropriately setting correction items for the filter displayed on the display unit 706, contrast correction and gamma correction can be performed.

By performing the scanning process as described above, in step S42 of FIG.
Thus, 4-bit original image data is obtained. As described above, this image data is filed with an extension of .BMP. This file is recorded on the hard disk 13. As shown in FIG. 4, for example, when the image is scanned as the first cell image of the layer A, it is recorded on the hard disk 13 with a file name of A0001.BMP.

Next, in step S43, a process of calculating lightness data, chromaticity data, and chroma data from the RGB 24-bit full-color bitmap data is executed. Further, in step S44, a filtering process is performed. The details of the filtering process are shown in FIG.

First, in step S91, it is determined whether or not the target pixel is white. If the value of the brightness data of the target pixel is larger than the predetermined threshold and the values of the chromaticity data and the saturation data are smaller than the predetermined thresholds, the color of the target pixel is determined to be white. In this case, the process proceeds to step S95, in which a predetermined bit of the 8-bit data is set to indicate that the color is white.

If it is determined in step S91 that the target pixel is not white, the flow advances to step S92 to determine whether the target pixel is black. Brightness data,
If the values of the chromaticity data and the saturation data are each smaller than a predetermined threshold value, it is determined that the target pixel is black. In this case, the process proceeds to step S96, and by setting a predetermined bit out of the eight bits, black is set.

If it is determined in step S92 that the target pixel is not black, the flow advances to step S93 to determine whether the target pixel is red. Whether or not the target pixel is red is determined based on whether or not the values of the brightness data and the chromaticity data of the target pixel are respectively within the range of the red threshold. If the target pixel is red, in step S97, it is set to be red by setting a predetermined bit of the eight bits.

If it is determined in step S93 that the target pixel is not red, the flow advances to step S94 to determine whether the target pixel is green. This determination is also determined to be green when the values of the brightness data and the chromaticity data of the target pixel are within the range of a predetermined threshold value of green. In this case, the process proceeds to step S98, and by setting a predetermined bit out of the eight bits, the color is set to be green.

As described above, when the filtering process is completed, the process proceeds to step S45 in FIG. 5, and the thinning process is executed. In this case, the CPU 1
Then, a GUI as shown in FIG. 9 is displayed. In this GUI, images captured by a specified layer are displayed in order in a layer image display window 902. Button 90
By operating the number 3, the displayed cell image can be scrolled rightward or leftward. In the image display window 901, a designated one (for example, the leftmost cell image in the figure) of the cell images displayed in the layer image display window 902 is displayed.

The window 904 displays the cell image immediately before the cell image displayed in the image display window 901, and the window 905 below the cell image displays the cell image largely displayed in the image display window 901. The same cell image as is displayed in small size. This window 90
By specifying a predetermined position of the image displayed in 5, that part can be displayed in the image display window 901 in an enlarged manner.

Buttons 906 are for Original (Org), Line (Line), Paint (Paint), and Alpha (Alph).
a), Trace, or Final
Operated when setting any of the modes. The display example of FIG. 9 shows a state in which the original button has been operated.

A button 907 is operated when the original image data read by the scanner 22 and recorded on the hard disk 13 is read. A button 908 is operated when a line image is emphasized and read. Window 909
Displays a brush shape. By operating the button 910, the size of the brush can be changed. The noise component of the line image displayed in the image display window 901 can be removed using the brush having the designated size.

The button 911 is operated when creating a filter for performing an operation for converting 24-bit full-color image data into 8-bit color image data. The button 912 is operated when thinning data is obtained from the original image data displayed in the image display window 901.

In the color selection window 914, a color palette used when coloring the image displayed in the image display window 901 is displayed. When a predetermined one of the color palettes displayed in the color selection window 914 is designated, the color is displayed in the color setting window 913. By appropriately setting and adjusting the buttons in the color setting window 913, the color of one palette in the color selection window 914 is set to a desired value (color).
Can be set to

When the user operates the button 912 in FIG. 9, a thinning process is performed in step S45 in FIG. This thinning processing means processing for converting a trace line having a predetermined thickness into a line having a width of one pixel. That is, the trace lines constituting the line image drawn as the original image are drawn with a pen or pencil by a human hand, and thus have an appropriate thickness (width). Therefore,
As described above, when this is taken in by the scanner 22 and becomes bitmap image data, the trace line is represented by a plurality of dots as shown in FIG. 10, for example. In the example shown in FIG. 10, the pixels (H8, V1), (H8, V2), (H
8, V3), (H7, V4), (H7, V5), (H
6, V6), (H6, V7), (H5, V8), (H
5, V9), (H4, V10), (H4, V11),
The process of converting into a line composed of a total of 13 pixels (H3, V12) and (H2, V13) is referred to as a thinning process.

The thinning process is a process of changing a black pixel in contact with a white pixel into a white pixel for each thinning process. In other words, the trace line is made thinner by deleting the black pixels that are in contact with the white pixels.
The trace line becomes thinner each time the thinning process is performed once, and by repeating the thinning process a plurality of times, a line having a width of one pixel can be finally obtained.

One pixel is 640 × 480 (= 3072)
00) When each pixel is composed of pixels, these pixels are binarized into white pixels and other colors (black, red, or green pixels) by the filtering processing in step S44 described above. . Here, white pixels are referred to as colorless pixels, and pixels of other colors are referred to as colored pixels.

Next, the details of the thinning processing will be described with reference to the flowchart of FIG. First, in step S111, it is determined whether the target pixel is a color pixel. If the target pixel is a colorless pixel, the process proceeds to step S116, the target pixel is changed to the next pixel, and the process returns to step S111 to determine whether the target pixel is a color pixel.

If it is determined in step S111 that the pixel of interest is a color pixel, the flow advances to step S112 to determine whether the pixel of interest is a pixel that is continuous with another color pixel. Specifically, for example, as shown in FIG. 12, it is checked whether eight pixels in contact with the target pixel are colorless pixels or colored pixels with the target pixel as a center, and among the eight pixels, If two or more pixels are colored pixels, it is determined that the target pixel is a pixel that is continuous with the colored pixels. For example, when the pixel of interest is binarized as a colored pixel due to noise or the like, there is no color pixel among the eight pixels in contact with the pixel of interest (because it is an isolated pixel). Is determined to be a pixel that is not continuous with other colored pixels.

If it is determined in step S112 that the pixel of interest is not continuous with another color pixel, the flow advances to step S115 to change the pixel of interest to a colorless pixel. That is, noise is removed. And step S
At 116, the target pixel is changed to the next pixel, and the process returns to step S111.

If it is determined in step S112 that the pixel of interest is continuous with another color pixel, the flow advances to step S113 to determine whether the pixel of interest is in contact with a colorless pixel. Specifically, two pixels in the vertical direction adjacent to the pixel of interest and two pixels in the horizontal direction are adjacent to the pixel of interest.
If all four of the pixels are colored pixels, it can be determined that the target pixel is a pixel inside the trace line that is not in contact with the colorless pixel. Therefore, in this case, the process proceeds to step S116, the target pixel is changed to the next pixel, and the process returns to step S111.

In step S113, if it is determined that any of the four pixels in contact with the pixel of interest in the horizontal and vertical directions is a colorless pixel, the pixel of interest is
It is determined that the pixel is in contact with the colorless pixel, and the process proceeds to step S114.

In the example shown in FIG. 12, among the pixels 2 and 6 which are in contact with the target pixel in the vertical direction and the pixels 4 and 2 among the pixels 0 and 4 which are in contact in the horizontal direction, the pixels are colorless. Proceed to S114.

In step S114, it is determined whether or not the target pixel is a thinned pixel. Specifically, first, a first pixel set including pixel 0, pixel 1, and pixel 2 located at the upper right of the pixel of interest, pixel 2, pixel 3, and pixel 4 located at the upper left of the pixel of interest A second pixel set, a third pixel set including pixels 4, 5, and 6 located at the lower left of the pixel of interest, and
It is checked whether or not each of the pixels included in the fourth pixel set including the pixel 6, the pixel 7, and the pixel 0 located at the lower right of the target pixel is a colorless pixel. That is, it is determined whether all the pixels included in any one of the first to fourth pixel sets are colorless pixels.

If one set of pixels is all colorless pixels, it is checked whether the set at the opposite position contains colorless pixels. When a colorless pixel is not included in the set of opposing pixels, it can be determined that the pixel of interest is a pixel located at the end of the trace line. When a colorless pixel is included in the set of opposing pixels, it can be determined that the target pixel is a thinned pixel (a pixel having a width of one pixel). .

For example, in the example of FIG. 12, the second set of pixels (pixel 2, pixel 3, and pixel 4) are all colorless pixels. Further, a fourth pixel opposing the second set of pixels
(Pixel 6, pixel 7, and pixel 0) do not include colorless pixels. Therefore, in such a case, it is determined in step S114 that the pixel of interest is a pixel located at the edge of the trace line. That is, the target pixel is determined to be a pixel that has not been thinned yet.

If it is determined in step S114 that the target pixel is not a thinned pixel (if it is determined that the target pixel is a pixel located at the edge of the trace line), the flow advances to step S115 to change the target pixel. A process for changing to a colorless pixel is performed. As a result, one color pixel located at the edge of the trace line is changed to a colorless pixel. As a result, the trace line becomes thinner by one pixel. Next, in step S116, the target pixel is changed to the next pixel, and the process returns to step S111.

If it is determined in step S114 that the pixel of interest is a thinned pixel (if it is determined that the pixel of interest is a pixel having a line width of one pixel), step S117 is performed.
Then, it is determined whether or not all the pixels are thinned pixels. If all the pixels are not thinned pixels, the process returns to step S111, and the subsequent processing is repeatedly executed. By repeating this thinning process, a line having a width of one pixel can be obtained.

As described above, by thinning the trace lines before the paint processing, it is possible to prevent the occurrence of unpainted colors.

In the embodiment of the present invention, the thinned data is represented by 8 bits. That is, the 24-bit pixel data obtained in step S42 is processed by the filter created by operating the button 911 in FIG. 9, and in step S46, 8-bit thinned data is obtained.

In this embodiment, a look-up table (LUT) as shown in FIG. 13 is used to represent the color of each pixel of the thinned data. This look-up table is a color palette for representing the original color of each pixel of the thinned data, and internal data is fixed in the system so that the user cannot freely change it. That is, it is a fixed pallet.

In the embodiment of the present invention, black, green, or red is used as the color of the original trace line (the meaning will be described later with reference to FIG. 30). Therefore, if the trace line is black, the line is represented by 8-bit data indicating palette number 0, the red trace line is represented by 8-bit data indicating palette number 2, and the green trace line Is represented by 8-bit data indicating pallet number 4. A white pixel without a trace line is represented by 8-bit data indicating a pallet number 7. As is apparent from the fixed palette shown in FIG. 13, as the color of the trace line, blue, yellow (yellow), and the like can be used in addition to black, green, and red.

As described above, when the processing of the original data is completed, the user operates the Line button among the buttons 906 to display the GUI of the line processing as shown in FIG.
Is displayed on CRT5. In this display example, an image composed of a line having a width of one pixel, which has been thinned by the thinning processing in step S45, is displayed in the image display window 901. The button 141 is a button operated when checking whether or not an area is closed with a line having a width of one pixel. This is a button that is operated when a process for correcting this hole is performed when there is a hole.

That is, in the embodiment of the present invention, as described later, when a closed area is designated by a line having a width of one pixel in the paint processing, all pixels in the area are designated by a designated color. Can be colored automatically. For example, as shown in FIG. 15, in a state where a closed figure of a triangle and a rectangle is displayed by a line having a width of one pixel, if a triangle is specified and red is specified as a paint color, the inside of the triangle becomes red. Colored with. If green is designated as the color for coloring the rectangle, the inside of the rectangle is colored green.

However, as shown in FIG. 16, for example, when a part of the triangle line has a hole and the triangle is not closed, the triangle is designated as a region to be colored, and the color to be further colored is specified. If you specify red as, not only inside the triangle but also outside the triangle will be colored red. As a result, it becomes impossible to color only a desired area to a desired color.

Therefore, the check button 1 shown in FIG.
By operating 41, it is possible to check whether or not a line having a width of one pixel is closed. That is, in this case, the processing shown in the flowchart of FIG. 17 is executed.

First, in step S131, the user uses the mouse 9 to move a predetermined area of a line image drawn by a line of one pixel width displayed in the image display window 901.
Specify by operating. At this time, in step S132, the CPU 1 colors and displays all the pixels in the area designated in step S131 in one color.
This processing is performed by changing the display color to a predetermined color one pixel at a time in the horizontal direction from the upper left pixel in the designated area. The same processing is performed in the same manner sequentially on the more adjacent pixels. As a result, as shown in FIG. 16, if there is a portion (hole) that is not closed by a line, there is a continuous pixel on the outside, and the pixel on the outside is also colored.

The user can determine from the displayed image whether or not only the designated area is displayed in a predetermined color. If the outside of the designated area is also displayed in the same color as the inside, it means that there is a hole somewhere in that area. Therefore, in step S133, it is determined whether or not a hole is formed in the designated area. If it is determined that a hole is formed, the process proceeds to step S134, and processing for filling the hole is performed. That is, the user operates the button 242 in FIG. 14 to perform an operation of connecting discontinuous lines so that the area is closed by a line having a width of one pixel. If there is no hole, step S134
Is skipped.

Next, the flow proceeds to step S47 in FIG. 5, and paint processing is executed. At this time, the user turns on the Paint button among the buttons 906 as shown in FIG. At this time, on the GUI, as shown in FIG. 18, a button 191 operated to paint an area surrounded by a line having a width of one pixel with a predetermined color is displayed. Button 1
A button 92 is operated when a predetermined area is painted in a predetermined pattern. The button 194 is a button operated when setting and selecting a pattern to be painted at that time. The button 193 is a button operated when the same color as the color of the corresponding area in the previous frame (the already colored frame) is painted on the corresponding area.

Next, referring to the flowchart of FIG. 19, the user turns on the button 193 of FIG. 18 and sets the same color as that of the corresponding area of the previous frame to the corresponding area of the frame to be processed. The process for applying will be described. First, in step S151, the user determines whether or not to color all regions in the same color as the color of the previous frame. If all areas are not to be processed, the process proceeds to step S152, and the user sets an area to be painted with the same color as that of the corresponding area of the previous frame with the mouse 9
Specify by operating. When the predetermined area is specified, the CPU 1 executes a process of searching for a corresponding closed area of the previous frame in step S153.

For example, as shown in FIG. 20, it is assumed that there is a cell image 1 as an image of the previous frame and a cell image 2 shown in FIG. 21 as an image of the next frame. Cel 1
Are the areas a1 to a4 in the cell image 2.
11 to a14 respectively. Usually, since the image is a moving image, the positions of the frame image shown in FIG. 21 and the frame image shown in FIG. 22 are slightly shifted. However, the shift is not so large because it is the image of the frame immediately before and immediately after. Assuming that there are 30 frames of image per second, the temporal difference between them is 1/30 second. Therefore, the CPU 1 sets the area a11
Is designated, the area a11 of the cell image 2 is virtually drawn on the screen of the cell image 1, for example, as shown in FIG. In this case, the area a11 is the cell image 1
And its range overlaps with any of the regions a1 to a4. The CPU 1 selects the area a among the areas a1 to a4.
The region having the widest range overlapping with the region 11 is determined as the region corresponding to the region a11. In the case of the example of FIG. 22, the region having the widest portion overlapping the region a11 is the region a1 among the regions a1 to a4. Therefore, it is determined that the area a1 is an area corresponding to the area a11. At this time, the color of the area a11 is detected.

Next, the flow advances to step S154 in FIG.
The CPU 1 determines the area of the frame to be processed (FIG. 21).
Area a11) is replaced with the corresponding area (FIG. 2) of the previous frame.
It is colored in the same color as the 0 area a1).

If it is determined in step S151 that coloring is to be performed automatically not only on the designated area but on all areas, the process proceeds to step S155, where all corresponding areas of the image of the previous frame are searched. Is done. In the case of the example shown in FIG. 21, not only the area corresponding to the area a11 but also the areas corresponding to the areas a12 to a14 are searched on the cell image in FIG. 20 of the immediately preceding frame. Then, the process proceeds to step S156, and a process of coloring in the same color as all the searched areas is executed. That is, FIG.
In the case of display example 1, not only is the area a11 colored in the same color as the area a1, but also the area a12 is colored in the same color as the area a2, and the area a13 is colored in the same color as the area a3. Further, the area a14 is colored in the same color as the area a4.

On the other hand, by operating the button 191,
Each area can be colored in a color specified by a color palette. In this case, the user selects the color selection window 914
Of the line image displayed in the image display window 901 is designated. At this time, the CPU 1 colors the designated area with the designated color.

When the user paints each area by painting, color data is added to white dots in the thinned data. Hereinafter, this color data is referred to as paint data. As described above, the thinning data is black,
It is composed of green or red trace line data and other white data. Therefore, the paint data generated by the paint processing is composed of the data of the trace line thinned to black, green, or red, and the color data painted in the white area.

Each pixel of the paint data is composed of 8-bit data indicating a pallet number for representing a painted color, similarly to the data represented by the 8-bit thinning data. FIG. 23 shows an example of a lookup table used in the paint data. As described above (as shown in FIG. 13),
Since palette numbers 0 to 7 are used by the system, the user can use colors from palette numbers 7 to 207. Various patterns are assigned to the pallet numbers 208 to 255.

By performing the above-described paint processing, 8-bit first paint data is obtained in step S48 of FIG.

The first 8-bit data obtained in step S48
Is subjected to line removal processing in step S49, and is converted into 8-bit second paint data in step S50.

The second paint data is generated from the thinned data generated by the thinning process and the paint data (first paint data) created by the paint process. The second paint data is data obtained by removing thinned trace line data from the first paint data. Specifically, by making the pixels representing the trace lines of the thinned data into colorless pixels, the second paint data becomes data representing only the pixels to which the color has been added by the paint processing. That is, the second
In the paint data, 8-bit data indicating color is assigned to pixels to which a color has been added by the paint processing, and an image representing a trace line thinned by the thinning processing and a paint processing 8-bit data indicating colorlessness is assigned to a pixel to which no color has been added yet. Note that the color palette referred to by the second paint data is the same color palette as the color palette referred to by the first paint data described above.

On the other hand, when the first paint data is obtained in step S48, the CPU 1 proceeds to step S5
In step 1, 8-bit thinned alpha key data is created. The alpha key is data indicating whether each pixel has a color. Each pixel of the alpha key data is represented by 8 bits. For example, in the embodiment of the present invention, “255” representing a color is assigned to a pixel colored by a paint process, and “0” representing a colorless is assigned to a pixel without a color.
Is assigned. Since the thinned pixel has a color, “255” representing the color is assigned.

Although the alpha key data is generated from the paint data, it may be generated from the thinning data and the paint data.

A fixed palette is assigned to the thinned alpha key data as shown in FIG. Therefore, this thinned alpha key data is
When the image is displayed at 5, the colored pixels to which the color is added by the paint process and the thinned pixels are displayed in white, and the colorless pixels to which no color is added are displayed in blue.

FIG. 25 shows a state where the Alpha key among the buttons 906 is operated to display the alpha key data in the image display window 901. The button 251 displayed at this time is a button operated when cutting so that a transparent area that should not be colored should be displayed. In this display example, a view window 252 is displayed in a part of the area displaying the alpha key image. In the view window 252, the image subjected to the paint processing (the image shown in FIG. 18) is displayed at a corresponding position. That is, by moving the view window 252 to a predetermined position, the user can check the image of the alpha key data and the image of the paint data at the corresponding positions without switching the display mode. Then, when an unpainted area is found, it is possible to immediately paint a predetermined color on the area without switching the display mode.

Next, the processing in this case will be described in detail with reference to the flowchart in FIG. That is, first, in step S161, a process of displaying alpha key data in the image display window 901 is performed as shown in FIG. At this time, in step S162, the user determines whether it is necessary to display the view window 252 to view the paint image. If there is no need to display, step S16
The process proceeds to step S3, where it is determined whether or not to terminate the alpha key processing. If not, the process returns to step S161.

If it is determined in step S162 that the view window 252 needs to be displayed, the process advances to step S164, and the user clicks the right button of the mouse 9 to display the view window 252. The view window 252 is displayed at the position where the cursor is located at that time. Next, step S165
Then, the user determines whether or not to perform processing for extracting a color and coloring a predetermined area in a state where the image of the alpha key data is displayed. If it is determined that there is no need to extract a color, the process advances to step S166 to determine whether to continue displaying the view window 252.
If the display of the view window 252 is to be continued, the process returns to step S164.

The view window 252 is displayed while right-clicking the mouse. By moving the mouse 9 while right-clicking, the view window 25
2 is moved, and a paint image at a predetermined position can be confirmed. When it is determined that it is no longer necessary to display the view window 252, the user releases the click of the right button of the mouse 9. At this time, step S16
6 to step S167, and the view window 25
2 is erased. Then, the process returns to step S161.

If it is determined in step S165 that the color needs to be extracted, the process proceeds to step S168,
The user performs a process of extracting a color. Although illustration is omitted, almost in the center of the view window 252,
The dropper shape is displayed. The user has a mouse 9
By clicking the left button of, the color of the paint image displayed near the suction port of the dropper figure is extracted (stored). In this state, the user proceeds to step S169, and operates the mouse 9 to move the view window 252 (eyedropper) to a position above an uncolored area, where the left mouse button is released. At this time, the CPU 1 colors the stored (extracted) color in the area (area of the paint image).

In this manner, a desired color can be quickly colored without switching the display mode.

Returning to FIG. 5, the CPU 1 determines in step S44
In step S52, a thick line processing is performed on the pixel data obtained as a result of the filtering processing. This thickening process is a process opposite to the thinning process in step S45, and is a process for thickening the trace line. This processing will be described with reference to the flowchart in FIG.

First, in step S181, it is determined whether or not the target pixel is a color pixel. As described above, each pixel is colorless, black,
A red or green pixel is identified. From this identification result, it can be determined whether or not the target pixel is a color pixel. If the target pixel is a color pixel, the process proceeds to step S182, and processing is performed to change three horizontal pixels and three vertical pixels of the target pixel to the same color as the target pixel. This process is performed whether the pixel of interest is a pixel located inside the trace line or a pixel located at the edge of the trace line. In addition,
The processing in step S182 is executed preferentially for red or green pixels over black pixels. That is,
If there is a black pixel and a green pixel or a black pixel and a red pixel in contact with the target pixel, the surrounding three pixels are changed to green or red instead of black.

If the target pixel is a colorless pixel, the process in step S82 is skipped.

FIG. 28 shows a display example of the GUI when the trace line processing mode is set by operating the Trace button among the buttons 906. Step S52 in FIG.
In step S53, after performing the thick line processing, when performing the trace line painting processing, the GUI
Is used. In this GUI, after the line image of the captured original image is subjected to the thick line processing in step S52,
It is displayed in the image display window 901. Step S5
Although the thickening process 2 is automatically performed, the width of the line can be further increased by operating the button 281.

The trace line painting process in step S53 is a process of changing the color of the bolded trace line. In this process, only the color of the pixel of the bolded data generated by the bolding process is changed. , The colors of the other pixels are not changed. The specification of this color is basically
This is performed in the same manner as the paint processing in step S47.

Each pixel of the trace line whose color is specified is composed of 8-bit data, similarly to the paint data, and the palette number is specified by the 8-bit data.
The color palette specified by this palette number is
The color palette is the same as the color palette of the corresponding paint data.

Even in the state where the image of the trace line paint processing is displayed, the view window 282 can be displayed as in the case described with reference to FIG. In the view window 282, the paint data image at the corresponding position is displayed, and the trace line is displayed in the color of the original trace line (the color identified in the filtering processing in step S44). That is, the trace line paint processing can color each trace line subjected to the thick line processing with an arbitrary color. However, the color of the original trace line can be changed as described later with reference to FIG. , Make up a kind of command. Therefore, this view window 28
The command can be confirmed by displaying the original color instead of the color painted in 2.

When the trace line paint processing is performed as described above, 8-bit trace line color data can be obtained in step S54.

In step S55 of FIG. 5, a process of extracting density data from the brightness data, chromaticity data, and chroma data generated in step S43 is executed. That is, the line image on the moving image has a density, and the density is captured here. This density data is represented by 8 bits. Therefore, the density of 256 gradations is expressed. The density data is black,
It is required regardless of colors such as red and green.

FIG. 29 shows a display example of the GUI when the final processing mode is set by operating the Final button among the buttons 906. The button 291 displayed at this time is operated when removing the boundary line.
That is, although the first paint data is obtained in step S48 as a result of the paint processing performed in step S47 of FIG. 5, by operating this button 291, the line removal processing in step S49 is performed and the step S50 is performed. Second
Will be obtained. Button 292
Is operated when the painted trace line generated in the trace line paint process in step S63 is combined with the paint image generated in the paint process in step S47. The button 293 is operated when saving the combined image. The button 294 is operated when combining with a background image.

In step S57 of FIG. 5, FIG.
The combining process is performed by using the GUI. In this synthesis processing, the second paint data obtained in step S50, the trace line color data obtained in step S54, and the density data obtained in step S56 are used. Next, details of the synthesizing process will be described with reference to the flowchart in FIG.

First, in step S201, it is determined whether or not there is a trace line pixel as a pixel to be synthesized. If there is a trace line pixel, step S201 is performed.
In steps 202 to S204, it is determined whether the color of the original trace line is black, red, or green.

If it is determined in step S202 that the color of the original trace line is black, the flow advances to step S205 to execute a process of gradation with the color of the region in contact with both ends (both edges) of the trace line.

For example, as shown in FIG. 31 (A), one of the trace lines and the other
It is assumed that areas having yellow and blue colors are in contact with each other. Further, as shown in FIG. 31B, it is assumed that the trace line subjected to the bolding processing is painted in brown. Further, as shown in FIG. 31C, the density data of the trace line has a maximum value of 255 at the center of the trace line, and is distributed so as to gradually decrease to 0 as the distance from the center increases. Shall be

In such a state, if the color of the original trace line is black, a combining process as shown in FIG. That is, the brown color of the trace line and the yellow color of one of the areas are gradationd in the section P1 corresponding to the density distribution. Similarly, the brown trace line and the blue color of the other region are also gradationally corresponding to the density of the trace line in the section P2.

When the data obtained as a result of the composition (gradation) is M, the second paint data is C1, the trace line color data is C2, and the density data is L, the composite data M is represented by the following equation. M = {(C1 × L) + (C2 × 255-L)} / 255

These data are all 8-bit data.

On the other hand, if it is determined in step S203 that the color of the original trace line is red, the process proceeds to step S206, where one end of the trace line is in contact with the other via the trace line. A process is performed to gradation the colors of the two areas.

That is, as shown in FIG. 31 (E), the yellow area and the blue area that are in contact with each other via the trace line are defined as a section at one end (the right end in this example) of the trace line. In P2, gradation is performed. At this time, the trace line is omitted.

If it is determined in step S204 that the color of the original trace line is green, the flow advances to step S207 to change the color of the two regions that are in contact with each other via the trace line into a thick trace line. Section P of
At 3, gradation is applied.

That is, as shown in FIG. 31 (F), a yellow area and a blue area are gradation-graded in the section P3. Also in this case, the trace line is omitted.

If it is determined in steps S202 to S204 that the color of the original trace line is not any of black, red, and green, other combination processing is performed in step S208.

On the other hand, if it is determined in step S201 that the pixel of the trace line does not exist in the target pixel to be synthesized, the process proceeds to step S209, and since there is no image to be synthesized in particular, only the paint processing image is set. .

As described above, desired composition can be performed by drawing an original trace line in black, red, or green. Therefore, when a moving image is drawn, black, red, or green can be used properly. Thus, a desired composite image can be obtained.

By the above processing, in step S58, 8-bit composite image data is obtained. This 8-bit composite image data is converted into 24-bit full-color final image data in step S59. That is, each pixel is converted into a 24-bit color registered in the color palette.

In step S60, step S5
The thinning alpha key data generated in step 1 and the density data generated in step S56 are combined to generate final alpha key data Fα.

Assuming that the density data is L and the thinned alpha key data is α, the final alpha key data Fα
Is represented by the following equation. Fα = Max (L, α)

Here, Max (A, B) means that the larger one of A and B is selected. That is, the larger one of the density data L and the thinned alpha key data Fα is the final alpha key data.

[0210] The final alpha key data is used as a key signal when synthesizing an image of another layer. Details of the processing in this case will be described later with reference to FIG.

As described above, by performing the synthesizing process in step S60, final alpha key data is obtained in step S61.

Further, in step S62, Targa data is generated from the 24-bit final image data obtained in step S59 and the 8-bit final alpha key data obtained in step S61. This data is saved as a Targa file with a .TGA extension added.

FIG. 32 shows an example of a GUI for performing the time sheet process described with reference to FIG. In this display example, a layer is input and displayed on the display unit 321. The button 322 is operated when registering a cell image in the entry list. In the special effect setting window 323, when setting a special effect such as moving, enlarging, or rotating a predetermined image in the X or Y direction, the amount of movement, enlargement, or rotation can be set. It has been made like that. In addition, transmission, focus, light effects, and lens effects can be set as special effects. Display 324
, A layer for setting a special effect can be designated and displayed.

[0214] In the time sheet display window 325,
The time sheet is displayed. In this time sheet, a frame number is displayed in a vertical direction, and a layer number is displayed in a horizontal direction. The time sheet is provided with a special effect setting display field. When a special effect is set, a mark 326 is displayed in a frame corresponding to the special effect.

[0215] The button 327 is operated when performing a preview operation, the button 328 is operated when creating an AVI file (animation file), and the button 329 is operated when performing a review operation.

Next, the time sheet processing will be described with reference to the flowcharts of FIGS. First, in step S220, a time sheet is displayed in the time sheet display window 325. Next, in step S221, the user causes the display unit 321 to specify and display the layer to be registered in the entry. Then, in step S222, the user operates the button 322 to display a menu necessary for registering the cell image in the entry list. In step S223, of the cell images captured by the scanner 22, the cell images of the designated numbers are sequentially registered in the entry list. In step S224, the registered cell images are sequentially displayed with cell numbers attached to the layer image display window 902. In step S225, it is determined whether or not registration of all necessary layers has been completed. If it is determined that there is a layer that has not been registered yet, the process returns to step S221, where the layer is changed and the same is performed. Repeat the process.

If it is determined in step S225 that registration of all layers has been completed, step S226 is performed.
The user proceeds to a predetermined frame of the time sheet,
Enter the cell number registered in the entry list. In the display example of FIG. 32, a cell image of number 1 is input as a background in frame 1, a cell image of cell number 1 is input in layer A, and a cell image of number 1 is input in layer B. Have been. When a cell number is input to a required number of layers in one frame, step S2
At 27, the frame image is displayed in the image display window 901. From this image, the user can confirm a frame image in which images of a plurality of layers are combined.

Next, the flow advances to step S228 to determine whether or not the frame image is a desired one. If it is determined that the frame image needs to be changed, the flow returns to step S226 to return to the time sheet. A process of changing the cell number above is performed.

When it is determined in step S228 that a desired frame image has been obtained, step S229 is performed.
To determine whether it is necessary to apply a special effect. If a special effect needs to be provided, the process proceeds to step S230, where a desired cell number is input and displayed on the display unit 324 of the special effect setting window 223, and values for the special effect such as movement, enlargement, and transparency are set. Set. After this setting, in step S231, a mark 326 indicating that a special effect has been set is displayed on the time sheet.

If it is determined in step S229 that no special effect needs to be given, the process proceeds to step S2.
30 and the processing of step S231 are skipped. Then, in step S232, it is determined whether or not the input to the time sheet has been completed for all frames,
If it is determined that the processing has not been completed, step S
Returning to 226, the subsequent processing is repeatedly executed.

If it is determined in step S232 that the input to the time sheet has been completed for all frames, the flow advances to step S233 to turn on the Preview button 327. At this time, in step S234, a moving image according to the settings on the time sheet is experimentally displayed in the image display window 901. The user looks at the preview image and determines in step S235 whether or not a change is necessary. If it is determined that the change is necessary, the process returns to step S226 and repeats the subsequent processing. I do.

If it is determined in step S235 that there is no need to change, the process proceeds to step S236,
The user turns on the Render button 328. At this time, in step S237, the images of a plurality of frames created on the time sheet are created as animation files and registered in the hard disk 13. Revi
When the ew button 329 is operated, the data of the animation file generated as described above is output to an external monitor or the like via the input / output interface 14.
Is displayed.

Here, the process of synthesizing a plurality of layers of paint images will be described. For the sake of simplicity, taking the case of combining images of two layers as an example, as shown in the flowchart of FIG. 35, in step S251, Targa data of the first layer (layer A) is acquired. This Targa
The data is composed of final alpha key data Fα _A and final image data FI _A as described above.

Next, in step S252, Targa data of the second layer (layer B) is obtained. This Tar
The ga data is also the final alpha key data Fα _B ,
It has been synthesized in the final image data FI _B.

Next, in step S253, a combining process is performed. That is, assuming that the video signal output by the final alpha key data Fα _A is V _AOUT , V _AOUT is obtained by using the equation for synthesizing the final image data FI _B with the final image data FI _A as follows. Become. _{V AOUT = Fα A · FI A} + (1-Fα A) · Fα B · FI B ··· (1)

Similarly, final alpha key data F
If the video signal output by α _B is V _BOUT ,
V _BOUT corresponds to the final image data FI _B
Using the formula for combining the final image data FI _A, it can be expressed as follows. _{V BOUT = Fα B · FI B} + (1-Fα B) · Fα A · FI A ··· (2)

Next, the final image data FI
The _B, and priority data indicating the degree to which priority over final image data _{FI A, P (0 ≦ P} ≦
1). When the layer B is arranged before the layer A, P = 1.

A video signal output as an image of layer A in consideration of priority data P is represented by V ′
_{Assuming AOUT} , the following equation is obtained from equation (1). _{V 'AOUT = V AOUT · (} 1-P) = {Fα A · FI A + (1-Fα A) · Fα B · FI B} (1-P) ··· (3)

Similarly, assuming that a video signal output as an image of the layer B in consideration of the priority data P is V ′ _BOUT , the following equation is obtained from the equation (2). _{V 'BOUT = V BOUT · P} = {Fα B · FI B + (1-Fα B) · Fα A · FI A} · P ··· (4)

If the combined video signal obtained by combining the layers A and B is V _OUT and the combined key signal is α _OUT , the following equation holds. V _OUT・ α _OUT = V ' _AOUT + V' _BOUT

Therefore, the following equation is obtained. V _OUT = (V ′ _AOUT + V ′ _BOUT ) / α _OUT (5)

Here, when α _OUT is obtained, in the area other than the area where the final image data FI _A and the final image data FI _B are displayed, that is, in the area where neither the video signal V _A nor the video signal V _B is displayed. Means that the alpha key data is (1-Fα _A ) and (1
−Fα _B ), the alpha key data of the area where the final image data FI _A or the final image data FI _B is displayed is defined by the following equation. 1- (1-Fα _A ) · (1-Fα _B )

Therefore, the following equation is obtained. α _OUT = 1− (1−Fα _A ) · (1−Fα _B ) (6)

From the above equations (3) to (6), the following equations can be obtained. _{V OUT = [{Fα A ·} FI A + (1-Fα A) · Fα B · F
_{I B} (1-P)} + {Fα B · FI B + (1-Fα B) · F
_{α A · FI A} · P} ] / {1- (1-Fα A) (1-F
α _B )｝

The priority data P is usually P = 1
It is. That is, the layer B is synthesized on the layer A. By setting the value of P to a predetermined value between 0 and 1, layer B can be seen through and layer A can be seen. This value of P can be set as a parameter in “transmission” of the special effect setting window 323 in FIG.

As a transmission medium for transmitting a program for performing the above processing to a user, a recording medium such as a magnetic disk, a CD-ROM, a solid-state memory, and a communication medium such as a network and a satellite may be used. Can be.

[0237]

As described above, according to the image data processing apparatus according to the first aspect, the image data processing method according to the fifth aspect, and the transmission medium according to the sixth aspect, a line is obtained from a captured image. Is generated, and the image in which the pixels in the area surrounded by the line are colored and the image of the line are combined, so that a color image can be quickly generated.

An image data processing apparatus according to claim 7, an image data processing method according to claim 10, and an image data processing method according to claim 10.
According to the transmission medium described in 1, the cell number and the layer number of the captured cell image are specified, and the cell number and the layer number of the captured cell image are displayed.
A cell image drawn by the author using a pencil, a pen, or the like on a manuscript can be quickly and reliably captured by a scanner or the like and converted into image data.

The image data processing device according to claim 12,
According to the image data processing method according to the twentieth aspect and the transmission medium according to the twenty-first aspect, the time sheet defined by the frame number and the layer number is displayed, and is captured at a predetermined position of the time sheet. Since the cell number of the cell image is input, each frame can be easily and reliably configured and changed with an arbitrary cell number.

An image data processing apparatus according to claim 22,
According to the image data processing method of claim 28 and the transmission medium of claim 29, the density of the trace line is detected, and the color near the trace line in the area surrounded by the trace line is detected. Is determined in accordance with, so that the touch intended by the author can be accurately expressed.

An image data processing apparatus according to claim 30,
According to the image data processing method described in claim 33 and the transmission medium described in claim 34, the boundary between the trace lines and the area surrounded by the trace lines corresponding to the identification result of the original colors of the trace lines. The color of the trace line or the color of the boundary between one area of the trace line and the other area, and the color when the trace line is omitted, is determined. By using the color, it is possible to determine the color of the boundary of the captured image to a desired color.

An image data processing apparatus according to claim 35,
According to the image data processing method of the present invention, the pixels of the captured trace line are binarized, and the trace line is converted into a line having a width of one pixel. As a result, it is possible to suppress the unpainted color near the trace line, and to quickly and reliably create a color animation image.

An image data processing apparatus according to claim 42,
According to the image data processing method described in claim 46 and the transmission medium described in claim 47, it is confirmed whether or not the trace line is closed.
The same color can be prevented from being colored, and the area of each image can be quickly and reliably colored with a desired color.

An image data processing apparatus according to claim 48,
According to the image data processing method described in claim 55 and the transmission medium described in claim 56, a colored image is displayed on an identification image for identifying a colored region and a non-colored region of a colored image. As a result, the uncolored area can be confirmed quickly and reliably, the operability is improved, and the occurrence of unpainted colors can be suppressed.

The image data processing apparatus according to claim 57,
According to the image data processing method described in claim 64 and the transmission medium described in claim 65, the first frame of the first frame is processed.
Of the first image and the second image of the second frame are determined, and the color of the first image is colored on the second image in accordance with the determination result. It is possible to perform a coloring process.

An image data processing apparatus according to claim 66,
According to the image data processing method described in claim 68 and the transmission medium described in claim 69, a colored image of a plurality of layers is combined in accordance with the parameter and the key data, so that it is simple and easy. Certainly, it is possible to generate a variety of images.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a configuration example of a personal computer to which the present invention has been applied.

FIG. 2 is a diagram showing a flow of animation production in the present invention.

FIG. 3 is a flowchart illustrating more detailed processing of steps S11 to S13 of FIG. 2;

FIG. 4 is a diagram showing a configuration of a file.

FIG. 5 is a flowchart illustrating data generation.

FIG. 6 is a diagram illustrating an example of a GUI of a scan process.

FIG. 7 is a flowchart illustrating a scan process.

FIG. 8 is a flowchart illustrating a filtering process.

FIG. 9 is a diagram illustrating an example of a GUI for original data processing.

FIG. 10 is a diagram showing a captured trace line.

FIG. 11 is a flowchart illustrating a thinning process.

FIG. 12 is a diagram for explaining the processing in FIG. 11;

FIG. 13 is a diagram showing an example of a fixed pallet for thinned data.

FIG. 14 is a diagram illustrating an example of a GUI for line processing.

FIG. 15 is a diagram illustrating a region surrounded by a line.

FIG. 16 is a diagram illustrating a region surrounded by a line.

FIG. 17 is a flowchart illustrating a line drawing check process.

FIG. 18 is a diagram illustrating an example of a GUI for a paint process.

FIG. 19 is a flowchart illustrating an automatic coloring process.

FIG. 20 is a diagram illustrating an operation of detecting a corresponding closed region.

FIG. 21 is a diagram illustrating an operation of detecting a corresponding closed region.

FIG. 22 is a diagram illustrating an operation of detecting a corresponding closed region.

FIG. 23 is a diagram illustrating an example of a look-up table for paint data.

FIG. 24 is a diagram illustrating an example of a fixed palette of alpha key data.

FIG. 25 is a diagram illustrating an example of a GUI for alpha key processing.

FIG. 26 is a flowchart illustrating alpha key data processing.

FIG. 27 is a flowchart illustrating a thick line processing.

FIG. 28 is a diagram illustrating an example of a GUI for trace line processing.

FIG. 29 is a diagram illustrating an example of a GUI for final processing.

FIG. 30 is a flowchart illustrating a composition process.

FIG. 31 is a diagram for explaining a combining process.

FIG. 32 is a diagram illustrating an example of a GUI of time sheet processing.

FIG. 33 is a flowchart illustrating a time sheet process.

FIG. 34 is a flowchart illustrating a time sheet process.

FIG. 35 is a flowchart illustrating a combining process of a plurality of layers.

FIG. 36 is a diagram showing a flow of a conventional animation production.

FIG. 37 is a diagram illustrating the configuration of a frame.

FIG. 38 is a diagram for explaining layer combination.

[Explanation of symbols]

1 CPU, 5 CRT, 9 mouse, 13 hard disk, 16 keyboard, 21 video camera,
22 Scanner, 23 VTR, 24 Disk Recorder

 ──────────────────────────────────────────────────続 き Continued on the front page (31) Priority claim number Japanese Patent Application No. 9-223066 (32) Priority date Hei 9 (1997) August 4 (33) Priority claim country Japan (JP) (31) Priority Claim No. Hei 9-223152 (32) Priority date Hei 9 (1997) August 4 (33) Priority claiming country Japan (JP) (31) Priority claim number Patent application Hei 9-223153 (32) Priority Hei 9 (1997) August 4 (33) Priority claim country Japan (JP) (31) Priority claim number Japanese Patent Application No. 9-223163 (32) Priority date Hei 9 (1997) August 4 (33) ) Priority claim country Japan (JP) (31) Priority claim number Japanese Patent Application No. 9-223170 (32) Priority date Hei 9 (1997) August 4 (33) Priority claim country Japan (JP) (31) Priority claim number Japanese Patent Application No. 9-223171 (32) Priority date Hei 9 (1997) August 4 (33) Priority claim country Japan (JP) (72) Inventor Eiichi Ishii Meguro-ku, Tokyo 1-6-3 Shimomeguro Asahi Shimomeguro Mansion 102 Logistics Co., Ltd. (72) Inventor Chizuru Makita 6-7-35 Kita-Shinagawa, Shinagawa-ku, Tokyo Inside Sony Corporation (72) Inventor Kohei Nojiri Tokyo 6-7-35 Kitashinagawa, Shinagawa-ku, Tokyo Sony Corporation

Claims (69)

[Claims] A line image generating unit configured to generate an image composed of lines from a captured image; a region coloring unit configured to color pixels in a region surrounded by the lines configuring the image; An image data processing apparatus, comprising: a synthesizing unit that synthesizes an image in which pixels in a region are colored by the unit and an image of a line that forms the image. 2. The image data processing apparatus according to claim 1, further comprising a line coloring unit that colors pixels of lines forming the image. 3. The image data processing apparatus according to claim 1, further comprising a capture unit configured to capture an image for generating an image composed of the lines. 4. The image data processing apparatus according to claim 1, wherein each of the units has a GUI for performing a predetermined input. 5. A line image generating step of generating an image composed of lines from a captured image, an area coloring step of coloring pixels of an area surrounded by the lines constituting the image, and the area coloring An image data processing method, comprising: a synthesizing step of synthesizing an image in which pixels of a region are colored by a step and an image of a line forming the image. 6. A line image generating step of generating an image composed of lines from the captured image, an area coloring step of coloring pixels of an area surrounded by the lines constituting the image, and the area coloring A transmission medium for transmitting a program including a combining step of combining an image in which pixels in a region are colored by a step and a line image forming the image. 7. An image data processing apparatus for generating an image of each frame by combining an arbitrary number of fetched cell images by an arbitrary number of layers, wherein a cell number designation for designating a cell number of a cell image to be acquired is provided. Image data processing apparatus, comprising: a layer number designating means for designating a layer number of a cell image to be taken in; and a display control means for displaying a cell number and a layer number of a cell image already taken in. . 8. The image data processing apparatus according to claim 7, wherein said display control means displays a cell number and a layer number of a cell image already taken in at a position on a matrix. 9. The image data processing apparatus according to claim 7, further comprising cell image display control means for displaying the taken cell image. 10. An image data processing method for generating an image of each frame by combining an arbitrary number of fetched cell images with an arbitrary number of layers, wherein a cell number designation for designating a cell number of a fetched cell image is provided. An image data processing method comprising: a step; a layer number designation step of designating a layer number of a cell image to be taken; and a display control step of displaying a cell number and a layer number of a cell image already taken. . 11. A transmission medium for transmitting a program for generating an image of each frame by combining an arbitrary number of fetched cell images with an arbitrary number of layers, and specifying a cell number of a cell image to be fetched. A program including a number designation step, a layer number designation step of designating a layer number of a cell image to be taken in, and a display control step of displaying a cell number and a layer number of a cell image already taken in, is transmitted. Transmission medium. 12. An image data processing apparatus, wherein an image of each frame is generated by synthesizing an arbitrary number of fetched cell images by an arbitrary number of layers and a moving image is formed by a plurality of frame images. A frame number corresponding to the time series of the frame of
A time sheet display control means for displaying a time sheet defined by a layer number; and a cell number input means for inputting a cell number of a fetched cell image at a predetermined position of the time sheet. Image data processing device. 13. The image processing apparatus according to claim 1, further comprising a registration unit that registers the fetched cell image in an entry list for each layer, wherein the cell number input unit inputs a cell number registered in the entry list. 13. The image data processing device according to claim 12, wherein: 14. The image data processing according to claim 13, further comprising a registered image display control means for displaying the cell images registered in the entry list in order of cell numbers for each layer. apparatus. 15. The image data processing apparatus according to claim 12, further comprising a special effect setting unit for setting a special effect for each layer, cell, or frame. 16. The time sheet display control means, when a special effect is set by the special effect setting means,
The image data processing device according to claim 15, wherein the setting of the special effect is displayed on the time sheet. 17. The special effect includes at least rotation,
16. The image data processing apparatus according to claim 15, wherein the apparatus includes enlargement, movement, and transparency. 18. The image data processing apparatus according to claim 12, further comprising a synthesizing unit for synthesizing a cell image of each layer number input on the time sheet for each frame. 19. The image data processing apparatus according to claim 18, further comprising a moving image display control unit for displaying an image synthesized by the synthesizing unit as a moving image on a trial basis. 20. An image data processing method in which an image of each frame is generated by synthesizing an arbitrary number of fetched cell images by an arbitrary number of layers and a moving image is formed by the images of a plurality of frames. A frame number corresponding to the time series of the frame of
A time sheet display control step of displaying a time sheet defined by a layer number, and a cell number input step of inputting a cell number of a fetched cell image at a predetermined position of the time sheet. Image data processing method. 21. A transmission medium for transmitting a program for generating an image of each frame by synthesizing an arbitrary number of fetched cell images by an arbitrary number of layers and using the images of a plurality of frames as a moving image, A frame number corresponding to a time series of frames of a moving image,
A program including a time sheet display control step of displaying a time sheet defined by a layer number and a cell number input step of inputting a cell number of a captured cell image at a predetermined position of the time sheet is transmitted. A transmission medium characterized by the above-mentioned. 22. A detecting means for detecting the density of a trace line constituting the captured image; an area coloring means for coloring an area surrounded by the trace line; and the trace of an area surrounded by the trace line Determining means for determining a color near the line in accordance with a density of the trace line; 23. The image forming apparatus further comprising a line coloring unit that colors the trace line, wherein the determination unit corresponds to the color of the boundary between the trace line and a region surrounded by the trace line according to the density of the trace line. 23. The image data processing apparatus according to claim 22, wherein gradation is performed by a color of the trace line and a color of an area surrounded by the trace line. 24. The determination means according to claim 1, wherein the color of a boundary between two regions surrounded by the trace line on one side and the other side of the trace line is determined in accordance with the density of the trace line. 23. The image data processing apparatus according to claim 22, wherein gradation is performed by a color of an area surrounded by the two trace lines. 25. The apparatus according to claim 22, further comprising identification means for identifying an original color of the trace line, wherein the determination means determines a color in accordance with an identification result of the identification means. Image data processing device. 26. The color identified by the identification means,
If the color is the first color, the determination unit may change the color of the trace line and the color of the boundary portion of the area surrounded by the trace line in accordance with the density of the trace line, When gradation is performed by the color of the area surrounded by the trace line and the second color, the color of the boundary between the two areas surrounded by the trace line on one side and the other side of the trace line 26. The image data processing apparatus according to claim 25, wherein the gradation of the image data is gradationalized by a color of an area surrounded by the two trace lines in accordance with the density of the trace lines. 27. The image data processing apparatus according to claim 22, further comprising a thickening means for thickening said trace line by a predetermined pixel. 28. A detecting step of detecting a density of a trace line constituting a captured image, an area coloring step of coloring an area surrounded by the trace line, and the trace of an area surrounded by the trace line Determining a color in the vicinity of the line in accordance with the density of the trace line. 29. A detecting step of detecting the density of a trace line constituting a captured image, an area coloring step of coloring an area surrounded by the trace line, and the trace of an area surrounded by the trace line A determination step of determining a color near a line in accordance with the density of the trace line. 30. An identification unit for identifying an original color of a trace line constituting a captured image, an area coloring unit for coloring an area surrounded by the trace line, and an area surrounded by the trace line and the trace line The color of the boundary of the traced area, or the color of the boundary between the area on one side of the trace line and the area on the other side, where the trace line is omitted. An image data processing apparatus, comprising: a determination unit that determines the image data according to the identification result. 31. A color identified by the identification means,
When the color is the first color, the determination means determines the color of the boundary between the trace line and the area surrounded by the trace line, and when the color is the second color, one side of the trace line 31. The image data processing apparatus according to claim 30, wherein a color at a boundary portion between the region and the region on the other side, the color when the trace line is omitted is determined. 32. The color identified by the identification means,
When the color is the first color, the determination means may set the color of the boundary portion between the one side area and the other side area of the trace line, and the color when the trace line is omitted as the first color. When the second color is determined over the width of the trace line, the determination means is the color of the boundary between the one side region and the other side region of the trace line, and the trace line is omitted. 31. The image data processing apparatus according to claim 30, wherein the color is determined over a second width. 33. An identification step for identifying an original color of a trace line forming a captured image; an area coloring step for coloring an area surrounded by the trace line; and an area surrounded by the trace line and the trace line. The color of the border of the traced area, or the color of the border between the area on one side of the trace line and the area on the other side, where the trace line is omitted, And a determining step of determining in accordance with the identification result. 34. An identifying step for identifying an original color of a trace line constituting a captured image; a region coloring step for coloring a region surrounded by the trace line; and a region surrounded by the trace line and the trace line The color of the border of the traced area, or the color of the border between the area on one side of the trace line and the area on the other side, where the trace line is omitted, A transmission medium for transmitting a program comprising: a decision step of deciding according to an identification result. 35. A binarizing unit for binarizing each pixel of a fetched trace line into a color pixel and a colorless pixel, and a conversion unit for converting the trace line into a line composed of color pixels having a width of one pixel. An image data processing device comprising: 36. The image data processing apparatus according to claim 35, further comprising coloring means for coloring a colorless pixel in a region surrounded by a line having a width of one pixel into a predetermined color. 37. The binarizing means, wherein the color of the pixel is
36. The image data processing apparatus according to claim 35, wherein white data is identified in the order of black, red, or green, white pixels are colorless pixels, and pixels of colors other than white are binarized as colored pixels. . 38. The method according to claim 35, wherein the conversion unit repeats a process of converting the color pixel in contact with the colorless pixel into a colorless pixel until the trace line has a width of one pixel. Image data processing device. 39. The image data processing apparatus according to claim 35, wherein the data of each pixel includes a flag indicating the color. 40. A binarizing step of binarizing each pixel of the fetched trace line into a color pixel and a colorless pixel, and a converting step of converting the trace line into a line composed of color pixels having a width of one pixel. An image data processing method comprising: 41. A binarizing step of binarizing each pixel of the fetched trace line into a color pixel and a colorless pixel, and a converting step of converting the trace line into a line composed of colored pixels having a width of one pixel. A transmission medium for transmitting a program comprising: 42. A binarizing means for binarizing the pixels of the fetched trace line into a color pixel and a colorless pixel, and whether a trace line composed of the color pixel binarized by the binarization means is closed. An image data processing apparatus, comprising: a confirmation unit for confirming whether or not the image data is processed. 43. The apparatus according to claim 42, wherein said confirmation means sequentially displays a predetermined colorless pixel in a region surrounded by a trace line composed of said color pixels and a colorless pixel in contact with said colorless pixel. Image data processing device. 44. A trace line comprising the color pixel,
43. The image data according to claim 42, further comprising a conversion unit configured to convert the trace line into a one-pixel width trace line, wherein the confirmation unit confirms that the one-pixel width trace line is closed. Processing equipment. 45. When the confirming means confirms that a part of the trace line is open, a correcting means for correcting the open part so as to form a closed area is provided. 43. The image data processing device according to claim 42, further comprising: 46. A binarization step of binarizing the captured trace line pixel into a color pixel and a colorless pixel, and whether a trace line composed of the color pixel binarized in the binarization step is closed. And a confirming step for confirming whether or not the image data is processed. 47. A binarization step of binarizing the captured trace line pixel into a color pixel and a colorless pixel, and whether the trace line composed of the color pixel binarized in the binarization step is closed. A transmission medium for transmitting a program comprising: a confirmation step of confirming whether or not the transmission is complete. 48. A colored image generating means for generating a colored image in which a predetermined area of a line image is colored, and an identification image for generating an identification image for identifying a colored area and an uncolored area of the colored image. An image data processing apparatus comprising: a generation unit; and a display control unit that displays the coloring image on the identification image. 49. The display apparatus according to claim 48, wherein the display control means displays a window at an arbitrary position on the identification image, and displays the colored image at a corresponding position in the window. Image data processing device. 50. An extracting means for extracting a color of a predetermined area of a colored image displayed on the identification image, and coloring for coloring an uncolored area of the colored image with the color extracted by the extracting means. 49. The image data processing device according to claim 48, further comprising: means. 51. The apparatus according to claim 48, wherein the identification image is an α key data image. 52. The image data according to claim 48, wherein the colored image is an image obtained by coloring an area closed by a line of a line image or an image obtained by coloring a line of the line image. Processing equipment. 53. The display control device according to claim 48, wherein when the colored image is an image obtained by coloring a line of the line image, the display control unit displays the image in a color before the line is colored. Image data processing device. 54. The image data processing device according to claim 53, wherein the color before coloring the line forms a command. 55. A colored image generating step of generating a colored image in which a predetermined area of a line image is colored, and an identification image for generating an identification image for identifying a colored area and an uncolored area of the colored image. An image data processing method comprising: a generation step; and a display control step of displaying the coloring image on the identification image. 56. A colored image generating step of generating a colored image obtained by coloring a predetermined area of a line image, and an identification image generating an identification image for identifying a colored area and an uncolored area of the colored image. A transmission medium for transmitting a program including a generation step and a display control step of displaying the coloring image on the identification image. 57. A judging means for judging a correspondence between a first image of a first frame and a second image of a second frame; a detecting means for detecting a color of the first image; An image data processing apparatus comprising: a coloring unit that colors the second image with a color detected by the detection unit according to a determination result of the unit. 58. The image data processing apparatus according to claim 57, wherein said determining means sets the temporally adjacent frames as the first frame and the second frame. 59. The image data according to claim 57, wherein the determination unit determines an area closed by a line constituting the line image as the first image and the second image. Processing equipment. 60. The determination unit determines, of a plurality of regions of the first frame, a region including a range of a target region of the second frame that is the largest as a region corresponding to the target region. The image data processing device according to claim 59, wherein: 61. The image data processing apparatus according to claim 59, wherein said coloring means colors only a designated area. 62. The image data processing apparatus according to claim 59, wherein said coloring means colors all of the plurality of corresponding areas. 63. Whether only a designated area is colored,
Or, whether to color all the corresponding multiple areas,
The image data processing apparatus according to claim 59, further comprising a selection unit for selecting. 64. A determining step of determining a correspondence between a first image of a first frame and a second image of a second frame; a detecting step of detecting a color of the first image; A coloring step of coloring the second image with the color detected in the detecting step in accordance with a result of the determination in the step. 65. A determining step of determining a correspondence between a first image of a first frame and a second image of a second frame; a detecting step of detecting a color of the first image; A transmission medium for transmitting a program including a coloring step of coloring the second image with the color detected in the detection step according to a result of the determination in the step. 66. An image data processing apparatus for generating an image of a frame by synthesizing an arbitrary number of fetched cell images by an arbitrary number of layers, wherein a colorless area surrounded by a trace line of the fetched cell image is provided. A colored image generating unit that generates a colored image by coloring a pixel with a predetermined color; and a colored region in which the color of the colored image is colored corresponding to a coloring process performed by the colored image generating unit. Key data generating means for generating key data for identifying a non-colored area that does not exist, parameter setting means for setting a parameter defining a priority when combining the colored images of a plurality of layers, and the parameter setting means Compositing for composing the colored images of a plurality of layers according to the set parameters and the key data generated by the key data generating means. Image data processing apparatus characterized by comprising a stage. 67. The image data processing apparatus according to claim 66, wherein the parameter is set as a special effect. 68. An image data processing method for generating an image of a frame by synthesizing an arbitrary number of fetched cell images by an arbitrary number of layers, wherein the colorless area of a region surrounded by trace lines of the fetched cell image is provided. A colored image generating step of generating a colored image by coloring a pixel with a predetermined color; and a colored region colored with the color of the colored image corresponding to the coloring process in the colored image generating step. A key data generating step of generating key data for identifying a non-colored area that is not present; a parameter setting step of setting a parameter that defines a priority when combining the colored images of a plurality of layers; and a parameter setting step. In accordance with the set parameters and the key data generated in the key data generating step, a plurality of Image data processing method characterized by comprising a synthetic step of the synthesis of the colored image. 69. A transmission medium for transmitting a program for synthesizing an arbitrary number of fetched cell images by an arbitrary number of layers to generate a frame image, an area surrounded by trace lines of the fetched cell images. A colored image generating step of generating a colored image by coloring a predetermined color on the colorless pixels of the color image, and a coloring region colored with the color of the colored image corresponding to the coloring process in the colored image generating step. A key data generating step of generating key data for identifying a non-colored area that has not been processed; a parameter setting step of setting a parameter that defines a priority when combining the colored images of a plurality of layers; Corresponding to the parameters set in the step and the key data generated in the key data generation step, Transmission medium characterized by transmitting a program and a synthesis step of synthesizing the colored image of the number of layers.