JP3002971B2 - 3D model creation device - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a three-dimensional model creating apparatus for creating a three-dimensional model from a two-dimensional image by image processing by a computer and performing a rendering process for generating a three-dimensional image.

[0002]

2. Description of the Related Art Conventionally, there has been known a computer graphics method for performing image processing on a two-dimensional image to convert the image into a three-dimensional image. For example, characters displayed as titles of video software or the like may be displayed as three-dimensional three-dimensional images. In the display of these three-dimensional characters, a certain depth is added to the outline of the two-dimensional character, and
After the dimensioning, a three-dimensional image is displayed by a rendering process. As the depth information, not only the depth is not necessarily made to look uniform, but also a deformation such as making the outline part thinner than other parts may be performed.

[0003] As a more complicated and general method of creating a three-dimensional model, a wire frame model is used in which the surface of an object is divided into a large number of polygons, for example, a large number of triangles, and the shape is represented by ridges formed by the sides of each triangle. Determines the final three-dimensional shape, and generates a three-dimensional image by a rendering process. In order to make the three-dimensional image have a complicated shape change, it is necessary to directly correct the wireframe model.

[0004]

Among the conventional methods for creating a three-dimensional model from a two-dimensional image, the technique used for titles of video software, etc., creates only a regular three-dimensional model. Can not. Creating a 3D model by directly modifying the wireframe model is
Has a great deal of expertise and effort.

SUMMARY OF THE INVENTION It is an object of the present invention to create a three-dimensional model by reflecting a component of a two-dimensional image on a component of a three-dimensional model and defining and creating a three-dimensional model without performing complicated modeling. It is to provide a device.

[0006]

According to the present invention, there is provided a three-dimensional model creating apparatus for creating a three-dimensional model by performing image processing on a two-dimensional image, and storing and inputting image data representing the two-dimensional image. Means, model setting means for setting modeling data for defining a three-dimensional shape serving as a basis for three-dimensional conversion of a two-dimensional image, and information on constituent elements predetermined from image data representing an input two-dimensional image. Element extracting means for extracting, element converting means for converting element information extracted by the element extracting means into three-dimensional information having a predetermined relationship, and element conversion for modeling data set by the model setting means. A model creating means for creating a three-dimensional model by reflecting the three-dimensional information converted by the means, and a tertiary model created by the model creating means. A rendering unit for generating a three-dimensional image from the model by a rendering process; a conversion of element information into three-dimensional information by an element conversion unit; a reflection of the three-dimensional information on the three-dimensional model by the model creation unit; In the course of the rendering process of the three-dimensional model, the correspondence between the pixels on the three-dimensional image generated by the rendering process and the pixels on the two-dimensional image represented by the image data stored in the image storage unit is shown. A mapping unit for creating mapping information, a rendering memory for storing the three-dimensional image data generated by the rendering unit together with the mapping information created by the mapping unit, and a three-dimensional image data stored in the rendering memory are displayed. Input drawing operation to correct When an image correction unit, rendering operation to the three-dimensional image correction means is performed,
A three-dimensional model creating apparatus, comprising: inverse mapping means for correcting image data representing a two-dimensional image stored in the image storage means according to mapping information stored in the rendering memory.

According to the present invention, image data representing a two-dimensional image is input to the image storage means and stored. Modeling data for defining a three-dimensional shape serving as a basis for converting a two-dimensional image into three dimensions is set in the model setting means. The element extracting means extracts information about a predetermined component from image data representing the input two-dimensional image. The element conversion means converts the element information extracted by the element extraction means into three-dimensional information having a predetermined relationship. The model creating means creates a three-dimensional model by reflecting the converted three-dimensional information on the three-dimensional shape set by the model setting means. The rendering means generates a three-dimensional model created by the model creation means as a three-dimensional image by a rendering process. Since the generated three-dimensional image is formed into a three-dimensional model by reflecting the element information extracted from the two-dimensional image, the three-dimensional image generated by changing the element information of the two-dimensional image is changed. Deformation can be easily performed.
The three-dimensional model is set by a model setting unit.
Since it is formed on the basis of modeling data that defines a three-dimensional shape, it is not necessary to construct the entire three-dimensional model based on element information extracted from a two-dimensional image. Can be planned. Further, the rendering memory stores three-dimensional image data generated by the rendering unit and mapping information indicating a correspondence relationship between pixels on the two-dimensional image corresponding to each pixel on the image data. If the image data stored in the rendering memory is corrected by the three-dimensional image correction means, the correction is reflected on the corresponding two-dimensional image data, and the three-dimensional model to be subjected to the rendering process is corrected based on the two-dimensional image. You. Even if the correction by the three-dimensional image correction means is performed on the three-dimensional image generated by the rendering means, the correction is performed on the image data representing the two-dimensional image from which the three-dimensional model is created. It is not necessary to perform a direct correction process on the three-dimensional image, and a three-dimensional correction can be performed by a simple two-dimensional image correction. In addition, correction is performed on the two-dimensional image,
Since the result of the correction is reflected on the three-dimensional image, it is possible to perform correction without any uncomfortable feeling around the three-dimensional image.

In the present invention, the element extracting means, the element converting means, the model creating means and the rendering means include pixels for which a rendering operation for correcting image data is performed by the three-dimensional image correcting means. , Only image data within a predetermined range is to be processed. According to the present invention, the correction to the three-dimensional image generated by the rendering unit is performed only on image data in a predetermined range including pixels on which a rendering operation for the correction is performed. The time can be reduced by performing the image processing only on the region to be processed, as compared with the case where the entire image processing is performed.

Further, the present invention provides a three-dimensional model creating apparatus for creating a three-dimensional model by performing image processing on a two-dimensional image, an image storage means for inputting and storing image data representing the two-dimensional image, Model setting means for setting modeling data for defining a three-dimensional shape serving as a basis for making an image three-dimensional, and element extracting means for extracting information on predetermined components from image data representing an input two-dimensional image Element conversion means for converting element information extracted by the element extraction means into three-dimensional information having a predetermined relationship; and modeling data set by the model setting means, which is converted by the element conversion means. A model creating means for creating a three-dimensional model by reflecting the three-dimensional information, and a three-dimensional model created by the model creating means Rendering means for generating a three-dimensional image by rendering processing, and two-dimensional image correcting means for inputting a drawing operation for displaying and correcting image data representing the two-dimensional image stored in the image storing means. , An element extracting unit, an element converting unit, a model creating unit, and a rendering unit perform processing on only image data in a predetermined range including pixels for which a rendering operation for correcting image data is performed by the two-dimensional image correcting unit. This is a three-dimensional model creation device.

According to the present invention, image data representing a two-dimensional image is input and stored in the image storage means. Modeling data for defining a three-dimensional shape serving as a basis for converting a two-dimensional image into three dimensions is set in the model setting means. The element extracting means extracts information about a predetermined component from image data representing the input two-dimensional image. The element conversion means converts the element information extracted by the element extraction means into three-dimensional information having a predetermined relationship. The model creating means creates a three-dimensional model by reflecting the converted three-dimensional information on the three-dimensional shape set by the model setting means. The rendering means generates a three-dimensional model created by the model creation means as a three-dimensional image by a rendering process. Since the generated three-dimensional image is formed into a three-dimensional model by reflecting the element information extracted from the two-dimensional image, the three-dimensional image generated by changing the element information of the two-dimensional image is changed. Deformation can be easily performed.
The three-dimensional model is set by a model setting unit.
Since it is formed on the basis of modeling data that defines a three-dimensional shape, it is not necessary to construct the entire three-dimensional model based on element information extracted from a two-dimensional image. Can be planned. Also, 2
When the image data representing the two-dimensional image is corrected by the three-dimensional image correcting means, a three-dimensional model is created reflecting the corrected two-dimensional image. The two-dimensional image can be easily checked and corrected until a desired three-dimensional image is obtained. The correction to the two-dimensional image input and stored in the image storage means is performed only on image data in a predetermined range including pixels on which a rendering operation for correction is performed. With only image processing, the time can be reduced as compared with the case where overall image processing is performed.

In the present invention, the two-dimensional image is a monochrome image having three or more gradations, and the element extracting means extracts gradation information as the element information from image data representing the monochrome image. The element conversion means converts the gradation information into three-dimensional depth information.

According to the present invention, a monochrome image having three or more tones is input as a two-dimensional image, and tone information is extracted as element information and converted into three-dimensional depth information. The shading can be converted into depth information representing three-dimensional unevenness. This makes it possible to easily create shape data such as a woodcut of a woodcut.

Further, in the present invention, the two-dimensional image is a color image having components of a plurality of colors, and the element extracting means determines density information of a color component predetermined as the element information from image data representing the color image. And the element conversion means converts the density information of the color component into three-dimensional depth information.

According to the present invention, a color image having a plurality of color components is input as a two-dimensional image, density information of a predetermined color component is extracted as element information, and is converted into three-dimensional depth information. It is possible to create a three-dimensional model reflecting a specific color component of the image.

[0015]

[0016]

Further, the present invention further includes a texture creating means for creating texture image data based on the two-dimensional image from which the element information is extracted by the element extracting means, and wherein the model creating means comprises the three-dimensional information. The texture mapping processing of the two-dimensional image based on the texture coordinate data created by the texture creating means is performed on the surface of the three-dimensional model created by reflecting the image.

According to the present invention, element information is extracted from the two-dimensional image by the element extracting means, the extracted element information is reflected on the three-dimensional model, and texture coordinate data based on the two-dimensional image is used for texture creation. Created by means. Based on the texture coordinate data, the rendering means performs a texture mapping process when generating the image of the three-dimensional model, so that the original two-dimensional image itself is made three-dimensional and a part thereof is three-dimensionally deformed. The obtained three-dimensional model can be obtained.

Further, the present invention further includes a bump storage means for inputting and storing data for bump processing, wherein the model creation means creates the data by reflecting the three-dimensional information.
The surface of the dimensional model is subjected to a bump process based on data stored by the bump storage unit.

According to the present invention, the bump processing data stored in the bump storage means is used for performing the bump processing when the three-dimensional model image is generated by the rendering means. Irregularities and the like can be easily added to the surface of the three-dimensional image by deformation in the normal direction.

Further, the present invention provides an image storing means for inputting and storing image data representing a two-dimensional image, and a model for setting modeling data for defining a three-dimensional shape as a basis for converting the two-dimensional image into a three-dimensional image. Setting means, element extracting means for extracting information on predetermined components from image data representing an input two-dimensional image, and three-dimensional information having predetermined relevance of the element information extracted by the element extracting means. The three-dimensional information converted by the element conversion means is reflected on the modeling data set by the element conversion means for converting the
Model creation means for creating a three-dimensional model, rendering means for creating a three-dimensional image by a rendering process from the three-dimensional model created by the model creation means, conversion of element information into three-dimensional information by element conversion means, In the process of reflecting the three-dimensional information on the three-dimensional model by the model creation part and rendering the three-dimensional model by the rendering part, the pixels on the three-dimensional image generated by the rendering processing are stored in the image storage part. Mapping means for creating mapping information indicating a correspondence relationship with pixels on a two-dimensional image represented by image data to be rendered, and mapping information created by the mapping means for three-dimensional image data generated by the rendering means. A rendering memory stored with the
The three-dimensional image data stored in the rendering memory is
Three-dimensional image correcting means for inputting a drawing operation for displaying and correcting, and when a drawing operation is performed on the three-dimensional image correcting means, the image is stored in the image storing means in accordance with the mapping information stored in the rendering memory. Inverse mapping means for modifying image data representing a two-dimensional image;
3D image processing to create a 3D model
It is a computer-readable recording medium that stores a program for causing a computer to function as a dimensional model creation device. Still further, the present invention provides an image storage means for inputting and storing image data representing a two-dimensional image, and a model setting means for setting modeling data for defining a three-dimensional shape as a basis for converting the two-dimensional image into three dimensions. And an element extracting means for extracting information on a predetermined component from image data representing an input two-dimensional image, and converting the element information extracted by the element extracting means into three-dimensional information having a predetermined relationship. An element conversion unit that performs the conversion, reflects the three-dimensional information converted by the element conversion unit on the modeling data set by the model setting unit, and creates a three-dimensional model, and a model creation unit that creates the three-dimensional model. Rendering means for generating a three-dimensional image from a three-dimensional model by a rendering process, and image data stored in an image storage means. That the image data representing a two-dimensional image, and a two-dimensional image correction means for inputting a drawing operation to view and modify, element extraction means, elements converting means, the model creating means and the rendering means,
Only a predetermined range of image data including pixels for which a rendering operation for correcting image data is performed by the two-dimensional image correction means is to be processed, and a two-dimensional image is subjected to image processing to create a three-dimensional model. A computer-readable recording medium that records a program for causing a computer to function as a three-dimensional model creation device.

According to the present invention, the computer operates as a program to input image data representing a two-dimensional image, extract element information, and reflect the extracted element information on the three-dimensional information.
The device can be operated as a three-dimensional model creating device that can easily create a three-dimensional model having a complicated shape.

[0023]

FIG. 1 shows a schematic electrical configuration of an embodiment of the present invention. In the two-dimensional image input unit 1,
A two-dimensional image to be made three-dimensional is input. In the two-dimensional image processing unit 2, the two-dimensional image input to the two-dimensional image input unit 1 is stored in the two-dimensional image storage unit 3 and, if necessary, stored in the two-dimensional image storage unit 3. The image data representing the two-dimensional image is read. 3D modeling data storage 4
Stores modeling data that defines a preset three-dimensional shape. As will be described later with reference to FIG. 4, the modeling data has a basic surface when a two-dimensional image is three-dimensionalized. The three-dimensional shape of the modeling data is stored in a state of a wire frame model, and can be read out and subjected to deformation and correction of a projection direction. The bump data storage unit 5 stores bump data for performing a bump process for adding a fine change in the normal direction to the surface of the three-dimensional model. The texture coordinate data storage unit 6 stores texture data representing colors, shadows, patterns, and the like of the surface of the object generated from the input two-dimensional image as texture coordinates.

The three-dimensional information associating processing unit 7 performs a process of associating the two-dimensional image read from the two-dimensional image processing unit 2 with the three-dimensional modeling data stored in the three-dimensional modeling data storage unit 4. The three-dimensional information based on the two-dimensional image associated by the three-dimensional information association processing unit 7 is converted into coordinates and normal components by a three-dimensional modeling data creation unit 8 to create a three-dimensional wireframe model. You. The created 3D modeling data is
The data is stored in the three-dimensional modeling data storage unit 4. Also,
The three-dimensional information association processing unit 7 can also perform association for bump mapping and texture mapping. In this case, the three-dimensional information is also provided to the bump data creation unit 9 and the texture data creation unit 10, respectively, and the bump data and the texture coordinate data are created respectively. Each is saved.

The three-dimensional modeling data created by the three-dimensional modeling data creation unit 8 is used to determine whether or not bump mapping is to be performed by the bump mapping control unit 11.
F control is performed. The control output of the bump mapping control unit 11 is given to the bump mapping pre-processing unit 12, and when the bump mapping is controlled to be ON, the bump data created by the bump data creation unit 9 and the two-dimensional image storage unit 3 A pre-process for bump mapping based on the stored image data representing the two-dimensional image is performed. The modeling data is provided from the bump mapping control unit 11 to the texture mapping control unit 13.
The texture mapping control unit 13 controls the texture mapping pre-processing unit 14 to perform ON / OFF control as to whether or not to perform texture mapping. When performing texture mapping, the texture coordinate data creation unit 10
The texture mapping pre-processing is performed between the texture coordinate data created in step (1) and the image data representing the two-dimensional image read from the two-dimensional image storage unit 3.

From the texture mapping control unit 13,
The three-dimensional modeling data is supplied to the rendering processing unit 15, and the wireframe model is three-dimensionally converted using the bump mapping data and the texture mapping data supplied from the bump mapping preprocessing unit 12 and the texture mapping preprocessing unit 14, respectively. A rendering process is performed to make it visible. The rendering processing unit 15 has a rendering memory that stores processing results as image data. If the wire frame is displayed as it is, the ridgeline on the back side when viewed from the viewpoint is also displayed, and it is difficult to recognize a realistic three-dimensional shape. The processing result of the rendering processing unit 15 is read from the rendering memory and displayed as an image on a display unit 16 such as a cathode ray tube (CRT) or a liquid crystal display (LCD).

As described above, the three-dimensional model creation device 20 of the present embodiment converts a two-dimensional image input to the two-dimensional image input unit 1 into three-dimensional modeling data created by the three-dimensional modeling data creation unit 8. By reflection, a three-dimensional model can be obtained. The two-dimensional image input unit 1 can include a two-dimensional image reading device such as a scanner, read a two-dimensional image stored in a file, or perform input by a direct drawing operation.

FIG. 2 shows the three-dimensional model creating apparatus 20 shown in FIG.
1 shows a schematic image processing procedure. The process starts from step a1. In step a2, a monochrome two-dimensional image, for example, a two-dimensional image as shown in FIG. 3 is input. In step a3, information on black and white shading levels, which is one of the elements constituting the two-dimensional image as shown in FIG. 3, is extracted and converted into three-dimensional depth information. For example, 2
When converting the shades of a two-dimensional image into depth information, the shades of shades are set to 256 tones and 128 levels are set as basic colors. When the shading level is 129 to 255, coordinate conversion is performed in a direction protruding from the surface, and the level is 12
At the time of 8, since there is no change in the depth, it is used when deleting the depth information. In addition, the gray level is 0 to 127.
In the case of a saw, coordinate transformation is performed so as to retract on the opposite side of the surface of the three-dimensional model. In step a4, a wireframe model as shown in FIG. 4 is prepared in advance as modeling data for defining a three-dimensional shape, and the depth information converted in step a3 is added to create a three-dimensional model. The wire frame model of FIG. 4 can arbitrarily deform the basic shape as shown in FIG. 4A as shown in FIG. 4B and set an arbitrary projection angle. FIG.
In the stage (a), the correspondence between pixels is set between the two-dimensional coordinates of the two-dimensional image in FIG. 3 and the three-dimensional deformed shape as shown in FIG. The correspondence with the two-dimensional coordinates in FIG. 3 is created as mapping data by the three-dimensional modeling data creating unit 8. Step a3
When the converted depth information is added, the two-dimensional image of FIG. 3 is converted to a three-dimensional model represented by a wire frame as shown in FIG.

In step a5, rendering processing is performed by the rendering processing unit 15 of FIG. In the rendering process, a process of modulating the normal direction of the surface of the three-dimensional model and mapping the two-dimensional texture data on the surface of the three-dimensional model is also performed according to the two-dimensional bump data. As shown in FIG.
Regarding the dimensional model, the texture mapping is not performed in the rendering process, and the indicated color is obtained, for example, as shown in FIG.
It is also possible to generate a three-dimensional image in a surface model format as shown in FIG. In step a6, an image generated after the rendering processing by the rendering processing unit 15 is displayed. In step a7, it is determined whether or not the two-dimensional image input to the two-dimensional image input unit 1 has been corrected. When the image displayed in step a6 does not always have the desired effect, the original two-dimensional image is corrected using a drawing tool such as a pen. After the correction, the process returns to step a3. If no correction has been made, the process ends at step a8.

When a three-dimensional image obtained by the rendering process is corrected, there are two types depending on the direction in which the correction is performed, and these can be switched.

Regardless of the orientation of the three-dimensional image displayed by rendering, the depth coordinate transformation is performed on the surface of the three-dimensional model at the position designated by the pen in the vertical direction. The correction angle with respect to the three-dimensional model surface is independent of the projection angle.

The coordinates of the depth are converted in the direction viewed from the display unit 16 with respect to the position specified by the pen on the three-dimensional image displayed by the rendering. 3 depending on the projection angle
The correction angle with respect to the three-dimensional model surface changes.

FIG. 7 shows another embodiment of the present invention.
2 shows a processing procedure performed by the three-dimensional model creation device of FIG. The process starts from step b1.
A two-dimensional image is input as in step a2. In the present embodiment, a color image as shown in FIG. 8 is used as a two-dimensional image. In step b3, a specific color component is extracted as a component from the input color image, and the density level of the extracted color component is converted into three-dimensional depth information. In step b4, similar to step a4 in FIG.
A three-dimensional model as shown in FIG. 5 is created. Step b
5 is based on a three-dimensional model as shown in FIG.
Rendering processing similar to the three-dimensional image of FIG. 6 created in step a5 of FIG. In step b7, the two-dimensional color image shown in FIG.
The texture mapping is performed on the surface of the three-dimensional image shown in FIG. 9 and an image as shown in FIG. 9 is displayed. In step b8, if the original two-dimensional image has been corrected, the process returns to step b3. If no correction has been made, step b9
To end the procedure.

FIG. 10 shows a schematic configuration of another embodiment of the present invention. A plurality of images 22a, 22b,..., 22n can be input to the two-dimensional image input unit 21. Image data representing the input images 22a, 22b, 22n is stored in the two-dimensional image storage unit 23. The element association specifying unit 24 specifies which constituent element is extracted from the two-dimensional image that is the source of the three-dimensional model creation and which element of the three-dimensional image is to be converted. Association data conversion processing unit 25
Indicates that the component specified by the element association specifying unit 24 is 2
It is extracted from image data representing a two-dimensional image stored in the three-dimensional image storage unit 23, converted into three-dimensional information, and reflected on three-dimensional modeling data. The coordinate data of the three-dimensional model processed by the association data conversion processing unit 25 is
It is stored in the dimensional coordinate storage unit 26. The association data conversion processing unit 25 can also create texture coordinate data from the two-dimensional image input from the two-dimensional image input unit 21, and the created data is stored in the texture coordinate data storage unit 27. The three-dimensional image processing unit 28 uses the two-dimensional image stored in the texture coordinate storage unit 27 or the two-dimensional image storage unit 23 as texture mapping information or bump mapping information, and stores the three-dimensional image in the three-dimensional coordinate storage unit 26. A three-dimensional model based on three-dimensional modeling data is rendered to generate a three-dimensional image. The three-dimensional image processing unit 28 includes a rendering memory, and obtains a three-dimensional image obtained by the rendering process.
One-dimensional image data can be stored. The contents stored in the rendering memory can be corrected by the three-dimensional image correction unit 29 while viewing the display image. 3D image correction unit 2
The correction given by 9 is reflected and corrected in the two-dimensional image stored in the two-dimensional image storage unit 23, and the correction result is reflected and displayed again in the three-dimensional image.

Here, in the correction of the three-dimensional image by the three-dimensional image correction unit 29, two types of pens are prepared, and switching between the three-dimensional model correction and the texture image correction is possible. If the type of pen is switched from the above-described three-dimensional model correction to the texture image correction and the image data stored in the rendering memory of the three-dimensional image processing unit 28 is corrected, texture mapping is performed on the surface of the three-dimensional image. Correction for the two-dimensional texture image data can be performed. The texture image can be corrected while viewing the image data obtained by the rendering process, so that the image data can be easily corrected.

When an image is modified, a predetermined area including pixels to be rendered for the modification may be set, and image processing for the modification may be performed only in the set area. It is not necessary to correct all image data. In addition, if reverse mapping data is created for mapping data in the reverse direction, that is, from a pixel on a three-dimensional image to a pixel on a two-dimensional image, the correction from the three-dimensional image to the two-dimensional image can be performed more quickly. be able to.

In the three-dimensional model creating apparatus 30 as shown in FIG. 10, for example, a monochrome gray-scale image as shown in FIG. 3 and a color image as shown in FIG. It is also possible to input a two-dimensional image used as texture data and bump data, and an image shown in FIG. 11 as the image 22n. That is, the two-dimensional image input unit 21 receives a plurality of two-dimensional images, and the two-dimensional image storage unit 23 stores the plurality of input two-dimensional images.
A two-dimensional image for creating a three-dimensional model, a two-dimensional image for texture mapping, and the like can be freely selected.
The three-dimensional coordinate storage unit 26 can store three-dimensional modeling data as shown in FIG. As an example of an image obtained by the three-dimensional image processing unit 28, FIG.
7 shows a three-dimensional image obtained by extracting one color component from the color image data of FIG. 8 and reflecting the same on the depth information in the same manner as in FIG. 7, and further subjecting the original two-dimensional color image shown in FIG. 8 to texture mapping. .

FIG. 13 shows a computer device 31 and peripheral devices necessary for realizing the three-dimensional model creating devices 20 and 30 as shown in FIG. 1 or FIG. As the computer device 31, a workstation or a personal computer can be used. A display device 32 such as a cathode ray tube (CRT) or a liquid crystal display (LCD) is used for displaying an image. A keyboard 33 is used to provide various data to the computer device 31. A combination of a pen 34 and a tablet 35 is used for drawing and inputting an image to the computer device 31. In the computer device 31, a semiconductor memory, a hard disk, or the like is housed as the internal storage device. Further, a CD-ROM is used as the external storage device 37.
Also, a reproducing apparatus for a recording medium such as a DVD-ROM or a floppy disk is provided. A program for operating the computer device 31 as the three-dimensional model creation device 20 in FIG. 1 or the three-dimensional model creation device 30 in FIG. 10 is inserted into the external storage device 37 while being recorded on, for example, a CD-ROM. The computer device 31
It is connected to a local area network (LAN), the Internet, or the like, and can also operate by downloading programs from those networks. The two-dimensional image input to the two-dimensional image input units 1 and 21 can also be input as a prepared image data file from a recording medium or a network, or can be input by drawing using the pen 34 and the tablet 35 or the like. In addition,
It is also possible to use dedicated hardware as the computer device 31.

FIGS. 14 to 16 show examples in which three-dimensional images can be displayed as three-dimensional images based on two-dimensional images using the three-dimensional model generating devices 20 and 30 shown in FIG. 1 or FIG. FIG.
From the color two-dimensional image shown in FIG. 4, the shade of each color is converted into three-dimensional depth information, and a three-dimensional rendering image as shown in FIG. 15 is generated. Further, when the original two-dimensional image as shown in FIG. 14 is texture-mapped on the surface of the three-dimensionally converted rendering image in FIG. 15, a three-dimensional image as shown in FIG. 16 can be easily obtained.

[0040]

As described above, according to the present invention, information on components extracted from a two-dimensional image is reflected when a three-dimensional model is created, and a three-dimensional model having a complicated shape can be easily obtained. Can be created. Further, if the three-dimensional image generated by the rendering process is corrected, the correction is performed on the original two-dimensional image, and the correction can be easily reflected on the correction of the shape of the three-dimensional model without discomfort. .

Further, according to the present invention, when the image data is corrected, the data is corrected only by a predetermined range of image processing, so that the three-dimensional image creation processing can be sped up.

Further, according to the present invention, information on constituent elements extracted from a two-dimensional image is reflected when a three-dimensional model is created, and a three-dimensional model having a complicated shape can be easily created. . Further, by correcting the image data of the two-dimensional image that is the basis of the three-dimensional model, the three-dimensional model can be easily corrected. Further, when the image data is corrected, the data is corrected by image processing only in a predetermined range, so that the three-dimensional image creation processing can be speeded up.

Further, according to the present invention, a three-dimensional model can be created by reflecting the shading of a monochrome image on a three-dimensional depth.

Further, according to the present invention, it is possible to easily obtain a three-dimensional model by reflecting a specific color component of a color image in depth information of the three-dimensional model.

[0045]

According to the present invention, the two-dimensional image is added to the surface of the three-dimensional image formed by reflecting the components extracted from the two-dimensional image by the texture mapping process. It is possible to obtain a three-dimensional image in which a part of the two-dimensional image is made uneven.

Further, according to the present invention, the surface of a three-dimensional image can be subjected to a bump treatment, so that a feeling of material and the like can be easily represented.

Further, according to the present invention, it is possible to cause a computer device to operate as a three-dimensional model creation device that reflects components of a two-dimensional image on a three-dimensional image by a program recorded on a recording medium.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a schematic configuration of a three-dimensional model creation device 20 according to an embodiment of the present invention.

FIG. 2 is a flowchart showing one embodiment of a processing procedure of the three-dimensional model creation device 20 of FIG.

FIG. 3 is a diagram illustrating an example of a monochrome two-dimensional image input to a two-dimensional image input unit 1 in FIG. 1;

FIG. 4 is a diagram illustrating an initial setting state and a deformed state of a three-dimensional wire frame model which is a basic of the three-dimensional model.

FIG. 5 is a diagram showing a three-dimensional wireframe model created by a three-dimensional modeling data creation unit 8 of FIG. 1;

6 is a diagram illustrating a three-dimensional image generated by performing a rendering process in a rendering processing unit 15 of FIG. 1;

FIG. 7 is a flowchart showing another embodiment of the processing procedure of the three-dimensional model creation device 20 of FIG.

8 is a diagram illustrating a color two-dimensional image input to the two-dimensional image input unit 1 in the processing procedure of FIG. 7;

FIG. 9 is a diagram showing a rendering process image in which the color components of the color image of FIG. 8 are extracted and three-dimensionalized by the processing procedure of FIG. 7;

FIG. 10 is a block diagram showing a schematic electrical configuration of a three-dimensional model creation device 30 according to another embodiment of the present invention.

11 is a diagram illustrating one of a plurality of two-dimensional images input to the two-dimensional image input unit 21 in FIG.

FIG. 12 is a diagram illustrating an example of a three-dimensional image obtained from a three-dimensional image processing unit of the embodiment in FIG. 10;

FIG. 13 shows the three-dimensional model creation device 20 of FIG. 1 or FIG.
FIG. 3 is a simplified perspective view showing an example of a hardware configuration for realizing the three-dimensional model creation device 30 of FIG.

FIG. 14 is a diagram showing still another example of the two-dimensional image from which the three-dimensional processing is performed in the embodiment of FIG. 1 or FIG. 10;

FIG. 15 is a diagram illustrating a three-dimensional rendering image obtained based on the two-dimensional image of FIG. 14;

FIG. 16 shows a three-dimensional rendering image of FIG.
FIG. 14 is a diagram illustrating a three-dimensional image obtained by performing texture mapping on the two-dimensional image No. 4;

[Explanation of symbols]

 1, 21 2D image input unit 3, 23 2D image storage unit 4 3D modeling data storage unit 5 Bump data storage unit 6, 27 Texture coordinate data storage unit 7 3D information association processing unit 8 3D modeling data creation unit 9 Bump data creation unit 10 Texture data coordinate creation unit 15 Rendering processing unit 16 Display unit 20, 30 3D model creation device 22a, 22b, ..., 22n Image 24 Element association specifying unit 25 Association data conversion processing unit 26 3D coordinate storage Unit 28 three-dimensional image processing unit 29 three-dimensional image correction unit 31 computer device 32 display device 34 pen 35 tablet 37 external storage device

Claims (9)

(57) [Claims] 1. A three-dimensional model creating apparatus for creating a three-dimensional model by performing image processing on a two-dimensional image, comprising: image storage means for inputting and saving image data representing a two-dimensional image; Model setting means for setting modeling data for defining a three-dimensional shape as a basis for dimensioning; element extracting means for extracting information about predetermined components from image data representing an input two-dimensional image; Element conversion means for converting the element information extracted by the extraction means into three-dimensional information having a predetermined relationship; and three-dimensional information converted by the element conversion means for modeling data set by the model setting means. From the model creating means for creating the three-dimensional model, and the three-dimensional model created by the model creating means,
Rendering means for generating a three-dimensional image by a rendering process; conversion of element information into three-dimensional information by element conversion means; reflection of three-dimensional information on the three-dimensional model by model creation means; In the course of the rendering process, mapping information indicating the correspondence between pixels on the three-dimensional image generated by the rendering process and pixels on the two-dimensional image represented by the image data stored in the image storage unit is stored. Mapping means for creating, a rendering memory for storing the three-dimensional image data generated by the rendering means together with mapping information created by the mapping means, and three-dimensional image data stored in the rendering memory.
Three-dimensional image correcting means for inputting a drawing operation for display and correction; and when a drawing operation to the three-dimensional image correcting means is performed, according to mapping information stored in a rendering memory.
A three-dimensional model creation device, comprising: inverse mapping means for correcting image data representing a two-dimensional image stored in the image storage means. 2. The element extracting unit, the element converting unit,
The model creating unit and the rendering unit are configured to process only image data in a predetermined range including pixels for which a rendering operation for correcting image data is performed by the three-dimensional image modifying unit. The three-dimensional model creation device according to claim 1, wherein 3. A three-dimensional model creation apparatus for creating a three-dimensional model by performing image processing on a two-dimensional image, comprising: image storage means for inputting and saving image data representing a two-dimensional image; Model setting means for setting modeling data for defining a three-dimensional shape as a basis for dimensioning; element extracting means for extracting information about predetermined components from image data representing an input two-dimensional image; Element conversion means for converting the element information extracted by the extraction means into three-dimensional information having a predetermined relationship; and three-dimensional information converted by the element conversion means for modeling data set by the model setting means. From the model creating means for creating the three-dimensional model, and the three-dimensional model created by the model creating means,
Rendering means for generating a three-dimensional image by a rendering process; and two-dimensional image correction means for inputting a drawing operation for displaying and correcting image data representing the two-dimensional image stored in the image storage means, The element extraction unit, the element conversion unit, the model creation unit, and the rendering unit determine that only a predetermined range of image data including pixels for which a rendering operation for correcting image data is performed by the two-dimensional image correction unit is to be processed. A three-dimensional model creating apparatus. 4. The two-dimensional image is a monochrome image having three or more gradations, wherein the element extracting means extracts gradation information as the element information from image data representing the monochrome image, The three-dimensional model creation device according to any one of claims 1 to 3, wherein the element conversion unit converts the gradation information into three-dimensional depth information. 5. The image processing apparatus according to claim 1, wherein the two-dimensional image is a color image having components of a plurality of colors, and the element extracting unit extracts density information of a predetermined color component as the element information from image data representing the color image. The three-dimensional model creation device according to any one of claims 1 to 3, wherein the element conversion unit converts the density information of the color component into three-dimensional depth information. 6. A texture creating means for creating texture image data based on a two-dimensional image from which the element information is extracted by the element extracting means, wherein the model creating means reflects the three-dimensional information. The three-dimensional model according to any one of claims 1 to 5, wherein a texture mapping process of the two-dimensional image is performed on the surface of the three-dimensional model created by the texture coordinate data created by the texture creating means. Model creation device. 7. A bump storage means for inputting and storing data for bump processing, wherein the model creation means is provided on the surface of a three-dimensional model created by reflecting the three-dimensional information by the bump storage means. The three-dimensional model creation device according to claim 1, wherein a bump process is performed based on the stored data. 8. An image storage means for inputting and storing image data representing a two-dimensional image, and a model setting means for setting modeling data for defining a three-dimensional shape which is a basis for converting a two-dimensional image into three dimensions. An element extracting means for extracting information about a predetermined component from image data representing an input two-dimensional image, and converting the element information extracted by the element extracting means into three-dimensional information having a predetermined relationship. Element conversion means, model creation means for creating a three-dimensional model by reflecting the three-dimensional information converted by the element conversion means on the modeling data set by the model setting means, and creation by the model creation means. From the three-dimensional model,
Rendering means for generating a three-dimensional image by a rendering process; conversion of element information into three-dimensional information by element conversion means; reflection of three-dimensional information on the three-dimensional model by model creation means; In the course of the rendering process, mapping information indicating the correspondence between pixels on the three-dimensional image generated by the rendering process and pixels on the two-dimensional image represented by the image data stored in the image storage unit is stored. Mapping means for creating, a rendering memory for storing the three-dimensional image data generated by the rendering means together with mapping information created by the mapping means, and three-dimensional image data stored in the rendering memory.
Three-dimensional image correcting means for inputting a drawing operation for display and correction; and when a drawing operation to the three-dimensional image correcting means is performed, according to mapping information stored in a rendering memory.
A reverse mapping means for correcting image data representing the two-dimensional image stored in the image storage means, and causing the computer to function as a three-dimensional model creation device for creating a three-dimensional model by performing image processing on the two-dimensional image Readable recording medium on which a program for recording is recorded. 9. An image storage means for inputting and storing image data representing a two-dimensional image, and a model setting means for setting modeling data for defining a three-dimensional shape serving as a basis for converting a two-dimensional image into three dimensions. An element extracting means for extracting information about a predetermined component from image data representing an input two-dimensional image, and converting the element information extracted by the element extracting means into three-dimensional information having a predetermined relationship. Element conversion means, model creation means for creating a three-dimensional model by reflecting the three-dimensional information converted by the element conversion means on the modeling data set by the model setting means, and creation by the model creation means. From the three-dimensional model,
Rendering means for generating a three-dimensional image by a rendering process; and two-dimensional image correction means for inputting a drawing operation for displaying and correcting image data representing the two-dimensional image stored in the image storage means, The element extraction unit, the element conversion unit, the model creation unit, and the rendering unit target only image data in a predetermined range including pixels for which a rendering operation for correcting image data is performed by the two-dimensional image correction unit. A computer-readable recording medium that records a program for causing a computer to function as a three-dimensional model creation device that creates a three-dimensional model by performing image processing on a two-dimensional image.