JP2013008137A - Data transmission device for three-dimensional shape modeling, data reception device for three-dimensional shape modeling, three-dimensional shape modeling system, data transmission program for three-dimensional shape modeling, and data reception program for three-dimensional shape modeling - Google Patents

Abstract

[PROBLEMS] To greatly reduce the amount of data transmitted from a transmission side when transmitting data related to the 3D shape model from the transmission side and restoring the 3D shape model based on the received data on the reception side. Can do.
A three-dimensional shape modeling data transmitting apparatus 100A transmits feature point data representing a three-dimensional shape feature point to a three-dimensional shape modeling data receiving apparatus 100B via a network 102. The three-dimensional shape modeling data receiving apparatus 100B restores the three-dimensional shape based on the received feature point data.
[Selection] Figure 1

Description

  The present invention relates to a three-dimensional shape modeling data transmission device, a three-dimensional shape modeling data reception device, a three-dimensional shape modeling system, a three-dimensional shape modeling data transmission program, and a program for generating a three-dimensional geometric shape of an object. And a three-dimensional shape modeling data receiving program.

  Techniques relating to the creation of three-dimensional geometric shapes are classified into two types depending on the method used. One is a method of automatically extracting geometric features from objects that actually exist. As an example, there is a method of generating a model based on a physical law by taking in three-dimensional geometric information of an object using a range scanner (see, for example, Non-Patent Document 1). There is also a method of generating a model from the front and side images of the object (see, for example, Non-Patent Document 2). The above technique has already been put into practical use in the entertainment field such as movies and computer games, and a realistic geometric shape can be obtained semi-automatically. However, the above method requires a special device such as a range scanner.

  The other is a technique that aims to make the work easier when directly creating the geometric shape of the object. Some of these methods are already incorporated into commercial 3D modeling software. However, since this technique requires a high level of artistic sensibility from workers, research is being conducted to enable higher level control. For example, a method of deforming a face shape using parameters (see Non-Patent Document 3) and a method of expressing local deformation parameters as a more global set (see Non-Patent Document 4) have been proposed.

  However, the above-described method is an auxiliary work for improving the efficiency of creating a geometric shape, and is not sufficient for any worker to create a geometric shape of an arbitrary object.

  There is also a method for generating a three-dimensional geometric shape of a face using parameters based on human body measurement (see Non-Patent Document 5). However, this method does not have enough parameters, and only a few features such as the degree of protrusion of the jaw and the size of the eye fissure can be manipulated, so a face shape having detailed features cannot be generated.

  On the other hand, as a method for generating an arbitrary three-dimensional shape, there is a method using two-dimensional graphic information of a three-dimensional object. This method takes a feature point of 2D graphic information of an object and a control point of a 3D basic shape model whose basic shape approximates the object. Then, the three-dimensional basic shape model is deformed so that the control points of the three-dimensional basic shape model coincide with the feature points of the two-dimensional graphic information (see, for example, Patent Document 1).

  For deformation of three-dimensional shapes, FFD (Free-Form Deformation), which is a deformation method, is used, and a method using a cosine function or cosine-n power function (where n is an integer of 2 or more) is proposed. (For example, refer to Patent Document 2).

  However, in the case of a face, it can be said that the method of simply creating a three-dimensional shape model such as the method of Patent Document 1 is insufficient. This is because the main use of the three-dimensional face shape model is to create an animation with a facial expression such as a digital actor or an avatar, or a cosmetic surgery simulation.

  In the prior art, since many of the objects are general three-dimensional shapes and do not handle information specific to the face shape, it is necessary to add information specific to the face shape every time a new face shape model is created, Work efficiency is getting worse.

  For this reason, in Patent Document 3, as a technique for obtaining a realistic and easy-to-use 3D face shape model for human faces, geometric features of face shapes are extracted as feature points. And the method of applying a deformation | transformation method with respect to the obtained feature point is disclosed.

Y. Lee, D. Terzopoulos, and K. Waters, realistic face modeling for animation In Proceedings SIGGRAPH'95, 1995, p.55-62 T. Akimoto, Y. Suenaga, and R. Wallace, Automatic creation of 3D facial models IEEE Computer Graphics and Applications, September 1993, 13 (5): p.16-22 F. Parke and K. Waters, Computer Facial Animation AKPeters, 1996 N.Magnenat-Thalmann, H.Minh, M.deAngelis, and D.Thalmann, Design, transformation and animation of human faces The Visual Computer, 1989, 5 (1/2): p.32-39 Douglas DeCarlo, Dimitris Metaxas, and Matthew Stone, anthropometric Face Model using VariationalTechniques In Proceedings SIGGRAPH'98, 1998, p.67-74

JP-A-4-289976 JP 2004-78309 A Japanese Patent No. 4474546

  As mentioned above, the main use of the 3D face shape model is to create animation with facial expressions such as digital actors and avatars. For example, 3D avatars are used in full-scale virtual shops on the web. May spread.

  Normally, when transmitting / receiving three-dimensional shape data, for example, as shown in FIG. 24, when transmitting three-dimensional shape data of about 1000 KB or polygon data of about 600 KB, compression processing is performed on the transmission side and then via a network. To send. In this case, the transmitted three-dimensional shape data is about 100 KB, and the polygon data is about 60 KB. Then, on the receiving side, this is decompressed to restore the three-dimensional shape.

  As described above, even if the data on the three-dimensional shape is compressed on the transmission side, the data size is not reduced so much and the communication load cannot be greatly reduced. This becomes a serious problem when, for example, three-dimensional avatars are widely spread as described above, and the demand for restoration by transmission / reception of three-dimensional shape data in real time increases.

  The present invention has been made in view of the above points, and transmits data related to a 3D shape model from the transmission side, and when the 3D shape model is restored on the reception side based on the received data. 3D shape modeling data transmitting device, 3D shape modeling data receiving device, 3D shape modeling system, 3D shape modeling that can obtain a 3D shape model that can greatly reduce the amount of data transmitted from the side An object of the present invention is to provide a data transmission program and a data reception program for three-dimensional shape modeling.

  In order to solve the above-described problem, a data transmission apparatus for 3D shape modeling according to the first aspect of the invention includes a two-dimensional image acquisition unit that acquires a plurality of two-dimensional images, and the two-dimensional image acquisition unit that acquires Feature point extracting means for extracting a first feature point from a three-dimensional image; three-dimensional position information acquiring means for acquiring three-dimensional position information of the first feature point extracted by the feature point extracting means; Transmission means for transmitting the three-dimensional position information of the first feature point acquired by the position information acquisition means.

  In addition, as described in claim 2, the transmission unit includes the three-dimensional position information of the first feature point at each stage when the three-dimensional position of the first feature point is moved in stages. History data may be transmitted.

  According to a third aspect of the present invention, the transmission unit may transmit the two-dimensional image acquired by the two-dimensional image acquisition unit.

  A data receiving apparatus for three-dimensional shape modeling according to a fourth aspect of the present invention is the three-dimensional position information of the first feature point transmitted from the transmitting apparatus according to any one of the first to third aspects. 3D position information receiving means for receiving, the standard position information of the second feature point of the 3D standard shape, and the 3D position information of the first feature point received by the 3D position information receiving means; And creating means for creating a three-dimensional shape model by deforming the three-dimensional standard shape.

  In addition, as described in claim 5, the three-dimensional position information receiving unit performs the tertiary processing of the first feature point in each step when the three-dimensional position of the first feature point is moved stepwise. The historical data of the original position information may be received, and the creation unit may create the three-dimensional shape model for each stage.

  According to a sixth aspect of the present invention, the creating means deforms the overall shape of the three-dimensional standard shape by a GFFD deformation method using Euclidean norm as a basis function, and details of the three-dimensional standard shape Such a shape may be deformed by a GFFD deformation method using a Gaussian function as a basis function.

  In addition, as described in claim 7, the reception unit receives the two-dimensional image transmitted from the transmission device according to claim 2, and the creation unit receives the reception in the three-dimensional shape model. The two-dimensional image received by the means may be pasted as a texture.

  Further, as described in claim 8, arbitrary information may be added to the three-dimensional standard shape.

  A three-dimensional shape modeling system according to a ninth aspect includes the three-dimensional shape modeling data transmitting device according to the first aspect and the three-dimensional shape modeling data receiving device according to the fourth aspect. It is characterized by.

  A three-dimensional shape modeling system according to a tenth aspect of the invention includes the three-dimensional shape modeling data transmitting device according to the second aspect and the three-dimensional shape modeling data receiving device according to the fifth aspect. It is characterized by.

  A three-dimensional shape modeling system according to an eleventh aspect includes the three-dimensional shape modeling data transmitting device according to the third aspect and the three-dimensional shape modeling data receiving device according to the seventh aspect. It is characterized by.

  A three-dimensional shape modeling data transmission program according to a twelfth aspect of the invention is a computer, each means constituting the three-dimensional shape modeling data transmission device according to any one of the first to third aspects. It is made to function as.

  A three-dimensional shape modeling data receiving program according to a thirteenth aspect of the invention is a computer, each means constituting the three-dimensional shape modeling data receiving device according to any one of the fourth to eighth aspects. It is made to function as.

  According to the present invention, when data related to a three-dimensional shape model is transmitted from the transmission side and the three-dimensional shape model is restored on the reception side based on the received data, the amount of data transmitted from the transmission side is greatly increased. It has the effect that it can be reduced.

It is a block diagram which shows schematic structure of a three-dimensional shape modeling system. It is a block diagram which shows schematic structure of the data transmission apparatus for three-dimensional shape modeling. It is a block diagram which shows schematic structure of the data receiver for three-dimensional shape modeling. It is a flowchart which shows operation | movement of the data transmission apparatus for three-dimensional shape modeling. It is a flowchart which shows operation | movement of the data receiver for three-dimensional shape modeling. It is the figure which extracted the feature point of the two-dimensional face image. It is a figure which shows an example of the standard face shape model which added the standard feature point. It is a modification of the three-dimensional shape by GFFD. It is a modification of the three-dimensional shape by GFFD. It is a modification from the standard face shape model by GFFD. It is the figure which stuck the texture on the deformed three-dimensional face shape model. It is an example of information addition to a standard face shape model. It is an example of a three-dimensional face shape model with a facial expression. It is an example of the three-dimensional face shape model at the time of performing spectacles wearing simulation. It is a figure which shows the example which showed the standard face shape model with the polygon mesh. It is a figure for demonstrating the feature point of a foot | leg part. It is a figure which shows the three-dimensional shape model of a leg part. It is a figure for demonstrating transmission / reception of feature point data. It is a figure for demonstrating the production | generation of various three-dimensional shapes. It is a figure which shows the mode of a deformation | transformation of the bucket seat of a vehicle. It is a figure which shows the mode of a deformation | transformation of a receiver. It is a figure which shows the mode of a deformation | transformation of a telephone. It is a figure for demonstrating the case where the log | history of feature point data is transmitted. It is a figure for demonstrating transmission / reception of the conventional three-dimensional shape data.

  Embodiments of the present invention will be described below with reference to the drawings.

  FIG. 1 is a block diagram showing a schematic configuration of a three-dimensional shape modeling system 10 according to an embodiment of the present invention. In the present embodiment, a case where a face shape is modeled as an example of a three-dimensional shape will be described.

  The three-dimensional shape modeling system 10 includes a three-dimensional shape modeling data transmission device 100A and a three-dimensional shape modeling data reception device 100B. The three-dimensional shape modeling data transmission device 100A and the three-dimensional shape modeling data transmission device 100B are used. The data receiving device 100B is connected via a network 102 such as the Internet.

  FIG. 2 is a block diagram showing a schematic configuration of a three-dimensional shape modeling data transmitting apparatus 100A according to an embodiment of the present invention. The three-dimensional shape modeling data transmitting apparatus 100A includes a CPU 1A for controlling the entire system, a ROM (read only memory) 2A, a RAM (random access memory) 3A for temporary data storage, a display unit 4A such as a monitor, a two-dimensional display An input unit 5A for inputting a face image, a data storage unit 7A, and a transmission unit 8A are included. The data storage unit 7A includes a program storage unit 73A and stores a processing program to be described later.

  FIG. 3 is a block diagram showing a schematic configuration of a three-dimensional shape modeling data receiving apparatus 100B according to an embodiment of the present invention. The three-dimensional shape modeling data receiving apparatus 100B includes a CPU 1B that controls the entire system, a ROM (read only memory) 2B, a RAM (random access memory) 3B for temporary data storage, a display unit 4B such as a monitor, and an input unit 5B. The data storage unit 7B and the reception unit 8B are included.

  The data storage unit 7B includes a standard face shape storage unit 71 that stores a standard face shape model (generic model), a measurement point database 72 that stores feature points, and a program storage unit 73B.

  The program storage unit 73B stores a processing program, which will be described later, and a GFFD (general free-form deformation) program based on a general function, which is a three-dimensional deformation method. The GFFD will be described later.

  The feature points stored in the measurement point database 72 are those used in the forensic compound face method, and based on the measurement points in the human body measurement, the feature points of the shape representing individual differences in face shape are statistically calculated. This is a point determined by analysis. This feature point has a clear feature on the two-dimensional image such as the most protruding point of the nose and the corner of the eye. In the present invention, by using this point as a feature point of the face shape, a three-dimensional face shape model of the target face can be obtained with sufficient accuracy.

  An apparatus having both functions of the three-dimensional shape modeling data transmitting apparatus 100A and the three-dimensional shape modeling data receiving apparatus 100B may be configured.

  Next, processing executed in the CPU 1A of the three-dimensional shape modeling data transmitting apparatus 100A will be described with reference to a flowchart shown in FIG. The CPU 1A reads and executes the processing program stored in the program storage unit 73A.

  First, in step S1, the user uses a digital camera to photograph a plurality of faces for which a face shape model is to be created from different imaging directions, and inputs the photographed two-dimensional face image to the input unit 5A. The two-dimensional face image uses two or more face images directed in different directions depending on the accuracy required for the system. The number of face images and the face orientation in the images are not important. In this example, three two-dimensional face images on the front and left and right sides are input.

  In step S2, the measurement points stored in the measurement point database 72 are called, and the feature points of the two-dimensional face image are extracted for each of the three two-dimensional face images input from the input unit 5A.

  The feature points can be automatically extracted by a general image processing method in addition to manual extraction such as mouse operation.

  The easiest feature point automatic extraction method is a method of binarizing an arbitrary luminance from a two-dimensional face image as a threshold and scanning the image to determine a point that meets the definition of the feature point. Alternatively, a feature point may be extracted by attaching a marker to the feature portion and extracting the marker from the captured image.

  In this example, in order to construct a three-dimensional face shape model having sufficient accuracy, 51 feature points shown in FIG. 6 are extracted. Note that an arbitrary number of feature points can be defined.

  The feature points extracted from each image have information on facial features such as the most protruding points of the nose and the corners of the eyes, but have coordinates only in two dimensions.

  Therefore, in step S3, the three-dimensional position information of the feature points is obtained from the correspondence between the feature points in the images with different imaging directions.

  The information of each face image is distorted due to the characteristics of the lens of the photographed camera. CPU1 corrects distortion etc. using the parameter of the digital camera image | photographed to the two-dimensional coordinate of the extracted feature point, and calculates the three-dimensional position information of a feature point.

  This parameter is an internal parameter indicating the focal length of the camera and the like, and an external parameter indicating the camera arrangement, posture, and the like. When the parameter is unknown, as a separate process, a cube whose size is known is photographed from a plurality of directions with the same camera, and the parameter is calculated from the photographed image.

  In step S4, the three-dimensional position information of the feature points and the texture of the two-dimensional face image are transmitted to the three-dimensional shape modeling data receiving apparatus 100B via the network 102 by the transmission unit 8A.

  Next, processing executed by the CPU 1B of the three-dimensional shape modeling data receiving apparatus 100B will be described with reference to a flowchart shown in FIG. The CPU 1B reads and executes the processing program stored in the program storage unit 73B.

  First, in step S5, the three-dimensional position information of the feature points and the texture of the two-dimensional face image transmitted from the three-dimensional shape modeling data transmitting apparatus 100A are received.

  In step S6, the standard face shape model stored in the standard face shape storage unit 71 is called, and the standard face shape model is deformed based on the three-dimensional position information of the feature points received in step S5.

  The standard face shape model stored in the standard face shape storage unit 71 is a one-to-one correspondence with a free-form surface as shown in FIG. 7 or a geometric shape composed of a polygon mesh and feature points extracted from a two-dimensional face image. Consists of corresponding feature points. The feature point standard position information of the standard face shape model is moved so as to match the three-dimensional position information of the feature point received in step S5, and the geometric shape portion other than the feature point is transformed so as to interpolate the movement of the feature point. To do.

  For the deformation of the standard face shape model in step S6, a method using GFFD (Generalized Free-Form Deformation) by a general function is used.

  Here, FFD (Free-Form Deformation) is a deformation method that is independent of the shape model to be deformed, and the number of operating points that define the deformation of the space is independent of the object to be deformed. There is no need to change many control points. However, the conventional FFD has a problem that the shape of the operation point is limited.

  GFFD, on the other hand, arranges an arbitrary number of operation points at arbitrary positions, allows the deformation to be controlled intuitively by moving the operation points, and allows arbitrary basis functions to be selected. Can be controlled. FIG. 8 shows an example of shape deformation by GFFD when the Gaussian function is a basis function, and FIG. 9 shows an example of shape deformation by GFFD when the Euclidean norm is a basis function. As described above, in GFFD, the surrounding geometric shape can be smoothly deformed by moving the operation point.

Therefore, the feature point of the standard face shape model is used as the GFFD operation point, and the geometric shape is deformed by moving to the feature point extracted from the two-dimensional face image.

  Here, details of the deformation of the standard face shape model using GFFD will be described below.

Feature points in n standard face shape models

Feature points extracted from face images

And a mapping that represents the transformation from pi to qi,

It is expressed. An arbitrary point on the space is transformed using this function f. Here, if the function f is considered as a weighted linear combination of n vectors,

It is expressed. here,

Is the control vector, function

Is an arbitrary basis function centered on the j-th feature point in the standard face shape model. Here, in order to obtain the unknown vector V, the feature point pi in the standard face shape model and the feature point qi extracted from the face image as the point after the movement are substituted into the equation (1),

It is expressed. Here, when rewritten in matrix form,

And here

V can be obtained as follows using the inverse matrix of G.

In this way, a point q that is obtained by moving an arbitrary point p in space according to the movement of the feature point

Can be obtained as

  As the basis function G, an arbitrary function can be selected according to the deformation target. In the present invention, a Gaussian function and an Euclidean norm are mainly used. In the case of using a Gaussian function, the fine adjustment of the deformation can be performed by the standard deviation, and in the case of the Euclidean norm, the deformation can be performed while keeping the characteristics of the original geometric shape as much as possible.

  If the entire shape of the face shape is deformed by GFFD using Euclidean norm, and the detailed shape of eyes, nose, mouth, etc. is deformed by GFFD using Gaussian function, it has a complex structure like a face. The shape can also be deformed with high accuracy.

  An example in which the standard face shape model is modified using this technique is shown in FIG. Since the created face shape model is a three-dimensional shape, it is possible to display a direction different from the input image as shown in FIG.

  Next, in step S7, the texture of the two-dimensional face image received by the receiving unit 8B is pasted on the created three-dimensional face shape model and displayed on the display unit 4B. Texture is a technique for improving texture by pasting an image into a shape in computer graphics. In the present invention, since the standard face shape model is deformed in accordance with the two-dimensional face image, the face image is pasted from the direction of the captured camera, so that a texture suitable for the created shape is obtained. FIG. 11 shows the face shape with the texture attached.

  By the way, it is possible to add arbitrary information to the standard face shape model according to the use of the created three-dimensional face shape model. The three-dimensional face shape model is generally subjected to deformation such as expression when actually used. Therefore, if information such as facial expressions is added to the standard face shape model, and the additional information is also changed in the same way when the standard face shape model is deformed, the additional information is also automatically added to the created 3D face shape model. It becomes very easy to operate the 3D face shape model after creation.

  Take facial expressions as an example. Muscles used for expressing a general expression are modeled as a three-dimensional vector, and the start point and end point of the muscle are defined as points on the standard face shape model as shown in FIG. Next, the starting point of the expression muscle is moved in the vector direction of the expression muscle, and the standard face shape model is deformed in accordance with the movement. Therefore, as shown in FIG. 12B, a standard face shape model with a facial expression can be created.

  For deformation from a standard face shape model with a facial expression, the deformation by GFFD using Gaussian function is also used. FIG. 13 shows an example in which a standard face shape model with a facial expression is deformed and a facial image texture is pasted. Therefore, expression is added to the created 3D face shape model without adding new elements to the system. In this way, it is possible to add a facial expression to the created three-dimensional face shape model relatively easily by simply adding information to the standard face shape model.

  As described above, according to the present embodiment, a three-dimensional face shape model can be easily created from a two-dimensional face image. Therefore, even a worker who does not have a special device or artistic sensitivity can create a three-dimensional face shape model in a few minutes by preparing a face image.

  As mentioned above, although embodiment of this invention was explained in full detail with reference to drawings, the specific structure is not restricted to this embodiment, The design change etc. of the range which does not deviate from the summary of this invention are included.

  For example, in the above embodiment, the standard face shape model incorporated in advance has been transformed, but the present invention is not limited to this, and any face shape may be set as the standard face shape model. Is possible.

  Further, the information added to the standard face shape model may be a glasses wearing simulation shown in FIG. In the example of FIG. 14, feature points necessary for fitting glasses are added to the standard face shape model, and the glasses of the 3D shape model are aligned with the feature points of the created 3D face shape model.

  In addition, the present invention can be applied in various fields dealing with faces. In addition to the above-described eyeglass wearing simulation, the present invention can be applied to cosmetic surgery simulation, use as a tool for creating characters such as games and movies, use for chatting on mobile communication terminals and creation of avatars in e-mails.

  In this embodiment, a geometric model represented by a free-form surface as shown in FIG. 7 is used as a standard face shape model (generic model). However, as shown in FIG. 15, a generic model composed of polygon meshes is used. A model may be used. Also in such a case, the three-dimensional shape modeling data receiving device 100B receives the feature point standard position information of the feature point P1 of the generic model from the three-dimensional shape point data P2 transmitted from the three-dimensional shape modeling data transmitting device 100A. It is possible to restore the three-dimensional shape model of the face by moving it so as to match the position information.

  In the present embodiment, the case where a three-dimensional shape of a face is created has been described. However, the three-dimensional shape is not limited to a face, and may be, for example, a foot. In the case of the foot, as shown in FIG. 16, feature points are set on the ankle and heel. Also in such a case, the three-dimensional shape modeling data receiver 100B transmits the feature point standard position information of the feature point P1 of the generic model from the three-dimensional shape modeling data transmitter 100A as shown in FIG. The three-dimensional shape model of the foot can be restored by moving the feature point P2 so as to match the three-dimensional position information of the feature point P2.

  As shown in FIG. 18, the three-dimensional shape data of the foot is about 1000 KB and the three-dimensional shape data of the face is about 600 KB, but the feature point data is about 2 KB, which is compared with the three-dimensional shape data. The amount of data is extremely small. Since the three-dimensional shape modeling data transmitting apparatus 100A according to the present embodiment only has to transmit the data of this feature point, the transmission data amount can be greatly reduced. The three-dimensional shape modeling data receiving apparatus 100B can easily restore the three-dimensional shape of the face and the foot if the conversion tool using GFFD as described above is provided.

  As shown in FIG. 19, the three-dimensional shape model is not limited to the shape of a part of a human being such as a face or a foot, but may be a car bucket seat, a receiver, a telephone, or the like. In this case, for example, as shown in FIG. 19, the generic model of the bucket seat of the car can be a sphere, and the generic model of the handset and the telephone can be a cuboid. FIG. 20 shows how the three-dimensional shape of the bucket seat of the car is created by moving the feature point P2 stepwise from the generic model of the sphere. FIG. 21 shows how the three-dimensional shape of the handset is created by moving the feature point P2 stepwise from the rectangular parallelepiped generic model. FIG. 22 shows how the three-dimensional shape of the telephone is created by moving the feature point P2 stepwise from the rectangular parallelepiped generic model.

  In this way, by moving the feature point P2 in stages, not only the final shape of the three-dimensional shape model but also the creation process can be displayed.

  Therefore, as shown in FIG. 23, in the three-dimensional shape modeling data transmitting apparatus 100A, the history data of the three-dimensional position information of the feature point P2 at each stage when the three-dimensional position of the feature point P2 is moved stepwise. The three-dimensional shape modeling data receiving apparatus 100B receives this history data, creates a three-dimensional shape model for each step, and displays a process of stepwise deformation of the three-dimensional shape model. You may do it. Thereby, it can be easily recognized how the three-dimensional shape is deformed.

  Note that the three-dimensional shape modeling data transmitting apparatus 100A may collectively transmit the three-dimensional position information of the feature points P2 at each stage to the three-dimensional shape modeling data receiving apparatus 100B. The three-dimensional position information of the point P2 may be transmitted once to the three-dimensional shape modeling data receiving device 100B once. At this time, when there is a response indicating that it has been received from the data receiving apparatus for 3D shape modeling 100B, the 3D position information of the next feature point P2 may be transmitted.

1A, 1B CPU
2A, 2B RAM
3A, 3B ROM
4A, 4B Display unit 5A, 5B Input unit 7A, 7B Data storage unit 8A Transmission unit 8B Reception unit 10 Three-dimensional shape modeling system 71 Standard face shape storage unit 72 Measurement point database 73A, 73B Program storage unit 100 Face shape modeling system 100A Three-dimensional shape modeling data transmission device 100B Three-dimensional shape modeling data reception device 102 Network

Claims (13)

Two-dimensional image acquisition means for acquiring a plurality of two-dimensional images;
Feature point extraction means for extracting a first feature point from the two-dimensional image acquired by the two-dimensional image acquisition means;
Three-dimensional position information acquisition means for acquiring three-dimensional position information of the first feature point extracted by the feature point extraction means;
Transmitting means for transmitting the three-dimensional position information of the first feature point acquired by the three-dimensional position information acquiring means;
3D shape modeling data transmission device. The tertiary transmission according to claim 1, wherein the transmission unit transmits the history data of the three-dimensional position information of the first feature point in each step when the three-dimensional position of the first feature point is moved stepwise. Data transmission device for original shape modeling. The three-dimensional shape modeling data transmission device according to claim 1, wherein the transmission unit transmits the two-dimensional image acquired by the two-dimensional image acquisition unit. 3D position information receiving means for receiving the 3D position information of the first feature point transmitted from the transmission device according to any one of claims 1 to 3;
Deforming the three-dimensional standard shape from the standard position information of the second feature point of the three-dimensional standard shape and the three-dimensional position information of the first feature point received by the three-dimensional position information receiving means; Creating means for creating a three-dimensional shape model by
A data receiving apparatus for three-dimensional shape modeling. The three-dimensional position information receiving means receives the history data of the three-dimensional position information of the first feature point in each step when the three-dimensional position of the first feature point is moved stepwise, The data receiving apparatus for three-dimensional shape modeling according to claim 4, wherein the creating means creates the three-dimensional shape model for each of the stages. The creation means deforms the overall shape of the three-dimensional standard shape by a GFFD deformation method using a Euclidean norm as a basis function, and uses a Gaussian function as a basis function for the detailed shape of the three-dimensional standard shape. The data receiving apparatus for three-dimensional shape modeling according to claim 4 or 5, wherein the data receiving apparatus is deformed by a GFFD deformation technique. The reception unit receives the two-dimensional image transmitted from the transmission device according to claim 2,
The three-dimensional shape modeling data receiving apparatus according to any one of claims 4 to 6, wherein the creating unit attaches the two-dimensional image received by the receiving unit as a texture to the three-dimensional shape model. The data receiving apparatus for three-dimensional shape modeling according to any one of claims 4 to 7, wherein arbitrary information is added to the three-dimensional standard shape. The data transmitting apparatus for three-dimensional shape modeling according to claim 1,
The data receiving apparatus for three-dimensional shape modeling according to claim 4,
3D shape modeling system with The data transmitting apparatus for three-dimensional shape modeling according to claim 2,
The data receiving apparatus for three-dimensional shape modeling according to claim 5,
3D shape modeling system with The data transmitting apparatus for three-dimensional shape modeling according to claim 3,
The data receiving apparatus for three-dimensional shape modeling according to claim 7,
3D shape modeling system with   A three-dimensional shape modeling data transmission program for causing a computer to function as each means constituting the three-dimensional shape modeling data transmission device according to any one of claims 1 to 3.   A three-dimensional shape modeling data receiving program for causing a computer to function as each means constituting the three-dimensional shape modeling data receiving device according to any one of claims 4 to 8.