CN1833271B - Method and apparatus for improved rendering of projections - Google Patents

Abstract

A method of a computer system, comprising: -posing the 3D model (500) in a first configuration, -determining a first 2D (510) view of the 3D model (500) in the first configuration, -posing the 3D model (550) in a second configuration, -determining a second 2D (570) view of the 3D model in the second configuration, -associating the first 2D image with the first 2D view of the model, -associating the second 2D image (570) with the second 2D view of the model, -associating the first set of surface parameters with the 3D model surface visible in the first 2D view in response to the first 2D image and the first configuration of the 3D model, and-associating the second set of surface parameters with the 3D model surface visible in the second 2D view in response to the second 2D image and the second configuration of the 3D model.

Description

Improved method and device for drawing projections

technical field

The present invention relates to computer animation, and more particularly to an enhancement method and apparatus for specifying surface properties of animated objects.

Background technique

During these years, filmmakers often attempted to tell stories involving imaginary creatures, far-flung locations, and fantastical things. To do this, they often rely on animation techniques to "wake up" fictional creatures. The two main paths in animation generally include paint-based animation techniques and stop motion animation techniques.

Paint-based animation techniques were refined in the twentieth century by filmmakers such as Disney and used in films such as "Snow White and the Seven Dwarves" and "Fantasia" (1940) Movie. This animation technique usually requires the artist to hand-draw or paint the animated image onto a transparent medium or cell. After drawing, each cell can be captured or recorded onto film as one or more frames in a movie.

Stop-motion animation techniques often require constructed miniature sets, props, and characters. Filmmakers need to build sets, add props, and get miniature characters into poses. After the animator is all satisfied with the arrangement, one or more frames of the movie will assume that particular arrangement. The stop motion animation technique was developed by film makers such as Willis O'Brien in the film King Kong (1932). These techniques were subsequently refined by animators such as Ray Harryhausen on films including "The Mighty Joe Young" (1948) and "Clash of The Titans" (1981).

With the widespread availability of computers in the second half of the twentieth century, animators began to rely on computers to help with animation. This includes using a computer to facilitate paint-based animation, eg, by rendering images, by generating tweening, and the like. This also includes the use of computers to augment stop motion animation techniques. For example, a physical model can be represented and manipulated by a virtual model in computer memory.

的奥斯卡(Academy-

)奖项提名软件。One of the pioneering companies in the Computer Aided Animation (CAA) industry is Pixar, dba Pixar Animation Studios. Over the years, Pixar has developed and provided a computing platform specially designed for CAA, and

Oscar (Academy-

) award-nominated software.

Over the years, Pixar has also developed software products and software environments for internal use that allow users (modelers) to easily define object rigs (rigs) and users (animators) to easily animate object rigs. Based on this real world experience, the inventors of the present invention have determined that additional features can be provided to these products and environments to facilitate object definition and animation. One such feature includes methods and apparatus for facilitating the definition of surface properties of objects.

The inventors of the present invention have determined that there is a need for an improved method for specifying surface parameters of an object.

Contents of the invention

This invention relates to computer animation, and more particularly to methods and apparatus that enable a user to specify surface parameters for objects or parts of objects in different poses.

Various embodiments of the present invention are used to help manage the process of creating three-dimensional "paintings". Various embodiments control the definition of multiple poses, manage the rendering of views, provide mechanisms for transferring texture information to surface materials, provide texture and other data Classification and source control of files, etc.

Using various embodiments of the present invention, a user can use any conventional two-dimensional drawing program to effectively draw "directly" on three-dimensional objects. Using various embodiments, a user draws numerous two-dimensional paintings (eg, overlapping images) on different views of an object. A typical view is a camera with orientation "front", "back", etc. Using various embodiments of the present invention, a user can repose an object model in a variety of configurations if the model is difficult to fully render in a single reference pose. Additionally, a user may draw numerous overlapping images of views of a re-posed object.

A typical workflow for embodiments of the invention includes loading an object model into the system and posing the object model in different configurations. For example to draw a table, the user may have one pose that defines the table, and another pose that "explodes" the model by translating the table legs from the bottom of the table. The workflow can then include creating or defining one or more views that are drawn on the model in different poses.

In various embodiments, a rendering pass is performed on objects in different poses and defined views. The result of a rendering scan is typically a bitmap image of the rendered object, a view, and an associated depth map of the rendered surface. The workflow may also include the user loading the rendered bitmap into a 2D rendering program and rendering color, displacement, etc. in one or more passes.

Then, at render time, the system computes the result of planar projection (back mapping) of each object to each view in each pose and stores the resulting 2D coordinates for each visible surface point. The surface shader will use these stored 2D coordinates to estimate surface parameters such as 2D texture maps in each pass. The values returned by the scan calculation are then used to produce different effects in the filter, such as shading, or shifting the surface affected by the paint. In other embodiments, non-planar projections such as perspective projections are used.

In various embodiments, the depth map is evaluated during the planar projection phase to ensure that only the most distant surfaces associated with the projected view receive rendering. Additionally, surface normals are taken into account during projection to avoid projecting the paint onto surfaces that are perpendicular to or away from the projected view.

In various embodiments of the invention, the surface filter completes its computation after resolving all projection scans for each view and each pose of the object model. The resulting rendered object models are often posed in different poses than those described above.

In various embodiments, the rendered object model is typically rendered in a scene environment, and the rendered scene is stored in memory. The rendered scene is typically later retrieved from memory and displayed to the user. In various embodiments, the memory may be a hard drive, RAM, DVD-ROM, CD-ROM, film media, print media, or the like.

In accordance with the above, various embodiments of the present invention enable users to pose assembled three-dimensional object models in various configurations for receiving projective renderings from multiple views. These embodiments increase the efficiency and effectiveness of applying surface parameters such as multi-texture mapping, color, etc. to complex deformable three-dimensional object models.

Advantages of various embodiments of the invention include the ability to enable a user to model any three-dimensional object from multiple viewpoints and multiple pose configurations of the object. The concept of multiple pose configurations enables the user to paint in areas that cannot be directly accessed unless the model is deformed or broken into small pieces.

Various embodiments of the present invention introduce unique techniques for organizing multiple views/poses, and for applying the resulting texture maps back to objects. More specifically, embodiments use surface orientations (normals) and depth maps rendered from projected views to selectively control which surfaces receive rendering.

According to an aspect of the present invention, a method for use in a computer system is described. A method includes posing at least a portion of a three-dimensional object model in a first configuration, determining first and second values of at least a portion of the three-dimensional object model in the first configuration. a two-dimensional view, posing at least a portion of the three-dimensional object model in a second configuration, and determining a second two-dimensional view of at least a portion of the three-dimensional object model in the second configuration. Various techniques also include combining the first two-dimensional image with the object model's associating at least a portion of the first two-dimensional view, and associating a second two-dimensional image with a second two-dimensional view of a portion of the object model. The process may also include responding to the first two-dimensional image, responsive to the three-dimensional object model a first configuration of at least a portion, the first set of surface parameters is associated with a surface of at least a portion of the three-dimensional object model visible in the first two-dimensional view, and responsive to the second two-dimensional image, responsive to the three-dimensional object model A second configuration of at least a portion, associating a second set of surface parameters with a surface of at least a portion of the 3D object model visible in a second 2D view.

According to another aspect of the invention, a computer program product for a computer system comprising a processor is described. The computer program product includes: code directing a processor to receive a first configuration of at least a portion of a three-dimensional object; code directing the processor to determine a first two-dimensional image, wherein the first two-dimensional image exhibits at least a portion of the three-dimensional object in the first configuration A surface of a portion; code directing the processor to receive a second configuration of at least a portion of the three-dimensional object; code directing the processor to determine a second two-dimensional image showing at least a portion of the three-dimensional object in the second configuration of a surface. The additional computer code may include: code directing the processor to receive a first two-dimensional rendered image, wherein the first two-dimensional rendered image is associated with the first two-dimensional image; code directing the processor to receive a second two-dimensional rendered image, wherein A second two-dimensional rendered image is associated with the second two-dimensional image. The code may also include: code directing the processor to determine a first set of parameters in response to the first two-dimensional rendered image, wherein the first set of parameters is associated with a surface of at least a portion of the three-dimensional object in the first configuration; and directing the processor A code for a second set of parameters associated with a surface of at least a portion of the three-dimensional object in the second configuration is determined in response to the second two-dimensional rendered image. Each code may comprise machine-readable or human-readable code on a tangible medium. Typical media include magnetic disks, optical disks, and the like.

According to yet another aspect of the present invention, a computer system is described. The computer system typically includes a display, memory and a processor. In a computer system, the memory is configured to store a model of a three-dimensional object, a first pose and a second pose of the three-dimensional object, a first two-dimensional image and a second two-dimensional image, and an image associated with a surface of the three-dimensional object Surface filter parameters. In the computer system, the processor is typically configured to output to the display a first view of the three-dimensional object in a first pose, to output to the display a second view of the three-dimensional object in a second pose, and to receive A first two-dimensional image and a second two-dimensional image are received. The processor may also be configured to determine a first set of surface parameters associated with respective surfaces of the three-dimensional object responsive to the first view of the three-dimensional image, responsive to the first two-dimensional image, and configured to respond to the first view of the three-dimensional image A second view, responsive to the second two-dimensional image, determines a second set of surface parameters associated with respective other surfaces of the three-dimensional object.

Description of drawings

For a more complete understanding of the invention, reference is made to the accompanying drawings. With the understanding that these drawings are not to be considered as limiting the scope of the invention, the presently described embodiments and what is presently considered the best mode of the invention will be described in more detail by use of the accompanying drawings, in which :

Figure 1 shows a block diagram of a system according to an embodiment of the present invention;

Figure 2 shows a block diagram of an embodiment of the present invention;

3A-B illustrate a process according to an embodiment of the present invention;

Figure 4 shows an example of an embodiment;

5A-C illustrate an example of an embodiment of the present invention;

6A-D illustrate another example of an embodiment of the present invention;

7A-C show yet another example of an embodiment of the present invention.

Detailed ways

In the following patent disclosure, the following terms are used:

Gprim (geometric element): A single 3D surface defined by a parametric function (Bspline) by organizing a collection of 3D points in an arbitrary number of surfaces (polygons) etc.

Model (Object Model): A collection of Gprims organized in any number of surfaces (polygon meshes and subdivided surfaces), implied surfaces, etc. The system does not require 2D surface parameterization to perform its operation.

View: An orthographic or perspective camera that produces an image of a model from a specific viewpoint.

Pose: The state of a model according to a specific rigid deformation in its hierarchy and a specific configuration of its Gprim. A pose also describes one or more views.

Pose typically includes the position and orientation of the model and the full view camera. In various embodiments of the invention, a pose specifies a particular configuration or orientation of one or more objects in the object model. For example, a pose may specify that two objects are a certain distance apart, or that two objects be at a certain angle from each other, and so on. Examples of different poses of objects are illustrated below.

Whenever a character is in position, its position is usually saved as a named pose so that it can be later referenced by the system and the user. The user saves the new pose after repositioning the model and establishing a new camera view. The drawing (overlay image) created in a particular view is closely related to the position and orientation of that camera.

Scan: The type of rendering, such as Color and Displacement, and the number of color channels to use in this scan. The name provides the handle with which to refer to a series of plots within the filter. Usually these names are arbitrary.

FIG. 1 is a block diagram of a typical computer system 100 according to one embodiment of the invention.

In this embodiment, the computer system 100 generally includes a monitor 110, a computer 120, a keyboard 130, a user input device 140, a network interface 150, and the like.

In this embodiment, user input devices 140 typically include computer mice, trackballs, trackpads, wireless remote controls, drawing tablets, integrated displays and tablets (such as Wacom's Cintiq), voice command systems, eye tracking systems, etc. . User input mouse 140 generally enables a user to select objects, icons, text, etc. that appear on monitor 110 .

Various embodiments of network interface 150 typically include Ethernet cards, modems (telephone, satellite, cable, ISDN), (asynchronous) Digital Subscriber Line (DSL) units, and the like. Network interface 150 is typically coupled to the computer network shown. In other embodiments, network interface 150 may be physically integrated on the motherboard of computer 120, may be a software program such as soft DSL, or the like.

Computer 120 typically includes familiar computer components such as a processor 160, a memory storage device such as random access memory (RAM) 170, a disk drive 180 and a system bus 190 interconnecting the above components.

In one embodiment, computer 120 is a PC compatible computer having one or more microprocessors, such as PentiumIV ^™ or Xeon ^™ microprocessors from Intel Corporation. Furthermore, in this embodiment, the computer 120 includes a Linux-based operating system.

RAM 170 and disk drive 180 are for storing data, hard disk/video files, computer programs, scene descriptor files, object data files, overlay images, depth maps, filter descriptors, rendering engines, filtering engines, output images Tangible media for files, texture maps, displacement maps, drawing environments, object creation environments, animation environments, surface filtering environments, asset management systems, databases and database management systems, etc. Other types of tangible media include floppy disks, removable hard disks, such as Optical storage media of CD-ROM, DVD, barcode, semiconductor memory such as flash memory, read-only memory (ROM), battery-backed volatile memory, networked storage devices, etc.

In this embodiment, the computer system 100 may also include software that enables communication over a network such as HTTP, TCP/IP, RTP/RTSP protocols, and the like. In various embodiments of the present invention, other communication software and transport protocols, such as IPX, UDP, etc., may also be used.

等、来自Sun Microsystems的Solaris、来自Apple ComputerCorporation的Linux、Unix、Mac OS等。Figure 1 illustrates a computer rendering system capable of embodying the present invention. It will be apparent to those skilled in the art that many other hardware and software configurations are suitable for use with the present invention, for example, the computer may be in a desktop, portable, stand-mounted, or tablet configuration. Additionally, other microprocessors are contemplated, such as Pentium ^™ or Itanium ^™ microprocessors; Opteron ^™ or AthlonXP ^™ microprocessors from Advanced Micro Devices Inc.; PowerPC G4 ^™ , G5 ^™ microprocessors from Motorola Inc. wait. Additionally, other types of operating systems are contemplated, such as the operating system, such as Windows Windows

etc., Solaris from Sun Microsystems, Linux, Unix, Mac OS from Apple Computer Corporation, etc.

Figure 2 shows a block diagram of an embodiment of the invention. Specifically, FIG. 2 shows animation environment 200 , object creation environment 210 , and storage system 220 .

In the present embodiment, the object creation environment 210 is to enable a user (modeller) to specify an object connection model including a skeleton and a rig. Within this environment, the user can create models of objects (manually, procedurally) and specify how these objects are connected to animation variables (Avars). In a particular embodiment, object creation environment 210 is a Pixar-specific object creation environment called "Gepetto." In other embodiments, other types of objects may be used to create environments.

In this embodiment, the object creation environment 210 can also be used by the user (filter) to specify the surface parameters of the object model. As described below, environments may be provided within the object creation environment 210 or independently, enabling a user to assign parameters to various surfaces of an object model by drawing. In various embodiments, surface parameters include color data, texture map data, displacement data, and the like. These surface parameters are often used to render objects in the scene.

In various embodiments of the invention, the environment enables the user to define the pose of the object model. Furthermore, it enables the user to present views of the object model in different poses. The environment also provides mechanisms to perform planar mapping (where depth maps and surface normals may be used) to a "reference" pose, also known as Pref, when filtering and rendering standard object configurations, and maintain different views, different poses, different Correlation of plotted data, different surface parameter data, etc., as described below.

In this embodiment, the object model created with the object creation environment 210 can also be applied to the animation environment 200 . Typically, object models are built hierarchically. The hierarchical nature for building object models is useful because different users (modelers) are often assigned the task of creating different models. For example, one modeler is assigned the task of creating the hand model 290, another modeler is assigned the task of creating the forearm model 280, and so on.

In this embodiment, the animation environment 200 is an environment that enables a user (animator) to manipulate an object connection model through animation variables (Avars). In one embodiment, animation environment 200 is a Pixar-specific animation environment called "MenV," although in other environments other animation environments are suitable. In this embodiment, animation environment 200 enables an animator to manipulate Avars provided in an object model (generic rig) and to move objects, ie, animate objects, with respect to time.

In other embodiments of the invention, animation environment 200 and object creation environment 210 may be combined into a single integrated environment.

In FIG. 2, storage system 220 may include any organized and repeatable method of accessing object connection models. For example, in one embodiment, storage system 220 includes a simple flat directory structure on a local drive or a network drive; in others In an embodiment, the storage system 220 may be an asset management system or a database access system connected to a database, etc. In an embodiment, the storage system 220 receives references to object models from the animation environment 200 and the object creation environment 210. In return , the storage system 220 provides object models stored therein. The storage system 220 typically also stores planar filtering parameters, overlay images, depth maps, etc. discussed herein.

Previously, Pixar's object creation environment allowed users to paint and project images (textures) from multiple views onto object models in specific configurations (poses). However, the inventors of the present invention understand that object creation environments do not support object views in different poses, and that applying textures to complex three-dimensional models in a single pose is difficult.

3A-B illustrate a flow according to an embodiment of the present invention. Initially, at step 300 a three-dimensional object model is provided. Typically, one or more users (object modelers) specify a geometric representation of one or more objects through an object creation environment. At the same time, these objects are combined to form models of larger objects. In this embodiment, the modeler can use objects such as Gepetto to create the environment.

Then, in this embodiment, other users specify how the surface of the object should appear. For example, these user (filters) specify any number of surface effects for objects, such as base color, scratches, dust, displacement mapping, roughness and glossiness mapping, transparency, and control over material types. To this end, the user obtains a three-dimensional object model and specifies an initial pose at step 310 . In other embodiments, this step does not need to be performed specifically, since the objects all have a default pose. For example, an object model for a character such as a car may have a default pose with its doors closed. At the same time, the user typically specifies one or more view camera positions. In other embodiments, numerous default cameras may be used for each object. For example, in various embodiments, the commonly designated projected views include: top view, left view, right view, bottom view, and the like. Also, the camera may be an oblique view or the like. Projected views can be planar, but they can also be non-planar and perspective. As an example, perspective projection is contemplated, where a curved projector maps an image onto a curved surface.

Then, in this embodiment, the computer system presents a 2D view of the 3D object in a first pose at step 320 . More specifically, the system renders each view by using the object model, pose, and view camera data. In various embodiments, the rendering scan may be a high quality rendering by a rendering program such as Pixar's Renderman product. In other embodiments, the rendering/filtering process may be performed with low-quality rendering processes such as GL and GPU hardware and software renderers.

In various embodiments, each rendered view may be stored as multiple separate view image files, or combined into one larger file. Along with each rendered view, a depth map is also produced, using the planar projection function described below.

In this embodiment, the system displays one or more rendered views of the object at step 330 . In various embodiments of the invention, this step is performed within a user environment that allows the user to graphically assign pixel values to a two-dimensional graphic. Typically, these environments are said to include "drawing" functionality. In one embodiment, one or more views may be displayed to the user at the same time.

Then, in various embodiments, the user assigns pixel values in step 340 to the object view. In one embodiment, the user performs this action by drawing "over" the object view. The painting is similar to sub-painting or coloring an image with a coloring book. For example, the user applies different brushes to the view of the object using overlays, etc. A mechanism similar to "layers" is contemplated here. In this embodiment, different brushes may have one or more grayscale values, one or more colors, and the like.

As an example, a user can use a thin black paintbrush to paint a crack-like pattern in an overlay of a view. In another example, a user can use a spray-paint type brush to darken a selected portion of an overlay of a view. In In yet another example, a user may use a brush to color an overlay of a view. In other embodiments, other methods of specifying an overlay image are also contemplated, such as adding one or more shades of gray to the image, applying limited overlay Handling of specific parts of layer images (e.g. selections), including one or more images in overlapping layer images (e.g. decal layers), etc.

In this embodiment, the overlapping layer images for each view are stored at step 350 . In various examples, overlay images are stored from the 2D view to separate and identifiable files. In other embodiments, overlapping layer images are stored in one layer of the two-dimensional view. In various embodiments, the file including the overlay image is also associated with the pose defined in step 310 , and the depth map determined in steps 320 , 360 .

In this embodiment, the user may determine to repose the three-dimensional object in the second pose at step 370 . Then repeat the above process. In various embodiments, the process of reposing the three-dimensional object, creating one or more views, and drawing a depth map on the views may be repeated for as many poses as the user deems necessary. As an example, for a character object, one pose could be with the character's mouth open and arms up, while another pose could be with the character's mouth closed and arms down. As another example, for a folding table, one posture is that the folding table is open, and another posture is that the legs of the folding table are "disintegrated" or separated from the table top.

In some embodiments of the invention, a user may simultaneously see views derived from different poses of a three-dimensional object on the screen. Therefore, the viewing and drawing process described above need not be performed on the basis of only one pose of the object at a time. Furthermore, the user can draw from different poses on the object view during the same time period. For example, for a character posing with its mouth open, the user can paint white on a layer on the view showing the character's mouth, then the user can paint black on a layer on the view showing the character's hair, and then the user can paint on the view showing the character's hair. Repaint a different shade of white on a layer above the view of the character's mouth.

In this embodiment, the next step is to reassociate the values drawn on each view of the three-dimensional object in the first pose at step 380 to the object. More specifically, each view of the object is typically a two-dimensional projection of various surfaces of the three-dimensional object in the first pose. Accordingly, the various parts that appear to be "rendered on" by the overlay image are projected back into a three-dimensional object using an associated depth map. This functionality is enabled because the system maintains links between overlapping images, views and poses of 3D objects. In the case of multiple rendered views, the drawing for each rendered view is projected back into a three-dimensional object in the first pose.

In various embodiments of the present invention, surface normals may be used to "feather" the effect of projection onto various surfaces of a three-dimensional object. For example, for a surface parallel to a parallel view, the rendering effect can be calculated as ~100%; for a surface at a 30° angle to the projected view, the rendering effect can be calculated as ~50% (sin(30)); for a surface with Surfaces projected at an angle of 60°, the rendering effect can be calculated to be ~13% (sin(60)) and so on. The amount of feathering can be adjusted by the user. In other embodiments, feathering may be used to change the paint effect on transition areas, such as the edges or borders of objects, and the like. In various embodiments, the feathering of the projected rendering reduces blurring of the projected rendering.

Figure 4 shows an example of an embodiment. In this example, three-dimensional cylinder 500 appears as rectangle 510 in two-dimensional view 520 of cylinder 500 . According to the above process, the user draws an overlay image 530 on the view 520 . In this example, the user has painted the bottom half of the cylinder 500 black.

Then, as shown in Figure 4, the overlapping images are projected into a three-dimensional cylinder, correspondingly, the model of the front lower surface 540 of the cylinder 500 is associated with attributes or black, and feathered to the surface normal points that are not on the viewing plane . The rear lower surface 550 of cylinder 500 is not associated with black because it is not shown in view 520 .

In this example, rear view 560 and bottom view 570 of cylinder 500 may be designated to reveal the remaining lower half surface of cylinder 500 .

Referring again to FIG. 3, the next step is to reassociate the values drawn on each view of the three-dimensional object in the second pose at step 390 to the object. Similarly, each view of the object is typically a three-dimensional The projection of the various surfaces of the object into two dimensions. Accordingly, the various parts that appear to be "painted on" by the overlapping images are projected as three-dimensional objects using the associated depth maps. Again, in the case of multiple rendering views , the drawing for each rendered view is projected back into a 3D object in the second pose.

In this embodiment, the planar projections of steps 380 and 390 are combined at step 400 and projected back to the surface of the three-dimensional object. In other words, the user can paint based on rendered views of the three-dimensional object in different poses, and have the paint data projected back into a single three-dimensional object in a neutral pose.

The inventors of the present invention believe that the above functionality is important because it enables users to "draw" hard-to-reach parts of three-dimensional objects by allowing them to repose the three-dimensional object and allow the user to draw based on the resulting rendered view. As an example, one pose could be a character with the mouth closed, while another pose has the mouth open. In addition, usage examples of each embodiment of the present invention will be shown below.

In various embodiments of the present invention, step 400 may be performed before the formal presentation of the three-dimensional object. In other embodiments, step 400 occurs dynamically during the formal rendering process. For example, data from steps 380 and 390 may be saved in separate files. The system then dynamically combines the planar projection data from the 3D object in the first pose with the planar projection data from the 3D object in the second pose when the object is to be rendered in high quality (with eg Pixar's Renderman).

Then at step 410, the combined planar projection data is used to render the three-dimensional object, generally in a third pose. As an example, a first pose could be a character with both arms down, a second pose could be a character with both arms up, and a third pose could be a character with only one arm up.

In various embodiments of the invention, rendering data may specify any number of attributes of the object's surface. These data may also be referred to as filter scan data. For a typical object surface, there are over a hundred scans. For example, paint data may specify surface color, application of texture mapping, application of displacement mapping, and the like. In various embodiments of the invention, the planar projections from steps 380 and 390 may apply the same attributes or different attributes to the surface of the object. For example, step 380 may be a surface "crack" scan, while step 390 may be a surface color scan.

In various embodiments, objects simultaneously appear as other objects in the scene. The rendered scene is typically another two-dimensional image stored at step 420 . In various embodiments of the invention, the rendered scene may be stored in an optical form such as film, an optical disc (e.g., CD-ROM, DVD), etc.; in a magnetic form such as a hard disk, network drive, etc.; etc. in electronic form. In step 430, the resulting representation of the rendered scene may later be retrieved and displayed to one or more viewers.

Figures 5A-C illustrate an example of an embodiment of the present invention. Specifically, FIG. 5A shows a three-dimensional model of case 600 in a closed pose. In FIG. 5B , a number of two-dimensional views of case 600 are shown, including front view 610 , top view 620 , and side view 630 .

In FIG. 5C, the user creates overlay images 640-660 on views 610-630, respectively. As described above, the user typically draws on views 610-630 to create overlay images 640-660. FIG. 5D shows the three-dimensional model of box 670 in the closed pose after overlapping images 640-660 are projected back into the three-dimensional model of box 600 in the closed pose.

6A-D illustrate another example of an embodiment of the present invention. Specifically, FIG. 6A shows a three-dimensional model of case 700 in an open pose. In FIG. 6B , a two-dimensional view of case 700 is shown, including a top view 710 , a first cross-section 720 and a second cross-section 730 .

In FIG. 6C, the user creates overlay images 740-760 on views 710-730, respectively. Again, the user typically draws on top of the corresponding views to create overlapping images. FIG. 6D shows the three-dimensional model of case 770 in the open pose after overlapping images 740-760 are projected back to the three-dimensional model of case 700 in the open pose.

In this embodiment, the three-dimensional models of box 670 and box 770 are combined into a single three-dimensional model. Shown in FIG. 6E is a single three-dimensional model of a box 780 including projection return data from FIGS. 5C and 6C. As shown in FIG. 6E, the three-dimensional model may be posed in a different pose than that of FIG. 5A or FIG. 6A.

7A-C illustrate another example of an embodiment of the present invention. More specifically, FIG. 7A shows a three-dimensional model of stool 800 in a default pose. In FIG. 7B, a number of views 810 of stool 800 in a default pose are shown. In this example, the user may draw based on view 810 as described above. FIG. 7C then shows the three-dimensional model of stool 820 in a second pose. As can be seen, the legs 830 of the stool can "break down" or separate from the sitting surface. A number of views 840 are shown. In this example, it can be seen that using view 840 the user can more easily draw the sitting surface 850 and the bottom of the legs 860 of the stool.

Many changes or modifications are contemplated. Those skilled in the art will appreciate, in light of the above disclosure, that the concepts described above may be applied in any number of contexts. For example, drawing functions can be fully provided to object creation environment, separation filter environment, third-party drawing programs (such as Photoshop, Maya, SoftImage), etc. The embodiments described above use planar projection techniques to form object views and project overlapping layers back into three-dimensional objects. Other embodiments may also use non-planar projection techniques to form stereoscopic images of objects and project them back into three-dimensional objects.

In other embodiments of the invention, the process of rendering in overlapping layers and performing the projection of the planes back into a three-dimensional object may be performed in real-time or near real-time for multiple poses of the object. For example, the user may be presented with a first view of the object in a first pose, and a first view of the object in a second pose. The user then draws an overlay of that first view. In this embodiment, a planar projection process that projects the drawing back to a three-dimensional object occurs as the user draws. The system then re-renders the first view of the object in the first pose, and the second view of the object in the second pose, in real time or near real time. In these embodiments, the user can see the specified effect of the surface parameters in one pose, and on the object in all other poses (views of the other poses) because the process proceeds extremely quickly.

Various methods for drawing on the surface are contemplated in various embodiments of the invention, such as brushes, textures, gradients, filters, and the like. In addition, various methods for storing rendering images (eg, layers) are also contemplated.

The above embodiments disclose a method for a computer system capable of performing the disclosed method. Other embodiments include a computer program product on a tangible medium, including software codes, etc., that enable a computer system to perform the disclosed methods.

Other embodiments will be envisioned to those skilled in the art after reading this specification. In other embodiments, combinations or sub-combinations of the inventions disclosed above may be advantageously made. The block diagrams of the architecture and flowcharts are grouped for ease of understanding. However, it should be understood that combinations of blocks, addition of new blocks, rearrangement of blocks, etc. are contemplated in other embodiments of the invention.

Accordingly, the specification and drawings are to be regarded as illustrative rather than restrictive. It will, however, be evident that various modifications and changes can be made without departing from the broader spirit and scope of the invention as set forth in the claims.

Claims (21)

1. the method for a computer system comprises:

At least a portion of three dimensional object model is posed with first configuration;

Determine first two dimension view of at least a portion of three dimensional object model described in first configuration;

The part of three dimensional object model is posed with second configuration;

Determine second two dimension view of a three dimensional object model part in second configuration;

Make first two dimensional image be associated with first two dimension view of at least a portion of object model;

Make second two dimensional image be associated with second two dimension view of the part of object model;

In response to first two dimensional image and in response to first configuration of at least a portion of three dimensional object model, make the first surface parameter set be associated with the surface of visible three dimensional object model at least a portion in first two dimension view; And

In response to second two dimensional image and in response to second configuration of the part of three dimensional object model, make the second surface parameter set be associated with the surface of a visible three dimensional object model part in second two dimension view.

2. the method for claim 1 is characterized in that, first two dimension view of a described three dimensional object model part is selected from following group: front view, side view, vertical view, upward view.

3. as arbitrary the described method of claim 1-2, it is characterized in that,

The part of described three dimensional object model comprises first object and second object;

First configuration of at least a portion of described three dimensional object model comprises first object and second object with primary importance and direction relations;

Second configuration of the part of described three dimensional object model comprises first object and second object with the second place and direction relations; And

Described primary importance and direction relations and the second place and direction relations are inequality.

4. method as claimed in claim 3 is characterized in that, described primary importance and direction relations and the second place and direction relations are selected from following state:

First object and second object be specific range apart,

First object and second object have special angle each other.

5. as the arbitrary described method of claim 1-2, also comprise:

First two dimension view of at least a portion of display object model on display; And

By on first two dimension view of at least a portion of the object model on the display, drawing, create first two dimensional image.

6. as arbitrary the described method of claim 1-2, it is characterized in that the first surface parameter set is selected from following combination: surface color and polish, appearance, displacement mapping, texture.

7. as arbitrary the described method of claim 1-2, also comprise:

Present the first surface parameter set and the second surface parameter set of object in response to formation, present the part of three dimensional object model; And

The expression of object is stored in the medium with presenting.

8. one kind is used for the equipment that 3-D view is controlled, and comprising:

Be used to receive the device of first configuration of at least a portion of three dimensional object;

Be used for determining the device of first two dimensional image, wherein said first two dimensional image represents the surface of at least a portion of three dimensional object in first configuration;

Be used to receive the device of second configuration of at least a portion of three dimensional object;

Be used for determining the device of second two dimensional image, wherein said second two dimensional image represents the surface of at least a portion of three dimensional object in second configuration;

Be used to receive the device of the first two-dimentional drawing image, the wherein said first two-dimentional drawing image is associated with first two dimensional image;

Be used to receive the device of the second two-dimentional drawing image, the wherein said second two-dimentional drawing image is associated with second two dimensional image;

Be used for determining the device of first group of parameter, the surface of wherein said first group of parameter association at least a portion of three dimensional object in first configuration in response to the first two-dimentional drawing image; And

Be used for determining the device of second group of parameter, the surface of wherein said second group of parameter association at least a portion of three dimensional object in second configuration in response to the second two-dimentional drawing image.

9. equipment as claimed in claim 8 is characterized in that, described first two dimensional image comprises the image of the view of selecting of at least a portion of three dimensional object in first configuration from following combination: front view, side view, vertical view, upward view, oblique view.

10. as arbitrary the described equipment of claim 8-9, also comprise: the device that is used to make up at least a portion of at least a portion of first group of parameter and second group of parameter.

11. arbitrary described equipment as claim 8-9 is characterized in that,

Be used for determining the device of the 3rd two dimensional image, wherein said the 3rd two dimensional image represents other surface of at least a portion of three dimensional object in first configuration;

Be used to receive the device of the 3rd two-dimentional drawing image, the wherein said the 3rd two-dimentional drawing image is associated with the 3rd two dimensional image; And

Be used for determining the device of the 3rd group of parameter, wherein other surface of the 3rd group of parameter association at least a portion of three dimensional object in first configuration in response to the 3rd two-dimentional drawing image;

Other surface of at least a portion of three dimensional object was overlapping during wherein the surface and first of at least a portion of three dimensional object disposed in first configuration.

12. arbitrary described equipment as claim 8-9 is characterized in that,

The part of described three dimensional object model comprises first object and second object;

Described first configuration comprises having first object and direction is second object of first angle;

Described second configuration comprises having first object and direction is second object of second angle; And

Described first angle and second angle are inequality.

13. arbitrary described equipment as claim 8-9 is characterized in that, first parameter set and second parameter set do not have alternatively to be selected from following combination: surface color and polish, appearance, displacement mapping, texture.

14. arbitrary described equipment as claim 8-9 also comprises:

Be used for determining the device of the 4th two dimensional image, wherein said the 4th two dimensional image represents other surface of at least a portion of three dimensional object in second configuration;

Be used to receive the device of the 4th two-dimentional drawing image, the wherein said the 4th two-dimentional drawing image is associated with the 4th two dimensional image; And

Be used for determining the device of the 4th group of parameter, wherein other surface of the 4th group of parameter association at least a portion of three dimensional object in the 4th configuration in response to the 4th two-dimentional drawing image; And

Be used to make up the device of first group of parameter and the 4th group of parameter.

15. a computer system comprises:

Display;

Storer, be configured to store the model of three dimensional object, wherein said storer is configured to store the prime and the second of described three dimensional object, wherein said storer also is configured to store first two dimensional image and second two dimensional image, and wherein said storer is configured to store the surface optical filtering parameter on the surface that is associated with described three dimensional object; And

With described storer and described display-coupled processor, wherein said processor is configured to first view of three dimensional object in display output prime, wherein said processor is configured to second view of three dimensional object in display output second, wherein said processor is configured to receive first two dimensional image and receives second two dimensional image, wherein said processor is configured to determine to be associated with the first surface parameter set on first group of surface of three dimensional object in response to first view of three dimensional object and in response to first two dimensional image, and wherein said processor is configured in response to second view of three dimensional object and determines to be associated with the second surface parameter set on second group of surface of three dimensional object in response to second two dimensional image.

16. computer system as claimed in claim 15 is characterized in that, first view of described three dimensional object is selected from following combination: front view, side view, vertical view, upward view, oblique view.

17. arbitrary described computer system as claim 15-16 is characterized in that,

Described three dimensional object model comprises first object and second object;

Described prime comprises first object that is positioned at primary importance and direction with respect to second object;

Described second comprises first object that is positioned at the second place and direction with respect to second object; And

Wherein said primary importance and direction and the second place and direction are selected from following state:

First object and second object be specific range apart,

First object and second object have special angle each other.

18. arbitrary described computer system as claim 15-16 is characterized in that, first group of second group of surface surperficial and three dimensional object of three dimensional object is different surfaces.

19. arbitrary described computer system as claim 15-16 is characterized in that the first surface parameter set is selected from following combination: surface color and polish, appearance, displacement mapping, texture.

20. arbitrary described computer system as claim 15-16 is characterized in that,

Described processor also is configured in response to first surface parameter set and the second surface parameter set three dimensional object that filters, with form three dimensional object through the expression that filters; And

Described storer also is configured to store the optical filtering of described three dimensional object and represents.

21. arbitrary described computer system as claim 15-16 is characterized in that,

First view of three dimensional object comprises front view in the prime; And

Second view of three dimensional object also comprises front view in the second.

Images