CN103677828B - Coverage drawing method, drawing engine and terminal equipment - Google Patents

Abstract

Embodiments of the present invention relate to computer technology. An embodiment of the present invention provides a layer drawing method, a drawing engine, and a terminal device. The method includes: receiving a drawing instruction; receiving post-processing information, and determining pre-processing information according to the post-processing information, and the post-processing information is used to represent Perform coordinate transformation processing on the layer to be drawn; perform coordinate transformation processing on the vertices of the primitive corresponding to the primitive information contained in the drawing instruction based on the vertex transformation information in the drawing instruction, and obtain the vertex transformation of the primitive Intermediate results; based on the preprocessing information, coordinate transformation processing is performed on the intermediate results of the vertex transformation of the primitives again to obtain the final results of the vertex transformations of the primitives; then rasterization and fragment coloring are performed to obtain the graph to be drawn layer. This solution is to perform coordinate transformation processing on the intermediate result of vertex transformation obtained after vertex transformation, thereby reducing the cost of special effect processing on the layer.

Description

Layer drawing method, drawing engine and terminal equipment

technical field

The invention relates to computer technology, in particular to a layer drawing method, a drawing engine and a terminal device.

Background technique

The current application of the Android system mainly uses OpenGL drawing. OpenGL (Open Graphic Library) is an open graphics hardware standard, which provides a series of application programming interfaces (API, Application Programming Interface) for developers to use. Under the OpenGL hardware standard, when processing the layer to be drawn that involves coordinate transformation, it is necessary to first draw the layer, and then perform the processing that involves coordinate transformation on the layer, such as rotation processing and/or scaling processing, etc. , since the drawn layer contains a large number of pixels, the amount of data to be processed is relatively large when processing the layer involving coordinate transformation, and the cost of image special effect processing is relatively large.

Contents of the invention

Embodiments of the present invention provide a layer drawing method, a drawing engine and a terminal device, which are used to reduce the processing cost of image special effects involving coordinate transformation.

In the first aspect, an embodiment of the present invention provides a layer drawing method, the method includes: receiving a drawing instruction, the drawing instruction includes primitive information, vertex transformation information, and fragment coloring information; receiving post-processing information, according to the The post-processing information determines the pre-processing information, and the post-processing information is used to represent the coordinate transformation processing of the layer to be drawn; based on the vertex transformation information in the drawing instruction, the coordinates of the vertices of the primitive corresponding to the primitive information are transformation processing, to obtain the intermediate result of the vertex transformation of the primitive; based on the preprocessing information, perform coordinate transformation processing again on the intermediate result of the vertex transformation of the primitive, to obtain the final result of the vertex transformation of the primitive; Perform rasterization processing on the final vertex transformation result of the primitive to obtain the rasterization processing result of the primitive; perform fragment shading processing on the rasterization processing result of the primitive based on the fragment shading information in the drawing instruction to obtain the rasterization processing result of the primitive The fragment shading processing result of the primitive; performing pixel filling within the display range of the layer to be drawn according to the fragment shading processing result of the primitive to obtain the layer to be drawn.

With reference to the first aspect, in a first implementation manner, the receiving post-processing information and determining pre-processing information according to the post-processing information include: receiving post-processing information, the post-processing information including rotation parameters; according to the The rotation parameters included in the post-processing information determine a rotation matrix, and the rotation matrix represents the pre-processing information; based on the pre-processing information, the intermediate result of the vertex transformation of the primitive is subjected to coordinate transformation processing again to obtain the The final result of the vertex transformation of the primitive includes: performing coordinate transformation again on the first vertex coordinate representing the intermediate result of the vertex transformation of the primitive based on the rotation matrix, and obtaining the first vertex coordinate representing the final result of the vertex transformation of the primitive. Two vertex coordinates, the primitive represented by the second vertex coordinate has a rotation effect relative to the primitive represented by the first vertex coordinate.

With reference to the first aspect, in a second implementation manner, the receiving post-processing information and determining pre-processing information according to the post-processing information include: receiving post-processing information, the post-processing information includes scaling parameters; according to the The scaling parameters included in the post-processing information determine a scaling matrix, and the scaling matrix represents the pre-processing information; based on the pre-processing information, the intermediate result of the vertex transformation of the primitive is subjected to coordinate transformation processing again to obtain the The final result of the vertex transformation of the primitive includes: performing coordinate transformation processing on the first vertex coordinate representing the intermediate result of the vertex transformation of the primitive based on the scaling matrix, and obtaining the first vertex coordinate representing the final result of the vertex transformation of the primitive. Three vertex coordinates, the primitive represented by the third vertex coordinate has a zoom effect relative to the primitive represented by the first vertex coordinate.

With reference to the first aspect, in a third implementation manner, the receiving post-processing information and determining pre-processing information according to the post-processing information include: receiving post-processing information, the post-processing information including rotation parameters and scaling parameters; Determine a rotation matrix according to the rotation parameters included in the post-processing information; determine a scaling matrix according to the scaling parameters included in the post-processing information; multiply the rotation matrix and the scaling matrix to obtain a pre-processing matrix, the pre-processing matrix The processing matrix represents the preprocessing information; the coordinate transformation process is performed on the intermediate result of the vertex transformation of the primitive based on the preprocessing information to obtain the final result of the vertex transformation of the primitive, including: based on the preprocessing information The processing matrix performs coordinate transformation processing on the first vertex coordinate representing the intermediate result of the vertex transformation of the primitive, and obtains the fourth vertex coordinate representing the final result of the vertex transformation of the primitive, and the graph represented by the fourth vertex coordinate The element has the effect of rotation and scaling relative to the primitive represented by the first vertex coordinates.

With reference to the first implementation manner of the first aspect, in the fourth implementation manner, after receiving the post-processing information, the post-processing information includes a rotation parameter, the method further includes: When the rotation angle is 90 or 270 degrees, the width attribute parameter and the height attribute parameter of the layer to be drawn are adjusted based on the rotation parameter, so that the adjusted width attribute and height attribute are consistent with the layer to be drawn The display range of the primitive is matched; the first vertex coordinate representing the intermediate result of the vertex transformation of the primitive is subjected to coordinate transformation processing again based on the rotation matrix, and the second coordinate transformation representing the final result of the vertex transformation of the primitive is obtained. After the vertex coordinates, it also includes: according to the adjusted width attribute and height attribute, clipping the second vertex coordinates representing the final result of the vertex transformation of the primitive to obtain the clipped second vertex coordinates; Performing rasterization processing on the final vertex transformation result of the primitive to obtain the rasterization processing result of the primitive, including: performing rasterization processing on the clipped second vertex coordinates to obtain the rasterization processing result of the primitive. .

With reference to the second implementation manner of the first aspect, in a fifth implementation manner, after receiving the post-processing information, the post-processing information includes scaling parameters, the method further includes: Adjust the width attribute parameter and height attribute parameter of the layer to be drawn, so that the adjusted width attribute and height attribute match the display range of the layer to be drawn; in the representation based on the scaling matrix The first vertex coordinate of the intermediate result of the vertex transformation of the graphics primitive is subjected to coordinate transformation processing again, and after obtaining the third vertex coordinate representing the final result of the vertex transformation of the primitive, it also includes: according to the adjusted width attribute and height attribute , clipping the coordinates of the third vertex representing the final result of the vertex transformation of the primitive to obtain the coordinates of the third vertex after clipping; performing rasterization processing on the final result of the transformation of the vertex of the primitive to obtain the graph The rasterization processing result of the primitive includes: performing rasterization processing on the clipped third vertex coordinates to obtain the rasterization processing result of the primitive.

With reference to the third implementation manner of the first aspect, in the sixth implementation manner, after receiving the post-processing information, the post-processing information includes a rotation parameter and a scaling parameter, the method further includes: based on the scaling parameter and the rotation parameter adjust the width attribute parameter and the height attribute parameter of the layer to be drawn, so that the adjusted width attribute and height attribute match the display range of the layer to be drawn; After performing coordinate transformation processing on the first vertex coordinate representing the intermediate result of the vertex transformation of the primitive based on the preprocessing matrix, and obtaining the fourth vertex coordinate representing the final result of the vertex transformation of the primitive, it also includes: According to the adjusted width attribute and height attribute, the fourth vertex coordinate representing the final result of the vertex transformation of the primitive is clipped to obtain the clipped fourth vertex coordinate; the final result of the vertex transformation of the primitive is obtained. Performing rasterization processing to obtain a rasterization processing result of the primitive includes: performing rasterization processing on the clipped fourth vertex coordinates to obtain a rasterization processing result of the primitive.

In a second aspect, an embodiment of the present invention provides a drawing engine, which includes: a receiving unit configured to receive a drawing instruction, the drawing instruction including primitive information, vertex transformation information, and fragment shading information; Receiving post-processing information, the post-processing information is used to indicate that the layer to be drawn is subjected to coordinate transformation processing; a pre-processing interface unit is used to determine pre-processing information according to the post-processing information; a vertex shader is used to determine the pre-processing information based on the The vertex transformation information in the drawing instruction performs coordinate transformation processing on the vertex of the primitive corresponding to the primitive information to obtain the intermediate result of the vertex transformation of the primitive; and is also used to transform the primitive based on the preprocessing information The intermediate result of the vertex transformation of the primitive is subjected to coordinate transformation processing again to obtain the final result of the vertex transformation of the primitive; the rasterizer is used to perform rasterization processing on the final result of the vertex transformation of the primitive to obtain the raster of the primitive the result of the rendering process; the fragment shader, which is used to perform fragment coloring processing on the rasterization processing result of the graphics element based on the fragment coloring information in the drawing instruction, and obtain the fragment coloring processing result of the graphics element; the layer obtaining unit , for performing pixel filling within the display range of the layer to be drawn according to the fragment shading processing result of the primitive to obtain the layer to be drawn.

With reference to the second aspect, in the first implementation manner, in the operation of receiving post-processing information, the receiving unit is specifically configured to receive post-processing information including rotation parameters; the pre-processing interface unit is specifically configured to The rotation parameter included in the post-processing information determines a rotation matrix, and the rotation matrix represents the pre-processing information; performing coordinate transformation processing on the intermediate result of the vertex transformation of the primitive based on the pre-processing information again, In the operation of obtaining the final result of the vertex transformation of the primitive, the vertex shader is specifically configured to perform coordinate transformation on the coordinates of the first vertex representing the intermediate result of the vertex transformation of the primitive based on the rotation matrix, to obtain Represents the second vertex coordinates of the ultimate result of the vertex transformation of the primitive, wherein the primitive represented by the second vertex coordinate has a rotation effect relative to the primitive represented by the first vertex coordinate.

With reference to the second aspect, in a second implementation manner, the receiving unit is specifically configured to receive post-processing information including scaling parameters; the pre-processing interface unit is specifically configured to determine according to the scaling parameters included in the post-processing information A scaling matrix, wherein the scaling matrix represents the preprocessing information; performing coordinate transformation processing again on the intermediate result of the vertex transformation of the primitive based on the preprocessing information to obtain the final result of the vertex transformation of the primitive In operation, the vertex shader is specifically configured to perform coordinate transformation processing again on the first vertex coordinate representing the intermediate result of the vertex transformation of the primitive based on the scaling matrix, to obtain the final result representing the vertex transformation of the primitive The third vertex coordinates, the primitive represented by the third vertex coordinates has a scaling effect relative to the primitive represented by the first vertex coordinates.

With reference to the second aspect, in a third implementation manner, the receiving unit is specifically configured to receive post-processing information including rotation parameters and scaling parameters; the pre-processing interface unit is specifically configured to The rotation parameter determines a rotation matrix, determines a scaling matrix according to a scaling parameter included in the post-processing information, and multiplies the rotation matrix and the scaling matrix to obtain a pre-processing matrix, where the pre-processing matrix represents the pre-processing information; In the operation of performing coordinate transformation again on the intermediate result of the vertex transformation of the primitive based on the preprocessing information to obtain the final result of the vertex transformation of the primitive, the vertex shader is specifically configured to The preprocessing matrix performs coordinate transformation processing on the first vertex coordinate representing the intermediate result of the vertex transformation of the primitive to obtain the fourth vertex coordinate representing the final result of the vertex transformation of the primitive, and the fourth vertex coordinate represents The primitive has the effect of rotation and scaling relative to the primitive represented by the first vertex coordinates.

With reference to the first implementation of the second aspect, in the fourth implementation, the preprocessing interface unit is further configured to, when the rotation angle represented by the rotation parameter is 90 or 270 degrees, based on the rotation parameter The width attribute parameter and the height attribute parameter of the layer to be drawn are adjusted so that the adjusted width attribute and height attribute match the display range of the layer to be drawn; the vertex shader is also used to The adjusted width and height attributes are used to clip the second vertex coordinates representing the final result of the vertex transformation of the primitive to obtain the clipped second vertex coordinates; the rasterizer is specifically used to clip the clipped Rasterization processing is performed on the second vertex coordinates of the primitive to obtain the rasterization processing result of the primitive.

With reference to the second implementation of the second aspect, in the fifth implementation, the preprocessing interface unit is further configured to perform a wide attribute parameter and a high attribute parameter of the layer to be drawn based on the scaling parameter Adjust, so that the adjusted width attribute and height attribute match the display range of the layer to be drawn; the vertex shader is also used to represent the primitive according to the adjusted width attribute and height attribute The coordinates of the third vertex of the final result of vertex transformation are clipped to obtain the coordinates of the third vertex after clipping; the rasterizer is specifically used to perform rasterization processing on the coordinates of the third vertex after clipping to obtain the coordinates of the primitive Rasterize the result.

With reference to the third implementation manner of the second aspect, in the sixth implementation manner, the preprocessing interface unit is further configured to adjust the width attribute parameter of the layer to be drawn based on the scaling parameter and the rotation parameter and high attribute parameters are adjusted so that the adjusted width and height attributes match the display range of the layer to be drawn; the vertex shader is also used to represent The fourth vertex coordinates of the final result of the vertex transformation are clipped to obtain the clipped fourth vertex coordinates; the rasterizer is specifically used to rasterize the clipped fourth vertex coordinates to obtain the image The result of the rasterization process for the element.

In a third aspect, an embodiment of the present invention provides a display method, the method comprising: receiving a drawing instruction, the drawing instruction including primitive information, vertex transformation information, and fragment shading information; receiving post-processing information, according to the post-processing The information determines the preprocessing information, and the postprocessing information is used to indicate that the layer to be drawn is subjected to coordinate transformation processing; based on the vertex transformation information in the drawing instruction, the coordinate transformation processing is performed on the vertex of the primitive corresponding to the primitive information , to obtain the intermediate result of the vertex transformation of the primitive; based on the preprocessing information, perform coordinate transformation processing on the intermediate result of the vertex transformation of the primitive to obtain the final result of the vertex transformation of the primitive; Perform rasterization processing on the final result of the vertex transformation to obtain the rasterization processing result of the primitive; perform fragment coloring processing on the rasterization processing result of the primitive based on the fragment shading information in the drawing instruction to obtain the graph The fragment shading processing result of the primitive; according to the fragment shading processing result of the graphics primitive, perform pixel filling within the display range of the layer to be drawn to obtain the layer to be drawn; output the layer to be drawn show.

With reference to the third aspect, in the first implementation manner, when the number of the layers to be drawn is more than two, the outputting and displaying the layers to be drawn includes: The layers to be drawn are synthesized to generate a target image, and the target image is output for display.

With reference to the third aspect or the first implementation manner of the third aspect, in the second implementation manner, the receiving post-processing information and determining the pre-processing information according to the post-processing information include: receiving the post-processing information, the The post-processing information includes rotation parameters; a rotation matrix is determined according to the rotation parameters included in the post-processing information, and the rotation matrix represents the pre-processing information; the vertex transformation of the primitive based on the pre-processing information is intermediate As a result, coordinate transformation processing is performed again to obtain the final result of the vertex transformation of the primitive, including: performing coordinate transformation processing again on the coordinates of the first vertex representing the intermediate result of the vertex transformation of the primitive based on the rotation matrix, and obtaining the final result representing the vertex transformation of the primitive. The second vertex coordinates of the final result of the vertex transformation of the primitive, the primitive represented by the second vertex coordinate has a rotation effect relative to the primitive represented by the first vertex coordinate.

With reference to the third aspect or the first implementation manner of the third aspect, in the third implementation manner, the receiving post-processing information and determining the pre-processing information according to the post-processing information include: receiving the post-processing information, the The post-processing information includes scaling parameters; a scaling matrix is determined according to the scaling parameters included in the post-processing information, and the scaling matrix represents the pre-processing information; the vertex transformation of the primitive based on the pre-processing information is intermediate As a result, coordinate transformation processing is performed again to obtain the final result of the vertex transformation of the primitive, including: performing coordinate transformation processing again on the coordinates of the first vertex representing the intermediate result of the vertex transformation of the primitive based on the scaling matrix, and obtaining the final result representing the vertex transformation of the primitive. The coordinates of the third vertex of the final result of the vertex transformation of the primitive, and the primitive represented by the coordinate of the third vertex has a scaling effect relative to the primitive represented by the coordinate of the first vertex.

With reference to the third aspect or the first implementation manner of the third aspect, in a fourth implementation manner, the receiving post-processing information and determining the pre-processing information according to the post-processing information include: receiving the post-processing information, the Post-processing information includes rotation parameters and scaling parameters;

Determine a rotation matrix according to the rotation parameters included in the post-processing information; determine a scaling matrix according to the scaling parameters included in the post-processing information; multiply the rotation matrix and the scaling matrix to obtain a pre-processing matrix, the pre-processing matrix The processing matrix represents the preprocessing information; the coordinate transformation process is performed on the intermediate result of the vertex transformation of the primitive based on the preprocessing information to obtain the final result of the vertex transformation of the primitive, including: based on the preprocessing information The processing matrix performs coordinate transformation processing on the first vertex coordinate representing the intermediate result of the vertex transformation of the primitive, and obtains the fourth vertex coordinate representing the final result of the vertex transformation of the primitive, and the graph represented by the fourth vertex coordinate The element has the effect of rotation and scaling relative to the primitive represented by the first vertex coordinates.

With reference to the second implementation manner of the third aspect, in the fifth implementation manner, after receiving the post-processing information, the post-processing information includes a rotation parameter, the method further includes: When the rotation angle is 90 or 270 degrees, the width attribute parameter and the height attribute parameter of the layer to be drawn are adjusted based on the rotation parameter, so that the adjusted width attribute and height attribute are consistent with the layer to be drawn The display range of the primitive is matched; the first vertex coordinate representing the intermediate result of the vertex transformation of the primitive is subjected to coordinate transformation processing again based on the rotation matrix, and the second coordinate transformation representing the final result of the vertex transformation of the primitive is obtained. After the vertex coordinates, it also includes: according to the adjusted width attribute and height attribute, clipping the second vertex coordinates representing the final result of the vertex transformation of the primitive to obtain the clipped second vertex coordinates; Performing rasterization processing on the final vertex transformation result of the primitive to obtain the rasterization processing result of the primitive, including: performing rasterization processing on the clipped second vertex coordinates to obtain the rasterization processing result of the primitive. .

With reference to the third implementation manner of the third aspect, in the sixth implementation manner, after receiving the post-processing information, where the post-processing information includes scaling parameters, the method further includes: Adjust the width attribute parameter and height attribute parameter of the layer to be drawn, so that the adjusted width attribute and height attribute match the display range of the layer to be drawn; in the representation based on the scaling matrix The first vertex coordinate of the intermediate result of the vertex transformation of the graphics primitive is subjected to coordinate transformation processing again, and after obtaining the third vertex coordinate representing the final result of the vertex transformation of the primitive, it also includes: according to the adjusted width attribute and height attribute , clipping the coordinates of the third vertex representing the final result of the vertex transformation of the primitive to obtain the coordinates of the third vertex after clipping; performing rasterization processing on the final result of the transformation of the vertex of the primitive to obtain the graph The rasterization processing result of the primitive includes: performing rasterization processing on the clipped third vertex coordinates to obtain the rasterization processing result of the primitive.

With reference to the fourth implementation manner of the third aspect, in the seventh implementation manner, after receiving the post-processing information, the post-processing information includes a rotation parameter and a scaling parameter, the method further includes: based on the scaling parameter and the rotation parameter adjust the width attribute parameter and the height attribute parameter of the layer to be drawn, so that the adjusted width attribute and height attribute match the display range of the layer to be drawn; After performing coordinate transformation processing on the first vertex coordinate representing the intermediate result of the vertex transformation of the primitive based on the preprocessing matrix, and obtaining the fourth vertex coordinate representing the final result of the vertex transformation of the primitive, it also includes: According to the adjusted width attribute and height attribute, the fourth vertex coordinate representing the final result of the vertex transformation of the primitive is clipped to obtain the clipped fourth vertex coordinate; the final result of the vertex transformation of the primitive is obtained. Performing rasterization processing to obtain a rasterization processing result of the primitive includes: performing rasterization processing on the clipped fourth vertex coordinates to obtain a rasterization processing result of the primitive.

In a fourth aspect, an embodiment of the present invention further provides a terminal device, which includes a display controller, a display screen component, and the third aspect or the first implementation manner of the third aspect to the seventh implementation manner of the third aspect In any one of the manners, the drawing engine described in the manner is implemented, wherein: the display controller is configured to display the output of the layer to be drawn obtained by the drawing engine on the display screen component.

With reference to the fourth aspect, in the first implementation manner, when the number of layers to be drawn is more than two, the display controller is specifically configured to use the two or more layers obtained by the drawing engine The layers to be drawn are synthesized to generate a target image, and the target image is output and displayed on the display screen component.

With reference to the fourth aspect, in the second implementation manner, the terminal device further includes a synthesizer, wherein: when the number of layers to be drawn is more than two, the synthesizer is used to obtain the drawing engine The two or more layers to be drawn are synthesized to generate a target image; the display controller is specifically configured to output and display the target image on the display screen component.

It can be seen that the layer drawing method, the drawing engine and the terminal device provided by the embodiment of the present invention, after receiving the drawing instruction, first follow the vertex transformation processing method in the prior art, according to the vertex transformation information included in the drawing instruction Perform coordinate transformation processing on the vertices of the primitives corresponding to the primitive information contained in the drawing instruction, and obtain the intermediate results of the vertex transformation of the primitives; then perform the coordinate transformation on the primitives based on the preprocessing information determined according to the received postprocessing information The intermediate result of the vertex transformation is processed again to obtain the final result of the vertex transformation of the primitive; then the final result of the vertex transformation of the primitive is rasterized and fragment shading processed, and finally the layer to be drawn is obtained . According to the technical solution described in the embodiment of the present invention, after the vertex transformation, the intermediate result of the vertex transformation of the primitive is processed again based on the preprocessing information. Since the vertex of the primitive obtained after the vertex transformation The amount of data contained in the transformation intermediate result is relatively small, so the processing cost of performing coordinate transformation on it again is relatively small.

Description of drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following will briefly introduce the accompanying drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only some of the present invention. Embodiments, for those of ordinary skill in the art, other drawings can also be obtained based on these drawings without any creative effort.

Figure 1a is a layer rendering pipeline diagram based on the OpenGL hardware standard;

Fig. 1b is a flow chart of layer drawing based on the OpenGL hardware standard in the prior art;

Fig. 1c is a flow chart of layer drawing provided by an embodiment of the present invention;

Figure 2 is a schematic diagram of the logical structure of existing terminal equipment

Fig. 3a is a schematic flow chart of a layer drawing method provided by an embodiment of the present invention;

Fig. 3b is a schematic flow chart of another layer drawing method provided by an embodiment of the present invention;

Fig. 4 is a schematic structural diagram of a drawing engine provided by an embodiment of the present invention;

Fig. 5 is a schematic flow chart of a display method provided by an embodiment of the present invention;

Fig. 6a is a structural block diagram of a terminal device provided by an embodiment of the present invention;

Fig. 6b is a structural block diagram of a terminal device provided by an embodiment of the present invention;

Fig. 7 is a schematic structural diagram of another terminal device provided by an embodiment of the present invention.

detailed description

The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

Embodiment one

As shown in Figure 1a, it is a layer rendering pipeline diagram based on the OpenGL hardware standard. Referring to the accompanying drawing, it can be seen that drawing a layer under the OpenGL hardware standard requires at least three processes of vertex transformation, rasterization, and fragment coloring. Specifically, First, the vertex shader performs vertex transformation based on the vertex data, and combines the obtained geometric vertices into primitives; then rasterizes these primitives to generate a series of interpolated texture coordinates and vertex coordinates; then renders with the fragment shader The pixel points corresponding to the texture coordinates and the vertex coordinates are filled with all the pixel points constituting the layer to be drawn within the display range of the layer to be drawn to obtain the layer to be drawn.

Accompanying drawing 1b is the layer drawing flow chart based on OpenGL hardware standard in the prior art, based on this drawing, if need to do rotation processing to the layer, the solution adopted in the prior art is to draw described layer to be drawn Afterwards, the layer is rotated accordingly based on the rotation requirement to obtain a rotated layer.

Accompanying drawing 1c is the layer drawing flow chart provided by the embodiment of the present invention, referring to this figure, it can be seen that in the layer drawing method provided by the embodiment of the present invention, if the layer needs to be rotated, the rotation is done after the vertex transformation. The vertex transformation is the vertex transformation performed by the vertex shader based on the vertex data in the layer rendering pipeline diagram shown in Figure 1a. Specifically, if the method provided by the embodiment of the present invention is used to draw a layer and the layer needs to be rotated, the vertex transformation described in the OpenGL hardware standard is first performed to obtain the intermediate result of the vertex transformation shown in Figure 1c, and then Based on the rotation requirements, the coordinate transformation process is performed again to obtain the final result of the vertex transformation, and then the final result of the vertex transformation is rasterized and fragment shaded according to the rasterization and fragment shading process under the OpenGL hardware standard to obtain the rotated layer.

Figure 1b and Figure 1c illustrate the difference between the present invention and the prior art by taking the need to rotate the layer as an example. In the prior art, the rotation operation based on the rotation requirement is for the image to be drawn after the drawing of the layer is completed. The rotation operation based on the rotation requirement in the present invention is carried out after the vertex transformation is completed and before the rasterization starts. The drawn layer contains a large number of pixels, and the rotation process of the layer to be drawn requires The amount of data to be processed is relatively large; only a small number of vertices are obtained after the vertex transformation, and the amount of data to be processed for the coordinate transformation of the vertices is relatively small, so the processing cost paid is relatively small.

Embodiment two

Referring to accompanying drawing 3a, it is a method flowchart of a layer drawing method provided by an embodiment of the present invention, the layer drawing method can be applied to a computer system, and the computer system can be located on a physical host or can be distributed in on multiple physical hosts. Specifically, the computer system may be located on one or more computers, portable computers, handheld devices (such as mobile phones, PADs, etc.), servers and other types of terminals.

Taking FIG. 2 as an example, the logical structure of the computing nodes applied in the layer drawing method provided by the embodiment of the present invention is introduced. The computing node may be a terminal device, and specifically, the terminal device may be a smart phone. As shown in Figure 2, the hardware layer of the terminal device includes CPU, GPU, etc., and of course may also include memory, input/output device, memory, memory controller, network interface, etc., and the input device may include keyboard, mouse, touch screen, etc. The output device may include a display device such as LCD, CRT, holographic imaging (Holographic), projection (Projector), and the like. Above the hardware layer is the driver layer, including CPU drivers, image processor drivers, display controller drivers, etc. Above the driver layer is the core library layer. The core library is the core part of the operating system, including input/output services, core services, graphics device interfaces, and graphics services (Graphics Engine) for CPU and GPU graphics processing. The graphics service may include a 2D engine, a 3D engine, a compositor (Composition), a frame buffer (Frame Buffer), OpenGL, and the like. In addition, the terminal also includes a framework layer and an application layer. The framework layer can include Graphic Service, System Service, Web Service and Customer Service, etc.; in Graphic Service, it can include such as Widget, Canvas , Views, Render Script, etc. The application layer may include desktop (launcher), media player (Media Player), browser (Browser), etc.

As shown in Figure 3a, the graphics processing method provided by the embodiment of the present invention includes:

S301. Receive a drawing instruction, where the drawing instruction includes primitive information, vertex transformation information, and fragment shading information;

Specifically, the application program transmits the drawing instruction to the display system control center (Surface Flinger) of the framework layer (Framework), and Surface Flinger applies to the system for drawing the canvas of the layer according to the drawing instruction, wherein the size of the canvas is based on the drawing instruction The width and height parameters of the layer to be drawn are determined; the system calls the layer memory allocation unit (Gralloc) based on SurfaceFlinger's application to allocate a canvas for drawing the layer; at the same time, the Surface Flinger passes the drawing command to The rendering driver (RenderingDriver) of the core library layer is used to make the Rendering Driver drive the drawing engine to draw the layer based on the drawing instruction. It should be noted that the drawing engine mentioned here refers to a drawing engine based on a graphics processing unit GPU, including a 2D drawing engine, a 3D drawing engine, and the like.

It should be noted that the drawing instruction includes primitive information, vertex transformation information and fragment shading information. Among them, primitives are the most basic materials used by graphics software to operate and organize pictures. A picture is composed of primitives, which are a group of the simplest and most common collection of graphics or characters, such as points, line segments, and triangles. , polygons, etc.

It should be noted that the drawing instruction may be input by the user through touch screen touch, keyboard input, mouse click, etc., which is not limited in this embodiment of the present invention.

S302. Receive post-processing information, and determine pre-processing information according to the post-processing information, where the post-processing information is used to indicate that coordinate transformation processing is performed on the layer to be drawn;

The post-processing information is used to represent the coordinate transformation processing of the layer to be drawn. The post-processing information includes rotation parameters, scaling parameters or a combination of both. The post-processing information may also include display layout (Source Crop) and Layer range (Display Frame), etc., where Source Crop indicates which part of the Buffer is collected for synthesis, and Display Frame indicates which area on the screen the Buffer is to be synthesized. Of course, the post-processing information can be used for Indicates that other coordinate transformations should be performed on the layer to be drawn, and there are no restrictive regulations here.

The preprocessing information is used to represent the coordinate transformation matrix for the intermediate result of the vertex transformation of the primitive. The preprocessing information includes a rotation matrix, a scaling matrix or a combination of the two. The preprocessing information may also include other It is the matrix that performs coordinate transformation again on the intermediate result of the vertex transformation of the primitive, and there are no restrictive regulations here.

It is worth noting that the post-processing information refers to the information indicating that the drawn layer is processed in the layer rendering mode based on the OpenGL hardware standard in the prior art, and the post-processing information includes processing the drawn layer Rotation and/or scaling and other information related to coordinate transformation processing will not be listed here.

Specifically, the determining the pre-processing information according to the post-processing information includes but is not limited to the following situation: when the rotation parameter (Transform Hint) contained in the post-processing information is not 0, determine the rotation matrix corresponding to the rotation parameter , the pre-processing information is the rotation matrix; when the post-processing information contains a scaling parameter that is not 0, determine the scaling matrix corresponding to the scaling parameter, the pre-processing information is the scaling matrix, what needs to be explained Yes, the scaling parameter includes a horizontal scaling parameter and a vertical scaling parameter; when the rotation parameter included in the post-processing information is not 0 and the scaling parameter included is also not 0, the corresponding rotation matrix is determined according to the rotation parameter, Determine the corresponding scaling matrix according to the scaling parameters, and then multiply the rotation matrix by the scaling matrix to obtain a preprocessing matrix, then the preprocessing information is the preprocessing matrix, similarly, the scaling parameters Including horizontal scaling parameters and vertical scaling parameters. It should be noted that the information obtained according to the post-processing information may also be a vertex transformation instruction set or other forms of pre-processing information, and is not limited to the above-mentioned matrix form.

It should be noted that the receiving post-processing information and determining the pre-processing information according to the post-processing information is that Surface Flinger obtains the post-processing information by detecting the drawing environment after receiving the drawing instruction and determines the pre-processing information according to the post-processing information. process information.

S303. Based on the vertex transformation information in the drawing instruction, perform coordinate transformation processing on the vertex of the primitive corresponding to the primitive information, and obtain an intermediate result of the vertex transformation of the primitive;

Specifically, performing coordinate transformation processing on the vertices of the primitive corresponding to the primitive information based on the vertex transformation information in the drawing instruction includes: determining the first vertex transformation based on the vertex transformation information in the drawing instruction matrix, and then perform coordinate transformation processing on the initial vertex coordinates of the primitive corresponding to the primitive information based on the first vertex transformation matrix, to obtain the first vertex coordinates representing the intermediate result of the vertex transformation of the primitive.

S304. Based on the preprocessing information, perform coordinate transformation processing on the intermediate vertex transformation result of the primitive to obtain the final result of the vertex transformation of the primitive;

It should be noted that the preprocessing information may be a rotation matrix, a scaling matrix, or a preprocessing matrix, and may also be other matrices used to indicate transformation processing on coordinates.

Referring to Fig. 3b, as an embodiment of the present invention, when the pre-processing information is a rotation matrix determined according to the rotation parameters contained in the post-processing information, the graphics primitives based on the pre-processing information Perform coordinate transformation processing again on the intermediate result of the vertex transformation of the primitive to obtain the final result of the vertex transformation of the primitive, which refers to performing coordinate transformation processing again on the coordinates of the first vertex representing the intermediate result of the vertex transformation of the primitive based on the rotation matrix , to obtain the second vertex coordinates representing the final result of the vertex transformation of the primitive, and the primitive represented by the second vertex coordinates has a rotation effect relative to the primitive represented by the first vertex coordinates. It should be noted that when the rotation angle represented by the rotation parameter included in the post-processing information is 90 or 270 degrees, the layer rendering method provided in the embodiment of the present invention further includes: The width attribute parameter and height attribute parameter of the layer are adjusted, so that the adjusted width attribute and height attribute of the layer to be drawn match the display range of the layer to be drawn.

As another embodiment of the present invention, when the pre-processing information is a scaling matrix determined according to the scaling parameters contained in the post-processing information, the vertex transformation of the primitive based on the pre-processing information is intermediate As a result, the coordinate transformation processing is performed again to obtain the final result of the vertex transformation of the primitive, which means that the first vertex coordinate representing the intermediate result of the vertex transformation of the primitive is subjected to coordinate transformation processing again based on the scaling matrix, and the result representing the vertex transformation of the primitive is obtained. The coordinates of the third vertex of the final result of the vertex transformation of the primitive, and the primitive represented by the coordinate of the third vertex has a scaling effect relative to the primitive represented by the coordinate of the first vertex. Wherein, the scaling parameters contained in the post-processing information include vertical scaling parameters and horizontal scaling parameters, and the scaling matrix determined according to the scaling parameters contained in the post-processing information actually refers to Contains the scaling matrix determined by the vertical scaling parameters and horizontal scaling parameters. It should be noted that the layer drawing method provided by the embodiment of the present invention further includes adjusting the width attribute parameter and the height attribute parameter of the layer to be drawn according to the scaling parameter contained in the post-processing information, so that the adjustment The width attribute and height attribute of the layer to be drawn are matched with the display range of the layer to be drawn.

As another embodiment of the present invention, when the post-processing information includes rotation parameters and scaling parameters, the pre-processing information is obtained by combining the rotation matrix determined according to the rotation parameters with the scaling matrix determined according to the scaling parameters Multiply the resulting preprocessing matrix. The step of performing coordinate transformation again on the intermediate result of the vertex transformation of the primitive based on the preprocessing information to obtain the final result of the vertex transformation of the primitive refers to the representation of the primitive based on the preprocessing matrix The first vertex coordinates of the intermediate result of vertex transformation are preprocessed to obtain the fourth vertex coordinates representing the final result of vertex transformation of the primitive, and the primitive represented by the fourth vertex coordinates is relative to the primitive represented by the first vertex coordinates. Primitives have the effect of rotation and scaling. Wherein, the scaling parameter includes a vertical scaling parameter and a horizontal scaling parameter, and the scaling matrix determined according to the scaling parameter refers to a scaling matrix determined according to the vertical scaling parameter and the horizontal scaling parameter. It should be noted that the layer drawing method provided by the embodiment of the present invention further includes adjusting the width attribute parameter and height attribute of the layer to be drawn according to the zoom parameter and the rotation parameter included in the post-processing information. The parameter is adjusted so that the adjusted width attribute and height attribute match the display range of the layer to be drawn.

It should be noted that the preprocessing information includes but is not limited to the above-mentioned rotation and/or scaling matrix, and also includes other parameters for performing special effect processing on the layer. The post-processing information of the back-end processing of the coordinate transformation can be converted into the pre-processing information, which is not limited in the present invention.

S305. Perform rasterization processing on the final vertex transformation result of the primitive to obtain the rasterization processing result of the primitive;

S306. Perform fragment shading processing on the rasterization processing result of the primitive based on the fragment shading information in the drawing instruction, to obtain the fragment shading processing result of the primitive;

S307. Perform pixel filling within the display range of the layer to be drawn according to the fragment shading processing result of the primitive to obtain the layer to be drawn.

Specifically, rasterization is the process of converting a geometric primitive into a two-dimensional image. The object of the fragment shading process is the rasterized data, and the pixel is generated after the shading process by the fragment shader, and the pixel is a component of a layer, and each layer contains multiple pixel points.

It should be noted that, the filling of pixels within the display range of the layer to be drawn to obtain the layer to be drawn according to the result of the fragment coloring processing of the primitive refers to the pixel points obtained through the fragment coloring processing in the The canvas of the layer to be drawn is filled to obtain the layer to be drawn.

It is worth noting that the object of the layer drawing method described in the embodiment of the present invention is not limited to rotating and/or scaling the layer, and can also be applied to other back-end processing in the prior art that only involves coordinate transformation situation. When the layer drawing method provided by the embodiment of the present invention is applied to a game application, the sliding of the game can be made smoother, and the special effect of the image can be increased.

An embodiment of the present invention provides a layer drawing method. After the vertex transformation is completed, the vertices obtained after the vertex transformation are preprocessed according to the preprocessing information. Since the amount of data for the preprocessing after the vertex transformation is relatively small, It can reduce the cost of special effect processing involving coordinate transformation on the layer.

Embodiment Three

Please refer to FIG. 4 , which is a schematic structural diagram of a drawing engine 40 provided by an embodiment of the present invention. The drawing engine 40 can be applied to the terminal device shown in FIG. 2 . Specifically, the drawing engine 40 includes a receiving unit 41, a preprocessing interface unit 42, a vertex shader 43, a rasterizer 44, a fragment shader 45, and a layer obtaining unit 46.

The receiving unit 41 is used to receive drawing instructions, which include primitive information, vertex transformation information, and fragment shading information; and is also used to receive post-processing information, which is used to represent the layer to be drawn Do coordinate transformation processing.

Among them, primitives are the most basic materials used by graphics software to operate and organize pictures. A picture is composed of primitives, which are a group of the simplest and most common collection of graphics or characters, such as points, line segments, and triangles. , polygons, etc.

The post-processing information is used to represent the coordinate transformation processing of the layer to be drawn. The post-processing information includes rotation parameters, scaling parameters or a combination of both. The post-processing information may also include display layout (Source Crop) and Layer range (Display Frame), etc., where Source Crop indicates which part of the Buffer is collected for synthesis, and Display Frame indicates which area on the screen the Buffer is to be synthesized. Of course, the post-processing information can be used for Indicates that other coordinate transformations should be performed on the layer to be drawn, and there are no restrictive regulations here.

The preprocessing information is used to represent the coordinate transformation matrix for the intermediate result of the vertex transformation of the primitive. The preprocessing information includes a rotation matrix, a scaling matrix or a combination of the two. The preprocessing information may also include other It is the matrix that performs coordinate transformation again on the intermediate result of the vertex transformation of the primitive, and there are no restrictive regulations here.

It should be noted that the drawing instruction may be input by the user through touch screen touch, keyboard input, mouse click, etc., which is not limited in this embodiment of the present invention.

The pre-processing interface unit 42 is configured to determine pre-processing information according to the post-processing information.

As an embodiment of the present invention, when the post-processing information includes rotation parameters, the pre-processing interface unit 42 is specifically used to determine the corresponding rotation matrix according to the rotation parameters, and the rotation matrix is used to represent The pre-processing information; it should be noted that when the rotation parameter contained in the post-processing information is 90 or 270 degrees, the pre-processing interface unit 42 is also used to Adjust the width attribute parameter and height attribute parameter of the layer, so that the adjusted width attribute and height attribute match the display range of the layer to be drawn.

As another embodiment of the present invention, when the post-processing information includes scaling parameters, the pre-processing interface unit 42 is specifically configured to determine a corresponding scaling matrix according to the scaling parameters, and the scaling matrix is used to represent The pre-processing information; it should be noted that the pre-processing interface unit 42 is also configured to adjust the width attribute parameter and the high attribute parameter of the layer to be drawn based on the scaling parameters contained in the post-processing information , so that the adjusted width and height attributes match the display range of the layer to be drawn.

As another embodiment of the present invention, when the post-processing information includes not only rotation parameters but also scaling parameters, the pre-processing interface unit 42 is specifically configured to determine the corresponding rotation matrix according to the rotation parameters, and according to the The scaling parameters determine the corresponding scaling matrix, and then determine the preprocessing matrix according to the product of the rotation matrix and the scaling matrix, and the preprocessing matrix is used to represent the preprocessing information; it should be noted that the preprocessing The processing interface unit 42 is further configured to adjust the width attribute parameter and the height attribute parameter of the layer to be drawn based on the zoom parameter and the rotation parameter included in the post-processing information, so that the adjusted width The attributes and high attributes match the display range of the layer to be drawn.

It should be noted that when the post-processing information contains other parameters related to indicating the transformation of coordinates, the pre-processing interface unit 42 is also specifically configured to determine the corresponding parameters according to the post-processing information. Preprocess information.

The vertex shader 43 is configured to perform coordinate transformation processing on the vertices of the primitive corresponding to the primitive information based on the vertex transformation information in the drawing instruction, to obtain an intermediate result of the vertex transformation of the primitive; and is also used to The intermediate result of the vertex transformation of the primitive is subjected to coordinate transformation processing again based on the preprocessing information to obtain the final result of the vertex transformation of the primitive.

Specifically, on the basis of the vertex transformation information in the drawing instruction, the coordinate transformation process is performed on the vertex of the primitive corresponding to the primitive information to obtain the intermediate result of the vertex transformation of the primitive, the vertex The shader 43 is specifically configured to determine a vertex transformation matrix based on the vertex transformation information in the drawing instruction; based on the vertex transformation matrix, perform coordinate transformation processing on the initial vertex coordinates representing the vertices of the graphics primitive to obtain The first vertex coordinate of the vertex transformation intermediate result.

It is worth noting that the preprocessing information is embodied as a matrix, such as a rotation matrix, a scaling matrix, or a preprocessing matrix, etc., and is used to instruct to perform transformation processing on the coordinates of vertices of primitives composing the layer.

As an embodiment of the present invention, when the pre-processing information is a rotation matrix determined according to the rotation parameters contained in the post-processing information, the vertex shader 43 is specifically configured to represent the The first vertex coordinate of the intermediate result of the vertex transformation of the primitive is subjected to coordinate transformation processing again to obtain the second vertex coordinate representing the final result of the vertex transformation of the primitive, wherein the primitive represented by the second vertex coordinate is relative to the The primitive represented by the coordinates of the first vertex has the effect of rotation.

As another embodiment of the present invention, when the pre-processing information is a scaling matrix determined according to the scaling parameters included in the post-processing information, the vertex shader 43 is specifically configured to represent the scaling matrix based on the scaling matrix. The first vertex coordinate of the intermediate result of the vertex transformation of the primitive is subjected to coordinate transformation processing again to obtain the third vertex coordinate representing the final result of the vertex transformation of the primitive, and the primitive represented by the third vertex coordinate is relative to the The primitive represented by the coordinates of the first vertex has a scaling effect.

As another embodiment of the present invention, when the post-processing information includes a rotation parameter and a scaling parameter, and the scaling parameter includes a vertical scaling parameter and a horizontal scaling parameter, the pre-processing information is determined according to the rotation parameter A preprocessing matrix determined by the product of the rotation matrix and the scaling matrix determined according to the vertical scaling parameter and the horizontal scaling parameter. The vertex shader 43 is specifically configured to perform coordinate transformation again on the first vertex coordinate representing the intermediate result of the vertex transformation of the primitive based on the preprocessing matrix, to obtain the first vertex coordinate representing the final result of the vertex transformation of the primitive. Four vertex coordinates, the primitive represented by the fourth vertex coordinate has the effect of rotation and scaling relative to the primitive represented by the first vertex coordinate.

It should be noted that the parameters contained in the post-processing information include but are not limited to the above-mentioned rotation and/or scaling parameters, and also include other parameters that only involve coordinate transformation processing. Correspondingly, the function of the vertex shader The parameters included in the post-processing information are different, that is, the vertex shader includes but not limited to the above functions.

The rasterizer 44 is configured to perform rasterization processing on the final result of the vertex transformation of the primitive to obtain the rasterization processing result of the primitive;

The fragment shader 45 is configured to perform fragment shading processing on the rasterization processing result of the primitive based on the fragment shading information in the drawing instruction, to obtain the fragment shading processing result of the primitive;

The layer to be drawn obtaining unit 46 is configured to perform pixel filling within the display range of the layer to be drawn to obtain the layer to be drawn according to the fragment coloring processing result of the primitive.

Specifically, the to-be-drawn layer obtaining unit 46 is specifically configured to transfer the drawn buffer to the synthesizer by SurfaceFlinger, and the synthesizer calls the enhanced display controller EDC to synthesize the buffer to generate the to-be-drawn layer.

An embodiment of the present invention provides a drawing engine. When using the drawing engine to draw a layer, after the vertex transformation is completed, the vertex transformation result is preprocessed according to the preprocessing information. Since the vertex transformation stage only targets fewer vertices , so the drawing engine provided by the embodiment of the present invention is used to preprocess the layer, because the amount of processed data is relatively small, so the processing cost is relatively small; further, the drawing engine provided by the embodiment of the present invention also includes determining the preprocessing information Finally, adjust the width and height attributes of the layer according to the rotation and/or scaling parameters corresponding to the preprocessing information, so that the width and height of the layer to be drawn match its display range, so that subsequent rasterization and fragment coloring can be directly Operating on the vertex change results of the layer further reduces the processing cost.

Embodiment Four

Please refer to accompanying drawing 5, which is a method flowchart of a display method provided by an embodiment of the present invention. The layer drawing method can be applied to a computer system, and the computer system can be located on a physical host or distributed across multiple locations. on a physical host. Specifically, the computer system can be located on one or more computers, portable computers, handheld devices (such as mobile phones, PADs, etc.), servers and other types of terminals, wherein the logical structure of the computer system can refer to FIG. 2 .

Specifically, as shown in FIG. 5, the display method provided by the embodiment of the present invention includes the following process:

S501. Receive a drawing instruction, where the drawing instruction includes primitive information, vertex transformation information, and fragment shading information;

Specifically, the drawing instruction includes primitive information, vertex transformation information and fragment shading information. Among them, primitives are the most basic materials used by graphics software to operate and organize pictures. A picture is composed of primitives, which are a group of the simplest and most common collection of graphics or characters, such as points, line segments, and triangles. , polygons, etc.

It should be noted that the drawing instruction may be input by the user through touch screen touch, keyboard input, mouse click, etc., which is not limited in this embodiment of the present invention.

S502. Receive post-processing information, and determine pre-processing information according to the post-processing information, where the post-processing information is used to indicate that coordinate transformation processing is performed on the layer to be drawn;

The post-processing information is used to represent the coordinate transformation processing of the layer to be drawn. The post-processing information includes rotation parameters, scaling parameters or a combination of both. The post-processing information may also include display layout (Source Crop) and Layer range (Display Frame), etc., where Source Crop indicates which part of the Buffer is collected for synthesis, and Display Frame indicates which area on the screen the Buffer is to be synthesized. Of course, the post-processing information can be used for Indicates that other coordinate transformations should be performed on the layer to be drawn, and there are no restrictive regulations here.

The preprocessing information is used to represent the coordinate transformation matrix for the intermediate result of the vertex transformation of the primitive. The preprocessing information includes a rotation matrix, a scaling matrix or a combination of the two. The preprocessing information may also include other It is the matrix that performs coordinate transformation again on the intermediate result of the vertex transformation of the primitive, and there are no restrictive regulations here.

It is worth noting that the post-processing information refers to the information used to indicate that the layer that has been drawn is processed in the layer rendering mode based on the OpenGL hardware standard in the prior art. Layer rotation and/or scaling and other information related to coordinate transformation processing are not listed here.

Specifically, the determination of pre-processing information based on the post-processing information includes but is not limited to the following situations:

As an embodiment of the present invention, when the rotation parameter (Transform Hint) contained in the post-processing information is not 0, the rotation matrix corresponding to the rotation parameter is determined, and the pre-processing information is the rotation matrix; it needs to be explained Notably, when the rotation angle represented by the rotation parameter included in the post-processing information is 90 or 270 degrees, the technical solution described in the embodiment of the present invention further includes adjusting the width attribute parameter of the layer to be drawn based on the zoom parameter And the high attribute parameter is adjusted, so that the adjusted width and height attributes of the layer to be drawn match the display range of the layer to be drawn.

As another embodiment of the present invention, when the scaling parameter included in the post-processing information is not 0, the scaling matrix corresponding to the scaling parameter is determined, and the pre-processing information is the scaling matrix. It should be noted that the The scaling parameters include horizontal scaling parameters and vertical scaling parameters; it should be noted that when the post-processing information includes scaling parameters, the technical solution described in the embodiment of the present invention also includes The width attribute parameter and the height attribute parameter of the layer are adjusted, so that the adjusted width and height attributes of the layer to be drawn match the display range of the layer to be drawn.

As another embodiment of the present invention, when the rotation parameter included in the post-processing information is not 0 and the scaling parameter included is also not 0, the corresponding rotation matrix is determined according to the rotation parameter, and the corresponding rotation matrix is determined according to the scaling parameter. get the corresponding scaling matrix, and then multiply the rotation matrix by the scaling matrix to get the preprocessing matrix, then the preprocessing information is the preprocessing matrix, similarly, the scaling parameters include horizontal scaling parameters and vertical scaling parameter. It should be noted that when the post-processing information includes not only the rotation parameter but also the scaling parameter, the technical solution described in the embodiment of the present invention also includes the adjustment of the layer to be drawn based on the rotation parameter and the scaling parameter. The width attribute parameter and the height attribute parameter are adjusted so that the adjusted width and height attributes of the layer to be drawn match the display range of the layer to be drawn.

It should be noted that the preprocessing information includes but is not limited to the above-mentioned rotation and/or scaling matrix, and also includes other parameters for performing special effect processing on the layer. The post-processing information of the back-end processing of the coordinate transformation can be converted into the pre-processing information, which is not limited in the present invention.

S503. Based on the vertex transformation information in the drawing instruction, perform coordinate transformation processing on the vertex of the primitive corresponding to the primitive information, and obtain an intermediate result of the vertex transformation of the primitive;

Specifically, performing coordinate transformation processing on the vertices of the primitive corresponding to the primitive information based on the vertex transformation information in the drawing instruction includes: determining the first vertex transformation based on the vertex transformation information in the drawing instruction matrix, and then perform coordinate transformation processing on the initial vertex coordinates of the primitive corresponding to the primitive information based on the first vertex transformation matrix, to obtain the first vertex coordinates representing the intermediate result of the vertex transformation of the primitive.

S504. Based on the preprocessing information, perform coordinate transformation processing on the intermediate vertex transformation result of the primitive to obtain the final result of the vertex transformation of the primitive;

It should be noted that the preprocessing information includes, but is not limited to, a rotation matrix, a scaling matrix, or a preprocessing matrix, and may also be other matrices used to indicate transformation processing on coordinates.

As an embodiment of the present invention, when the preprocessing information is a rotation matrix determined according to the rotation parameters contained in the postprocessing information, the intermediate result of the vertex transformation of the primitive based on the preprocessing information is Carrying out the coordinate transformation processing again to obtain the final result of the vertex transformation of the primitive refers to performing coordinate transformation processing again on the coordinates of the first vertex representing the intermediate result of the vertex transformation of the primitive based on the rotation matrix to obtain the The second vertex coordinates of the final result of the vertex transformation of the primitive, the primitive represented by the second vertex coordinates has a rotation effect relative to the primitive represented by the first vertex coordinates. It should be noted that when the rotation angle represented by the rotation parameter included in the post-processing information is 90 or 270 degrees, the layer rendering method provided in the embodiment of the present invention further includes: The width attribute parameter and height attribute parameter of the layer are adjusted, so that the adjusted width attribute and height attribute of the layer to be drawn match the display range of the layer to be drawn.

As another embodiment of the present invention, when the pre-processing information is a scaling matrix determined according to the scaling parameters contained in the post-processing information, the vertex transformation of the primitive based on the pre-processing information is intermediate As a result, the coordinate transformation processing is performed again to obtain the final result of the vertex transformation of the primitive, which means that the first vertex coordinate representing the intermediate result of the vertex transformation of the primitive is subjected to coordinate transformation processing again based on the scaling matrix, and the result representing the vertex transformation of the primitive is obtained. The coordinates of the third vertex of the final result of the vertex transformation of the primitive, and the primitive represented by the coordinate of the third vertex has a scaling effect relative to the primitive represented by the coordinate of the first vertex. Wherein, the scaling parameters contained in the post-processing information include vertical scaling parameters and horizontal scaling parameters, and the scaling matrix determined according to the scaling parameters contained in the post-processing information actually refers to Contains the scaling matrix determined by the vertical scaling parameters and horizontal scaling parameters. It should be noted that the layer drawing method provided by the embodiment of the present invention further includes adjusting the width attribute parameter and the height attribute parameter of the layer to be drawn according to the scaling parameter contained in the post-processing information, so that the adjustment The width attribute and height attribute of the layer to be drawn are matched with the display range of the layer to be drawn.

As another embodiment of the present invention, when the post-processing information includes rotation parameters and scaling parameters, and the scaling parameters include vertical scaling parameters and/or horizontal scaling parameters, the pre-processing information is based on the rotation parameters A preprocessing matrix determined by the product of the determined rotation matrix and the scaling matrix determined according to the vertical scaling parameter and/or the horizontal scaling parameter. The step of performing coordinate transformation again on the intermediate result of the vertex transformation of the primitive based on the preprocessing information to obtain the final result of the vertex transformation of the primitive refers to the representation of the primitive based on the preprocessing matrix The first vertex coordinate of the vertex transformation intermediate result is subjected to coordinate transformation processing again, and the fourth vertex coordinate representing the final result of the vertex transformation of the primitive is obtained, and the primitive represented by the fourth vertex coordinate is relative to the first vertex coordinate The primitive represented has the effect of rotation and scaling. Wherein, the scaling parameter includes a vertical scaling parameter and a horizontal scaling parameter, and the scaling matrix determined according to the scaling parameter refers to a scaling matrix determined according to the vertical scaling parameter and the horizontal scaling parameter. It should be noted that the layer drawing method provided by the embodiment of the present invention further includes adjusting the width attribute parameter and height attribute of the layer to be drawn according to the zoom parameter and the rotation parameter included in the post-processing information. The parameter is adjusted so that the adjusted width attribute and height attribute match the display range of the layer to be drawn.

It should be noted that the preprocessing information includes but is not limited to the above-mentioned rotation and/or scaling matrix, and also includes other parameters for performing special effect processing on the layer. The post-processing information of the back-end processing of the coordinate transformation can be converted into the pre-processing information, which is not limited in the present invention.

S505. Perform rasterization processing on the final vertex transformation result of the primitive to obtain a rasterization processing result of the primitive;

S506. Perform fragment shading processing on the rasterization processing result of the primitive based on the fragment shading information in the drawing instruction, to obtain the fragment shading processing result of the primitive;

S507. Perform pixel filling within the display range of the layer to be drawn according to the fragment coloring processing result of the primitive to obtain the layer to be drawn;

Specifically, rasterization is the process of converting a geometric primitive into a two-dimensional image. The object of the fragment shading process is the rasterized data, and the pixel is generated after the shading process by the fragment shader, and the pixel is a component of a layer, and each layer contains multiple pixel points.

It should be noted that, the filling of pixels on the layer to be drawn to obtain the layer to be drawn according to the result of the fragment coloring processing of the primitive means that the pixel points obtained through the fragment coloring process are placed on the layer to be drawn. The canvas of the layer to be drawn is filled to obtain the layer to be drawn.

S508. Output and display the layer to be drawn.

It is worth noting that when the number of the layers to be drawn is more than two, before outputting and displaying the layers to be drawn, it also includes synthesizing the two or more layers to be drawn Processing generates a target image, and then outputs the target image for display. Wherein, the one used for combining two or more layers to be drawn to generate the target image may be a synthesizer, or an enhanced display controller; the one used for outputting and displaying the target image is an enhanced display controller.

It is worth noting that the object of the display method described in the embodiment of the present invention is not limited to the rotation and/or scaling of the layer, and can also be applied to other situations in the prior art that only involve the back-end processing of coordinate transformation . When the layer drawing method provided by the embodiment of the present invention is applied to a game application, the sliding of the game can be made smoother, and the special effect of the image can be increased.

It can be seen that when the display method provided by the embodiment of the present invention is used, the preprocessing is performed in the vertex transformation stage. Since the vertex transformation stage only targets fewer vertices, the technical solution provided by the embodiment of the present invention is used to perform the preprocessing The amount of data to be processed is relatively small, the processing speed is relatively fast, and the processing cost of image special effects involving coordinate transformation is reduced; moreover, when the number of layers to be drawn is more than two, the output displays the two The above layers need to be synthesized before to generate images. Based on the preprocessing of the layers to be drawn, the amount of data that needs to be processed during image synthesis is relatively small, which can further reduce the processing cost. Improve display performance.

Embodiment five

Please refer to accompanying drawing 6a, which is a structural block diagram of a terminal device 600 provided by the present invention. Specifically, the terminal device 600 can be a computer, a portable computer, a handheld device (such as a mobile phone, a PAD, etc.), a server, etc., and the terminal device For the logical structure diagram of 600, please refer to accompanying drawing 2. Specifically, as shown in FIG.

Wherein, the drawing engine 601 is used to receive drawing instructions, the drawing instructions include primitive information, vertex transformation information and fragment shading information; receive post-processing information, determine pre-processing information according to the post-processing information, and the post-processing information The processing information is used to represent the coordinate transformation processing of the layer to be drawn; based on the vertex transformation information in the drawing instruction, the coordinate transformation processing is performed on the vertex of the primitive corresponding to the primitive information to obtain the vertex transformation of the primitive intermediate results; based on the preprocessing information, perform coordinate transformation processing again on the intermediate results of the vertex transformation of the primitives to obtain the final results of the vertex transformations of the primitives; perform rasterization processing on the final results of the vertex transformations of the primitives , to obtain the rasterization processing result of the primitive; perform fragment shading processing on the rasterization processing result of the primitive based on the fragment shading information in the drawing instruction, and obtain the fragment shading processing result of the primitive; according to the The fragment shading processing result of the primitive is filled with pixels within the display range of the layer to be drawn to obtain the layer to be drawn.

Specifically, the drawing instruction received by the drawing engine 601 may be input by the user through touch screen touch, keyboard input, mouse click, etc., which is not limited in this embodiment of the present invention.

The post-processing information is used to represent the coordinate transformation processing of the layer to be drawn. The post-processing information includes rotation parameters, scaling parameters or a combination of both. The post-processing information may also include display layout (Source Crop) and Layer range (Display Frame), etc., where Source Crop indicates which part of the Buffer is collected for synthesis, and Display Frame indicates which area on the screen the Buffer is to be synthesized. Of course, the post-processing information can be used for Indicates that other coordinate transformations should be performed on the layer to be drawn, and there are no restrictive regulations here.

The preprocessing information is used to represent the coordinate transformation matrix for the intermediate result of the vertex transformation of the primitive. The preprocessing information includes a rotation matrix, a scaling matrix or a combination of the two. The preprocessing information may also include other It is the matrix that performs coordinate transformation again on the intermediate result of the vertex transformation of the primitive, and there are no restrictive regulations here.

As an embodiment of the present invention, when the post-processing information includes rotation parameters, the drawing engine 601 is specifically configured to determine a corresponding rotation matrix according to the rotation parameters, and the rotation matrix is used to represent the pre-processing information; it should be noted that, when the rotation parameter contained in the post-processing information is 90 or 270 degrees, the drawing engine 601 is also used for the layer to be drawn based on the rotation parameter The width attribute parameter and the height attribute parameter are adjusted so that the adjusted width attribute and height attribute of the layer to be drawn match the display range of the layer to be drawn.

As another embodiment of the present invention, when the post-processing information includes scaling parameters, the drawing engine 601 is specifically configured to determine a corresponding scaling matrix according to the scaling parameters, and the scaling matrix is used to represent the the above preprocessing information; it should be noted that the drawing engine 601 is also configured to adjust the width attribute parameters and high attribute parameters of the layer to be drawn based on the scaling parameters contained in the post-processing information, so that The adjusted width attribute and height attribute of the layer to be drawn match the display range of the layer to be drawn.

As another embodiment of the present invention, when the post-processing information includes not only rotation parameters but also scaling parameters, the drawing engine 601 is specifically configured to determine the corresponding rotation matrix according to the rotation parameters, and determine the corresponding rotation matrix according to the scaling parameters. The parameters determine the corresponding scaling matrix, and then determine the preprocessing matrix according to the product of the rotation matrix and the scaling matrix, and the preprocessing matrix is used to represent the preprocessing information; it should be noted that the drawing engine 601 It is also used to adjust the width attribute parameter and the height attribute parameter of the layer to be drawn based on the scaling parameter and the rotation parameter included in the post-processing information, so that the adjusted layer to be drawn The width attribute and height attribute of the layer match the display range of the layer to be drawn.

It is worth noting that the post-processing information received by the drawing engine 601 refers to the information used to indicate that the layer that has been drawn is processed in the layer rendering mode based on the OpenGL hardware standard in the prior art. The processing information includes rotating and/or scaling the drawn layer and other processing information related to coordinate transformation, which will not be listed here.

The display controller 603 is configured to output and display the layer to be drawn;

The display screen component 605 is used to display the layer to be drawn.

Specifically, when the number of the layers to be drawn is more than two, before outputting and displaying the layers to be drawn, it also includes using the display controller 603 to perform an operation on two or more of the layers to be drawn Layers are synthesized to generate a target image, and the target image is output for display, and the display screen component 605 is specifically used to display the target image.

It should be noted that, as another embodiment of the present invention, please refer to FIG. 6b, the terminal device 610 also includes a synthesizer 613, wherein when the number of layers to be drawn is more than two, the The synthesizer 613 is used to synthesize more than two layers to be drawn to generate a target image, and then the display controller 614 outputs and displays the target image generated by the synthesizer 613, and the display screen component 615 specifically uses to display the target image.

Of course, the terminal device 610 also includes a drawing engine 611, and the function of the drawing engine 611 in the terminal device 610 is the same as that of the drawing engine 601 in the terminal device 600, so its specific functions refer to the drawing engine 601 in the terminal device 600. The functions in it are enough, so I won’t repeat them here.

It can be seen that when using the terminal device described in the embodiment of the present invention to draw a layer and display the layer to be drawn, firstly, when drawing a layer, the preprocessing is performed in the vertex transformation stage, because the vertex transformation stage is only for Fewer vertices, so the amount of data that needs to be processed during preprocessing by the terminal device described in the embodiment of the present invention is relatively small, and the processing cost is relatively small; moreover, when the number of layers to be drawn is more than two When the output shows the two or more layers, they need to be synthesized to generate the target image. Based on the preprocessing of the layers to be drawn, the amount of data that needs to be processed during the synthesis is relatively small, and then Improve the display performance of the system to a certain extent.

Embodiment six

Correspondingly, the embodiment of the present invention also provides a terminal device. As shown in FIG. 7, the terminal device may include at least one processor 701, such as a CPU, at least one network interface 704, such as a physical network card, or other user interfaces 703 , and memory 705, display 706 and at least one communication bus 702.

Wherein, the communication bus 702 is used to realize connection and communication between these components.

The network interface 704 is used to realize connection and communication between the terminal device and the network, for example, the network interface 704 may be used to connect devices such as a physical network card and/or a physical switch.

Optionally, the user interface 703 may include a display, a keyboard, or other pointing devices, such as a mouse, a trackball (trackball), a touch panel, or a touch display screen.

The memory 705 may include a high-speed random access memory (RAM, Random Access Memory), and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory. Optionally, the memory 705 may also include at least one storage device located away from the aforementioned processor 701 .

In some implementations, the memory 705 stores the following elements, executable modules or data structures, or their subsets, or their extensions:

Operating system 7051, including various system programs, used to realize various basic services and handle hardware-based tasks;

The application module 7052 includes various application programs for realizing various application services.

Specifically, the processor 701 is configured to receive a drawing instruction, the drawing instruction includes primitive information, vertex transformation information, and fragment shading information; receive post-processing information, determine pre-processing information according to the post-processing information, and The post-processing information is used to represent the coordinate transformation processing of the layer to be drawn; based on the vertex transformation information in the drawing instruction, the coordinate transformation processing is performed on the vertex of the primitive corresponding to the primitive information to obtain the coordinate transformation of the primitive The intermediate result of vertex transformation; based on the preprocessing information, coordinate transformation processing is performed on the intermediate result of vertex transformation of the primitive to obtain the final result of vertex transformation of the primitive; rasterization is performed on the final result of vertex transformation of the primitive performing a fragment shading process on the rasterization processing result of the graphic element based on the fragment shading information in the drawing instruction to obtain a fragment shading processing result of the graphic element; Performing pixel filling within the display range of the layer to be drawn according to the fragment coloring processing result of the primitive to obtain the layer to be drawn, and outputting the layer to be drawn for display.

Specifically, when the number of the layers to be drawn is more than two, the processor 701 is further configured to perform synthesis processing on the two or more layers to be drawn to generate a target image and combine the The target image output is displayed.

As an embodiment of the present invention, the processor 701 is specifically configured to determine a corresponding rotation matrix according to the rotation parameters when the received post-processing information includes rotation parameters, and the pre-processing information is the rotation matrix. Specifically, when the rotation angle contained in the rotation parameter contained in the post-processing information is 90 or 270 degrees, the processor 701 is further configured to set the width attribute of the layer to be drawn based on the rotation parameter parameters and height attribute parameters are adjusted so that the adjusted width and height attributes match the display range of the layer to be drawn. It is worth noting that the processor 701 is also specifically configured to perform coordinate transformation processing on the first vertex coordinate representing the intermediate result of the vertex transformation of the primitive based on the rotation matrix to obtain the vertex transformation representing the primitive The second vertex coordinate of the final result, the primitive represented by the second vertex coordinate has a rotation effect relative to the primitive represented by the first vertex coordinate.

As another embodiment of the present invention, the processor 701 is specifically configured to determine a corresponding scaling matrix according to the scaling parameter when the post-processing information includes the scaling parameter, and the pre-processing information is the scaling matrix, which is worth It should be noted that the scaling parameters include vertical scaling parameters and/or horizontal scaling parameters, and determining the corresponding scaling matrix according to the scaling parameters is determining the corresponding scaling matrix according to the vertical scaling parameters and/or horizontal scaling parameters . It should be noted that, when the post-processing information includes a scaling parameter, the processor 701 is also configured to adjust the width attribute parameter and the high attribute parameter of the layer to be drawn based on the scaling parameter, so that the adjusted The following width and height attributes match the display range of the layer to be drawn. It should be noted that when the pre-processing information is a scaling matrix determined according to the scaling parameters included in the post-processing information, the processor 701 is specifically configured to represent the vertex of the primitive based on the scaling matrix pair Transform the first vertex coordinates of the intermediate result to the coordinate transformation process again to obtain the third vertex coordinates representing the final result of the vertex transformation of the primitive, and the primitive represented by the third vertex coordinates is expressed relative to the first vertex coordinates The primitives have the effect of scaling.

As another embodiment of the present invention, the processor 701 is specifically configured to determine the corresponding rotation matrix according to the rotation parameters when the post-processing information includes not only the rotation parameters but also the scaling parameters, and determine the corresponding rotation matrix according to the scaling parameters. get the corresponding scaling matrix, and then multiply the rotation matrix by the scaling matrix to obtain a preprocessing matrix, then the preprocessing information is the preprocessing matrix, it is worth noting that the scaling parameters include vertical scaling parameters and/or horizontal scaling parameters, the determining the corresponding scaling matrix according to the scaling parameters is determining the corresponding scaling matrix according to the vertical scaling parameters and/or horizontal scaling parameters. It should be noted that, when the post-processing information includes not only the rotation parameter but also the scaling parameter, the processor 701 is also configured to set the width attribute parameter of the layer to be drawn based on the rotation parameter and the scaling parameter and height attribute parameters are adjusted so that the adjusted width and height attributes match the display range of the layer to be drawn.

It should be noted that when the post-processing information includes rotation parameters and scaling parameters, and the scaling parameters include vertical scaling parameters and/or horizontal scaling parameters, the pre-processing information is a rotation matrix determined according to the rotation parameters When the preprocessing matrix is determined by multiplying the scaling matrix determined according to the scaling parameter, the processor 701 is specifically configured to re-determine the first vertex coordinate representing the intermediate result of the vertex transformation of the primitive based on the preprocessing matrix Carry out coordinate transformation processing to obtain the fourth vertex coordinate representing the final result of the vertex transformation of the primitive, and the primitive represented by the fourth vertex coordinate has the effect of rotation and scaling relative to the primitive represented by the first vertex coordinate .

It should be noted that the post-processing information refers to the information used to indicate that the drawn layer is processed in the layer rendering mode based on the OpenGL hardware standard in the prior art, and the post-processing information includes the finished drawing Layer rotation and/or scaling and other information related to coordinate transformation processing are not listed here. Correspondingly, the preprocessing information may be the rotation and/or scaling matrix and other matrices for transforming the vertex coordinates of primitives, and the functions that the processor 701 can implement include but are not limited to function.

The display 706 is used to display the layer to be drawn.

It should be noted that when the number of the layers to be drawn is more than two, the processor 701 is further configured to synthesize the two or more layers to be drawn to generate a target image, and then combine the The above target image output display. Correspondingly, the display 706 is used to display the target image.

For the specific implementation of each of the above devices, reference may be made to the foregoing embodiments, and details are not repeated here.

It can be seen that when using the terminal device described in the embodiment of the present invention to draw a layer and display the layer to be drawn, firstly, when drawing a layer, preprocessing is performed in the vertex transformation stage, because the vertex transformation stage is aimed at There are only fewer vertices, so when using the terminal device described in the embodiment of the present invention to perform preprocessing operations, the amount of data to be processed is relatively small, and the processing cost is relatively small; moreover, when the number of layers to be drawn is two When there are more than two layers, it is necessary to synthesize them before displaying the two or more layers to generate the target image. Based on the fact that the layers to be drawn have been pre-processed, the amount of data that needs to be processed when synthesizing is relatively small , which can improve the display performance of the system to a certain extent.

Those skilled in the art can appreciate that the units and algorithm steps of the examples described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are executed by hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions for each specific application, but such implementation should not be regarded as exceeding the scope of the present invention.

Those skilled in the art can clearly understand that for the convenience and brevity of the description, the specific working process of the above-described system, device and unit can refer to the corresponding process in the foregoing method embodiment, which will not be repeated here.

In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods may be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or May be integrated into another system, or some features may be ignored, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit.

If the functions described above are realized in the form of software function units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the essence of the technical solution of the present invention or the part that contributes to the prior art or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including Several instructions are used to make a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor execute all or part of the steps of the methods described in various embodiments of the present invention. The aforementioned storage media include: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or optical disk, and other media that can store program codes. .

The above is only a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Anyone skilled in the art can easily think of changes or substitutions within the technical scope disclosed in the present invention. Should be covered within the protection scope of the present invention. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.

Claims (25)

1. a kind of figure layer method for drafting is it is characterised in that methods described includes：

Receive drawing for order, in described drawing for order, comprise primitive information, summit information converting and segment shading information；

Receive post-processing information, pretreatment information is determined according to described post-processing information, described post-processing information is used for representing right Figure layer to be drawn does coordinate transform processing；

Coordinate change is carried out to the summit of the corresponding pel of described primitive information based on the summit information converting in described drawing for order Change process, obtain the summit conversion intermediate result of described pel；

Coordinate transform processing is carried out again to the summit conversion intermediate result of described pel based on described pretreatment information, obtains institute The summit stating pel converts ultimate result；

Rasterization process is carried out to the summit ultimate result of conversion of described pel, obtains the rasterization process result of described pel；

Based on the segment shading information in described drawing for order, the rasterization process result of described pel is carried out at segment coloring Reason, obtains the segment coloring treatment result of described pel；

Segment coloring treatment result according to described pel is described in carrying out pixel filling and obtaining in the indication range of described figure layer Figure layer to be drawn.

2. figure layer method for drafting according to claim 1 is it is characterised in that described reception post-processing information, according to described Post-processing information determines pretreatment information, including：

Receive post-processing information, described post-processing information includes rotation parameter；

Spin matrix is determined according to the rotation parameter that described post-processing information includes, described spin matrix represents described pretreatment Information；

Described coordinate transform processing is carried out again to the summit of described pel conversion intermediate result based on described pretreatment information, obtain Summit to described pel converts ultimate result, including：

Sat again based on the first apex coordinate that described spin matrix converts intermediate result to the summit representing described pel Mark conversion process, obtains representing that the summit of described pel converts the second apex coordinate of ultimate result, described second apex coordinate The pel that the pel representing represents with respect to described first apex coordinate has the effect of rotation.

3. figure layer method for drafting according to claim 1 is it is characterised in that described reception post-processing information, according to described Post-processing information determines pretreatment information, including：

Receive post-processing information, described post-processing information includes zooming parameter；

Scaled matrix is determined according to the zooming parameter that described post-processing information includes, described scaled matrix represents described pretreatment Information；

Described coordinate transform processing is carried out again to the summit of described pel conversion intermediate result based on described pretreatment information, obtain Summit to described pel converts ultimate result, including：

Sat again based on the first apex coordinate that described scaled matrix converts intermediate result to the summit representing described pel Mark conversion process, obtains representing that the summit of described pel converts the 3rd apex coordinate of ultimate result, described 3rd apex coordinate The pel that the pel representing represents with respect to described first apex coordinate has the effect of scaling.

4. figure layer method for drafting according to claim 1 is it is characterised in that described reception post-processing information, according to described Post-processing information determines pretreatment information, including：

Receive post-processing information, described post-processing information includes rotation parameter and zooming parameter；

Spin matrix is determined according to the rotation parameter that described post-processing information includes；

Scaled matrix is determined according to the zooming parameter that described post-processing information includes；

Described spin matrix is multiplied with described scaled matrix and obtains preconditioning matrix, described preconditioning matrix represents described pre- place Reason information；

Described coordinate transform processing is carried out again to the summit of described pel conversion intermediate result based on described pretreatment information, obtain Summit to described pel converts ultimate result, including：

Carried out again based on the first apex coordinate that described preconditioning matrix converts intermediate result to the summit representing described pel Coordinate transform processing, obtains representing that the summit of described pel converts the 4th apex coordinate of ultimate result, described 4th summit is sat The pel that the pel that mark represents represents with respect to described first apex coordinate has rotation and the effect of scaling.

5. figure layer method for drafting according to claim 2 is it is characterised in that in described reception post-processing information, described after After processing information includes rotation parameter, methods described also includes：

When the anglec of rotation representing in described rotation parameter is 90 or 270 degree, wait to draw to described based on described rotation parameter The wide property parameters of figure layer and high property parameters are adjusted so that the wide attribute after adjusting and high attribute are waited to draw with described The indication range of figure layer match；

In described the first apex coordinate that intermediate result is converted to the summit representing described pel based on described spin matrix again Carry out coordinate transform processing, after obtaining representing that the summit of described pel converts the second apex coordinate of ultimate result, also include：

According to the wide attribute after adjustment and high attribute, the second apex coordinate of ultimate result is converted to the summit representing described pel Carry out cutting, obtain the second apex coordinate after cutting；

The described summit to described pel converts ultimate result and carries out rasterization process, obtains the rasterization process knot of described pel Really, including：

Rasterization process is carried out to the second apex coordinate after described cutting, obtains the rasterization process result of described pel.

6. figure layer method for drafting according to claim 3 is it is characterised in that in described reception post-processing information, described after After processing information includes zooming parameter, methods described also includes：

Based on described zooming parameter, the wide property parameters of described figure layer to be drawn and high property parameters are adjusted so that adjusting Wide attribute after whole and high attribute are matched with the indication range of described figure layer to be drawn；

In described the first apex coordinate that intermediate result is converted to the summit representing described pel based on described scaled matrix again Carry out coordinate transform processing, after obtaining representing that the summit of described pel converts the 3rd apex coordinate of ultimate result, also include：

According to the wide attribute after adjustment and high attribute, the 3rd apex coordinate of ultimate result is converted to the summit representing described pel Carry out cutting, obtain the 3rd apex coordinate after cutting；

The described summit to described pel converts ultimate result and carries out rasterization process, obtains the rasterization process knot of described pel Really, including：

Rasterization process is carried out to the 3rd apex coordinate after described cutting, obtains the rasterization process result of described pel.

7. figure layer method for drafting according to claim 4 is it is characterised in that in described reception post-processing information, described after After processing information includes rotation parameter and zooming parameter, methods described also includes：

Based on described zooming parameter and described rotation parameter to the wide property parameters of described figure layer to be drawn and high property parameters It is adjusted so that the wide attribute after adjusting and high attribute are matched with the indication range of described figure layer to be drawn；

In described the first apex coordinate that intermediate result is converted to the summit representing described pel based on described preconditioning matrix again Secondary carry out coordinate transform processing, after obtaining representing that the summit of described pel converts the 4th apex coordinate of ultimate result, also wrap Include：

According to the wide attribute after adjustment and high attribute, the 4th apex coordinate of ultimate result is converted to the summit representing described pel Carry out cutting, obtain the 4th apex coordinate after cutting；

The described summit to described pel converts ultimate result and carries out rasterization process, obtains the rasterization process knot of described pel Really, including：

Rasterization process is carried out to the 4th apex coordinate after described cutting, obtains the rasterization process result of described pel.

8. a kind of drawing engine is it is characterised in that include：

Receiving unit, for receiving drawing for order, comprises primitive information, summit information converting and segment in described drawing for order Shading information；And be additionally operable to receive post-processing information, described post-processing information is used for representing that the figure layer treating drafting does coordinate Conversion process；

Pretreatment interface unit, for determining pretreatment information according to described post-processing information；

Vertex shader, for based on the summit information converting in described drawing for order to the corresponding pel of described primitive information Summit carries out coordinate transform processing, obtains the summit conversion intermediate result of described pel；And be additionally operable to based on described pretreatment Information carries out coordinate transform processing again to the summit conversion intermediate result of described pel, obtains the summit conversion of described pel eventually Pole result；

Rasterizer, carries out rasterization process for converting ultimate result to the summit of described pel, obtains the light of described pel Gated result；

Fragment shader, for the rasterization process result to described pel based on the segment shading information in described drawing for order Carry out segment coloring treatment, obtain the segment coloring treatment result of described pel；

Figure layer obtaining unit, for the segment coloring treatment result according to described pel described figure layer to be drawn display model Carry out in enclosing pixel filling obtain described in figure layer to be drawn.

9. drawing engine according to claim 8 it is characterised in that：

In the described operation receiving post-processing information, described receiving unit includes the post processing of rotation parameter specifically for receiving Information；

Described pretreatment interface unit specifically for spin matrix is determined according to the rotation parameter that described post-processing information includes, Described spin matrix represents described pretreatment information；

Described, coordinate transform processing is carried out again to the summit conversion intermediate result of described pel based on described pretreatment information, The summit obtaining described pel converts in the operation of ultimate result, and described vertex shader is specifically for based on described spin matrix The first apex coordinate converting intermediate result to the summit representing described pel carries out coordinate transform processing again, obtains representing institute The summit stating pel converts the second apex coordinate of ultimate result, and the pel that wherein said second apex coordinate represents is with respect to institute State the effect that the pel that the first apex coordinate represents has rotation.

10. drawing engine according to claim 8 it is characterised in that：

Described receiving unit includes the post-processing information of zooming parameter specifically for receiving；

Described pretreatment interface unit specifically for scaled matrix is determined according to the zooming parameter that described post-processing information includes, Described scaled matrix represents described pretreatment information；

Described, coordinate transform processing is carried out again to the summit conversion intermediate result of described pel based on described pretreatment information, The summit obtaining described pel converts in the operation of ultimate result, and described vertex shader is specifically for based on described scaled matrix The first apex coordinate converting intermediate result to the summit representing described pel carries out coordinate transform processing again, obtains representing institute The summit stating pel converts the 3rd apex coordinate of ultimate result, and the pel that described 3rd apex coordinate represents is with respect to described the The pel that one apex coordinate represents has the effect of scaling.

11. drawing engines according to claim 8 it is characterised in that：

Described receiving unit includes the post-processing information of rotation parameter and zooming parameter specifically for receiving；

Described pretreatment interface unit specifically for spin matrix is determined according to the rotation parameter that described post-processing information includes, Scaled matrix is determined according to the zooming parameter that described post-processing information includes, by described spin matrix and described scaled matrix phase Multiplied to preconditioning matrix, described preconditioning matrix represents described pretreatment information；

Described, coordinate transform processing is carried out again to the summit conversion intermediate result of described pel based on described pretreatment information, The summit obtaining described pel converts in the operation of ultimate result, and described vertex shader is specifically for based on described pretreatment square The first apex coordinate that battle array converts intermediate result to the summit representing described pel carries out coordinate transform processing again, is represented The summit of described pel converts the 4th apex coordinate of ultimate result, and the pel that described 4th apex coordinate represents is with respect to described The pel that first apex coordinate represents has rotation and the effect of scaling.

12. drawing engines according to claim 9 it is characterised in that：

When the anglec of rotation that described pretreatment interface unit is additionally operable to represent in described rotation parameter is 90 or 270 degree, it is based on Described rotation parameter is adjusted the width so that after adjusting to the described wide property parameters wait the figure layer drawn and high property parameters Attribute and high attribute are matched with the indication range of described figure layer to be drawn；

Described vertex shader is additionally operable to according to the wide attribute after adjusting and high attribute, whole to the summit conversion representing described pel Second apex coordinate of pole result carries out cutting, obtains the second apex coordinate after cutting；

Described rasterizer, specifically for carrying out rasterization process to the second apex coordinate after described cutting, obtains described pel Rasterization process result.

13. drawing engines according to claim 10 it is characterised in that：

Described pretreatment interface unit be additionally operable to based on described zooming parameter to the wide property parameters of described figure layer to be drawn and High property parameters are adjusted the indication range phase so that wide attribute after adjusting and high attribute and described figure layer to be drawn Join；

Described vertex shader is additionally operable to according to the wide attribute after adjusting and high attribute, whole to the summit conversion representing described pel 3rd apex coordinate of pole result carries out cutting, obtains the 3rd apex coordinate after cutting；

Described rasterizer, specifically for carrying out rasterization process to the 3rd apex coordinate after described cutting, obtains described pel Rasterization process result.

14. drawing engines according to claim 11 it is characterised in that：

Described pretreatment interface unit is additionally operable to based on described zooming parameter and described rotation parameter to described figure layer to be drawn Wide property parameters and high property parameters are adjusted so that wide attribute after adjusting and high attribute and described figure layer to be drawn Indication range match；

Described vertex shader is additionally operable to according to the wide attribute after adjusting and high attribute, and to expression, described summit converts ultimate result The 4th apex coordinate carry out cutting, obtain the 4th apex coordinate after cutting；

Described rasterizer, specifically for carrying out rasterization process to the 4th apex coordinate after described cutting, obtains described pel Rasterization process result.

A kind of 15. display packings are it is characterised in that methods described includes：

Receive drawing for order, in described drawing for order, comprise primitive information, summit information converting and segment shading information；

Receive post-processing information, pretreatment information is determined according to described post-processing information, described post-processing information is used for representing right Figure layer to be drawn does coordinate transform processing；

Coordinate change is carried out to the summit of the corresponding pel of described primitive information based on the summit information converting in described drawing for order Change process, obtain the summit conversion intermediate result of described pel；

Coordinate transform processing is carried out again to the summit conversion intermediate result of described pel based on described pretreatment information, obtains institute The summit stating pel converts ultimate result；

Rasterization process is carried out to the summit ultimate result of conversion of described pel, obtains the rasterization process result of described pel；

Based on the segment shading information in described drawing for order, the rasterization process result of described pel is carried out at segment coloring Reason, obtains the segment coloring treatment result of described pel；

Pixel filling is carried out in the indication range of described figure layer to be drawn according to the segment coloring treatment result of described pel Figure layer to be drawn described in obtaining；

By described figure layer output display to be drawn.

16. display packings according to claim 15 it is characterised in that：

When the described number wait the figure layer drawn is two or more,

Described by described figure layer output display to be drawn, including：

Plural described figure layer to be drawn is carried out with synthesis process generation target image and export described target image Display.

17. display packings according to claim 15 or 16 it is characterised in that described reception post-processing information, according to institute State post-processing information and determine pretreatment information, including：

Receive post-processing information, described post-processing information includes rotation parameter；

Spin matrix is determined according to the rotation parameter that described post-processing information includes, described spin matrix represents described pretreatment Information；

Described coordinate transform processing is carried out again to the summit of described pel conversion intermediate result based on described pretreatment information, obtain Summit to described pel converts ultimate result, including：

Sat again based on the first apex coordinate that described spin matrix converts intermediate result to the summit representing described pel Mark conversion process, obtains representing that the summit of described pel converts the second apex coordinate of ultimate result, described second apex coordinate The pel that the pel representing represents with respect to described first apex coordinate has the effect of rotation.

18. display packings according to claim 15 or 16 it is characterised in that described reception post-processing information, according to institute State post-processing information and determine pretreatment information, including：

Receive post-processing information, described post-processing information includes zooming parameter；

Scaled matrix is determined according to the zooming parameter that described post-processing information includes, described scaled matrix represents described pretreatment Information；

Described coordinate transform processing is carried out again to the summit of described pel conversion intermediate result based on described pretreatment information, obtain Summit to described pel converts ultimate result, including：

Sat again based on the first apex coordinate that described scaled matrix converts intermediate result to the summit representing described pel Mark conversion process, obtains representing that the summit of described pel converts the 3rd apex coordinate of ultimate result, described 3rd apex coordinate The pel that the pel representing represents with respect to described first apex coordinate has the effect of scaling.

19. display packings according to claim 15 or 16 it is characterised in that described reception post-processing information, according to institute State post-processing information and determine pretreatment information, including：

Receive post-processing information, described post-processing information includes rotation parameter and zooming parameter；

Spin matrix is determined according to the rotation parameter that described post-processing information includes；

Scaled matrix is determined according to the zooming parameter that described post-processing information includes；

Described spin matrix is multiplied with described scaled matrix and obtains preconditioning matrix, described preconditioning matrix represents described pre- place Reason information；

Described coordinate transform processing is carried out again to the summit of described pel conversion intermediate result based on described pretreatment information, obtain Summit to described pel converts ultimate result, including：

Carried out again based on the first apex coordinate that described preconditioning matrix converts intermediate result to the summit representing described pel Coordinate transform processing, obtains representing that the summit of described pel converts the 4th apex coordinate of ultimate result, described 4th summit is sat The pel that the pel that mark represents represents with respect to described first apex coordinate has rotation and the effect of scaling.

20. display packings according to claim 17 it is characterised in that in described reception post-processing information, described after locate After reason information includes rotation parameter, methods described also includes：

When the anglec of rotation representing in described rotation parameter is 90 or 270 degree, wait to draw to described based on described rotation parameter The wide property parameters of figure layer and high property parameters are adjusted so that the wide attribute after adjusting and high attribute are waited to draw with described The indication range of figure layer match；

In described the first apex coordinate that intermediate result is converted to the summit representing described pel based on described spin matrix again Carry out coordinate transform processing, after obtaining representing that the summit of described pel converts the second apex coordinate of ultimate result, also include：

According to the wide attribute after adjustment and high attribute, the second apex coordinate of ultimate result is converted to the summit representing described pel Carry out cutting, obtain the second apex coordinate after cutting；

The described summit to described pel converts ultimate result and carries out rasterization process, obtains the rasterization process knot of described pel Really, including：

Rasterization process is carried out to the second apex coordinate after described cutting, obtains the rasterization process result of described pel.

21. display packings according to claim 18 it is characterised in that in described reception post-processing information, described after locate After reason information includes zooming parameter, methods described also includes：

Based on described zooming parameter, the wide property parameters of described figure layer to be drawn and high property parameters are adjusted so that adjusting Wide attribute after whole and high attribute are matched with the indication range of described figure layer to be drawn；

In described the first apex coordinate that intermediate result is converted to the summit representing described pel based on described scaled matrix again Carry out coordinate transform processing, after obtaining representing that the summit of described pel converts the 3rd apex coordinate of ultimate result, also include：

According to the wide attribute after adjustment and high attribute, the 3rd apex coordinate of ultimate result is converted to the summit representing described pel Carry out cutting, obtain the 3rd apex coordinate after cutting；

The described summit to described pel converts ultimate result and carries out rasterization process, obtains the rasterization process knot of described pel Really, including：

Rasterization process is carried out to the 3rd apex coordinate after described cutting, obtains the rasterization process result of described pel.

22. display packings according to claim 19 it is characterised in that in described reception post-processing information, described after locate After reason information includes rotation parameter and zooming parameter, methods described also includes：

Based on described zooming parameter and described rotation parameter to the wide property parameters of described figure layer to be drawn and high property parameters It is adjusted so that the wide attribute after adjusting and high attribute are matched with the indication range of described figure layer to be drawn；

In described the first apex coordinate that intermediate result is converted to the summit representing described pel based on described preconditioning matrix again Secondary carry out coordinate transform processing, after obtaining representing that the summit of described pel converts the 4th apex coordinate of ultimate result, also wrap Include：

According to the wide attribute after adjustment and high attribute, the 4th apex coordinate of ultimate result is converted to the summit representing described pel Carry out cutting, obtain the 4th apex coordinate after cutting；

The described summit to described pel converts ultimate result and carries out rasterization process, obtains the rasterization process knot of described pel Really, including：

Rasterization process is carried out to the 4th apex coordinate after described cutting, obtains the rasterization process result of described pel.

A kind of 23. terminal units are it is characterised in that include display controller, display screen assembly and as claim 8-14 Drawing engine described in any one, wherein：

Described display controller be used for by described drawing engine obtain described in figure layer output display to be drawn to described display On screen assembly.

24. terminal units according to claim 23 it is characterised in that：

When the described number wait the figure layer drawn is two or more, described display controller is specifically for by described drawing engine The plural described figure layer to be drawn obtaining carries out being synthetically generated target image and by described target image output display To on described display screen assembly.

25. terminal units according to claim 23 are it is characterised in that also include synthesizer, wherein:

When the described number wait the figure layer drawn is two or more, described synthesizer is used for obtain described drawing engine two Individual above described in figure layer to be drawn carry out being synthetically generated target image；

Described display controller is specifically for by described target image output display to described display screen assembly.