WO2024066559A1 - Rendering method, apparatus and system, electronic device, and storage medium - Google Patents

Abstract

Provided are a rendering method, apparatus and system for use in illumination simulation, a scene interaction method, for use in illumination simulation, for a lamp model made of a self-luminous material, an electronic device, and a storage medium, relating to the technical fields of computer image processing and decoration design. The rendering method for use in illumination simulation comprises: acquiring light parameters of lamp sets to be adjusted of a scene to be rendered; according to the light parameters, determining target image parameters of light layers corresponding to said lamp sets; according to the target image parameters, performing post-processing on the light layers corresponding to said lamp sets; and obtaining a target image of said scene on the basis of the light layers respectively corresponding to the lamp sets of said scene.

Description

Rendering method, device and system, electronic device and storage medium Technical Field

The present disclosure relates to the technical field of computer image processing and interior design, and in particular to a rendering method in lighting simulation, a rendering device in lighting simulation, a rendering system in lighting simulation, a scenario interaction method of a lamp model with self-luminous material in lighting simulation, an electronic device and a storage medium.

Background technique

When designers are designing house decoration, in order to further improve the design effect, in addition to the necessary scene design, they also need to set the lighting layout, and then the home lighting simulation system comes into being.

In related lighting simulation systems, for example, as disclosed in patent application CN114299219A, each time a design is modified, such as modifying lighting parameters, the rendering engine needs to be re-called to render the scene rendering image, which consumes a large amount of rendering resources and increases the cost of use.

Summary of the invention

According to a first aspect of the present disclosure, a rendering method in lighting simulation is provided, which is applied to a terminal and includes: obtaining lighting parameters of a light group to be adjusted of a scene to be rendered; wherein the scene to be rendered is associated with at least one light group, and the at least one light group includes the light group to be adjusted; according to the lighting parameters, determining target image parameters of a light layer corresponding to the light group to be adjusted; wherein the target image parameters include at least one of a target brightness and a target color temperature; according to at least one of the target brightness and the target color temperature, post-processing the light layer corresponding to the light group to be adjusted; wherein layer data corresponding to the scene to be rendered is included in the terminal, and the layer data includes initial light layers corresponding to at least one light group respectively; and obtaining a target image of the scene to be rendered based on the light layers corresponding to at least one light group respectively.

In one embodiment, the method may further include: obtaining layer data from a server in advance; wherein the layer data is obtained by the server performing rendering calculations on each of at least one light group according to rendering process parameters.

In one implementation, the rendering process parameters may include: at least one of overflow correction, highlight correction, color enhancement, or convergence termination conditions.

In one embodiment, post-processing the light layer corresponding to the light group to be adjusted according to at least one of the target brightness and the target color temperature may include: post-processing the initial light layer corresponding to the light group to be adjusted according to at least one of the target brightness and the target color temperature; or post-processing the light layer corresponding to the light group to be adjusted that has been post-processed at least once according to at least one of the target brightness and the target color temperature.

In one embodiment, obtaining a target image of a scene to be rendered based on light layers respectively corresponding to at least one light group may include: when at least one light group is a plurality of light groups, superimposing light layers respectively corresponding to the plurality of light groups.

In one implementation, superimposing light layers corresponding to the plurality of light groups may include: performing color temperature superposition calculation using a normalization method.

In one implementation, the color temperature superposition calculation method may include: multiplying each light layer by its brightness adjustment factor and color temperature adjustment weight.

In one embodiment, the post-processing may include at least one of automatic exposure, white balance, or tone mapping, wherein the tone mapping includes a Reinhard method.

In one implementation, obtaining the lighting parameters of the light group to be adjusted of the scene to be rendered may include: determining the light group to be adjusted according to the selected lighting point.

In one embodiment, the method may further include: obtaining camera parameters and world coordinates of the light group to be adjusted; converting the world coordinates of the light group to be adjusted into coordinates on a two-dimensional image based on the camera parameters; and presenting light points based on the coordinates on the two-dimensional image.

In one embodiment, the method may further include: prompting the user to select a light point through a prompt circle; and, in response to the light point being selected, determining a light layer corresponding to the light group to be adjusted.

In one embodiment, the lighting parameter includes at least one of brightness, color temperature, or color.

According to a second aspect of the present disclosure, a rendering method in lighting simulation is provided, which is applied to a server, comprising: performing rendering calculations on a scene to be rendered according to rendering process parameters to obtain layer data; wherein the scene to be rendered is associated with at least one light group, and the layer data includes initial light layers corresponding to the at least one light group; and The layer data is transmitted to the terminal; wherein the server does not perform post-processing during the rendering calculation for the scene to be rendered.

In one embodiment, the method may further include: obtaining rendering process parameters; wherein the rendering process parameters include: at least one of overflow correction, highlight correction, color enhancement, or convergence termination conditions.

In one implementation, before transmitting the layer data to the terminal, the method may further include: encoding the layer data using an encoding method that reduces the space occupied by the image.

According to a third aspect of the present disclosure, there is provided a device for rendering in lighting simulation, which is arranged in a terminal and includes: an acquisition unit, configured to acquire lighting parameters of a light group to be adjusted of a scene to be rendered; wherein the scene to be rendered is associated with at least one light group, and the at least one light group includes the light group to be adjusted; and a processing unit, configured to determine target image parameters of a light layer corresponding to the light group to be adjusted according to the lighting parameters; wherein the target image parameters include at least one of a target brightness and a target color temperature; according to at least one of the target brightness and the target color temperature, post-processing the light layer corresponding to the light group to be adjusted; wherein layer data corresponding to the scene to be rendered is included in the terminal, and the layer data includes initial light layers corresponding to at least one light group respectively; and based on the light layers corresponding to at least one light group respectively, a target image of the scene to be rendered is obtained.

According to a fourth aspect of the present disclosure, there is provided a device for rendering in lighting simulation, which is arranged in a server and includes: a rendering unit, configured to perform rendering calculations on a scene to be rendered according to rendering process parameters to obtain layer data; wherein the scene to be rendered is associated with at least one light group, and the layer data includes an initial light layer corresponding to the at least one light group; and a transmission unit, configured to transmit the layer data to a terminal; wherein the rendering unit does not perform post-processing during the process of performing rendering calculations on the scene to be rendered.

According to a fifth aspect of the present disclosure, a system for rendering in lighting simulation is provided, comprising: a server, configured to perform rendering calculations on a scene to be rendered according to rendering process parameters to obtain layer data; wherein the scene to be rendered is associated with at least one light group, and the layer data includes initial light layers corresponding to the at least one light group; and transmitting the layer data to a terminal device; wherein the server does not perform post-processing during the process of performing rendering calculations on the scene to be rendered; and the terminal device, configured to obtain Light parameters of a light group to be adjusted of a scene to be rendered; wherein the light group to be adjusted is included in at least one light group; according to the light parameters, target image parameters of a light layer corresponding to the light group to be adjusted are determined; wherein the target image parameters include at least one of a target brightness and a target color temperature; according to at least one of the target brightness and the target color temperature, post-processing the light layer corresponding to the light group to be adjusted; and obtaining a target image of the scene to be rendered based on the light layers respectively corresponding to at least one light group.

According to a sixth aspect of the present disclosure, a scenario interaction method for a lamp model with a self-luminous material in a lighting simulation is provided, comprising: obtaining data of the lamp model with a self-luminous material; converting the data of the lamp model with a self-luminous material into universal format data that can be used for layer separation; separating each lamp model and the IES corresponding to the lamp model from the universal format data into a single layer to obtain a plurality of separate lamp model layers; wherein the lamp model comprises a single lamp model, and/or a lamp model group formed by a plurality of lamp models; obtaining lighting parameters of the lamp model to be adjusted; rendering the separate lamp model layer corresponding to the lamp model to be adjusted according to the lighting parameters; and displaying the rendering result to achieve scenario interaction.

In one embodiment, separating each lamp model from the general format data into a single layer may include: filtering the lamp model layer from the general format data; wherein filtering the lamp model layer from the general format data includes: when the lamp model is a solid color lamp model without a texture, extracting at least one of the object name of the lamp model, the location information of the lamp model, the material information of the lamp model, the self-luminous property of the lamp model, or the diffuse reflection property of the lamp model; and, when the lamp model has a texture, extracting at least one of the object name of the lamp model, the location information of the lamp model, the material information of the lamp model, the self-luminous property of the lamp model, the information of the lamp model's texture, or the diffuse reflection property of the lamp model; wherein the self-luminous properties include light color and/or light intensity.

In one embodiment, the method may further include: adding a light on/off logic of the lamp model; and, according to the light on/off logic, presenting the light on/off effect of the lamp model during the rendering process; wherein, according to the light on/off logic, presenting the light on/off effect of the lamp model during the rendering process includes: in the case of rendering a separate lamp model layer, reading the self-luminous property of the lamp model; and, in the case of rendering other layers, reading the self-luminous property of the lamp model. Diffuse properties of .

In one embodiment, when the general format data is lightmesh data, according to the light on/off logic, the light on/off effect of the lamp model is presented during the rendering process, which may include: enlarging the size corresponding to the lightmesh data of the individual lamp model by a set multiple and retaining the self-luminous property, so that when rendering a separate lamp model layer, the self-luminous property of the individual lamp model can be read to achieve the display of the light on effect; and retaining the diffuse reflection property of the individual lamp model, so that when rendering other layers, the diffuse reflection property of the individual lamp model can be read to achieve the display of the light off effect.

In one embodiment, when the general format data is vraymtl data, the on/off light effect of the lamp model is presented during the rendering process according to the on/off light logic, which may include: when the vraymtl data of a separate lamp model includes a self-luminous attribute value, and when rendering a separate lamp model layer, the self-luminous attribute value of the separate lamp model is read to achieve the display of the light-on effect; and, when rendering other layers, the diffuse reflection attribute of the separate lamp model is read to achieve the display of the light-off effect.

According to the seventh aspect of the present disclosure, an electronic device is provided, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor, so that the at least one processor executes the method provided in the first aspect, the second aspect or the sixth aspect above.

According to an eighth aspect of the present disclosure, a non-transitory computer-readable storage medium storing computer instructions is provided, wherein the computer instructions are used to enable the computer to execute the method provided by the first aspect, the second aspect or the sixth aspect above.

It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings are used to better understand the present solution and do not constitute a limitation of the present disclosure.

FIG1 is a schematic flow chart of a rendering method in lighting simulation provided by an embodiment of the present disclosure.

FIG. 2 is another schematic flow chart of a rendering method in lighting simulation provided by an embodiment of the present disclosure.

FIG. 3 is another schematic flow chart of a rendering method in lighting simulation provided by an embodiment of the present disclosure.

FIG. 4 is another schematic flow chart of a rendering method in lighting simulation provided by an embodiment of the present disclosure.

FIG. 5 is a schematic diagram of the architecture of a system for rendering in lighting simulation provided by an embodiment of the present disclosure.

FIG. 6 is a flow chart of a scenario interaction method for a lamp model with a self-luminous material in a lighting simulation provided by an embodiment of the present disclosure.

FIG. 7 is another flow chart of a scenario interaction method for a lamp model with a self-luminous material in a lighting simulation provided by an embodiment of the present disclosure.

FIG. 8 is a schematic block diagram of an electronic device provided by an embodiment of the present disclosure.

Detailed ways

The present disclosure is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present disclosure and are not used to limit the present disclosure.

Unless otherwise specified, the terms (including scientific and technological terms) used in this embodiment have the commonly understood meanings to those skilled in the art. In addition, it is understood that the terms defined in commonly used dictionaries should be understood to have the same meanings as those in the context of the relevant fields, and should not be understood as idealized or overly formal meanings.

The following are definitions of some terms:

WebP image format: a highly compressed sRGB (standard Red Green Blue) data format.

PNG image format: PNG (Portable Network Graphics), portable network graphics, is a bitmap format that uses a lossless compression algorithm. It supports index, grayscale, RGB (Red Green Blue) three color schemes and Alpha channel and other features.

EXR image format: a high-dynamic linear image data.

Tone Mapping: Used to convert colors from their original hue (usually High dynamic range, HDR) is mapped to a target tone (usually low dynamic range, LDR).

Directly render the image: The design platform directly renders the image after fixing the viewing angle.

Scenario interaction results: After scenario configuration of the lighting simulation in the design platform, the animation effect of the lighting simulation is obtained.

In addition, the front end mentioned in this article may refer to a terminal (ie, a terminal device), and the back end may refer to a server.

The embodiment of the present disclosure provides a rendering method in lighting simulation. As shown in FIG1 , it is a flow chart of a rendering method in lighting simulation provided by the embodiment of the present disclosure, and the rendering method in lighting simulation includes S101 to S106.

In S101, the server performs rendering calculations on the scene to be rendered according to the rendering process parameters to obtain layer data; wherein the scene to be rendered is associated with at least one light group, and the layer data includes initial light layers corresponding to the at least one light group; wherein the server does not perform post-processing during the process of performing rendering calculations on the scene to be rendered.

In one embodiment, the scene to be rendered may be associated with one light group or multiple light groups. The at least one light group associated with the scene to be rendered may refer to all light groups that affect the lighting effect of the scene to be rendered. For example, for a living room, all light groups associated with the living room may include light groups located in the living room space and light groups located in the corridor space connecting the living room and the bedroom. In addition, any light group may include one or more lamps.

In one embodiment, the server may also establish a mapping relationship between the identification information of the scene to be rendered and the identification information of at least one light group. The server may also establish a mapping relationship between at least one light group and the identification information of the initial light layer corresponding to the at least one light group. The embodiments of the present disclosure will not be described in detail herein.

In one embodiment, the rendering method in the lighting simulation may further include, before S101: the server receives a rendering request sent by the terminal. That is, the server may receive a rendering request sent by the terminal, and in response to the rendering request, perform rendering calculations for the scene to be rendered according to the rendering process parameters. The rendering request may carry rendering process parameters and/or information related to the scene to be rendered. The information related to the scene to be rendered may include identification information of the scene to be rendered, layout information of the scene to be rendered, light group information associated with the scene to be rendered, etc. As long as the server can perform rendering calculations for the scene to be rendered according to the rendering request and pre-stored information, It is sufficient to perform rendering calculations on the scene to be rendered, and the embodiments of the present disclosure do not impose any limitation on this.

It should also be noted that the terminal sending the rendering request may be triggered by a user clicking, dragging, and/or inputting on the terminal interface. In other words, the server may perform rendering calculations for the scene to be rendered in response to the user's operation.

In S102, the server transmits the layer data to the terminal.

In one implementation, the server may encode the layer data using an encoding method that reduces the space occupied by the image and then transmit the encoded layer data to the terminal, and the terminal decodes the received layer data.

It should be noted that the server can transmit the layer data to the terminal by pushing or pulling, that is, the server can actively send the layer data to the terminal, or the terminal can actively obtain the layer data from the server. The present embodiment does not impose any limitation on this.

In one embodiment, the server may also transmit to the terminal a mapping relationship between identification information of a scene to be rendered and identification information of at least one light group, and/or a mapping relationship between at least one light group and identification information of an initial light layer corresponding to the at least one light group, and the embodiments of the present disclosure will not be elaborated herein.

In S103, the terminal obtains the lighting parameters of the light group to be adjusted of the scene to be rendered.

In one embodiment, the light group to be adjusted is included in at least one light group associated with the scene to be rendered, and the light group to be adjusted may be part or all of the at least one light group associated with the scene to be rendered. That is, on the terminal side, the light parameters of all the light groups associated with the scene to be rendered may be adjusted, or the light parameters of some of the light groups associated with the scene to be rendered may be adjusted.

In one embodiment, the terminal obtains the lighting parameters of the light group to be adjusted for the scene to be rendered, which may specifically include: the terminal receives a lighting parameter adjustment request input by a user, and the lighting parameter adjustment request may include identification information of the light group to be adjusted, and/or the lighting parameters of the light group to be adjusted.

It should be noted that the user can input a lighting parameter adjustment request by clicking, dragging, and/or inputting on the terminal interface. In other words, the terminal can adjust the lighting parameters of the light group to be adjusted in response to the user's operation.

In S104, the terminal determines the light corresponding to the light group to be adjusted according to the light parameters. The target image parameters of the layer; wherein the target image parameters include at least one of a target brightness and a target color temperature.

In one embodiment, the lighting parameter may include at least one of color temperature and brightness, that is, on the terminal side, for any light group to be adjusted, only the color temperature of the light group to be adjusted may be adjusted, only the brightness of the light group to be adjusted may be adjusted, or both the color temperature and the brightness of the light group to be adjusted may be adjusted. In addition, for all light groups to be adjusted, the categories of the lighting parameters to be adjusted (i.e., brightness and/or color temperature) may be the same or different.

In one embodiment, determining the target brightness of the light layer corresponding to the light group to be adjusted according to the light parameters may include: determining a brightness adjustment factor according to the brightness of the light group to be adjusted; and determining the target brightness as the product of the brightness of the current light layer corresponding to the light group to be adjusted and the brightness adjustment factor.

In one embodiment, determining the target color temperature of the light layer corresponding to the light group to be adjusted according to the light parameters may include: determining the first color of the light group to be adjusted and the second color of the basic light according to the color temperature of the light group to be adjusted and the basic color temperature; determining the color temperature adjustment weight as the ratio of the first color to the second color; and determining the target color temperature as the product of the color temperature of the current light layer corresponding to the light group to be adjusted and the color temperature adjustment weight.

In a preferred embodiment, the current light layer corresponding to the light group to be adjusted may be the initial light layer corresponding to the light group to be adjusted. That is, when the light parameters of the light group to be adjusted are set or the light parameters of the light group to be adjusted are changed, the terminal may adjust the initial light layer corresponding to the light group to be adjusted obtained by the server rendering according to the light parameters of the light group to be adjusted.

In another embodiment, the current light layer corresponding to the light group to be adjusted may be a light layer corresponding to the light group to be adjusted that has been post-processed at least once. That is, when setting the light parameters of the light group to be adjusted, or when the light parameters of the light group to be adjusted change, the terminal may also determine the target image parameters based on the light parameters of the light group to be adjusted and the light layer corresponding to the light group to be adjusted obtained in the last adjustment process, and adjust the light layer corresponding to the light group to be adjusted obtained in the last adjustment process according to the target image parameters. That is to say, the inventive concept of the present disclosure is to render the light groups associated with the scene to be rendered on the server side, respectively, and obtain the light layers corresponding to the light groups respectively. When the lighting parameters of the lighting group to be adjusted need to be set or changed, the terminal side can adjust the initial lighting layer corresponding to the lighting group to be adjusted once or multiple times in a progressive manner to obtain the target lighting layer, and finally obtain the target image of the scene to be rendered based on the target lighting layer.

In S105, the terminal performs post-processing on the light layer corresponding to the light group to be adjusted according to at least one of the target brightness and the target color temperature.

In one embodiment, post-processing the light layer corresponding to the light group to be adjusted according to at least one of the target brightness and the target color temperature may include: according to the target brightness, the terminal automatically exposes the light layer corresponding to the light group to be adjusted, that is, the terminal adjusts the brightness of the light layer corresponding to the light group to be adjusted according to the target brightness.

In one embodiment, post-processing the light layer corresponding to the light group to be adjusted according to at least one of the target brightness and the target color temperature may include: according to the target color temperature, the terminal performs white balance processing on the light layer corresponding to the light group to be adjusted, that is, the terminal performs color adjustment on the light layer corresponding to the light group to be adjusted according to the target color temperature.

In one embodiment, post-processing the light layer corresponding to the light group to be adjusted according to at least one of the target brightness and the target color temperature may include: according to the target brightness and the target color temperature, the terminal performs tone mapping processing on the light layer corresponding to the light group to be adjusted, that is, the terminal adjusts the pixel value of the light layer corresponding to the light group to be adjusted according to the target brightness and the target color temperature.

In S106, the terminal obtains a target image of the scene to be rendered based on the light layers respectively corresponding to the at least one light group.

In one embodiment, when at least one light group associated with the scene to be rendered is one light group, that is, only one light group to be adjusted is associated with the scene to be rendered, a target light layer obtained by post-processing the light layer corresponding to the light group to be adjusted can be used as the target image of the scene to be rendered without superimposing other light layers.

In one embodiment, when there are multiple light groups associated with at least one light group to be rendered, light layers corresponding to the multiple light groups respectively (including target light layers obtained by post-processing the light layers corresponding to the light groups to be adjusted) can be superimposed to obtain a target image of the scene to be rendered.

It should be noted that for the scene interaction mode of lighting simulation, it is only necessary to Adjust the lighting parameters of the lighting group, determine the target image parameters of the lighting layer corresponding to the lighting group to be adjusted at multiple moments; and for each of the multiple moments, post-process the lighting layer corresponding to the lighting group to be adjusted according to the target image parameters corresponding to the moment and generate a target image frame of the scene to be rendered corresponding to the moment; finally, arrange the multiple target image frames corresponding to the multiple moments in chronological order to generate a scene interactive effect animation to dynamically display the lighting effect of the scene to be rendered.

According to an embodiment of the present disclosure, on the server side, rendering calculation can be performed on each of at least one light group associated with the scene to be rendered without performing post-processing according to the rendering process parameters, so as to obtain an initial light layer corresponding to the at least one light group respectively; on the terminal side, the target brightness and/or target color temperature of the light layer corresponding to the light group to be adjusted can be determined according to the obtained light parameters of the light group to be adjusted, and the light layer corresponding to the light group to be adjusted can be post-processed according to the target brightness and/or target color temperature, so that the brightness and/or color temperature of the light layer corresponding to the light group to be adjusted after post-processing is equal to or approximately equal to the target brightness and/or target color temperature, and finally, based on the light parameters of the at least one light group respectively associated with the scene to be rendered, the target brightness and/or target color temperature of the light layer can be determined according to the obtained light parameters of the light group to be adjusted. that is, for the scene to be rendered associated with at least one light group, a rendering is performed on the server side once to obtain the initial light layers corresponding to the at least one light group; when modifying the design, such as modifying the light parameters, the terminal can generate a target image of the scene to be rendered based on the light layers corresponding to the at least one light group, which is equivalent to the result of direct rendering. This not only saves rendering resources, but also avoids the frequent use of the network to transmit the results of direct rendering, thereby reducing the burden of network transmission and improving rendering efficiency.

An implementation of a rendering method in lighting simulation provided by an embodiment of the present disclosure is described in detail below in conjunction with the accompanying drawings. Referring to Fig. 2 , the rendering method in lighting simulation may include S201-S205.

In S201, the front end obtains the lighting parameters of the scene interaction mode.

In one embodiment, the front end may obtain the lighting parameters of the scene interaction mode input by the user, such as the color temperature and/or brightness of the light group to be adjusted. The lighting parameters of the scene interaction mode may involve the light combination used in the lighting scheme and the color temperature, brightness, color, and brightness of each light (e.g., the light group to be adjusted and each light in the light group to be adjusted). The delay time of the light, and/or the gradient time of the light.

In S202, the backend performs rendering calculations on each light layer to obtain a layer rendering result.

In one embodiment, before the backend performs the rendering calculation of each light layer, the rendering process parameters can be set. Since it may be necessary to solve problems such as brightness overexposure and/or highlights during the rendering process, rendering process parameters including but not limited to overflow correction, highlight correction, color enhancement, or at least one of the convergence termination conditions are often added during the rendering process. In order to ensure that the result of scene interaction can correspond to the result of direct rendering, the rendering process parameters used in the scene interaction rendering process can be made consistent with the rendering process parameters used in the direct rendering process. For example, the parameter values of overflow correction, highlight correction, color enhancement and/or convergence termination conditions set in the scene interaction rendering process are respectively the same as the parameter values of overflow correction, highlight correction, color enhancement and/or convergence termination conditions used in the direct rendering process. After setting the rendering process parameters, the backend can perform rendering calculations of the light layers for each light group associated with the scene to be rendered to obtain a layer rendering result, which includes an initial light layer corresponding to each light group.

In one implementation, the method of setting the rendering process parameters may include: receiving preset parameters selected by a user from a lighting template.

In S203, the backend encodes the layer rendering result and transmits it to the frontend, and the frontend decodes it to obtain the layer data.

It should also be noted that, in an implementation manner where the layer rendering result is not encoded/decoded, or when data loss caused by encoding/decoding is ignored, the layer data is the layer rendering result.

This step mainly encodes the layer rendering result and transmits it to the front end, and then decodes it on the front end to obtain the layer data. The reason for image encoding/decoding is that the layer rendering result is saved in EXR format. EXR is a high dynamic range HDR picture (or light layer). The stored image information is very detailed, but it takes up a lot of space, which causes a lot of network transmission pressure on the front end. It needs to be solved by using appropriate image compression and decoding technology. The disclosed embodiment provides three encoding/decoding methods, but it can be recognized that the disclosed embodiment does not impose any restrictions on the encoding/decoding methods, and any method passed in the back end is not limited. Methods of reducing the space occupied by over-encoding layer rendering results (ie, layer data) and transmitting the encoded layer rendering results to the front end for decoding and use are all within the scope of protection of the present disclosure.

In a possible implementation, encoding/decoding method 1 may be adopted.

This method refers to the decoding method of lightmap in UE4 to restore UE4's encoding of lightmap. The specific formula is as follows:
img_i＝(log2(img_hdr_i+0.00390625)+8)/16;

Where img_hdr_i is the pixel value of the i-th pixel of the EXR image (i.e., the light layer) rendered by the backend, where i = 1, 2, ... N, and N is the total number of pixels in the EXR image;
v_min = min(img_i);
v_max = max(img_i);
n_mul=1/(v_max-v_min);
n_add = -v_min/(v_max - v_min);
img_webp_i＝img_i*n_mul+n_add；

img_webp_i is the pixel value of the i-th pixel of the encoded image (i.e., the light layer), which can be stored in WebP format or JPEG (Joint Photographic Experts Group) format. The image is transmitted to the front end for decoding:
img_i = (img_webp_i - n_add)/n_mul;
img_hdr_i=2img_i*16-8-0.00390625;

img_hdr_i is the pixel value of the i-th pixel of the EXR image (that is, the light layer) finally decoded by the front end.

In another possible implementation, encoding/decoding method 2 may be adopted.

Xp_i＝img_hdr_i*M, where img_hdr_i is the pixel value of the i-th pixel of the EXR image (i.e., the light layer) rendered by the backend, where i＝1,2,…N, N is the total number of pixels in the EXR image, and M is the encoding matrix:

resX_i＝Xp_i[0]/Xp_i[2]；
resY_i＝Xp_i[1]/Xp_i[2]；
Le_i＝2*log2(Xp_i[1])+127;

Xp_i stores three values, Xp_i[0], Xp_i[1] and Xp_i[2] represent the first value, the second value and the third value respectively, and the same below.
img_webp_i[0] = resX_i;
img_webp_i[1] = resY_i;
img_webp_i[2] = resZ_i/255;
img_webp_i[3] = resW_i;

Among them, img_webp_i stores four values, resW_i is the decimal part of Le_i, and resZ_i is the integer part of Le_i. After the assignment is completed, each value in img_webp_i is multiplied by 255, and then rounded, and the values less than 0 are assigned to 0, and the values greater than 255 are assigned to 255. After processing, the encoded image is obtained, which is saved in WebP format and transmitted to the front end for decoding:
Le_i = img_webp_i[2]*255+img_webp_i[3];
y_i＝2(Le_i-127)/2;
z_i＝y_i/img_webp_i[1];
x_i＝img_webp_i[0]*z_i；
Xp_i[0]＝x_i；
Xp_i[1]＝y_i；
Xp_i[2]＝z_i；
img_hdr_i＝Xp_i*M_reverse；

Among them, M_inverse is the inverse matrix of M, and img_hdr_i is the pixel value of the i-th pixel of the rendering image (that is, the light layer) obtained by front-end decoding.

In another possible implementation, encoding/decoding method three may be adopted.

max_float_i stores the sum of the maximum of the three values in the i-th pixel img_exr_i of the EXR image (i.e., the light layer) rendered by the backend and 0.00001, where i = 1, 2, ... N, and N is the total number of pixels in the EXR image;

Split max_float_i into two values: scale_i and exponent_i, the relationship between them is max_float_i = scale_i * 2exponent_i;
scale_i = scale_i*256/max_float_i;
img_webp_i[0]＝(img_exr_i*scale_i)[0]；
img_webp_i[1]＝(img_exr_i*scale_i)[1]；
img_webp_i[2] = (img_exr_i * scale_i)[2];
img_webp_i[3] = exponent_i + 128;

img_webp_i is the pixel value of the i-th pixel of the encoded image (i.e., the light layer), which can be saved in WebP format and transmitted to the front end for decoding:
img3_i＝2img_webp_i[3]*255-128;
img_hdr_i[0]＝img_webp_i[0]*img3_i；
img_hdr_i[1]＝img_webp_i[1]*img3_i；
img_hdr_i[2]＝img_webp_i[2]*img3_i；

Among them, img_hdr_i is the pixel value of the i-th pixel of the rendering image (that is, the light layer) obtained by front-end decoding.

The above three methods can effectively compress EXR images. For example, a 2048×2048 pixel EXR file with a size of 5.33M can be compressed to 218K. When encoding with method 1, since there are only three channels in the storage space, there will be stripe defects and color noise problems that are difficult to detect with the naked eye at the image level; therefore, when a low data loss rate is required or there are many layers, methods 2 and 3 can be used to store images with four channels, which can save more information and effectively solve the above problems.

It can be seen that in actual applications, the data transmitted over the network is not limited to the WebP format. Using encoding/decoding method one, the data transmitted over the network can be in JPEG, PNG or WebP format; using encoding/decoding method two or three, the data transmitted over the network can be in PNG or WebP format. Since the PNG and WebP formats have the same precision, both are higher than the JPEG format, and the WebP format has a higher compression rate but there are compatibility issues. About 5% of browsers do not support the WebP format; therefore, in one embodiment, the layer rendering results can be compressed to the WebP format by default; if the WebP format is not supported, the terminal can request the server (for example, a cloud server) to transcode the data into PNG format and return it.

In S204, the front end performs post-processing on the decoded layer data.

The front end performs post-processing on the obtained image (i.e., the light layer corresponding to the light group to be adjusted), and the post-processing may include at least one of automatic exposure, white balance, or tone mapping. Tone Mapping in the rendering layering process These may include: Linear multiply, Exponential, HSV exponential, Gamma correction, and/or Reinhard, etc., briefly described below:

Linear multiply: Linear addition, the brightness is directly added linearly without any changes.

Exponential: Exponential changes based on brightness can prevent overly bright parts from being overexposed.

HSV exponential: Similar to exponential correction, but preserves the hue and saturation of the color instead of washing out the color to white.

Gamma correction: Directly apply gamma function correction to color.

Reinhard: A mixture of exponential multiplication and linear multiplication. Input parameters include burn value (mixed value or burning value). When burn value is 0, it shows the effect of linear multiplication, the picture is beautiful but easy to be exposed; when burn value is 1, it shows the effect of exponential multiplication, the picture is soft but the saturation and layer relationship are not clear. Adjust burn value between 0 and 1 according to the actual situation.

Automatic exposure: On the one hand, automatic exposure can automatically adjust rendering parameters according to the brightness of the rendered image to achieve the best exposure effect, which can avoid repeated manual adjustment of parameters and improve rendering efficiency. On the other hand, automatic exposure can automatically adjust parameters such as exposure, contrast and color balance to make the rendered image closer to the real scene, while also avoiding errors or deviations caused by manual adjustment.

White balance: Through white balance, users can adjust the warmth or coldness of the picture to what they need, making the picture appear closer to reality.

Tone Mapping: In computer graphics, some special lighting conditions produce very bright or very dark areas, which are beyond the perception of the human eye. Tone mapping can help users restore the details of HDR scenes on LDR display devices, thereby improving the quality of the image. In addition, HDR images contain a lot of detail information, which low dynamic range display devices cannot faithfully restore. By using excellent tone mapping algorithms, these detail information can be compressed into LDR images and presented on low dynamic range display devices. After tone mapping, the LDR image can make the color, brightness, and contrast of the entire image more balanced, enhance the visual effect, and allow users to better immerse themselves in the image scene. Tone mapping can select appropriate tone mapping algorithms for different display devices. The appropriate algorithm is used to achieve the best rendering effect, which allows users to convert HDR images into LDR images that meet the requirements of different display devices, thereby enhancing the versatility and applicability of the image.

It should be noted that the built-in post-processing must be turned off in the rendering process of the backend of S202, that is, no post-processing algorithm is added in S202. In other words, the post-processing algorithm in the rendering layering process (including but not limited to Color Mapping) is turned off, the original layering result (that is, the initial light layer) is output, the post-processing is implemented in the layer overlay part of the front end, and the Reinhard algorithm is selected to implement tone mapping (Tone Mapping).

After the back-end renders the original light layer separation, no post-processing operations are added. The layer data is directly encoded and transmitted to the front-end. The front-end uses the Reinhard algorithm to perform tone mapping (Tone Mapping) on the decoded layer data. The Reinhard exposure method takes into account the characteristics of both "linear multiplication" and "exponential multiplication". A larger exposure degree, such as near the HDR space pixel value 1, is equivalent to linear multiplication, while a smaller exposure value is equivalent to exponential multiplication. The use of the Reinhard algorithm can make the color performance of the interior space richer. This method converts the data of the HDR space into the image data of the image unit8 space, which can reduce the data loss from the HDR space to the image unit8 space, and the gap with the direct rendering result, such as the image in PNG format, will be smaller.

In S205, the front end performs layer overlay according to the target brightness and the target color temperature, and generates and displays a scene interaction effect animation.

The front end calculates the target brightness and target color temperature of the light layer corresponding to each light group to be adjusted in each frame of image through the delay, gradient and other parameters of the scene mode (that is, the lighting parameters of the light group to be adjusted), and then superimposes the layers in the decoded layer data according to their respective target brightness and target color temperature to obtain each image frame, and finally generates and displays the scene interaction effect animation.

In one implementation, superimposing light layers corresponding to the plurality of light groups may include: performing color temperature superposition calculation using a normalization method.

The color temperature superposition algorithm in the embodiment of the present disclosure is described in detail below with reference to specific examples.

Take the scene to be rendered as an example, which is associated with two light groups light_1 and light_2. The backend uses the basic color temperature 6500k to render light_1 and light_2 respectively to obtain the corresponding light layers img_exr_1 and img_exr_2. Assume that on the front end, the light group to be adjusted light_1 The brightness and color temperature of the light group light_2 to be adjusted are set to bright_ratio_1 and temperature_1 respectively, and the brightness and color temperature of the light group light_2 to be adjusted are set to bright_ratio_2 and temperature_2 respectively.

First, according to the brightness bright_ratio_1 of light_1 and the brightness bright_ratio_2 of light_2, the target brightness of img_exr_1 corresponding to light_1 can be determined as img_exr_1*bright_ratio_1, and the target brightness of img_exr_2 corresponding to light_2 can be determined as img_exr_2*bright_ratio_2.

Then, the color temperature of the light group can be converted into RGB values used to describe the pixel color in the image. The corresponding conversion algorithm can be:

According to the blackbody radiation curve function in the CIE 1931 chromaticity diagram, the color temperature is converted into relative chromaticity coordinates (x, y); then the relative chromaticity coordinates (x, y) are converted into absolute chromaticity coordinates (X, Y, Z) by the formula: X = (x/y), Z = (1-xy)/y, where Y is fixed to 1 to ensure that the adjustment of the color temperature does not change the brightness; finally, the absolute chromaticity coordinates are converted into RGB values by a preset matrix, which can be:

According to the color temperatures temperature_1, temperature_2 and 6500k, the above calculations can respectively obtain the color color_1 of light_1, color_2 of light_2, and color_base of the base light. Since both img_exr_1 and img_exr_2 are layers rendered based on the color temperature of 6500k, the target color temperature of img_exr_1 corresponding to light_1 can be determined as img_exr_1*(color_1/color_base) according to the color color_base of the base light and color_1 of light_1, and the target color temperature of img_exr_2 corresponding to light_2 can be determined as img_exr_2*(color_2/color_base) according to the color color_base of the base light and color_2 of light_2.

Finally, img_exr_1 is post-processed according to the target brightness img_exr_1*bright_ratio_1 and the target color temperature img_exr_1*(color_1/color_base) of img_exr_1 to obtain the target light layer img_exr_post_1 corresponding to light_1, and the target light layer img_exr_2 is post-processed according to the target brightness img_exr_2*bright_ratio_2 and the target color temperature img_exr_1*(color_1/color_base) of img_exr_1. img_exr_2*(color_2/color_base) post-processes img_exr_2 to obtain the target light layer img_exr_post_2 corresponding to light_2, then adds img_exr_post_1 to img_exr_post_2, and applies the Tone mapping algorithm to output a PNG format image to obtain the target image of the scene to be rendered.

Through the rendering method in the lighting simulation provided by the embodiment of the present disclosure, the scene interaction mode and the direct rendering results can be effectively aligned. Experimental results show that the average pixel error between the final effect of the scene interaction and the direct rendering effect can be controlled within 10, and the difference between the picture level and the direct rendering is almost invisible, so that the scene interaction and direct rendering results are aligned, successfully realizing on-demand use and reducing rendering costs.

The disclosed embodiments can effectively narrow the gap between the lighting scene interaction effect and the final image output effect, optimize the difference between the scene interaction and the direct rendering results, and make the difference between the two almost invisible to the naked eye. The results show that the average pixel error is about 9.41. In this way, the direct rendering can be used to preview the results and continuously adjust the design during the design process. After the design is completed, the same effect but with dynamic scene interaction can be rendered, thereby reducing the demand for rendering resources and thus reducing costs. At the same time, the method provided by the disclosed embodiments can be extended to real-time lighting effects and scene interactions, and the method can be used to achieve an effect aligned with direct rendering, so that users can obtain a consistent experience.

In the home lighting simulation system, after the scene interaction product front end adjusts the brightness and color temperature of the grouped lamps, it is necessary to wait for the offline rendering results before the scene interaction effect can be viewed. This period of time is generally several minutes or even dozens of minutes, which reduces the scene interaction efficiency of a single lamp. In response to this problem, the rendering method in the lighting simulation provided by the embodiment of the present disclosure adds a single lamp dimming function based on the scene interaction, so that the user can further realize the change of the brightness, color temperature and/or color of the lamp based on the results of the scene interaction, thereby quickly achieving the lighting effect desired by the designer.

Another implementation of the rendering method in the lighting simulation provided by the embodiment of the present disclosure is described in detail below in conjunction with the accompanying drawings. FIG3 and FIG4 are another flow chart of the rendering method in the lighting simulation provided by the embodiment of the present disclosure. As shown in FIG3 and FIG4, the rendering method in the lighting simulation provided by the embodiment of the present disclosure can realize the scene interaction of a single lamp or a single lamp group, and may include S301-S305.

In S301, the front end obtains the light of each light group in the current scene interaction result. Layer.

In the home lighting simulation system, the back-end separates the light layers of each light group through the rendering layer separation of the rendering engine, and transmits the light layers of each light group to the front-end. The front-end receives the light layers of each light group and presents the lighting results of the light layers of each light group in the current scene interaction results.

In S302, the front end determines the light group to be adjusted according to the presented light points.

While presenting the current scene interaction results, the front end can also generate light points for users to select the light groups to be adjusted. Specifically, the camera parameters and the world coordinates of the light groups can be obtained from the current scene interaction results, and the world coordinates of the light groups can be converted into coordinates on the two-dimensional image based on the camera parameters, and the light points can be presented based on the coordinates on the two-dimensional image.

The camera parameters may include at least one of the camera's horizontal viewing angle, the camera's vertical viewing angle, the camera's position, the camera's clipping depth, the camera's horizontal rightward direction U, the camera's vertical upward direction V, or the camera's lookat direction W. Based on these camera parameters, the world coordinates of the light group are projected according to the orthogonal projection model to calculate the image coordinate point position corresponding to the light group, that is, the light group in the world coordinate system is converted into a light point on a two-dimensional image.

In one embodiment, the front end can prompt the user to select the presented light point through a prompt circle, and selecting the light group to be adjusted can trigger the search and matching of the light layer. That is, the front end displays the positions of each light group that can be clicked in the form of a prompt circle, and the user can select the light point to be adjusted according to the prompt circle. After determining the selected light point to be adjusted, the front end searches and determines the light layer to be adjusted corresponding to the light group to be adjusted.

In one implementation, the front end may determine the light layer to be adjusted corresponding to the light group to be adjusted based on a mapping relationship between the acquired at least one light group and identification information of the initial light layer respectively corresponding to the at least one light group.

In S303, the front end searches for a light layer corresponding to the light group to be adjusted from the light layers corresponding to each light group, and uses the light layer to be adjusted as the light layer.

When the user selects the light group to be adjusted, the front end searches for the light layer corresponding to the light group to be adjusted from all light layers as the light layer to be adjusted for subsequent adjustment.

In S304, the front end obtains the lighting parameters of the light group to be adjusted, and adjusts the light according to the lighting parameters. The target light layer corresponding to the light group to be adjusted is formed.

In one embodiment, the user adjusts the lighting parameters of the light group to be adjusted through the lighting parameter adjustment function provided by the front end, wherein the lighting parameters may include at least one of brightness, color temperature, or color, that is, the user can adjust at least one of the brightness, color temperature, or color of the light group to be adjusted. The target lighting layer formed based on the adjusted lighting parameters can be used for subsequent layer overlay to display the adjusted lighting effect.

In S305, the front end superimposes the target light layer and the light layers corresponding to other light groups, and displays the scene interaction effect after superposition in real time.

In one embodiment, the target light layer formed according to the brightness, color temperature and/or color input by the user and the light layers corresponding to other light groups (i.e., light groups other than the light group to be adjusted in at least one light group associated with the scene to be rendered) are re-superimposed and displayed in real time, and finally the adjusted brightness, color temperature and/or color are saved, and then the adjusted data is used to re-perform scene interaction or directly render the image, so that the scene interaction effect desired by the designer can be achieved with just one adjustment.

According to the embodiment of the present disclosure, by adding a lighting parameter adjustment layer for the lighting group to be adjusted, and superimposing the lighting parameter adjustment layer on the lighting layer corresponding to other lighting groups, and displaying the superimposed scene interaction effect in real time, this process does not require re-rendering of the lighting group, that is, the lighting effect can be changed, which greatly improves the scene interaction efficiency of a single lamp.

The embodiment of the present disclosure provides a system for rendering in lighting simulation to implement the rendering method in lighting simulation provided by the embodiment of the present disclosure.

As shown in Fig. 5, the system for rendering in lighting simulation provided by the embodiment of the present disclosure includes: one or more servers 120, and at least one terminal device 110 communicatively connected to the server 120. The terminal device 110 and the server 120 cooperate to implement the rendering method in lighting simulation.

The server is configured to perform rendering calculations on a scene to be rendered according to rendering process parameters to obtain layer data; wherein the scene to be rendered is associated with at least one light group, and the layer data includes initial light layers corresponding to the at least one light group; and transmit the layer data to a terminal device; wherein the server does not perform post-processing during the process of performing rendering calculations on the scene to be rendered.

The terminal device is configured to obtain lighting parameters of the light group to be adjusted of the scene to be rendered; Wherein, the light group to be adjusted is included in at least one light group; according to the light parameters, the target image parameters of the light layer corresponding to the light group to be adjusted are determined; wherein the target image parameters include at least one of the target brightness and the target color temperature; according to at least one of the target brightness and the target color temperature, the light layer corresponding to the light group to be adjusted is post-processed; and based on the light layers corresponding to at least one light group, a target image of the scene to be rendered is obtained.

In one embodiment, the terminal device can obtain the lighting parameters of the scene interaction mode in the lighting simulation of the scene to be rendered, and send the lighting parameters to the server; the server performs rendering calculations of each light layer according to the set rendering parameters, and encodes the layer rendering results and transmits them to the terminal device; the terminal device receives the rendering results, decodes them to obtain the layer data, and post-processes the decoded layer data, and superimposes the layers according to the brightness and color temperature to generate and display the scene interaction effect animation.

In one implementation, a terminal device includes: an acquisition unit and a processing unit.

The acquisition unit is configured to acquire the lighting parameters of the light group to be adjusted of the scene to be rendered; wherein the scene to be rendered is associated with at least one light group, and the at least one light group includes the light group to be adjusted.

The processing unit is configured to determine target image parameters of a light layer corresponding to the light group to be adjusted according to the light parameters; wherein the target image parameters include at least one of a target brightness and a target color temperature; and post-process the light layer corresponding to the light group to be adjusted according to at least one of the target brightness and the target color temperature; wherein layer data corresponding to the scene to be rendered is included in the terminal, and the layer data includes initial light layers respectively corresponding to at least one light group; and based on the light layers respectively corresponding to at least one light group, a target image of the scene to be rendered is obtained.

In one embodiment, the terminal device may further include a receiving unit and a decoding unit. The acquiring unit may be configured to acquire the lighting parameters of the scene interaction mode in the lighting simulation of the scene to be rendered. The receiving unit may be configured to receive the encoded layer rendering result. The decoding unit may be configured to decode the received layer rendering result to obtain the layer data. The processing unit may be configured to calculate the target brightness and target color temperature of each light layer of each frame image according to the lighting parameters, post-process the decoded light layer according to the target brightness and target color temperature, and superimpose the layers and transform them into the LDR space to generate and display the scene interaction effect animation.

In one implementation, the server includes: a rendering unit and a transmission unit.

The rendering unit is configured to perform rendering calculations on the scene to be rendered according to the rendering process parameters to obtain layer data; wherein the scene to be rendered is associated with at least one light group, and the layer data includes initial light layers corresponding to the at least one light group.

The transmission unit is configured to transmit the layer data to the terminal; wherein the rendering unit does not perform post-processing during the process of performing rendering calculations for the scene to be rendered.

In one embodiment, the server may further include an encoding unit. The rendering unit may be configured to perform rendering calculations of each light layer according to the rendering process parameters. The encoding unit may be configured to encode the layer rendering result using an encoding method that reduces the space occupied by the image. The transmission unit may be configured to transmit the encoded layer rendering result to the terminal device.

The specific process of the terminal device 110 and the server 120 cooperating to implement the rendering method in the lighting simulation can refer to the description of the rendering method in the lighting simulation in the embodiment of the present disclosure, and the embodiment of the present disclosure will not be repeated here.

As shown in FIG5 , the terminal device includes but is not limited to tablet computers, laptop computers, desktop computers, smart phones, intelligent voice interaction devices and other devices; the terminal device may be installed with a client related to the presentation of the scene interaction mode effect, which may be software (such as a browser, etc.), or a web page, a small program, etc. The terminal device may include a memory, a communication module and one or more processors. The memory is used to store computer programs executed by the processor. The memory may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, and programs required to run data transmission and communication functions, etc.; the data storage area may store various data transmission and communication information and operation instruction sets, etc. The memory may be a volatile memory (volatile memory), such as a random-access memory (RAM); it may also be a non-volatile memory (non-volatile memory), such as a read-only memory, a flash memory (flash memory), a hard disk drive (HDD) or a solid-state drive (SSD); or it may be any other medium that can be used to carry or store a desired computer program in the form of an instruction or data structure and can be accessed by a computer, but is not limited thereto. The memory may also be a combination of the above memories. The processor may include one or more central processing units (CPU) or a digital processing unit, etc.

The server is a background server corresponding to the software, webpage, applet, etc., or a server dedicated to image rendering, which is not specifically limited in this disclosure. The server can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDN), and big data and artificial intelligence platforms.

In the home lighting simulation system, since the current scene interaction only supports the layer separation and individual control of IES lights, the common lamp models with self-luminous materials in the scene are currently all output to one layer, so they cannot be controlled individually, affecting the scene interaction effect of the lamp models with self-luminous materials. The disclosed embodiment provides a scene interaction method for lamp models with self-luminous materials in lighting simulation, realizes the layer separation of the lamp model, expresses/characterizes the self-luminous material on the lamp model with universal format data that can be used for layer separation, and reads the self-luminous properties of the lamp model when rendering the lamp model layer, and reads the diffuse reflection properties of the lamp model when rendering other light layers, thereby realizing the on/off light effect of the lamp model.

It should be noted that diffuse reflection means that the microscopic state of the surface of an object is uneven, and the incident light will be reflected in different directions according to the normal of the surface it hits. Even in a very small area, it does not have the property that the angle of incidence is equal to the angle of reflection like a mirror or metal. Common latex paint walls, cloth, plastic, wood, etc. all have diffuse reflection properties. Lamps made of these materials are no longer light sources after turning off the lights, but degenerate into ordinary models, receiving illumination from other light sources.

Figures 6 and 7 are flow charts of a scenario interaction method for a lamp model with self-luminous material in a lighting simulation provided by an embodiment of the present disclosure. As shown in Figures 6 and 7, the scenario interaction method for a lamp model with self-luminous material in a lighting simulation provided by an embodiment of the present disclosure includes S601-S604.

In S601, the front end obtains data of a lamp model with a self-luminous material, and converts the data of the lamp model with a self-luminous material into general format data that can be used for layer separation.

In the home lighting simulation system, the front end obtains the lamp with self-luminous material from the back end. The data of the lamp model with self-luminous material is converted into the general format data that can be used for layer separation. The general format data includes lightmesh and vraymtl. Among them, lightmesh is a kind of luminous mesh in the rendering business. Converting the rendering data of the lamp model into lightmesh can facilitate the separation of a single lamp model. Vraymtl is a standard material. Converting the data of the lamp model with self-luminous material into Vraymtl material can also facilitate the separation of the lamp model.

In one implementation, when the backend renders a layer of a lamp model having a self-luminous material, the lightmesh and the IES file of the lamp model are rendered on the same layer.

Taking the conversion of the data of a lamp model with a self-luminous material into a lightmesh as an example, the following information needs to be extracted from the data of the lamp model and converted into a lightmesh, wherein the data of the lamp model may include the spatial position information of the lamp, the geometric information of the lamp, the material information of the lamp, the light color information of the lamp, the light intensity information of the lamp, the information used to characterize whether the lamp uses a texture, or at least one of the information of the lamp's texture. The spatial position information of the lamp can characterize how the self-luminous material on the lamp model is translated, rendered, and scaled from the origin to reach the specified position in the 3D scene:

LightMesh node{

Transform = spatial location information;

geometry＝geometry information;

material = original material information;

color = original light color information;

intensity = the intensity of the original light;

use_tex＝1or 0Whether to use texture information;

tex = texture information if texture is used;

affectDiffuse=0;

affectSpecular=0;

affectReflections＝0；turn off GI (Global Illumination) information}

In the process of converting the data of the lamp model to lightmesh, it is necessary to inherit its original color and texture for rendering the base layer. At the same time, in order to bind the IES file later, it is necessary to turn off the GI of the indirect light affected part of the converted lightmesh.

In S602, the front end separates each lamp model from the general format data into a single layer, and obtains a plurality of separate lamp model layers.

In one embodiment, the lamp model may include a single lamp model, and/or a lamp model group formed by multiple lamp models. Specifically, separating each lamp model with self-luminous material from the general format data into a single layer may include: for a solid color lamp model without a texture, extracting at least one of the object name of the lamp model, the position information of the lamp model, the material information of the lamp model, the self-luminous property of the lamp model, or the diffuse reflection property of the lamp model; for a lamp model with a texture, extracting at least one of the object name of the lamp model, the position information of the lamp model, the material information of the lamp model, the self-luminous property of the lamp model, the texture information of the lamp model, or the diffuse reflection property of the lamp model to obtain a lamp model layer. The self-luminous property may include at least one of light color (color(R, G, B)), light intensity (intensity), or a self-illumination texture (self illumination texture).

In one embodiment, a separate layering logic is added to the lamp model. If all the lights of the lamp model are output to the same layer, the color temperature and brightness of the self-luminous lights cannot be changed individually. Therefore, the data of the lamp model is converted into a universal format data that can be used for layer separation, and then the self-luminous lights of each lamp model with a self-luminous material are separated into a separate layer (that is, each type of self-luminous light is converted to lightmesh and then separated), thereby achieving control of the separate layer of the lamp model.

In S603, the front end obtains the lighting parameters of the lamp model to be adjusted.

In one embodiment, the front end provides the user with a function of adjusting the lighting parameters of the lamp model, through which the user can adjust lighting parameters such as brightness and/or color temperature. The adjusted lighting parameters are received by the front end.

In S604, the front end renders a separate lamp model layer corresponding to the lamp model to be adjusted according to the lighting parameters, and displays the rendering result to achieve scene interaction.

In one implementation, the server may also render a separate lamp model layer corresponding to the lamp model to be adjusted according to the lighting parameters, and the terminal (ie, the front end) may display the rendering result to achieve scene interaction, which will not be described in detail in the disclosed embodiments.

In one embodiment, a light on/off logic can be added to the lamp model. According to the light on/off logic, the light on/off effect of the lamp model is presented during rendering. In short: when rendering a separate lamp model layer, read the self-luminous properties of the lamp model to achieve the rendering result of turning on the light; and when rendering other layers, read the diffuse reflection properties of the lamp model to achieve the rendering result of turning off the light.

When different universal formats are used, the rendering results of turning on/off lights are also different. For lightmesh data, the size corresponding to the lightmesh data of the individual lamp model (that is, the self-luminous material model) is enlarged by a certain multiple (for example, 1.01 times) and the self-luminous properties are retained, and the diffuse reflection properties of the original individual lamp model are retained. In this way, when rendering the individual lamp model layer, the self-luminous properties of the individual lamp model are read to achieve the display of the light-on effect; when rendering other layers, the diffuse reflection properties of the individual lamp model are read. Since lightmesh is a transparent property, the diffuse reflection properties retained internally are naturally displayed to achieve the display of the light-off effect, thereby achieving the separation logic of the lamp model layer and the separation logic of the light-on/light-off layer.

For vraymtl data, vraymtl materials and ordinary diffuse materials have the same properties. When the vraymtl data of a separate lamp model includes self-luminous attribute values, when rendering a separate lamp model layer, the self-luminous attribute values of the separate lamp model are read to display the lighting effect; when rendering other layers, the diffuse reflection properties of the separate lamp model are read to display the lighting effect.

According to the embodiment of the present disclosure, when the lamp model is converted into universal format data, the layer separation of the lamp model is realized, so as to realize individual control, and the self-luminous property is read when rendering the lamp model layer, and the diffuse reflection property of the lamp model is read when rendering other layers, so as to realize the switching light effect of the lamp model, which greatly improves the scene interaction effect of a single lamp model.

According to an embodiment of the present disclosure, an electronic device and a readable storage medium are also provided.

FIG8 shows a schematic block diagram of an example electronic device 800 that can be used to implement an embodiment of the present disclosure. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships are The systems, and their functions, are merely examples and are not intended to limit implementations of the present disclosure described and/or claimed herein.

As shown in FIG8 , the electronic device 800 includes a computing unit 801, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 802 or a computer program loaded from a storage unit 808 to a random access memory (RAM) 803. In the RAM 803, various programs and data required for the operation of the device 800 can also be stored. The computing unit 801, the ROM 802, and the RAM 803 are connected to each other via a bus 804. An input/output (I/O) interface 805 is also connected to the bus 804.

A number of components in the electronic device 800 are connected to the I/O interface 805, including: an input unit 806, such as a keyboard, a mouse, etc.; an output unit 807, such as various types of displays, speakers, etc.; a storage unit 808, such as a disk, an optical disk, etc.; and a communication unit 809, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 809 allows the device 800 to exchange information/data with other devices through a computer network such as the Internet and/or various telecommunication networks.

The computing unit 801 may be a variety of general and/or special processing components with processing and computing capabilities. Some examples of the computing unit 801 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The computing unit 801 performs the various methods and processes described above, such as the rendering method in the lighting simulation, and/or the scenario interaction method of the lamp model with self-luminous material in the lighting simulation. For example, in some embodiments, the rendering method in the lighting simulation, and/or the scenario interaction method of the lamp model with self-luminous material in the lighting simulation can be implemented as a computer software program, which is tangibly contained in a machine-readable medium, such as a storage unit 808. In some embodiments, part or all of the computer program can be loaded and/or installed on the device 800 via the ROM 802 and/or the communication unit 809. When the computer program is loaded into the RAM 803 and executed by the computing unit 801, the rendering method in the lighting simulation described above and/or the automatic rendering method in the lighting simulation can be executed. Alternatively, in other embodiments, the computing unit 801 may be configured to execute the training method of the target ranking model and/or the target ranking method in any other appropriate manner (eg, by means of firmware).

Various implementations of the systems and techniques described above herein may be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various implementations may include: being implemented in one or more computer programs that are executable and/or interpreted on a programmable system that includes at least one programmable processor that may be a special purpose or general purpose programmable processor that may receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

The program code for implementing the method of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that the program code, when executed by the processor or controller, enables the functions/operations specified in the flow chart and/or block diagram to be implemented. The program code may be executed entirely on the machine, partially on the machine, partially on the machine as a stand-alone software package and partially on a remote machine, or entirely on a remote machine or server.

In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of machine-readable storage media would include base An electrical connection on one or more wires, a portable computer disk, a hard disk, a random access memory, a read-only memory, an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a cathode ray tube (CRT) or a liquid crystal display (LCD) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

The systems and techniques described herein may be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communications network). Examples of communications networks include: Local Area Network (LAN), Wide Area Network (WAN), and the Internet.

A computer system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The relationship of client and server is generated by computer programs running on the respective computers and having a client and server relationship with each other. The server may be a cloud server, a server of a distributed system, or a server combined with a blockchain.

It is worth noting that, although the execution process of the method provided by the present disclosure is described in a specific order in the drawings, this does not require or imply that the execution process must be performed in this specific order. Execution, or all the steps shown must be executed to achieve the expected result. Optionally, some steps can be omitted, multiple steps can be combined into one step, and/or one step can be decomposed into multiple steps.

It will be appreciated by those skilled in the art that the embodiments of the present disclosure may be provided as methods, devices, or computer program products. Therefore, the present disclosure may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Furthermore, the present disclosure may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing a computer-usable computer program.

The present disclosure is described with reference to the flowchart and/or block diagram of the method, device, electronic device and computer program product according to the embodiment of the present disclosure. It should be understood that each process and/or box in the flowchart and/or block diagram, as well as the combination of the process and/or box in the flowchart and/or block diagram can be implemented by computer program commands. These computer program commands can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor or other programmable data processing device to generate a machine, so that the command executed by the processor of the computer or other programmable data processing device generates a device for implementing the function specified in one process or multiple processes in the flowchart and/or one box or multiple boxes in the block diagram.

It should be understood that the "one embodiment" or "one implementation" mentioned in the specification means that the specific features, structures or characteristics related to the embodiment are included in at least one embodiment or implementation of the present disclosure. Therefore, the "in one embodiment" or "one implementation" appearing in various places throughout the specification does not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner.

Claims (25)

A rendering method in lighting simulation, applied to a terminal, comprising: Obtaining lighting parameters of a light group to be adjusted of a scene to be rendered; wherein the scene to be rendered is associated with at least one light group, and the at least one light group includes the light group to be adjusted; Determine, according to the light parameters, a target image parameter of the light layer corresponding to the light group to be adjusted; wherein the target image parameter includes at least one of a target brightness and a target color temperature; According to at least one of the target brightness and the target color temperature, post-processing the light layer corresponding to the light group to be adjusted; wherein the terminal includes layer data corresponding to the scene to be rendered, and the layer data includes initial light layers corresponding to the at least one light group respectively; and Based on the light layers respectively corresponding to the at least one light group, a target image of the scene to be rendered is obtained. The method according to claim 1, further comprising: The layer data is obtained in advance from a server; wherein the layer data is obtained by the server performing rendering calculations on each of the at least one light group according to rendering process parameters. The method according to claim 2, wherein the rendering process parameters include: at least one of overflow correction, highlight correction, color enhancement, or convergence termination conditions. The method according to claim 1, wherein post-processing the light layer corresponding to the light group to be adjusted according to at least one of the target brightness and the target color temperature comprises: Post-processing the initial light layer corresponding to the light group to be adjusted according to at least one of the target brightness and the target color temperature; or According to at least one of the target brightness and the target color temperature, post-process the light layer corresponding to the light group to be adjusted and which has been post-processed at least once. The method according to claim 1, wherein obtaining the target image of the scene to be rendered based on the light layers respectively corresponding to the at least one light group comprises: In the case that the at least one light group is a plurality of light groups, light layers respectively corresponding to the plurality of light groups are superimposed. The method according to claim 5, wherein superimposing light layers corresponding to the plurality of light groups respectively comprises: Use the normalization method to perform color temperature superposition calculations. The method according to claim 6, wherein the color temperature superposition calculation method comprises: Each light layer is multiplied by its brightness adjustment factor and color temperature adjustment weight. The method of claim 1, wherein the post-processing comprises at least one of automatic exposure, white balance, or tone mapping, wherein the tone mapping comprises a Reinhard method. The method according to claim 1, wherein obtaining the lighting parameters of the light group to be adjusted of the scene to be rendered comprises: The light group to be adjusted is determined according to the selected light point. The method according to claim 9, further comprising: Obtaining camera parameters and the world coordinates of the light group to be adjusted; According to the camera parameters, converting the world coordinates of the light group to be adjusted into coordinates on the two-dimensional image; and The light point is presented according to the coordinates on the two-dimensional image. The method according to claim 9, further comprising: Prompting the user to select the light point through a prompt circle; and In response to the light point being selected, determining the light corresponding to the light group to be adjusted Layer. The method according to claim 1, wherein the lighting parameter comprises at least one of brightness, color temperature, or color. A rendering method in lighting simulation, applied to a server, comprising: According to the rendering process parameters, rendering calculation is performed for the scene to be rendered to obtain layer data; wherein the scene to be rendered is associated with at least one light group, and the layer data includes initial light layers corresponding to the at least one light group respectively; and Transmitting the layer data to a terminal; Wherein, the server does not perform post-processing during the process of performing rendering calculation on the scene to be rendered. The method according to claim 13, further comprising: Acquire the rendering process parameters; wherein the rendering process parameters include: overflow correction, highlight correction, color enhancement, or at least one of convergence termination conditions. The method according to claim 13, before transmitting the layer data to the terminal, further comprising: The layer data is encoded using an encoding method that reduces the space occupied by the image. A rendering device for lighting simulation, arranged in a terminal, comprising: an acquisition unit, configured to acquire light parameters of a light group to be adjusted of a scene to be rendered; wherein the scene to be rendered is associated with at least one light group, and the at least one light group includes the light group to be adjusted; and The processing unit is configured to determine the target image parameters of the light layer corresponding to the light group to be adjusted according to the light parameters; wherein the target image parameters include at least one of a target brightness and a target color temperature; and post-process the light layer corresponding to the light group to be adjusted according to at least one of the target brightness and the target color temperature; wherein the terminal includes layer data corresponding to the scene to be rendered, and the layer The data includes initial light layers respectively corresponding to the at least one light group; and based on the light layers respectively corresponding to the at least one light group, a target image of the scene to be rendered is obtained. A device for rendering in lighting simulation, arranged in a server, comprising: A rendering unit, configured to perform rendering calculations on a scene to be rendered according to rendering process parameters to obtain layer data; wherein the scene to be rendered is associated with at least one light group, and the layer data includes initial light layers corresponding to the at least one light group respectively; and A transmission unit, configured to transmit the layer data to a terminal; Wherein, the rendering unit does not perform post-processing during the process of performing rendering calculation on the scene to be rendered. A system for rendering in lighting simulation, comprising: The server is configured to perform rendering calculations on a scene to be rendered according to rendering process parameters to obtain layer data; wherein the scene to be rendered is associated with at least one light group, and the layer data includes initial light layers corresponding to the at least one light group; and transmit the layer data to a terminal device; wherein the server does not perform post-processing during the process of performing rendering calculations on the scene to be rendered; and The terminal device is configured to obtain lighting parameters of the light group to be adjusted of the scene to be rendered; wherein the light group to be adjusted is included in the at least one light group; according to the lighting parameters, determine the target image parameters of the light layer corresponding to the light group to be adjusted; wherein the target image parameters include at least one of a target brightness and a target color temperature; according to at least one of the target brightness and the target color temperature, post-process the light layer corresponding to the light group to be adjusted; and obtain the target image of the scene to be rendered based on the light layers respectively corresponding to the at least one light group. An electronic device, comprising: at least one processor; and a memory communicatively coupled to the at least one processor; The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor, so that the at least one processor executes the rendering method in the lighting simulation according to any one of claims 1-15. A non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to enable a computer to execute the rendering method in lighting simulation according to any one of claims 1-15. A scenario interaction method for a lamp model with a self-luminous material in a lighting simulation, comprising: Get the data of the lamp model with self-illuminating material; Convert the data of the lamp model with self-illuminating materials into a common format that can be used for layer separation; Separating each lamp model and the IES corresponding to the lamp model from the general format data into a single layer to obtain a plurality of separate lamp model layers; wherein the lamp model includes a single lamp model and/or a lamp model group formed by a plurality of lamp models; Get the lighting parameters of the lamp model to be adjusted; Rendering a separate lamp model layer corresponding to the lamp model to be adjusted according to the lighting parameters; and Display rendering results for scene interaction. The method of claim 21, wherein separating each luminaire model into a single layer from the common format data comprises: Filtering a lamp model layer from the general format data; The step of selecting the lamp model layer from the general format data includes: In the case where the lamp model is a solid color lamp model without a texture, extracting at least one of an object name of the lamp model, location information of the lamp model, material information of the lamp model, a self-luminous property of the lamp model, or a diffuse reflection property of the lamp model; and In the case where the lamp model has a texture, extract the object of the lamp model at least one of the name, the location information of the lamp model, the material information of the lamp model, the self-luminous property of the lamp model, the texture information of the lamp model, or the diffuse reflection property of the lamp model; The self-illumination properties include light color and/or light intensity. The method according to claim 21, further comprising: Adding the on/off logic of the lamp model; and According to the light on/off logic, presenting the light on/off effect of the lamp model during rendering; According to the light on/off logic, presenting the light on/off effect of the lamp model in the rendering process includes: In the case of rendering a separate lamp model layer, reading the self-illumination property of the lamp model; and When rendering other layers, read the diffuse properties of the lamp model. The method according to claim 23, wherein, when the general format data is lightmesh data, presenting the light on/off effect of the lamp model in the rendering process according to the light on/off logic comprises: Enlarge the size of the lightmesh data of the individual lamp model by a set multiple and retain the self-luminous property, so that the self-luminous property of the individual lamp model can be read when rendering the individual lamp model layer, so as to achieve the display of the lighting effect; and The diffuse reflection properties of a separate lamp model are retained so that the diffuse reflection properties of a separate lamp model can be read when rendering other layers, thereby achieving the display of the light-off effect. The method according to claim 23, wherein, when the general format data is vraymtl data, presenting the on/off light effect of the lamp model in the rendering process according to the on/off light logic comprises: When the vraymtl data of the individual lamp model includes the self-luminous attribute value, and when rendering the individual lamp model layer, the self-luminous attribute value of the individual lamp model is read to achieve the display of the lighting effect; and When rendering other layers, read the diffuse properties of a separate lamp model to achieve the effect of turning off the light.