Fluid special effects processing method, device, computer equipment and storage medium

Abstract

The embodiments of the present application disclose a method, apparatus, computer equipment and storage medium for processing fluid special effects, which obtain first depth data of a scene model; obtain second depth data of a fluid model that overlaps with the scene model in a virtual space; adjust the second depth data of the fluid model to obtain adjusted second depth data, so that at least a portion of the fluid model that is blocked by the scene model is rendered in front of the scene model; adjust display parameters corresponding to model points of the fluid model to obtain adjusted display parameters; based on the adjusted second depth data of the fluid model, the adjusted display parameters and the first depth data of the scene model, render the fluid model and the scene model to obtain a scene with fluid special effects, wherein the fluid special effects simulated by the fluid model have a stronger sense of space for the scene, and the intensity of the fluid special effects can be flexibly adjusted by adjusting the second depth data of the fluid model.

Description

Technical Field

[0001] The present application relates to the field of special effects generation, and specifically to a fluid special effects processing method, device, computer equipment and computer-readable storage medium, wherein the storage medium is a computer-readable storage medium. Background Art

[0002] In movies and game animations, it is sometimes necessary to add fluid special effects to the scene, for example, to adjust the fog effect. For the fog effect, the usual practice is to superimpose some 2D smoke materials on the real scene screen or the screen rendered based on the scene model to simulate the fog. The fog effect simulated by 2D smoke materials has a poor sense of space, and in order to simulate the effect of different fog concentrations in different positions, a lot of processing of the fog material is required, such as cropping, superposition, etc., and the production of fluid special effects is cumbersome. Summary of the invention

[0003] The embodiments of the present application provide a fluid special effects processing method, apparatus, computer equipment and storage medium, which can generate fluid special effects with a stronger sense of space.

[0004] A fluid special effects processing method provided in an embodiment of the present application includes:

[0005] Acquire first depth data of the scene model;

[0006] Acquire second depth data of a fluid model that overlaps with the position of the scene model in the virtual space;

[0007] Performing adjustment processing on the second depth data of the fluid model to obtain adjusted second depth data, so that at least a portion of the fluid model blocked by the scene model is rendered in front of the scene model;

[0008] Adjusting the display parameters corresponding to the model points of the fluid model to obtain adjusted display parameters;

[0009] Based on the adjusted second depth data of the fluid model, the adjusted display parameters and the first depth data of the scene model, the fluid model and the scene model are rendered to obtain a scene with fluid special effects.

[0010] Accordingly, an embodiment of the present application further provides a fluid special effects processing device, comprising:

[0011] A first acquisition unit, used to acquire first depth data of the scene model;

[0012] A second acquisition unit, configured to acquire second depth data of a fluid model that overlaps with the scene model in the virtual space;

[0013] A first adjustment unit is used to adjust the second depth data of the fluid model to obtain adjusted second depth data, so that at least a portion of the fluid model blocked by the scene model is rendered in front of the scene model;

[0014] A second adjustment unit, used for adjusting the display parameters corresponding to the model points of the fluid model to obtain adjusted display parameters;

[0015] A rendering unit is used to render the fluid model and the scene model based on the adjusted second depth data of the fluid model, the adjusted display parameters and the first depth data of the scene model to obtain a scene with fluid special effects.

[0016] Correspondingly, an embodiment of the present application also provides a computer device, including a memory and a processor; the memory stores a computer program, and the processor is used to run the computer program in the memory to execute any fluid special effects processing method provided in the embodiment of the present application.

[0017] Correspondingly, an embodiment of the present application also provides a computer-readable storage medium, which is used to store a computer program, and the computer program is loaded by a processor to execute any fluid special effect processing method provided in the embodiment of the present application.

[0018] The embodiment of the present application obtains first depth data of a scene model; obtains second depth data of a fluid model that overlaps with the scene model in a virtual space; adjusts the second depth data of the fluid model to obtain adjusted second depth data, so that at least a portion of the fluid model that is blocked by the scene model is rendered in front of the scene model; adjusts display parameters corresponding to model points of the fluid model to obtain adjusted display parameters; and renders the fluid model and the scene model based on the adjusted second depth data of the fluid model, the adjusted display parameters, and the first depth data of the scene model to obtain a scene with fluid special effects.

[0019] In the embodiment of the present application, the scene model and the fluid model overlap in the virtual space, so the fluid special effects simulated based on the fluid model have a strong sense of space with the scene, and by adjusting the second depth data of the fluid model, the front and back relationship between the fluid model and the scene model during rendering can be adjusted, thereby flexibly adjusting the intensity of the fluid special effects. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0021] Figure 1 is a flow chart of a fluid special effects processing method provided in an embodiment of the present application;

[0022] FIG2(1) is a schematic diagram of model overlap provided in an embodiment of the present application;

[0023] Figure 2 (2) is a schematic diagram of model overlap provided in an embodiment of the present application;

[0024] Figure 2(3) is a schematic diagram of model overlap provided in an embodiment of the present application;

[0025] FIG3(1) is a schematic diagram of a fluid special effect provided in an embodiment of the present application;

[0026] FIG3(2) is a schematic diagram of a fluid special effect provided in an embodiment of the present application;

[0027] FIG3 (3) is a schematic diagram of a fluid special effect provided in an embodiment of the present application;

[0028] Figure 4 is another flow chart of the fluid special effects processing method provided in an embodiment of the present application;

[0029] Figure 5 is a schematic diagram of a scene model and a virtual camera provided in an embodiment of the present application;

[0030] FIG6 (1) is a schematic diagram of a plane model provided in an embodiment of the present application;

[0031] FIG6 (2) is a schematic diagram of a plane model provided in an embodiment of the present application;

[0032] Figure 7 is a schematic diagram of a fluid model provided in an embodiment of the present application;

[0033] FIG8 (1) is a schematic diagram of fluid special effects at different heights provided in an embodiment of the present application;

[0034] FIG8(2) is a schematic diagram of fluid special effects at different heights provided in an embodiment of the present application;

[0035] Fig. 9 is a schematic diagram of a fluid special effects processing device provided in an embodiment of the present application;

[0036] Fig.10 It is a schematic diagram of the structure of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0037] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of this application.

[0038] The embodiment of the present application provides a fluid special effect processing method, device, computer equipment and computer readable storage medium. The fluid special effect processing device can be integrated in a computer equipment, which can be a server or a terminal.

[0039] The terminal may include a mobile phone, a wearable smart device, a tablet computer, a laptop computer, a personal computer (PC), and a vehicle-mounted computer.

[0040] Among them, the server can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDN), as well as big data and artificial intelligence platforms.

[0041] It should be noted that the description order of the following embodiments is not intended to limit the preferred order of the embodiments.

[0042] This embodiment will be described from the perspective of a fluid special effect processing device, which can be integrated into a computer device, which can be a server or a terminal.

[0043] The present application provides a method for processing fluid special effects, such as Figure 1 As shown, the specific process of the fluid special effect processing method can be as follows:

[0044] 101. Obtain first depth data of a scene model.

[0045] The scene model may be a two-dimensional virtual model or a three-dimensional virtual model corresponding to a scene, etc. The scene model may be a simulation of the scene, and the scene may be a real scene or a fictional scene.

[0046] The first depth data may be depth data of a scene model. The first depth data may include a model point of the scene model (the model point may be a point on the scene model, and may be obtained by sampling the scene model) and the distance between the virtual camera. The first depth data may also include position information of each pixel of the scene model in the virtual space, such as the coordinates of the model point of the scene model in the virtual space, which may be, for example, an x-coordinate and a y-coordinate.

[0047] 102. Acquire second depth data of the fluid model that overlaps with the scene model in the virtual space.

[0048] Among them, the fluid model can be a model used to create fluid special effects, and the fluid special effects can include liquid special effects and gas special effects, such as fog special effects, smoke special effects, or cloud special effects, and for example, flowing water special effects; for example, the effect of fog in the mountains, or the effect of clouds and mist on the mountains, or a mountain villa flooded by floods, can be simulated based on the fluid model.

[0049] The second depth data may be the depth data of the fluid model. The second depth data may include the distance between the model point of the fluid model and the virtual camera. The second depth data may also include the position information of the model point of the fluid model in the virtual space, such as the coordinates of the model point of the fluid model in the virtual space, which may be, for example, the x-coordinate and the y-coordinate.

[0050] The scene model and the fluid model overlap in the virtual space. If the fluid model is a plane model, the fluid model can cross the scene model or overlap with the bottom of the scene model. Exemplarily, the positional relationship between the scene model and the fluid model in the virtual space can be as shown in the figure.

[0051] Based on the first depth data of the scene model and the second depth data of the fluid model, the front and back relationship of the scene model and the fluid model can be determined during rendering. For example, for the same model point, the front and back relationship and distance relationship between the scene model and the fluid model can be determined, and then the front and back relationship and sense of space between the fluid model and the scene model can be rendered.

[0052] In one embodiment, multiple depth channels can be set for each pixel of the fluid model, each depth channel corresponds to a type of second depth data, and different types of second depth data can indicate the depth of the pixel in different dimensions, such as the depth of the foreground (also referred to as the foreground depth), the depth of the background (also referred to as the background depth), etc. One of the second depth data can be adjusted, such as adjusting the foreground depth, which can also be called deep.front, or adjusting the background depth, which can also be called deep.back.

[0053] Each type of second depth data may also be adjusted separately so as to superimpose the effects of the adjustment of each type of second depth data. That is, in one embodiment, the second depth data has at least two types, and the step of “obtaining the second depth data of the fluid model overlapping with the scene model in the virtual space” may include:

[0054] Sampling the fluid model based on the virtual camera to determine at least two types of second depth data of the fluid model, wherein the different types of second depth data are the same;

[0055] Among them, the virtual camera can be a virtual camera in the virtual space for observing the scene model and the fluid model. By sampling the fluid model with the virtual camera, at least two types of second depth data of the fluid model can be obtained. Before adjusting the second depth data, the different types of second depth data are the same, that is, the different types of second depth data obtained by sampling are the same.

[0056] Exemplarily, the second depth data includes deep.front and deep.back, and the values ​​of the two are the same.

[0057] In one embodiment, the fluid model may be sampled through a deepsample node in a Nuke tool to obtain second depth data of the fluid model.

[0058] Before obtaining the second depth data of the fluid model, the position of the fluid model may be adjusted so that the fluid model intersects with the scene model and the height thereof can produce special effects that meet the requirements. That is, in one embodiment, before the step of “obtaining the second depth data of the fluid model that overlaps with the scene model in the virtual space”, the method further includes:

[0059] Get the fluid model;

[0060] Get the target fluid effect height for the scene model;

[0061] The position of the fluid model in the virtual space is adjusted according to the target fluid special effect height, so that the fluid model overlaps with the scene model at the target fluid special effect height.

[0062] Among them, the fluid model can be a pre-made model, the target fluid special effect height can be used to control the height of the fluid special effect in the rendered scene, the target fluid special effect height can be related to time, and the height of the fluid special effect rendered based on the fluid model can change over time. For example, for fog, the fog is thicker in the morning, and as the sun rises, the fog will slowly fade away. Then the target fluid special effect height can be gradually reduced over time to simulate the change of fog over time. For example, if the rendered special effect is a village flooded by floods, the water level may first rise and then decrease. Then the target fluid special effect height may first increase over time and then decrease over time.

[0063] A fluid model can be obtained, and a target fluid effect height can be obtained. The target fluid effect height can be pre-set or determined in response to information input by an input device of the terminal. The movement of the fluid model is controlled according to the target fluid effect height, so that the origin of the fluid model (it can also be other reference points, which can be set according to the structure of the model and are not limited here) is located at the target fluid effect height, so that the fluid model overlaps with the scene model at the target fluid effect height, and in the scene rendered in this way, the target fluid effect height has a fluid effect. It can be understood that the larger the target fluid effect height, the more parts of the scene are surrounded by fluid.

[0064] For example, for different target fluid special effect heights, the rendered fluid special effects can be as follows: Figure 2(1)-Figure 2(3) , where the black part can represent the scene model and the oblique line part can represent the fluid model. Specifically, the scene model can be a mountain model and the fluid model can be used to simulate fog. As shown in FIG2(1), the target special effect height of FIG2(2) is smaller than the target special effect height of FIG2(2), and the target special effect height of FIG2(2) is smaller than the target special effect height of FIG2(3). It can be seen that the higher the target special effect height, the more part of the scene model is blocked by the fluid model, and the more part of the scene is surrounded by the fluid in the rendered image.

[0065] In one embodiment, the fluid model may be a plane model or a mesh. Optionally, a plane model may be created, and then the plane model may be displaced to change its surface so as to create a more varied fluid special effect, that is, the step of “obtaining the fluid model” includes:

[0066] Create a plane model;

[0067] Determine the offset information corresponding to each vertex of the plane model according to the program texture;

[0068] The model vertices of the plane model are controlled to be offset according to the offset information to obtain a fluid model.

[0069] Among them, the plane model can be considered as a three-dimensional model in the virtual space, and the plane model can be located horizontally in the virtual space; the procedural texture is different from the texture created by image editing or photography technology. The procedural texture can be a texture generated by an algorithm or mathematical formula. For example, the procedural texture can include noise texture, wave texture, etc. The procedural texture can be a dynamic texture, that is, the procedural texture can change over time, so that the rendered fluid special effects have a dynamic effect.

[0070] For example, a noise map may be generated according to a noise algorithm, and the noise algorithm may include Perlin noise, Simplex noise, Fractal Brownian noise, and the like.

[0071] The offset information of each model vertex of the plane model is determined according to the texture map, and then the model vertex of the plane model is controlled to move according to the offset information to obtain a fluid model.

[0072] Since the noise map generated by the noise algorithm has a certain degree of randomness, the changes of the fluid model generated by controlling the deformation of the plane model surface based on the noise map are random, which can enrich the changes of the fluid special effects and create a more natural fluid special effects.

[0073] 103. Perform adjustment processing on the second depth data of the fluid model to obtain adjusted second depth data, so that at least a portion of the fluid model blocked by the scene model is rendered in front of the scene model.

[0074] The adjustment processing on the second depth data may be changing the value of the second depth data, for example, the value of the second depth data may be increased or decreased.

[0075] Due to the adjustment processing of the second depth data, the front-to-back relationship and the distance relationship between the fluid model and the scene model during rendering may change. For example, before the second depth data is adjusted, the second depth data of the fluid model on a pixel is greater than the first depth data of the scene model on the pixel, that is, compared with the fluid model, the scene model is closer to the camera. For this pixel, the scene model is rendered in front of the fluid model. The fluid model may be completely obscured by the scene model, or the fluid model may be seen through the scene model. The specific visual effect is related to the settings of the model and the rendering process, and is not limited here. After the second depth data is adjusted, the second depth data of the fluid model on the pixel is less than the first depth data of the scene model on the pixel, that is, compared with the scene model, the fluid model is closer to the camera, then at this pixel, the fluid model is rendered in front of the scene model.

[0076] In one embodiment, a plurality of depth channels may be provided for each pixel of the fluid model, for example, foreground depth and background depth, and the depth data of one of the channels may be adjusted separately.

[0077] Among them, adjusting the foreground depth can make the fluid model closer to the camera, and more fluid models appear in the rendered image, or make the fluid model farther away from the camera, and fewer fluid models appear in the rendered image. The specific setting can be based on the required fluid special effects, and is not limited here.

[0078] For example, assuming that a fog effect is created in a scene through a fluid model, if a large fog effect needs to be created, the fluid model can be brought closer to the camera; if a small fog effect needs to be created, the fluid model can be moved further away from the camera.

[0079] Adjusting the background depth can make the depth of the background part in the fluid model deeper, or shallower, thereby adjusting the degree to which the fluid model is obscured by the scene model. For example, the greater the difference between the background depths of the fluid model and the scene model, the higher the degree to which the fluid model is obscured by the background model; the smaller the difference between the background depths of the fluid model and the scene model, the lower the degree to which the fluid model is obscured by the background model.

[0080] Optionally, each type of second depth data may be adjusted separately so as to superimpose the effects of the adjustment of each type of second depth data. That is, in one embodiment, the second depth data has at least two types, and the step of "adjusting the second depth data of the fluid model to obtain adjusted second depth data" may include:

[0081] Each type of second depth data of the fluid model is adjusted to obtain adjusted second depth data corresponding to each type, wherein the adjusted second depth data of different types are different.

[0082] For example, each type of second depth data can be processed separately to obtain adjusted second depth data corresponding to each type of second depth data. The adjusted second depth data corresponding to different types of second depth data are different. Different occlusion effects for the fluid model and the scene model can be achieved based on the different types of second depth data. By superimposing multiple occlusion effects, a more layered fluid special effect can be obtained.

[0083] Exemplarily, assuming that the fluid model has two types of depth data, deep.front and deep.back, before adjustment, deep.front and deep.back are equal, and adjustment is performed on deep.front and deep.back respectively, which may be deep.front-A and deep.back+A, where A may be greater than zero.

[0084] Figure 3(1) to Figure 3(3) The figure is a schematic diagram of simulating fog effects by adjusting the depth data of the fluid model, wherein Figure 3(1) is the effect of A=0, where the white area is the part of the fluid model that is not blocked by the mountains; Figure 3(2) is the effect of A=50, where more fluid models are displayed before the scene model; Figure 3(3) is the effect of A=100, where more fluid models are displayed before the scene model compared to Figure 3(2).

[0085] 104. Adjust the display parameters corresponding to the model points of the fluid model to obtain adjusted display parameters.

[0086] The display parameters may include parameters related to controlling the display effect of the fluid special effects in the scene, for example, they may include transparency, and the display parameters may also include color and the like.

[0087] By adjusting the display parameters corresponding to the model points of the fluid model, the fluid model displayed at different positions on the screen can present different visual effects, thereby creating the desired fluid special effects.

[0088] For example, the transparency of the model points of the fluid model can be adjusted to be non-0, or the opacity to be non-1. The display effects of pixels with multiple superimposed model points and pixels with only one model point are different. The color of the pixels with multiple superimposed model points will be more obvious and opaque than the color of the pixels with only one model point. That is, pixels with different numbers of superimposed model points have different display effects. Therefore, the display parameters can be adjusted to create fluid special effects in the scene.

[0089] In one embodiment, the display parameters of the fluid model can be adjusted according to preset target adjustment parameters. For example, the display parameters and the preset adjustment parameters can be added or multiplied to obtain the adjusted display parameters. Optionally, the display parameters and the preset adjustment parameters can be multiplied to obtain the adjusted display parameters.

[0090] Exemplarily, the display parameter is opacity, and the preset adjustment parameter may be 0.3. The opacity of each model point of the fluid model is multiplied by 0.3 to obtain the adjusted opacity, ie, the adjusted display parameter.

[0091] Optionally, the target adjustment parameter may also be determined according to a mapping relationship, and the preset relationship includes a corresponding relationship between the depth data and the adjustment parameter, that is, in one example, the step of "adjusting the display parameter corresponding to the model point of the fluid model to obtain the adjusted display parameter" includes:

[0092] Determine the target adjustment parameter corresponding to the adjusted second depth data of each model point of the fluid model according to the mapping relationship between the depth data and the adjustment parameter corresponding to the display parameter;

[0093] The display parameters are adjusted based on the target adjustment parameters to obtain the adjusted display parameters.

[0094] The second depth data may include a depth value of each model point of the fluid model. If there is more than one type of second depth data, one type of second depth data may be selected to determine the target adjustment parameter. For example, the target adjustment parameter may be determined according to the foreground depth.

[0095] For example, assuming that the fluid special effect to be generated is a fog special effect, the display parameter can be opacity. In the mapping relationship between the depth value and the adjustment parameter, the larger the depth value, the larger the adjustment parameter, so as to control the fog to be lighter nearby and thicker in the distance. For another example, if the display parameter is color, the fog in the near distance can be controlled to be lighter and the fog in the distance to be darker by adjusting the parameter.

[0096] After determining the target adjustment parameters, you can control the target adjustment parameters to change over time to achieve fluid effects that change over time. For example, for fog effects, you can control the fog to gradually fade until it dissipates, and then you can control the opacity to decrease until it reaches 0.

[0097] The mapping relationship can be flexibly set according to display parameters and the effects to be achieved, and the mapping relationship is not limited here.

[0098] According to the mapping relationship, the target adjustment parameters corresponding to the depth values ​​of each model point of the fluid model are determined, and the display parameters are adjusted based on the target adjustment parameters to obtain the adjusted display parameters. The display parameters are adjusted based on the target adjustment parameters, which can be achieved by multiplying the target adjustment parameters and the display parameters, or adding the target adjustment parameters and the display parameters.

[0099] Optionally, the target adjustment parameter may be processed in combination with the height data of the fluid model to achieve different fluid effects at high and low depths at the same depth. That is, in one embodiment, the step of "adjusting the display parameter based on the target adjustment parameter to obtain the adjusted display parameter" includes:

[0100] Obtain height data of model points of the fluid model;

[0101] According to the height data of the model point of the fluid model, the target adjustment parameter is weighted to obtain the weighted target adjustment parameter;

[0102] The display parameters are adjusted according to the weighted target adjustment parameters to obtain adjusted display parameters.

[0103] The height data of the model point of the fluid model can indicate the height of the model point in the virtual space, and the height value can be extracted from the coordinates of the model point. For example, the coordinate component of the model point on the y-axis can be used as the height data of the model point.

[0104] For example, the height data of each model point of the fluid model can be normalized and mapped to between 0 and 1. The normalized height data can be used as a weight to perform weighted processing on the target adjustment parameter to obtain the weighted target adjustment parameter.

[0105] The display parameters are adjusted according to the weighted target adjustment parameters. Specifically, the weighted target adjustment parameters and the display parameters are multiplied to obtain the adjusted display parameters, so that the fluid special effects have a height change in the picture rendered based on the adjusted display parameters.

[0106] Exemplarily, the fluid special effect is a fog special effect, and the display parameter is opacity. In order to simulate the effect that the higher the altitude, the thicker the fog, the larger the altitude data, the smaller the normalized altitude data, and the smaller the altitude data, the larger the normalized altitude data, so as to achieve that the fog at low places is more opaque than the fog at high places, that is, more obvious, creating an effect that the higher the altitude, the thinner the fog.

[0107] 105. Render the fluid model and the scene model based on the adjusted second depth data of the fluid model, the adjusted display parameters, and the first depth data of the scene model to obtain a scene with fluid special effects.

[0108] The fluid model and the scene model are rendered according to the adjusted second depth data corresponding to the fluid model, the adjusted display parameters, and the first depth data of the scene model, so as to obtain a scene with fluid special effects.

[0109] If the second depth data has multiple types, display data can be calculated for the adjusted second depth data corresponding to each type of second depth data, and then the display data calculated based on each adjusted depth data can be fused to obtain fused display data, and a scene with fluid special effects can be rendered. That is, in one embodiment, the step of "rendering the fluid model and the scene model based on the adjusted second depth data of the fluid model, the adjusted display parameters and the first depth data to obtain a scene with fluid special effects" includes:

[0110] For each type of second depth data, a plurality of display data corresponding to each screen pixel is calculated according to the second depth data, the adjusted display parameter and the first depth data;

[0111] Performing fusion processing on multiple display data corresponding to the same screen pixel to obtain fused display data of each screen pixel;

[0112] A scene with fluid special effects is obtained by rendering based on the fused display data.

[0113] For example, for each type of second depth data, the front and back relationship of the fluid model and the scene model at each pixel can be determined based on the second depth data of that type and the first depth data, and then based on the adjusted display parameters of the fluid model and the display parameters of the scene model, multiple display data corresponding to the screen pixels can be calculated, and the display data may include color values, etc.

[0114] For the same screen pixel, multiple display data corresponding to the screen pixel can be fused to obtain fused display data of the screen pixel, and a scene with fluid special effects can be rendered based on the fused display data.

[0115] As can be seen from the above, the embodiment of the present application obtains first depth data of the scene model; obtains second depth data of the fluid model that overlaps with the scene model in the virtual space; adjusts the second depth data of the fluid model to obtain adjusted second depth data, so that at least a portion of the fluid model obscured by the scene model is rendered in front of the scene model; adjusts the display parameters corresponding to the model points of the fluid model to obtain adjusted display parameters; based on the adjusted second depth data of the fluid model, the adjusted display parameters and the first depth data of the scene model, the fluid model and the scene model are rendered to obtain a scene with fluid special effects.

[0116] In the embodiment of the present application, the scene model and the fluid model overlap in the virtual space, so the fluid special effects simulated based on the fluid model have a strong sense of space with the scene, and by adjusting the second depth data of the fluid model, the front and back relationship between the fluid model and the scene model during rendering can be adjusted, thereby flexibly adjusting the intensity of the fluid special effects.

[0117] In order to more clearly illustrate the fluid special effect processing method provided in the embodiment of the present application, further examples will be given below. Figure 4 As shown, the process of the fluid special effects processing method can be as follows:

[0118] 201. Obtain first depth data of a scene model and a camera file of the scene.

[0119] The scene model may be a model created by digital content creation (DCC) software, and the first depth data includes the depth of each model point of the scene model.

[0120] The camera file may be a camera file in the virtual space where the scene model is located, or may be a camera file obtained by tracking and inverse analysis in a real-life movie.

[0121] The position of the virtual camera in the virtual space can be determined according to the camera file.

[0122] Based on the first depth data of the scene model and the camera file, the positional relationship between the scene model rendered in the virtual space and the virtual camera can be as follows: Figure 5 shown.

[0123] 202. Create a plane model.

[0124] Optionally, in order to more finely control the deformation of the plane model, the plane model's patches may be subdivided so that the plane model contains more patches.

[0125] The plane model may be shown in FIG6(1), and a partial enlarged view of the plane model may be shown in FIG6(2).

[0126] 203. The plane model is distorted and displaced based on the program texture to obtain a fluid model.

[0127] For example, a noise map may be generated according to a noise algorithm, and the noise algorithm may include Perlin noise, Simplex noise, Fractal Brownian noise, and the like.

[0128] The offset information of each model vertex of the plane model is determined according to the texture map, and then the model vertex of the plane model is controlled to move according to the offset information, so that the plane model is distorted and deformed to obtain a fluid model. The local enlarged image of the fluid model can be shown as follows Figure 7 shown.

[0129] By distorting the fluid model, the distribution and shape of the fluid effects can be made more random.

[0130] 204. Sample the fluid model to obtain second depth data of the fluid model.

[0131] At least two types of second depth data of the fluid model can be obtained by sampling the fluid model through a virtual camera. Before adjusting the second depth data, the different types of second depth data are the same, that is, the different types of second depth data obtained by sampling are the same.

[0132] 205. Adjust the position of the fluid model in the virtual space according to the target fluid special effect height, so that the fluid model overlaps with the scene model.

[0133] Get the target fluid special effect height, control the movement of the fluid model according to the target fluid special effect height, make the origin of the fluid model (it can also be other reference points, which can be set according to the structure of the model, and is not limited here) at the target fluid special effect height, so that the fluid model overlaps with the scene model at the target fluid special effect height.

[0134] Compared with Figure 2(1) to Figure 2(3) The fluid model shown, Figure 7 The surface of the fluid model shown is undulating. Figure 7 The fluid model shown is a model obtained by deforming a plane model based on program texture control. The changes in the model are random and varied, so that the generated fluid special effects can be rich in changes.

[0135] 206. Perform adjustment processing on the second depth data of the fluid model to obtain adjusted second depth data.

[0136] For example, the fluid model has two types of depth data, deep.front and deep.back. Before adjustment, deep.front and deep.back are equal. Adjustment can be performed on deep.front and deep.back, respectively, which can be deep.front-A and deep.back+A, where A can be a value greater than zero.

[0137] For example, see Figure 3(1) to Figure 3(3) Schematic diagram of fog effect shown, FIG3(1) is the effect of A=0, wherein the white area is the part of the fluid model that is not blocked by the mountains; FIG3(2) is the effect of A=50, and it can be seen that more fluid models are displayed before the scene model; FIG3(3) is the effect of A=100, and compared with FIG3(2), FIG3(3) has more fluid models displayed before the scene model.

[0138] 207. Adjust the display parameters corresponding to the model points of the fluid model to obtain adjusted display parameters.

[0139] The display parameter may be opacity. For the fluid model, the display parameter of the fluid model may be adjusted according to the preset target adjustment parameter. For example, the display parameter and the preset adjustment parameter may be multiplied to obtain the adjusted display parameter. The opacity may be controlled by the alpha channel of the model point. Then the adjusted display parameter may be alpha×value, where value is the target adjustment parameter.

[0140] Exemplarily, the display parameter is opacity, and the preset adjustment parameter may be 0.3. The opacity of each model point of the fluid model is multiplied by 0.3 to obtain the adjusted opacity, ie, the adjusted display parameter.

[0141] Optionally, the adjustment parameter can also be determined based on a mapping relationship, and the preset relationship includes the corresponding relationship between the depth data and the adjustment parameter. For example, assuming that the fluid special effect to be generated is a fog special effect, the display parameter can be opacity. In the mapping relationship between the depth value and the adjustment parameter, the larger the depth value, the larger the adjustment parameter, so as to control the fog to be lighter nearby and thicker in the distance. For example, if the display parameter is color, the color of the fog in the near distance can be controlled to be lighter and the color of the fog in the distance to be darker by adjusting the parameter.

[0142] Optionally, the target adjustment parameters can also be processed in combination with the height data of the fluid model to achieve different fluid effects at high and low locations at the same depth. For example, the height data of each model point of the fluid model can be normalized and the height data can be mapped to between 0 and 1. The normalized height data can be used as a weight to perform weighted processing on the target adjustment parameters to obtain weighted target adjustment parameters. The weighted target adjustment parameters are multiplied by the display parameters to obtain adjusted display parameters.

[0143] Exemplarily, the fluid special effect is a fog special effect, and the display parameter is opacity. In order to simulate the effect that the higher the altitude, the thicker the fog, the larger the altitude data, the smaller the normalized altitude data, and the smaller the altitude data, the larger the normalized altitude data, so as to achieve that the fog at low places is more opaque than the fog at high places, that is, more obvious, creating an effect that the higher the altitude, the thinner the fog.

[0144] 208. Render the fluid model and the scene model based on the adjusted second depth data, the adjusted display parameter, and the first depth data to obtain a scene with fluid special effects.

[0145] Exemplarily, for different target fluid special effect heights, the schematic diagrams of the rendered images are shown in Figures 8(1) and 8(2). The black parts in Figures 8(1) and 8(2) can correspond to the scene model, and the gray parts can correspond to the fluid model. The target fluid special effect height corresponding to Figure 8(1) is smaller than the target fluid special effect height corresponding to Figure 8(2). Figures 8(1) and 8(2) are only schematic diagrams, not real rendering effects. Figures 8(1) and 8(2) show the display height of the fluid special effect in the scene at different target fluid special effect heights. For the fluid special effect of fog effect, the rendering effect can be specifically shown in Figures 3(2) and 3(3), and it can be seen that the fog has a light and dark effect.

[0146] As can be seen from the above, the embodiment of the present application creates a plane model by acquiring the first depth data of the scene model and the camera file of the scene, distorts and displaces the plane model based on the program texture to obtain a fluid model, samples the fluid model to obtain the second depth data of the fluid model, adjusts the position of the fluid model in the virtual space according to the target fluid special effect height so that the fluid model overlaps with the scene model, adjusts the second depth data of the fluid model to obtain adjusted second depth data, adjusts the display parameters corresponding to the model points of the fluid model to obtain adjusted display parameters, renders the fluid model and the scene model based on the adjusted second depth data, the adjusted display parameters and the first depth data, and obtains a scene with fluid special effects.

[0147] In the embodiment of the present application, the scene model and the fluid model overlap in the virtual space, so the fluid special effects simulated based on the fluid model have a strong sense of space with the scene, and by adjusting the second depth data of the fluid model, the front and back relationship between the fluid model and the scene model during rendering can be adjusted, thereby flexibly adjusting the intensity of the fluid special effects.

[0148] In order to better implement the fluid special effects processing method provided in the embodiment of the present application, a fluid special effects processing device is also provided in one embodiment. The meanings of the terms are the same as those in the above-mentioned fluid special effects processing method, and the specific implementation details can refer to the description in the method embodiment.

[0149] The fluid special effects processing device can be integrated into a computer device, such as Fig. 9 As shown, the fluid special effect processing device may include: a first acquisition unit 301, a second acquisition unit 302, a first adjustment unit 303, a second adjustment unit 304 and a rendering unit 305, as follows:

[0150] (1) a first acquisition unit 301, configured to acquire first depth data of a scene model;

[0151] (2) A second acquisition unit 302, used to acquire second depth data of the fluid model that overlaps with the scene model in the virtual space.

[0152] In one embodiment, the fluid special effects processing device provided by the present application may also include:

[0153] A model acquisition unit, used for acquiring a fluid model;

[0154] Height unit, used to obtain the height of the target fluid effect for the scene model;

[0155] The position adjustment unit is used to adjust the position of the fluid model in the virtual space according to the target fluid special effect height, so that the fluid model overlaps with the scene model at the target fluid special effect height.

[0156] In one embodiment, the model acquisition unit may also be used to:

[0157] Create a plane model;

[0158] Determine the offset information corresponding to each vertex of the plane model according to the program texture;

[0159] The model vertices of the plane model are controlled to be offset according to the offset information to obtain a fluid model.

[0160] (3) A first adjustment unit 303, configured to adjust the second depth data of the fluid model to obtain adjusted second depth data, so that at least a portion of the fluid model blocked by the scene model is rendered in front of the scene model.

[0161] In one embodiment, the second depth data has at least two types, and the second acquisition unit 302 may also be used for:

[0162] Sampling the fluid model based on the virtual camera to determine at least two types of second depth data of the fluid model, wherein the different types of second depth data are the same;

[0163] The first adjustment unit 303 may also be used for:

[0164] Each type of second depth data of the fluid model is adjusted to obtain adjusted second depth data corresponding to each type, wherein the adjusted second depth data of different types are different.

[0165] (4) A second adjustment unit 304 is used to adjust the display parameters corresponding to the model points of the fluid model to obtain adjusted display parameters.

[0166] In one embodiment, the second adjustment unit 304 may also be used to:

[0167] Determine the target adjustment parameter corresponding to the adjusted second depth data of each model point of the fluid model according to the mapping relationship between the depth data and the adjustment parameter corresponding to the display parameter;

[0168] The display parameters are adjusted based on the target adjustment parameters to obtain the adjusted display parameters.

[0169] In one embodiment, the second adjustment unit 304 may also be used to:

[0170] Obtain height data corresponding to the model points of the fluid model;

[0171] According to the height data of the model point of the fluid model, the target adjustment parameter is weighted to obtain the weighted target adjustment parameter;

[0172] The display parameters are adjusted according to the weighted target adjustment parameters to obtain adjusted display parameters.

[0173] (5) A rendering unit 305, configured to render the fluid model and the scene model based on the adjusted second depth data of the fluid model, the adjusted display parameters, and the first depth data of the scene model to obtain a scene with fluid special effects.

[0174] In one embodiment, the rendering unit 305 may also be used to:

[0175] For each type of second depth data, a plurality of display data corresponding to each screen pixel is calculated according to the second depth data, the adjusted display parameter and the first depth data;

[0176] Fusing multiple display data corresponding to the same screen pixel to obtain fused display data for each screen pixel;

[0177] A scene with fluid special effects is obtained by rendering based on the fused display data.

[0178] As can be seen from the above, the fluid special effects processing device of the embodiment of the present application obtains the first depth data of the scene model through the first acquisition unit 301; the second acquisition unit 302 obtains the second depth data of the fluid model that overlaps with the scene model in the virtual space; the first adjustment unit 303 adjusts the second depth data of the fluid model to obtain adjusted second depth data, so that at least part of the fluid model obscured by the scene model is rendered in front of the scene model; the second adjustment unit 304 adjusts the display parameters corresponding to the model points of the fluid model to obtain adjusted display parameters; the rendering unit 305 renders the fluid model and the scene model based on the adjusted second depth data of the fluid model, the adjusted display parameters and the first depth data of the scene model to obtain a scene with fluid special effects.

[0179] In the embodiment of the present application, the scene model and the fluid model overlap in the virtual space, so the fluid special effects simulated based on the fluid model have a strong sense of space with the scene, and by adjusting the second depth data of the fluid model, the front and back relationship between the fluid model and the scene model during rendering can be adjusted, thereby flexibly adjusting the intensity of the fluid special effects.

[0180] Accordingly, the embodiment of the present application also provides a computer device, which may be a terminal. Fig.10 As shown, Fig.10A schematic diagram of the structure of a computer device provided in an embodiment of the present application. The computer device 500 includes a processor 501 having one or more processing cores, a memory 502 having one or more computer-readable storage media, and a computer program stored in the memory 502 and executable on the processor. The processor 501 is electrically connected to the memory 502. It will be understood by those skilled in the art that the computer device structure shown in the figure does not constitute a limitation on the computer device, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0181] The processor 501 is the control center of the computer device 500. It uses various interfaces and lines to connect the various parts of the entire computer device 500, executes various functions of the computer device 500 and processes data by running or loading software programs and / or modules stored in the memory 502, and calling data stored in the memory 502, thereby monitoring the computer device 500 as a whole.

[0182] In the embodiment of the present application, the processor 501 in the computer device 500 will load instructions corresponding to the processes of one or more application programs into the memory 502 according to the following steps, and the processor 501 will run the application programs stored in the memory 502 to implement various functions:

[0183] Acquire first depth data of the scene model;

[0184] Acquire second depth data of the fluid model that overlaps with the position of the scene model in the virtual space;

[0185] The second depth data of the fluid model is adjusted to obtain adjusted second depth data, so that at least a portion of the fluid model blocked by the scene model is rendered in front of the scene model;

[0186] Adjusting the display parameters corresponding to the model points of the fluid model to obtain the adjusted display parameters;

[0187] Based on the adjusted second depth data of the fluid model, the adjusted display parameters and the first depth data of the scene model, the fluid model and the scene model are rendered to obtain a scene with fluid special effects.

[0188] From the above, it can be seen that the scene model and the fluid model of the embodiment of the present application overlap in the virtual space. Therefore, the fluid special effects simulated based on the fluid model have a strong sense of space with the scene, and by adjusting the second depth data of the fluid model, the front and back relationship between the fluid model and the scene model during rendering can be adjusted, and then the intensity of the fluid special effects can be flexibly adjusted.

[0189] The specific implementation of the above operations can be found in the previous embodiments, which will not be described in detail here.

[0190] Optional, such as Fig.10 As shown, the computer device 500 further includes: a touch screen 503, a radio frequency circuit 504, an audio circuit 505, an input unit 506, and a power supply 507. The processor 501 is electrically connected to the touch screen 503, the radio frequency circuit 504, the audio circuit 505, the input unit 506, and the power supply 507, respectively. Those skilled in the art can understand that Fig.10 The computer device structure shown in the figure does not constitute a limitation on the computer device, and may include more or less components than shown in the figure, or combine certain components, or arrange the components differently.

[0191] The touch display screen 503 can be used to display a graphical user interface and receive operation instructions generated by the user acting on the graphical user interface. The touch display screen 503 may include a display panel and a touch panel. Among them, the display panel may be used to display information input by the user or information provided to the user and various graphical user interfaces of computer equipment, and these graphical user interfaces may be composed of graphics, text, icons, videos and any combination thereof. Optionally, the display panel may be configured in the form of a liquid crystal display (LCD, Liquid Crystal Display), an organic light emitting diode (OLED, Organic Light-Emitting Diode) and the like. The touch panel may be used to collect the user's touch operation on or near it (such as the user using any suitable object or attachment such as a finger, a stylus, etc. on the touch panel or near the touch panel), and generate corresponding operation instructions, and the operation instructions execute corresponding programs. Optionally, the touch panel may include two parts, a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into the touch point coordinates, and then sends it to the processor 501, and can receive the command sent by the processor 501 and execute it. The touch panel can cover the display panel. When the touch panel detects a touch operation on or near it, it is transmitted to the processor 501 to determine the type of touch event, and then the processor 501 provides a corresponding visual output on the display panel according to the type of touch event. In an embodiment of the present application, the touch panel and the display panel can be integrated into the touch display screen 503 to realize the input and output functions. However, in some embodiments, the touch panel and the touch panel can be used as two independent components to realize the input and output functions. That is, the touch display screen 503 can also be used as a part of the input unit 506 to realize the input function.

[0192] The radio frequency circuit 504 may be used to send and receive radio frequency signals, so as to establish wireless communication with a network device or other computer devices through wireless communication, and to send and receive signals between the network device or other computer devices.

[0193] The audio circuit 505 can be used to provide an audio interface between the user and the computer device through a speaker and a microphone. The audio circuit 505 can transmit the electrical signal converted from the received audio data to the speaker, which is converted into a sound signal for output; on the other hand, the microphone converts the collected sound signal into an electrical signal, which is received by the audio circuit 505 and converted into audio data, and then the audio data is output to the processor 501 for processing, and then sent to another computer device through the radio frequency circuit 504, or the audio data is output to the memory 502 for further processing. The audio circuit 505 may also include an earphone jack to provide communication between an external headset and the computer device.

[0194] The input unit 506 may be used to receive input numbers, character information or user feature information (such as fingerprint, iris, facial information, etc.), and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control.

[0195] The power supply 507 is used to supply power to various components of the computer device 500. Optionally, the power supply 507 can be logically connected to the processor 501 through a power management system, so that the power management system can manage charging, discharging, and power consumption. The power supply 507 can also include one or more DC or AC power supplies, recharging systems, power failure detection circuits, power converters or inverters, power status indicators, and other arbitrary components.

[0196] although Fig.10 Not shown, the computer device 500 may also include a camera, a sensor, a wireless fidelity module, a Bluetooth module, etc., which will not be described in detail here.

[0197] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0198] A person of ordinary skill in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be completed by instructions, or by controlling related hardware through instructions. The instructions may be stored in a computer-readable storage medium and loaded and executed by a processor.

[0199] To this end, an embodiment of the present application provides a computer-readable storage medium, in which a plurality of computer programs are stored, and the computer program can be loaded by a processor to execute the steps in any one of the fluid special effects processing methods provided in the embodiment of the present application. For example, the computer program can execute the following steps:

[0200] Acquire first depth data of the scene model;

[0201] Acquire second depth data of the fluid model that overlaps with the position of the scene model in the virtual space;

[0202] The second depth data of the fluid model is adjusted to obtain adjusted second depth data, so that at least a portion of the fluid model blocked by the scene model is rendered in front of the scene model;

[0203] Adjusting the display parameters corresponding to the model points of the fluid model to obtain the adjusted display parameters;

[0204] Based on the adjusted second depth data of the fluid model, the adjusted display parameters and the first depth data of the scene model, the fluid model and the scene model are rendered to obtain a scene with fluid special effects.

[0205] From the above, it can be seen that the scene model and the fluid model of the embodiment of the present application overlap in the virtual space. Therefore, the fluid special effects simulated based on the fluid model have a strong sense of space with the scene, and by adjusting the second depth data of the fluid model, the front and back relationship between the fluid model and the scene model during rendering can be adjusted, and then the intensity of the fluid special effects can be flexibly adjusted.

[0206] The specific implementation of the above operations can be found in the previous embodiments, which will not be described in detail here.

[0207] The storage medium may include: a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0208] The above is a detailed introduction to a fluid special effects processing method, device, computer equipment and computer storage medium provided in the embodiments of the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea; at the same time, for technical personnel in this field, according to the ideas of the present application, there will be changes in the specific implementation methods and application scopes. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A method for processing fluid special effects, characterized in that: include: Acquire first depth data of the scene model; Acquire second depth data of a fluid model that overlaps with the position of the scene model in the virtual space; Performing adjustment processing on the second depth data of the fluid model to obtain adjusted second depth data, so that at least a portion of the fluid model blocked by the scene model is rendered in front of the scene model; Adjusting the display parameters corresponding to the model points of the fluid model to obtain adjusted display parameters; Based on the adjusted second depth data of the fluid model, the adjusted display parameters and the first depth data of the scene model, the fluid model and the scene model are rendered to obtain a scene with fluid special effects.

2. The method according to claim 1, characterized in that The second depth data has at least two types, and the acquiring the second depth data of the fluid model overlapping with the scene model in the virtual space includes: Sampling the fluid model based on a virtual camera to determine at least two types of second depth data of the fluid model, wherein the different types of second depth data are the same; The step of adjusting the second depth data of the fluid model to obtain adjusted second depth data includes: The second depth data of each type of the fluid model is adjusted respectively to obtain adjusted second depth data corresponding to each type, wherein the adjusted second depth data of different types are different.

3. The method according to claim 2, characterized in that The step of rendering the fluid model and the scene model based on the adjusted second depth data of the fluid model, the adjusted display parameter, and the first depth data of the scene model to obtain a scene with fluid special effects includes: For each type of second depth data, calculating a plurality of display data corresponding to each screen pixel according to the second depth data, the adjusted display parameter and the first depth data; Fusing the plurality of display data corresponding to the same screen pixel to obtain fused display data of each screen pixel; A scene with fluid special effects is obtained by rendering according to the fused display data.

4. The method according to any one of claims 1 to 3, characterized in that: Before acquiring the second depth data of the fluid model overlapping with the scene model in the virtual space, the method further includes: Get the fluid model; Obtaining a target fluid special effect height for the scene model; The position of the fluid model in the virtual space is adjusted according to the target fluid special effect height, so that the fluid model overlaps with the scene model at the target fluid special effect height.

5. The method according to claim 4, characterized in that The step of obtaining the fluid model comprises: Create a plane model; Determine the offset information corresponding to each vertex of the plane model according to the program texture; The model vertices of the plane model are controlled to be offset according to the offset information to obtain the fluid model.

6. The method according to claim 1, characterized in that The adjusting the display parameters corresponding to the model points of the fluid model to obtain the adjusted display parameters includes: Determining the target adjustment parameter corresponding to the adjusted second depth data of each model point of the fluid model according to a mapping relationship between the depth data and the adjustment parameter corresponding to the display parameter; The display parameter is adjusted based on the target adjustment parameter to obtain the adjusted display parameter.

7. The method according to claim 6, characterized in that The adjusting the display parameter based on the target adjustment parameter to obtain the adjusted display parameter includes: Acquire height data corresponding to a model point of the fluid model; According to the height data of the model point of the fluid model, the target adjustment parameter is weighted to obtain the weighted target adjustment parameter; The display parameters are adjusted according to the weighted target adjustment parameters to obtain the adjusted display parameters.

8. A fluid special effects processing device, characterized in that: include: A first acquisition unit, used to acquire first depth data of the scene model; A second acquisition unit, configured to acquire second depth data of a fluid model that overlaps with the scene model in the virtual space; A first adjustment unit is used to adjust the second depth data of the fluid model to obtain adjusted second depth data, so that at least a portion of the fluid model blocked by the scene model is rendered in front of the scene model; A second adjustment unit, used for adjusting the display parameters corresponding to the model points of the fluid model to obtain adjusted display parameters; A rendering unit is used to render the fluid model and the scene model based on the adjusted second depth data of the fluid model, the adjusted display parameters and the first depth data of the scene model to obtain a scene with fluid special effects.

9. A computer device, characterized in that: It comprises a memory and a processor; the memory stores a computer program, and the processor is used to run the computer program in the memory to execute the fluid special effect processing method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium is used to store a computer program, and the computer program is loaded by a processor to execute the fluid special effect processing method according to any one of claims 1 to 7.

Images