Special effect processing method and device, computer equipment and computer readable storage medium

Abstract

The embodiment of the invention discloses a special effect processing method and device, computer equipment and a computer readable storage medium, and the method comprises the steps: obtaining a target model which comprises a planar model with a plurality of overlapped target points; determining parallax information of the pixel points according to the position relationship between the pixel points of the target model and the virtual camera; for each planar model of the target model, determining a special effect area from the planar model according to the shape control information of the target special effect and the distance between a pixel point in the planar model and a target point location; at least two target special effect areas observed from a virtual camera in the special effect area; according to the display parameters and the parallax information of the at least two target special effect areas, the target special effect areas are rendered to obtain the target special effect, and the visual change effect of the special effect under different visual angles can be achieved.

Description

Technical Field

[0001] The present application relates to the field of special effects production, and specifically to a special effects processing method, device, computer equipment and computer-readable storage medium, wherein the storage medium is a computer-readable storage medium and the product is a computer program product. Background Art

[0002] In the process of game production or film and television special effects production, special effects such as luminous three-dimensional objects are usually produced. The camera can be pointed at by a two-dimensional patch grid, and the volume of the three-dimensional object can be simulated through texture bias and attenuation function. However, the reliability of this method is low. When the camera is close to the two-dimensional patch grid, it is easy to appear out of place, and it is impossible to present multi-perspective visual changes. Summary of the invention

[0003] The embodiments of the present application provide a special effect processing method, apparatus, computer device and computer-readable storage medium, which can achieve visual change effects of special effects under different viewing angles.

[0004] A special effects processing method provided in an embodiment of the present application includes:

[0005] Acquire a target model, wherein the target model includes a plane model with multiple target points overlapping;

[0006] Determining disparity information of the pixel points according to the positional relationship between the pixel points of the target model and the virtual camera;

[0007] For each plane model of the target model, a special effect area is determined from the plane model according to shape control information of the target special effect and the distance between the pixel point in the plane model and the target point;

[0008] Determine at least two target special effect areas observed by the virtual camera from the special effect areas;

[0009] The target special effect area is rendered according to the display parameters of the at least two target special effect areas and the parallax information to obtain the target special effect.

[0010] Accordingly, an embodiment of the present application further provides a special effects processing device, including:

[0011] An acquisition unit, used for acquiring a target model, wherein the target model includes a plane model with multiple target points overlapping;

[0012] An information determining unit, configured to determine the disparity information of the pixel point according to the positional relationship between the pixel point of the target model and the virtual camera;

[0013] A first area determination unit is used to determine a special effect area from each plane model of the target model according to shape control information of the target special effect and a distance between a pixel point in the plane model and a target point;

[0014] A second area determination unit, configured to determine at least two target special effect areas observed by the virtual camera from the special effect area;

[0015] A rendering unit is used to render the target special effect area according to the display parameters of the at least two target special effect areas and the parallax information to obtain the target special effect.

[0016] Correspondingly, an embodiment of the present application also provides a computer device, including a memory and a processor; the memory stores a computer program, and the processor is used to run the computer program in the memory to execute any special effect processing method provided in the embodiment of the present application.

[0017] Correspondingly, an embodiment of the present application also provides a computer-readable storage medium, which is used to store a computer program, and the computer program is loaded by a processor to execute any special effect processing method provided in the embodiment of the present application.

[0018] The embodiment of the present application obtains a target model, which includes a plane model with multiple overlapping target points; determines the disparity information of the pixel points based on the positional relationship between the pixel points of the target model and the virtual camera; for each plane model of the target model, determines the special effect area from the plane model based on the shape control information of the target special effect and the distance between the pixel points in the plane model and the target points; obtains at least two target special effect areas observed by the virtual camera from the special effect area; and renders the target special effect area based on the display parameters and disparity information of the at least two target special effect areas to obtain the target special effect.

[0019] In the embodiment of the present application, the virtual camera observes more than one plane model each time, so the rendered target special effects have a strong sense of three-dimensionality and are not easy to be exposed. In addition, the plane models observed from different camera perspectives are different, which can achieve the visual change effect of special effects at different perspectives. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0021] Figure 1is a flow chart of a special effects processing method provided in an embodiment of the present application;

[0022] Figure 2 is a schematic diagram of a target model provided in an embodiment of the present application;

[0023] Figure 3 is a schematic diagram of a plane model and a target model provided in an embodiment of the present application;

[0024] Figure 4 is a schematic diagram of the plane model rotation and target model provided in the embodiment of the present application;

[0025] Figure 5 is a schematic diagram of the target special effect provided in the embodiment of the present application;

[0026] Figure 6 is a schematic diagram of a process for determining an internal region of a target special effect provided in an embodiment of the present application;

[0027] Figure 7 is a schematic diagram of a plane model and a contour area determination process provided in an embodiment of the present application;

[0028] Figure 8 is another flow chart of the special effect processing method provided in an embodiment of the present application;

[0029] Fig. 9 is a schematic diagram of a noise texture provided in an embodiment of the present application;

[0030] Fig.10 is a schematic diagram of parallax information of a plane model provided in an embodiment of the present application;

[0031] Fig.11 is a schematic diagram of a special effects processing device provided in an embodiment of the present application;

[0032] Fig.12 It is a schematic diagram of the structure of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0033] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of this application.

[0034] The embodiments of the present application provide a special effect processing method, device, computer equipment and computer readable storage medium. The special effect processing device can be integrated in a computer equipment, which can be a server or a terminal.

[0035] The terminal may include a mobile phone, a wearable smart device, a tablet computer, a laptop computer, a personal computer (PC), and a vehicle-mounted computer.

[0036] Among them, the server can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDN), as well as big data and artificial intelligence platforms.

[0037] It should be noted that the description order of the following embodiments is not intended to limit the preferred order of the embodiments.

[0038] This embodiment will be described from the perspective of a special effect processing device. The special effect processing device may be integrated into a computer device, which may be a server or a terminal.

[0039] The embodiment of the present application provides a special effect processing method, such as Figure 1 As shown, the specific process of the special effect processing method can be as follows:

[0040] 101. Obtain a target model, wherein the target model includes a plane model with multiple target points overlapping.

[0041] Among them, the target model includes multiple plane models, and the target point is a position on the plane model, for example, it can be the origin of the plane model, or the plane center of the plane model. The target point can also be other points on the plane model. The target points of multiple plane models contained in the target model overlap.

[0042] Taking the target point as the plane center as an example, the target model containing two mutually perpendicular plane models can be as follows Figure 2 shown.

[0043] In one embodiment, at least one new plane model can be obtained by rotating a plane model around its coordinate axis, and the original plane model and the new plane model can be used as target models. That is, in one embodiment, the target model is generated by the following steps:

[0044] Acquire a plane model, wherein the coordinate axis of the plane model passes through the target point of the plane model;

[0045] For at least one coordinate axis of the plane model, rotating the plane model around the coordinate axis at least once to obtain at least one new plane model;

[0046] The target model is generated based on the new plane model obtained by rotating each of the coordinate axes and the plane model.

[0047] The coordinate axis of the plane model may be considered as the coordinate axis in the model space of the plane model, and the coordinate axis of the plane model passes through the target point of the plane model, that is, the target point is the origin of the plane model. Since the coordinate axis of the plane model passes through the target point, the target point of the new plane model obtained by rotating around the coordinate axis overlaps with the target point of the original plane model.

[0048] For example, the plane model can be Figure 3 As shown in (1), the red and green lines are two coordinate axes of the plane model, the origin of the model is the plane center of the plane model, and the plane model is rotated around the green coordinate axis by 45°, 90° and 135° respectively, and the following can be obtained: Figure 3 The model shown in (2) includes 4 plane models, and the model centers of the 4 plane models overlap.

[0049] The plane model can also be rotated around at least two coordinate axes of the plane model to obtain the target model. For example, Figure 4 As shown in (1), rotating 45°, 90° and 135° around each coordinate axis, and then superimposing, we can get Figure 4 The target model shown in (2).

[0050] The coordinate axis around which the plane model revolves can be flexibly set according to application requirements and is not limited here.

[0051] The embodiment of the present application can render the target special effects through multiple plane models. The plane models observed from different camera perspectives are different, so the continuity of the special effects is good and the credibility is high. In addition, the embodiment of the present application determines the special effects area through shape control information, does not require complex texture mapping, has high special effects production efficiency, and does not require complex volume rendering calculations, which can reduce the performance consumption of computer equipment.

[0052] 102. Determine disparity information of the pixel points according to a positional relationship between the pixel points of the target model and the virtual camera.

[0053] For example, the distance between the pixel point and the virtual camera can be determined according to the position of the pixel point in the world space and the position of the virtual camera in the world space, and the disparity information can be determined based on the distance. The larger the disparity information distance, the larger the disparity information.

[0054] Determining the disparity information based on the distance may specifically be taking the distance as the disparity information, or mapping the distance to a preset data range, for example, between 0 and 1, to obtain the disparity information.

[0055] Optionally, the step of "determining the disparity information of the pixel point according to the positional relationship between the pixel point of the target model and the virtual camera" may also be: determining the disparity information of the pixel point according to the angle between the normal direction corresponding to the pixel point of the target model and the target direction, and the target direction is determined based on the ray direction from the virtual camera to the pixel point.

[0056] The target direction may be the direction of a ray from the virtual camera to the pixel point, or may be the opposite direction of the ray direction.

[0057] The distance between the pixel point and the virtual camera can be determined based on the angle between the normal direction and the target direction. For example, for the opposite direction of the ray direction from the virtual camera to the pixel point, the larger the angle between the opposite direction and the normal direction corresponding to the pixel point, the farther the pixel point is from the camera. Therefore, the parallax information of the pixel point can be determined based on the angle between the normal direction and the target direction.

[0058] Exemplarily, the cosine of the angle between the opposite direction and the normal direction can be used as the disparity information, or the absolute value of the cosine of the angle between the ray direction and the normal direction can be used as the disparity information. The specific calculation formula can be: disparity information = abs(dot(normalWorld,veiwWorld)), where abs(x) is a function for calculating the absolute value of x, dot(A,B) represents the dot product of two vectors A and B, normalWorld is the normal vector corresponding to the pixel point, and veiwWorld is the vector corresponding to the ray direction from the virtual camera to the pixel point.

[0059] Optionally, the disparity information may be mapped to data in a preset value range. For example, the disparity information may be mapped to a value between 0 and 1 through smoothstep(), or the disparity information may be mapped through other functions, which are not limited here.

[0060] In one embodiment, the disparity information and the noise texture may be combined to achieve a delicate and dreamy special effect. Specifically, the disparity information and the noise texture may be multiplied to obtain the adjusted disparity information. That is, before the step of "calculating the region identification information of the pixel point according to the region index information and the disparity information of the pixel point", the special effect processing method provided in the embodiment of the present application may further include:

[0061] Get the noise texture;

[0062] The disparity information of the pixel point is adjusted according to the noise texture to obtain adjusted disparity information.

[0063] The noise texture may be a noise map. For each pixel point on the plane model, the texture coordinates of the noise texture may be targeted and the noise texture may be sampled to obtain texture data. The texture data and the disparity information may be multiplied to obtain the adjusted disparity information of the pixel point.

[0064] Optionally, the texture coordinates of the pixel points may be associated with the time function to bias the texture coordinates of the pixel points to achieve texture changes of the target model.

[0065] After the disparity information is adjusted, the special effect area can be determined based on the adjusted disparity information, so that the special effect area determined based on the disparity information also changes dynamically, thereby achieving a dynamic defense effect of the special effect.

[0066] 103. For each plane model of the target model, determine a special effect area from the plane model according to shape control information of the target special effect and a distance between a pixel point in the plane model and a target point.

[0067] Among them, the shape control information of the target special effect can be used to control the shape of the special effect rendered based on the target model. The special effect area can be determined on each plane model according to the shape control information, so as to render a special effect of a specified shape based on the special effect area, such as light ball special effects, light ball rhythmic special effects, light columns, and luminous cubes.

[0068] The corresponding shape control parameters can be set according to the shape of the desired target special effect, so that special effects of different shapes can be rendered.

[0069] The distance between the pixel point and the target point may be determined according to the coordinates of the pixel point and the target point in the virtual space, or may be determined according to the texture coordinates of the pixel point and the target point.

[0070] For each plane model, the area in the plane model that needs to be used to render special effects, i.e., the special effects area, can be determined based on the distance between the pixel points and the target points. For example, if you want to render the light ball rhythm special effects, you need to determine a circular area on the plane model. According to the radius of the required circular area, the pixel points with a distance less than or equal to the radius can be determined as the special effects area, and the pixel points with a distance greater than the radius can be determined as the non-special effects area.

[0071] Exemplarily, the distance between the pixel point and the target point is determined by texture coordinates, and a circular area is determined from the plane model through the smoothstep() function. The specific shape control information may be smoothstep(0,0.5,distance), where distance represents the distance between the pixel point and the target position. smoothstep(0,0.5,distance) may determine the area where the pixel points with a distance greater than 0.5 are located as a non-special effect area, and determine the area where the pixel points with a distance less than 0.5 are located as a special effect area.

[0072] If you need to determine a rectangular area on the plane model, you can use smoothstep(0,0.5,max((dx,dy)), where dx represents the distance between the pixel and the target point in the x-axis direction, dy represents the distance between the pixel and the target point in the y-axis direction, and max() represents the maximum value.

[0073] In one embodiment, in order to deform the special effect shape, the index information from outside to inside can be obtained according to the distance between the pixel point and the target point in the plane model, and the special effect area can be determined in the plane by combining the index information and the parallax information. That is, in one embodiment, the step of "determining the special effect area from the plane model according to the shape control information of the target special effect and the distance between the pixel point and the target point in the plane model" can include:

[0074] Determine the area index information corresponding to each pixel point according to the shape control information of the target special effect and the distance between the pixel point and the target point in the plane model;

[0075] The region identification information of the pixel point is calculated according to the region index information and the parallax information of the pixel point to obtain the special effect region of the plane model.

[0076] The regional indicator information is used to determine whether the pixel is in the special effect area. For example, if the regional indicator information meets the conditions, the pixel is determined to be in the special effect area. Otherwise, the pixel is not in the special effect area. Exemplarily, the regional indicator information can be a value in the range of 0 to 1. The regional indicator information is compared with a preset numerical range or a preset threshold to determine whether the pixel is in the special effect area and assign the corresponding regional identification information.

[0077] The region identification information is information marking whether a pixel point is in a special effect region. For example, if the pixel point is determined to belong to the special effect region based on the region indicator information, the pixel point is assigned region identification information marking that the pixel point is in the special effect region. If the pixel point is determined not to belong to the special effect region based on the region indicator information, the pixel point is assigned region identification information marking that the pixel point is not in the special effect region. In one embodiment, the region identification information may be two different data, one indicating that the pixel point is in the special effect region, and the other indicating that the pixel point is not in the special effect region. Exemplarily, whether the pixel point is in the special effect region may be marked by 1 and 0, respectively.

[0078] The target special effect shape control parameters can be set according to the required shape and size of the target special effect, and the area index information of each pixel point in each plane model can be determined according to the shape control parameters and the distance between the pixel point in the plane model and the target point.

[0079] For example, if the target special effect is a sphere or a ring-shaped contour special effect, the regional index information of each pixel can be obtained by gradient = 1-smoothstep(0, 0.25, distance(uv, float2(0.5, 0.5))). The value in the smoothstep() function can be adjusted according to the required special effect size. For example, the regional index information can also be gradient = 1-smoothstep(0, 0.5, distance(uv, float2(0.5, 0.5))). Among them, gradient is the regional index information, uv is the texture coordinate of the pixel point, and float2(0.5, 0.5) is the texture coordinate of the target point.

[0080] In one embodiment, the special effect area may include an internal area and a contour area, and the pixel point may correspond to different area indicator information and area identification information for the internal area and the contour area. For the internal area, the pixel point corresponds to the first area indicator information and the first area identification information, and the first area indicator information is used to determine whether the pixel point is a pixel point in the internal area, and the first area identification information is used to indicate whether the pixel point is a pixel point in the internal area. For the internal area and the contour area, the step of "calculating the area identification information of the pixel point according to the area indicator information and disparity information of the pixel point" includes:

[0081] For each plane model, adjusting the first area index information of each pixel point according to the disparity information corresponding to each pixel point in the plane model to obtain first adjusted index information;

[0082] Mapping the first adjusted indicator information into a preset value range to obtain mapped indicator information;

[0083] The mapped index information is processed according to a first processing function corresponding to the internal area to obtain first area identification information of the pixel point.

[0084] Among them, the first processing function can be used to generate the first area identification information of the pixel point according to the mapped indicator information of the pixel point. The first processing function can be a smoothstep() function or a step() function, etc., with a preset data range, for example, it can be 0-1 or other numerical ranges.

[0085] The first region index information is adjusted according to the disparity information, for example, the first region index information and the disparity information are added, subtracted or multiplied, so that the first region index information is correlated with the disparity to obtain the first adjusted index information.

[0086] The first adjusted indicator information is mapped into a preset data range to obtain mapped indicator information, and then the first region identification information is generated based on the mapped indicator information through a first processing function.

[0087] For example, in order to achieve Figure 5 For the internal special effects of the special effects shown, the first area indicator information can be determined in the following way, where gradient (inside) is the first area indicator information.

[0088] gradient(internal)=1-smoothstep(0,0.5,distance(uv,float2(0.5,0.5))).

[0089] For a plane model, its first region index information can be as follows: Figure 6 shown in (1).

[0090] The first region identification information can be determined in the following manner, wherein innerRange is the first region identification information, the processing of saturate(x) is as follows: if x<0, return 0, if x>1, return 1, 0<x<1, return x, and atten is the disparity information.

[0091] innerRange=1-moothstep(0.05,0.1,1-saturate(gradient*atten)).

[0092] For a plane model, its first region identification information can be as follows: Figure 6 As shown in (2), the white area is the internal area, that is, 1 indicates that the pixel is in the internal area, and 0 indicates that the pixel is not in the internal area. In order to achieve a better display effect, the black and white colors of the plane model can be replaced. The replaced target model can be shown as Figure 6 As shown in (3).

[0093] It is understandable that the parameters can be flexibly adjusted according to the required special effect shape and size, and are not limited here.

[0094] The pixel point corresponds to the second area indicator information and the second area identification information for the contour area, the second area indicator information is used to determine whether the pixel point is a pixel point in the contour area, and the second area identification information is used to indicate whether the pixel point is a pixel point in the contour area. For the internal area and the contour area, the step of "calculating the area identification information of the pixel point according to the area indicator information and disparity information of the pixel point" may include:

[0095] For each plane model, adjusting the second area index information of each pixel point according to the disparity information corresponding to each pixel point in the plane model to obtain second adjusted index information;

[0096] According to the magnitude relationship between the first processing parameter of the second processing function corresponding to the contour area and the second area index information, performing a first mapping process on the second area index information to obtain first reference index information;

[0097] According to the magnitude relationship between the second processing parameter of the second processing function and the second adjusted indicator information, performing a second mapping process on the second adjusted indicator information to obtain second reference indicator information;

[0098] Second region identification information of the pixel is obtained according to the first reference indicator information and the second reference indicator information.

[0099] The second processing function may be a smoothstep() function or a step() function, etc.

[0100] The second region index information is adjusted according to the disparity information, for example, the second region index information and the disparity information are added, subtracted or multiplied, so that the second region index information is correlated with the disparity to obtain the second adjusted index information.

[0101] The second adjusted index information is processed by the second processing function to obtain the first reference index information, the regional index information is processed by the second processing function to obtain the second reference index information, and the second regional identification information is obtained based on the first reference index information and the second reference index information. For example, the first reference index information and the second reference information can be multiplied to obtain the target reference index information, and then the target index parameter information is processed by the smoothstep() function to obtain the second regional identification information of the pixel point.

[0102] For example, in order to achieve Figure 5 For the contour effect of the special effect shown, the second area indicator information can be determined in the following way, where gradient (outside) is the second area indicator information.

[0103] gradient(external)=1-smoothstep(0,0.5,distance(uv,float2(0.5,0.5))).

[0104] For a plane model, its second region index information can be as follows: Figure 7 shown in (1).

[0105] The second area identification information can be determined in the following way, where 0.1 is the first processing parameter, 0.2 is the second processing parameter, outEdge is the second area identification information, frac(x) is the decimal processing, and the processing of step(x,a) is that if x is less than a, 0 is returned, and if x is greater than or equal to a, 1 is returned.

[0106] outEdge=(1-step(frac((gradient*atten)*5),0.1))*step(gradient,0.2).

[0107] For a plane model, its second region identification information can be as follows: Figure 7 As shown in (2), the target model can be Figure 7 As shown in (3).

[0108] It is understandable that the processing parameters can be flexibly adjusted according to the required special effect shape and size, and are not limited here.

[0109] 104. Determine at least two target special effect areas observed by the virtual camera from the special effect areas.

[0110] The target model contains target points of multiple plane models that overlap each other. The target model is photographed by a virtual camera, and special effects can be rendered based on the partial model photographed by the virtual camera. The virtual camera can only observe part of the target model each time, that is, it can only observe part of the special effects area.

[0111] At least two special effect areas observed by the camera may be determined from a plurality of special effect areas of the target model according to the viewing angle range of the virtual camera.

[0112] 105. Render the target special effect area according to display parameters of the at least two target special effect areas and the parallax information to obtain a target special effect.

[0113] Among them, the display parameters may include at least one of special effect color and transparency, and the parallax information may be used to adjust the display parameters so that the display effects of pixels with different angles between the normal direction and the target direction are different, such as different colors or different transparencies.

[0114] In one embodiment, the step of “rendering the target special effect area according to the display parameters of the at least two target special effect areas and the disparity information to obtain the target special effect” may include:

[0115] Determine, according to the display parameter and the parallax information, a pixel value of each pixel point in the target special effect area observed by the virtual camera;

[0116] The target special effect is rendered according to the pixel value of each pixel in the target special effect area.

[0117] The pixel value of a pixel point may include a color value, and the color value may be preset or determined according to a user input; optionally, the pixel value of a pixel point may also include the transparency of the pixel point.

[0118] The display parameter may include at least one color, and the color value of each pixel in the target special effect area may be determined by interpolating the colors.

[0119] The color value or transparency of the pixel can be adjusted through the disparity information.

[0120] The target special effect is rendered according to the pixel value of each pixel in the target special effect area.

[0121] In one embodiment, the target special effect area may include an internal area and an outline area, the internal area and the outline area may correspond to different colors, and color interpolation processing may be performed on the internal area and the outline area respectively to determine the color values ​​of the pixels in the internal area and the color values ​​of the pixels in the outline area. Specifically, color interpolation may be performed by the function lerp(c1, c2, x), wherein c1 and c2 may be the same two colors or different two colors, c1 and c2 may be pre-set or determined according to user input, and x may be area identification information.

[0122] In one embodiment, the transparency can be adjusted by parallax information so that pixels farther from the camera appear darker, that is, the display parameters include transparency. Before the step of "rendering the target special effect area according to the display parameters of the at least two target special effect areas and the parallax information to obtain the target special effect", the method further includes:

[0123] Acquire initial transparency of pixels of at least two target plane models observed by the virtual camera;

[0124] The initial transparency is adjusted according to the disparity information to obtain an adjusted transparency.

[0125] For example, the initial transparency of the pixels of at least two target plane models observed by the virtual camera may be obtained, and the parallax information and the initial transparency may be multiplied to adjust the initial transparency to obtain the adjusted transparency.

[0126] Optionally, the target model can be made to cyclically move in the (0,0,1) direction by using a time function (e.g., sint) and acting on the float3 (0,0,1) direction, and outputting it to the world coordinate offset interface, thereby realizing the photosphere rhythm.

[0127] It can be understood that the special effects processing method provided in the embodiment of the present application can be implemented by a shader.

[0128] As can be seen from the above, the embodiment of the present application obtains a target model, which includes a plane model with multiple target points overlapping; determines the disparity information of the pixel points based on the positional relationship between the pixel points of the target model and the virtual camera; for each plane model of the target model, determines the special effects area from the plane model based on the shape control information of the target special effect and the distance between the pixel points in the plane model and the target points; at least two target special effects areas observed by the virtual camera from the special effects area; and renders the target special effects area based on the display parameters and disparity information of at least two target special effects areas to obtain the target special effects.

[0129] In the embodiment of the present application, the virtual camera observes more than one plane model each time, so the rendered target special effects have a strong sense of three-dimensionality and are not easy to be exposed. In addition, the plane models observed from different camera perspectives are different, which can achieve the visual change effect of special effects at different perspectives.

[0130] In order to more clearly illustrate the special effect processing method provided by the present application, the target special effect will be taken as follows. Figure 5 The light ball special effect shown in the figure is used as an example to illustrate that the process of the special effect processing method provided in the following application embodiment can be as follows Figure 8 shown.

[0131] 201. Obtain a target model.

[0132] The target model can be Figure 4 As shown in (2), the process of making the target model can refer to the above-mentioned related content and will not be repeated here.

[0133] 202. Perform texture mapping on the target model based on the noise texture, and obtain texture data of each pixel point of the target model.

[0134] Step 202 can be implemented through a material shader, specifically through the first part of the material shader. The writing of the first part of the material shader can include sampling a smoothly transitioned noise map, scaling and offsetting the noise map to align it with the texture coordinates of the target model, and associating the texture of the target model with a time function (for example, sin(t)), so as to control the flow speed of the texture.

[0135] For example, the noise map can be Fig. 9 shown.

[0136] Therefore, the target model can be texture mapped based on the noise map through the material shader to obtain the texture coordinates of each pixel of the target model.

[0137] 203. Determine the parallax information of the pixel point, and control the parallax effect of the light ball special effect according to the parallax information.

[0138] Step 203 may be implemented by a material shader, specifically by the second part of the material shader. The writing of the second part of the material shader may include:

[0139] Multiply the normal of the pixel point in the world space by the camera direction (the direction of the ray from the virtual camera to the pixel point), and take the absolute value to get the change factor of the light ball toward the camera direction. The smaller the angle between the camera direction and the normal direction, the larger the change factor.

[0140] The smoothstep function is used to control the value range of the parallax information, and the parallax information is output to the opacity interface to simulate the effect of light ball parallax under multiple perspectives. Since the surface of a spherical object is an arc-shaped plane, the distances from different points on the plane to the virtual camera may be different. By controlling the opacity of the special effect area based on the parallax information, the parallax feeling that the edge of the surface of the light ball is farther away than the center can be simulated to create a three-dimensional effect.

[0141] The pseudo code is as follows:

[0142] atten=smoothstep(attenAdjust1,attenAdjust2,abs(dot(normalWorld,veiwWorld)))

[0143] Among them, atten is the disparity information, attenAdjust1 is the disparity value control value 1, attenAdjust2 = disparity control value 2, normalWorld = the normal vector in the world space, and wiewWorld = the camera direction in the world space.

[0144] The disparity information of a plane model can be expressed as Fig.10 (1) as shown.

[0145] Combining the disparity information with the texture data obtained in step 202 can control the dynamic change of the disparity information. Fig.10 The disparity information shown in (1) is adjusted by the texture data as shown in Fig.10 As shown in (2), the adjusted disparity information corresponding to the target model is shown in (3).

[0146] 204. Determine an internal area of ​​the plane model according to the distance between the pixel point in the plane model and the plane center and the parallax information.

[0147] Step 204 can be implemented by the third part of the material shader. The writing of the third part of the material shader may include:

[0148] Calculate the distance field between the texture coordinates of each pixel on the plane model and the texture coordinates float2 (0.5, 0.5) of the center of the plane, scale the range of the distance field through smoothstep, and then perform the inversion process to obtain the first attenuation trend (that is, the first area indicator information). The pseudo code is as follows, where gradient is the first attenuation trend:

[0149] gradient=1-smoothstep(0,0.25,distance(uv,float2(0.5,0.5)))

[0150] Combined with the adjusted parallax information obtained in step 203, the simulation of the inner area of ​​the light ball special effect is completed through an algorithm. The pseudo code is as follows, where innerRange is the inner area:

[0151] innerRange=1-smoothstep(0.05,0.1,1-saturate(gradient*atten))

[0152] 205. Determine a contour area of ​​the plane model according to the distance between the pixel point in the plane model and the plane center and the parallax information.

[0153] Step 205 can be implemented by the fourth part of the material shader. The writing of the fourth part of the material shader may include:

[0154] Calculate the distance field between the texture coordinates of each pixel in the plane model and the texture coordinates float2 (0.5, 0.5) of the plane center of the plane model, scale the range of the distance field through smoothstep, and then perform the inversion process to obtain the second attenuation trend (i.e., the second area indicator information). The pseudo code is as follows, where gradient is the second attenuation trend:

[0155] gradient=1-smoothstep(0,0.5,distance(uv,float2(0.5,0.5)));

[0156] Combined with the adjusted parallax information obtained in step 203, the simulation of the light ball special effect contour is completed through the algorithm. The pseudo code is as follows, where outEdge is the contour area:

[0157] outEdge=(1-step(frac((gradient*atten)*5),0.1))*step(gradient,0.2)

[0158] 206. Perform color interpolation processing on the inner area and the outline area respectively, and input the self-luminous interface to render the light ball special effect.

[0159] Step 206 can be implemented by the fifth part of the material shader. The writing of the fifth part of the material shader may include:

[0160] For the internal area and the outline area, you can use the lerp() function to perform color interpolation, send the difference processed color value to the self-luminous interface, control the self-luminous area of ​​the internal area and the outline area, and realize the light ball effect; you can also Figure 7 The plane model shown in (2) can also set different effects for the inner white area and the outer white area in the plane model, for example, setting a white luminous effect for the inner white area and a gradient luminous effect for the outer white area.

[0161] Specifically, for Figure 7 The plane model shown in (2) can be smoothed by using smooth() to smooth the pixels at the edge of the black area of ​​the plane model, so that the pixels gradually change from 0 to 1, obtaining a transition area from black to white, where 0 is black and 1 is white; color interpolation is performed on the transition area to achieve the effect of glowing the outline of the black area, which is also applicable to the outlines of other shapes and is not limited here.

[0162] Since the inner contour line is 1, and the contour line of the transition area is between 0-1, the two contours can be set to present different effects.

[0163] From the above, it can be seen that the embodiment of the present application obtains the target model, performs texture mapping on the target model based on the noise texture, and the texture data of each pixel point of the target model, determines the disparity information of the pixel point, and controls the disparity effect of the light ball special effect according to the disparity information, determines the internal area of ​​the plane model according to the distance and disparity information between the pixel point in the plane model and the center of the plane, determines the contour area of ​​the plane model according to the distance and disparity information between the pixel point in the plane model and the center of the plane, performs color interpolation processing on the internal area and the contour area respectively, and inputs the self-luminous interface to render the light ball special effect.

[0164] In the embodiment of the present application, the virtual camera observes more than one plane model each time, so the rendered light ball special effect has a strong sense of three-dimensionality and is not easy to be exposed. In addition, the plane models observed at different camera perspectives are different, and the visual change effect of the light ball at different camera perspectives can be achieved.

[0165] In order to better implement the special effect processing method provided in the embodiment of the present application, a special effect processing device is also provided in one embodiment. The meanings of the terms are the same as those in the special effect processing method described above, and the specific implementation details can refer to the description in the method embodiment.

[0166] The special effect processing device can be integrated into a computer device, such as Fig.11 As shown, the special effect processing device may include: an acquisition unit 301, an information determination unit 302, a first area determination unit 303, a second area determination unit 304 and a rendering unit 305, as follows:

[0167] (1) An acquisition unit 301 is used to acquire a target model, where the target model includes a plane model with multiple target points overlapping.

[0168] (2) An information determination unit 302, configured to determine the disparity information of the pixel point according to the positional relationship between the pixel point of the target model and the virtual camera.

[0169] In one embodiment, the special effect processing method provided in the embodiment of the present application may further include:

[0170] A texture acquisition unit, used for acquiring noise texture;

[0171] An adjustment unit is used to adjust the disparity information of the pixel points according to the noise texture to obtain adjusted disparity information.

[0172] (3) A first area determination unit 303 is used to determine a special effect area from each plane model of the target model according to shape control information of the target special effect and the distance between the pixel point in the plane model and the target point.

[0173] (4) A second region determining unit 304, configured to determine at least two target special effect regions observed by the virtual camera from the special effect region.

[0174] In one embodiment, the second area determining unit 304 may also be configured to:

[0175] Determine the area index information corresponding to each pixel point according to the shape control information of the target special effect and the distance between the pixel point and the target point in the plane model;

[0176] The region identification information of the pixel point is calculated according to the region index information and the disparity information of the pixel point to obtain the special effect region of the plane model.

[0177] In one embodiment, the special effect area includes an internal area, the area indicator information includes first area indicator information for determining whether a pixel point is located in the internal area, and the area identification information includes first area identification information indicating whether the pixel point is located in the internal area;

[0178] The second area determination unit 304 may also be configured to:

[0179] For each plane model, adjusting the first area index information of each pixel point according to the disparity information corresponding to each pixel point in the plane model to obtain first adjusted index information;

[0180] Mapping the first adjusted indicator information into a preset value range to obtain mapped indicator information;

[0181] The mapped index information is processed according to a first processing function corresponding to the internal area to obtain first area identification information of the pixel point.

[0182] In one embodiment, the special effect area includes a contour area, the area indicator information includes second area indicator information for determining whether the pixel point is located in the contour area, and the area identification information includes second area identification information indicating whether the pixel point is located in the contour area;

[0183] The second area determination unit 304 may also be configured to:

[0184] For each plane model, adjusting the second area index information of each pixel point according to the disparity information corresponding to each pixel point in the plane model to obtain second adjusted index information;

[0185] According to the second processing function corresponding to the contour area, the second area index information and the second adjusted index information are processed respectively to obtain the second area identification information of the pixel point.

[0186] (5) A rendering unit 305, configured to render the target special effect area according to display parameters of the at least two target special effect areas and the disparity information to obtain a target special effect.

[0187] In one embodiment, the rendering unit 305 may also be used for:

[0188] Determine, according to the display parameter and the parallax information, a pixel value of each pixel point in the target special effect area observed by the virtual camera;

[0189] The target special effect is rendered according to the pixel value of each pixel in the target special effect area.

[0190] In one embodiment, the special effect processing method provided in the embodiment of the present application may further include:

[0191] A model acquisition unit, used for acquiring a plane model, wherein the coordinate axis of the plane model passes through the target point of the plane model;

[0192] An optional unit, for rotating the plane model around at least one coordinate axis of the plane model at least once to obtain at least one new plane model;

[0193] A generating unit is used to generate the target model by using a new plane model obtained by rotating each of the coordinate axes and the plane model.

[0194] In one embodiment, the display parameter includes transparency, and the special effect processing method provided in the embodiment of the present application may further include:

[0195] A transparency acquisition unit, used to acquire initial transparency of pixel points of at least two target plane models observed by the virtual camera;

[0196] The transparency adjustment unit is used to adjust the initial transparency according to the parallax information to obtain an adjusted transparency.

[0197] As can be seen from the above, the special effects processing device of the embodiment of the present application obtains the target model through the acquisition unit 301, and the target model includes a plane model with multiple target points overlapping; the information determination unit 302 determines the disparity information of the pixel points according to the positional relationship between the pixel points of the target model and the virtual camera; the first area determination unit 303 determines the special effects area from the plane model for each plane model of the target model according to the shape control information of the target special effect and the distance between the pixel points in the plane model and the target points; the second area determination unit 304 determines at least two target special effects areas observed by the virtual camera from the special effects area; the rendering unit 305 renders the target special effects area according to the display parameters and disparity information of at least two target special effects areas to obtain the target special effects.

[0198] In the embodiment of the present application, the virtual camera observes more than one plane model each time, so the rendered target special effects have a strong sense of three-dimensionality and are not easy to be exposed. In addition, the plane models observed from different camera perspectives are different, which can achieve the visual change effect of special effects at different perspectives.

[0199] Accordingly, the embodiment of the present application also provides a computer device, which may be a terminal. Fig.12 As shown, Fig.12 A schematic diagram of the structure of a computer device provided in an embodiment of the present application. The computer device 500 includes a processor 501 having one or more processing cores, a memory 502 having one or more computer-readable storage media, and a computer program stored in the memory 502 and executable on the processor. The processor 501 is electrically connected to the memory 502. It will be understood by those skilled in the art that the computer device structure shown in the figure does not constitute a limitation on the computer device, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0200] The processor 501 is the control center of the computer device 500. It uses various interfaces and lines to connect the various parts of the entire computer device 500, executes various functions of the computer device 500 and processes data by running or loading software programs and / or modules stored in the memory 502, and calling data stored in the memory 502, thereby monitoring the computer device 500 as a whole.

[0201] In the embodiment of the present application, the processor 501 in the computer device 500 will load instructions corresponding to the processes of one or more application programs into the memory 502 according to the following steps, and the processor 501 will run the application programs stored in the memory 502 to implement various functions:

[0202] Acquire a target model, where the target model includes a plane model with multiple target points overlapping;

[0203] Determine the disparity information of the pixel points according to the positional relationship between the pixel points of the target model and the virtual camera;

[0204] For each plane model of the target model, the special effect area is determined from the plane model according to the shape control information of the target special effect and the distance between the pixel point in the plane model and the target point;

[0205] At least two target special effect areas observed by a virtual camera from the special effect area;

[0206] The target special effect area is rendered according to display parameters and disparity information of at least two target special effect areas to obtain the target special effect.

[0207] In the embodiment of the present application, the virtual camera observes more than one plane model each time, so the rendered target special effects have a strong sense of three-dimensionality and are not easy to be exposed. In addition, the plane models observed from different camera perspectives are different, which can achieve the visual change effect of special effects at different perspectives.

[0208] The specific implementation of the above operations can be found in the previous embodiments, which will not be described in detail here.

[0209] Optional, such as Fig.12 As shown, the computer device 500 further includes: a touch screen 503, a radio frequency circuit 504, an audio circuit 505, an input unit 506, and a power supply 507. The processor 501 is electrically connected to the touch screen 503, the radio frequency circuit 504, the audio circuit 505, the input unit 506, and the power supply 507, respectively. Those skilled in the art can understand that Fig.12 The computer device structure shown in the figure does not constitute a limitation on the computer device, and may include more or less components than shown in the figure, or combine certain components, or arrange the components differently.

[0210] The touch display screen 503 can be used to display a graphical user interface and receive operation instructions generated by the user acting on the graphical user interface. The touch display screen 503 may include a display panel and a touch panel. Among them, the display panel may be used to display information input by the user or information provided to the user and various graphical user interfaces of computer equipment, and these graphical user interfaces may be composed of graphics, text, icons, videos and any combination thereof. Optionally, the display panel may be configured in the form of a liquid crystal display (LCD, Liquid Crystal Display), an organic light emitting diode (OLED, Organic Light-Emitting Diode) and the like. The touch panel may be used to collect the user's touch operation on or near it (such as the user using any suitable object or attachment such as a finger, a stylus, etc. on the touch panel or near the touch panel), and generate corresponding operation instructions, and the operation instructions execute corresponding programs. Optionally, the touch panel may include two parts, a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into the touch point coordinates, and then sends it to the processor 501, and can receive the command sent by the processor 501 and execute it. The touch panel can cover the display panel. When the touch panel detects a touch operation on or near it, it is transmitted to the processor 501 to determine the type of touch event, and then the processor 501 provides a corresponding visual output on the display panel according to the type of touch event. In an embodiment of the present application, the touch panel and the display panel can be integrated into the touch display screen 503 to realize the input and output functions. However, in some embodiments, the touch panel and the touch panel can be used as two independent components to realize the input and output functions. That is, the touch display screen 503 can also be used as a part of the input unit 506 to realize the input function.

[0211] The radio frequency circuit 504 may be used to send and receive radio frequency signals, so as to establish wireless communication with a network device or other computer devices through wireless communication, and to send and receive signals between the network device or other computer devices.

[0212] The audio circuit 505 can be used to provide an audio interface between the user and the computer device through a speaker and a microphone. The audio circuit 505 can transmit the electrical signal converted from the received audio data to the speaker, which is converted into a sound signal for output; on the other hand, the microphone converts the collected sound signal into an electrical signal, which is received by the audio circuit 505 and converted into audio data, and then the audio data is output to the processor 501 for processing, and then sent to another computer device through the radio frequency circuit 504, or the audio data is output to the memory 502 for further processing. The audio circuit 505 may also include an earphone jack to provide communication between an external headset and the computer device.

[0213] The input unit 506 may be used to receive input numbers, character information or user feature information (such as fingerprint, iris, facial information, etc.), and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control.

[0214] The power supply 507 is used to supply power to various components of the computer device 500. Optionally, the power supply 507 can be logically connected to the processor 501 through a power management system, so that the power management system can manage charging, discharging, and power consumption. The power supply 507 can also include one or more DC or AC power supplies, recharging systems, power failure detection circuits, power converters or inverters, power status indicators, and other arbitrary components.

[0215] although Fig.12 Not shown, the computer device 500 may also include a camera, a sensor, a wireless fidelity module, a Bluetooth module, etc., which will not be described in detail here.

[0216] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0217] A person of ordinary skill in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be completed by instructions, or by controlling related hardware through instructions. The instructions may be stored in a computer-readable storage medium and loaded and executed by a processor.

[0218] To this end, an embodiment of the present application provides a computer-readable storage medium, in which multiple computer programs are stored, and the computer program can be loaded by a processor to execute the steps in any special effect processing method provided in the embodiment of the present application. For example, the computer program can execute the following steps:

[0219] Acquire a target model, where the target model includes a plane model with multiple target points overlapping;

[0220] Determine the disparity information of the pixel points according to the positional relationship between the pixel points of the target model and the virtual camera;

[0221] For each plane model of the target model, the special effect area is determined from the plane model according to the shape control information of the target special effect and the distance between the pixel point in the plane model and the target point;

[0222] At least two target special effect areas observed by a virtual camera from the special effect area;

[0223] The target special effect area is rendered according to display parameters and disparity information of at least two target special effect areas to obtain the target special effect.

[0224] In the embodiment of the present application, the virtual camera observes more than one plane model each time, so the rendered target special effects have a strong sense of three-dimensionality and are not easy to be exposed. In addition, the plane models observed from different camera perspectives are different, which can achieve the visual change effect of special effects at different perspectives.

[0225] The specific implementation of the above operations can be found in the previous embodiments, which will not be described in detail here.

[0226] The storage medium may include: a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0227] The above is a detailed introduction to a special effects processing method, device, computer equipment and computer storage medium provided in the embodiments of the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea; at the same time, for technical personnel in this field, according to the ideas of the present application, there will be changes in the specific implementation methods and application scopes. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A special effect processing method, characterized in that: include: Acquire a target model, wherein the target model includes a plane model with multiple target points overlapping; Determining disparity information of the pixel points according to the positional relationship between the pixel points of the target model and the virtual camera; For each plane model of the target model, a special effect area is determined from the plane model according to shape control information of the target special effect and the distance between the pixel point in the plane model and the target point; Determine at least two target special effect areas observed by the virtual camera from the special effect areas; The target special effect area is rendered according to the display parameters of the at least two target special effect areas and the parallax information to obtain the target special effect.

2. The method according to claim 1, characterized in that The target model is generated by the following steps: Acquire a plane model, wherein the coordinate axis of the plane model passes through the target point of the plane model; For at least one coordinate axis of the plane model, rotating the plane model around the coordinate axis at least once to obtain at least one new plane model; The target model is generated based on the new plane model obtained by rotating each of the coordinate axes and the plane model.

3. The method according to claim 1, characterized in that Determining a special effect area from the plane model according to shape control information of the target special effect and the distance between the pixel point in the plane model and the target point position includes: Determine the area index information corresponding to each pixel point according to the shape control information of the target special effect and the distance between the pixel point and the target point in the plane model; The region identification information of the pixel point is calculated according to the region index information and the parallax information of the pixel point to obtain the special effect region of the plane model.

4. The method according to claim 3, characterized in that The special effect area includes an internal area, the area indicator information includes first area indicator information for determining whether a pixel point is located in the internal area, and the area identification information includes first area identification information indicating whether the pixel point is located in the internal area; The calculating the region identification information of the pixel point according to the region index information and the disparity information of the pixel point includes: For each plane model, adjusting the first area index information of each pixel point according to the disparity information corresponding to each pixel point in the plane model to obtain first adjusted index information; Mapping the first adjusted indicator information into a preset value range to obtain mapped indicator information; The mapped index information is processed according to a first processing function corresponding to the internal area to obtain first area identification information of the pixel point.

5. The method according to claim 3, characterized in that: The special effect area includes a contour area, the area index information includes second area index information for determining whether a pixel point is located in the contour area, and the area identification information includes second area identification information indicating whether the pixel point is located in the contour area; The calculating the region identification information of the pixel point according to the region index information and the disparity information of the pixel point includes: For each plane model, adjusting the second area index information of each pixel point according to the disparity information corresponding to each pixel point in the plane model to obtain second adjusted index information; According to the magnitude relationship between the first processing parameter of the second processing function corresponding to the contour area and the second area index information, performing a first mapping process on the second area index information to obtain first reference index information; According to the magnitude relationship between the second processing parameter of the second processing function and the second adjusted indicator information, performing a second mapping process on the second adjusted indicator information to obtain second reference indicator information; Second region identification information of the pixel is obtained according to the first reference indicator information and the second reference indicator information.

6. The method according to claim 3, characterized in that Before calculating the region identification information of the pixel point according to the region index information and the disparity information of the pixel point, the method further includes: Get the noise texture; The disparity information of the pixel point is adjusted according to the noise texture to obtain adjusted disparity information.

7. The method according to claim 1, characterized in that The display parameters include transparency, and before rendering the target special effect area according to the display parameters of the at least two target special effect areas and the parallax information to obtain the target special effect, the method further includes: Acquire initial transparency of pixels of at least two target plane models observed by the virtual camera; The initial transparency is adjusted according to the disparity information to obtain an adjusted transparency.

8. The method according to any one of claims 1 to 7, characterized in that: The step of rendering the target special effect area according to the display parameters of the at least two target special effect areas and the parallax information to obtain the target special effect includes: Determine, according to the display parameter and the parallax information, a pixel value of each pixel point in the target special effect area observed by the virtual camera; The target special effect is rendered according to the pixel value of each pixel in the target special effect area.

9. A special effects processing device, characterized in that: include: An acquisition unit, used for acquiring a target model, wherein the target model includes a plane model with multiple target points overlapping; An information determining unit, configured to determine the disparity information of the pixel point according to the positional relationship between the pixel point of the target model and the virtual camera; A first area determination unit is used to determine a special effect area from each plane model of the target model according to shape control information of the target special effect and a distance between a pixel point in the plane model and a target point; A second area determination unit, configured to determine at least two target special effect areas observed by the virtual camera from the special effect area; A rendering unit is used to render the target special effect area according to the display parameters of the at least two target special effect areas and the parallax information to obtain the target special effect.

10. A computer device, characterized in that: It comprises a memory and a processor; the memory stores a computer program, and the processor is used to run the computer program in the memory to execute the special effect processing method according to any one of claims 1 to 8.

11. A computer-readable storage medium, characterized in that: The computer-readable storage medium is used to store a computer program, and the computer program is loaded by a processor to execute the special effect processing method according to any one of claims 1 to 8.

Images