User interface processing method and device, program product and electronic equipment

Abstract

The invention provides a user interface processing method and device, a program product and electronic equipment, and relates to the technical field of computers. The method comprises the following steps: acquiring a virtual model, and acquiring a first map corresponding to the virtual model; performing dynamic sampling on the first chartlet according to preset dynamic information, and rendering the virtual model according to a dynamic sampling result; obtaining a static image matched with the virtual model; and overlapping and displaying the rendered virtual model and the static image on a target user interface. According to the method and the device, a high-quality interface display effect can be realized, the workload of manually drawing materials is reduced, and the manpower and time cost is reduced.

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, and in particular to a user interface processing method, a user interface processing device, a computer program product, and an electronic device. Background Art

[0002] In some user interfaces, in order to enhance the visual experience, unique background effects, such as dynamic background effects, are usually used.

[0003] In the related art, artists are required to manually draw relevant background effect materials, such as dynamic images, etc. This method consumes high manpower and time costs, and it is difficult to ensure the quality of the materials and the display effect in the interface. Summary of the invention

[0004] The present disclosure provides a user interface processing method, a user interface processing device, a computer program product and an electronic device, so as to at least to some extent solve the problem of relying on manually drawn background effect materials in the related art.

[0005] According to a first aspect of the present disclosure, a user interface processing method is provided, the method comprising: obtaining a virtual model and obtaining a first map corresponding to the virtual model; dynamically sampling the first map according to preset dynamic information, and rendering the virtual model according to the result of the dynamic sampling; obtaining a static image matching the virtual model; and superimposing the rendered virtual model and the static image and displaying them on a target user interface.

[0006] According to a second aspect of the present disclosure, a user interface processing device is provided, the device comprising: a first acquisition module, configured to acquire a virtual model and a first map corresponding to the virtual model; a virtual model processing module, configured to dynamically sample the first map according to preset dynamic information, and render the virtual model according to the result of the dynamic sampling; a second acquisition module, configured to acquire a static image matching the virtual model; and a display processing module, configured to superimpose the rendered virtual model and the static image on a target user interface.

[0007] According to a third aspect of the present disclosure, a computer program product is provided, including a computer program, wherein when the computer program is executed by a processor, the method of the first aspect and possible implementation methods thereof are implemented.

[0008] According to a fourth aspect of the present disclosure, an electronic device is provided, comprising: a processor; and a memory for storing executable instructions of the processor; wherein the processor is configured to execute the method of the above-mentioned first aspect and its possible implementation methods by executing the executable instructions.

[0009] The technical solution disclosed in this disclosure has the following beneficial effects:

[0010] Obtain a virtual model and a corresponding first map, dynamically sample the first map according to preset dynamic information, render the virtual model according to the result of dynamic sampling, and superimpose the rendered virtual model and the static image on the target user interface. On the one hand, by superimposing the dynamic virtual model and the static image, a visual experience combining movement and stillness can be created in the target user interface, achieving high-quality interface display effects. On the other hand, this solution reduces the workload of manually drawing materials, reduces manpower and time costs, and improves processing efficiency. On another hand, in response to the dynamic display requirements in the target user interface, dynamic effects are achieved by dynamic map sampling, which is conducive to reducing performance consumption and is particularly suitable for lightweight scenarios such as mobile terminals. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] Figure 1 A flowchart showing a user interface processing method in this exemplary embodiment;

[0012] Figure 2 A schematic diagram showing a virtual model in this exemplary embodiment;

[0013] Figure 3 A flowchart of rendering a virtual model in this exemplary embodiment is shown;

[0014] Figure 4 A schematic diagram showing an overlay display in this exemplary embodiment;

[0015] Figure 5 A flowchart of obtaining a virtual model in this exemplary embodiment is shown;

[0016] Figure 6 A schematic diagram showing a display effect in this exemplary embodiment;

[0017] Figure 7 A schematic diagram showing the structure of a user interface processing device in this exemplary embodiment is shown;

[0018] Figure 8 A schematic structural diagram of an electronic device in this exemplary embodiment is shown. DETAILED DESCRIPTION

[0019] Exemplary embodiments of the present disclosure will be described more fully hereinafter with reference to the accompanying drawings.

[0020] The accompanying drawings are schematic diagrams of the present disclosure and are not necessarily drawn to scale. Some of the block diagrams shown in the accompanying drawings may be functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities can be implemented in software form, or in hardware modules or integrated circuits, or in networks, processors or microcontrollers. The embodiments can be implemented in various forms and should not be construed as being limited to the examples set forth herein. The features, structures or characteristics described in the present disclosure may be combined in one or more embodiments in any suitable manner. In the description below, many specific details are provided to provide a full description of the embodiments of the present disclosure. However, those skilled in the art should appreciate that one or more specific details may be omitted when implementing the technical solution of the present disclosure, or one or more specific details may be replaced by other methods, components, devices, steps, etc.

[0021] In some user interfaces, unique background effects are often used to enhance the visual experience. For example, in pop-up windows and other interfaces, dynamic background effects are used to increase the user's interest in the interface content or enhance the user's immersion in the interface. In related technologies, artists are required to manually draw relevant background effect materials, such as dynamic images. This method consumes high manpower and time costs and is inefficient. In addition, the quality of the drawn materials cannot be guaranteed, that is, the final display effect in the user interface cannot be guaranteed.

[0022] In view of the above problems, an exemplary embodiment of the present disclosure provides a user interface processing method, which can render a virtual model with dynamic effects without relying on manually drawn materials, and overlay it with a static image in the target user interface, with better display effects.

[0023] Figure 1 An exemplary process of a user interface processing method is shown, which may include the following steps:

[0024] Step S110, obtaining a virtual model, and obtaining a first map corresponding to the virtual model;

[0025] Step S120, dynamically sampling the first map according to preset dynamic information, and rendering the virtual model according to the result of the dynamic sampling;

[0026] Step S130, obtaining a static image matching the virtual model;

[0027] Step S140: Overlaying and displaying the rendered virtual model and the static image on the target user interface.

[0028] based on Figure 1The method shown obtains a virtual model and a corresponding first map, dynamically samples the first map according to preset dynamic information, renders the virtual model according to the result of dynamic sampling, and superimposes and displays the rendered virtual model and the static image on the target user interface. On the one hand, by superimposing the dynamic virtual model and the static image, a visual experience combining movement and stillness can be created in the target user interface, achieving high-quality interface display effects. On the other hand, this solution reduces the workload of manually drawing materials, reduces manpower and time costs, and improves processing efficiency. On another hand, in response to the dynamic display requirements in the target user interface, dynamic effects are achieved by dynamic map sampling, which is conducive to reducing performance consumption and is particularly suitable for lightweight scenarios such as mobile terminals.

[0029] Below Figure 1 Provide detailed instructions for each step.

[0030] refer to Figure 1 In step S110, a virtual model is obtained, and a first map corresponding to the virtual model is obtained.

[0031] The virtual model is a model with a certain shape and structure made or generated by a computer graphics program, which can be a two-dimensional model or a three-dimensional model. In this exemplary embodiment, the corresponding virtual model can be obtained according to the display requirements of the target user interface to be displayed. For example, if it is necessary to display a plane content in the target user interface, a two-dimensional virtual model can be obtained.

[0032] In one embodiment, the corresponding virtual model may be obtained according to the interface elements expected to be displayed in the target user interface or the theme, style, etc. of the target user interface. For example, if it is desired to display the water surface in the target user interface, or the theme of the target user interface is the sea, or the style of the target user interface is summer waves, etc., a virtual model related to water or the sea may be obtained, such as a virtual water body model.

[0033] In one implementation, the virtual model acquired in step S110 may be an unrendered virtual model (such as a “white model”). Figure 2 The schematic diagram of the virtual model is shown, which is a four-sided patch structure and may include curved edges. Of course, the present disclosure does not limit the specific shape, structure, etc. of the virtual model.

[0034] The first map corresponding to the virtual model is used to provide part or all of the information required for rendering, and the first map may include one or more maps. Exemplarily, the first map may include a normal map, and the virtual model may be illuminated according to the normal map, thereby rendering the lighting effect. In addition, the first map may also include a texture map, etc.

[0035] The first texture can be edited and generated by an artist, or the artist can select a texture from a texture library as the first texture, or the program can automatically obtain the first texture, such as searching or generating a corresponding texture based on the theme, style, and other information of the target user interface as the first texture.

[0036] Continue to refer Figure 1 In step S120, the first map is dynamically sampled according to preset dynamic information, and the virtual model is rendered according to the result of the dynamic sampling.

[0037] Generally, the mapping relationship between the virtual model and the first map can be determined, sampling is performed in the first map based on the mapping relationship, and the sampled information is assigned to the virtual model, such as obtaining shading information of each vertex of the virtual model, thereby achieving rendering of the virtual model.

[0038] In this exemplary embodiment, preset dynamic information is introduced to add dynamic effects to the rendering of the virtual model. When the preset dynamic information is used, the sampling of the first map is a dynamic sampling process, and the sampled result is a dynamic result, which can achieve a dynamic rendering effect.

[0039] Exemplarily, the preset dynamic information may be dynamic change information for the first map, such as adding random or periodic small changes to the values ​​in the first map according to the preset dynamic information, so that after the virtual model is rendered using the first map, the surface of the virtual model presents random or periodic changes, thereby achieving a dynamic effect. Alternatively, the preset dynamic information may be dynamic information for the mapping relationship between the virtual model and the first map, such as dynamic deviation information of the mapping coordinates of the virtual model in the first map, so that the map sampling points corresponding to the virtual model change dynamically, and after the virtual model is rendered, its surface presents a flowing dynamic effect.

[0040] In one embodiment, the first map includes a normal map. In the normal map, the value of each point can represent the normal direction. Figure 3 As shown, the above-mentioned dynamic sampling of the first map according to the preset dynamic information and rendering of the virtual model according to the result of the dynamic sampling may include the following steps S310 to S330:

[0041] Step S310, dynamically sampling the normal map according to preset dynamic information to obtain dynamic normal information.

[0042] According to the preset dynamic information, the value of the normal map itself can be dynamically changed, or the mapping relationship between the virtual model and the normal map can be dynamically changed, thereby realizing dynamic sampling and obtaining dynamic normal information. The dynamic normal information can refer to the normal direction changing over time.

[0043] In one embodiment, the preset dynamic information includes a plurality of disturbance information, and different disturbance information corresponds to different disturbance directions. The above-mentioned dynamic sampling of the normal map according to the preset dynamic information to obtain the dynamic normal information may include the following steps:

[0044] Add disturbances to the mapping relationship between the virtual model and the normal map according to the multiple disturbance information respectively, and sample the normal map based on the mapping relationship after adding the disturbance, so as to obtain normal dynamic sampling results corresponding to the multiple disturbance information;

[0045] The normal dynamic sampling results corresponding to multiple disturbance information are superimposed to obtain dynamic normal information.

[0046] Among them, the disturbance information can cause the mapping relationship between the virtual model and the normal map to change dynamically. For example, the disturbance information may include a disturbance vector, which has a specific direction and speed. Under the action of the disturbance information, the mapping coordinates of the virtual model in the normal map can be offset according to the direction and speed. In this exemplary embodiment, at least two disturbance information corresponding to different directions can be set, such as disturbance information 1 corresponding to the x direction, and disturbance information 2 corresponding to the y direction. Disturbance is added to the mapping relationship according to each disturbance information, so that multiple dynamic mapping relationships are obtained, and sampling is performed respectively to obtain the dynamic sampling results of the normal corresponding to the multiple disturbance information. For example, according to the above-mentioned disturbance information 1, the mapping relationship is disturbed and sampled to obtain the dynamic result of the normal information flowing along the x direction. According to the above-mentioned disturbance information 2, the mapping relationship is disturbed and sampled to obtain the dynamic result of the normal information flowing along the y direction. Finally, the dynamic sampling results of the normal corresponding to the multiple disturbance information are superimposed, such as the dynamic sampling results of the normal corresponding to the disturbance information 1 and the disturbance information 2 can be superimposed in the diagonally opposite directions to obtain the final dynamic normal information.

[0047] This makes the normal information produce richer dynamic changes, which is conducive to the subsequent high-quality dynamic rendering effects.

[0048] Step S320, performing lighting calculation according to the dynamic normal information to obtain dynamic lighting information.

[0049] Among them, the illumination calculation may include but is not limited to the following methods: illumination calculation based on diffuse reflection, the principle of which is to calculate the illumination intensity according to the angle between the light source direction and the normal direction of the virtual model surface (i.e., the value in the normal information), and then obtain the diffuse light color at different points on the virtual model surface. Among them, the illumination intensity can be determined according to the dot product of the light source direction and the normal direction. The larger the dot product result, the smaller the angle between the light source direction and the normal direction, and the stronger the illumination. The illumination calculation based on highlight reflection, the principle of which is to simulate the highlight effect produced by the object reflecting light and entering the observer's eyes. For example, the reflection direction can be calculated according to the normal direction of the virtual model surface, and then the angle between the reflection direction and the observer direction is calculated to obtain the highlight intensity, and then the highlight color at different points on the virtual model surface is obtained.

[0050] Through illumination calculation, dynamic illumination information is obtained, which may include illumination colors of different points on the surface of the virtual model at different times, such as illumination color changes of each vertex of the virtual model over a period of time.

[0051] Step S330: rendering the virtual model according to the dynamic lighting information.

[0052] Among them, according to the dynamic lighting information, the color or lighting change effect of the virtual model over a period of time can be rendered. For example, according to the dynamic lighting information, the lighting color in multiple key frames is determined, and the surface of the virtual model is drawn according to the corresponding lighting color in each key frame to achieve dynamic changes in lighting color.

[0053] based on Figure 3 The method shown uses a method of dynamically sampling the normal map to obtain dynamic normal information, and performs lighting calculation to obtain dynamic lighting information, thereby rendering a dynamic lighting effect for the virtual model, which can enhance the dynamic effect of the virtual model. In addition, the processing process is relatively simple, which is conducive to reducing performance overhead.

[0054] In one embodiment, the user interface processing method may further include the following steps:

[0055] Obtaining a second map corresponding to the virtual model; the second map includes color change information;

[0056] Sampling the second map, and determining basic color information of the virtual model according to the sampled color change information and at least one reference color;

[0057] The virtual model is rendered according to the basic color information.

[0058] Among them, the values ​​of different points in the second map can represent the color difference between different points. The mapping relationship between the virtual model and the second map can be determined according to the parameters such as tiling and offset corresponding to the second map, and the second map can be sampled according to the mapping relationship to obtain the color change information of the virtual model surface. At the same time, at least one reference color can be obtained, which can be a matching color set according to the characteristics of the virtual model or the theme, style, etc. of the target user interface. For example, if the virtual model is a virtual water body model, the reference color can be blue. The reference color is interpolated according to the color change information of the virtual model surface to obtain the basic color information of the virtual model, which may include the basic colors of different points on the surface of the virtual model. The basic color reflects the color of the virtual model itself in a conventional external environment (such as under standard uniform lighting conditions). If a reference color is obtained, the reference color can be interpolated according to the color change information to obtain the basic colors of different points on the surface of the virtual model. If multiple reference colors are obtained, the multiple reference colors can be interpolated according to the color change information to obtain the basic colors of different points on the surface of the virtual model. Then, the virtual model is rendered according to the color information, and the color gradient effect of the virtual model surface can be achieved.

[0059] In one embodiment, the dynamic lighting information includes highlight information, such as highlight color. The virtual model may be a virtual water model. The user interface processing method may further include the following steps:

[0060] Obtaining a third map corresponding to the virtual model; the third map represents foam area information;

[0061] The third map is sampled, and the foam area is determined in the virtual model according to the sampled foam area information;

[0062] Renders the foam area based on the highlight information.

[0063] Among them, the foam area refers to the area on the water surface where foam (usually white) appears. The values ​​of different points in the third map can indicate whether it is a foam area. The mapping relationship between the virtual model and the third map can be determined according to the tiling, offset and other parameters corresponding to the third map. The third map is sampled according to the mapping relationship to obtain the foam area information on the surface of the virtual model, indicating which positions of the virtual model have foam, such as the white edge area at the edge of the virtual model, the area with foam in the middle, etc., thereby determining the foam area in the virtual model. The foam area can be rendered according to the highlight information, such as rendering the foam area as the highlight color. Exemplarily, the highlight color and the foam area can be multiplied to obtain the color of the foam area, and the foam area can be rendered as the color. This enhances the visual effect of the foam area.

[0064] In one embodiment, a fourth map corresponding to the virtual model may be obtained; the fourth map may be an environment map such as a cubemap, which represents the environment reflection information of the virtual model and is used to simulate the situation where the virtual model reflects the surrounding environment. The fourth map may be sampled, and the virtual model may be rendered according to the sampled environment reflection information. This allows the surface of the virtual model to have an environment reflection effect. For example, the reflection effect on the water surface may be simulated.

[0065] It should be understood that the above provides multiple ways to render the virtual model. Any one of the ways can be used to render the virtual model. A combination of multiple ways can also be used to render the virtual model, which integrates multiple aspects of information such as lighting and environment, and can achieve richer visual effects.

[0066] For example, the first map, the second map, the third map, and the fourth map corresponding to the virtual model can be obtained, and dynamic lighting information can be obtained according to the first map, and the lighting information can include diffuse lighting, highlight reflection, etc. The basic color information is obtained according to the second map, the color of the foam area is obtained according to the third map, and the environmental reflection information is obtained according to the fourth map. The virtual model is rendered based on the dynamic lighting information, basic color information, the color of the foam area, and environmental reflection information, and the rendered virtual model can include the following effects: basic gradient color, such as simulating the color change of water surface areas of different depths or water surface areas at different distances from the observer; diffuse reflection and highlight reflection lighting effects, and the lighting effects can change dynamically over time, that is, each point on the surface of the virtual model has different lighting colors at different times, thus simulating the effect of water surface flow or ripples; environmental reflection effect, simulating the effect of water surface reflection of the surrounding environment; whitening effect of foam area and edge, simulating foam and white edges on the water surface.

[0067] Continue to refer Figure 1 , in step S130, a static image matching the virtual model is obtained.

[0068] Among them, the matching relationship between the static image and the virtual model can refer to the matching of the two in terms of shape, or the matching of the two in terms of display content. For example, based on the rendered virtual model, a static image that matches its color is obtained, so that the color of the static image and the virtual model is the same or similar (such as in the same color system), so that the visual experience after the combination of the two is more harmonious. Alternatively, based on the shape of the virtual model, a static image in which the boundary shape between different areas in the image is the same or similar to the shape of the virtual model is obtained, so that the virtual model and the static image match in shape, which can also enhance the visual harmony.

[0069] The static image can be drawn and generated by an artist, or selected by an artist from an image library, or automatically acquired by a program, such as searching for or generating a static image that matches the rendered virtual model.

[0070] Continue to refer Figure 1 In step S140, the rendered virtual model and the static image are superimposed and displayed on the target user interface.

[0071] At least one of the rendered virtual model and the static image may have a certain degree of transparency, so that when the two are superimposed, the transparent area simultaneously displays information of the virtual model and the static image. Alternatively, the rendered virtual model may be displayed on a layer of the static image to block a portion of the static image. Alternatively, the rendered virtual model and the static image may be spliced ​​together, and if the shapes of the two match, they may be spliced ​​together to form a regular rectangle or other shape, which is displayed on the target user interface.

[0072] In one embodiment, the static image includes at least two image areas, and the at least two image areas correspond to different image elements, wherein the virtual model of the first image area matches in shape, such as the shape of the first image area and the virtual model may be the same. In addition, the second image area and the rendered virtual model may match in color, such as the colors of the two are the same or in the same color system. The above-mentioned superimposing and displaying the rendered virtual model and the static image on the target user interface may include the following steps:

[0073] Displaying the static image as a first layer in the target user interface;

[0074] The rendered virtual model is displayed on a second layer in the target user interface and covers the first image area; the second layer is located above the first layer.

[0075] The second graphic where the rendered virtual model is located is located on the first layer where the static image is located, so that the virtual model blocks the static image. Specifically, the virtual model can be aligned with the first image area, so that after superimposed display, the virtual model covers and blocks the first image area, exposing other image areas in the static image, which forms a continuous and highly integrated picture effect with the rendered virtual model, and creates a visual effect combining movement and stillness.

[0076] Figure 4A schematic diagram of superimposing a rendered virtual model with a static image is shown. The static image includes a first image area (i.e., a water surface area) located at the bottom and a second image area (i.e., a sky area) located at the top. It can be seen that the virtual model matches the shape of the first image area. When superimposed, the rendered virtual model is located in front of the static image, and the layer relationship between the two is that the virtual model blocks the static image, and the virtual model can show the dynamic effect of the water surface at the bottom. The static image exposes the second image area at the top, which matches the rendered virtual model in terms of picture content. The two form a whole, which can eliminate the sense of image splicing and make the overall picture harmonious and natural. In addition, graphics or special effects of other effects can be added, such as inserting the effect of a fish jumping out of the water in front of the virtual model (indicating that its layer is higher than the second layer of the virtual model) to further enrich the picture.

[0077] In one embodiment, reference Figure 5 As shown, the above-mentioned acquisition of the virtual model may include the following steps S510 and S520:

[0078] Step S510, determining model shape information according to a first orientation predetermined in the target user interface for displaying a dynamic effect; the model shape information indicates that an edge of a second orientation of the expected virtual model is a concave shape, and the second orientation is an orientation opposite to the first orientation;

[0079] Step S520: Acquire a virtual model that matches the model shape information.

[0080] Among them, since the target user interface adopts a display method combining static and dynamic, the dynamic effect is located in a certain position in the target user interface, and the position, that is, the first position, can be predetermined, and the model shape information is determined according to the first position. For example, if it is predetermined that the dynamic effect is located at the bottom of the target user interface, then the first position is the bottom, and the model shape information of the virtual model can be determined accordingly: the upper edge (the upper and second position, which is opposite to the first position) is a concave shape. Then a virtual model matching the model shape information is obtained. Figure 2 The virtual model shown has an upper edge that is an inward-concave arc, which conforms to the above-mentioned model shape information. Alternatively, if it is predetermined that the dynamic effect is located on the left side of the target user interface, the model shape information of the virtual model can be determined accordingly: the right edge is an inward-concave shape. Then, a virtual model that conforms to this shape is obtained.

[0081] based on Figure 5 According to the method shown, after the rendered virtual model and the static image are superimposed and displayed, the entire screen in the target user interface has a sense of picture similar to fisheye lens distortion, thereby achieving a display effect of a simulated fisheye lens, which is conducive to further enhancing the visual experience and increasing the user's sense of immersion in viewing the interface.

[0082] Figure 6 The diagram shows the effect of superimposing the rendered dynamic virtual water model and the static image on the target user interface, which can create the visual feeling of an observer observing or photographing the water surface near the water surface. Combined with the dynamic changes of the bottom water surface, the overall picture looks very realistic and expressive.

[0083] The exemplary embodiment of the present disclosure also provides a user interface processing device. Figure 7 As shown, the user interface processing device 700 may include the following program modules:

[0084] A first acquisition module 710 is configured to acquire a virtual model and acquire a first map corresponding to the virtual model;

[0085] A virtual model processing module 720 is configured to dynamically sample the first map according to preset dynamic information, and render the virtual model according to the result of the dynamic sampling;

[0086] A second acquisition module 730 is configured to acquire a static image matching the virtual model;

[0087] The display processing module 740 is configured to display the rendered virtual model and the static image in a superimposed manner on a target user interface.

[0088] In one embodiment, obtaining the virtual model includes:

[0089] Determining model shape information according to a first orientation predetermined in the target user interface for displaying a dynamic effect; wherein the model shape information indicates that an edge of a second orientation of the expected virtual model is a concave shape, and the second orientation is an orientation opposite to the first orientation;

[0090] The virtual model matching the model shape information is acquired.

[0091] In one embodiment, the first map includes a normal map; and dynamically sampling the first map according to preset dynamic information, and rendering the virtual model according to the result of the dynamic sampling, includes:

[0092] Dynamically sampling the normal map according to the preset dynamic information to obtain dynamic normal information;

[0093] Performing illumination calculation according to the dynamic normal information to obtain dynamic illumination information;

[0094] The virtual model is rendered according to the dynamic lighting information.

[0095] In one implementation, the preset dynamic information includes a plurality of disturbance information, and different disturbance information corresponds to different disturbance directions; and dynamically sampling the normal map according to the preset dynamic information to obtain dynamic normal information includes:

[0096] Adding disturbances to the mapping relationship between the virtual model and the normal map according to a plurality of disturbance information respectively, and sampling the normal map based on the mapping relationship after adding the disturbances, to obtain normal dynamic sampling results corresponding to the plurality of disturbance information;

[0097] The normal dynamic sampling results corresponding to the plurality of disturbance information are superimposed to obtain the dynamic normal information.

[0098] In one embodiment, the apparatus is further configured to:

[0099] Acquire a second map corresponding to the virtual model; the second map includes color change information;

[0100] Sampling the second map, and determining basic color information of the virtual model according to the sampled color change information and at least one reference color;

[0101] The virtual model is rendered according to the basic color information.

[0102] In one embodiment, the dynamic lighting information includes highlight information; the virtual model is a virtual water model; and the method further includes:

[0103] Acquire a third map corresponding to the virtual model; the third map represents foam area information;

[0104] Sampling the third map, and determining a foam area in the virtual model according to the sampled foam area information;

[0105] The foam area is rendered according to the highlight information.

[0106] In one embodiment, the static image includes at least two image areas, the at least two image areas correspond to different image elements, and the virtual model in the first image area matches in shape; and superimposing the rendered virtual model and the static image on the target user interface includes:

[0107] Displaying the static image on a first layer in the target user interface;

[0108] The rendered virtual model is displayed on a second layer in the target user interface and covers the first image area; the second layer is located above the first layer.

[0109] The specific details of each part of the above-mentioned device have been described in detail in the implementation method of the method part. The undisclosed details can be found in the implementation method of the method part, so they will not be repeated here.

[0110] It should be noted that, although several modules or units of the device for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the exemplary embodiments of the present disclosure, the features and functions of two or more modules or units described above can be embodied in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided into multiple modules or units to be embodied.

[0111] The exemplary embodiments of the present disclosure also provide a computer program product, which includes a computer program, and the computer program implements the above method when executed by a processor.

[0112] In one embodiment, the computer program product may be a tangible product containing a computer program, such as a computer-readable storage medium storing a computer program. The readable storage medium may be a storage medium based on electrical, magnetic, optical, electromagnetic, infrared, or other signals, including but not limited to: random access memory (RAM), read-only memory (ROM), magnetic tape, floppy disk, flash memory (Flash), mechanical hard disk (HDD), solid-state drive (SSD), and the like. Exemplarily, the computer program product may be implemented as a non-volatile storage medium storing a computer program, such as a read-only memory, a NAND flash memory, and the like.

[0113] In one embodiment, the computer program product may be an intangible product including a computer program. Exemplarily, the computer program product may be implemented as a virtual digital product, such as a digital file storing an executable file, an installation package, etc. of the computer program.

[0114] The code of the computer program can be written in one or more programming languages. Programming languages ​​such as C language, Java, C++, etc. The program code can be executed entirely on the user computing device, or partially on the user computing device, or as a separate software package, or partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server. In the case of a remote computing device, the remote computing device can be connected to the user computing device through any type of network, such as a local area network (LAN), a wide area network (WAN), etc., or can be connected to an external computing device (e.g., an Internet connection provided by an operator).

[0115] Computer programs can be carried or transmitted through electrical, magnetic, optical, electromagnetic, infrared and other signals. Electronic devices can convert signals carrying computer programs into digital signals to run computer programs. When a computer program runs on an electronic device, its code is used to enable the electronic device to execute (more specifically, it can enable the processor of the electronic device to execute) the method steps of various exemplary embodiments of the present disclosure, such as the following steps: Step S110, obtain a virtual model, and obtain a first map corresponding to the virtual model; Step S120, dynamically sample the first map according to preset dynamic information, and render the virtual model according to the result of dynamic sampling; Step S130, obtain a static image matching the virtual model; Step S140, superimpose the rendered virtual model and the static image on the target user interface.

[0116] The above method steps are implemented through a computer program to obtain a virtual model and a corresponding first map, dynamically sample the first map according to preset dynamic information, render the virtual model according to the result of dynamic sampling, and superimpose the rendered virtual model and the static image on the target user interface. On the one hand, by superimposing the dynamic virtual model and the static image, a visual experience combining movement and stillness can be created in the target user interface, achieving a high-quality interface display effect. On the other hand, this solution reduces the workload of manually drawing materials, reduces manpower and time costs, and improves processing efficiency. On another hand, in response to the dynamic display requirements in the target user interface, dynamic effects are achieved by adopting dynamic map sampling, which is conducive to reducing performance consumption and is particularly suitable for lightweight scenarios such as mobile terminals.

[0117] The exemplary embodiments of the present disclosure also provide an electronic device. The electronic device may include a processor and a memory. The memory stores executable instructions of the processor, such as a computer program. The processor executes the method steps of various exemplary embodiments of the present disclosure by executing the executable instructions.

[0118] Reference below Figure 8 , the electronic device is exemplarily described in the form of a general-purpose computing device. It should be understood that Figure 8 The electronic device 800 shown is merely an example and should not limit the functions and scope of use of the embodiments of the present disclosure.

[0119] like Figure 8 As shown, the electronic device 800 may include: a processor 810 , a memory 820 , a bus 830 , an I / O (input / output) interface 840 , and a network adapter 850 .

[0120] The memory 820 may include a volatile memory, such as a RAM 821, a cache unit 822, and may also include a non-volatile memory, such as a ROM 823. The memory 820 may also include one or more program modules 824, such program modules 824 include but are not limited to: an operating system, one or more application programs, other program modules, and program data, each of which or a combination thereof may include the implementation of a network environment. For example, the program module 824 may include each module in the above-mentioned device.

[0121] The processor 810 may include one or more processing units. For example, the processor 810 may include an AP (Application Processor), a modem processor, a GPU, an ISP (Image Signal Processor), a controller, an encoder, a decoder, a DSP (Digital Signal Processor), a baseband processor and / or an NPU (Neural-Network Processing Unit) and other processing units.

[0122] The processor 810 can be used to execute executable instructions stored in the memory 820, such as executing the following steps: step S110, obtaining a virtual model and obtaining a first map corresponding to the virtual model; step S120, dynamically sampling the first map according to preset dynamic information, and rendering the virtual model according to the result of the dynamic sampling; step S130, obtaining a static image matching the virtual model; step S140, superimposing the rendered virtual model and the static image and displaying them on the target user interface.

[0123] The processor 810 executes the above method steps to obtain the virtual model and the corresponding first map, dynamically sample the first map according to preset dynamic information, render the virtual model according to the result of dynamic sampling, and superimpose the rendered virtual model and the static image on the target user interface. On the one hand, by superimposing the dynamic virtual model and the static image, a visual experience combining movement and stillness can be created in the target user interface, achieving high-quality interface display effects. On the other hand, this solution reduces the workload of manually drawing materials, reduces manpower and time costs, and improves processing efficiency. On another hand, in response to the dynamic display requirements in the target user interface, dynamic effects are achieved by dynamic map sampling, which is conducive to reducing performance consumption and is particularly suitable for lightweight scenarios such as mobile terminals.

[0124] The bus 830 is used to realize the connection between different components of the electronic device 800, and may include a data bus, an address bus, and a control bus.

[0125] The electronic device 800 can communicate with one or more external devices 900 (eg, a keyboard, a mouse, an external controller, etc.) through the I / O interface 840 .

[0126] The electronic device 800 can communicate with one or more networks through the network adapter 850. For example, the network adapter 850 can provide mobile communication solutions such as 3G / 4G / 5G, or wireless communication solutions such as wireless LAN, Bluetooth, near field communication, etc. The network adapter 850 can communicate with other modules of the electronic device 800 through the bus 830.

[0127] although Figure 8 Not shown, other hardware and / or software modules may also be provided in the electronic device 800, including but not limited to: a display, a microcode, a device driver, a redundant processor, an external disk drive array, a tape drive, and a data backup storage system.

[0128] As can be seen from the above, the technical solution of the present disclosure can be implemented as a method, an apparatus, a system, a computer program product, a storage medium, an electronic device, etc. Those skilled in the art can understand that various aspects of the present disclosure can be specifically implemented in the following forms, namely: a complete hardware implementation, a complete software implementation (including firmware, microcode, etc.), or an implementation combining hardware and software, such as being respectively referred to as a "circuit", "module" or "system".

[0129] It should be understood that the present disclosure is not limited to the specific method steps or structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from the scope thereof. Those skilled in the art will easily think of other embodiments based on the specific embodiments provided by the present disclosure. Therefore, the specific embodiments provided by the present disclosure are only exemplary, and the scope and spirit of the present disclosure are indicated by the claims, and any variations, uses or adaptive changes of the present disclosure should be covered, which follow the general principles of the present disclosure and include common knowledge or customary technical means in the technical field that are not disclosed in the present disclosure.

Claims

1. A user interface processing method, characterized in that: The method comprises: Acquire a virtual model, and acquire a first map corresponding to the virtual model; Dynamically sampling the first map according to preset dynamic information, and rendering the virtual model according to the result of the dynamic sampling; Acquiring a static image matching the virtual model; The rendered virtual model and the static image are superimposed and displayed on a target user interface.

2. The method according to claim 1, characterized in that The obtaining of the virtual model comprises: Determining model shape information according to a first orientation predetermined in the target user interface for displaying a dynamic effect; wherein the model shape information indicates that an edge of a second orientation of the expected virtual model is a concave shape, and the second orientation is an orientation opposite to the first orientation; The virtual model matching the model shape information is acquired.

3. The method according to claim 1, characterized in that The first map includes a normal map; the step of dynamically sampling the first map according to preset dynamic information and rendering the virtual model according to the result of the dynamic sampling includes: Dynamically sampling the normal map according to the preset dynamic information to obtain dynamic normal information; Performing illumination calculation according to the dynamic normal information to obtain dynamic illumination information; The virtual model is rendered according to the dynamic lighting information.

4. The method according to claim 3, characterized in that The preset dynamic information includes a plurality of disturbance information, and different disturbance information corresponds to different disturbance directions; the dynamic sampling of the normal map according to the preset dynamic information to obtain dynamic normal information includes: Adding disturbances to the mapping relationship between the virtual model and the normal map according to a plurality of disturbance information respectively, and sampling the normal map based on the mapping relationship after adding the disturbances, to obtain normal dynamic sampling results corresponding to the plurality of disturbance information; The normal dynamic sampling results corresponding to the plurality of disturbance information are superimposed to obtain the dynamic normal information.

5. The method according to claim 3, characterized in that: The method further comprises: Acquire a second map corresponding to the virtual model; the second map includes color change information; Sampling the second map, and determining basic color information of the virtual model according to the sampled color change information and at least one reference color; The virtual model is rendered according to the basic color information.

6. The method according to claim 3, characterized in that The dynamic lighting information includes highlight information; the virtual model is a virtual water model; and the method further includes: Acquire a third map corresponding to the virtual model; the third map represents foam area information; Sampling the third map, and determining a foam area in the virtual model according to the sampled foam area information; The foam area is rendered according to the highlight information.

7. The method according to any one of claims 1 to 6, characterized in that: The static image includes at least two image areas, the at least two image areas correspond to different image elements, and the virtual model in the first image area matches in shape; and displaying the rendered virtual model and the static image in a superimposed manner on a target user interface includes: Displaying the static image on a first layer in the target user interface; The rendered virtual model is displayed on a second layer in the target user interface and covers the first image area; the second layer is located above the first layer.

8. A user interface processing device, characterized in that: The device comprises: A first acquisition module is configured to acquire a virtual model and acquire a first map corresponding to the virtual model; A virtual model processing module, configured to dynamically sample the first map according to preset dynamic information, and render the virtual model according to the result of the dynamic sampling; A second acquisition module is configured to acquire a static image matching the virtual model; The display processing module is configured to overlay and display the rendered virtual model and the static image on a target user interface.

9. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.

10. An electronic device, characterized in that: include: processor; A memory, configured to store executable instructions of the processor; The processor is configured to perform the method of any one of claims 1 to 7 by executing the executable instructions.

Images