Special effect rendering method and apparatus, computer readable medium, and electronic device

Abstract

Embodiments of the present application provide a special effect rendering method and device, a computer readable medium and an electronic device. The method comprises: selecting and downloading a material from a material library of a server; adjusting a custom parameter of the material, and previewing a material rendering effect corresponding to the adjusted custom parameter in real time; uploading the adjusted custom parameter to the server, and rendering the material according to the fixed parameter of the material and the received adjusted custom parameter by the server; and displaying a rendering result issued by the server. The rendering result in the embodiments of the present application is provided by the server, and better rendering effect can be provided. Moreover, the custom parameter can be adjusted, and the corresponding rendering effect can be previewed in real time, so that the user can freely adjust the custom parameter to obtain the required rendering effect. Finally, the server renders according to the uploaded custom parameter, so that the custom of the rendering effect can be realized.

Description

Technical Field

[0001] This application relates to the field of special effects processing technology, and more specifically, to a special effects rendering method, apparatus, computer-readable medium, and electronic device. Background Technology

[0002] Currently, there are two main solutions for special effects rendering: one is to create special effects files on a PC (Personal Computer) using special effects software, and then render the files on the PC or in the cloud; the other is to render images directly on mobile devices via a graphics interface. The first solution has the drawback of long rendering time and the inability to customize in real time; the second solution has the drawback of poor rendering results. Summary of the Invention

[0003] Embodiments of this application provide a special effects rendering method, apparatus, computer-readable medium, and electronic device, which enable at least some degree of custom rendering and provide better rendering effects.

[0004] Other features and advantages of this application will become apparent from the following detailed description, or may be learned in part from practice of this application.

[0005] According to one aspect of the embodiments of this application, a special effects rendering method is provided, the method comprising: selecting and downloading materials from a material library on a server; adjusting custom parameters of the materials and previewing the rendering effect of the materials corresponding to the adjusted custom parameters in real time; uploading the adjusted custom parameters to the server, wherein the server renders the materials according to the fixed parameters of the materials and the received adjusted custom parameters; and displaying the rendering result sent by the server.

[0006] According to one aspect of the embodiments of this application, a special effects rendering method is provided. The method includes: sending materials to a mobile terminal so that the mobile terminal can adjust custom parameters of the materials and preview the rendering effect of the materials corresponding to the adjusted custom parameters in real time, wherein the materials are selected by the mobile terminal from a local material library; receiving the adjusted custom parameters from the mobile terminal and rendering the materials according to the fixed parameters of the materials and the received adjusted custom parameters; and sending the rendering result to the mobile terminal.

[0007] According to one aspect of the embodiments of this application, a special effects rendering apparatus is provided. The apparatus includes: a download unit for selecting and downloading materials from a material library on a server; an adjustment unit for adjusting custom parameters of the materials and previewing the rendering effect of the materials corresponding to the adjusted custom parameters in real time; an upload unit for uploading the adjusted custom parameters to the server, whereby the server renders the materials according to the fixed parameters of the materials and the received adjusted custom parameters; and a display unit for displaying the rendering result sent by the server.

[0008] In some embodiments of this application, based on the foregoing scheme, the download unit is configured to: display a selection control corresponding to the material in the material library of the server; upload the material identification information corresponding to the selection control to the server in response to the triggering of the selection control; and download the material corresponding to the material identification information from the material library of the server; the adjustment unit is configured to: adjust the custom parameters of the material corresponding to the material identification information, and render the material corresponding to the material identification information in real time according to the adjusted custom parameters.

[0009] In some embodiments of this application, based on the foregoing scheme, the upload unit is configured to: send a rendering request to the server carrying adjusted custom parameters and the material identification information; the server obtains fixed parameters corresponding to the material identification information according to the rendering request; and renders the material corresponding to the material identification information on the server according to the fixed parameters and the adjusted custom parameters.

[0010] In some embodiments of this application, based on the foregoing scheme, before downloading the material corresponding to the material identification information from the material library of the server, the display unit is further configured to: display the shooting interface according to the received first shooting instruction; after downloading the material corresponding to the material identification information from the material library of the server, the display unit is further configured to: display the material corresponding to the material identification information in real time on the shooting interface, so as to preview the rendering effect of the material corresponding to the material identification information in real time.

[0011] In some embodiments of this application, based on the foregoing scheme, after displaying the shooting interface according to the received first shooting instruction, the display unit is further configured to: shoot video or images according to the received second shooting instruction to obtain a multimedia file; the upload unit is configured to: send a rendering request to the server carrying adjusted custom parameters, the material identification information and the multimedia file, the server obtains the fixed parameters corresponding to the material identification information according to the rendering request, and performs composite rendering of the material corresponding to the material identification information and the multimedia file on the server according to the fixed parameters and the adjusted custom parameters.

[0012] In some embodiments of this application, based on the foregoing scheme, the display unit is configured to display the rendering results returned in real time by the server in the form of streaming media during the rendering process.

[0013] In some embodiments of this application, based on the foregoing scheme, the display unit is configured to display the multimedia file returned by the server after rendering is completed, as the rendering result.

[0014] In some embodiments of this application, based on the foregoing scheme, after displaying the rendering result issued by the server, the display unit is further configured to: perform post-processing operations on the rendering result according to the received post-processing instructions to obtain a processed file; and upload the processed file to the server according to the received publishing instructions so that other terminals can obtain the processed file by accessing the server.

[0015] In some embodiments of this application, based on the foregoing scheme, the post-processing operation includes at least one of the following: adding filters, video compositing, and video editing.

[0016] In some embodiments of this application, based on the foregoing scheme, the display unit is further configured to: display explanatory information corresponding to the material.

[0017] According to one aspect of the embodiments of this application, a special effects rendering apparatus is provided. The apparatus includes: a first sending unit, configured to send materials to a mobile terminal so that the mobile terminal can adjust custom parameters of the materials and preview the rendering effect of the materials corresponding to the adjusted custom parameters in real time, wherein the materials are selected by the mobile terminal from a local material library; a receiving unit, configured to receive the adjusted custom parameters from the mobile terminal and perform material rendering according to the fixed parameters of the materials and the received adjusted custom parameters; and a second sending unit, configured to send the rendering result to the mobile terminal. According to one aspect of the embodiments of this application, a computer-readable medium is provided, on which a computer program is stored, wherein the computer program, when executed by a processor, implements the special effects rendering method as described in the above embodiments.

[0018] According to one aspect of the embodiments of this application, an electronic device is provided, including: one or more processors; and a storage device for storing one or more programs, which, when executed by the one or more processors, cause the one or more processors to implement the special effects rendering method as described in the above embodiments.

[0019] In some embodiments of this application, after uploading the adjusted custom parameters to the server, the server can render the material based on the fixed parameters of the material and the received adjusted custom parameters. The server can obtain the rendering result sent by the server via the network and can also display the rendering result. Therefore, the rendering result is provided by the server, which can provide better rendering effects. Moreover, the custom parameters of the material can be adjusted, and the rendering effect of the downloaded material after rendering based on the custom parameters can be previewed in real time. After the custom parameters are set, the adjusted custom parameters are uploaded to the server, and the server renders according to the adjusted custom parameters. Therefore, this application realizes a collaborative rendering scheme combining the local terminal and the server. Users can freely adjust the custom parameters of the material to obtain the desired rendering effect, and finally realize the customization of the rendering effect.

[0020] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and do not limit this application. Attached Figure Description

[0021] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application. It is obvious that the drawings described below are merely some embodiments of this application, and those skilled in the art can obtain other drawings based on these drawings without any inventive effort. In the drawings:

[0022] Figure 1 A schematic diagram illustrating the principle of cloud rendering solutions in related technologies is shown;

[0023] Figure 2 A schematic diagram illustrating the principle of mobile rendering schemes in related technologies is shown;

[0024] Figure 3 A schematic diagram of an exemplary system architecture to which the technical solutions of the embodiments of this application can be applied is shown;

[0025] Figure 4 A flowchart of a special effects rendering method according to an embodiment of this application is shown;

[0026] Figure 5 A schematic diagram illustrating the categories of material parameters according to an embodiment of this application is shown;

[0027] Figure 6 A schematic diagram illustrating the material properties according to an embodiment of this application is shown;

[0028] Figure 7 An embodiment according to this application is shown. Figure 4Flowcharts detailing steps 410 and 420;

[0029] Figure 8 A schematic diagram showing a display interface for explanatory information corresponding to materials according to an embodiment of this application is shown;

[0030] Figure 9 A schematic diagram of a real-time preview interface of the material rendering effect according to an embodiment of this application is shown;

[0031] Figure 10 An embodiment according to this application is shown. Figure 4 Flowchart of the steps following step 440;

[0032] Figure 11 A schematic diagram of the interaction flow of a client application software according to an embodiment of this application is shown;

[0033] Figure 12 A flowchart of a special effects rendering method according to another embodiment of this application is shown;

[0034] Figure 13 This diagram illustrates the basic architecture that can implement the special effects rendering method provided in the embodiments of this application.

[0035] Figure 14 A block diagram of a special effects rendering apparatus according to an embodiment of this application is shown;

[0036] Figure 15 A block diagram of a special effects rendering apparatus according to another embodiment of this application is shown;

[0037] Figure 16 A schematic diagram of the structure of a computer system suitable for implementing the electronic device of the present application is shown. Detailed Implementation

[0038] Exemplary embodiments will now be described more fully with reference to the accompanying drawings. However, these exemplary embodiments can be implemented in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided to make this application more comprehensive and complete, and to fully convey the concept of the exemplary embodiments to those skilled in the art.

[0039] Furthermore, the described features, structures, or characteristics can be combined in any suitable manner in one or more embodiments. Numerous specific details are provided in the following description to give a thorough understanding of embodiments of this application. However, those skilled in the art will recognize that the technical solutions of this application can be practiced without one or more of the specific details, or other methods, components, apparatuses, steps, etc., can be employed. In other instances, well-known methods, apparatuses, implementations, or operations are not shown or described in detail to avoid obscuring various aspects of this application.

[0040] The block diagrams shown in the accompanying drawings are merely functional entities and do not necessarily correspond to physically independent entities. That is, these functional entities can be implemented in software, in one or more hardware modules or integrated circuits, or in different network and / or processor devices and / or microcontroller devices.

[0041] The flowcharts shown in the accompanying drawings are merely illustrative and do not necessarily include all content and operations / steps, nor do they necessarily have to be performed in the described order. For example, some operations / steps can be broken down, while others can be combined or partially combined; therefore, the actual execution order may change depending on the specific circumstances.

[0042] Rendering is a crucial part of computer graphics processing. It involves using computer programs to generate images from 2D or 3D models, ensuring the generated images match the 3D scene. Because rendering often produces special effects that wouldn't normally occur in reality, it can also be called the process of creating special effects.

[0043] In related technologies, there are two main rendering solutions: cloud rendering and mobile rendering.

[0044] Cloud-based rendering solutions in related technologies are primarily used in film and advertising special effects. This involves creating special effects on a PC using special effects software, then rendering them offline on the PC or storing the effects files in the cloud for offline rendering. The rendering process is lengthy. The final rendered result is identical to the original production image, but modifications are inconvenient. Figure 1 A schematic diagram illustrating the principle of cloud rendering solutions in related technologies is shown. Please refer to [link / reference]. Figure 1 The cloud rendering process is as follows: First, use professional client software on a PC to create special effects and obtain the special effects file. Then, use the professional client software to check the effect. Once the effect is checked, upload the special effects file to the cloud and render it in the cloud to obtain the final rendering result. Then, download the final rendering result from the cloud using the professional client software. Finally, the professional client software can display the result.

[0045] Although not shown in the attached diagram, offline rendering on a PC is easy to understand. Compared to rendering effects files in the cloud, rendering on a PC does not involve uploading or downloading via the network. Specifically, the process of offline rendering on a PC includes: first, creating effects using professional client software on the PC to obtain the effects file; then, verifying the effect using the same software; next, rendering the effects file using the software; and finally, displaying the rendering result.

[0046] Therefore, whether rendering is done on a PC or rendering effects files in the cloud, the effects files must be created first before rendering. Furthermore, the effects files are usually very large, and the file creation and rendering processes are both time-consuming. If the rendering result needs to be adjusted, the effects file must be recreated using professional client software and then re-rendered. This results in high time and manpower costs for users to modify the rendering results, making it inconvenient for users to modify and customize the rendering results.

[0047] The mobile rendering solutions in related technologies are mainly real-time rendering, which renders images directly on mobile devices through a graphics interface. Figure 2 A schematic diagram illustrating the principle of mobile rendering schemes in related technologies is shown. Please refer to [link / reference]. Figure 2 The mobile rendering process is as follows: First, after the materials are created, they are saved in the cloud; then, the client application on the mobile device downloads the materials from the cloud to the mobile device; next, the client application loads the materials and renders them; finally, the client application displays the results on the mobile device.

[0048] Therefore, in mobile rendering solutions, users can select materials for real-time rendering, and thus the final rendering effect can be modified by the user in real time; however, due to the performance limitations of mobile devices, the effect may not be as good as that of cloud rendering.

[0049] In summary, both cloud-based rendering and mobile-based rendering solutions in the relevant technologies have certain drawbacks. Cloud-based rendering solutions suffer from long processing times and the inability to customize in real time, while mobile-based rendering solutions suffer from poor rendering effects.

[0050] Therefore, this application first provides a special effects rendering method. The special effects rendering method provided by this application can at least overcome the shortcomings of cloud rendering schemes and mobile rendering schemes in related technologies.

[0051] Figure 3 A schematic diagram of an exemplary system architecture to which the technical solutions of the embodiments of this application can be applied is shown.

[0052] like Figure 3 As shown, system architecture 300 may include mobile terminal devices (such as...) Figure 3 The mobile terminal device shown includes one or more of a smartphone 301, a tablet computer 302 (which could also be a portable computer, etc.), a network 303, and a server 304. The mobile terminal device has a display screen. The network 303 serves as a medium for providing a communication link between the mobile terminal device and the server 304. The network 303 can include various connection types, such as wired communication links, wireless communication links, etc.

[0053] It should be understood that Figure 3 The number of mobile terminal devices, networks, and servers shown is merely illustrative. Depending on implementation needs, any number of mobile terminal devices, networks, and servers can be included. For example, server 304 could be a server cluster composed of multiple servers.

[0054] In one embodiment of this application, a client application software is deployed on the mobile terminal device, and a material library is deployed on the server 304, which stores multiple rough materials. The client application software can display download buttons for each material in the material library on the server 304. When the user operates the client application software, the download button is triggered to select the corresponding material and download the corresponding rough material from the material library. The client application software can render and display the downloaded rough material.

[0055] In one embodiment of this application, the client application software on the mobile terminal device can display an adjustment entry for material parameters. Users can adjust the custom parameters of the material through the adjustment entry and preview the rendering effect of the rough material based on the custom parameters in real time on the client application software.

[0056] In one embodiment of this application, the material library of server 304 also stores the original material corresponding to each rough material and the fixed parameters corresponding to each original material. The original material has a higher level of detail than the rough material. The rough material and the original material corresponding to the rough material are obtained by modeling the same object.

[0057] In one embodiment of this application, the mobile terminal device uploads user-defined parameters for adjusting materials to the server 304 via network 303. The server 304 then renders the corresponding native materials based on the user-defined parameters and the fixed parameters of the native materials.

[0058] In one embodiment of this application, server 304 sends the rendering result to mobile terminal device via network 303, and mobile terminal device displays the rendering result.

[0059] Therefore, Figure 3 The illustrated embodiment achieves material rendering through collaboration between the mobile terminal device and the server 304. Users can set custom parameters for the materials and preview the rendering effect of the custom parameters in real time on the mobile terminal device. The mobile terminal device also sends the custom parameters to the server 304, which performs the final rendering, giving users the ability to customize the rendering effect in real time. Furthermore, the server 304 can use its stronger rendering capabilities to render more detailed native materials, which can both shorten the rendering time and improve the final rendering effect.

[0060] It should be noted that although both the rough and raw materials are stored in the same server's material library in the embodiments of this application, in other embodiments of this application, the rough and raw materials can be stored in any location, such as in different material libraries on the same server, on different servers, in the same server cluster, on different server clusters, in the same cloud, on different clouds, etc. Although the storage and rendering of materials are performed through the same server in the embodiments of this application, in other embodiments of this application, material storage and rendering can be performed through any two identical or different devices, such as on different servers, in different server clusters, in the same cloud, on different clouds, etc. The embodiments of this application do not impose any limitations on these aspects, and the scope of protection of this application should not be limited in any way.

[0061] Furthermore, it is easy to understand that the special effects rendering method provided in this application embodiment is generally executed by a mobile terminal device, and correspondingly, the special effects rendering device is generally located in the mobile terminal device. However, in other embodiments of this application, the server 304 may also have similar functions to the mobile terminal device, thereby executing the special effects rendering scheme provided in this application embodiment.

[0062] As mentioned above, the storage and rendering of materials in the embodiments of this application can be performed on a server cluster or in the cloud. Therefore, the special effects rendering method provided in the embodiments of this application can be implemented based on cloud computing or cloud technology.

[0063] Cloud computing is a computing model that distributes computing tasks across a large pool of computers, enabling various application systems to access computing power, storage space, and information services as needed. The network providing these resources is called the "cloud." From the user's perspective, resources in the "cloud" appear infinitely scalable, readily available, on-demand, and expandable, with payment based on usage.

[0064] As a provider of fundamental cloud computing capabilities, a cloud resource pool (referred to as a cloud platform, generally called IaaS (Infrastructure as a Service)) platform is established. Various types of virtual resources are deployed within the resource pool for external customers to choose from. The cloud resource pool mainly includes: computing devices (virtualized machines containing operating systems), storage devices, and network devices.

[0065] Based on logical function, a PaaS (Platform as a Service) layer can be deployed on top of the IaaS (Infrastructure as a Service) layer, and a SaaS (Software as a Service) layer can be deployed on top of the PaaS layer. Alternatively, SaaS can be deployed directly on top of IaaS. PaaS is a platform for running software, such as databases and web containers. SaaS refers to various types of business software, such as web portals and bulk SMS senders. Generally speaking, SaaS and PaaS are upper layers compared to IaaS.

[0066] The implementation details of the technical solutions in the embodiments of this application are described in detail below:

[0067] Figure 4 A flowchart of a special effects rendering method according to an embodiment of this application is shown. This special effects rendering method can be executed by a mobile terminal device with display, computing, and communication functions. These devices can also capture video data through a camera. The mobile terminal device can be a smartphone, iPad, laptop, or other portable mobile device. (Refer to...) Figure 4 As shown below, the execution subject of this application embodiment will be referred to as the mobile terminal. The special effects rendering method includes at least the following steps:

[0068] In step 410, materials are selected and downloaded from the server's material library.

[0069] Server-side devices can be personal computers, cloud servers, or cloud server clusters. Server-side performance is superior to mobile devices. Specifically, the server's CPU and / or graphics card performance is higher than that of the mobile device, the server's memory and / or video memory size is larger, and the server's disk space size is also larger. Therefore, the server's rendering capabilities are superior to those of the mobile device.

[0070] Materials can include files such as models, texture maps, and materials.

[0071] Specifically, the mobile device has a client application that allows access to the server's media library. The client application displays button controls for each media item in the server's media library, with icons displayed on the buttons. Users can click on the button to select and download the corresponding media item.

[0072] In one embodiment of this application, the special effects rendering method further includes: displaying explanatory information corresponding to the material.

[0073] Specifically, the explanatory information corresponding to the material can take the form of, but is not limited to, text, images, audio, video, etc.; and for a single material, the mobile device can display multiple explanatory information items corresponding to that material simultaneously, and each explanatory information item can take any of the forms mentioned above.

[0074] In one embodiment of this application, the explanatory information corresponding to the material is arranged and displayed in a corresponding manner with the button controls.

[0075] Specifically, the description information and the corresponding button control can be displayed in the same row or column. In this way, users can first determine the material they need based on the description information, and then click the button control corresponding to the description information to select the material they need.

[0076] In one embodiment of this application, on a mobile device, the description information corresponding to the material is displayed using a corresponding button control.

[0077] Specifically, the explanatory information corresponding to the material is in the form of an icon or text, which can be embedded in the button control. In this embodiment, the explanatory information and the button control are displayed in an integrated manner, which can simplify the interface layout and allow the interface to display more content.

[0078] In other embodiments of this application, the selection of materials can also be carried out in other ways, such as receiving a voice command and then recognizing the voice command to determine the selected materials.

[0079] In step 420, the custom parameters of the material are adjusted, and the rendering effect of the material corresponding to the adjusted custom parameters is previewed in real time.

[0080] Mobile devices can render assets based on custom parameters by calling graphics interfaces such as OpenGL.

[0081] Custom parameters can include one or more, and different rendering results can be obtained by rendering the footage based on different custom parameters. Mobile devices can display a parameter adjustment interface or parameter adjustment tool, and can adjust the custom parameters of the footage by receiving parameter adjustment commands from the user.

[0082] In one embodiment of this application, the mobile device displays a slider with a sliding component. The user can operate the sliding component to slide on the slider, and the mobile device adjusts parameters based on the sliding distance of the sliding component. For example, in the mobile device, a slider corresponding to a custom parameter can be displayed horizontally. When the user moves the sliding component to the left end of the slider, the mobile device can determine that the operation adjusts the corresponding custom parameter to the minimum; when the user moves the sliding component to the right end of the slider, the mobile device can determine that the operation adjusts the corresponding custom parameter to the maximum.

[0083] In one embodiment of this application, the mobile terminal displays parameter selection buttons corresponding to different custom parameters. Each custom parameter has multiple parameter selection buttons, and different parameter selection buttons correspond to different custom parameter values.

[0084] In this embodiment, the user adjusts the custom parameters by clicking the parameter selection button. Therefore, the user can be given limited parameter customization capabilities. Each custom parameter is pre-set, which can ensure the rationality of the custom parameters.

[0085] In one embodiment of this application, the mobile device displays an entry point for submitting custom parameter values.

[0086] The submission entry for custom parameter values ​​can be in the form of a text input box, allowing users to set custom parameters by entering information.

[0087] The mobile app can render downloaded materials in real time based on the adjusted custom parameters.

[0088] In one embodiment of this application, the server-side material library stores multiple materials of different levels of detail obtained by modeling the same object, and the level of detail of the materials downloaded from the server matches the rendering performance of the mobile device.

[0089] Multiple assets with different levels of detail, obtained by modeling the same object, refer to assets that correspond to the same special effect but differ in level of detail. The level of detail of an asset is also its quality. The higher the level of detail, the larger the file size, the better the rendering effect, the richer the details after rendering, and the more faces the model in the asset often has. The asset also requires stronger rendering performance. If the device's rendering performance is weak, the asset may not be able to complete rendering or the rendering time may be longer.

[0090] Specifically, the server stores a first correspondence table between rendering performance levels and different levels of detail, and a second correspondence table between rendering performance levels and device parameters. When a mobile device requests to download materials from the server, it sends its device parameters to the server. The server first finds the rendering performance level corresponding to the device parameters by querying the second correspondence table, then determines the corresponding level of detail by querying the first correspondence table, and finally returns the materials corresponding to the determined level of detail to the mobile device.

[0091] The device parameters mentioned above can be the mobile device model or the GPU model.

[0092] In this embodiment, since the detail of the materials downloaded by the mobile device matches the rendering performance of the mobile device, the mobile device can optimize the rendering quality while ensuring the real-time rendering.

[0093] When the corresponding device parameter does not exist in the second mapping table, the server can return the material corresponding to the specified level of detail to the mobile device.

[0094] In step 430, the adjusted custom parameters are uploaded to the server, and the server renders the material based on the fixed parameters of the material and the received adjusted custom parameters.

[0095] When the server-side device is a cloud server cluster, the operations of rendering materials and storing materials in the material library can be performed by different servers in the cloud server cluster.

[0096] Mobile devices can also upload fixed parameters to the server. For example, when a material is downloaded from a server's material library, the fixed parameters of that material will be obtained. When a mobile device uploads custom parameters to the server, both the fixed and custom parameters of the material will be uploaded to another server on the server that can render the material.

[0097] Specifically, the server can be configured with a special effects rendering engine, and the materials can be rendered in the server-side special effects rendering engine.

[0098] Special effects assets can be configured with both fixed and custom parameters. Fixed parameters, provided by the designer, cannot be changed by the user. Examples include rendered models, materials, and camera positions. Custom parameters have default values ​​and can be modified by the user. The range of custom parameter values ​​is provided by the designer, and users can only set values ​​within this range to ensure reasonableness. Parameters such as the number of models rendered and whether to render at all can be set as custom parameters. Figure 5 A schematic diagram illustrating the categories of material parameters according to one embodiment of this application is shown. For example... Figure 5As shown, the parameters of a material include fixed parameters and custom parameters. Fixed parameters include model, materials, animation, lighting, camera, and renderer settings; custom parameters can include model visibility, number of models, etc. The parameters of a material can be referred to as its attributes.

[0099] Figure 6 A schematic diagram illustrating the material properties according to an embodiment of this application is shown. Figure 6 The special effects scene in the video is actually an explosion, shattering, and smoke effect of the model. Figure 6 The left side of the middle section shows the fixed properties of the special effects material, including ambient light, camera position, model material, materials, and renderer settings; Figure 6 The right side shows the variable properties of this special effects material, including the number of fragments, smoke density, and explosion direction. Fixed properties are the material's fixed parameters, while variable properties are its custom parameters. There is no strict boundary between fixed and variable properties; some properties can be both. However, the setting of variable properties should generally follow these two principles:

[0100] 1. Keep the attribute structure as simple as possible. Quantities such as number or direction can be represented by a single number or a three-dimensional vector. Figure 6 The "number of fragments" and "smoke concentration" are numerical values. The "explosion direction" is a directional value.

[0101] 2. Attribute settings should follow procedural modeling rules to ensure their effectiveness. Settings such as "explosion direction" may affect the location of smoke, thus impacting the overall smoke effect. The design of such attributes needs to ensure the overall rationality of the material's effect. If modifying an attribute would significantly affect subsequent effects and this effect is difficult to eliminate, then this attribute should be set as a fixed attribute. Therefore, although... Figure 6 The "explosion direction" is set as a variable attribute, but it can also be set as a fixed attribute to ensure the validity of the setting.

[0102] Figure 7 An embodiment according to this application is shown. Figure 4 A flowchart detailing steps 410 and 430 is provided. Please refer to [link / reference]. Figure 7 Step 410 may specifically include the following steps:

[0103] In step 411, the selection controls corresponding to the materials in the material library on the server are displayed.

[0104] Selection controls can be, for example, selection buttons, which allow users to select corresponding materials by triggering the selection control.

[0105] The solutions in this application can be applied to the field of video sharing, especially to the field of short videos.

[0106] Figure 8 A schematic diagram showing a display interface for explanatory information corresponding to materials according to one embodiment of this application is illustrated. Please refer to... Figure 8 This is the display page of a short video app, specifically showing a clip titled "Flower." The image in the middle window is not the clip itself, but a video demonstrating its usage. This video, along with the text "Flower," constitutes the description of the clip. The middle window also includes a button control titled "Use," which is essentially a selection control for the "Flower" clip.

[0107] In step 412, in response to the triggering of the selection control, the material identification information corresponding to the selection control is uploaded to the server.

[0108] When a trigger event for the selection control is detected, a response will be made to the trigger event, and the material identification information corresponding to the selection control will be uploaded to the server.

[0109] Material identification information is used to identify a material. Material identification information can be a string containing letters, numbers, underscores, etc. Each selection control on the mobile device is configured with corresponding material identification information.

[0110] Figure 9 A schematic diagram of a real-time preview interface of the material rendering effect according to an embodiment of this application is shown. When clicked... Figure 8 After clicking the "Use" button, you can enter... Figure 9 The interface shown is Figure 9 Below this is also a set of selection controls, including a selection control for an image named "flower," which is related to... Figure 8 The "Use" button in the app has the same effect: it allows users to select and preview materials named "Flowers" in real time. Therefore, short video apps can also directly access this feature. Figure 9 The interface shown allows you to select materials; when... Figure 9 When the selection control located at the bottom is slid, it can trigger the selection controls for other materials, allowing the user to select from those materials. After the user selects a material, the selection will then proceed to the next step. Figure 9 The blank space in the middle allows for a real-time preview of the rendered material.

[0111] In one embodiment of this application, the mobile device sorts the displayed selection controls according to the user's personal information.

[0112] The personal information here can be either basic user information or user usage habit information. Specifically, users of short video apps register accounts on the app's servers and can submit information such as name, address, gender, age, and occupation; this constitutes the user's basic information. User usage habit information could include, for example, the effects the user has recently used, the effects the user has used most frequently, the effects most frequently used by other users the user follows, and the effects most frequently used in the short videos the user has watched, etc.

[0113] Mobile devices can be equipped with deep learning or neural network models, which make decisions about how to sort the displayed selection controls based on the user's personal information.

[0114] In this embodiment of the application, by personalizing the sorting of the selection controls, users can quickly find their favorite materials, thereby improving user satisfaction.

[0115] In one embodiment of this application, the material downloaded by the mobile device from the server is the same material rendered by the server.

[0116] To ensure the real-time preview effect of the materials, the mobile device can render the downloaded materials with low precision, and the final high-quality rendering is completed by the server.

[0117] In one embodiment of this application, on the display interface of the selection control on the mobile terminal, the selection control at the top is the selection control corresponding to the material that the user has recently used or the material that the user has used the most.

[0118] In one embodiment of this application, the default value of the custom parameters corresponding to the material is configured based on the user's personal information.

[0119] In many cases, users do not adjust custom parameters. This application embodiment ensures the user's material usage experience by personalizing the default values ​​of the materials according to the user's personal information.

[0120] In step 413, the material corresponding to the material identification information is downloaded from the material library on the server.

[0121] By providing material identification information to the server, the server can determine the materials that the mobile device actually wants to download. Then, the server can return the corresponding materials to the mobile device, allowing the mobile device to download the required resources.

[0122] Step 420 in Figure 4 may specifically include the following steps:

[0123] In step 420', the custom parameters of the material corresponding to the material identification information are adjusted, and the material corresponding to the material identification information is rendered in real time according to the adjusted custom parameters.

[0124] Based on the material identification information, it can be determined which material's custom parameters should be adjusted, and which material should be rendered in real time.

[0125] In one embodiment of this application, the adjusted custom parameters are uploaded to the server, and the server renders the material based on the fixed parameters of the material and the received adjusted custom parameters. This includes: sending a rendering request to the server carrying the adjusted custom parameters and material identification information; the server obtaining the fixed parameters corresponding to the material identification information based on the rendering request; and rendering the material corresponding to the material identification information on the server based on the fixed parameters and the adjusted custom parameters.

[0126] The assets downloaded from the server and the assets rendered on the server corresponding to the asset identifier information can be the same assets or different assets; when they are different assets, they should both correspond to the same special effect. For example, if the asset downloaded from the server is the first asset, and the asset rendered on the server corresponding to the asset identifier information is the second asset, then the first and second assets correspond to the same special effect, with the second asset having higher detail than the first asset.

[0127] As mentioned earlier, the server-side asset library can store multiple assets of different detail levels corresponding to the same effect. Second assets can also be stored in the asset library, or in other locations; the second asset can be the asset with the highest detail level corresponding to a given effect. A higher detail level for the second asset means that it has more detail compared to the first asset.

[0128] When the second material is stored in the material library, the server can retrieve the associated second material from the library based on the material identifier information and then render the second material. Specifically, the second material in the material library can be stored directly as a single material, or it can be stored as an associated identifier, which in turn is stored as the material identifier information. In this way, the associated second material can be found in the material library based on the material identifier information.

[0129] In this embodiment, by downloading and previewing the first material with lower detail on the mobile device, the user can initially grasp the effect of the material in real time. By rendering the second material with higher detail on the server, the quality and effect of the final rendering result can be guaranteed. Furthermore, relying on the server's more powerful rendering capabilities, the rendering time can be effectively controlled, thereby improving the user experience.

[0130] The second source material can be a high-quality special effects scene created by professional designers using professional software such as Houdini, Maya, and C4D; the first source material can also be created by professional designers or generated automatically.

[0131] In one embodiment of this application, the first material is obtained by processing the second material using a deep learning model.

[0132] Both the first and second footage correspond to the same special effect; therefore, most of the details in the first footage can be reflected in the second footage. Deep learning models are trained models that can reduce the detail of footage.

[0133] In this embodiment of the application, by using a model that can reduce the detail of the material to automatically generate the first material, the corresponding first material can be generated in batches for multiple second materials, which greatly improves the speed of establishing the material library, can improve the efficiency of launching new materials, and significantly reduces labor costs.

[0134] In one embodiment of this application, the special effects rendering method further includes: rendering and displaying the rendered first material in real time.

[0135] After displaying the first source material on the mobile interface, the interface can also display a parameter adjustment tool. After the user uses the parameter adjustment tool to adjust the custom parameters, the interface can also generate the rendering effect of the first source material based on the custom parameters in real time.

[0136] In one embodiment of this application, before downloading the material corresponding to the material identification information from the material library on the server, the method further includes: displaying a shooting interface according to the received first shooting instruction; after downloading the material corresponding to the material identification information from the material library on the server, the method further includes: displaying the material corresponding to the material identification information in real time on the shooting interface to preview the rendering effect of the material corresponding to the material identification information in real time.

[0137] Specifically, the main interface of a short video app is often not a real-time preview interface for the footage, but rather a browsing interface for the short video. The main interface may display a button to enter the real-time preview interface for the footage. When the user clicks this button, the short video app receives the first shooting instruction and enters the real-time preview interface for the footage. Figure 9 The real-time preview interface for the materials is the same as the shooting interface.

[0138] In one embodiment of this application, after displaying the shooting interface according to the received first shooting instruction, the method further includes: shooting video or images according to the received second shooting instruction to obtain a multimedia file; uploading adjusted custom parameters to the server, and having the server render the material according to the fixed parameters of the material and the received adjusted custom parameters, including: sending a rendering request to the server carrying the adjusted custom parameters, material identification information, and multimedia file; the server obtaining the fixed parameters corresponding to the material identification information according to the rendering request, and performing composite rendering of the material corresponding to the material identification information and the multimedia file on the server according to the fixed parameters and the adjusted custom parameters.

[0139] Multimedia files are video or image files captured by mobile devices. Please continue reading. Figure 9 When the user clicks on the location Figure 9 After selecting the option at the bottom center, the mobile device will receive a second shooting command to capture video or images, with the footage overlaid in real time on the shooting interface. The final multimedia file may or may not include the overlaid footage.

[0140] Composite rendering generates content containing high-quality secondary materials and multimedia files, ensuring the quality of the rendering results and improving the user experience.

[0141] In one embodiment of this application, the mobile device has a front-facing camera, and the special effects rendering method further includes: the mobile device displays the selected first material in real time according to the activation of the front-facing camera.

[0142] For details, please continue to see Figure 9 There is a flip button in the upper right corner of the interface. When the user clicks the button, they can switch between the front and rear cameras.

[0143] In many cases, the selected materials only take effect when the front-facing camera is activated, and these materials are mainly used to enhance the user's selfies. Therefore, the embodiments of this application ensure that the first material selected by the user is used correctly.

[0144] Figure 9 The interface also features a music button. When users click this button, they can add music to the multimedia files they record, making the short videos more appealing to users.

[0145] Please continue reading Figure 4 In step 440, the rendering results sent by the server are displayed.

[0146] The rendering results sent by the server can be images or videos, and the rendering results include the source materials.

[0147] In one embodiment of this application, displaying the rendering result sent by the server includes: displaying the multimedia file returned by the server after rendering is completed as the rendering result.

[0148] The server can render based on higher quality materials and with higher rendering efficiency; therefore, the server can return better rendering results to the mobile device more efficiently.

[0149] In one embodiment of this application, displaying the rendering results sent by the server includes: displaying the rendering results returned by the server in real time as streaming media during the rendering process.

[0150] When the rendering performance on the server side and the network conditions between the mobile device and the server are good enough, the mobile device can display the rendering results of the server in real time, which can further improve the user experience.

[0151] Figure 10 An embodiment according to this application is shown. Figure 4 A flowchart of the steps following step 440. Please refer to [link / reference]. Figure 10 The following steps may also be included after step 440:

[0152] In step 450, post-processing operations are performed on the rendering result according to the received post-processing instructions to obtain the processed file.

[0153] In one embodiment of this application, the post-processing operation includes at least one of the following: adding filters, video compositing, and video editing.

[0154] Different post-processing operations correspond to different post-processing instructions. In short video scenarios, different buttons can be set in short video apps, and users can send corresponding post-processing instructions to the mobile device by clicking the buttons.

[0155] In step 460, the processed file is uploaded to the server according to the received publishing instruction, so that other terminals can obtain the processed file by accessing the server.

[0156] Other terminals can be other mobile devices.

[0157] Specifically, after creating a video or image file, users upload it to the short video platform's server via a short video app, allowing other users of the app to access the file.

[0158] Post-processing can further improve the quality of the generated files.

[0159] Figure 11 This diagram illustrates the interaction flow of a client application software according to an embodiment of this application. The aforementioned short video app is an example of this. Figure 11 The client application software in [the context]. Below, we will combine [the following] with... Figure 11 The embodiments of this application are further explained below.

[0160] 1. Loading materials and material descriptions

[0161] After a user opens the client application, a material preview option will be displayed, which includes material descriptions such as text, images, and videos, to fully inform the user of the specific content and effects of the scene. The material preview option can also include low-resolution models of the materials. After the user selects a material, a material resource package will be downloaded, including a parameter list and basic real-time rendering materials.

[0162] 2. Users select parameters and shoot custom videos.

[0163] Users can adjust various material parameters in the parameter adjustment interface. These parameters include model size, model parameters, and quantities or orientations.

[0164] 3. Real-time low-quality preview

[0165] Real-time rendering is performed using a renderer on mobile platforms to show users the approximate effect. The meaning of these material parameters is dynamically communicated to the user through real-time rendering, giving them a clear understanding of the overall effect.

[0166] 4. View the rendering results and post-process the video.

[0167] After adjusting the parameter model, the user uploads the material parameters. The server then renders the content based on these parameters. Once rendering is complete, the rendered image or video is transmitted to the user, who can then view the final result and begin post-processing operations such as editing, applying filters, or merging with other videos.

[0168] Figure 12 A flowchart of a special effects rendering method according to another embodiment of this application is shown. This special effects rendering method can be executed by a server-side device with display, computing, and communication functions. The rendering performance of these server-side devices is generally higher than that of the aforementioned mobile terminal devices. The server-side device can be, for example, a personal computer, a cloud server, a cloud server cluster, etc. (Refer to...) Figure 12 As shown, this special effects rendering method includes at least the following steps:

[0169] In step 1210, the material is sent to the mobile device so that the mobile device can adjust the custom parameters of the material and preview the rendering effect of the material corresponding to the adjusted custom parameters in real time.

[0170] The materials were selected from the local material library on the mobile device.

[0171] The server sends materials to the mobile device based on the download request from the mobile device.

[0172] In step 1220, the adjusted custom parameters from the mobile device are received, and the material is rendered based on the fixed parameters of the material and the received adjusted custom parameters.

[0173] Custom parameters can be set by mobile users.

[0174] In step 1230, the rendering result is sent to the mobile device.

[0175] The server can send the rendering results to the mobile device after rendering is complete, or it can send the rendering results to the mobile device in real time via streaming media during the rendering process.

[0176] Figure 13 A schematic diagram of the basic architecture that can implement the special effects rendering method provided in the embodiments of this application is shown. Below, based on... Figure 13 The basic architecture of the embodiments of this application is introduced.

[0177] first, Figure 13 On the right side of the infrastructure is the server-side, which is a cloud rendering platform that provides rendering services. The server-side includes a cloud-based asset library and a cloud-based special effects rendering engine. The cloud-based asset library stores special effects rendering assets, and the cloud-based special effects rendering engine is used to render these special effects rendering assets.

[0178] Figure 13 The left side of the infrastructure represents the client side. Clients are divided into two types: professional client software and client application software. Professional client software includes special effects scene creation software such as Houdini, Maya, and C4D, primarily used for creating high-quality special effects scenes. Client application software is an application that users can download and install on their mobile devices, such as short video apps like Weishi. It's a user-accessible mobile application responsible for receiving, downloading, and uploading data from the client. The data uploaded by client application software can include the following formats: custom parameters for related materials and videos captured by the user's mobile phone camera.

[0179] Figure 13 The operational flow of the infrastructure in China is as follows:

[0180] 1. Building a cloud-based resource library

[0181] Professional designers use specialized visual effects scene design software to create special effects assets and implement a procedural modeling process, which involves configuring parameters and running the program to complete the final rendering of the special effects. The effects are then produced on professional client-side software for verification. Once verified, the designed assets are uploaded to a cloud-based asset library for storage and user selection.

[0182] 2. Users preview the effect on the client application software.

[0183] After opening the media library in the client application, the application will load the media and its description. Users can select media and preview the rendering effect in real time. They can then shoot custom videos. Users can also see adjustable parameters and adjust them to their desired values ​​to achieve different effects in the shot custom videos, enabling real-time low-quality effect previews.

[0184] 3. Real-time rendering in the cloud

[0185] After receiving custom parameters and video footage from the client application, the cloud-based effects rendering engine begins rendering. Rendering parameters include both default parameters for the footage and user-defined parameters. Once cloud rendering is complete, the final rendering result is generated and composited into a video.

[0186] 4. The client displays the final result.

[0187] The client application downloads the video from the network, obtains the composite video from the cloud-based effects rendering engine, and then renders the final effect within the client application. Users can choose to continue post-processing or share the video.

[0188] The real-time nature of mobile rendering provides users with a strong sense of interactivity and can meet their customization needs, transforming them from video consumers into producers. However, due to performance limitations, mobile devices cannot produce cinematic-level special effects that truly wow users. Cloud-based offline rendering, on the other hand, can render high-quality special effects. However, due to the offline nature of rendering, the rendered scenes are generally customized by professional designers. Ordinary users then become video consumers, only able to watch videos and not create them. Some creative ideas cannot be realized.

[0189] The special effects rendering method provided in this application combines the advantages of mobile rendering and cloud rendering, allowing users to customize rendering effects while also producing high-quality rendering effects. This lowers the barrier for ordinary users to create movie special effects, enabling more users to participate in the development of high-quality special effects and stimulating their imagination.

[0190] The following describes an apparatus embodiment of this application, which can be used to execute the special effects rendering method in the above embodiments of this application. For details not disclosed in the apparatus embodiments of this application, please refer to the embodiments of the special effects rendering method described above.

[0191] Figure 14 A block diagram of a special effects rendering apparatus according to an embodiment of this application is shown.

[0192] Reference Figure 14 As shown, a special effects rendering apparatus 1400 according to an embodiment of this application includes:

[0193] The unit includes a download unit 1410, an adjustment unit 1420, an upload unit 1430, and a display unit 1440.

[0194] The download unit 1410 is used to select and download materials from the material library on the server; the adjustment unit 1420 is used to adjust the custom parameters of the materials and preview the rendering effect of the materials corresponding to the adjusted custom parameters in real time; the upload unit 1430 is used to upload the adjusted custom parameters to the server, and the server renders the materials according to the fixed parameters of the materials and the received adjusted custom parameters; the display unit 1440 is used to display the rendering results sent by the server.

[0195] In some embodiments of this application, based on the foregoing scheme, the download unit 1410 is configured to: display a selection control corresponding to the material in the material library of the server; upload the material identification information corresponding to the selection control to the server in response to the triggering of the selection control; and download the material corresponding to the material identification information from the material library of the server; the adjustment unit 1420 is configured to: adjust the custom parameters of the material corresponding to the material identification information, and render the material corresponding to the material identification information in real time according to the adjusted custom parameters.

[0196] In some embodiments of this application, based on the foregoing scheme, the upload unit 1430 is configured to: send a rendering request carrying adjusted custom parameters and the material identification information to the server; the server obtains the fixed parameters corresponding to the material identification information according to the rendering request; and renders the material corresponding to the material identification information on the server according to the fixed parameters and the adjusted custom parameters.

[0197] In some embodiments of this application, based on the foregoing scheme, before downloading the material corresponding to the material identification information from the material library of the server, the display unit 1440 is further configured to: display the shooting interface according to the received first shooting instruction; after downloading the material corresponding to the material identification information from the material library of the server, the display unit 1440 is further configured to: display the material corresponding to the material identification information in real time on the shooting interface, so as to preview the rendering effect of the material corresponding to the material identification information in real time.

[0198] In some embodiments of this application, based on the foregoing scheme, after displaying the shooting interface according to the received first shooting instruction, the display unit 1440 is further configured to: shoot video or pictures according to the received second shooting instruction to obtain a multimedia file; the upload unit 1430 is configured to: send a rendering request to the server carrying adjusted custom parameters, the material identification information and the multimedia file, the server obtains the fixed parameters corresponding to the material identification information according to the rendering request, and performs composite rendering of the material corresponding to the material identification information and the multimedia file on the server according to the fixed parameters and the adjusted custom parameters.

[0199] In some embodiments of this application, based on the foregoing scheme, the display unit 1440 is configured to display the rendering results returned in real time by the server in the form of streaming media during the rendering process.

[0200] In some embodiments of this application, based on the foregoing scheme, the display unit 1440 is configured to display the multimedia file returned by the server after rendering is completed, as the rendering result.

[0201] In some embodiments of this application, based on the foregoing scheme, after displaying the rendering result issued by the server, the display unit 1440 is further configured to: perform post-processing operations on the rendering result according to the received post-processing instructions to obtain a processed file; and upload the processed file to the server according to the received publishing instructions so that other terminals can obtain the processed file by accessing the server.

[0202] In some embodiments of this application, based on the foregoing scheme, the post-processing operation includes at least one of the following: adding filters, video compositing, and video editing.

[0203] In some embodiments of this application, based on the foregoing scheme, the display unit 1440 is further configured to: display explanatory information corresponding to the material.

[0204] Figure 15 A block diagram of a special effects rendering apparatus according to another embodiment of this application is shown.

[0205] Reference Figure 15 As shown, a special effects rendering apparatus 1500 according to another embodiment of this application includes: a first sending unit 1510, a receiving unit 1520 and a second sending unit 1530.

[0206] The first sending unit 1510 is used to send materials to the mobile terminal so that the mobile terminal can adjust the custom parameters of the materials and preview the rendering effect of the materials corresponding to the adjusted custom parameters in real time. The materials are selected by the mobile terminal from the local material library. The receiving unit 1520 is used to receive the adjusted custom parameters from the mobile terminal and perform material rendering according to the fixed parameters of the materials and the received adjusted custom parameters. The second sending unit 1530 is used to send the rendering result to the mobile terminal.

[0207] Figure 16 A schematic diagram of the structure of a computer system suitable for implementing the electronic device of the present application is shown.

[0208] It should be noted that, Figure 16 The computer system 1600 of the electronic device shown is merely an example and should not impose any limitation on the functionality and scope of use of the embodiments of this application.

[0209] like Figure 16 As shown, the computer system 1600 includes a Central Processing Unit (CPU) 1601, which can perform various appropriate actions and processes based on programs stored in Read-Only Memory (ROM) 1602 or programs loaded from storage portion 1608 into Random Access Memory (RAM) 1603, such as performing the methods described in the above embodiments. Various programs and data required for system operation are also stored in RAM 1603. The CPU 1601, ROM 1602, and RAM 1603 are interconnected via bus 1604. An input / output (I / O) interface 1605 is also connected to bus 1604.

[0210] The following components are connected to I / O interface 1605: an input section 1606 including a keyboard, mouse, etc.; an output section 1607 including a cathode ray tube (CRT), liquid crystal display (LCD), etc., and speakers, etc.; a storage section 1608 including a hard disk, etc.; and a communication section 1609 including a network interface card such as a LAN (Local Area Network) card, modem, etc. The communication section 1609 performs communication processing via a network such as the Internet. A drive 1610 is also connected to I / O interface 1605 as needed. Removable media 1611, such as a disk, optical disk, magneto-optical disk, semiconductor memory, etc., are installed on drive 1610 as needed so that computer programs read from them can be installed into storage section 1608 as needed.

[0211] Specifically, according to embodiments of this application, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this application include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via communication section 1609, and / or installed from removable medium 1611. When the computer program is executed by central processing unit (CPU) 1601, it performs various functions defined in the system of this application.

[0212] It should be noted that the computer-readable medium shown in the embodiments of this application can be a computer-readable signal medium, a computer-readable storage medium, or any combination of the two. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), flash memory, optical fiber, portable compact disc read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this application, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In this application, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such transmitted data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. The computer-readable signal medium can also be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to wireless, wired, etc., or any suitable combination thereof.

[0213] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this application. Each block in a flowchart or block diagram may represent a module, segment, or portion of code, which contains one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in a block diagram or flowchart, and combinations of blocks in a block diagram or flowchart, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0214] The units described in the embodiments of this application can be implemented in software or hardware, and the described units can also be located in a processor. The names of these units do not necessarily limit the specific unit itself.

[0215] In one aspect, this application also provides a computer-readable medium, which may be included in the electronic device described in the above embodiments; or it may exist independently and not assembled into the electronic device. The computer-readable medium carries one or more programs, which, when executed by the electronic device, cause the electronic device to perform the methods described in the above embodiments.

[0216] It should be noted that although several modules or units for the device used to perform actions have been mentioned in the detailed description above, this division is not mandatory. In fact, according to the embodiments of this application, the features and functions of two or more modules or units described above can be embodied in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided and embodied by multiple modules or units.

[0217] Through the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein can be implemented by software or by combining software with necessary hardware. Therefore, the technical solutions according to the embodiments of this application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (such as a CD-ROM, USB flash drive, external hard drive, etc.) or on a network, including several instructions to cause a computing device (such as a personal computer, server, touch terminal, or network device, etc.) to execute the methods according to the embodiments of this application.

[0218] Other embodiments of this application will readily occur to those skilled in the art upon consideration of the specification and practice of the embodiments disclosed herein. This application is intended to cover any variations, uses, or adaptations of this application that follow the general principles of this application and include common knowledge or customary techniques in the art not disclosed herein.

[0219] The data collection and processing plan outlined in this application must be implemented in strict accordance with the requirements of relevant national laws and regulations, obtaining the informed consent or separate consent of the data subject (or having a legal basis as stipulated by the relevant national laws and regulations), and conducting subsequent data use and processing within the scope authorized by laws and regulations and the data subject.

[0220] It should be understood that this application is not limited to the precise structure described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this application is limited only by the appended claims.

Claims

1. A special effects rendering method, characterized in that, The method is executed by a mobile device, and the method includes: The shooting interface is displayed upon receiving the first shooting command; Display the selection controls corresponding to the materials in the material library on the server side; In response to the triggering of the selection control, the corresponding material identification information of the selection control is uploaded to the server; Download the material corresponding to the material identification information from the material library on the server side; the material library on the server side stores multiple materials with different levels of detail obtained by modeling the same object, and the level of detail of the material downloaded from the server side matches the rendering performance of the mobile device; The shooting interface displays the material corresponding to the material identification information in real time, so as to preview the rendering effect of the material corresponding to the material identification information in real time; Adjust the variable properties of the material and preview the rendering effect of the material corresponding to the adjusted variable properties in real time. The variable properties include quantities represented by numbers or three-dimensional vectors, and the variable properties include model visibility and model quantity. The system captures video or images according to the received second shooting command to obtain multimedia files. A rendering request carrying adjusted variable attributes, material identification information, and multimedia file is sent to the server. The server obtains the fixed attributes corresponding to the material identification information according to the rendering request, and performs composite rendering of the material corresponding to the material identification information and the multimedia file on the server according to the fixed attributes and the adjusted variable attributes. The fixed attributes include at least one of the following: material, animation, lighting, camera, and renderer settings. Display the rendering results sent by the server.

2. The special effects rendering method according to claim 1, characterized in that, The variable properties of the adjusted material include: Adjust the variable attributes of the material corresponding to the material identification information, and render the material corresponding to the material identification information in real time according to the adjusted variable attributes.

3. The special effects rendering method according to claim 1, characterized in that, The process of uploading the adjusted variable attributes to the server, and the server rendering the material based on the fixed attributes of the material and the received adjusted variable attributes, includes: A rendering request carrying the adjusted variable attributes and the material identification information is sent to the server. The server obtains the fixed attributes corresponding to the material identification information according to the rendering request, and renders the material corresponding to the material identification information on the server according to the fixed attributes and the adjusted variable attributes.

4. The special effects rendering method according to claim 1, characterized in that, The display of the rendering results sent by the server includes: The rendering results are displayed in real time as a streaming media stream during the rendering process.

5. The special effects rendering method according to claim 1, characterized in that, The display of the rendering results sent by the server includes: Display the multimedia file returned by the server after rendering is complete, as the rendering result.

6. The special effects rendering method according to claim 1, characterized in that, After displaying the rendering result sent by the server, the method further includes: Based on the received post-processing instructions, post-processing operations are performed on the rendering results to obtain the processed file; According to the received publishing instruction, the processed file is uploaded to the server so that other terminals can obtain the processed file by accessing the server.

7. The special effects rendering method according to claim 6, characterized in that, The post-processing operations include at least one of the following: adding filters, video compositing, and video editing.

8. The special effects rendering method according to claim 1, characterized in that, The method further includes: Display descriptive information corresponding to the material.

9. A special effects rendering method, characterized in that, The method is executed by the server, and the method includes: Materials are distributed to a mobile device so that the mobile device can adjust the variable attributes of the materials and preview the rendering effect of the materials corresponding to the adjusted variable attributes in real time. The mobile device selects and downloads materials from the server's material library in the following ways: displaying a selection control corresponding to the materials in the server's material library; responding to a trigger on the selection control and uploading the material identification information corresponding to the selection control to the server; downloading the material corresponding to the material identification information from the server's material library; the server's material library stores multiple materials of different levels of detail obtained from modeling the same object, and the level of detail of the materials downloaded from the server matches the rendering performance of the mobile device; the variable attributes include... The variable attributes, represented by characters or three-dimensional vectors, include model visibility and the number of models. Before downloading the material corresponding to the material identification information from the server's material library, the mobile terminal further performs the following: displaying a shooting interface according to the received first shooting instruction; after downloading the material corresponding to the material identification information from the server's material library, the mobile terminal further performs the following: displaying the material corresponding to the material identification information in real time on the shooting interface to preview the rendering effect of the material corresponding to the material identification information in real time; after displaying the shooting interface according to the received first shooting instruction, the mobile terminal further performs the following: shooting video or images according to the received second shooting instruction to obtain multimedia files. The system receives a rendering request from the mobile terminal, which carries the adjusted variable attributes, the material identification information, and the multimedia file. Based on the rendering request, it obtains the fixed attributes corresponding to the material identification information. Based on the fixed attributes and the adjusted variable attributes, it performs composite rendering of the material corresponding to the material identification information and the multimedia file on the server. The fixed attributes include at least one of the following: material, animation, lighting, camera, and renderer settings. The rendering result is sent to the mobile device for display.

10. A special effects rendering device, characterized in that, The device is located in a mobile terminal and includes: A download unit is used to select and download materials from a material library on the server side. The download unit is configured to: display a selection control corresponding to the materials in the material library on the server side; upload material identification information corresponding to the selection control to the server side in response to the triggering of the selection control; and download the material corresponding to the material identification information from the material library on the server side. The material library on the server side stores multiple materials with different levels of detail obtained by modeling the same object, and the level of detail of the materials downloaded from the server side matches the rendering performance of the mobile device. An adjustment unit is used to adjust the variable attributes of the material and preview the rendering effect of the material corresponding to the adjusted variable attributes in real time. The variable attributes include quantities represented by numbers or three-dimensional vectors, and the variable attributes include model visibility and model quantity. An upload unit is used to upload the adjusted variable attributes to the server, and the server renders the material according to the fixed attributes of the material and the received adjusted variable attributes. The fixed attributes include at least one of the following: material, animation, lighting, camera, and renderer settings. The display unit is used to display the rendering results sent by the server. Before downloading the material corresponding to the material identification information from the material library on the server, the display unit is further configured to: display the shooting interface according to the received first shooting instruction; after downloading the material corresponding to the material identification information from the material library on the server, the display unit is further configured to: display the material corresponding to the material identification information in real time on the shooting interface, so as to preview the rendering effect of the material corresponding to the material identification information in real time; After displaying the shooting interface according to the received first shooting instruction, the display unit is further configured to: shoot video or pictures according to the received second shooting instruction to obtain multimedia files; The upload unit is configured to send a rendering request to the server, which carries the adjusted variable attributes, the material identification information, and the multimedia file. The server obtains the fixed attributes corresponding to the material identification information according to the rendering request, and performs composite rendering of the material corresponding to the material identification information and the multimedia file on the server according to the fixed attributes and the adjusted variable attributes.

11. A special effects rendering device, characterized in that, The device is located in the server and includes: The first distribution unit is used to distribute materials to the mobile terminal so that the mobile terminal can adjust the variable attributes of the materials and preview the rendering effect of the materials corresponding to the adjusted variable attributes in real time. The mobile terminal selects and downloads materials from the server's material library in the following ways: displaying a selection control corresponding to the materials in the server's material library; responding to a trigger on the selection control and uploading the material identification information corresponding to the selection control to the server; downloading the material corresponding to the material identification information from the server's material library; the server's material library stores multiple materials of different levels of detail obtained from modeling the same object, and the level of detail of the materials downloaded from the server matches the rendering performance of the mobile terminal; the variable attributes... The variable attributes include quantities represented by numbers or three-dimensional vectors, such as model visibility and the number of models. Before downloading the material corresponding to the material identification information from the server's material library, the mobile terminal further performs the following: displaying a shooting interface according to the received first shooting instruction; after downloading the material corresponding to the material identification information from the server's material library, the mobile terminal further performs the following: displaying the material corresponding to the material identification information in real time on the shooting interface to preview the rendering effect of the material corresponding to the material identification information in real time; after displaying the shooting interface according to the received first shooting instruction, the mobile terminal further performs the following: shooting video or images according to the received second shooting instruction to obtain multimedia files. A receiving unit is configured to receive a rendering request from the mobile terminal carrying adjusted variable attributes, the material identification information, and the multimedia file, and to obtain the fixed attributes corresponding to the material identification information according to the rendering request, and to perform composite rendering of the material corresponding to the material identification information and the multimedia file on the server according to the fixed attributes and the adjusted variable attributes. The fixed attributes include at least one of the following: material, animation, lighting, camera, and renderer settings. The second sending unit is used to send the rendering result to the mobile terminal so as to display the rendering result on the mobile terminal.

12. A computer-readable medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the special effects rendering method as described in any one of claims 1 to 9.

13. An electronic device, characterized in that, include: One or more processors; A storage device for storing one or more programs, which, when executed by one or more processors, cause the one or more processors to implement the special effects rendering method as described in any one of claims 1 to 9.

Images