Device rendering method, system and apparatus
Patent Information
- Application Number
- CN202611228859.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2026-08-13
- Publication Date
- 2026-10-27
AI Technical Summary
[0009]根据本说明书实施例的第六方面,提供了一种计算机程序产品,包括计算机程序或指令,该计算机程序或指令被处理器执行时实现上述设备渲染方法的步骤。
Smart Images

Figure CN122985165A_ABST
Abstract
Description
Technical Field
[0001] The embodiments in this specification relate to the field of image rendering technology, and in particular to device rendering methods, systems and apparatus. Background Technology
[0002] In current multimedia content display applications, social and content platforms generally employ preset fixed configurations or static rendering strategies based solely on device models. These methods fail to effectively integrate dynamic state changes during device operation, including current device load levels, battery health, network connection quality, and real-time differences in user interaction scenarios. In practice, low-end devices often experience interface stuttering, unstable frame rates, or even unexpected application termination due to their inability to handle high-load rendering tasks; high-end devices may also suffer from performance degradation due to background process resource contention or increased hardware temperature causing performance throttling. Existing technical solutions lack the ability to perform real-time fusion analysis of multi-dimensional state information locally on the client side, cannot dynamically adjust rendering strategies according to changes in the device's operating environment, and struggle to achieve a smooth transition during rendering quality degradation or upgrades. In practical implementation, available device resources fluctuate significantly at different operating times, and various business scenarios have different priorities for rendering effects. Users expect both smooth presentation of high-quality animations and the safe and stable operation of device resources. Therefore, an effective solution is urgently needed to address these issues. Summary of the Invention
[0003] In view of this, embodiments of this specification provide a device rendering method. One or more embodiments of this specification also relate to a device rendering system, a device rendering apparatus, a computing device, a computer-readable storage medium, and a computer program product, to address the technical deficiencies existing in the prior art.
[0004] According to a first aspect of the embodiments of this specification, a device rendering method is provided, applied to a terminal device, comprising: In response to a rendering request for multimedia resources, the rendering status information of the terminal device in multiple device rendering dimensions is obtained; A rendering decision matrix is constructed based on the rendering state information corresponding to the multiple device rendering dimensions, and the rendering decision matrix is processed according to preset decision rules to obtain structured instruction information. The preset rendering mapping table is queried according to the structured instruction information to obtain the set of rendering parameters corresponding to the current state of the terminal device; The target rendering strategy is determined based on the structured instruction information and the set of rendering parameters, and the rendering engine is driven to execute the multimedia rendering task corresponding to the multimedia resource based on the target rendering strategy.
[0005] According to a second aspect of the embodiments of this specification, a device rendering system is provided, including a terminal device and a server, comprising: The terminal device is used to send a resource loading request to the server in response to a rendering request triggered in a multimedia browsing page. The server is configured to retrieve multimedia resources from the resource library according to the resource loading request, and send the multimedia resources to the terminal device. The terminal device is configured to receive the multimedia resources and obtain rendering status information of the terminal device in multiple device rendering dimensions; construct a rendering decision matrix based on the rendering status information corresponding to the multiple device rendering dimensions, and process the rendering decision matrix according to preset decision rules to obtain structured instruction information; query a preset rendering mapping table based on the structured instruction information to obtain a set of rendering parameters corresponding to the current state of the terminal device; determine a target rendering strategy based on the structured instruction information and the set of rendering parameters, and drive the rendering engine to execute the multimedia rendering task corresponding to the multimedia resources based on the target rendering strategy, and display the multimedia content on the multimedia browsing page according to the task execution result.
[0006] According to a third aspect of the embodiments of this specification, a device rendering apparatus is provided, applied to a terminal device, comprising: The acquisition module is configured to acquire rendering status information of the terminal device in multiple device rendering dimensions in response to rendering requests of multimedia resources. The processing module is configured to construct a rendering decision matrix based on the rendering state information corresponding to the multiple device rendering dimensions, and process the rendering decision matrix according to preset decision rules to obtain structured instruction information. The query module is configured to query a preset rendering mapping table based on the structured instruction information to obtain the set of rendering parameters corresponding to the current state of the terminal device. The rendering module is configured to determine a target rendering strategy based on the structured instruction information and the set of rendering parameters, and drive the rendering engine to execute the multimedia rendering task corresponding to the multimedia resource based on the target rendering strategy.
[0007] According to a fourth aspect of the embodiments of this specification, a computing device is provided, comprising: Memory and processor; The memory is used to store computer-executable instructions, and the processor is used to execute the computer-executable instructions, which, when executed by the processor, implement the steps of the above-described device rendering method.
[0008] According to a fifth aspect of the embodiments of this specification, a computer-readable storage medium is provided that stores computer-executable instructions that, when executed by a processor, implement the steps of the device rendering method described above.
[0009] According to a sixth aspect of the embodiments of this specification, a computer program product is provided, including a computer program or instructions that, when executed by a processor, implement the steps of the device rendering method described above.
[0010] The device rendering method provided in this embodiment, in order to maintain device operational stability while ensuring rendering quality, can respond to rendering requests from multimedia resources and obtain rendering status information of the terminal device in multiple device rendering dimensions. Then, a rendering decision matrix is constructed based on the rendering status information corresponding to each of the multiple device rendering dimensions, and the rendering decision matrix is processed according to preset decision rules to obtain structured instruction information. Subsequently, a preset rendering mapping table can be queried based on the structured instruction information to obtain the set of rendering parameters corresponding to the current state of the terminal device. Then, a target rendering strategy is determined based on the structured instruction information and the set of rendering parameters. Finally, the rendering engine is driven to execute the multimedia rendering task corresponding to the multimedia resources based on the target rendering strategy. This method achieves adaptive rendering control by integrating the multi-dimensional dynamic states of the terminal to solve the problem that existing static rendering strategies cannot adapt to dynamic changes in device operation, balancing rendering quality and device operational stability, and effectively avoiding problems such as stuttering, unstable frame rates, or even abnormal application termination during rendering. Attached Figure Description
[0011] Figure 1 This is a flowchart illustrating a device rendering method provided in one embodiment of this specification; Figure 2a This is a schematic diagram of the rendering process in a device rendering method provided in one embodiment of this specification; Figure 2b This is a schematic diagram illustrating strategy optimization in a device rendering method provided in one embodiment of this specification; Figure 3 This is a timing flowchart of a device rendering method provided in one embodiment of this specification; Figure 4 This is a schematic diagram of the structure of a device rendering system provided in one embodiment of this specification; Figure 5 This is a schematic diagram of the structure of a device rendering apparatus provided in one embodiment of this specification; Figure 6 This is a structural block diagram of a computing device provided in one embodiment of this specification. Detailed Implementation
[0012] Many specific details are set forth in the following description to provide a full understanding of this specification. However, this specification can be implemented in many other ways than those described herein, and those skilled in the art can make similar extensions without departing from the spirit of this specification. Therefore, this specification is not limited to the specific implementations disclosed below.
[0013] The terminology used in one or more embodiments of this specification is for the purpose of describing particular embodiments only and is not intended to be limiting of the one or more embodiments of this specification. The singular forms “a,” “described,” and “the” as used in one or more embodiments of this specification and the appended claims are also intended to include the plural forms unless the context clearly indicates otherwise. It should also be understood that the term “and / or” as used in one or more embodiments of this specification refers to and includes any or all possible combinations of one or more associated listed items.
[0014] It should be understood that although the terms first, second, etc., may be used to describe various information in one or more embodiments of this specification, such information should not be limited to these terms. These terms are only used to distinguish information of the same type from one another. For example, first may also be referred to as second without departing from the scope of one or more embodiments of this specification, and similarly, second may also be referred to as first. Depending on the context, the word "if" as used herein may be interpreted as "when," "when," or "in response to a determination."
[0015] Furthermore, it should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in one or more embodiments of this specification are all information and data authorized by the user or fully authorized by all parties. Moreover, the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions, and corresponding operation entry points are provided for users to choose to authorize or refuse.
[0016] This specification provides a device rendering method. One or more embodiments of this specification also relate to a device rendering system, a device rendering apparatus, a computing device, a computer-readable storage medium, and a computer program product, which will be described in detail in the following embodiments.
[0017] See Figure 1 , Figure 1A flowchart of a device rendering method according to an embodiment of this specification is shown. The method is applied to a terminal device and specifically includes the following steps.
[0018] Step S102: In response to the rendering request of multimedia resources, obtain the rendering status information of the terminal device in multiple device rendering dimensions.
[0019] Step S104: Construct a rendering decision matrix based on the rendering state information corresponding to the multiple device rendering dimensions, and process the rendering decision matrix according to preset decision rules to obtain structured instruction information.
[0020] Step S106: Query the preset rendering mapping table according to the structured instruction information to obtain the set of rendering parameters corresponding to the current state of the terminal device.
[0021] Step S108: Determine the target rendering strategy based on the structured instruction information and the rendering parameter set, and drive the rendering engine to execute the multimedia rendering task corresponding to the multimedia resource based on the target rendering strategy.
[0022] The device rendering method provided in this embodiment can be applied to any terminal device with rendering needs, such as mobile phones, computers, and smart wearable devices. When rendering multimedia resources, it can dynamically adjust the rendering strategy based on multi-dimensional information such as the operating status and resource status of the terminal device, so as to ensure the quality of the rendered picture while taking into account the device capabilities, thereby improving the user experience.
[0023] Specifically, terminal devices refer to various electronic devices with computing and display capabilities, capable of performing multimedia content rendering tasks, such as smartphones, tablets, personal computers, and smart TVs. Multimedia resources refer to data content in various forms, including images, videos, audio, and animations, which need to be presented on terminal devices through a rendering process. A rendering request is an instruction issued by the terminal device or its running application to the rendering system, requesting rendering processing of specific multimedia resources. Device rendering dimensions refer to multiple considerations affecting the rendering performance and resource consumption of terminal devices, such as scene dimensions, device dimensions, runtime dimensions, and resource dimensions. These dimensions collectively reflect the overall rendering capabilities and current load of the terminal device. Rendering status information refers to the specific status data of the terminal device under a specific device rendering dimension, such as CPU utilization, memory usage, GPU load, network bandwidth, battery level, current application priority, and screen resolution.
[0024] Correspondingly, the rendering decision matrix refers to a data structure formed by integrating and quantifying rendering state information obtained from multiple device rendering dimensions. It is used to comprehensively evaluate the overall rendering capabilities and environment of the terminal device. Decision rules refer to a series of pre-defined logical judgment conditions and processing flows, used to analyze the rendering decision matrix to generate structured instruction information to guide the rendering process. Structured instruction information refers to instruction data with a clear format and semantics extracted from the rendering decision matrix after processing by the decision rules. It is used to indicate the rendering level, engine selection, or parameter adjustment direction that the rendering system should adopt. The rendering mapping table is a data table pre-stored on the terminal device or accessible storage, recording the correspondence between different rendering levels, different device states, or different structured instruction information and specific sets of rendering parameters.
[0025] Correspondingly, the rendering parameter set refers to a specific set of parameters used to guide the rendering engine in executing multimedia rendering tasks. These parameters include frame rate, resolution, texture quality, anti-aliasing level, effects on / off, and particle-related parameters (particle image quality, quantity, etc.). These parameters collectively determine the rendering effect and resource consumption. The target rendering strategy refers to the specific execution plan for the current multimedia rendering task, determined comprehensively based on structured instruction information and the rendering parameter set. It includes the selection of the rendering engine, the rendering level, and detailed rendering parameter configurations. The rendering engine refers to the software module or hardware acceleration unit in the terminal device responsible for parsing multimedia resource data, performing graphics and image processing, and ultimately presenting the content to the screen. A multimedia rendering task refers to the entire process by which the rendering engine decodes, processes, and displays specific multimedia resources according to the target rendering strategy.
[0026] Based on this, firstly, in response to rendering requests for multimedia resources, the terminal device acquires its rendering status information across multiple device rendering dimensions. As one implementation, the terminal device can be configured to query the operating system for current CPU usage and available memory upon receiving a rendering request, and use this data as rendering status information. Alternatively, the terminal device can be configured to periodically sample its operating status, for example, recording it every few seconds, and retrieve the most recently sampled status information upon receiving a rendering request. Furthermore, the terminal device can be configured to set specific trigger points within the system. When a rendering request is triggered, these trigger points are activated to collect specific data points, such as current battery level, network connection status, or the priority of the foreground application; these data points collectively constitute the rendering status information.
[0027] Secondly, a rendering decision matrix is constructed based on the rendering state information corresponding to multiple device rendering dimensions. This matrix is then processed according to preset decision rules to obtain structured instruction information. Specifically, one implementation involves quantifying the acquired rendering state information, for example, mapping CPU utilization and available memory to numerical scores, and arranging these scores into a one-dimensional array or table to form a basic rendering decision matrix. Preset decision rules can sum these scores, and when the sum exceeds a specific threshold, an instruction such as "high-performance mode" is generated. Another implementation involves categorizing the collected state information into "low," "medium," and "high" categories, such as "medium" CPU state and "high" memory state. These categories are then filled into the decision matrix. Preset decision rules can be a series of "if-then" statements, such as "if CPU state is low and memory state is low, then generate a 'reduce quality' instruction." Furthermore, specific numerical ranges can be defined for each state parameter; for example, CPU utilization of 0-30% is "idle," 30-70% is "normal," and above 70% is "high load." These categorized state information are populated into the matrix from different dimensions. Decision rules may involve finding specific combinations in the matrix; for example, when the CPU is under "high load" and the battery is "low," the output instruction information is determined to "prioritize power saving."
[0028] Next, the system queries a pre-defined rendering map table based on the structured instruction information to obtain the set of rendering parameters corresponding to the current state of the terminal device. Specifically, one implementation involves using the structured instruction information as a lookup key in a pre-defined base lookup table. For example, when the structured instruction is "low quality," the system retrieves a fixed set of parameters associated with "low quality" from the base lookup table, which includes parameters such as "frame rate: 15, resolution: 720p, texture quality: low." Another implementation involves the structured instruction information containing an identifier, such as a numerical code, which is used to search the map table. Each code directly corresponds to a specific set of rendering parameters. Furthermore, the structured instruction information can indicate a "level," such as "level 3," which is used to access the portion of the rendering map table containing the parameter set for that level and retrieve the default parameter set for "level 3."
[0029] Finally, the target rendering strategy is determined based on the structured instruction information and the set of rendering parameters, and the rendering engine is driven to execute the multimedia rendering task corresponding to the multimedia resources based on the target rendering strategy. Specifically, one implementation involves directly combining the structured instruction information and the set of rendering parameters. For example, when the structured instruction indicates "use the default engine" and the parameter set specifies "frame rate 30, resolution 1080p," the target rendering strategy is formed by directly concatenating this information. This strategy is then passed to the rendering engine, which is pre-programmed to interpret such combined instructions and execute the multimedia rendering task. As another implementation, the structured instruction information can provide "hints" about the desired rendering behavior, such as "prioritize smoothness," while the rendering parameter set provides specific values. The system then combines the two using basic rules; for example, if the hint is "prioritize smoothness" and the parameter set includes a frame rate, the target strategy can explicitly set the engine to maintain that frame rate and adjust other parameters as necessary. Furthermore, the structured instruction information can specify the "type" of the rendering strategy, such as "performance-oriented," while the rendering parameter set provides specific details of that type. The system then constructs a strategy object or data structure that encapsulates the type and parameters. The strategy object is passed to the rendering engine, which is designed to parse and implement the instructions contained in the object to render multimedia resources.
[0030] In summary, by dynamically acquiring rendering status information of the terminal device across multiple device rendering dimensions, and constructing a rendering decision matrix to obtain structured instruction information, this method queries the rendering mapping table and determines the target rendering strategy, thereby driving the rendering engine to execute multimedia rendering tasks. This method overcomes the limitations of traditional static rendering strategies, achieving dynamic perception and comprehensive consideration of the terminal device's runtime state. This can prevent stuttering or crashes on low-end devices due to excessive rendering load, while also mitigating the experience degradation on high-end devices caused by runtime resource fluctuations. By adaptively adjusting the rendering strategy, this embodiment effectively balances the smooth experience of high-quality animations with the need for safe operation of device resources. Furthermore, the collected rendering state information is prone to missing key states that affect the rendering effect, and it does not assign corresponding decision weights to different dimensions, making it impossible to distinguish the degree of influence of different dimensions on the rendering decision. This leads to the constructed rendering decision matrix failing to accurately reflect the actual rendering needs and available capabilities of the terminal, resulting in an inappropriate rendering strategy and causing rendering stuttering or poor rendering effects. To address this, in this embodiment, the step of obtaining the rendering state information of the terminal device in multiple device rendering dimensions in response to a rendering request for multimedia resources includes: In response to a rendering request for multimedia resources, the system acquires scene status information (scene dimension), device status information (device dimension), runtime status information (running dimension), and resource status information (resource dimension) corresponding to the terminal device. The scene status information, device status information, runtime status information, and resource status information are then used as the rendering status information. The step of constructing a rendering decision matrix based on the rendering status information corresponding to the multiple device rendering dimensions includes: acquiring decision weight information corresponding to the scene dimension, device dimension, runtime dimension, and resource dimension, and constructing a rendering decision matrix based on the decision weight information and the resource status information.
[0031] Specifically, in response to rendering requests from multimedia resources, the system acquires scene status information at the scene level, device status information at the device level, runtime status information at the runtime level, and resource status information at the resource level for the terminal device. This aims to comprehensively and meticulously collect state data from the terminal device at different levels, serving as the basis for subsequent rendering decisions. By subdividing rendering state information into scene, device, runtime, and resource dimensions, key factors affecting rendering effects can be captured more accurately, avoiding information omissions.
[0032] The "scene dimension" refers to the business scenario or user interaction context in which the multimedia content is currently situated. For example, when a user is browsing social media feeds, the scene dimension is indicated as "news feed browsing"; when a user is watching a short video, the scene dimension is indicated as "video playback." This scene information can be proactively reported by the application or determined by the operating system based on currently active applications and user behavior. It can be understood that the scene state information associated with the scene dimension is a characteristic indicator related to scene-specific effects and user interaction frequency, its purpose being to define experience goals and priorities.
[0033] Device dimension refers to the hardware configuration and basic capabilities of the terminal device itself, such as the device's CPU model, GPU model, memory size, screen resolution, and operating system version. This information is acquired and stored during device initialization or queried through system APIs. It can be understood that device-level related device status information are characteristic indicators describing the terminal device model, system version, and architecture, used to define security boundaries and capabilities.
[0034] Operational dimensions refer to the overall operating load and system status of a terminal device, such as CPU utilization, memory usage, battery level, device temperature, and network connectivity. This information can be obtained in real time through the performance monitoring interface provided by the operating system. In essence, operational dimensions correspond to operational status information that reflects the device's real-time memory level, load, temperature, and other relevant metrics.
[0035] Resource dimensions refer to the real-time resource status currently available for rendering tasks, such as GPU real-time utilization, available video memory size, rendering queue length, and current frame rate. This information can be queried through graphics APIs or driver interfaces. Essentially, resource status information corresponding to resource dimensions reflects features such as resource download progress, integrity verification results, local cache hit rate, and the current time interval, which can be used to control triggering timing and fallback paths.
[0036] Accordingly, the scene state information, device state information, running state information, and resource state information are used as the rendering state information. This step aims to integrate the scattered state data collected from different dimensions into a unified and comprehensive set of rendering state information. This integration simplifies the subsequent processing flow and provides a structured input for constructing the rendering decision matrix.
[0037] For example, this state information from different dimensions can be encapsulated into a data structure, such as a JSON object, a struct, or a hash table, where each dimension serves as the key and the corresponding state data as the value. Alternatively, this state information can be concatenated into a vector or array in a predetermined order for subsequent processing by the algorithm model.
[0038] Accordingly, decision weight information corresponding to the scene dimension, device dimension, operation dimension, and resource dimension is obtained respectively. A rendering decision matrix is constructed based on the decision weight information and the resource status information. This step aims to assign different levels of importance to the status information of different dimensions to more accurately reflect their influence on rendering decisions. By introducing decision weights, all dimensions are avoided from being treated equally, thus enabling the rendering decision matrix to more precisely capture the actual rendering needs and capabilities of the terminal device. Decision weight information can be pre-configured locally on the terminal device, for example, stored in a configuration file, or hard-coded into the application logic. These weights can also be dynamically adjusted, for example, by training and updating a machine learning model based on historical rendering performance and user feedback, or by being issued by the server.
[0039] For example, on low-end devices, resource dimensions are given higher weight to prioritize smoothness; while on high-end devices, scene dimensions are given higher weight to prioritize visual effects. There are several ways to construct the rendering decision matrix. One approach is to sum the state information of each dimension with its corresponding decision weight to form a comprehensive score, which can then be used as an element of the matrix. For example, a linear weighted model can be used: Decision matrix element = Σ (Dimension state value * Dimension weight). Another approach is to take the state information and weights of each dimension as input, process them through models such as decision trees, rule engines, or neural networks, and output a multi-dimensional decision matrix, where each element represents the decision tendency under a specific combination of states.
[0040] Based on this, see Figure 2a The diagram illustrates how the relevant states affecting rendering are first divided into four independent yet complementary dimensions. These dimensions cover all key rendering-related information, from business scenarios to the hardware itself, from current operation to available resources, preventing the omission of crucial information during state collection. The scenario dimension corresponds to different rendering level requirements in different business scenarios; the device dimension corresponds to the terminal's basic hardware rendering capabilities; the operation dimension corresponds to the terminal's current overall operating load; and the resource dimension corresponds to the real-time resources available for rendering. These four dimensions complement each other, ensuring that the collected information fully reflects the terminal's current rendering-related state. Next, the state information collected from the four dimensions is integrated as rendering state information. This step directly and clearly integrates multi-dimensional state data, simplifying subsequent processing and facilitating the next matrix construction operation on the integrated state data. In the step of constructing the rendering decision matrix, the decision weight information corresponding to each of the four dimensions is first obtained. This step sets corresponding weights based on the different degrees of influence of different dimensions on rendering decisions, distinguishing the influence of different dimensions and avoiding confusion in the decision-making process. For example, dimensions with a greater impact on rendering effects and load can be assigned higher weights, making the decisions more aligned with actual needs. Finally, a rendering decision matrix is constructed by combining decision weight information and state information. This step combines weights of different dimensions and state information of each dimension to construct the matrix, so that the constructed matrix can accurately reflect the degree of influence of different states on rendering, accurately reflect the actual rendering capabilities and rendering needs of the terminal, solve the problem of unclear dimension division and missing weights in the original scheme, which leads to inaccurate decision-making, and provide an accurate and reliable data foundation for determining the appropriate target rendering strategy.
[0041] Furthermore, when determining the parameter set, if the specific implementation method for querying the rendering mapping table is not clearly defined, nor is the specific information in the structured instructions used to determine the target rendering strategy, it is impossible to quickly and accurately match the rendering parameters corresponding to the current state of the terminal, nor can it clearly and accurately combine existing information to determine the target rendering strategy adapted to the current state. This easily leads to matching errors and low query efficiency, making it difficult to meet the actual needs of dynamic adaptive rendering. Therefore, in this embodiment, the step of querying a preset rendering mapping table based on the structured instruction information to obtain the rendering parameter set corresponding to the current state of the terminal device includes: The parameter index handle is extracted from the structured instruction information, and a preset rendering mapping table is queried based on the parameter index handle to obtain the rendering parameter set corresponding to the current state of the terminal device; wherein, the rendering mapping table records the correspondence between parameter index handles and parameter sets for different rendering levels; wherein, the step of determining the target rendering strategy based on the structured instruction information and the rendering parameter set includes: extracting engine selection information and rendering level information from the structured instruction information, and determining the target rendering strategy based on the engine selection information, the rendering level information and the rendering parameter set.
[0042] Specifically, parameter index handles are extracted from the structured instruction information. These handles are identifiers or references used for quickly locating and retrieving sets of rendering parameters. They are not actual parameter values, but rather keys pointing to the storage location or logical grouping of the rendering parameter set within the rendering map table. The introduction of these handles aims to improve query efficiency and accuracy. For example, a parameter index handle could be a hash value, obtained by hashing specific rendering dimension state information, directly mapping to an entry in the rendering map table; or, it could be a composite string encoded from multiple key state features (such as device model, current load range, and scene type), serving as the query key for the rendering map table.
[0043] Correspondingly, the rendering mapping table records the correspondence between parameter index handles and parameter sets for different rendering levels. This rendering mapping table is a data structure whose core function is to store the mapping relationship between parameter index handles and specific rendering parameter sets at different rendering levels, thereby providing a structured query mechanism and supporting hierarchical rendering. For example, the rendering mapping table can be a multi-level nested hash table or dictionary, where the first-level key is the rendering level, the second-level key is the parameter index handle, and the corresponding value is the specific parameter set; alternatively, the rendering mapping table can be a relational database table containing fields such as "rendering level," "parameter index handle," and "parameter set," and using indexes to optimize query performance.
[0044] Correspondingly, engine selection information is extracted from the structured instruction information. This engine selection information indicates which rendering engine should be used to perform the multimedia rendering task. Its purpose is to ensure that the rendering engine best suited to the current task and device state is selected. For example, the engine selection information can be an enumeration value, such as "OpenGL ES engine", "Vulkan engine", "Metal engine", or "custom software rendering engine"; or it can be a string identifier corresponding to the name of a rendering engine registered in the system.
[0045] Correspondingly, rendering level information is extracted from the structured instruction information. This rendering level information indicates the quality or performance level at which the multimedia rendering task should be performed. Its purpose is to achieve tiered rendering to balance performance and visual effects. For example, the rendering level information can be an integer value, such as 1 (highest quality), 2 (medium quality), 3 (lowest quality); or it can be a predefined string, such as "high quality", "balanced", "performance priority".
[0046] Based on this, by extracting parameter index handles from structured instruction information and querying the preset rendering mapping table based on these handles, rapid and accurate location of the rendering parameter set can be achieved. The rendering mapping table, by recording the correspondence between parameter index handles and parameter sets for different rendering levels, further improves the accuracy and efficiency of the query and provides clear structured support for hierarchical adaptive rendering. Simultaneously, by extracting engine selection and rendering level information from the structured instruction information and combining it with the obtained rendering parameter set, the target rendering strategy can be determined in a targeted manner, ensuring that the selected strategy conforms to both the current state decision of the terminal device and meets the preset parameter specifications. This effectively solves the problems of inaccurate queries, low efficiency, and lack of clear information basis for rendering strategy determination in traditional solutions, improving the adaptability, accuracy, and response speed of device rendering, thereby providing users with a smoother and more stable multimedia experience. Furthermore, multimedia rendering tasks often require a considerable amount of time to execute. The terminal's running state and resource state change dynamically during the rendering task execution. Adhering to the initially determined target rendering strategy cannot adapt to the real-time changes in the terminal's state. Maintaining the original high-load rendering strategy when terminal resources are insufficient during execution can easily lead to stuttering or even crashes. Conversely, maintaining the original low-load rendering strategy when terminal resources are restored will not achieve better rendering results. It is impossible to dynamically adapt to changes in terminal state during the rendering task execution to balance rendering quality and operational stability. Therefore, in this embodiment, after the step of driving the rendering engine to execute the multimedia rendering task corresponding to the multimedia resource based on the target rendering strategy is completed, the method further includes: When the multimedia rendering task is in execution, real-time running status information and real-time resource status information of the terminal device are collected; if the multimedia rendering task meets the rendering optimization conditions based on the real-time running status information and the real-time resource status information, a set of candidate rendering parameters is read from the rendering mapping table; a candidate rendering strategy is determined based on the set of candidate rendering parameters, the real-time running status information and the real-time resource status information, and the rendering engine is driven to continue executing the multimedia rendering task according to the candidate rendering strategy.
[0047] Specifically, while the multimedia rendering task is in execution, real-time operating status information and real-time resource status information of the terminal device are collected. This aims to obtain the actual operating status and resource usage of the terminal device during the execution of the multimedia rendering task, providing accurate and timely data for subsequent dynamic strategy adjustments. For example, real-time operating status information such as CPU usage, GPU usage, memory usage, device temperature, battery level, and network bandwidth can be periodically obtained through operating system APIs, device driver interfaces, or specific monitoring modules. Simultaneously, real-time resource status information such as currently available graphics memory, texture memory, frame buffer size, and rendering pipeline load can be obtained by querying the system resource manager, rendering engine internal interfaces, or hardware sensors.
[0048] Accordingly, based on the real-time running status information and the real-time resource status information, if the multimedia rendering task meets the rendering optimization conditions, the aim is to set conditions to trigger rendering strategy adjustments, avoiding unnecessary frequent adjustments and ensuring system stability. For example, a series of thresholds or rules can be preset: when CPU utilization exceeds X% for N consecutive seconds and GPU utilization exceeds Y% for N consecutive seconds, or when available memory is below Z MB, it is determined that the downgrade optimization conditions are met; when CPU utilization is below X'% for N consecutive seconds and GPU utilization is below Y'% for N consecutive seconds, or when available memory is above Z' MB, it is determined that the upgrade optimization conditions are met. Alternatively, a machine learning model can be used to train a classifier based on historical data, taking real-time running status information and real-time resource status information as input, and outputting whether the rendering optimization conditions are met (e.g., downgrade required, upgrade required, remain unchanged).
[0049] Accordingly, the candidate rendering parameter set is read from the rendering mapping table to quickly obtain a preset set of parameters that can be used to adjust the rendering strategy, thereby improving response speed. The rendering mapping table can be a lookup table stored in a local file system, database, or memory, containing sets of rendering parameters corresponding to different rendering levels (e.g., high, medium, low) or different optimization scenarios (e.g., power-saving mode, performance mode). The corresponding parameter set can be directly queried using an index (e.g., derived from structured instruction information or the current rendering level). The rendering mapping table can also be a dynamically generated configuration set, generating a series of candidate parameter sets at startup or during the first query based on the hardware capabilities of the current terminal device and the preset rendering quality level, and storing them for subsequent rapid retrieval.
[0050] Accordingly, a candidate rendering strategy is determined based on the candidate rendering parameter set, the real-time running status information, and the real-time resource status information. This aims to generate a new rendering strategy best suited to the current terminal condition by combining preset candidate parameters with the current real-time status. For example, based on the real-time running status information and real-time resource status information, the most matching set of parameters can be selected from the candidate rendering parameter set, and combined with preset rendering level, engine selection, and other information to form a candidate rendering strategy. If the real-time status indicates resource scarcity, the parameters corresponding to the lower rendering level in the candidate parameter set are selected. Alternatively, a decision logic module can be used to input the candidate rendering parameter set, real-time running status information, and real-time resource status information. Based on preset priority and weight rules, certain parameters in the candidate parameter set (such as resolution, frame rate, texture quality, etc.) can be dynamically adjusted, and combined with the rendering engine type, to generate the final candidate rendering strategy.
[0051] Accordingly, the rendering engine continues to execute the multimedia rendering task based on the candidate rendering strategies, aiming to apply the newly determined rendering strategy to the rendering engine and achieve dynamic adjustment of the multimedia rendering task. The rendering engine provides APIs or interfaces that allow dynamic modification of rendering parameters (such as resolution, frame rate, texture filtering mode, shader complexity, etc.) at runtime. By calling these interfaces, the parameters in the candidate rendering strategies are applied to the rendering engine. The rendering engine can also support a strategy hot-switching mechanism, that is, loading and activating a new rendering configuration file or parameter set without interrupting the rendering task, thereby smoothly switching to a new rendering strategy.
[0052] Based on this, the above processing continuously collects real-time operating status and resource status information of the terminal device during the execution of multimedia rendering tasks, enabling the system to dynamically perceive changes in the terminal's operating environment. When preset rendering optimization conditions are met, the system can quickly read the candidate rendering parameter set from the preset rendering mapping table and, combined with real-time operating status and resource status information, determine the most suitable candidate rendering strategy for the current terminal situation. Subsequently, the rendering engine will continue to execute the multimedia rendering task based on this candidate rendering strategy. This dynamic adaptive mechanism ensures that the rendering strategy can match the actual state of the terminal device in real time, thereby effectively avoiding stuttering or crashes caused by using high-load strategies when resources are insufficient, and simultaneously enabling timely switching to higher-quality rendering strategies when resources are sufficient, improving the user experience. This solution adds dynamic adjustment capabilities during the execution of rendering tasks without changing the initial rendering strategy determination process, achieving an excellent balance between rendering performance, visual quality, and system stability, and reducing real-time computational overhead by using preset parameter sets, ensuring rapid response and smooth switching of strategy adjustments.
[0053] In other words, such as Figure 2b The diagram illustrates that while the above process allows the engine to successfully start and proceed with subsequent rendering, the complex and ever-changing operating environment of terminal devices (such as sudden memory alarms, GPU overheating and throttling, and background applications consuming resources) means that a single rendering strategy cannot guarantee rendering quality and device performance. Therefore, to avoid this issue, a preset configuration baseline can be established during the motion effects rendering phase after engine startup. This baseline allows for real-time state adjustments. In other words, negative feedback indicates resource constraints, necessitating a lower rendering strategy; positive feedback indicates the device can maintain or enhance high-level effects, thus improving the user experience. This dynamic strategy adjustment ensures a good viewing experience for users with terminal devices.
[0054] In practice, relying solely on the current real-time status for judgment is susceptible to occasional, transient fluctuations in device status, which can erroneously trigger adjustments to the rendering strategy, leading to frequent switching of rendering levels. This not only affects the smoothness of the rendering experience but also fails to accurately match the device's current continuous operating state, making it difficult to achieve a balance between rendering quality and device operational stability. Therefore, in this embodiment, when it is determined that the multimedia rendering task meets the rendering optimization conditions based on the real-time operating status information and the real-time resource status information, the candidate rendering parameter set is read from the rendering mapping table, including: Based on the real-time running status information and the real-time resource status information, determine the running status change information and resource status change information of a set number of image frames corresponding to the multimedia rendering task; if the running status change information and / or resource status change information of the set number of image frames meet the rendering optimization conditions, read the candidate rendering parameter set from the rendering mapping table.
[0055] Specifically, a "set number of image frames" refers to a pre-defined set of consecutive image frames. This number can be a fixed integer value, such as 5 frames, 10 frames, or more, used to observe continuous changes in the device's state over a period of time. Furthermore, this number can be dynamically configured based on the type of multimedia resource (e.g., video streaming, animation, or interactive content) or the performance characteristics of the terminal device to adapt to different rendering scenarios and requirements. By observing consecutive image frames, misjudgments caused by instantaneous state fluctuations can be effectively avoided.
[0056] Correspondingly, "operational status change information" refers to the dynamic changes in the terminal device's operating status within the set number of image frames. For example, this may include fluctuations in the average frame rate (FPS) within the set number of image frames, compared to a preset baseline or the average value of the previous period; it may also include the average, peak, or standard deviation of CPU or GPU utilization within the set number of image frames to reflect its load trend; or it may include temperature changes in the terminal device within the set number of image frames or whether thermal throttling events have occurred. This information collectively reflects the continuous performance of the device.
[0057] Correspondingly, "resource status change information" refers to dynamic changes in the availability or usage of terminal device resources within the set number of image frames. For example, this may include memory usage data, such as average available memory and the frequency of memory pressure events; it may also include disk I / O or network bandwidth usage trends; and it may include changes in power consumption or battery level. This information can be used to assess the sustainability of device resource pressure.
[0058] Accordingly, "meeting rendering optimization conditions" refers to a set of preset judgment criteria or thresholds. When the runtime status changes and / or resource status changes of the set number of image frames meet these criteria, it indicates that adjusting the rendering strategy is necessary and beneficial. For example, when the average frame rate of the set number of image frames is consistently lower than a certain preset threshold (e.g., 25 FPS), degradation optimization is triggered; or when the average CPU / GPU utilization is consistently higher than a certain preset threshold (e.g., 90%), optimization can also be triggered. These conditions can be judged individually or in combination to ensure the accuracy and rationality of rendering optimization decisions.
[0059] Based on this, the above processing addresses the problem of erroneous adjustments easily triggered by relying solely on the current real-time state. By introducing a continuous multi-frame state statistical judgment method, the accuracy of rendering optimization trigger judgment is improved, effectively avoiding unnecessary frequent switching of rendering strategies and ensuring a stable and smooth rendering process. Specifically, this solution first determines the running state change information and resource state change information of a set number of image frames corresponding to the multimedia rendering task based on real-time running state information and real-time resource state information. This method does not simply use the instantaneous state at a single moment as the judgment basis, but uses the state changes of continuous multiple frames as the judgment basis, which can effectively filter out occasional instantaneous state fluctuations, making the judgment basis more closely aligned with the actual continuous running state of the device and avoiding interference from temporary abnormal fluctuations in the judgment results. On this basis, only when the running state change information and / or resource state change information of the set number of image frames meet the rendering optimization conditions is the candidate rendering parameter set read from the rendering mapping table. This supports triggering adjustments when either the running state or resource state meets the conditions, covering scenarios where rendering optimization needs are triggered by two different factors, ensuring that no actual situations requiring rendering strategy adjustments are missed. Meanwhile, the operation of reading candidate parameters will only be triggered if the conditions are met for multiple consecutive frames. The rendering strategy will not be adjusted rashly due to a single state change, which effectively avoids the problem of frequent rendering switching caused by accidental triggering. This makes the adjustment of the rendering strategy more in line with the actual continuous load requirements of the device, thereby better balancing the rendering quality and the smoothness and stability of the device operation. Based on this, there are no clear judgment rules and corresponding rendering strategy adjustment directions for scenarios where terminal resources are continuously insufficient and rendering degradation is required. This makes it impossible to accurately identify scenarios with continuously insufficient resources, nor can it provide suitable rendering degradation solutions. It cannot solve the rendering stuttering or even crashing problems caused by insufficient resources, and it is also prone to erroneous adjustments, unnecessarily reducing rendering quality, failing to balance the needs of rendering experience and the safe operation of device resources. Therefore, in this embodiment, when the resource status change information of the set number of image frames meets the rendering optimization conditions, the candidate rendering parameter set is read from the rendering mapping table, including: The resource status change information of the set number of image frames is compared with a preset resource degradation threshold; if the resource status change information of the set number of image frames is less than the resource degradation threshold, the step of reading the candidate rendering parameter set in the rendering mapping table is executed; wherein, the step of determining the candidate rendering strategy based on the candidate rendering parameter set, the real-time running status information and the real-time resource status information includes: determining a first candidate rendering strategy based on the candidate rendering parameter set, the real-time running status information and the real-time resource status information, wherein the rendering level of the first candidate rendering strategy is less than the target rendering strategy.
[0060] Specifically, the resource status change information of the set number of image frames refers to the dynamic change data of resource status (such as CPU utilization, GPU utilization, memory usage, bandwidth, etc.) collected by the system over several consecutive image frame cycles during the execution of the multimedia rendering task. This information can be obtained by performing difference calculations, trend analysis, or statistical averaging on resource snapshots of each image frame to reflect the fluctuation of resources over a period of time. For example, the percentage change in GPU utilization over N consecutive frames, or the change in memory free space over N consecutive frames, can be recorded. The preset resource degradation threshold refers to a set of critical values pre-set by the system to determine whether resources are continuously insufficient to support the current rendering level. These thresholds can be set empirically based on factors such as the hardware performance of the terminal device, operating system characteristics, the type of multimedia resources, and user experience requirements, or obtained through training a machine learning model. For example, a degradation can be triggered when the GPU utilization change is below -5% for 5 consecutive frames (indicating a continuous decline in resources), or when the memory free space is continuously below a certain absolute value.
[0061] Accordingly, the comparison of resource status change information of a set number of image frames with a preset resource degradation threshold aims to assess whether the resource status change trend of the terminal device over a period of time has reached a level requiring rendering degradation. The comparison can be implemented through frame-by-frame comparison, statistical tests (such as comparison of mean, variance, and threshold), or pattern matching. For example, the system can check whether the resource status change of each frame is lower than the corresponding degradation threshold, or calculate whether the average value of these changes is lower than the average degradation threshold. This conditional judgment mechanism, where the resource status change information of a set number of image frames is all less than the resource degradation threshold, ensures that subsequent rendering strategy adjustments are only triggered when the resource status of the terminal device continuously deteriorates over multiple consecutive image frames, and the degree of change is all less than the preset degradation threshold. This "all less than" judgment method effectively avoids misjudgments and unnecessary rendering degradation caused by instantaneous resource fluctuations, thereby improving the accuracy and stability of strategy adjustments.
[0062] Accordingly, the process of reading candidate rendering parameter sets from the rendering map table is described. The rendering map table records rendering parameter sets corresponding to different rendering levels (such as high, medium, and low). These parameter sets include specific rendering configurations such as resolution, frame rate, texture quality, and effect complexity. When the degradation conditions are met, the system retrieves and obtains a set of parameters suitable for the lower rendering level from the rendering map table based on the real-time status of the current terminal device and the preset degradation strategy. This set serves as the basis for generating subsequent candidate rendering strategies. The first candidate rendering strategy refers to an alternative rendering strategy generated by the system to reduce the rendering load when the terminal device's resources are continuously insufficient. This strategy is determined comprehensively based on the candidate rendering parameter set read from the rendering map table, combined with the current real-time running status information and real-time resource status information, through specific algorithms or rules (e.g., dynamically adjusting parameter weights according to resource scarcity). The rendering level of the first candidate rendering strategy is lower than that of the target rendering strategy. This characteristic clarifies that the core objective of the first candidate rendering strategy is to achieve rendering degradation. By reducing the rendering level, such as from high definition to standard definition, or from 60 frames to 30 frames, the computation and resource consumption of the rendering engine can be reduced, thereby alleviating the resource pressure on the terminal device, avoiding stuttering, delays or even application crashes caused by insufficient resources, and ensuring smooth playback of multimedia content.
[0063] Based on this, the above processing effectively solves the problem of existing solutions lacking clear judgment rules and adaptive degradation schemes for scenarios with persistently insufficient terminal resources. Specifically, by comparing the resource status change information of a set number of image frames with a preset resource degradation threshold, and requiring that subsequent operations be triggered only when the resource status change information of the set number of image frames is less than the resource degradation threshold, scenarios with persistently insufficient terminal device resources can be accurately identified, avoiding misjudgments caused by occasional resource fluctuations. This judgment mechanism based on the resource status of consecutive multiple frames makes the adjustment of rendering strategies more robust and reliable. Once persistent resource insufficiency is confirmed, the system reads the set of candidate rendering parameters from the rendering mapping table and determines the first candidate rendering strategy based on this set, real-time running status information, and real-time resource status information. The rendering level of the first candidate rendering strategy is explicitly set to be lower than the current target rendering strategy, thereby achieving effective rendering degradation. This degradation strategy can reduce the rendering load, alleviate the resource pressure on the terminal device, effectively avoid stuttering, delays, or crashes caused by insufficient resources in multimedia rendering tasks, and avoid unnecessary degradation of rendering quality, thus ensuring a smooth user experience while also taking into account the safe operation of device resources. Furthermore, only the rendering degradation processing when device resources are insufficient is considered, without taking into account the adaptation and adjustment when device resources recover from an insufficient state to a sufficient state. This makes it impossible to improve the rendering effect after resource recovery, making it difficult to balance the dual requirements of device operational stability and rendering quality, and failing to meet users' demands for a high-quality, smooth animation experience. Therefore, in this embodiment, when the resource state change information of the set number of image frames meets the rendering optimization conditions, the candidate rendering parameter set is read from the rendering mapping table, including: The resource status change information of the set number of image frames is compared with a preset resource recovery threshold; if the resource status change information of the set number of image frames is greater than the resource recovery threshold, the step of reading the candidate rendering parameter set in the rendering mapping table is executed; wherein, the step of determining the candidate rendering strategy based on the candidate rendering parameter set, the real-time running status information and the real-time resource status information includes: determining a second candidate rendering strategy based on the candidate rendering parameter set, the real-time running status information and the real-time resource status information, wherein the rendering level of the second candidate rendering strategy is less than or equal to the target rendering strategy and greater than the first candidate rendering strategy.
[0064] Specifically, the process includes comparing the resource status change information of the set number of image frames with a preset resource recovery threshold; and, if the resource status change information of the set number of image frames is greater than the resource recovery threshold, performing the step of reading the candidate rendering parameter set from the rendering mapping table. The resource status change information of the set number of image frames refers to the trend or magnitude of changes in available device resources (e.g., CPU, GPU, memory, etc.) within a consecutive specific number of image frames. For example, it can be obtained by calculating the difference between the average resource utilization of the most recent N frames and the average utilization of the previous N frames, or by tracking the minimum or maximum resource availability changes within N frames. This aggregation method provides a more stable indication of resource trends than instantaneous measurements, effectively avoiding misjudgments caused by short-term resource fluctuations. The preset resource recovery threshold is a pre-configured numerical limit; when the resource status change information exceeds this limit, it indicates that the device's resources have recovered from a strained state to a level sufficient to support higher rendering quality. For example, this threshold can be set as a percentage increase in available GPU memory, or a decrease in average frame rendering time below a certain value. Its function is to provide a clear and quantifiable judgment standard for upgrading rendering strategies, ensuring the effectiveness and sustainability of resource recovery. When the resource status change information of a predetermined number of image frames is greater than the resource recovery threshold, this condition requires that the resource status change information continuously exhibits a recovery trend and exceeds the preset threshold within a consecutive predetermined number of image frames. For example, the system can detect resource status changes frame by frame and ensure that the resource status change in each frame meets the recovery condition in several consecutive frames; or, the system can calculate the average resource status change of this predetermined number of image frames and require that the average value is higher than the threshold. This strict judgment mechanism aims to avoid frequent adjustments to the rendering strategy due to short-term resource fluctuations, thereby ensuring the smoothness of the rendering process and the consistency of the user experience.
[0065] Based on this, determining the candidate rendering strategy based on the candidate rendering parameter set, the real-time running status information, and the real-time resource status information specifically includes determining a second candidate rendering strategy based on the candidate rendering parameter set, the real-time running status information, and the real-time resource status information. The rendering level of the second candidate rendering strategy is less than or equal to the target rendering strategy, but greater than the first candidate rendering strategy. The second candidate rendering strategy is a set of optimized rendering parameters and engine configurations designed to provide better visual quality or performance than the current (downgraded) strategy when device resources recover. For example, it may include increasing texture resolution, re-enabling some advanced shader effects, or increasing the target frame rate. The limitation that the rendering level of the second candidate rendering strategy is less than or equal to the target rendering strategy, but greater than the first candidate rendering strategy, ensures that the improvement in rendering quality is gradual and safe. For example, if the initial target rendering strategy is the highest level (e.g., level 4), and the downgraded first candidate rendering strategy is a low-to-medium level (e.g., level 2), then the level of the second candidate rendering strategy can be selected between level 3 and level 4.
[0066] Based on this, corresponding dynamic adjustment rules for rendering strategies are supplemented for scenarios where device resources recover from a state of scarcity to a state of abundance, as described above. By comparing the resource status change information of a set number of image frames with a preset resource recovery threshold, and requiring multiple consecutive frames to meet the resource recovery condition before triggering adjustment, scenarios where device resources have recovered from a state of scarcity to a state of abundance can be accurately identified, avoiding accidental triggering of rendering strategy adjustments and ensuring the smoothness of the rendering process. Furthermore, a second candidate rendering strategy is determined by combining the current real-time device operation and resource status, ensuring that the new strategy adapts to the actual situation of the current device, making the adjusted rendering strategy more suitable for the device's carrying capacity. Simultaneously, the rendering level of the second candidate rendering strategy is limited to being less than or equal to the target rendering strategy, but greater than the first candidate rendering strategy. This allows for appropriate improvement in rendering effects after resource recovery, providing a better viewing experience for users, while ensuring that the improved rendering level does not exceed the actual carrying capacity of the current device, avoiding further stuttering and other issues. This enables the system to adapt and adjust the rendering level after the device's available resources are restored, balancing device operational stability and rendering output quality, effectively balancing the needs of rendering quality and device operational stability, thereby meeting users' demands for a high-quality, smooth animation experience. Besides the above processing, corresponding handling is only provided for cases that meet the resource degradation or resource recovery conditions, without covering scenarios where resource status changes are within a stable range. When the resource status does not require adjustment of the rendering strategy, the lack of corresponding processing logic means that blindly switching rendering strategies according to the original rules will increase unnecessary computational overhead, and may even cause abnormal fluctuations in the rendered image due to frequent switching of rendering strategies, affecting the user's viewing experience. It is impossible to maintain the existing stable rendering state in scenarios where rendering strategy adjustment is not required. Therefore, in this embodiment, the method further includes: when the resource status change information of the set number of image frames is within a preset resource stability range, using the rendering parameter set as the candidate rendering parameter set, and driving the rendering engine to continue executing the multimedia rendering task according to the target rendering strategy.
[0067] Specifically, the resource status change information of the set number of image frames refers to the fluctuations or trends in the resource status (e.g., CPU utilization, GPU utilization, memory usage, frame rate, etc.) of the terminal device within a set number of consecutive image frames (i.e., the set number of image frames) after the terminal device continuously collects its own real-time operating status information and real-time resource status information during the execution of the multimedia rendering task. Specifically, this can be obtained in the following ways: One way is for the terminal device to record the current resource data when rendering each frame or every preset number of frames, and then calculate the average rate of change, maximum fluctuation value, or trend of these data within the set number of image frames. For example, calculating the difference between the average resource usage of N consecutive frames and the average resource usage of the previous N frames. Another way is for the terminal device to define a series of resource status indicators, such as frame rate stability and rendering latency, and to count the number of times the frame rate is lower than a certain threshold or the duration of rendering latency exceeding a certain threshold in the most recent M frames, thereby forming a comprehensive resource status change information.
[0068] Correspondingly, the preset resource stability range is a predefined threshold or range used to determine whether the resource status of the terminal device is within a stable range. When the resource status change information of the set number of image frames falls within this range, it indicates that the current resource fluctuation is within an acceptable range, and no rendering strategy adjustment is required. Specifically, this range can be set in the following ways: One way is to set a fixed upper and lower limit for different resource indicators (such as CPU utilization changes, GPU utilization changes, frame rate fluctuations, etc.) through a large amount of experimental data and user experience feedback. For example, when the CPU utilization change is between -5% and +5%, and the frame rate fluctuation is within ±2 frames / second, the resource status is considered stable. These thresholds can be pre-configured according to device type, application scenario, etc. Another way is that, considering the differences in different application scenarios and device loads, the resource stability range can also be dynamically adjusted. For example, in game scenarios, the tolerance for frame rate fluctuations is lower, and the stability range will be narrower; while in video playback scenarios, the tolerance for resource utilization fluctuations is higher. This range can be calculated and adjusted in real time by a machine learning model based on historical data and the current business scenario.
[0069] Accordingly, the rendering parameter set refers to a set of configuration parameters used to guide the rendering engine in performing multimedia rendering tasks. These parameters collectively determine the rendering quality, performance, and effect. During the initial rendering phase, the rendering parameter set is obtained by querying a preset rendering map table based on structured instruction information, representing the rendering configuration corresponding to the current state of the terminal device. Specifically, the rendering parameter set can be a set of predefined configurations, such as a combination of parameters like texture resolution, anti-aliasing level, shadow quality, and particle effect quantity corresponding to "high-quality mode"; or another set of lower parameter combinations corresponding to "smooth mode." These sets are stored in the rendering map table and referenced through parameter index handles.
[0070] Accordingly, the candidate rendering parameter set refers to a group of alternative rendering parameters used to replace the current rendering parameter set when the rendering strategy is adjusted. In this embodiment, when the resource status change information is within a preset resource stability range, the candidate rendering parameter set is determined to be the same as the currently used rendering parameter set. Specifically, one implementation is that the system directly passes the memory address or reference of the currently used rendering parameter set to the subsequent processing module as a candidate rendering parameter set, without needing to copy data or re-query. Another implementation is that the system creates a new set with the exact same content as the current rendering parameter set and uses it as the candidate rendering parameter set.
[0071] Accordingly, the target rendering strategy is a comprehensive rendering execution scheme that combines the selection of the rendering engine, the rendering level, and a specific set of rendering parameters to guide the rendering engine in processing multimedia resources. During the initial rendering phase, the target rendering strategy is determined based on structured instruction information and the set of rendering parameters. Specifically, the target rendering strategy can be a strategy ID, which is bound to a specific rendering engine, rendering level, and set of rendering parameters. When the target rendering strategy is determined, the system loads the corresponding configuration based on this ID and drives the rendering engine.
[0072] Accordingly, driving the rendering engine to continue executing multimedia rendering tasks means instructing the rendering engine to continuously process multimedia resources, generate image frames, and display them according to predetermined rendering strategies and parameters. Specifically, one implementation involves the terminal device calling the API interface provided by the rendering engine to pass a set of rendering parameters and rendering instructions to the engine. The engine then performs vertex processing, rasterization, shading, and other operations based on these instructions, ultimately outputting the rendering result. Another implementation involves the rendering engine maintaining a state machine internally. When a new rendering strategy or parameter is received, the state machine performs corresponding state transitions and adjusts the behavior of its internal rendering pipeline according to the new state, thereby achieving continuous execution of the rendering task.
[0073] Based on this, the above processing effectively solves the problem of unnecessary strategy switching and performance overhead caused by not covering stable resource states during dynamic adjustment of rendering strategies. Specifically, when the resource state change information of a set number of image frames is within the preset stable resource range during the execution of a multimedia rendering task, it indicates that the current terminal's resource state has not experienced significant fluctuations requiring adjustment of the rendering level, and the originally used rendering parameters have adapted to the current terminal state. In this case, the original set of rendering parameters is directly used as the candidate set of rendering parameters, and the rendering engine continues to execute the multimedia rendering task according to the target rendering strategy. This avoids unnecessary rendering strategy switching, thereby eliminating visual anomalies such as screen jitter and stuttering caused by frequent strategy switching, ensuring the smoothness and continuity of the multimedia rendering process, and improving the user's viewing experience. At the same time, since there is no need to re-query the preset rendering mapping table to obtain a new set of candidate rendering parameters, this solution reduces the overhead of local computation and data reading, and improves system efficiency. This solution determines whether resource status changes fall within a preset stable resource range. It relies on resource status change information from a predetermined number of image frames already collected in the existing dynamic adjustment process to make this judgment. This eliminates the need to collect additional terminal status data, meeting the requirements of local real-time computing and without adding extra operational burden to the terminal. Therefore, it improves the mechanism for dynamically adjusting the rendering strategy, ensuring that while it can dynamically adjust the rendering level based on resource status, it can intelligently maintain the existing stable rendering state when resources are stable, reducing unnecessary performance overhead and providing a more stable and consistent user experience.
[0074] In other words, to prevent frequent strategy switching at threshold thresholds from degrading the user experience, a dual-threshold mechanism can be set. Strategy switching is only triggered when multiple consecutive frames exceed the threshold, thus ensuring a good user experience. When the terminal device is in high-performance mode (corresponding to the target rendering strategy) or conservative performance mode (corresponding to the non-target rendering strategy), the specific performance under different modes can be dynamically monitored. For example, when available resources (such as memory) fall below a set threshold, it can be determined that a degradation threshold (T) has been met. down At this point, the framework determines that there is a high risk, and therefore can enter conservative mode; for example, in conservative mode, it determines that the current resources have recovered and exceeded the recovery threshold (T). up If the condition is met, the system is considered safe and can be restored to high-performance mode. Additionally, a lag interval (H=T) can be set. up - T down At any given time, there may be a situation where the current resource value is within the range. Regardless of fluctuations, the system can force the current state to remain unchanged, thereby maintaining stability.
[0075] In practical implementation, in multimedia browsing scenarios, there is no resource acquisition process adapted to the interactive characteristics of the browsing scenario, nor is there any preparation for rendering subsequent multimedia resources in advance for users' continuous browsing behavior. This easily leads to unnecessary resource consumption and excessively long waiting times when users switch browsing content, failing to meet the user's need for continuous browsing of multimedia content and still resulting in problems affecting the user experience. Therefore, in this embodiment, the step of responding to the rendering request of multimedia resources and obtaining the rendering status information of the terminal device in multiple device rendering dimensions includes: In response to a rendering request triggered in a multimedia browsing page, a resource loading request is sent to the server; the server provides multimedia resources in response to the resource loading request, and the steps of obtaining rendering status information of the terminal device in multiple device rendering dimensions are executed; wherein, after the step of driving the rendering engine to execute the multimedia rendering task corresponding to the multimedia resource based on the target rendering strategy is executed, the method further includes: if the multimedia rendering task is completed, requesting the server to send candidate multimedia resources, using the candidate multimedia resources as the multimedia resources, and executing the steps of obtaining rendering status information of the terminal device in multiple device rendering dimensions.
[0076] Specifically, responding to a rendering request triggered in a multimedia browsing page by sending a resource loading request to the server means that when a user triggers a rendering request for a multimedia resource through interactive operations such as clicking, swiping, or scrolling on a multimedia browsing page on their terminal device, the terminal device will initiate a resource loading request to the server. This request may include the identifier of the required multimedia resource, user session information, terminal device type, etc., so that the server can accurately locate and send the corresponding multimedia resource. For example, when a user swipes to new video content in a short video application, this swipe operation triggers a rendering request, and the terminal device then sends a request to the server to load the video resource. Another implementation is that when a user browses an area containing animated images or videos on a mixed text and image information page, the rendering request is triggered when that area enters the visible range, and the terminal device sends a request to the server to load the animated image or video resource.
[0077] The step of receiving multimedia resources from the server in response to the resource loading request and obtaining rendering status information of the terminal device across multiple device rendering dimensions refers to the terminal device waiting for and receiving the actual multimedia data returned by the server after sending a resource loading request. Once the multimedia resources are received, the terminal device immediately initiates the process of obtaining its own rendering status information across multiple device rendering dimensions. For example, after receiving video stream data, the terminal device immediately collects information such as current CPU usage, GPU load, memory usage, network bandwidth, battery level, screen brightness, and current application priority to comprehensively assess the current rendering environment. Another implementation is that after receiving an image or animation resource package, the terminal device immediately checks whether the device is in low-power mode, whether other high-priority applications are running in the background, and the current frame rate target, and uses this information as rendering status information.
[0078] Upon completion of the multimedia rendering task, the terminal device requests the server to send candidate multimedia resources, uses these candidate resources as the final multimedia resources, and executes the step of obtaining rendering status information of the terminal device across multiple device rendering dimensions. This refers to the terminal device actively requesting "candidate" multimedia resources that the user will browse next after the currently rendered multimedia content (e.g., a video or animation) finishes playing or rendering. These candidate resources can be determined based on user history, recommendation algorithms, or preset playlists. Once these candidate resources are received, the terminal device treats them as new multimedia resources to be rendered and again executes the step of obtaining rendering status information of the terminal device across multiple device rendering dimensions to prepare for subsequent rendering tasks. For example, after a short video finishes playing, the terminal device requests resources for the next one or more videos from the server based on the recommendation list, and immediately obtains the current device rendering status information upon receiving these video resources. Another implementation is that after an interactive animation scene ends, the terminal device requests animation resources for the next scene from the server based on preset plot branches or user selections, and simultaneously obtains the terminal device's rendering status information.
[0079] Based on this, the entire adaptive rendering process has been optimized by addressing the interaction and usage characteristics of multimedia browsing scenarios. First, by only sending resource loading requests to the server in response to rendering requests triggered within the multimedia browsing page, resources are only requested when the user actually initiates browsing behavior. This avoids preloading a large amount of resources that the user will not browse, effectively saving bandwidth and terminal device storage space, and reducing unnecessary resource consumption. Second, after receiving the multimedia resources from the server, the step of obtaining the rendering status information of the terminal device across multiple device rendering dimensions is executed. This ensures that the obtained rendering status is the latest status at the current rendering moment, allowing subsequent rendering decisions to be generated based on the latest actual situation of the terminal device, improving the accuracy of rendering decisions and better adapting to the current resources and operating status of the terminal device. Furthermore, after the current multimedia rendering task is completed, the server is proactively requested to send candidate multimedia resources. These candidate resources are then used as new multimedia resources to re-execute the step of obtaining the terminal device's rendering status. This allows for preliminary rendering preparation steps for candidate content that the user is likely to browse next. When the user switches to browsing candidate content, the resource request and rendering decision process does not need to be repeated, greatly improving the smoothness of continuous browsing. At the same time, re-acquiring the current rendering state of the terminal device can ensure that the rendering decisions of the candidate content are adapted to the latest terminal device state, ensuring that even pre-prepared rendering tasks can balance the rendering effect and the operational stability of the terminal device, and avoid affecting the user experience due to inconsistent strategies.
[0080] Based on the above technical solution, a user is browsing a multimedia content platform on their terminal device. This platform displays multimedia resources in various forms, including videos and animations. When the user swipes the screen and a new video resource enters the visible area, the terminal device responds to the rendering request of that multimedia resource.
[0081] First, the terminal device obtains its rendering status information across multiple device rendering dimensions. Specifically, it obtains the following information: 1. Scene-level state information: For example, whether the current video is played by the user or automatically, whether it is in full-screen mode, and the priority of the video in the entire application (for example, videos recommended on the homepage have a higher priority than videos playing in the background).
[0082] 2. Device status information at the device level: For example, fixed or semi-fixed parameters such as the model of the terminal device, the hardware capabilities of the CPU and GPU, and the screen resolution.
[0083] 3. Operational status information: such as the current real-time CPU utilization, real-time GPU load, available memory space, remaining battery power, and dynamically changing system resource status such as device temperature.
[0084] 4. Resource status information at the resource level: For example, parameters related to the multimedia resource itself and its transmission, such as the resolution, encoding format, bitrate, real-time network bandwidth status, and video caching progress of the video to be rendered.
[0085] These scene status information, device status information, operational status information, and resource status information are integrated into the rendering status information. Unlike existing technologies that rely solely on device model or fixed configuration, this solution can dynamically and comprehensively perceive the real-time status of the terminal device and its operating environment.
[0086] Furthermore, the terminal device constructs a rendering decision matrix based on the rendering status information corresponding to these multiple device rendering dimensions. For example, the system obtains decision weight information corresponding to the scene dimension, device dimension, runtime dimension, and resource dimension. Assume the current scene has a high priority (the user is actively watching), the device is a mid-to-high-end model, but the runtime dimension shows high CPU and GPU load (e.g., other background applications are running), while the resource dimension shows stable network bandwidth and high-definition video resolution. The system inputs this multi-dimensional state data into preset decision rules based on these decision weight information and resource status information to process the rendering decision matrix. For example, the decision rule stipulates that when the scene priority is high but the device load is high, smoothness should be prioritized over the highest image quality. After processing, the system obtains structured instruction information, such as "Rendering level: Medium quality, Rendering engine: Hardware acceleration." This multi-dimensional feature fusion decision mechanism solves the problem of existing solutions lacking dynamic perception and comprehensive consideration of runtime device status, business scene priority, and resource readiness.
[0087] Furthermore, the terminal device queries a pre-defined rendering map based on the obtained structured instruction information. This structured instruction information includes parameter index handles, such as "medium quality video parameters." The system uses these parameter index handles to query the rendering map. The rendering map pre-records the correspondence between different rendering levels (identified by parameter index handles) and specific sets of rendering parameters. Through this query, the system obtains the set of rendering parameters corresponding to the terminal device's current state, for example: video bitrate set to 5Mbps, frame rate set to 30fps, texture quality set to medium, and anti-aliasing disabled. This tiered rendering management approach allows the system to flexibly adjust rendering parameters according to actual conditions, rather than using a single fixed configuration.
[0088] Subsequently, the terminal device determines the target rendering strategy based on the structured instruction information and the set of rendering parameters. The structured instruction information extracts engine selection information (e.g., "hardware acceleration") and rendering level information (e.g., "medium quality"). Combined with the previously obtained set of rendering parameters, the system determines the final target rendering strategy, such as: "Use a hardware decoder to render at a bitrate of 5Mbps, a frame rate of 30fps, and medium texture quality."
[0089] Finally, the terminal device drives the rendering engine to execute the multimedia rendering tasks corresponding to the multimedia resources based on the target rendering strategy. The rendering engine starts playing the video according to the determined strategy, and the user experiences smooth video content with appropriate image quality.
[0090] Furthermore, this solution also possesses dynamic optimization capabilities while the multimedia rendering task is in progress. The terminal device continuously collects real-time operational status information (e.g., CPU load, GPU load, memory usage) and real-time resource status information (e.g., network bandwidth, video cache status). For example, during video playback, if the terminal device detects a continuous increase in CPU and GPU load, or a sudden drop in network bandwidth...
[0091] In practice, the system determines whether the multimedia rendering task meets the rendering optimization conditions based on these real-time operational status and resource status information. For example, the system monitors the operational status changes and resource status changes of a set number of image frames (e.g., 30 consecutive frames). If these changes meet the rendering optimization conditions, for example, if the resource status changes (such as average network bandwidth) of 30 consecutive frames are all less than a preset resource degradation threshold (e.g., below 2Mbps), it indicates that the network condition is continuously deteriorating and degradation processing is required.
[0092] In this scenario, the system reads a set of candidate rendering parameters from the rendering map table. For example, it might read a set of parameters with lower image quality (e.g., a video bitrate of 2Mbps and a frame rate of 20fps). Based on this set of candidate rendering parameters, real-time runtime status information, and real-time resource status information, the system determines a first candidate rendering strategy. This first candidate rendering strategy has a lower rendering level than the current target rendering strategy. Subsequently, the system drives the rendering engine to continue executing multimedia rendering tasks according to this first candidate rendering strategy, thereby smoothly reducing the video quality to avoid stuttering or interruptions and ensure smooth playback.
[0093] Conversely, if the system detects resource status changes (such as average network bandwidth) exceeding a preset resource recovery threshold (e.g., above 4 Mbps), it indicates that network conditions have improved. At this point, the system reads another set of candidate rendering parameters from the rendering map table, for example, a set of parameters for restoring to medium quality. Based on this, the system determines a second candidate rendering strategy, whose rendering level is less than or equal to the target rendering strategy, but greater than the first candidate rendering strategy. The rendering engine will then smoothly improve video quality according to this second candidate rendering strategy to provide a better user experience.
[0094] If the resource status change information of a set number of image frames is within the preset resource stability range, the system will use the currently used set of rendering parameters as the candidate set of rendering parameters, and drive the rendering engine to continue to execute the multimedia rendering task according to the target rendering strategy, so as to maintain the current rendering quality unchanged.
[0095] Once the current multimedia rendering task is completed, the terminal device can request the server to send the next candidate multimedia resource. This candidate multimedia resource will then be used as the new multimedia resource, and the entire process described above—obtaining rendering state information of the terminal device across multiple device rendering dimensions, constructing a decision matrix, determining the rendering strategy, and driving the rendering engine—will be executed again. This mechanism ensures dynamic adaptive rendering even when multimedia content is switched.
[0096] In summary, by employing multi-dimensional state perception, dynamic decision matrix construction, hierarchical rendering mapping, and real-time strategy adjustment and switching mechanisms, this technology effectively solves the problems of lack of dynamic perception, sluggishness, or degraded experience in existing multimedia rendering technologies, achieving a dynamic, refined, and low-risk adaptive multimedia rendering experience.
[0097] The following is in conjunction with the appendix Figure 3 Taking the application of the device rendering method provided in this specification in browsing videos on a content publishing platform as an example, the device rendering method will be further explained. Among other things, Figure 3 A timing flowchart of a device rendering method provided in one embodiment of this specification is shown.
[0098] A content publishing platform includes terminal devices and a server. Terminal devices refer to the devices held by users browsing video, published content, products, audio, text, and other content on the content application platform. The server is the service terminal corresponding to the content application platform, such as... Figure 3 As shown, the specific implementation method is as follows: The terminal device, in response to a rendering request triggered in a multimedia browsing page, sends a resource loading request to the server.
[0099] On the server side, multimedia resources are retrieved from the resource library based on the resource loading request, and then the multimedia resources are sent to the terminal device.
[0100] The terminal device receives the multimedia resources and obtains rendering status information of the terminal device in multiple device rendering dimensions.
[0101] For terminal devices, a rendering decision matrix is constructed based on the rendering status information corresponding to multiple device rendering dimensions.
[0102] The terminal device processes the rendering decision matrix according to preset decision rules to obtain structured instruction information.
[0103] The terminal device queries a preset rendering mapping table based on structured instruction information to obtain the set of rendering parameters corresponding to the current state of the terminal device.
[0104] The terminal device determines the target rendering strategy based on structured instruction information and a set of rendering parameters.
[0105] The terminal device drives the rendering engine to execute multimedia rendering tasks corresponding to multimedia resources based on the target rendering strategy.
[0106] Terminal devices collect real-time operating status information and real-time resource status information.
[0107] The terminal device, based on real-time operating status information and real-time resource status information, determines that the multimedia rendering task meets the rendering optimization conditions, and then reads the set of candidate rendering parameters from the rendering mapping table.
[0108] The terminal device determines the candidate rendering strategy based on the candidate rendering parameter set, real-time running status information, and real-time resource status information, and drives the rendering engine to continue executing the multimedia rendering task according to the candidate rendering strategy.
[0109] Furthermore, the collected rendering state information is prone to missing key states that affect the rendering effect, and it does not assign corresponding decision weights to different dimensions, making it impossible to distinguish the degree of influence of different dimensions on the rendering decision. This leads to the constructed rendering decision matrix failing to accurately reflect the actual rendering needs and available capabilities of the terminal, resulting in an inappropriate rendering strategy and causing rendering stuttering or poor rendering effects. To address this, in this embodiment, the step of obtaining the rendering state information of the terminal device in multiple device rendering dimensions in response to a rendering request for multimedia resources includes: In response to a rendering request for multimedia resources, the system acquires scene status information (scene dimension), device status information (device dimension), runtime status information (running dimension), and resource status information (resource dimension) corresponding to the terminal device. The scene status information, device status information, runtime status information, and resource status information are then used as the rendering status information. The step of constructing a rendering decision matrix based on the rendering status information corresponding to the multiple device rendering dimensions includes: acquiring decision weight information corresponding to the scene dimension, device dimension, runtime dimension, and resource dimension, and constructing a rendering decision matrix based on the decision weight information and the resource status information.
[0110] Furthermore, when determining the parameter set, if the specific implementation method for querying the rendering mapping table is not clearly defined, nor is the specific information in the structured instructions used to determine the target rendering strategy, it is impossible to quickly and accurately match the rendering parameters corresponding to the current state of the terminal, nor can it clearly and accurately combine existing information to determine the target rendering strategy adapted to the current state. This easily leads to matching errors and low query efficiency, making it difficult to meet the actual needs of dynamic adaptive rendering. Therefore, in this embodiment, the step of querying a preset rendering mapping table based on the structured instruction information to obtain the rendering parameter set corresponding to the current state of the terminal device includes: The parameter index handle is extracted from the structured instruction information, and a preset rendering mapping table is queried based on the parameter index handle to obtain the rendering parameter set corresponding to the current state of the terminal device; wherein, the rendering mapping table records the correspondence between parameter index handles and parameter sets for different rendering levels; wherein, the step of determining the target rendering strategy based on the structured instruction information and the rendering parameter set includes: extracting engine selection information and rendering level information from the structured instruction information, and determining the target rendering strategy based on the engine selection information, the rendering level information and the rendering parameter set.
[0111] Furthermore, multimedia rendering tasks often require a considerable amount of time to execute. The terminal's running state and resource state change dynamically during the rendering task execution. Adhering to the initially determined target rendering strategy cannot adapt to the real-time changes in the terminal's state. Maintaining the original high-load rendering strategy when terminal resources are insufficient during execution can easily lead to stuttering or even crashes. Conversely, maintaining the original low-load rendering strategy when terminal resources are restored will not achieve better rendering results. It is impossible to dynamically adapt to changes in terminal state during the rendering task execution to balance rendering quality and operational stability. Therefore, in this embodiment, after the step of driving the rendering engine to execute the multimedia rendering task corresponding to the multimedia resource based on the target rendering strategy is completed, the method further includes: When the multimedia rendering task is in execution, real-time running status information and real-time resource status information of the terminal device are collected; if the multimedia rendering task meets the rendering optimization conditions based on the real-time running status information and the real-time resource status information, a set of candidate rendering parameters is read from the rendering mapping table; a candidate rendering strategy is determined based on the set of candidate rendering parameters, the real-time running status information and the real-time resource status information, and the rendering engine is driven to continue executing the multimedia rendering task according to the candidate rendering strategy.
[0112] In practice, relying solely on the current real-time status for judgment is susceptible to occasional, transient fluctuations in device status, which can erroneously trigger adjustments to the rendering strategy, leading to frequent switching of rendering levels. This not only affects the smoothness of the rendering experience but also fails to accurately match the device's current continuous operating state, making it difficult to achieve a balance between rendering quality and device operational stability. Therefore, in this embodiment, when it is determined that the multimedia rendering task meets the rendering optimization conditions based on the real-time operating status information and the real-time resource status information, the candidate rendering parameter set is read from the rendering mapping table, including: Based on the real-time running status information and the real-time resource status information, determine the running status change information and resource status change information of a set number of image frames corresponding to the multimedia rendering task; if the running status change information and / or resource status change information of the set number of image frames meet the rendering optimization conditions, read the candidate rendering parameter set from the rendering mapping table.
[0113] Based on this, there are no clear judgment rules and corresponding rendering strategy adjustment directions for scenarios where terminal resources are continuously insufficient and rendering degradation is required. This makes it impossible to accurately identify scenarios with continuously insufficient resources, nor can it provide suitable rendering degradation solutions. It cannot solve the rendering stuttering or even crashing problems caused by insufficient resources, and it is also prone to erroneous adjustments, unnecessarily reducing rendering quality, failing to balance the needs of rendering experience and the safe operation of device resources. Therefore, in this embodiment, when the resource status change information of the set number of image frames meets the rendering optimization conditions, the candidate rendering parameter set is read from the rendering mapping table, including: The resource status change information of the set number of image frames is compared with a preset resource degradation threshold; if the resource status change information of the set number of image frames is less than the resource degradation threshold, the step of reading the candidate rendering parameter set in the rendering mapping table is executed; wherein, the step of determining the candidate rendering strategy based on the candidate rendering parameter set, the real-time running status information and the real-time resource status information includes: determining a first candidate rendering strategy based on the candidate rendering parameter set, the real-time running status information and the real-time resource status information, wherein the rendering level of the first candidate rendering strategy is less than the target rendering strategy.
[0114] Furthermore, only the rendering degradation processing when device resources are insufficient is considered, without taking into account the adaptation and adjustment when device resources recover from an insufficient state to a sufficient state. This makes it impossible to improve the rendering effect after resource recovery, making it difficult to balance the dual requirements of device operational stability and rendering quality, and failing to meet users' demands for a high-quality, smooth animation experience. Therefore, in this embodiment, when the resource state change information of the set number of image frames meets the rendering optimization conditions, the candidate rendering parameter set is read from the rendering mapping table, including: The resource status change information of the set number of image frames is compared with a preset resource recovery threshold; if the resource status change information of the set number of image frames is greater than the resource recovery threshold, the step of reading the candidate rendering parameter set in the rendering mapping table is executed; wherein, the step of determining the candidate rendering strategy based on the candidate rendering parameter set, the real-time running status information and the real-time resource status information includes: determining a second candidate rendering strategy based on the candidate rendering parameter set, the real-time running status information and the real-time resource status information, wherein the rendering level of the second candidate rendering strategy is less than or equal to the target rendering strategy and greater than the first candidate rendering strategy.
[0115] Besides the above processing, corresponding handling is only provided for cases that meet the resource degradation or resource recovery conditions, without covering scenarios where resource status changes are within a stable range. When the resource status does not require adjustment of the rendering strategy, the lack of corresponding processing logic means that blindly switching rendering strategies according to the original rules will increase unnecessary computational overhead, and may even cause abnormal fluctuations in the rendered image due to frequent switching of rendering strategies, affecting the user's viewing experience. It is impossible to maintain the existing stable rendering state in scenarios where rendering strategy adjustment is not required. Therefore, in this embodiment, the method further includes: when the resource status change information of the set number of image frames is within a preset resource stability range, using the rendering parameter set as the candidate rendering parameter set, and driving the rendering engine to continue executing the multimedia rendering task according to the target rendering strategy.
[0116] In summary, by dynamically acquiring rendering status information of the terminal device across multiple device rendering dimensions, and constructing a rendering decision matrix to obtain structured instruction information, this method queries the rendering mapping table and determines the target rendering strategy, thereby driving the rendering engine to execute multimedia rendering tasks. This method overcomes the limitations of traditional static rendering strategies, achieving dynamic perception and comprehensive consideration of the terminal device's runtime state. This can prevent stuttering or crashes on low-end devices due to excessive rendering load, while also mitigating the experience degradation on high-end devices caused by runtime resource fluctuations. By adaptively adjusting the rendering strategy, this embodiment effectively balances the smooth experience of high-quality animations with the need for safe operation of device resources. Corresponding to the above method embodiments, this specification also provides embodiments of a device rendering system. Figure 4 A schematic diagram of the structure of a device rendering system according to one embodiment of this specification is shown. Figure 4 As shown, the device rendering system 400 includes a terminal device 410 and a server 420, comprising: The terminal device 410 is used to send a resource loading request to the server in response to a rendering request triggered in a multimedia browsing page. The server 420 is configured to retrieve multimedia resources from the resource library according to the resource loading request, and send the multimedia resources to the terminal device. The terminal device 410 is configured to receive the multimedia resources and obtain rendering status information of the terminal device in multiple device rendering dimensions; construct a rendering decision matrix based on the rendering status information corresponding to the multiple device rendering dimensions, and process the rendering decision matrix according to preset decision rules to obtain structured instruction information; query a preset rendering mapping table based on the structured instruction information to obtain a set of rendering parameters corresponding to the current state of the terminal device; determine a target rendering strategy based on the structured instruction information and the set of rendering parameters, and drive the rendering engine to execute the multimedia rendering task corresponding to the multimedia resources based on the target rendering strategy, and display the multimedia content on the multimedia browsing page according to the task execution result.
[0117] In practical applications, multimedia motion rendering typically employs fixed configurations or static strategies based on device models, lacking dynamic awareness and comprehensive consideration of runtime device status, business scenario priorities, and resource availability. During use, low-end devices experience stuttering or even crashes due to excessive rendering load, while high-end devices suffer from degraded performance due to runtime resource fluctuations (such as background preemption and GPU throttling). Existing solutions fail to implement mechanisms for multi-dimensional feature fusion decisions on the client side, dynamic runtime scheduling of rendering strategies, and smooth handling of degradation and upgrade transitions, making it difficult to effectively balance a smooth, high-quality motion effect experience with the safe operation of device resources.
[0118] To address this issue, this application proposes a device rendering system. The system includes a terminal device and a server. The terminal device, in response to a rendering request triggered in a multimedia browsing page, sends a resource loading request to the server. The server, based on the resource loading request, retrieves multimedia resources from a resource library and sends the multimedia resources to the terminal device. The terminal device also receives multimedia resources and obtains rendering status information for the terminal device across multiple device rendering dimensions; constructs a rendering decision matrix based on the rendering status information corresponding to each of the multiple device rendering dimensions, processes the rendering decision matrix according to preset decision rules to obtain structured instruction information; queries a preset rendering mapping table based on the structured instruction information to obtain the set of rendering parameters corresponding to the current state of the terminal device; determines a target rendering strategy based on the structured instruction information and the set of rendering parameters, drives the rendering engine to execute multimedia rendering tasks corresponding to the multimedia resources based on the target rendering strategy, and displays multimedia content in the multimedia browsing page based on the task execution results.
[0119] The core of this embodiment lies in combining the acquisition of rendering status information from multiple device rendering dimensions of the terminal device with the construction of a rendering decision matrix through multi-dimensional feature fusion decision-making. This achieves dynamic perception and comprehensive consideration of runtime device status, business scenario priority, and resource readiness, enabling real-time rendering strategy scheduling on the client side and balancing a smooth experience with high-quality animation effects with safe operation of device resources. Specifically, after receiving a rendering request, the terminal device first sends a resource loading request to the server to acquire multimedia resources in advance. Simultaneously, it collects rendering status information from multiple device rendering dimensions in real time, such as CPU usage, memory consumption, battery level, and network bandwidth. This information is integrated and quantified into a rendering decision matrix. Preset decision rules process this matrix through threshold comparison or logical combination to generate structured instruction information. For example, when the device dimension shows high load and the running dimension indicates low battery, the decision rule outputs an energy-saving instruction. The terminal device then queries a preset rendering mapping table based on this structured instruction information to quickly match the corresponding set of rendering parameters, such as frame rate, resolution, and texture quality. Ultimately, the structured instruction information and the set of rendering parameters jointly determine the target rendering strategy, drive the rendering engine to execute tasks, and ensure that a smooth experience is maintained while avoiding resource overload under the current device conditions.
[0120] The above processing effectively overcomes the limitations of traditional static strategies. Terminal devices complete multi-dimensional state fusion decisions locally, avoiding coarse-grained judgments based solely on device model, thus improving the accuracy and timeliness of rendering strategies. The server centrally manages resource distribution, reducing terminal storage pressure, while the terminal device immediately initiates state awareness and decision-making processes upon receiving resources, reserving sufficient time for dynamic scheduling. The construction and processing of the rendering decision matrix achieves systematic integration of multi-dimensional data, the generation of structured instruction information simplifies the subsequent parameter matching process, and the preset mechanism of the rendering mapping table accelerates strategy determination. Overall, the system adaptively adjusts rendering quality under various device conditions, preventing lag and crashes on low-end devices while mitigating the experience degradation caused by resource fluctuations on high-end devices, ultimately achieving a dynamic balance between high-quality animations and safe device operation in multimedia browsing scenarios. In an optional embodiment, the step of obtaining rendering status information of the terminal device in multiple device rendering dimensions in response to a rendering request for multimedia resources includes: In response to a rendering request for multimedia resources, the system obtains scene status information corresponding to the scene dimension, device status information, operation status information, and resource status information of the terminal device. The scene status information, the device status information, the running status information, and the resource status information are used as the rendering status information; The step of constructing a rendering decision matrix based on the rendering state information corresponding to the multiple device rendering dimensions includes: Obtain the decision weight information corresponding to the scene dimension, the device dimension, the operation dimension and the resource dimension respectively, and construct a rendering decision matrix based on the decision weight information and the resource status information.
[0121] In an optional embodiment, the step of querying a preset rendering mapping table based on the structured instruction information to obtain the set of rendering parameters corresponding to the current state of the terminal device includes: The parameter index handle is extracted from the structured instruction information, and a preset rendering mapping table is queried based on the parameter index handle to obtain the rendering parameter set corresponding to the current state of the terminal device; wherein, the rendering mapping table records the correspondence between parameter index handles and parameter sets for different rendering levels; The step of determining the target rendering strategy based on the structured instruction information and the rendering parameter set includes: Engine selection information and rendering level information are extracted from the structured instruction information, and the target rendering strategy is determined based on the engine selection information, the rendering level information and the set of rendering parameters.
[0122] In an optional embodiment, after the step of driving the rendering engine to execute the multimedia rendering task corresponding to the multimedia resource based on the target rendering strategy is completed, the method further includes: While the multimedia rendering task is in execution, the real-time operating status information and real-time resource status information of the terminal device are collected. If the multimedia rendering task meets the rendering optimization conditions based on the real-time running status information and the real-time resource status information, then read the candidate rendering parameter set from the rendering mapping table. Based on the candidate rendering parameter set, the real-time running status information, and the real-time resource status information, a candidate rendering strategy is determined, and the rendering engine is driven to continue executing the multimedia rendering task according to the candidate rendering strategy.
[0123] In an optional embodiment, when it is determined that the multimedia rendering task meets the rendering optimization conditions based on the real-time running status information and the real-time resource status information, reading the candidate rendering parameter set from the rendering mapping table includes: Based on the real-time running status information and the real-time resource status information, determine the running status change information and resource status change information of a set number of image frames corresponding to the multimedia rendering task; If the running status change information and / or resource status change information of the set number of image frames meet the rendering optimization conditions, the set of candidate rendering parameters is read from the rendering mapping table.
[0124] In an optional embodiment, the step of reading a set of candidate rendering parameters from the rendering mapping table when the resource state change information of the set number of image frames meets the rendering optimization conditions includes: The resource status change information of the set number of image frames is compared with a preset resource degradation threshold. If the resource status change information of the set number of image frames is less than the resource degradation threshold, the step of reading the candidate rendering parameter set in the rendering mapping table is executed. The step of determining the candidate rendering strategy based on the candidate rendering parameter set, the real-time running status information, and the real-time resource status information includes: A first candidate rendering strategy is determined based on the candidate rendering parameter set, the real-time running status information, and the real-time resource status information, wherein the rendering level of the first candidate rendering strategy is lower than that of the target rendering strategy.
[0125] In an optional embodiment, the step of reading a set of candidate rendering parameters from the rendering mapping table when the resource state change information of the set number of image frames meets the rendering optimization conditions includes: The resource status change information of the set number of image frames is compared with a preset resource recovery threshold. If the resource status change information of the set number of image frames is greater than the resource recovery threshold, the step of reading the candidate rendering parameter set in the rendering mapping table is executed. The step of determining the candidate rendering strategy based on the candidate rendering parameter set, the real-time running status information, and the real-time resource status information includes: A second candidate rendering strategy is determined based on the candidate rendering parameter set, the real-time running status information, and the real-time resource status information, wherein the rendering level of the second candidate rendering strategy is less than or equal to the target rendering strategy, and greater than the first candidate rendering strategy.
[0126] In an optional embodiment, the method further includes: If the resource status change information of the set number of image frames is within the preset resource stability range, the set of rendering parameters is used as the set of candidate rendering parameters, and the rendering engine is driven to continue to execute the multimedia rendering task according to the target rendering strategy.
[0127] The above is an illustrative scheme of a device rendering system according to this embodiment. It should be noted that the technical solution of this device rendering system and the technical solution of the device rendering method described above belong to the same concept. For details not described in detail in the technical solution of the device rendering system, please refer to the description of the technical solution of the device rendering method described above.
[0128] Corresponding to the above method embodiments, this specification also provides embodiments of a device rendering apparatus. Figure 5 A schematic diagram of a device rendering apparatus according to one embodiment of this specification is shown. Figure 5 As shown, the device is applied to a terminal device and includes: The acquisition module 502 is configured to acquire rendering status information of the terminal device in multiple device rendering dimensions in response to a rendering request of multimedia resources. The processing module 504 is configured to construct a rendering decision matrix based on the rendering state information corresponding to the multiple device rendering dimensions, and process the rendering decision matrix according to preset decision rules to obtain structured instruction information. The query module 506 is configured to query a preset rendering mapping table based on the structured instruction information to obtain the set of rendering parameters corresponding to the current state of the terminal device. The rendering module 508 is configured to determine a target rendering strategy based on the structured instruction information and the set of rendering parameters, and drive the rendering engine to execute the multimedia rendering task corresponding to the multimedia resource based on the target rendering strategy.
[0129] In an optional embodiment, the step of obtaining rendering status information of the terminal device in multiple device rendering dimensions in response to a rendering request for multimedia resources includes: In response to a rendering request for multimedia resources, the system obtains scene status information corresponding to the scene dimension, device status information, operation status information, and resource status information of the terminal device. The scene status information, the device status information, the running status information, and the resource status information are used as the rendering status information; The step of constructing a rendering decision matrix based on the rendering state information corresponding to the multiple device rendering dimensions includes: Obtain the decision weight information corresponding to the scene dimension, the device dimension, the operation dimension and the resource dimension respectively, and construct a rendering decision matrix based on the decision weight information and the resource status information.
[0130] In an optional embodiment, the step of querying a preset rendering mapping table based on the structured instruction information to obtain the set of rendering parameters corresponding to the current state of the terminal device includes: The parameter index handle is extracted from the structured instruction information, and a preset rendering mapping table is queried based on the parameter index handle to obtain the rendering parameter set corresponding to the current state of the terminal device; wherein, the rendering mapping table records the correspondence between parameter index handles and parameter sets for different rendering levels; The step of determining the target rendering strategy based on the structured instruction information and the rendering parameter set includes: Engine selection information and rendering level information are extracted from the structured instruction information, and the target rendering strategy is determined based on the engine selection information, the rendering level information and the set of rendering parameters.
[0131] In an optional embodiment, after the step of driving the rendering engine to execute the multimedia rendering task corresponding to the multimedia resource based on the target rendering strategy is completed, the method further includes: While the multimedia rendering task is in execution, the real-time operating status information and real-time resource status information of the terminal device are collected. If the multimedia rendering task meets the rendering optimization conditions based on the real-time running status information and the real-time resource status information, then read the candidate rendering parameter set from the rendering mapping table. Based on the candidate rendering parameter set, the real-time running status information, and the real-time resource status information, a candidate rendering strategy is determined, and the rendering engine is driven to continue executing the multimedia rendering task according to the candidate rendering strategy.
[0132] In an optional embodiment, when it is determined that the multimedia rendering task meets the rendering optimization conditions based on the real-time running status information and the real-time resource status information, reading the candidate rendering parameter set from the rendering mapping table includes: Based on the real-time running status information and the real-time resource status information, determine the running status change information and resource status change information of a set number of image frames corresponding to the multimedia rendering task; If the running status change information and / or resource status change information of the set number of image frames meet the rendering optimization conditions, the set of candidate rendering parameters is read from the rendering mapping table.
[0133] In an optional embodiment, the step of reading a set of candidate rendering parameters from the rendering mapping table when the resource state change information of the set number of image frames meets the rendering optimization conditions includes: The resource status change information of the set number of image frames is compared with a preset resource degradation threshold. If the resource status change information of the set number of image frames is less than the resource degradation threshold, the step of reading the candidate rendering parameter set in the rendering mapping table is executed. The step of determining the candidate rendering strategy based on the candidate rendering parameter set, the real-time running status information, and the real-time resource status information includes: A first candidate rendering strategy is determined based on the candidate rendering parameter set, the real-time running status information, and the real-time resource status information, wherein the rendering level of the first candidate rendering strategy is lower than that of the target rendering strategy.
[0134] In an optional embodiment, the step of reading a set of candidate rendering parameters from the rendering mapping table when the resource state change information of the set number of image frames meets the rendering optimization conditions includes: The resource status change information of the set number of image frames is compared with a preset resource recovery threshold. If the resource status change information of the set number of image frames is greater than the resource recovery threshold, the step of reading the candidate rendering parameter set in the rendering mapping table is executed. The step of determining the candidate rendering strategy based on the candidate rendering parameter set, the real-time running status information, and the real-time resource status information includes: A second candidate rendering strategy is determined based on the candidate rendering parameter set, the real-time running status information, and the real-time resource status information, wherein the rendering level of the second candidate rendering strategy is less than or equal to the target rendering strategy, and greater than the first candidate rendering strategy.
[0135] In an optional embodiment, the method further includes: If the resource status change information of the set number of image frames is within the preset resource stability range, the set of rendering parameters is used as the set of candidate rendering parameters, and the rendering engine is driven to continue to execute the multimedia rendering task according to the target rendering strategy.
[0136] In an optional embodiment, the step of obtaining rendering status information of the terminal device in multiple device rendering dimensions in response to a rendering request for multimedia resources includes: In response to a rendering request triggered in a multimedia browsing page, a resource loading request is sent to the server; The system receives multimedia resources from the server in response to the resource loading request and performs the step of obtaining rendering status information of the terminal device in multiple device rendering dimensions. After the step of driving the rendering engine to execute the multimedia rendering task corresponding to the multimedia resource based on the target rendering strategy is executed, the method further includes: Upon completion of the multimedia rendering task, a request is made to the server to send candidate multimedia resources, which are then used as the multimedia resources. The process of obtaining the rendering status information of the terminal device in multiple device rendering dimensions is then executed.
[0137] The above is a schematic scheme of a device rendering apparatus according to this embodiment. It should be noted that the technical solution of this device rendering apparatus and the technical solution of the device rendering method described above belong to the same concept. For details not described in detail in the technical solution of the device rendering apparatus, please refer to the description of the technical solution of the device rendering method described above.
[0138] Figure 6 A structural block diagram of a computing device 600 according to one embodiment of this specification is shown. The components of the computing device 600 include, but are not limited to, a memory 610 and a processor 620. The processor 620 is connected to the memory 610 via a bus 630, and a database 650 is used to store data.
[0139] The computing device 600 also includes an access device 640, which enables the computing device 600 to communicate via one or more networks 660. Examples of these networks include Public Switched Telephone Network (PSTN), Local Area Network (LAN), Wide Area Network (WAN), Personal Area Network (PAN), or combinations of communication networks such as the Internet. The access device 640 may include one or more of any type of wired or wireless network interface (e.g., a network interface card (NIC)), such as an IEEE 802.11 Wireless Local Area Network (WLAN) wireless interface, a Wi-MAX (Worldwide Interoperability for Microwave Access) interface, an Ethernet interface, a Universal Serial Bus (USB) interface, a cellular network interface, a Bluetooth interface, or a Near Field Communication (NFC) interface.
[0140] In one embodiment of this specification, the above-described components of the computing device 600 and Figure 6 Other components, not shown, can also be connected to each other, for example, via a bus. It should be understood that... Figure 6 The block diagram of the computing device shown is for illustrative purposes only and is not intended to limit the scope of this specification. Those skilled in the art can add or replace other components as needed.
[0141] The computing device 600 can be any type of stationary or mobile computing device, including mobile computers or mobile computing devices (e.g., tablet computers, personal digital assistants, laptop computers, notebook computers, netbooks, etc.), mobile phones (e.g., smartphones), wearable computing devices (e.g., smartwatches, smart glasses, etc.) or other types of mobile devices, or stationary computing devices such as desktop computers or personal computers (PCs). The computing device 600 can also be a mobile or stationary server.
[0142] The processor 620 is configured to execute the following computer-executable instructions, which, when executed by the processor, implement the steps of the above-described device rendering method.
[0143] The above is an illustrative scheme of a computing device according to this embodiment. It should be noted that the technical solution of this computing device and the technical solution of the device rendering method described above belong to the same concept. For details not described in detail in the technical solution of the computing device, please refer to the description of the technical solution of the device rendering method described above.
[0144] An embodiment of this specification also provides a computer-readable storage medium storing computer-executable instructions that, when executed by a processor, implement the steps of the device rendering method described above.
[0145] The above is an illustrative scheme of a computer-readable storage medium according to this embodiment. It should be noted that the technical solution of this storage medium and the technical solution of the device rendering method described above belong to the same concept. For details not described in detail in the technical solution of the storage medium, please refer to the description of the technical solution of the device rendering method described above.
[0146] An embodiment of this specification also provides a computer program product, including a computer program or instructions that, when executed by a processor, implement the steps of the device rendering method described above.
[0147] The above is an illustrative scheme of a computer program product according to this embodiment. It should be noted that the technical solution of this computer program product and the technical solution of the device rendering method described above belong to the same concept. For details not described in detail in the technical solution of the computer program product, please refer to the description of the technical solution of the device rendering method described above.
[0148] The foregoing has described specific embodiments of this specification. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims may be performed in a different order than that shown in the embodiments and may still achieve the desired result. Furthermore, the processes depicted in the drawings do not necessarily require the specific or sequential order shown to achieve the desired result. In some embodiments, multitasking and parallel processing are possible or may be advantageous.
[0149] The computer instructions include computer program code, which may be in the form of source code, object code, executable file, or certain intermediate forms. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording media, USB flash drive, portable hard drive, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signals, telecommunication signals, and software distribution media, etc. It should be noted that the content included in the computer-readable medium may be appropriately added or removed according to the requirements of patent practice. For example, in some regions, according to patent practice, computer-readable media may not include electrical carrier signals and telecommunication signals.
[0150] It should be noted that, for the sake of simplicity, the foregoing method embodiments are all described as a series of actions. However, those skilled in the art should understand that the embodiments in this specification are not limited to the described order of actions, because according to the embodiments in this specification, some steps can be performed in other orders or simultaneously. Furthermore, those skilled in the art should also understand that the embodiments described in this specification are all preferred embodiments, and the actions and modules involved are not necessarily essential to the embodiments in this specification.
[0151] In the above embodiments, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments.
[0152] The preferred embodiments disclosed above are merely illustrative of this specification. Optional embodiments do not exhaustively describe all details, nor do they limit the invention to the specific implementations described. Clearly, many modifications and variations can be made based on the embodiments described in this specification. These embodiments are selected and specifically described in this specification to better explain the principles and practical applications of the embodiments, thereby enabling those skilled in the art to better understand and utilize this specification.
Claims
1. A device rendering method, characterized in that, Applied to terminal devices, including: In response to a rendering request for multimedia resources, the rendering status information of the terminal device in multiple device rendering dimensions is obtained; A rendering decision matrix is constructed based on the rendering state information corresponding to the multiple device rendering dimensions, and the rendering decision matrix is processed according to preset decision rules to obtain structured instruction information. The preset rendering mapping table is queried according to the structured instruction information to obtain the set of rendering parameters corresponding to the current state of the terminal device; The target rendering strategy is determined based on the structured instruction information and the set of rendering parameters, and the rendering engine is driven to execute the multimedia rendering task corresponding to the multimedia resource based on the target rendering strategy.
2. The device rendering method according to claim 1, characterized in that, The step of responding to a rendering request for multimedia resources by obtaining rendering status information of the terminal device in multiple device rendering dimensions includes: In response to a rendering request for multimedia resources, the system obtains scene status information corresponding to the scene dimension, device status information, operation status information, and resource status information of the terminal device. The scene status information, the device status information, the running status information, and the resource status information are used as the rendering status information; The step of constructing a rendering decision matrix based on the rendering state information corresponding to the multiple device rendering dimensions includes: Obtain the decision weight information corresponding to the scene dimension, the device dimension, the operation dimension and the resource dimension respectively, and construct a rendering decision matrix based on the decision weight information and the resource status information.
3. The device rendering method according to claim 1, characterized in that, The step of querying a preset rendering mapping table based on the structured instruction information to obtain the set of rendering parameters corresponding to the current state of the terminal device includes: The parameter index handle is extracted from the structured instruction information, and a preset rendering mapping table is queried based on the parameter index handle to obtain the rendering parameter set corresponding to the current state of the terminal device; wherein, the rendering mapping table records the correspondence between parameter index handles and parameter sets for different rendering levels; The step of determining the target rendering strategy based on the structured instruction information and the rendering parameter set includes: Engine selection information and rendering level information are extracted from the structured instruction information, and the target rendering strategy is determined based on the engine selection information, the rendering level information and the set of rendering parameters.
4. The device rendering method according to claim 1, characterized in that, After the step of driving the rendering engine to execute the multimedia rendering task corresponding to the multimedia resource based on the target rendering strategy is executed, the method further includes: While the multimedia rendering task is in execution, the real-time operating status information and real-time resource status information of the terminal device are collected. If the multimedia rendering task meets the rendering optimization conditions based on the real-time running status information and the real-time resource status information, then read the candidate rendering parameter set from the rendering mapping table. Based on the candidate rendering parameter set, the real-time running status information, and the real-time resource status information, a candidate rendering strategy is determined, and the rendering engine is driven to continue executing the multimedia rendering task according to the candidate rendering strategy.
5. The device rendering method according to claim 4, characterized in that, When it is determined, based on the real-time running status information and the real-time resource status information, that the multimedia rendering task meets the rendering optimization conditions, a set of candidate rendering parameters is read from the rendering mapping table, including: Based on the real-time running status information and the real-time resource status information, determine the running status change information and resource status change information of a set number of image frames corresponding to the multimedia rendering task; If the running status change information and / or resource status change information of the set number of image frames meet the rendering optimization conditions, the set of candidate rendering parameters is read from the rendering mapping table.
6. The device rendering method according to claim 5, characterized in that, When the resource status change information of the set number of image frames meets the rendering optimization conditions, the candidate rendering parameter set is read from the rendering mapping table, including: The resource status change information of the set number of image frames is compared with a preset resource degradation threshold. If the resource status change information of the set number of image frames is less than the resource degradation threshold, the step of reading the candidate rendering parameter set in the rendering mapping table is executed. The step of determining the candidate rendering strategy based on the candidate rendering parameter set, the real-time running status information, and the real-time resource status information includes: A first candidate rendering strategy is determined based on the candidate rendering parameter set, the real-time running status information, and the real-time resource status information, wherein the rendering level of the first candidate rendering strategy is lower than that of the target rendering strategy.
7. The device rendering method according to claim 6, characterized in that, When the resource status change information of the set number of image frames meets the rendering optimization conditions, the candidate rendering parameter set is read from the rendering mapping table, including: The resource status change information of the set number of image frames is compared with a preset resource recovery threshold. If the resource status change information of the set number of image frames is greater than the resource recovery threshold, the step of reading the candidate rendering parameter set in the rendering mapping table is executed. The step of determining the candidate rendering strategy based on the candidate rendering parameter set, the real-time running status information, and the real-time resource status information includes: A second candidate rendering strategy is determined based on the candidate rendering parameter set, the real-time running status information, and the real-time resource status information, wherein the rendering level of the second candidate rendering strategy is less than or equal to the target rendering strategy, and greater than the first candidate rendering strategy.
8. The device rendering method according to claim 6 or 7, characterized in that, The method further includes: If the resource status change information of the set number of image frames is within the preset resource stability range, the set of rendering parameters is used as the set of candidate rendering parameters, and the rendering engine is driven to continue to execute the multimedia rendering task according to the target rendering strategy.
9. The device rendering method according to any one of claims 1 to 7, characterized in that, The step of responding to a rendering request for multimedia resources by obtaining rendering status information of the terminal device in multiple device rendering dimensions includes: In response to a rendering request triggered in a multimedia browsing page, a resource loading request is sent to the server; The system receives multimedia resources from the server in response to the resource loading request and performs the step of obtaining rendering status information of the terminal device in multiple device rendering dimensions. After the step of driving the rendering engine to execute the multimedia rendering task corresponding to the multimedia resource based on the target rendering strategy is executed, the method further includes: Upon completion of the multimedia rendering task, a request is made to the server to send candidate multimedia resources, which are then used as the multimedia resources. The process of obtaining the rendering status information of the terminal device in multiple device rendering dimensions is then executed.
10. A device rendering system, characterized in that, Including terminal devices and server-side components, including: The terminal device is used to send a resource loading request to the server in response to a rendering request triggered in a multimedia browsing page. The server is configured to retrieve multimedia resources from the resource library according to the resource loading request, and send the multimedia resources to the terminal device. The terminal device is configured to receive the multimedia resources and obtain rendering status information of the terminal device in multiple device rendering dimensions; construct a rendering decision matrix based on the rendering status information corresponding to the multiple device rendering dimensions, and process the rendering decision matrix according to preset decision rules to obtain structured instruction information; query a preset rendering mapping table based on the structured instruction information to obtain a set of rendering parameters corresponding to the current state of the terminal device; determine a target rendering strategy based on the structured instruction information and the set of rendering parameters, and drive the rendering engine to execute the multimedia rendering task corresponding to the multimedia resources based on the target rendering strategy, and display the multimedia content on the multimedia browsing page according to the task execution result.
11. A device rendering apparatus, characterized in that, Applied to terminal devices, including: The acquisition module is configured to acquire rendering status information of the terminal device in multiple device rendering dimensions in response to rendering requests of multimedia resources. The processing module is configured to construct a rendering decision matrix based on the rendering state information corresponding to the multiple device rendering dimensions, and process the rendering decision matrix according to preset decision rules to obtain structured instruction information. The query module is configured to query a preset rendering mapping table based on the structured instruction information to obtain the set of rendering parameters corresponding to the current state of the terminal device. The rendering module is configured to determine a target rendering strategy based on the structured instruction information and the set of rendering parameters, and drive the rendering engine to execute the multimedia rendering task corresponding to the multimedia resource based on the target rendering strategy.
12. A computing device, characterized in that, include: Memory and processor; The memory is used to store computer-executable instructions, and the processor is used to execute the computer-executable instructions, which, when executed by the processor, implement the steps of the method according to any one of claims 1 to 9.
13. A computer-readable storage medium, characterized in that, It stores computer-executable instructions that, when executed by a processor, implement the steps of the method according to any one of claims 1 to 9.
14. A computer program product, characterized in that, It includes a computer program or instructions that, when executed by a processor, implement the steps of the method according to any one of claims 1 to 9.
