Display data processing methods, devices, systems, equipment, and media.

Abstract

This disclosure provides a display data processing method, apparatus, system, device, and medium, relating to the field of computer technology. The method includes: determining the output resolution for each layer to be displayed; wherein at least some of the layers to be displayed have output resolutions smaller than the display resolution of the display device; rendering the corresponding layers to be displayed according to their output resolutions to generate layer data corresponding to the output resolutions of each layer; and sending the layer data to the display device, so that the display device performs resolution upscaling on the layer data whose output resolution is smaller than the display resolution of the display device. This method significantly reduces display link bandwidth and power consumption without significantly affecting the visual experience.

Description

Technical Field

[0001] This disclosure relates to the field of computer technology, specifically to a display data processing method, apparatus, system, device, and medium. Background Technology

[0002] With the rapid development of display technology, the resolution of display systems is constantly improving, evolving from High Definition (HD) and Ultra High Definition (UHD) to even higher resolutions. In high-resolution display scenarios, the amount of data that the display controller needs to process increases exponentially, posing severe challenges to system bandwidth, power consumption, and stability. Summary of the Invention

[0003] This disclosure provides a display data processing method, apparatus, system, electronic device, and computer-readable storage medium.

[0004] In a first aspect, embodiments of this disclosure propose a display data processing method, which includes: determining an output resolution for each layer to be displayed; wherein at least some of the output resolutions of the layers to be displayed are less than the display resolution of the display device; rendering the corresponding layers to be displayed according to their output resolutions to generate layer data corresponding to the output resolutions of each layer to be displayed; and sending the layer data to the display device so that the display device displays the layer data whose output resolutions are less than the display resolution of the display device after performing resolution upscaling processing.

[0005] In some embodiments, the step of determining the output resolution for each layer to be displayed includes: determining a layer importance index for each layer to be displayed; and determining the output resolution for each layer to be displayed based on the layer importance index.

[0006] In some embodiments, determining the output resolution of each layer to be displayed based on the layer importance index includes: assigning a corresponding resolution weight to each layer to be displayed based on the layer importance index; and determining the output resolution of each layer to be displayed based on the resolution weight and the display resolution of the display device.

[0007] In some embodiments, the step of determining the layer importance index of each layer to be displayed includes: determining the display accuracy requirement of the corresponding layer to be displayed based on at least one of the content characteristics, geometric distribution relationship and spatial overlay relationship of each layer to be displayed; and determining the layer importance index of each layer to be displayed based on the display accuracy requirement.

[0008] In some embodiments, the output resolution corresponding to the layer to be displayed that has a layer importance lower than a preset performance index is lower than the display resolution of the display device.

[0009] In some embodiments, the step of determining the output resolution for each layer to be displayed includes: receiving display capability information reported by the display device; and determining the output resolution of each layer to be displayed based on the display capability information; wherein the display capability information includes at least one of the following: the maximum number of layers supported by the display device, the data output format supported by each layer, and scaling processing capability.

[0010] In some embodiments, the method further includes: monitoring state change information of each layer to be displayed; wherein the state change information includes at least one of user interaction state or static state; and dynamically adjusting the output resolution of the corresponding layer to be displayed based on the state change information.

[0011] In some embodiments, dynamically adjusting the output resolution of the corresponding layer to be displayed based on the state change information includes: increasing the output resolution of the layer to be displayed when the layer is in a user interaction state; and decreasing the output resolution of the layer to be displayed when the layer is in a static state.

[0012] Secondly, this disclosure also provides a display data processing method applied to a display device. The method includes: receiving layer data corresponding to the output resolution of each layer to be displayed; wherein each layer data is generated by rendering according to the output resolution of the corresponding layer to be displayed, and at least some of the output resolutions of the layers to be displayed are smaller than the display resolution of the display device; performing resolution upscaling processing on the layer data whose output resolution is smaller than the display resolution of the display device to generate updated layer data; and displaying each layer to be displayed at the display resolution according to the layer data corresponding to the output resolution of each layer to be displayed and the updated layer data.

[0013] Thirdly, this disclosure also provides a display data processing apparatus, which includes a determining module, a rendering module, and a sending module; wherein the determining module is configured to determine the output resolution for each layer to be displayed; wherein at least some of the layers to be displayed have output resolutions smaller than the display resolution of the display device; the rendering module is configured to render the corresponding layers to be displayed according to their output resolutions, generating layer data corresponding to the output resolutions of each layer to be displayed; and the sending module is configured to send the layer data to the display device, so that the display device performs resolution upscaling processing on the layer data whose output resolution is smaller than the display resolution before displaying it.

[0014] Fourthly, this disclosure also provides a data processing system, which includes: a display data processing device and a display device as described in the third aspect above; wherein the display device is configured to perform resolution magnification processing on layer data whose output resolution is smaller than the display resolution of the display device, and to display each layer to be displayed at the display resolution.

[0015] In some embodiments, the layer data of the layers to be displayed includes first layer data and second layer data, and the first layer data is layer data with an output resolution lower than the display resolution; wherein, the display device includes a display controller and a display; the display controller is configured to perform resolution upscaling processing on the first layer data based on the display resolution to generate updated layer data; wherein, the resolution corresponding to the updated layer data is the display resolution; the display is configured to display each layer to be displayed at the display resolution according to the second layer data and the updated layer data.

[0016] In some embodiments, the display controller includes a scaling unit and an output control unit; the scaling unit is configured to receive first layer data and, based on the display resolution, perform resolution scaling on the first layer data to generate updated layer data; the output control unit is configured to receive second layer data and the updated layer data, and send the second layer data and the updated layer data to the display.

[0017] In some embodiments, the display device is further configured to report display capability information of the display device to the display data processing device; the determining module is further configured to determine the output resolution of each layer to be displayed based on the display capability information; wherein the display capability information includes at least one of the following: the maximum number of layers supported by the display device, the data output format supported by each layer, and the scaling processing capability of the display controller.

[0018] Fifthly, embodiments of this disclosure provide an electronic device comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to implement the display data processing method as described in any implementation of the first aspect.

[0019] In a sixth aspect, embodiments of this disclosure provide a non-transitory computer-readable storage medium storing computer instructions that enable a computer to implement the display data processing method as described in any implementation of the first aspect.

[0020] The display data processing method provided in this disclosure determines different output resolutions for each layer to be displayed, with at least some layers having output resolutions smaller than the display resolution of the display device, and renders them separately according to these differentiated resolutions. This avoids the large amount of redundant computation caused by rendering all layers at the highest resolution, reduces resource consumption during rendering, lowers rendering power consumption, and speeds up rendering. Furthermore, the layer data corresponding to the lower output resolution layers is smaller, which effectively reduces the amount of data transmitted during transmission to the display device, lowers the demand for transmission bandwidth, and improves the stability and efficiency of data transmission. Attached Figure Description

[0021] Other features, objects, and advantages of this disclosure will become more apparent from the following detailed description of non-limiting embodiments with reference to the accompanying drawings: Figure 1 This is a schematic diagram of a display data processing method provided in this disclosure; Figure 2 This is a schematic diagram illustrating yet another data processing method provided in this disclosure; Figure 3 A flowchart of a display data processing method provided in an embodiment of this disclosure; Figure 4 A flowchart of a display data processing method applied to a display device is provided in this disclosure; Figure 5 A structural block diagram of a display data processing device provided in an embodiment of this disclosure; Figure 6 A structural block diagram of a data processing system provided in an embodiment of this disclosure; Figure 7 A schematic diagram of a data processing system provided in an embodiment of this disclosure; Figure 8 This is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of this disclosure. Detailed Implementation

[0022] The exemplary embodiments of this disclosure are described below with reference to the accompanying drawings, including various details of the embodiments to aid understanding; these should be considered merely exemplary. Therefore, those skilled in the art will recognize that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of this disclosure. Similarly, for clarity and brevity, descriptions of well-known functions and structures are omitted in the following description. It should be noted that, unless otherwise specified, the embodiments and features described in this disclosure can be combined with each other.

[0023] Display systems typically employ a multi-layer architecture. The display controller supports direct / pass-through output of multiple layers / planes. This means that layer data is not pre-composited by the central processing unit or graphics processor, but is directly transmitted to the display, where the display controller performs on-the-fly composition / blending. Typical multi-layer applications include, but are not limited to: main content layers (such as video playback and game screens), background layers (such as desktop wallpapers and application backgrounds), decorative layers (such as user interface borders, status bars, and floating controls), blur effect layers (such as frosted glass backgrounds and depth-of-field effect layers), video preview layers (such as picture-in-picture and thumbnail previews), and cursor layers.

[0024] For example, when processing multi-layered content, a display system can adopt a uniform resolution strategy: all layers, regardless of their actual content characteristics, visual importance, or final display size, are rendered, transmitted, and displayed at the final display resolution (Native Resolution / Panel Resolution). For instance, in 4K or 8K full HD display output scenarios, background layers, decorative user interface (UI) elements, blurred layers, and small video preview windows are all forcibly upscaled to the same resolution as the main display content for transmission and compositing.

[0025] Figures 1-2 This is a schematic diagram illustrating two different display data processing methods provided in this disclosure.

[0026] like Figures 1-2 As shown, the method can be applied to a display system, which includes a display controller 103 and a display 104, wherein the display controller 103 includes a scaling unit and an output control unit.

[0027] like Figure 1 As shown, the layer to be displayed 101 includes 6 layers: layer 1, layer 2, layer 3, layer 4, layer 5 and layer 6. First, each of the 6 layers is rendered at a resolution consistent with the display resolution of the monitor 104 and then combined to obtain a target layer 102. Then, the target layer 102 is directly output to the display controller 103 in the display system, and the output control unit in the display controller 103 sends the target layer 102 directly to the monitor 104 for display.

[0028] like Figure 2As shown, layers 1, 2, 3, 4, 5, and 6 in the layer to be displayed 101 can be directly adapted and rendered according to the display resolution of the monitor 104 and then directly output to the display controller 103 in the display system. Then, the layer to be displayed 101 is combined into the target layer 102 in the output control unit of the display controller 103, and the combined target layer 102 is directly sent to the monitor 104 for display.

[0029] according to Figures 1-2 As can be seen from the corresponding embodiments, in both output methods, all layers are uniformly output to the display controller 103 of the display system at the display resolution, and then directly sent to the display 104 for display via the display controller 103. That is, in Figure 1 and Figure 2 In the corresponding implementation, the size of each layer remains constant from rendering to display. Therefore, the output display bandwidth, rendering power consumption, and other required parameters for each layer are strongly correlated with the display resolution, placing rigid demands on hardware capabilities and battery life, making fine-grained control impossible. Furthermore, it increases display memory bandwidth in high-resolution scenes, causing underflow issues such as screen flickering and jitter, while also increasing the power consumption of image rendering.

[0030] Based on this, the present disclosure provides a new display data processing scheme.

[0031] Figure 3 This is a flowchart of a display data processing method provided in an embodiment of the present disclosure.

[0032] like Figure 3 As shown, the method specifically includes the following steps: Step 301: Determine the output resolution for each layer to be displayed.

[0033] In this case, at least some of the layers to be displayed have an output resolution that is smaller than the display resolution of the display device.

[0034] Specifically, output resolution refers to the resolution set for each layer to be displayed before rendering, used to generate the corresponding layer data. The size of this output resolution can be flexibly determined based on actual display requirements, system computing power, transmission bandwidth, and other factors. Optionally, the output resolution can be the same as or smaller than the display resolution of the display device. Its size directly determines the amount of data in the corresponding layer, the amount of rendering computation, and the precision of subsequent processing. The smaller the output resolution, the smaller the amount of data in the corresponding layer and the smaller the amount of rendering computation, thus reducing the data processing and computational overhead during layer rendering and increasing rendering efficiency.

[0035] In some embodiments, the output resolution can be determined either based on layer importance index allocation, or by pre-setting a fixed resolution, or by dynamically adapting to the real-time scene. This disclosure does not limit the method of determination.

[0036] Furthermore, at least some of the layers to be displayed have an output resolution lower than the display resolution of the display device, while another portion of the layers (usually the highest interactive layer) are rendered or output based on the original resolution of the display device. By setting the output resolution of at least some of the layers to be displayed to be lower than the display resolution of the display device, the amount of data processing and computational overhead during layer rendering can be reduced while ensuring display quality, thus improving rendering efficiency. Of course, the output resolution of all layers to be displayed can also be set to be lower than the display resolution of the display device, thereby minimizing the amount of data and computational overhead during rendering.

[0037] Step 302: Render the corresponding layers according to their output resolution to generate layer data corresponding to their output resolution.

[0038] Specifically, rendering processing refers to the process of drawing, rasterizing, or compositing graphics based on the layer content, graphic elements, drawing instructions, etc. of the layer to be displayed, according to the output resolution set for that layer, in order to generate image data that can be used for display output.

[0039] Layer data refers to the image data obtained after rendering and that is consistent with the corresponding output resolution. Layers with different output resolutions correspond to the generation of layer data of different resolutions. That is, high-resolution output layers correspond to the generation of high-resolution layer data, and low-resolution output layers correspond to the generation of low-resolution layer data, ensuring that the layer data and the output resolution are accurately matched.

[0040] Step 303: Send the layer data to the display device so that the display device can display the layer data after performing resolution upscaling on the output resolution which is smaller than the display resolution of the display device.

[0041] Specifically, layer data refers to pixel image data with a fixed resolution, which is rendered and output as numerical image data that can be directly used for display. This includes pixel color data, transparency data, etc. Therefore, this layer data can be sent to a display device for display.

[0042] Upscaling refers to processing low-resolution layer data through resolution upscaling or upsampling to obtain high-resolution layer data. This process is used to adjust the size and resolution of an image and generate pixel data that matches the target resolution based on information such as the color and transparency of the original pixels.

[0043] After receiving layer data, the display device first identifies the output resolution of each layer. For layer data whose output resolution is lower than its own display resolution, it performs a magnification operation to increase the resolution of the low-resolution layer data to match the display resolution of the display device. This adapts the resolution of the low-resolution layer data to the display resolution of the display device, thereby completing the final image composition of all layers to be displayed and displaying them correctly. The display device can perform the magnification operation on layer data whose output resolution is lower than its own display resolution using a magnification algorithm built into the display chip or a preset magnification logic; this disclosure does not limit this approach. In some embodiments, the magnification algorithm can be an interpolation magnification algorithm. This algorithm increases the total number of pixels in the image by inserting new pixels between pixels in the low-resolution image and calculating the pixel value of the new pixels based on the color and transparency information of the surrounding original pixels, thus increasing the image resolution to the target resolution. This interpolation magnification algorithm includes nearest neighbor interpolation, bilinear interpolation, or bicubic interpolation, etc. Of course, the preset magnification algorithm can also be, in addition to interpolation magnification algorithms, convolution-based upsampling, deep learning-based super-resolution algorithms, etc., and this disclosure does not limit this approach.

[0044] This disclosure improves the display of layer data that is lower than the display resolution of the display device by performing resolution upscaling, which can meet the display requirements of the layer without having to use a high resolution during the layer rendering stage. This effectively reduces the data processing pressure and transmission bandwidth consumption on the rendering end, while ensuring the normal output of the final display screen.

[0045] The display data processing method provided in this disclosure determines different output resolutions for each layer to be displayed, with at least some layers having output resolutions smaller than the display resolution of the display device, and renders them separately according to these differentiated resolutions. This avoids the large amount of redundant computation caused by rendering all layers at the highest resolution, reduces resource consumption during rendering, lowers rendering power consumption, and speeds up rendering. It is particularly suitable for display processing scenarios with multiple layers and complex scenes. Furthermore, the layer data volume corresponding to the low-output-resolution layers is smaller, which effectively reduces the amount of data transmitted during transmission to the display device, lowers the demand for transmission bandwidth, avoids transmission stuttering and delays caused by large amounts of high-resolution data transmission, and improves the stability and efficiency of data transmission. Further, after receiving the layer data, the display device can also perform resolution upscaling on the low-output-resolution layer data to adapt the upscaled layer data to the display resolution of the display device. This avoids problems such as blurring and size mismatch caused by directly displaying low-resolution layers, ensuring that all layers to be displayed can be displayed normally, meeting actual display needs, and not affecting the user experience due to reduced resolution. The method provided in this disclosure can significantly reduce display link bandwidth and power consumption without significantly affecting the visual experience.

[0046] In step 301 above, the output resolution can be determined either based on the layer importance index, a fixed resolution can be preset, or it can be dynamically adapted according to the real-time scene.

[0047] In some embodiments, the step of determining the output resolution for each layer to be displayed includes: determining a layer importance index for each layer to be displayed; and determining the output resolution for each layer to be displayed based on the layer importance index.

[0048] Specifically, this disclosure can determine the layer importance index of the layers to be displayed through a preset formula or a preset neural network model. The layer importance index can be a score within a preset range or a discrete numerical representation of importance levels; this disclosure does not limit this. The importance of the corresponding layers can be determined based on the layer importance index. Important layers occupy the visual focus and should be matched with high resolution, while less important layers can be matched with relatively low resolution. In this way, while ensuring display quality, rendering speed can be improved by reducing the bandwidth and power consumption of the display output. Furthermore, this disclosure can also determine the output resolution of each layer to be displayed based on a preset algorithm, a neural network model, or the mapping relationship between the layer importance index and the output resolution.

[0049] In some embodiments, determining the output resolution of each layer to be displayed based on a layer importance index includes: assigning a corresponding resolution weight to each layer to be displayed based on the layer importance index; and determining the output resolution of each layer to be displayed based on the resolution weight and the display resolution of the display device.

[0050] Specifically, resolution weight refers to the weight assigned relative to the display resolution of the display device. Layers with higher importance levels are assigned higher resolution weights to ensure a higher output resolution and thus guarantee high-definition display. Conversely, layers with lower importance levels are assigned lower resolution weights to reduce rendering power consumption and improve rendering speed. For example, layer importance can be categorized into core layers, normal layers, and secondary layers based on their importance level. Then, the resolution weight of each layer can be determined based on the mapping relationship between layer importance level and resolution weight. For instance, core layers can be assigned higher weights, such as a resolution weight of 1.0; normal layers can be assigned relatively lower weights, such as a resolution weight of 0.8; and secondary layers can be assigned even lower weights, such as a resolution weight of 0.6.

[0051] After determining the resolution weights of each layer to be displayed, the output resolution of each layer can be determined based on the resolution weights and the display resolution of the display device.

[0052] Specifically, the output resolution can be calculated as: Output resolution = Display device display resolution × Resolution weight. This method ensures that the output resolution of at least some of the layers to be displayed (usually layers with lower importance and weight) is lower than the display device's display resolution. The resolution weight ranges from 0 to 1.

[0053] This disclosure directly links layer importance to output resolution. Layers with high importance are assigned higher resolution weights to ensure high-definition display, while layers with lower importance are assigned lower resolution weights to ensure lower output resolution. This avoids the excessive redundant calculations caused by rendering all layers at the highest resolution without affecting display quality, reducing rendering power consumption and improving rendering speed. Furthermore, the weight quantization logic makes the improvement in rendering efficiency more controllable. In addition, it avoids the resource redundancy problems caused by unreasonable resource allocation in existing technologies, achieving precise and efficient resource utilization.

[0054] Furthermore, in some embodiments, the step of determining the layer importance index of each layer to be displayed includes: determining the display accuracy requirement of the corresponding layer to be displayed based on at least one of the content characteristics, geometric distribution relationship and spatial overlay relationship of each layer to be displayed; and determining the layer importance index of each layer to be displayed based on the display accuracy requirement.

[0055] Specifically, this disclosure can determine the layer importance index of each layer to be displayed based on the clarity requirements of each layer, thereby determining an output resolution that matches the layer importance index for each layer. For example, for layers such as background layers, decoration layers, blur layers, and video preview layers, even if the clarity is low, it will not affect the overall display effect. Therefore, these layers only need to display content and do not have high clarity requirements, so their layer importance index can be set lower. On the other hand, for layers such as the main screen layer or layers that the user is interested in, various details need to be displayed to meet the display effect. These layers have high clarity requirements, so their layer importance index can be set higher to ensure the display effect.

[0056] In other words, the layer importance index can indicate the clarity requirement of the corresponding layer to be displayed. The higher the layer importance index, the higher the clarity of the display. Conversely, the higher the layer importance index, the lower the clarity of the display.

[0057] The richer the content features of a layer, the higher the required display accuracy.

[0058] In some embodiments, content features may include layer type and information density of the layer interface. Optionally, layer type may include main interface layer, video interface layer, focus interface layer, guide bar layer, control bar layer, and subtitle bar layer. The content richness of the corresponding layer can be determined based on its category, thereby determining the display accuracy requirements of the corresponding layer. For example, the main interface layer, video interface layer, and focus interface layer generally contain more content and are considered core layers, requiring higher display accuracy; while the guide bar layer, control bar layer, and subtitle layer contain simpler or fixed content, thus requiring lower display accuracy. Optionally, layer type can also be divided into text layers and background layers, where text layers generally contain richer content and have relatively higher display accuracy requirements. Of course, layer types can also be divided in other ways, and this disclosure does not limit this.

[0059] The information density of a layer interface refers to a quantitative indicator of the amount of effective information carried per unit display area, reflecting the balance between the richness of the layer content and its visual complexity.

[0060] This disclosure can also determine the richness of content features of a corresponding layer based on the information density of the layer interface. Specifically, the higher the information density of the layer interface, the richer the content of the corresponding layer to be displayed, and the higher the display accuracy requirement; conversely, the lower the information density of the layer interface, the simpler the content of the corresponding layer to be displayed, and the lower the display accuracy requirement. Furthermore, content features may also include the amount of pop-up information, the number of subtitles, etc. When determining the display accuracy requirement of a layer to be displayed based on its content features, this can be determined through the layer type and / or the information density of the layer interface within the content features.

[0061] In addition, geometric distribution relationships can include the complexity of the arrangement of layer elements and their size proportions, while spatial overlay relationships can include the overlay levels of layers, such as changing the layer to be displayed to the top display layer or the bottom background layer.

[0062] This disclosure can also determine the display accuracy requirements of layers to be displayed based on content characteristics, combined with the geometric distribution and / or spatial overlay relationships of each layer. A higher display accuracy requirement indicates that the layer needs higher display precision to ensure the accuracy of information transmission, corresponding to a higher layer importance index. For example, text-based and core function icon-based layers have key content characteristics and high spatial overlay levels, resulting in high display accuracy requirements and correspondingly higher importance levels; while solid color background layers have simple content and low spatial overlay levels, resulting in low display accuracy requirements and correspondingly lower importance levels.

[0063] The display accuracy requirement of the layer to be displayed can be determined by a correspondence table between at least one of the preset content features, geometric distribution relationships, and spatial overlay relationships and the display accuracy requirements of the layer to be displayed. Alternatively, it can be determined by a preset neural network model, which outputs the display accuracy requirement of the layer to be displayed by inputting at least one of the content features, geometric distribution relationships, and spatial overlay relationships of the layer to be displayed. Other methods are also possible, and this disclosure does not limit this approach. Furthermore, the display accuracy requirement can be represented by a quantified numerical value or by a requirement level classification, and this disclosure does not limit this approach either.

[0064] Of course, depending on the application scenario, the display accuracy requirements of the layers to be displayed can also be determined based on one or more of the content characteristics, geometric distribution relationships, and spatial overlay relationships of the layers to be displayed. Based on these display accuracy requirements, the layer importance index of each layer to be displayed can be determined; this disclosure does not limit this. Furthermore, the layer importance index of the layers to be displayed can also be determined based on one or more factors, including the display priority, the core content, and the user's focus. Layers with higher display priority, higher content core, and greater user attention have higher importance levels.

[0065] This embodiment of the disclosure improves the accuracy of display accuracy requirement determination by introducing at least one of the content features, geometric distribution relationships, and spatial overlay relationships of the layer to be displayed as the basis for determining display accuracy requirements. Furthermore, by using display accuracy requirements as the core basis for importance level classification, it ensures that the classification results align with the actual display requirements of the layers and enables reuse across different application scenarios and terminals, thus enhancing the versatility and operability of the solution.

[0066] In some embodiments, the output resolution corresponding to a layer to be displayed whose layer importance index is lower than a preset performance index is lower than the display resolution of the display device.

[0067] Specifically, when multiple layers to be displayed are output to a display device, the output resolution of each layer can be distinguished according to the layer importance index of each layer. Important layers are output at the display resolution of the display device, while unimportant layers are output at a resolution lower than the display resolution and enlarged for display on the display end. This significantly reduces the bandwidth of the layers to be displayed to the display device, and reduces rendering power consumption and rendering memory.

[0068] In some embodiments, a preset performance index can be set in advance. If the layer importance index of the layer to be displayed is lower than the preset performance index, it is indicated that the layer to be displayed is a non-important layer, thereby reducing its output resolution. The preset performance index can be determined based on different display requirements or application scenarios, and this disclosure does not limit it.

[0069] In some embodiments, preset performance metrics can be automatically selected based on different application scenarios. For example, in gaming scenarios, to prioritize smooth frame rates, the system can automatically adopt higher preset performance metrics, thereby reducing the resolution of non-critical layers; while in post-production film and television or professional design scenarios, a lower preset performance metric can be switched to retain more details and ensure output quality.

[0070] In addition, preset performance indicators can be determined based on the application scenario and actual display requirements.

[0071] Specifically, the initial performance level is first determined based on different application scenarios. Then, this initial level is adjusted based on specific display requirements to obtain the final preset performance index. For example, as mentioned above, in a game scenario, to prioritize smooth frame rates, the system can automatically adopt a higher preset performance index to reduce the resolution of non-critical layers. However, in practical applications, the detail requirements of game visuals are higher, thus requiring an increase in layer resolution. In this case, a higher initial level can be determined based on the game scenario, and then, based on actual needs, the level can be appropriately reduced from the initial level to meet image quality requirements, resulting in the final preset performance index.

[0072] In some embodiments, the preset performance indicators can also be adaptively adjusted based on hardware parameters such as the resolution and computing power of the current display device. For example, on a high-resolution display, the preset performance indicators can be appropriately reduced to fully utilize the display capabilities; while on a device with limited performance, the preset performance indicators can be increased to reduce the rendering burden and ensure system response speed.

[0073] Furthermore, the preset performance metrics can be dynamically updated based on real-time monitoring of system load, user focus areas (e.g., through eye tracking), or content changes. When the system detects a performance bottleneck or the user's gaze is focused on an important area, the preset performance metrics can be temporarily adjusted to ensure high-quality display of critical layers while sacrificing the resolution of secondary layers. This disclosure does not limit the determination of the preset performance metrics.

[0074] In addition, the display capabilities of the display device also affect the output resolution of the layer to be displayed.

[0075] In some embodiments, the step of determining the output resolution for each layer to be displayed includes: receiving display capability information reported by the display device; and determining the output resolution of each layer to be displayed based on the display capability information; wherein the display capability information includes at least one of the following: the maximum number of layers supported by the display device, the data output format supported by each layer, and scaling processing capability.

[0076] Specifically, the maximum number of layers supported by the display device refers to the number of layers that the display device can process simultaneously, which determines whether the rendering end needs to merge or transmit the layers to be displayed separately; the data output format determines the encoding format selection of the rendering end, thereby ensuring that it can be accurately recognized and displayed in the display device; the scaling processing capability determines the range of output resolution, so as to ensure that the display device can scale the layer data of the corresponding output resolution to the display resolution, ensuring the normal display of the layers to be displayed.

[0077] Furthermore, this disclosure can also determine the output resolution of each layer to be displayed based on display capability information and layer importance indicators.

[0078] Specifically, this disclosure can determine the initial output resolution of each layer to be displayed based on the layer importance index, and determine the range of output resolution based on the scaling processing capability in the display capability information. Then, it determines whether the initial output resolution is within the range. If the initial output resolution is within the range, it is converted into the output format in the display capability information to obtain the final output resolution. If the initial output resolution is not within the range, it is mapped to the range through a preset mapping relationship or a preset activation function, and the mapped resolution is converted into the output format in the display capability information to obtain the final output resolution.

[0079] In this embodiment of the disclosure, by receiving display capability information reported by the display device and dynamically determining the output resolution of each layer to be displayed based on the information, the rendering end can reversely determine the optimal output resolution based on the actual processing capability of the display device.

[0080] Furthermore, the output resolution of each layer to be displayed can be updated in real time to meet the display effect requirements of the layer to be displayed in different scenarios.

[0081] In some embodiments, the method further includes: monitoring state change information of each layer to be displayed; wherein the state change information includes at least one of user interaction state or static state; and dynamically adjusting the output resolution of the corresponding layer to be displayed based on the state change information.

[0082] In some embodiments, dynamically adjusting the output resolution of the corresponding layer to be displayed based on state change information includes: increasing the output resolution of the corresponding layer to be displayed when the layer to be displayed is in a user interactive state; and decreasing the output resolution of the corresponding layer to be displayed when the layer to be displayed is in a static state.

[0083] Specifically, during the operation of the display system, each layer to be displayed is not always in a fixed state; its state changes dynamically with user operations, system commands, or its own data updates. This disclosure can capture the state change information of each layer to be displayed in real time through a preset monitoring mechanism, thereby dynamically adjusting the corresponding output resolution based on the state change information. The user interaction state refers to the state in which the layer to be displayed is receiving or responding to user operations and is in a dynamic interaction process. In this state, the layer needs to maintain a high display clarity to ensure that the user can clearly identify the interactive content and obtain a smooth operating experience. Therefore, it is necessary to automatically increase the corresponding output resolution. In some embodiments, user interaction operations include, but are not limited to: clicking buttons within the layer, entering text, dragging the layer, scaling the layer, sliding the layer content, hovering operations, etc. As long as the layer is triggered by any perceptible interactive behavior by the user, it is determined that the layer is in a user interaction state.

[0084] The static state refers to a layer that has not received any user interaction and whose content has not been updated. It is in a stable and static display state. In this state, the requirements for display clarity can be appropriately reduced, and the system resource consumption can be reduced by lowering the output resolution.

[0085] This disclosure allows for the pre-setting of a mapping table between various state change information and corresponding output resolution adjustment values, and the dynamic adjustment of the output resolution of the corresponding layer to be displayed by looking up the table. Furthermore, the output resolution adjustment value can be positive, negative, or zero. A positive output resolution adjustment value indicates that the output resolution needs to be increased; conversely, a negative value of zero indicates that no adjustment is needed. Alternatively, this disclosure can also be based on a pre-set neural network model, directly outputting the corresponding adjustment value by inputting the state change information of the layer to be displayed, and adjusting the output resolution based on that value.

[0086] This disclosure monitors the state changes of each layer to be displayed and maintains a high output resolution during user interaction to ensure that the interactive content is clearly distinguishable and avoid operational errors caused by low resolution. In the static state, it reduces the output resolution to reduce unnecessary computing power consumption, data transmission bandwidth and system power consumption, thereby achieving on-demand adaptation of the output resolution of the layers to be displayed.

[0087] The display data processing method provided in this disclosure determines different output resolutions for each layer to be displayed, with at least some layers having output resolutions smaller than the display resolution of the display device, and renders them separately according to these differentiated resolutions. This avoids the large amount of redundant computation caused by rendering all layers at the highest resolution, reduces resource consumption during rendering, lowers rendering power consumption, and speeds up rendering. Furthermore, the layer data corresponding to the lower output resolution layers is smaller, which effectively reduces the amount of data transmitted during transmission to the display device, lowers the demand for transmission bandwidth, and improves the stability and efficiency of data transmission.

[0088] Furthermore, in multi-layer output, different layers have different importance and weight, and different requirements for display effect. This disclosure introduces the concept of layer importance, maintaining the true resolution output for important layers, and sending and enlarging the display of unimportant layers at a low resolution, so as to significantly reduce the display link bandwidth and power consumption without significantly affecting the visual experience. Moreover, layers of different importance can be scaled differently for output, allowing for fine-grained control over each layer.

[0089] Based on the same inventive concept as the above-described display data processing method, this disclosure also provides a display data processing method applied to a display device.

[0090] Figure 4 A flowchart of a display data processing method for a display device provided in this disclosure is shown below. Figure 4 As shown, the method includes: Step 401: Receive layer data corresponding to the output resolution of each layer to be displayed.

[0091] Each layer's data is generated by rendering according to the output resolution of the corresponding layer to be displayed, and at least some of the layers to be displayed have an output resolution lower than the display resolution of the display device; the layer data with an output resolution lower than the display resolution of the display device are subjected to resolution upscaling processing to generate updated layer data.

[0092] Step 402: Based on the layer data corresponding to the output resolution of each layer to be displayed and the updated layer data.

[0093] Step 403: Display each layer to be displayed at the display resolution.

[0094] The specific details and technical effects of the display data processing method applied to the display device provided in the embodiments of this disclosure are similar to the embodiments of the above-mentioned display data processing methods, and will not be repeated here.

[0095] The data processing method disclosed herein, after the display device receives layer data, can perform resolution upscaling on the low-output-resolution layer data to be displayed, making the upscaled layer data compatible with the display resolution of the display device. This avoids problems such as blurring and size mismatch caused by directly displaying low-resolution layers, ensuring that all layers to be displayed can be displayed normally, meeting actual display requirements, and not affecting the user experience due to reduced resolution. Specifically, the layer data is obtained by determining different output resolutions for each layer to be displayed and rendering them separately according to these differentiated resolutions. At least some layers to be displayed are assigned output resolutions smaller than the display resolution of the display device, avoiding the large amount of redundant computation caused by rendering all layers at the highest resolution, reducing resource consumption during rendering, lowering rendering power consumption, and accelerating rendering speed. This method is particularly suitable for display processing scenarios with multiple layers and complex scenes. Furthermore, the layer data volume corresponding to low-output-resolution layers is smaller, effectively reducing the amount of data transmitted during transmission to the display device, lowering the demand for transmission bandwidth, avoiding transmission stuttering and delays caused by transmitting large amounts of high-resolution data, and improving the stability and efficiency of data transmission.

[0096] Based on the same inventive concept as the above-described display data processing method, this disclosure also provides a display data processing apparatus.

[0097] Figure 5 This is a structural block diagram of a display data processing device provided in an embodiment of the present disclosure.

[0098] Further reference Figure 5 As an implementation of the methods shown in the above figures, this device embodiment is similar to... Figure 3 Corresponding to the method embodiments shown, this device can be specifically applied to various electronic devices.

[0099] like Figure 5 As shown, the device includes a determining module 501, a rendering module 502, and a sending module 503. The determining module 501 is configured to determine the output resolution for each layer to be displayed. At least some of the layers to be displayed have output resolutions lower than the display resolution of the display device. The rendering module 502 is configured to render the corresponding layers according to their output resolutions, generating layer data corresponding to the output resolutions of each layer. The sending module 503 is configured to send the layer data to the display device, so that the display device can perform resolution upscaling on the layer data with output resolutions lower than the display resolution before displaying it.

[0100] In this embodiment, the specific processing of the determination module 501, rendering module 502, and sending module 503 in the display data processing device, and the resulting technical effects, can be referred to respectively. Figure 3The relevant descriptions of steps 301-303 in the corresponding embodiments will not be repeated here.

[0101] In some embodiments, the determining module 501 is specifically configured to determine the layer importance index of each layer to be displayed; assign a corresponding resolution weight to each layer to be displayed according to the layer importance index; and determine the output resolution of each layer to be displayed based on the resolution weight and the display resolution of the display device.

[0102] In some embodiments, the determining module 501 is specifically configured to determine the display accuracy requirement of the corresponding layer to be displayed based on at least one of the content characteristics, geometric distribution relationship and spatial overlay relationship of each layer to be displayed; and to determine the layer importance index of each layer to be displayed based on the display accuracy requirement.

[0103] In some embodiments, the output resolution of the layer to be displayed that has a layer importance or other performance metric lower than a preset value is less than the display resolution of the display device.

[0104] In some embodiments, the determining module 501 is specifically configured to receive display capability information reported by the display device; and determine the output resolution of each layer to be displayed based on the display capability information; wherein the display capability information includes at least one of the following: the maximum number of layers supported by the display device, the data output format supported by each layer, and scaling processing capability.

[0105] In some embodiments, the display data processing device includes not only the determination module 501, the rendering module 502, and the sending module 503, but also an adjustment module, which is configured to monitor the state change information of each layer to be displayed; wherein the state change information includes at least one of user interaction state or static state; and dynamically adjust the output resolution of the corresponding layer to be displayed according to the state change information.

[0106] The specific implementation details and technical effects of the display data processing device embodiments provided in this disclosure are the same as the implementation details and technical effects of the display data processing method embodiments described above, and will not be repeated here.

[0107] This embodiment exists as a device embodiment corresponding to the above method embodiment. The display data processing device provided in this embodiment determines different output resolutions for each layer to be displayed, and at least some layers to be displayed are determined to have output resolutions smaller than the display resolution of the display device, and renders them separately according to the differentiated resolutions. This avoids the large amount of redundant calculations caused by rendering all layers at the highest resolution, reduces resource consumption during the rendering process, lowers rendering power consumption, and speeds up the rendering process. In addition, the layer data corresponding to the low output resolution layers to be displayed is smaller, which can effectively reduce the amount of data transmitted during the process of sending to the display device, reduce the demand for transmission bandwidth, and improve the stability and efficiency of data transmission. Furthermore, after receiving the layer data, the display device can also perform resolution upscaling processing on the low output resolution layer data to be displayed, so that the upscaled layer data is adapted to the display resolution of the display device. This can avoid problems such as blurring and size mismatch caused by directly displaying low resolution layers, ensuring that all layers to be displayed can be displayed normally, meeting actual display needs, and not affecting the user experience due to reduced resolution.

[0108] Based on the same inventive concept as the above-described display data processing method, this disclosure also provides a data processing system.

[0109] Figure 6 This is a structural block diagram of a data processing system provided in an embodiment of the present disclosure.

[0110] Figure 7 This is a schematic diagram of a data processing system provided in an embodiment of the present disclosure.

[0111] See Figures 6-7 The system includes a display data processing device 601 and a display device 602. The display data processing device 601 is as described in any of the above embodiments, and the display device 602 is configured to perform resolution upscaling processing on layer data whose output resolution is lower than the display resolution of the display device, and to display each layer at its own resolution.

[0112] The display data processing device 601 processes the layers 101 to be displayed (including layers 1, 2, 3, 4, 5, and 6) to generate layer data corresponding to each layer element, and sends the layer data to the display device 602, so that the display device 602 can display the layers to be displayed based on the layer data. The specific processing procedure of the display data processing device 601 to process each layer to be displayed and the resulting technical effects can be found in the corresponding method embodiments described above, and will not be repeated here.

[0113] In some embodiments, the layer data of the layer to be displayed includes first layer data and second layer data, and the first layer data is layer data with an output resolution lower than the display resolution.

[0114] like Figure 7 As shown, the display device 602 includes a display controller 103 and a display 104. The display controller 103 is configured to perform resolution upscaling processing on the first layer data based on the display resolution to generate updated layer data; wherein the resolution corresponding to the updated layer data is the display resolution. The display 104 is configured to display each layer to be displayed at the display resolution based on the second layer data and the updated layer data.

[0115] Specifically, the first layer data is layer data with an output resolution lower than the display resolution. The display controller 103 can enlarge the first layer data to the display resolution, so that the resolution of the layer data of each layer to be displayed is the display resolution, and the display 104 can display each layer to be displayed normally at the display resolution.

[0116] In some embodiments, the display controller 103 includes a scaling unit 113 and an output control unit 123. The scaling unit 113 is configured to receive first layer data and, based on the display resolution, perform resolution scaling on the first layer data to generate updated layer data; the output control unit 123 is configured to receive second layer data and the updated layer data, and send the second layer data and the updated layer data to the display 104.

[0117] Specifically, such as Figure 7 As shown, the output resolutions of layers 1, 2, 4, 5, and 6 in layer 101 to be displayed are all lower than the display resolution, while the output resolution of layer 3 is adapted to the display resolution of monitor 104. Therefore, the display data processing device 601 sends the layer data corresponding to layers 1, 2, 4, 5, and 6 in layer 101 to the scaling unit 113 for resolution magnification. After the scaling unit 113 completes the magnification process, the generated updated layer data is then sent to the output control unit 123. The layer data of layer 3 does not need to be magnified and can be directly sent to the output control unit 123, which then sends the layer data with the display resolution (i.e., the second layer data and the updated layer data) to the monitor 104 for display.

[0118] In some embodiments, the display device 602 is further configured to report display capability information of the display device 602 to the display data processing device 601; the determining module in the display data processing device 601 is further configured to determine the output resolution of each layer to be displayed based on the display capability information; wherein the display capability information includes at least one of the following: the maximum number of layers supported by the display device 602, the data output format supported by each layer, and the scaling processing capability of the display controller.

[0119] Other implementation details of the data processing system provided in this disclosure and its resulting technical effects can be found in the corresponding embodiments above, and will not be repeated here.

[0120] The data processing system disclosed herein determines different output resolutions for each layer to be displayed through a display data processing device, and at least some layers are assigned output resolutions smaller than the display resolution of the display device. These layers are then rendered separately according to their differentiated resolutions. This avoids the excessive redundant computations caused by rendering all layers at the highest resolution, reduces resource consumption during rendering, lowers rendering power consumption, and accelerates rendering speed. Furthermore, the lower output resolution layers correspond to smaller layer data volumes, effectively reducing the amount of data transmitted during transmission to the display device, lowering bandwidth requirements, and improving data transmission stability and efficiency. Moreover, after receiving the layer data, the display device can further enlarge the lower output resolution layer data to match the display device's resolution. This avoids problems such as blurring and size mismatch caused by directly displaying low-resolution layers, ensuring that all layers can be displayed correctly, meeting actual display requirements, and preventing user experience issues caused by reduced resolution.

[0121] According to embodiments of the present disclosure, the present disclosure also provides an electronic device, the electronic device comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to implement the display data processing method described in any of the above embodiments when executed.

[0122] Figure 8 This is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of this disclosure. For example... Figure 8As shown, the electronic device 800 of this embodiment includes a processor 801 and a memory 802; wherein, the memory 802 is used to store computer execution instructions; the processor 801 is used to execute the computer execution instructions stored in the memory to implement the various steps performed by the electronic device in the above embodiment. For details, please refer to the relevant descriptions in the foregoing method embodiments. For example, the electronic device 800 can be a general-purpose processor, a graphics processing device, a neural network computing device, or a graph neural network computing device.

[0123] In some embodiments, the memory 802 can be either standalone or integrated with the processor 801.

[0124] When the memory 802 is set up independently, the electronic device also includes a bus 803 for connecting the memory 802 and the processor 801.

[0125] It should be understood that the processor 801 described above can be a Central Processing Unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), etc. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the method disclosed in this invention can be directly manifested as being executed by a hardware processor, or being executed by a combination of hardware and software modules within the processor.

[0126] The memory 802 may include high-speed RAM memory, and may also include non-volatile memory NVM, such as at least one disk storage device, and may also be a USB flash drive, portable hard drive, read-only memory, disk or optical disc, etc.

[0127] Bus 803 can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. Buses can be categorized as address buses, data buses, control buses, etc. For ease of illustration, the buses shown in the accompanying drawings are not limited to a single bus or a single type of bus.

[0128] This disclosure also provides a computer storage medium storing computer execution instructions, which, when executed by a processor, implement the steps of the display data processing method in any of the above method embodiments.

[0129] This disclosure also provides a computer program product, including a computer program that, when executed by a processor, implements the steps of the display data processing method according to any of the above embodiments.

[0130] In the several embodiments provided by this invention, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative; for instance, the division of modules is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple modules may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be indirect coupling or communication connection through some interfaces, devices, or modules, and may be electrical, mechanical, or other forms.

[0131] The modules described as separate components may or may not be physically separate. The components shown as modules may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to implement the solution of this embodiment according to actual needs.

[0132] Furthermore, the functional modules in the various embodiments of the present invention can be integrated into one processing unit, or each module can exist physically separately, or two or more modules can be integrated into one unit. The unit composed of the above modules can be implemented in hardware or in the form of hardware plus software functional units.

[0133] The integrated modules described above, implemented as software functional modules, can be stored in a computer-readable storage medium. These software functional modules, stored in a storage medium, include several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) or processor to execute partial steps of the methods in the various embodiments of this application.

[0134] The aforementioned storage medium can be implemented from any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk. The storage medium can be any available medium accessible to general-purpose or special-purpose computers.

[0135] An exemplary storage medium is coupled to a processor, enabling the processor to read information from and write information to the storage medium. Alternatively, the storage medium can be an integral part of the processor. Both the processor and the storage medium can reside in an Application Specific Integrated Circuit (ASIC). Alternatively, the processor and storage medium can exist as discrete components in an electronic device or host device.

[0136] Those skilled in the art will understand that all or part of the steps of the above-described method embodiments can be implemented by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When executed, the program performs the steps of the above-described method embodiments; and the aforementioned storage medium includes various media capable of storing program code, such as ROM, RAM, magnetic disks, or optical disks.

[0137] In the above embodiments, the descriptions of each embodiment have their own emphasis. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments. The technical features of the above embodiments can be combined arbitrarily. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as the combination of these technical features does not contradict each other, it should be considered within the scope of this specification.

[0138] It should be understood that the various forms of processes shown above can be used to rearrange, add, or delete steps. For example, the steps described in this disclosure can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution disclosed in this disclosure can be achieved, and this is not limited herein.

[0139] The specific embodiments described above do not constitute a limitation on the scope of protection of this disclosure. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this disclosure should be included within the scope of protection of this disclosure.

Claims

1. A method for processing display data, characterized in that, The method includes: Determine the output resolution for each layer to be displayed; wherein, at least some of the layers to be displayed have an output resolution that is less than the display resolution of the display device; According to the output resolution of each layer to be displayed, render the corresponding layer to be displayed to generate layer data corresponding to the output resolution of each layer to be displayed. The layer data is sent to the display device so that the display device can display the layer data after performing resolution upscaling on the layer data whose output resolution is smaller than the display resolution of the display device.

2. The method according to claim 1, characterized in that, Determining the output resolution for each layer to be displayed includes: Determine the layer importance index for each of the layers to be displayed; The output resolution of each layer to be displayed is determined based on the layer importance index.

3. The method according to claim 2, characterized in that, The step of determining the output resolution of each layer to be displayed based on the layer importance index includes: Based on the layer importance index, assign corresponding resolution weights to each of the layers to be displayed; The output resolution of each layer to be displayed is determined based on the resolution weight and the display resolution of the display device.

4. The method according to claim 2, characterized in that, The determination of the layer importance index for each of the layers to be displayed includes: Based on at least one of the content characteristics, geometric distribution relationship, and spatial overlay relationship of each layer to be displayed, determine the display accuracy requirement of the corresponding layer to be displayed; Based on the aforementioned display accuracy requirements, the layer importance index for each of the layers to be displayed is determined.

5. The method according to any one of claims 2-4, characterized in that, The output resolution corresponding to the layer to be displayed whose importance index is lower than the preset performance index is lower than the display resolution of the display device.

6. The method according to any one of claims 1-4, characterized in that, Determining the output resolution for each layer to be displayed includes: Receive display capability information reported by the display device; Based on the display capability information, determine the output resolution of each layer to be displayed; The display capability information includes at least one of the following: the maximum number of layers supported by the display device, the data output format supported by each layer, and scaling processing capability.

7. The method according to claim 6, characterized in that, The method further includes: Monitor the state change information of each of the layers to be displayed; wherein the state change information includes at least one of user interaction state or static state; Based on the state change information, the output resolution of the corresponding layer to be displayed is dynamically adjusted.

8. The method according to claim 7, characterized in that, The step of dynamically adjusting the output resolution of the corresponding layer to be displayed based on the state change information includes: When the layer to be displayed is in the user interaction state, increase the output resolution of the layer to be displayed; When the layer to be displayed is in the static state, reduce the output resolution of the layer to be displayed.

9. A method for processing display data, characterized in that, Applied to a display device, the method includes: Receive layer data corresponding to the output resolution of each layer to be displayed; wherein each layer data is generated by rendering according to the output resolution of the corresponding layer to be displayed, and at least some of the output resolutions of the layers to be displayed are smaller than the display resolution of the display device; The layer data with an output resolution lower than the display resolution of the display device is subjected to resolution upscaling processing to generate updated layer data; Based on the layer data corresponding to the output resolution of each layer to be displayed and the updated layer data, each layer to be displayed is displayed at the specified display resolution.

10. A display data processing device, characterized in that, The device includes: The determining module is configured to determine the output resolution for each layer to be displayed; wherein at least some of the layers to be displayed have an output resolution that is less than the display resolution of the display device. The rendering module is configured to render the corresponding layers to be displayed according to the output resolution of each layer to be displayed, and generate layer data corresponding to the output resolution of each layer to be displayed. The sending module is configured to send the layer data to the display device so that the display device displays the layer data after performing resolution upscaling on the layer data whose output resolution is smaller than the display resolution.

11. A data processing system, characterized in that, The system includes: The display data processing apparatus as described in claim 10; The display device is configured to perform resolution upscaling on layer data whose output resolution is smaller than the display resolution of the display device, and to display each of the layers to be displayed at the display resolution.

12. The system according to claim 11, characterized in that, The layer data of the layer to be displayed includes first layer data and second layer data, and the first layer data is layer data with an output resolution smaller than the display resolution; The display device includes: The display controller is configured to perform resolution upscaling on the first layer data based on the display resolution to generate updated layer data; wherein the resolution corresponding to the updated layer data is the display resolution; The display is configured to display each of the layers to be displayed at the display resolution based on the second layer data and the updated layer data.

13. The system according to claim 12, characterized in that, The display controller includes: The scaling unit is configured to receive the first layer data and, based on the display resolution, perform resolution scaling on the first layer data to generate updated layer data. The output control unit is configured to receive the second layer data and the updated layer data, and to send the second layer data and the updated layer data to the display.

14. The system according to any one of claims 11-13, characterized in that, The display device is also configured to report display capability information of the display device to the display data processing device; The determining module is further configured to determine the output resolution of each layer to be displayed based on the display capability information; The display capability information includes at least one of the following: the maximum number of layers supported by the display device, the data output format supported by each layer, and the scaling processing capability of the display controller.

15. An electronic device, characterized in that, include: At least one processor; as well as A memory that is communicatively connected to the at least one processor; The memory stores instructions that can be executed by the at least one processor, which, when executed by the at least one processor, enables the at least one processor to perform the display data processing method according to any one of claims 1-8.

16. A non-transitory computer-readable storage medium storing computer instructions, characterized in that, The computer instructions are used to cause the computer to perform the display data processing method according to any one of claims 1-8.

Images