Display method, device, equipment and chip

Abstract

The invention relates to a display method and device, equipment and a chip. The method comprises the following steps: receiving layer information of a to-be-processed layer sent by a graphics processing unit (GPU); determining a target super-resolution multiple according to the layer information; determining a rendering resolution according to the target super-resolution multiple and the display resolution; sending the rendering resolution to a GPU, so that the GPU generates a rendered image according to the rendering resolution and the to-be-processed layer; and performing super-magnification display on the rendered image based on the target super-resolution multiple. By adopting the method, the optimal balance between the performance and the display effect is realized.

Description

Technical Field

[0001] This application relates to the field of display technology, and in particular to a display method, apparatus, device, and chip. Background Technology

[0002] With the development of display technology, electronic devices need to process and synthesize increasingly complex visual layers. In this process, the system often needs to perform rendering, merging, and display of visual layers to provide a clear and smooth visual experience.

[0003] However, traditional display processing often employs fixed or predefined scaling strategies. This can lead to compromised final presentation in complex display scenarios, while in simpler scenarios, it results in unnecessary waste of chip computing resources. Summary of the Invention

[0004] Therefore, it is necessary to provide a display method, device, equipment, and chip to address the aforementioned technical problems, thereby achieving an optimized balance between performance and display effect.

[0005] In a first aspect, this application provides a display method applied to a data processing unit (DPU), comprising:

[0006] Receive layer information of the layer to be processed sent by the graphics processing unit (GPU);

[0007] Determine the target super-resolution factor based on the layer information;

[0008] Determine the rendering resolution based on the target super-resolution factor and the display resolution;

[0009] The rendering resolution is sent to the GPU so that the GPU can generate a rendered image based on the rendering resolution and the layer to be processed;

[0010] Based on the target super-resolution factor, the rendered image is super-magnified for display.

[0011] In one embodiment, the layer information of the layer to be processed includes the layer number of the layer to be processed and the layer overlap area corresponding to the layer to be processed; accordingly, based on the layer information, the target super-resolution factor is determined, including: determining the target layer number range to which the layer number belongs, and the target area range to which the layer overlap area belongs; and determining the target super-resolution factor that matches the target layer number range and the target area range according to a preset matching relationship.

[0012] In one embodiment, determining a target super-resolution factor that matches the target layer range and the target area range according to a preset matching relationship includes: determining an initial super-resolution factor that matches the target layer range and the target area range according to the preset matching relationship; in response to at least one candidate super-resolution factor including the initial super-resolution factor, using the initial super-resolution factor as the target super-resolution factor; in response to at least one candidate super-resolution factor not including the initial super-resolution factor, selecting the target super-resolution factor from at least one candidate super-resolution factor based on the initial super-resolution factor.

[0013] In one embodiment, determining the rendering resolution based on the target super-resolution factor and the display resolution includes: determining the ratio between the display resolution and the target super-resolution factor; and determining the rendering resolution based on the ratio.

[0014] Secondly, this application provides a display method applied to a graphics processing unit (GPU), comprising:

[0015] The layer information of the layer to be processed is sent to the data processing unit (DPU) so that the DPU can determine the rendering resolution based on the display resolution and the target super-resolution multiple determined based on the layer information.

[0016] Generate a rendered image based on the rendering resolution and the layer to be processed;

[0017] The rendered image is sent to the DPU so that the DPU can perform super-resolution upscaling of the rendered image based on the target super-resolution factor.

[0018] In one embodiment, generating a rendered image based on the rendering resolution and the layer to be processed includes at least one of the following: obtaining a target processing layer corresponding to the target super-resolution multiple, and performing layer compositing on the target processing layer to obtain a rendered image; the target processing layer is obtained by adjusting the size of the layer to be processed based on the rendering resolution corresponding to the target super-resolution multiple; and performing layer compositing on the layer to be processed at the rendering resolution to obtain a rendered image.

[0019] Thirdly, this application also provides a display device configured in a data processing unit (DPU), comprising:

[0020] The receiving module is used to receive layer information of the layer to be processed sent by the graphics processing unit (GPU).

[0021] The first determining module is used to determine the target super-resolution factor based on the layer information;

[0022] The second determining module is used to determine the rendering resolution based on the target super-resolution multiplier and the display resolution;

[0023] The first sending module is used to send the rendering resolution to the GPU so that the GPU can generate a rendering image based on the rendering resolution and the layer to be processed;

[0024] The processing module is used to perform super-resolution magnification and display of the rendered image based on the target super-resolution factor.

[0025] Fourthly, this application also provides a display device configured on a graphics processing unit (GPU), comprising:

[0026] The second sending module is used to send the layer information of the layer to be processed to the data processing unit (DPU), so that the DPU can determine the rendering resolution based on the display resolution and the target super-resolution multiple determined based on the layer information.

[0027] The generation module is used to generate a rendered image based on the rendering resolution and the layer to be processed;

[0028] The third sending module is used to send the rendered image to the DPU so that the DPU can perform super-resolution magnification and display of the rendered image based on the target super-resolution factor.

[0029] Fifthly, this application also provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to implement the methods described in the first or second aspect above.

[0030] Sixthly, this application also provides a chip, including a processor and a communication interface, wherein the processor is configured to cause the chip to perform the steps of the methods provided in the first or second aspect above.

[0031] Seventhly, this application also provides a chip module, including a communication module, a power module, a storage module, and a chip, wherein:

[0032] The power module is used to provide power to the chip module;

[0033] Storage modules are used to store data and instructions;

[0034] The communication module is used for internal communication within the chip module, or for communication between the chip module and external devices;

[0035] The chip is used to perform the steps of the method provided in the first or second aspect above.

[0036] Eighthly, this application also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the methods of the first or second aspect described above.

[0037] Ninthly, this application also provides a computer program product, including a computer program that, when executed by a processor, implements the methods of the first or second aspect described above.

[0038] The aforementioned display method, apparatus, device, and chip, by receiving layer information of the layer to be processed from the graphics processing unit (GPU), can quantify the complexity of the layer to be processed, providing a data foundation for subsequent differentiated rendering and super-resolution upscaling decisions. By determining the target super-resolution factor based on the layer information, a matching target super-resolution factor can be adaptively determined based on the objective complexity of the scene. By sending the rendering resolution to the GPU, the GPU generates a rendered image that matches the scene requirements based on the rendering resolution and the layer to be processed. By super-upscaling the rendered image based on the target super-resolution factor, an adaptive balance between display quality and rendering efficiency is achieved, that is, an optimized balance between performance and display effect is achieved. Attached Figure Description

[0039] To more clearly illustrate the technical solutions in the embodiments of this application or related technologies, the drawings used in the description of the embodiments of this application or related technologies will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.

[0040] Figure 1 This is a diagram illustrating the application environment of the method in one embodiment;

[0041] Figure 2 This is a flowchart illustrating the method in one embodiment;

[0042] Figure 3 This is a flowchart illustrating the method in another embodiment;

[0043] Figure 4A This is a flowchart illustrating the steps for determining the target super-resolution factor in one embodiment;

[0044] Figure 4B This is a flowchart illustrating the steps for determining the target super-resolution factor in another embodiment;

[0045] Figure 4C This is a flowchart illustrating the steps for determining the target super-resolution factor in yet another embodiment;

[0046] Figure 5 This is a schematic diagram of the model structure of the target processing model in one embodiment;

[0047] Figure 6A timing diagram illustrating the method in one embodiment;

[0048] Figure 7 This is a structural block diagram of a display device in one embodiment;

[0049] Figure 8 This is a structural block diagram of the display device in another embodiment;

[0050] Figure 9 This is an internal structural diagram of a computer device in one embodiment;

[0051] Figure 10 This is an internal structure diagram of a chip module in one embodiment. Detailed Implementation

[0052] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.

[0053] The terms "comprising" and "having," and any variations thereof, as used in this application, are intended to cover non-exclusive inclusion. The term "multiple" as used in this application refers to two or more. The term "and / or" as used in this application refers to one of the embodiments, or any combination of multiple embodiments.

[0054] The display method provided in this application embodiment can be applied to, for example, Figure 1 In the application environment shown, the data processing unit (DPU) 102 is connected to the graphics processing unit (GPU) 104 for collaborative processing to display the layer to be processed. The data processing unit 102 and the graphics processing unit 104 can be deployed in an electronic device, which can be, but is not limited to, various personal computers, laptops, smartphones, tablets, IoT devices, and portable wearable devices. IoT devices can include in-vehicle displays and projection devices; portable wearable devices can include smartwatches, smart bracelets, and head-mounted devices.

[0055] The graphics processor 104 can send layer information of the layer to be processed to the data processing unit 102; the data processing unit 102 determines the target super-resolution factor based on the layer information, and determines the rendering resolution based on the target super-resolution factor and the display resolution; the graphics processor 104 generates a rendered image based on the rendering resolution and the layer to be processed; the data processing unit 102 performs super-resolution magnification display on the rendered image based on the target super-resolution factor.

[0056] Understandably, by receiving layer information from the graphics processor (GPU) about the layers to be processed, the complexity of those layers can be quantified, providing a data foundation for subsequent differentiated rendering and super-resolution scaling decisions. By determining the target super-resolution factor based on the layer information, a matching target super-resolution factor can be adaptively determined based on the objective complexity of the scene. By sending the rendering resolution to the GPU, the GPU generates a rendered image that matches the scene requirements based on the rendering resolution and the layers to be processed. By super-scaling the rendered image based on the target super-resolution factor, an adaptive balance between display quality and rendering efficiency is achieved, that is, an optimized balance between performance and display effect.

[0057] In one exemplary embodiment, such as Figure 2 As shown, a display method is provided, which is applied to Figure 1 The following steps are used as an example to illustrate the process of data processing unit 102, or a chip / chip module with data processing capabilities:

[0058] S210: Receive layer information of the layer to be processed sent by the graphics processing unit (GPU).

[0059] Among them, layer information can be understood as data used to describe the layer structure of the layer to be processed, and is used to quantify the load type and processing load of the rendering scene.

[0060] For example, the layer information of the layer to be processed may include the number of layers in the layer to be processed and the layer overlap area corresponding to the layer to be processed. The layer overlap area can be understood as the sum of the overlap areas between adjacent layers in the layer to be processed. Optionally, the graphics processor can determine the overlap area between adjacent layers in the layer to be processed; and sum the overlap areas to obtain the layer overlap area. The number of layers reflects the complexity of the compositing and the scale of resources that the system needs to allocate; the layer overlap area characterizes the degree of spatial occlusion and blending between layers. A larger layer overlap area indicates more intensive pixel-level blending calculations and higher requirements for rendering processing capabilities.

[0061] S220. Determine the target super-resolution factor based on the layer information.

[0062] The target super-resolution factor, also known as the target SR (Super Resolution) factor, is used to characterize the linear scaling ratio between the number of pixels in the output image in the spatial dimension and the number of pixels in the input image in the corresponding dimension.

[0063] In an optional embodiment, layer information can be input into a super-resolution scaling determination model to obtain a target super-resolution scaling that matches the layer information. The super-resolution scaling determination model can be a traditional machine learning model or a neural network model, and this application does not impose any limitations on it. For example, when training the super-resolution scaling determination model, sample layer information can be input into the model. Based on the super-resolution scaling prediction results output by the model and the super-resolution scaling labels corresponding to the sample layer information, the model is trained to improve its accuracy.

[0064] In another optional embodiment, a correlation function can be pre-constructed with the number of layers and the layer overlap area as independent variables and the target super-resolution factor as the dependent variable; and the corresponding target super-resolution factor can be determined based on the correlation function and the received number of layers and layer overlap area. For example, the correlation function can be obtained by fitting sample data, including the number of sample layers, the sample layer overlap area, and the corresponding sample super-resolution factor. This application does not limit the specific construction method of the correlation function.

[0065] In another optional embodiment, the target layer number range and the target area range of the layer overlap area can be determined; based on a preset matching relationship, a target super-resolution factor matching the target layer number range and the target area range is determined. The preset matching relationship can be set by a technician based on needs or experience, or determined through extensive experimentation; this application does not impose any limitations on it.

[0066] For example, the preset matching relationship may include a preset matching table, which includes super-resolution multiples corresponding to different two-dimensional interval ranges. The two-dimensional interval ranges include a range of layer counts and an area range. Optionally, the target super-resolution multiple corresponding to the target range of layer counts and the target area range can be queried from the preset matching table.

[0067] Optionally, a comprehensive logic value can be determined based on the target number of layers and the layer overlap area; the target super-resolution factor can then be determined based on the comprehensive logic value. For example, a comprehensive logic value of 1 indicates a target super-resolution factor of 2; a comprehensive logic value of 3 indicates a target super-resolution factor of 2; and a comprehensive logic value of 5 indicates a target super-resolution factor of 4.

[0068] Optionally, an initial super-resolution factor matching the target layer range and target area range can be determined based on a preset matching relationship; in response to at least one candidate super-resolution factor including the initial super-resolution factor, the initial super-resolution factor is used as the target super-resolution factor; in response to at least one candidate super-resolution factor not including the initial super-resolution factor, the target super-resolution factor is selected from at least one candidate super-resolution factor based on the initial super-resolution factor. For example, candidate super-resolution factors can be understood as pre-configured, available super-resolution factors, which can be determined based on chip performance.

[0069] In another optional embodiment, the graphics processor can be used to determine the layer processing computation amount corresponding to different super-resolution ratios for the layer information, thereby determining a target super-resolution ratio that matches the preset processing computation amount among different super-resolution ratios.

[0070] S230. Determine the rendering resolution based on the target super-resolution multiplier and the display resolution.

[0071] Display resolution can be understood as the pixel size of the image presented on the screen of an electronic device, also known as panel size. It is usually expressed as the number of pixels in width multiplied by the number of pixels in height, such as 3840*2160.

[0072] The rendering resolution can be understood as the resolution of the intermediate image used by the graphics processing unit (GPU) during layer compositing and rendering operations, i.e., the blend size. The rendering resolution is no greater than the display resolution. It should be noted that this application does not impose any limitations on the specific numerical form of the display resolution and rendering resolution; for example, the display resolution and rendering resolution can be represented in hexadecimal numbers. For instance, the display resolution could be 0x4380780, and the rendering resolution could be 0x10e1e00.

[0073] In an optional embodiment, a ratio between the display resolution and the super-resolution factor can be determined; based on this ratio, the rendering resolution is determined.

[0074] For example, a target ratio between the display resolution and the target super-resolution multiple can be determined; this target ratio is then used as the rendering resolution.

[0075] S240: Send the rendering resolution to the GPU so that the GPU can generate a rendered image based on the rendering resolution and the layer to be processed.

[0076] In an optional embodiment, the rendering resolution can be sent to the GPU so that the GPU can obtain the target processing layer corresponding to the target super-resolution multiple and perform layer compositing on the target processing layer to obtain the rendered image; the target processing layer is obtained by resizing the layer to be processed based on the rendering resolution corresponding to the target super-resolution multiple.

[0077] In another alternative embodiment, the layers to be processed can be composited at the rendering resolution to obtain a rendered image.

[0078] S250: Based on the target super-resolution factor, the rendered image is super-magnified for display.

[0079] In one optional embodiment, the rendered image can be super-scaled and displayed according to the target super-resolution factor. Taking a 1080P rendered image (i.e., 2K resolution) with a target super-resolution bit depth of 4 as an example, the rendered image can be super-scaled by 4 times, resulting in an 8K output for display.

[0080] Among them, the resolution of the displayed image after super-resolution magnification of the rendered image can be equal to the display resolution.

[0081] The aforementioned display method, by receiving layer information of the layers to be processed from the graphics processing unit (GPU), can quantify the complexity of the layers, providing a data foundation for subsequent differentiated rendering and super-resolution scaling decisions. By determining the target super-resolution factor based on the layer information, a matching target super-resolution factor can be adaptively determined based on the objective complexity of the scene. By sending the rendering resolution to the GPU, the GPU generates a rendered image that matches the scene requirements based on the rendering resolution and the layers to be processed. By super-scaling the rendered image based on the target super-resolution factor, an adaptive balance between display quality and rendering efficiency is achieved, that is, an optimized balance between performance and display effect.

[0082] Based on the above embodiments, such as Figure 3 As shown, another display method is provided, which can be applied to... Figure 1 Taking the graphics processor 104 in the image, or a chip / chip module with data processing capabilities as an example, the following steps are included:

[0083] S310. Send the layer information of the layer to be processed to the data processing unit (DPU) so that the DPU can determine the rendering resolution based on the display resolution and the target super-resolution multiple determined based on the layer information.

[0084] S320: Generate a rendered image based on the rendering resolution and the layer to be processed.

[0085] S330: Send the rendered image to the DPU so that the DPU can perform super-resolution magnification and display of the rendered image based on the target super-resolution factor.

[0086] The information regarding layer details, target super-resolution multiplier, and rendered image has already been explained above and will not be repeated here.

[0087] In an optional embodiment, a target processing layer corresponding to the target super-resolution multiple can be obtained, and the target processing layer can be subjected to layer compositing to obtain a rendered image; the target processing layer is obtained by adjusting the size of the layer to be processed based on the rendering resolution corresponding to the target super-resolution multiple.

[0088] Optionally, candidate processing layers corresponding to different candidate super-resolution multiples can be pre-generated, the target processing layer corresponding to the target super-resolution multiple can be obtained from each candidate processing layer, and the target processing layer can be processed by layer compositing to obtain the rendered image.

[0089] In another alternative embodiment, the layers to be processed can be composited at the rendering resolution to obtain a rendered image.

[0090] The aforementioned display method, by introducing layer information, quantifies the complexity of the layer to be processed, providing a data foundation for subsequent differentiated rendering and super-resolution amplification decisions. By sending the layer information of the layer to be processed to the Data Processing Unit (DPU), the DPU can determine the rendering resolution based on the display resolution and the target super-resolution factor determined based on the layer information. This achieves adaptive determination of a matching target super-resolution factor based on the objective complexity of the scene, and generates a rendered image that matches the scene requirements. By sending the rendered image to the DPU, the DPU can perform super-resolution amplification display based on the target super-resolution factor, achieving an adaptive balance between display quality and rendering efficiency, that is, achieving an optimized balance between performance and display effect.

[0091] Based on the above embodiments, the steps for determining the target super-resolution factor are described in detail.

[0092] refer to Figure 4A The diagram shown is a flowchart illustrating the steps for determining the target super-resolution factor in one embodiment.

[0093] Specifically, configuration parameters corresponding to different super-resolution ratios can be pre-configured in the LCD driver; during device initialization, candidate super-resolution ratios supported by the current device are obtained from different super-resolution ratios; the application refreshes the image and generates an image display task, which includes the layer data to be processed; the GPU determines the layer information based on the layer data to be processed, including the number of layers and the layer overlap area; the DPU selects the target super-resolution ratio from the candidate super-resolution ratios based on the layer information, configures the target super-resolution ratio, and then displays the image based on the target super-resolution ratio.

[0094] The DPU can determine the rendering resolution based on the target super-resolution factor and the display resolution; send the rendering resolution to the GPU so that the GPU can generate a rendered image based on the rendering resolution and the layer to be processed; and perform super-resolution magnification on the rendered image based on the target super-resolution factor.

[0095] refer to Figure 4B The diagram illustrates the steps for determining the target super-resolution factor in another embodiment. Configuration parameters corresponding to different super-resolution factors can be pre-configured in the LCD driver; during device initialization, candidate super-resolution factors supported by the current device are obtained from different super-resolution factors; the app refreshes the image, generating an image display task, which includes data of the layers to be processed; the GPU pre-draws candidate processing layers corresponding to different candidate super-resolution factors; the DPU determines the target super-resolution factor based on the layer information and selects the target processing layer corresponding to the target super-resolution from different candidate processing layers; and the display is performed based on the target super-resolution factor and the corresponding target processing layer.

[0096] The candidate super-resolution factor can be any super-resolution factor supported by the current device and whose usage probability is greater than a preset probability threshold. The usage probability can be determined based on the corresponding target super-resolution factor within a historical time period.

[0097] Specifically, the GPU can perform layer compositing on the target processing layer to obtain the rendered image; the DPU can perform super-resolution magnification and display of the rendered image based on the target super-resolution factor.

[0098] refer to Figure 4CThe diagram illustrates the process of determining the target super-resolution factor in another embodiment, including: the app refreshing the image and generating an image display task, the image display task including layer data to be processed; the GPU determining the rendering performance required for the image display task and judging whether the rendering performance exceeds the rendering performance threshold V1: if it exceeds the rendering performance threshold V1, the super-resolution factor is increased to obtain a first super-resolution factor, and it is further determined whether the rendering performance required at the first super-resolution factor exceeds the rendering performance threshold V2; if it exceeds the rendering performance threshold V2, the super-resolution factor is further increased to obtain a second super-resolution factor; and so on, until it is determined that the super-resolution factor exceeds the rendering performance threshold Vn, at which point the (n-1)th super-resolution factor is taken as the target resolution factor. Wherein, Vn > Vn-1 > ... > V2 > V1.

[0099] If the rendering performance threshold is not exceeded, and the corresponding rendering performance threshold can support the rendering performance required for the updated super-resolution multiplier, then the updated super-resolution multiplier will be used as the target resolution multiplier; the display will then be based on the target super-resolution multiplier. Optionally, if the corresponding rendering performance threshold cannot support the rendering performance required for the updated super-resolution multiplier, the increment step of the super-resolution multiplier can be reduced, and the process can return to the previous step, i.e., re-comparing it with the corresponding rendering performance threshold.

[0100] In another optional embodiment, candidate processing layers corresponding to different super-resolution ratios can be pre-drawn using the GPU, and a target processing layer corresponding to the target resolution ratio can be selected from the candidate processing layers; the display can then be performed based on the target resolution ratio and the target processing layer.

[0101] Based on the above embodiments, a video data display step is added. This involves acquiring the video stream, its corresponding video parameters, and the window resolution; inputting the video stream, video parameters, and window resolution into the target processing model to optimize and adjust the resolution of the video stream, obtaining a target video stream that conforms to the window resolution, and then displaying the target video stream.

[0102] Here, window resolution can be understood as the display resolution of the current player's corresponding display window.

[0103] The video parameters may include at least one of the following: the original resolution of the video stream, the input source format, and the frame rate.

[0104] The target processing model can be a traditional machine learning model or a neural network model, and this application does not limit the specific model type of the target processing model. For example, the target processing model can optimize and adjust the resolution of the video stream based on video parameters and window resolution. For instance, it can enhance the image quality of the video stream based on video parameters and window resolution, and can also perform magnification processing such as 2x, 3x, or 4x magnification.

[0105] refer to Figure 5 The diagram shows the model structure of the target processing model. It can acquire a video stream, which includes a U-channel control signal u_ctrl, a V-channel control signal v_ctrl, and a Y-channel control signal y_ctrl. The U-channel control signal includes the raw chroma data of the U-channel, the V-channel control signal includes the raw chroma data of the V-channel, and the Y-channel control signal includes the raw luminance data of the Y-channel.

[0106] Based on the Bicubic interpolation module, the raw chroma data of the U channel and the raw chroma data of the V channel are interpolated and amplified according to the target magnification, and then input to the timing synchronization module.

[0107] The raw Y-channel luminance data is input into the Near Y (nearest neighbor interpolation module) module. The raw Y-channel luminance data output by the Near Y module using nearest neighbor interpolation, along with the data after being interpolated and amplified by the Bicubic (bicubic interpolation) module, are then input into the scaling factor selection module to obtain the first Y-channel data. N Simultaneously, the raw Y-channel brightness data is input into a CNN (Convolutional Neural Network) module for feature extraction and detail prediction, restoring the high-detail information hidden in the low resolution. Then, it is upsampled through a Pixel Shuffle module to obtain the second Y-channel data. C By analyzing the first Y channel data Y... N Second Y channel data Y C The data is fused to obtain the Y channel data. F And input it into the timing synchronization module.

[0108] The timing synchronization module performs timing synchronization processing on the amplified U-channel data, the fused Y-channel data, and the YCbCr data to obtain YCbCr data. The Bicubic interpolation module then performs interpolation processing on the YCbCr data to obtain the processed video stream. YCbCr data can be understood as a color coding space for video or digital images. Y represents luminance, and Cb / Cr represents chrominance.

[0109] The target magnification (Scale) can be at least one of 1x, 2x, 3x, 4x, and 6x. The target magnification can be determined based on video parameters and window resolution.

[0110] Based on the above embodiments, the display method will be described in detail using the interaction between a graphics processor and a data processing unit to implement the above display method as an example.

[0111] refer to Figure 6 The diagram shown is a timing diagram of the display method, which includes the following steps:

[0112] S610, the graphics processor sends the layer information of the layer to be processed to the data processing unit. The layer information includes the number of layers and the overlapping area of ​​the layers.

[0113] S620, the data processing unit determines the target layer range to which the layer number belongs, and the target area range to which the layer overlap area belongs.

[0114] S630, the data processing unit determines the target super-resolution factor that matches the target layer range and target area range according to the preset matching relationship.

[0115] S640, the data processing unit determines the ratio between the display resolution and the super-resolution factor, and determines the rendering resolution based on the ratio.

[0116] S650, the data processing unit sends the rendering resolution to the graphics processor.

[0117] The S660 graphics processor generates a rendered image based on the rendering resolution and the layers to be processed.

[0118] For example, the target processing layer corresponding to the target super-resolution multiple can be obtained, and the target processing layer can be composited to obtain the rendered image; the target processing layer is obtained by adjusting the size of the layer to be processed based on the rendering resolution corresponding to the target super-resolution multiple.

[0119] For example, the layers to be processed can be composited at the rendering resolution to obtain a rendered image.

[0120] S670: The graphics processor sends rendered images to the data processing unit.

[0121] The S680 data processing unit performs super-resolution magnification on the rendered image based on the target super-resolution factor.

[0122] It should be understood that although the steps in the flowcharts of the embodiments described above are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowcharts of the embodiments described above may include multiple steps or multiple stages. These steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the steps or stages in other steps. It is understood that the steps in different embodiments can be freely combined as needed, and all non-contradictory solutions formed by such combinations are within the scope of protection of this application.

[0123] Based on the same inventive concept, this application also provides a display device for implementing the display method described above. This device can be applied to or integrated into a chip or chip module, for example. The solution provided by this device is similar to the implementation scheme described in the above method; therefore, the specific limitations in one or more display device embodiments provided below can be found in the limitations of the display method above, and will not be repeated here.

[0124] In one exemplary embodiment, such as Figure 7 As shown, a display device is provided, including: a receiving module 710, a first determining module 720, a second determining module 730, a first transmitting module 740, and a processing module 750, wherein:

[0125] The receiving module 710 is used to receive layer information of the layer to be processed sent by the graphics processing unit (GPU);

[0126] The first determining module 720 is used to determine the target super-resolution factor based on the layer information;

[0127] The second determining module 730 is used to determine the rendering resolution based on the target super-resolution multiplier and the display resolution;

[0128] The first sending module 740 is used to send the rendering resolution to the GPU so that the GPU can generate a rendering image based on the rendering resolution and the layer to be processed;

[0129] Processing module 750 is used to super-enlarge the rendered image based on the target super-resolution factor.

[0130] In one embodiment, the layer information of the layer to be processed includes the layer number of the layer to be processed and the layer overlap area corresponding to the layer to be processed; accordingly, the first determining module 720 includes: a first determining unit, used to determine the target layer number range to which the layer number belongs and the target area range to which the layer overlap area belongs; and a second determining unit, used to determine the target super-resolution multiple that matches the target layer number range and the target area range according to a preset matching relationship.

[0131] In one embodiment, the second determining unit includes: a first determining subunit, configured to determine an initial super-resolution factor that matches the target layer range and the target area range according to a preset matching relationship;

[0132] A first selection subunit is configured to, in response to at least one candidate super-resolution factor including an initial super-resolution factor, select the initial super-resolution factor as a target super-resolution factor. A second selection subunit is configured to, in response to at least one candidate super-resolution factor not including an initial super-resolution factor, select a target super-resolution factor from at least one candidate super-resolution factor based on the initial super-resolution factor.

[0133] In one embodiment, the second determining module 730 includes: a third determining unit for determining the proportional relationship between the display resolution and the target super-resolution multiple; and a fourth determining unit for determining the rendering resolution based on the proportional relationship.

[0134] In one exemplary embodiment, such as Figure 8 As shown, another display device is provided, including: a second transmitting module 810, a generating module 820, and a third transmitting module 830. Wherein:

[0135] The second sending module 810 is used to send the layer information of the layer to be processed to the data processing unit (DPU) so that the DPU can determine the rendering resolution based on the display resolution and the target super-resolution multiple determined based on the layer information.

[0136] The generation module 820 is used to generate a rendered image based on the rendering resolution and the layer to be processed;

[0137] The third sending module 830 is used to send the rendered image to the DPU so that the DPU can perform super-resolution magnification display of the rendered image based on the target super-resolution factor.

[0138] In one embodiment, the generation module 820 includes at least one of the following: a first processing unit, configured to obtain a target processing layer corresponding to the target super-resolution multiple, and perform layer compositing processing on the target processing layer to obtain a rendered image; the target processing layer is obtained by adjusting the size of the layer to be processed based on the rendering resolution corresponding to the target super-resolution multiple; and a second processing unit, configured to perform layer compositing processing on the layer to be processed at the rendering resolution to obtain a rendered image.

[0139] Regarding the modules / units included in the various devices and products described in the above embodiments, they can be software modules / units, hardware modules / units, or a combination of both. For example, for various devices and products applied to or integrated into a chip, all of their modules / units can be implemented using hardware methods such as circuits, or at least some modules / units can be implemented using software programs that run on a processor integrated within the chip, while the remaining (if any) modules / units can be implemented using hardware methods such as circuits; for various devices and products applied to or integrated into a chip module, all of their modules / units can be implemented using hardware methods such as circuits, and different modules / units can be located in the same component (e.g., chip, circuit module, etc.) or different components of the chip module, or at least some modules / units can be implemented using hardware methods such as circuits. The components can be implemented using software programs that run on the processor integrated within the chip module. The remaining (if any) modules / units can be implemented using hardware methods such as circuits. For various devices and products applied to or integrated into the terminal, each of its components / units can be implemented using hardware methods such as circuits. Different modules / units can be located in the same component (e.g., chip, circuit module, etc.) or in different components within the terminal. Alternatively, at least some modules / units can be implemented using software programs that run on the processor integrated within the terminal, while the remaining (if any) modules / units can be implemented using hardware methods such as circuits.

[0140] In one exemplary embodiment, a computer device is provided, which may be a terminal, and its internal structure diagram may be as follows: Figure 9As shown, the computer device includes a processor, memory, input / output interfaces, a communication interface, a display unit, and an input device. The processor, memory, and input / output interfaces are connected via a system bus, and the communication interface, display unit, and input device are also connected to the system bus via the input / output interfaces. The processor provides computing and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs stored in the non-volatile storage media. The input / output interfaces are used for exchanging information between the processor and external devices. The communication interface is used for wired or wireless communication with external terminals; wireless communication can be achieved through Wi-Fi, mobile cellular networks, Near Field Communication (NFC), or other technologies. When the computer program is executed by the processor, it implements a display method. The display unit of the computer device forms a visually visible image and can be a display screen, a projection device, or a virtual reality imaging device. The display screen can be an LCD screen or an e-ink screen. The input device of the computer device can be a touch layer covering the display screen, or buttons, trackballs, or touchpads set on the casing of the computer device, or external keyboards, touchpads, or mice, etc.

[0141] Those skilled in the art will understand that Figure 9 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the computer device to which the present application is applied. Specific computer devices may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0142] In one embodiment, a computer device is also provided, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to implement the steps in the above method embodiments.

[0143] Based on the same inventive concept, this application also provides a chip, including a processor coupled to a memory, for executing a computer program or instructions stored in the memory, and implementing the steps in the above method embodiments when the processor executes the computer program or instructions.

[0144] It is understood that the chip involved in the embodiments of this application may be a field-programmable gate array (FPGA), may include an application-specific integrated circuit (ASIC), may be a system on chip (SoC), may be a central processor unit (CPU), may be a network processor (NP), may be a digital signal processor (DSP), may be a microcontroller unit (MCU), may be a programmable logic device (PLD), a data processing unit (DPU), a graphics processing unit (GPU), or other integrated chips, etc.

[0145] Based on the same inventive concept, this application also provides a chip module, such as... Figure 10 As shown, the chip module includes a communication module, a power module, a storage module, and a chip. Among them:

[0146] The power module is used to provide power to the chip module; the storage module is used to store data and instructions; the communication module is used for internal communication within the chip module, or for communication between the chip module and external devices; this chip corresponds to the chip in the above chip embodiment.

[0147] The implementation method of this chip module can be found in the relevant content of the above chip embodiment, and will not be repeated here.

[0148] In one embodiment, a computer-readable storage medium is provided having a computer program stored thereon that, when executed by a processor, implements the steps in the above method embodiments.

[0149] In one embodiment, a computer program product is provided, including a computer program that, when executed by a processor, implements the steps in the above method embodiments.

[0150] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. Any references to memory, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM). The databases involved in the embodiments provided in this application may include at least one type of relational database and non-relational database. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the embodiments provided in this application may be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, quantum computing-based data processing logic devices, artificial intelligence (AI) processors, etc., and are not limited to these.

[0151] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0152] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are specific and detailed, they should not be construed as limiting the scope of this patent application. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this application should be determined by the appended claims.

Claims

1. A display method, characterized in that, Applied to a data processing unit (DPU), the method includes: Receive layer information of the layer to be processed sent by the graphics processing unit (GPU); Based on the layer information, determine the target super-resolution factor; The rendering resolution is determined based on the target super-resolution factor and the display resolution. The rendering resolution is sent to the GPU so that the GPU generates a rendered image based on the rendering resolution and the layer to be processed; Based on the target super-resolution factor, the rendered image is super-magnified for display.

2. The method according to claim 1, characterized in that, The layer information of the layer to be processed includes the number of layers of the layer to be processed and the overlapping area of ​​the corresponding layers; correspondingly, determining the target super-resolution factor based on the layer information includes: Determine the target layer range to which the layer number belongs, and the target area range to which the layer overlap area belongs; Based on a preset matching relationship, a target super-resolution factor that matches the target layer range and the target area range is determined.

3. The method according to claim 2, characterized in that, The step of determining the target super-resolution factor that matches the target layer range and the target area range according to a preset matching relationship includes: Based on a preset matching relationship, an initial super-resolution factor that matches the target layer range and the target area range is determined; In response to at least one candidate super-resolution factor including the initial super-resolution factor, the initial super-resolution factor is used as the target super-resolution factor; In response to the fact that at least one candidate super-resolution factor does not include the initial super-resolution factor, a target super-resolution factor is selected from the at least one candidate super-resolution factor based on the initial super-resolution factor.

4. The method according to any one of claims 1-3, characterized in that, Determining the rendering resolution based on the target super-resolution factor and the display resolution includes: Determine the proportional relationship between the display resolution and the target super-resolution factor; The rendering resolution is determined based on the aforementioned proportional relationship.

5. A display method, characterized in that, Applied to a graphics processing unit (GPU), the method includes: The layer information of the layer to be processed is sent to the data processing unit (DPU) so that the DPU determines the rendering resolution based on the display resolution and the target super-resolution multiple determined based on the layer information. Generate a rendered image based on the rendering resolution and the layer to be processed; The rendered image is sent to the DPU so that the DPU can perform super-resolution magnification and display of the rendered image based on the target super-resolution factor.

6. The method according to claim 5, characterized in that, The step of generating a rendered image based on the rendering resolution and the layer to be processed includes at least one of the following: Obtain the target processing layer corresponding to the target super-resolution multiplier, and perform layer compositing on the target processing layer to obtain the rendered image; the target processing layer is obtained by adjusting the size of the layer to be processed based on the rendering resolution corresponding to the target super-resolution multiplier. The layer to be processed is subjected to layer compositing processing at the stated rendering resolution to obtain a rendered image.

7. A display device, characterized in that, The device, configured in a data processing unit (DPU), includes: The receiving module is used to receive layer information of the layer to be processed sent by the graphics processing unit (GPU). The first determining module is used to determine the target super-resolution factor based on the layer information; The second determining module is used to determine the rendering resolution based on the target super-resolution multiplier and the display resolution; The first sending module is used to send the rendering resolution to the GPU, so that the GPU can generate a rendering image based on the rendering resolution and the layer to be processed; The processing module is used to perform super-resolution magnification display on the rendered image based on the target super-resolution factor.

8. A display device, characterized in that, The device, configured on a graphics processing unit (GPU), includes: The second sending module is used to send the layer information of the layer to be processed to the data processing unit (DPU), so that the DPU determines the rendering resolution based on the display resolution and the target super-resolution multiple determined based on the layer information. The generation module is used to generate a rendered image based on the rendering resolution and the layer to be processed; The third sending module is used to send the rendered image to the DPU, so that the DPU can perform super-resolution magnification display of the rendered image based on the target super-resolution factor.

9. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that, When the processor executes the computer program, it implements the steps of the method according to any one of claims 1 to 6.

10. A chip, characterized in that, It includes a processor and a communication interface, the processor being configured to cause the chip to execute the steps of the method according to any one of claims 1 to 6.

Images