Graph display method and device, equipment and storage medium
Through the coordinated work of the central processor and the display controller, the problem of inefficient graphics display is solved by pure CPU, improving the graphics display efficiency and user experience, and meeting the updated display hardware and software needs.
Patent Information
- Application Number
- CN202411107965.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-13
- Publication Date
- 2024-11-26
AI Technical Summary
In the absence of a GPU, when the pure CPU implements graphics display, the graphics display is inefficient and cannot meet the current needs of display hardware and upper-level applications.
Receive rendering vertical synchronization signals through the central processor, use the preset user interface to render the application's user interface using the preset user interface drawing interface, and query whether the display controller supports synthesis of all rendered content, and call the user interface of the display controller based on the query results. Issue a synthesis command, use the display controller to perform synthesis operations, and improve rendering synthesis efficiency.
It greatly improves the efficiency of graphics display, reduces the occupancy of the central processor, improves the user experience, and achieves smoother graphics display, meeting the needs of the increasingly updated display hardware and upper-level software.
Smart Images

Figure CN119025206A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of computer technology, and in particular to a graphic display method, device, equipment and storage medium. Background Art
[0002] Usually, the premise for the perfection and maturity of graphic display is that the terminal device is equipped with GPU (graphics processing unit). GPU, as graphics acceleration hardware, provides OpenGL ES (a 3D graphics application programming interface targeting handheld and embedded devices) for related rendering and synthesis. At present, in order to enhance the capabilities of other cores or consider low cost, manufacturers or terminals will remove GPU, and graphic display based on CPU (Central Processing Unit) has become a research hotspot.
[0003] In the related art, the GPU is removed and only the CPU remains. The CPU is used to simulate the GPU to implement software-based OpenGL ES components, and the CPU is used to perform rendering and synthesis operations to realize graphics display.
[0004] However, in the related art, the pure CPU display method is prone to the problem of low graphics display efficiency. Summary of the invention
[0005] The purpose of this application is to provide a graphic display method, device, equipment and storage medium to address the deficiencies in the above-mentioned prior art, so as to solve the above-mentioned technical problems existing in the related art.
[0006] To achieve the above purpose, the technical solution adopted in the embodiment of the present application is as follows:
[0007] In a first aspect, an embodiment of the present application provides a graphics display method, applied to a central processing unit, comprising:
[0008] According to the received rendering vertical synchronization signal, a preset user interface drawing interface is used to render the user interface of the preset application program to obtain rendering content; wherein the rendering vertical synchronization signal is obtained by processing the vertical synchronization signal sent by the display controller;
[0009] Requesting to generate a synthetic vertical synchronization signal, and querying the display controller according to the synthetic vertical synchronization signal to obtain a query result; wherein the query result is used to indicate whether the display controller supports synthesis of all the rendering contents;
[0010] According to the query result, the user interface of the display controller is called to send a synthesis command for the rendering content to the display controller, so that the display controller synthesizes the rendering content according to the synthesis command and completes the graphic display corresponding to the rendering content.
[0011] Optionally, before rendering the user interface of a preset application program using a preset user interface drawing interface according to the received rendering vertical synchronization signal to obtain the rendering content, the method further includes:
[0012] Applying for a first cache area from the display controller to complete initialization of the preset application;
[0013] After rendering the user interface of the preset application program using a preset user interface drawing interface according to the received rendering vertical synchronization signal and obtaining the rendering content, the method further includes:
[0014] The rendered content is stored in the first cache area.
[0015] Optionally, calling a user interface of the display controller to issue a synthesis command to the display controller according to the query result includes:
[0016] If the query result indicates that part of the rendered content is not supported, or all of the rendered content is not supported, applying for a second cache area from the display controller;
[0017] According to the parameter information of the rendering content not supported by the display controller, calling the user interface drawing interface to perform an editing operation on each layer corresponding to the unsupported rendering content, so as to obtain display information of each layer in the final synthesized image;
[0018] Using the user interface drawing interface, synthesizing each layer into the second cache area according to the display information;
[0019] According to the second cache area and the query result, the user interface of the display controller is called to send the synthesis command to the display controller.
[0020] Optionally, calling a user interface of the display controller to issue a synthesis command to the display controller according to the second cache area and the query result includes:
[0021] Associating the second buffer area to the main layer plane of the display controller;
[0022] If the query result indicates that there is supported content in the rendering content, binding the supported rendering content to a hardware layer plane supported by the display controller;
[0023] According to the main layer plane and the hardware layer plane, the user interface of the display controller is called to send the synthesis command to the display controller.
[0024] Optionally, calling a user interface of the display controller to issue a synthesis command to the display controller according to the second cache area and the query result includes:
[0025] Associating the synthesized second buffer area to the main layer plane of the display controller;
[0026] If the query result indicates that there is no supported content in the rendering content, then according to the main layer plane, the user interface of the display controller is called to send the synthesis command to the display controller.
[0027] Optionally, calling the user interface drawing interface to perform an editing operation on each layer corresponding to the unsupported rendering content according to the parameter information of the rendering content not supported by the display controller to obtain display information of each layer in the final synthesized image includes:
[0028] Calling the user interface drawing interface to perform rotation, scaling, and cropping operations on each layer according to the parameter information of the unsupported rendering content;
[0029] The position information and the visible area of each layer in the final composite image are calculated; and the display information includes the position information and the visible area.
[0030] Optionally, calling a user interface of the display controller to issue a synthesis command to the display controller according to the query result includes:
[0031] If the query result indicates that the display controller supports all the contents in the rendering content, the user interface of the display controller is called to bind the rendering content to the corresponding plane, and the synthesis command is issued to the display controller.
[0032] Optionally, calling the user interface of the display controller to issue a synthesis command for the rendering content to the display controller according to the query result, so that the display controller synthesizes the rendering content according to the synthesis command to complete the graphic display corresponding to the rendering content, includes:
[0033] According to the query result, the user interface of the display controller is called to send a synthesis command for the rendering content to the hardware register in the display controller, so that the hardware register simplifies the synthesis command to obtain a simplified synthesis command, and the simplified synthesis command is sent to the display controller, so that the display controller performs algorithm overlay processing to complete the graphic display corresponding to the rendering content.
[0034] In a second aspect, an embodiment of the present application further provides a graphics display device, applied to a central processing unit, comprising:
[0035] A rendering module, configured to render a user interface of a preset application program using a preset user interface drawing interface according to a received rendering vertical synchronization signal, so as to obtain rendering content; wherein the rendering vertical synchronization signal is obtained by processing a vertical synchronization signal sent by a display controller;
[0036] A query module, used for requesting to generate a synthetic vertical synchronization signal, and querying the display controller according to the synthetic vertical synchronization signal to obtain a query result; wherein the query result is used to indicate whether the display controller supports synthesis of all the rendering contents;
[0037] The sending module is used to call the user interface of the display controller to send a synthesis command for the rendering content to the display controller according to the query result, so that the display controller synthesizes the rendering content according to the synthesis command and completes the graphic display corresponding to the rendering content.
[0038] Optionally, the device further comprises:
[0039] An application module, used for applying for a first cache area from the display controller to complete the initialization of the preset application;
[0040] The device also includes:
[0041] A storage module is used to store the rendered content in the first cache area.
[0042] Optionally, the sending module is specifically used to apply for a second cache area from the display controller if the query result indicates that part of the rendering content is not supported, or all of the rendering content is not supported; based on the parameter information of the rendering content not supported by the display controller, call the user interface drawing interface to perform editing operations on each layer corresponding to the unsupported rendering content to obtain display information of each layer in the final composite image; use the user interface drawing interface to synthesize each layer into the second cache area according to the display information; and based on the second cache area and the query result, call the user interface of the display controller to send the synthesis command to the display controller.
[0043] Optionally, the sending module is specifically used to associate the second cache area to the main layer plane of the display controller; if the query result indicates that there is supported content in the rendering content, the supported rendering content is bound to the hardware layer plane supported by the display controller; based on the main layer plane and the hardware layer plane, the user interface of the display controller is called to send the synthesis command to the display controller.
[0044] Optionally, the sending module is specifically used to associate the synthesized second cache area to the main layer plane of the display controller; if the query result indicates that there is no supported content in the rendered content, then according to the main layer plane, the user interface of the display controller is called to send the synthesis command to the display controller.
[0045] Optionally, the sending module is specifically used to call the user interface drawing interface to perform rotation, scaling, and cropping operations on each layer according to the parameter information of the unsupported rendering content; calculate the position information and visible area of each layer in the final composite image; and the display information includes the position information and the visible area.
[0046] Optionally, the sending module is specifically used to call the user interface of the display controller to bind the rendering content to the corresponding plane if the query result indicates that the display controller supports all the contents of the rendering content, and send the synthesis command to the display controller.
[0047] Optionally, the sending module is specifically used to call the user interface of the display controller to send a synthesis command for the rendering content to the hardware register in the display controller according to the query result, so that the hardware register simplifies the synthesis command to obtain a simplified synthesis command, and sends the simplified synthesis command to the display controller, so that the display controller performs algorithm overlay processing to complete the graphic display corresponding to the rendering content.
[0048] In a third aspect, an embodiment of the present application further provides a graphics display device, comprising: a central processing unit and a display controller, wherein the central processing unit and the display controller are communicatively connected, and the central processing unit is used to execute the graphics display method described in any one of the first aspects.
[0049] In a fourth aspect, an embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is read and executed, the graphic display method described in any one of the first aspects is implemented.
[0050] The beneficial effects of the present application are as follows: the embodiment of the present application provides a graphics display method, which includes: according to the received rendering vertical synchronization signal, using a preset user interface drawing interface to render the user interface of a preset application program to obtain rendering content; wherein the rendering vertical synchronization signal is obtained by processing the vertical synchronization signal sent by the display controller; requesting to generate a synthetic vertical synchronization signal, and querying the display controller according to the synthetic vertical synchronization signal to obtain a query result; wherein the query result is used to indicate whether the display controller supports the synthesis of all rendering contents; according to the query result, calling the user interface of the display controller to issue a synthesis command for the rendering content to the display controller, so that the display controller synthesizes the rendering content according to the synthesis command and completes the graphic display corresponding to the rendering content. The central processing unit is used to render the user interface of the preset application program, querying whether the display controller supports the synthesis of all rendering contents to obtain the rendering result, issuing a synthesis command for the rendering content to the display controller based on the rendering result, and using the display controller to perform the synthesis operation, based on the central processing unit and the display controller to the result, the efficiency of rendering synthesis is greatly improved, thereby improving the efficiency of graphics display. BRIEF DESCRIPTION OF THE DRAWINGS
[0051] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.
[0052] Figure 1 A schematic diagram of a framework based on a graphic display method provided in an embodiment of the present application;
[0053] Figure 2 A schematic diagram of a graphic display method provided in an embodiment of the present application Figure 1 ;
[0054] Figure 3 A schematic diagram of a graphic display method provided in an embodiment of the present application Figure 2 ;
[0055] Figure 4 A schematic diagram of a graphic display method provided in an embodiment of the present application Figure 3 ;
[0056] Figure 5 A schematic diagram of a graphic display method provided in an embodiment of the present application Figure 4 ;
[0057] Figure 6 A schematic diagram of a graphic display method provided in an embodiment of the present application Figure 5 ;
[0058] Figure 7 A schematic diagram of a graphic display method provided in an embodiment of the present application Figure 6 ;
[0059] Figure 8 A schematic diagram of the structure of a graphic display device provided in an embodiment of the present application;
[0060] Fig. 9 A schematic diagram of the hardware structure of a display controller provided in an embodiment of the present application;
[0061] Fig.10 A schematic diagram of the structure of a graphic display device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0062] In order to make the purpose, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below in combination with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments.
[0063] Therefore, the following detailed description of the embodiments of the present application provided in the accompanying drawings is not intended to limit the scope of the present application for which protection is sought, but merely represents selected embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without creative work are within the scope of protection of the present application.
[0064] In the description of the present application, it should be noted that if the terms "upper", "lower", etc. appear, the orientation or position relationship indicated is based on the orientation or position relationship shown in the drawings, or is the orientation or position relationship in which the product of the application is usually placed when used. It is only for the convenience of describing the present application and simplifying the description, and does not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation on the present application.
[0065] In addition, the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequential order. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.
[0066] It should be noted that, in the absence of conflict, the features in the embodiments of the present application may be combined with each other.
[0067] The following is an explanation of the terms involved in the embodiments of the present application.
[0068] Framebuffer: FB for short, is an interface provided by the kernel system, which shields the underlying differences of the image hardware, abstracts the display buffer, and allows upper-level applications to directly read and write to the display buffer in graphics mode. For example, if a color value is written to the area corresponding to the display point in the display buffer, the corresponding color will be automatically displayed on the screen and other hardware devices. In the early days when GPUs had not yet appeared, the framebuffer component was an important component used in the key steps of the image processing process.
[0069] DRM / KMS: Direct Rendering Manager / Kernel Mode Settings, it is the current mainstream open source display solution. It has the ability to adapt to the current increasingly updated display hardware characteristics and can support more advanced controls and features in software.
[0070] Planes: plane. It is a memory address. For its role, here is an analogy. On a computer, you can type and chat on WeChat while watching a movie. There are two opposing concepts here. Typing is text interaction, which is a small-scale updated Graphics mode; watching a movie is a full-frame high-speed updated Video mode. These two modes pull the use of graphics cards to two extremes. At this time, Planes plays a very good role. It provides a high-speed channel for Video refresh, making Video a separate layer that can be superimposed on or under Graphics and has functions such as zooming. There can be multiple Planes, which is equivalent to layer superposition. Therefore, the image scanned by the scanner (CRTC) is actually often a combination (Blending) of frame buffer and Planes. Usually Planes are divided into the following three types: Cursor (cursor layer, used to display the mouse), Overlay (overlay layer, usually used for video layers in YUV format), and Primary (main layer, usually used for simple layers that only support RGB (red, green, and blue) format).
[0071] gralloc: A module responsible for allocating and releasing storage rendering and synthesis buffer areas, implemented by hardware drivers or software.
[0072] SurfaceFlinger: is an independent service that receives all rendered layer contents as input, calculates the position of each layer in the final composite image based on ZOrder (a computer term used to set the order), transparency, size, position and other parameters, and then sends it to HWComposer (hardware hybrid renderer) or OpenGL (OpenGraphics Library) to generate the final display buffer, which is then displayed on a specific display device.
[0073] HWC: HWComposer, hardware compositing renderer, is used to synthesize layers received from SurfaceFlinger, thereby reducing the amount of synthesis performed by OpenGL ES (a form of OpenGL specification suitable for embedded devices, referred to as GLES) and the GPU. It is also relatively weak, does not receive any layers for synthesis, and directly marks all layers as not supporting synthesis, such as when using frame buffer technology. Its specific implementation is provided by various terminal manufacturers or solution manufacturers.
[0074] EGL: It is an intermediate interface layer between OpenGL components and local window management systems. Introducing EGL can shield the differences between different windows on different platforms. EGL can also be used as an interface layer between Wayland (a simple "display server") applications and OpenGL components.
[0075] HWUI: The full name is Hardware Accelerated Rendering Engine for UI. It is a graphics engine based on GPU acceleration. The goal of HWUI is to provide efficient, stable, and high-quality graphics rendering capabilities to provide technical support for the system's UI experience. Its final drawing interface will be implemented through Skia (a two-dimensional vector graphics processing function library) OpenGL ES or Skia Vulkan (a graphics application program interface).
[0076] Skia: is an open source 2D graphics library that provides a variety of commonly used APIs (application programming interfaces) and can run on a variety of software and hardware platforms. In the Skia graphics library, it is divided into the front end and the back end. The front end usually refers to the interface and functions provided by the graphics library, which are used to create and operate graphic objects, set graphic properties, and define graphic scenes; the back end refers to the rendering engine of the graphics library, which is responsible for rendering the graphic scenes defined by the front end to the screen. The back end usually involves the interaction with the graphics hardware. Skia's commonly used backends include: Skia raster (this is the most basic backend provided by Skia itself, used to present graphics on the screen. It mainly implements graphics rendering through pixel operations. This backend is widely used in desktop applications and some mobile applications. It was designed to support CPU instruction optimization acceleration), Skia OpenGL (Skia supports the use of OpenGL as the rendering backend. This is very useful for applications that require higher performance and complex graphics effects, especially in games and graphics-intensive applications, which require GPU-supported OpenGL ES support or software-implemented OpenGL ES simulation), Skia Vulkan (Skia can also use Vulkan as the backend. Vulkan provides more direct hardware access, enabling more efficient graphics rendering on devices that support Vulkan, or software-implemented Vulkan library simulation).
[0077] Dumb buffer: A continuous physical memory buffer supported by the DRM driver. It represents a buffer where all drawing operations are performed by the CPU. It is just a software function definition and has nothing to do with whether the system has GPU hardware. Even if your hardware supports GPU acceleration, it does not prevent the use of dumb buffer for pure CPU soft drawing. The most important thing is that this buffer can be used seamlessly with the DRM / KMS display solution.
[0078] In the related art, in order to enhance the capabilities of other cores or for low cost considerations, the GPU is removed and only the CPU is left. Without the support of the GPU, the CPU can only use the outdated FB display, and at this time, the CPU simulates the GPU to implement the software-based OpenGL ES component, and uses the CPU to perform rendering and synthesis operations to achieve graphics display. At this time, the CPU must replace the GPU to do both rendering and synthesis, which are what the CPU is not good at. At this time, the operating power consumption and performance cannot achieve the expected effect. In the related art, this pure CPU display method is prone to the problem of low graphics display efficiency.
[0079] The embodiment of the present application provides a graphics display method, which uses a central processing unit to render the user interface of a preset application, queries the display controller to see if it supports the synthesis of all the rendering content to obtain the rendering result, issues a synthesis command for the rendering content to the display controller based on the rendering result, uses the display controller to perform the synthesis operation, and greatly improves the efficiency of rendering synthesis based on the central processing unit and the display controller to the result, thereby improving the efficiency of graphics display. Moreover, the hardware capabilities of the display controller are fully utilized, the occupancy rate of the central processing unit is reduced, the graphics display efficiency is improved, the graphics display is made more streamlined, the user experience is improved, and the occupancy rate of the central processing unit is also greatly released and optimized. The technical problems existing in the related technology are solved.
[0080] Figure 1 A schematic diagram of a framework based on a graphic display method provided in an embodiment of the present application, such as Figure 1 As shown, the framework may include: an application layer, a framework and library layer (Farmwork & libaries), a kernel layer (kernel), and a hardware layer (hardware). The hardware layer includes: a CPU and a DC (Display Controller), and the CPU and the DC are communicated with each other.
[0081] The application layer includes: applications and 3D applications, and the applications communicate with each other. The framework and library layer includes: SurfaceFlinger, software-based EGL, OpenGL ES components, Skia raster, gralloc, HWC, among which the applications communicate with Skia raster, SurfaceFlinger, and gralloc respectively, and SurfaceFlinger communicates with gralloc, HWC, and Skia raster respectively. 3D applications, software-based EGL, OpenGL ES components, and Skia raster communicate with each other in sequence, and Skia raster communicates with the CPU.
[0082] The kernel layer includes: DC video memory, DC driver, KMS driver. The KMS driver communicates with DC and each other respectively. The DC video memory communicates with gralloc and DC driver respectively. The DC driver communicates with DC.
[0083] In the embodiment of the present application, each of the above contents in the application layer, framework and library layer, and kernel layer is a software module, and each software module in the application layer, framework and library layer, and kernel layer runs on the CPU.
[0084] An embodiment of the present application provides a graphics display method, which is applied to the CPU, i.e., the central processing unit, in the above-mentioned framework. The following explains a graphics display method provided by an embodiment of the present application.
[0085] Figure 2 A schematic diagram of a graphic display method provided in an embodiment of the present application Figure 1 ,like Figure 2 As shown, the method may include:
[0086] S101 . According to a received rendering vertical synchronization signal, a preset user interface drawing interface is used to render a user interface of a preset application program to obtain rendering content.
[0087] The rendering vertical synchronization signal is obtained by processing the vertical synchronization signal sent by the display controller. The rendering vertical synchronization signal can also be called a rendering vsync (vertical synchronization) signal, and the rendering vertical synchronization signal can also be called a rendering vsync signal.
[0088] In an embodiment of the present application, the display controller can generate a hardware vertical synchronization signal, which sends the vertical synchronization signal to the central processing unit. The central processing unit can use SurfaceFlinger to process the vertical synchronization signal to obtain a rendering vertical synchronization signal. SurfaceFlinger can transmit the rendering vertical synchronization signal to the application run by the central processing unit through a preset communication mechanism. The preset communication mechanism can be a Binder communication mechanism (an inter-process communication mechanism provided by the Android system).
[0089] In some embodiments, the preset user interface drawing interface may be a 2D UI (2D User Interface) drawing interface of Skia raster. The central processing unit uses the 2D UI drawing interface of Skia raster to draw the user interface of the preset application in sequence according to the hierarchical relationship traversal, and directly renders the user interface of the preset application to obtain the rendering content. The rendering content may also be referred to as the rendering result. For example, the preset application may be an Android application.
[0090] It is worth noting that in the prior art, HWUI components are rendered by using software-simulated OpenGL ES. The rendering process involves generating GL instructions, transmitting GL instructions, and translating GL instructions into instructions that the central processor can understand, which is extremely time-consuming and inefficient. However, the present application directly adopts the rendering solution of Skia raster, abandoning the original solution of using software-simulated OpenGL ES of HWUI components. Since Skia raster directly uses the instruction optimization set of the central processor, it is faster, more efficient, and has a lower CPU occupancy rate than using HWUI components with simulated OpenGL ES. It can greatly improve rendering efficiency, reduce the occupancy of the central processor, thereby improving rendering efficiency and making graphics display smoother.
[0091] S102: Request to generate a synthetic vertical synchronization signal, and query the display controller according to the synthetic vertical synchronization signal to obtain a query result.
[0092] The query result is used to indicate whether the display controller supports compositing all rendered content. The composite vertical synchronization information may also be referred to as a composite vsync signal.
[0093] In some embodiments, a preset application running on the central processing unit sends a synthesis request for rendering content to SurfaceFlinger running on the central processing unit. The central processing unit uses SurfaceFlinger to trigger the generation of a synthetic vsync signal based on the synthesis request after a series of complex processing, so that the request to generate a synthetic vertical synchronization signal can be realized. At this time, it is detected whether at least one application has new content to update the display; if there is new content to update the display, the central processing unit uses SurfaceFlinger to transmit the rendering content to the HWC running on the central processing unit, and calls the libdrm (Library Drm, display application interface encapsulation library) interface in the HWC to query the display controller to obtain the query result.
[0094] In an embodiment of the present application, the display controller can return the query result to SurfaceFlinger through HWC.
[0095] It should be noted that the query result may include any one of the following three situations: the display controller supports synthesis of all rendering contents, the display controller supports synthesis of part of the rendering contents, and the display does not support synthesis of all rendering contents.
[0096] S103 . According to the query result, the user interface of the display controller is called to send a synthesis command for the rendering content to the display controller, so that the display controller synthesizes the rendering content according to the synthesis command and completes the graphic display corresponding to the rendering content.
[0097] For different query results, different methods are used to call the user interface of the display controller to send a synthesis command for rendering content to the display controller.
[0098] In some embodiments, if the query result indicates that the display controller supports synthesis of all rendered content, a first preset strategy is used to call the user interface of the display controller to issue a synthesis command for the rendered content to the display controller; if the query result indicates that the display controller supports synthesis of part of the rendered content, a second preset strategy is used to call the user interface of the display controller to issue a synthesis command for the rendered content to the display controller; if the query result indicates that the display controller does not support synthesis of all rendered content, a third preset strategy is used to call the user interface of the display controller to issue a synthesis command for the rendered content to the display controller.
[0099] In an embodiment of the present application, the display controller may receive a synthesis command, and synthesize the rendering content according to the synthesis command to complete the graphic display corresponding to the rendering content, that is, the display controller is used to complete the synthesis operation.
[0100] It should be noted that the hardware support framework code of the display control controller is introduced to fully utilize the hardware capabilities of the display control controller, thereby improving the user experience on the one hand and making full use of hardware resources on the other hand.
[0101] In summary, the embodiment of the present application provides a graphics display method, which includes: according to the received rendering vertical synchronization signal, using a preset user interface drawing interface to render the user interface of a preset application program to obtain rendering content; wherein the rendering vertical synchronization signal is obtained by processing the vertical synchronization signal sent by the display controller; requesting to generate a synthetic vertical synchronization signal, and querying the display controller according to the synthetic vertical synchronization signal to obtain a query result; wherein the query result is used to indicate whether the display controller supports the synthesis of all rendering contents; according to the query result, calling the user interface of the display controller to issue a synthesis command for the rendering content to the display controller, so that the display controller synthesizes the rendering content according to the synthesis command and completes the graphic display corresponding to the rendering content. A central processing unit is used to render the user interface of the preset application program, querying whether the display controller supports the synthesis of all rendering contents to obtain a rendering result, issuing a synthesis command for the rendering content to the display controller based on the rendering result, and using the display controller to perform the synthesis operation, based on the way in which the central processing unit and the display controller send the result, the efficiency of rendering synthesis is greatly improved, thereby improving the efficiency of graphics display.
[0102] Moreover, the hardware capabilities of the display controller are fully utilized, the CPU occupancy rate is reduced, the graphics display efficiency is improved, the graphics display is more streamlined, the user experience is improved, and the CPU occupancy rate is also greatly released and optimized.
[0103] Figure 3 A schematic diagram of a method for displaying graphics provided in an embodiment of the present application Figure 2 ,like Figure 3 As shown, before the process of rendering the user interface of the preset application program using the preset user interface drawing interface according to the received rendering vertical synchronization signal in the above S101 to obtain the rendering content, the method may further include:
[0104] S201: Apply for a first cache area from a display controller to complete initialization of a preset application.
[0105] The central processing unit is used to call the libdrm interface through gralloc to apply to the display controller for a first cache area for storing rendering content.
[0106] It should be noted that, before S201, pre-configuration can be performed. Specifically, the system can be started. For example, the system can be an Android system; the buffer application method of gralloc can be configured and implemented. The buffer application method of gralloc can be a dumb buffer. Dumb buffer is a simple cache mechanism for data storage and transmission. The backend method of configuring HWC is DRM / KMS.
[0107] It is worth mentioning that the display controller hardware is used to creatively introduce dumb buffer and open up the DRM / KMS display solution, so that it can adapt to the current increasingly updated display hardware and support more advanced controls and features in software.
[0108] After the process of rendering the user interface of the preset application program using the preset user interface drawing interface according to the received rendering vertical synchronization signal in the above S101 to obtain the rendering content, the method may further include:
[0109] S202: Store the rendered content in a first cache area.
[0110] In some embodiments, initialization of a preset application is completed, the user interface of the preset application is measured, laid out, and drawn, a first cache area is obtained during the drawing process, the user interface of the preset application is rendered using a preset user interface drawing interface, rendering content is obtained, and the rendering content is then stored in the first cache area.
[0111] Figure 4 A schematic diagram of a method for displaying graphics provided in an embodiment of the present application Figure 3 ,like Figure 4 As shown, the process of calling the user interface of the display controller to send the synthesis command to the display controller according to the query result in the above S103 may include:
[0112] S301: If the query result indicates that part of the content in the rendering is not supported, or all of the content in the rendering is not supported, apply to the display controller for a second cache area.
[0113] In an embodiment of the present application, if the query result indicates that the display controller does not support part of the rendering content, or does not support all of the rendering content; the central processing unit calls the libdrm interface through gralloc in SurfaceFlinger to apply for a second cache area from the display controller, and the second cache area is a dumb buffer.
[0114] The second cache area is used to store the content in the rendered content that is not supported by the display controller, and the content that is not supported by the display controller can be marked. For example, if the display controller does not support part of the rendered content, the part of the content is marked; if the display controller does not support all of the rendered content, the whole content is marked.
[0115] S302: According to the parameter information of the rendering content not supported by the display controller, a user interface drawing interface is called to perform an editing operation on each layer corresponding to the unsupported rendering content to obtain display information of each layer in the final synthesized image.
[0116] Among them, each layer in the embodiment of the present application refers to: each layer corresponding to the unsupported rendering content.
[0117] In some embodiments, the central processing unit inputs the rendering content that is marked as not supported by the display controller into SurfaceFlinger, and inputs the parameter information of the rendering content that is not supported by the display controller into SurfaceFlinger, that is, the parameter information of the rendering content that is marked as not supported by the display controller is edited to obtain the display information of each layer in the final composite image.
[0118] S303: Using a user interface drawing interface, synthesize each layer into a second cache area according to display information.
[0119] The 2D UI drawing interface of Skia raster is used to synthesize each layer into the second cache area according to the display information, so as to obtain the synthesized second cache area.
[0120] S304: According to the second cache area and the query result, call the user interface of the display controller to send a synthesis command to the display controller.
[0121] It should be noted that the central processing unit passes the synthesized second cache area to the HWC. In an embodiment of the present application, if there is rendering content supported by the display controller, the HWC calls the user interface libdrm interface of the display controller to send a synthesis command to the display controller based on the rendering content supported by the display controller in the query results and the synthesized second cache area.
[0122] It is worth noting that in the related art, when performing synthesis operations, the GL instructions to be synthesized are passed to the OpenGL ES implementation component, and the conversion of GL instructions to CPU instructions is completed in the component. This involves the transmission of GL instructions, and the translation of GL instructions to central processing unit instructions is extremely time-consuming and inefficient. In the embodiment of the present application, the Skia raster and display controller hardware synthesis combination is adopted, and the original software-simulated OpenGLES solution is abandoned, which can greatly improve the synthesis efficiency and reduce the occupancy of the central processing unit, especially if the display controller hardware is powerful. The synthesis can be completely handed over to the display controller's proprietary hardware to execute with almost no overhead on the central processing unit. Thereby improving the synthesis efficiency and making the user experience change from stuck to smooth and more user-friendly.
[0123] Optionally, Figure 5 A schematic diagram of a graphic display method provided in an embodiment of the present application Figure 4 ,like Figure 5 As shown, the process of calling the user interface of the display controller to send the synthesis command to the display controller according to the second cache area and the query result in the above S304 may include:
[0124] S401, associating the second cache area to the main layer plane of the display controller.
[0125] Among them, the main layer plane can also be called primary plane, and the main layer plane refers to the main layer plane of the display controller hardware.
[0126] In some implementations, the synthesized second cache area is transferred to the HWC, and the libdrm interface is called in the HWC to associate the synthesized second cache area with the primary plane of the display controller.
[0127] S402: If the query result indicates that supported content exists in the rendering content, the supported rendering content is bound to a hardware layer plane supported by the display controller.
[0128] The supported content in the rendered content will also be marked by the display controller. The hardware layer plane can also be called the hardware layer plane.
[0129] In an embodiment of the present application, HWC calls the libdrm interface to bind part of the supported content in the marked rendering content to each hardware layer plane supported by the display controller, wherein the number of hardware layer planes supported by the display controller is at least one.
[0130] It is worth noting that S401 may be executed first and then S402, or S402 may be executed first and then S401, or S401 and S402 may be executed simultaneously, and the embodiments of the present application do not impose specific limitations on this.
[0131] S403: According to the main layer plane and the hardware layer plane, the user interface of the display controller is called to send a synthesis command to the display controller.
[0132] In some implementations, in the HWC, based on the main layer plane and the hardware layer plane supported by the display controller, the user interface libdrm interface of the display controller is called to send a synthesis command to the display controller, and the display controller can receive the synthesis command.
[0133] The synthesis command may be a series of instructions.
[0134] In an embodiment of the present application, a synthesis command is sent to a display controller hardware register, and the synthesis instruction triggers an operation of the display controller hardware register, wherein the operation is simplified according to hardware characteristics, and the simplified instruction is then sent to the display controller hardware, enabling the Blend blender in the display controller to perform algorithmic superposition processing on the content of the Primary main layer and the content of other layers, thereby completing the hardware synthesis work without the need for software intervention, and finally outputting it to the screen through a scanner, and the screen can display graphics corresponding to the rendered content.
[0135] Optionally, Figure 6 A schematic diagram of a graphic display method provided in an embodiment of the present application Figure 5 ,like Figure 6 As shown, the process of calling the user interface of the display controller to send the synthesis command to the display controller according to the second cache area and the query result in the above S304 may include:
[0136] S501, associating the synthesized second cache area to the main layer plane of the display controller.
[0137] It should be noted that the process of S401 is similar to the process of S501, and will not be described in detail here.
[0138] S502: If the query result indicates that there is no supported content in the rendering content, then according to the main layer plane, the user interface of the display controller is called to send a synthesis command to the display controller.
[0139] In an embodiment of the present application, if the query result indicates that there is no supported content in the rendering content, that is, the query result indicates that all the content in the rendering content is not supported, the central processing unit uses HWC to call the user interface libdrm interface of the display controller according to the main layer plane to send a synthesis command to the display controller, and the display controller can receive the synthesis command.
[0140] The synthesis command may be a series of instructions.
[0141] Optionally, Figure 7 A schematic diagram of a graphic display method provided in an embodiment of the present application Figure 6 ,like Figure 7 As shown, the process of calling the user interface drawing interface to perform an editing operation on each layer corresponding to the unsupported rendering content according to the parameter information of the rendering content not supported by the display controller in the above S302 to obtain the display information of each layer in the final synthesized image may include:
[0142] S601: Call a user interface drawing interface to perform rotation, scaling, and cropping operations on each layer according to parameter information of unsupported rendering content.
[0143] The parameter information of the unsupported rendering content includes: the ZOrder, transparency, size, position, etc. of the rendering content that is not supported by the display controller as parameters. The ZOrder, transparency, size, position, etc. of the rendering content that is not supported by the display controller are input in SurfaceFlinger.
[0144] In some implementations, the user interface drawing interface is a 2D UI drawing interface of Skia raster, and according to the ZOrder, transparency, size, and position of the rendered content not supported by the display controller, the 2D UI drawing interface of Skia raster is called to perform a series of operations such as rotation, scaling, and cropping.
[0145] S602: Calculate the position information and visible area of each layer in the final composite image.
[0146] The display information includes location information and visible area.
[0147] In an embodiment of the present application, an open source solution may be used to calculate the position information and visible area of each layer in the final composite image.
[0148] Optionally, the process of calling the user interface of the display controller to send the synthesis command to the display controller according to the query result in S103 may include:
[0149] If the query result indicates that the display controller supports all the contents in the rendering content, the user interface of the display controller is called to bind the rendering content to the corresponding plane, and a synthesis command is issued to the display controller.
[0150] In some embodiments, if the query result indicates that the display controller supports all the rendering content, the central processor will call the display controller's user interface libdrm interface through HWC, bind all supported rendering content to the corresponding plane, and send a synthesis command to the display controller, which can receive the synthesis command.
[0151] In an embodiment of the present application, the synthesis command will be sent to the hardware register of the display controller, where the operation will be simplified according to the hardware characteristics, and the Blend superimposer in the display controller will be enabled to perform algorithmic superposition processing on the content of the Primary main layer and the content of other layers to complete the hardware synthesis work. This process does not require software intervention. The final synthesized content is then output to the screen through the scanner, and the graphics corresponding to the rendered content can be displayed on the screen.
[0152] The process of calling the user interface of the display controller to issue a synthesis command for the rendering content to the display controller according to the query result in S103, so that the display controller synthesizes the rendering content according to the synthesis command and completes the graphic display corresponding to the rendering content, may include:
[0153] According to the query results, the user interface of the display controller is called to send a synthesis command for the rendering content to the hardware register in the display controller, so that the hardware register simplifies the synthesis command to obtain the simplified synthesis command, and sends the simplified synthesis command to the display controller, so that the display controller performs algorithm overlay processing to complete the graphic display corresponding to the rendering content.
[0154] In an embodiment of the present application, the display controller calls the user interface of the display controller to send a synthesis command for rendering content to the hardware register in the display controller, and the hardware register in the display controller triggers an operation, which simplifies the synthesis command according to the hardware characteristics and generates a simplified synthesis command. Among them, whether to simplify the synthesis command can be determined according to the hardware capabilities of the display controller.
[0155] Among them, the hardware register in the display controller sends the streamlined synthesis command to the display controller hardware, and the display controller hardware starts the Blend blender in the display controller to perform algorithmic superposition processing on the content of the Primary main layer and the content of other layers to complete the hardware synthesis work without the need for software intervention. Finally, it is output to the screen through the scanner, and the graphics corresponding to the rendered content can be displayed on the screen.
[0156] It is worth noting that the embodiment of the present application uses a pure central processing unit architecture of a mobile terminal operating system, and the display controller may only support the Primary main layer, or support two or more layers of Primary and Cursor cursor layers.
[0157] In summary, the embodiment of the present application provides a graphics display method, which uses a central processing unit to render the user interface of a preset application, queries the display controller whether it supports the synthesis of all rendering content to obtain a rendering result, and sends a synthesis command for the rendering content to the display controller based on the rendering result. The display controller is used to perform synthesis operations, and based on the combination of the central processing unit and the display controller, the efficiency of rendering synthesis is greatly improved, thereby improving the efficiency of graphics display.
[0158] Moreover, in the prior art, the frame buffer FB component does not natively support multi-layer synthesis, does not support VSYNC, does not support DMA-BUF (it is an independent subsystem in the kernel, providing a unified framework for sharing caches between different devices and subsystems), does not support asynchronous updates, does not support fence mechanisms (a security protection mechanism that can effectively control or separate unauthorized resources or computer programs in the network system), etc., and can only provide the most basic display functions, which cannot meet the display requirements of current upper-layer applications and underlying hardware. However, in this application, the original frame buffer display solution is abandoned and the DRM / KMS display solution is opened. Thus, it can adapt to the current increasingly updated display hardware, and the software can support more advanced controls and features, such as supporting multi-layer synthesis, supporting VSYNC, supporting DMA-BUF, supporting asynchronous updates, supporting fence mechanisms, etc. It meets the support of the current increasingly updated display hardware and upper-layer software for display control and related features. Among them, the display controller hardware support framework code is introduced.
[0159] In addition, the introduction of Skia raster rendering and Skia raster combined with display controller synthesis solutions, and abandoning the original software-simulated OpenGL ES solution, can greatly improve the rendering and synthesis efficiency, make full use of the hardware capabilities of the display controller, reduce the CPU occupancy rate, and change the user experience from stuttering to smooth and easy-to-use effects, and the CPU occupancy rate is also greatly released and optimized.
[0160] The following describes a graphic display device, a graphic display equipment, a storage medium, etc. used to execute the graphic display method provided in the present application. The specific implementation process and technical effects thereof refer to the relevant contents of the above-mentioned graphic display method, which will not be repeated below.
[0161] Figure 8A schematic diagram of the structure of a graphic display device provided in an embodiment of the present application is shown in FIG. Figure 8 As shown, the device may include:
[0162] The rendering module 101 is used to render the user interface of the preset application program using a preset user interface drawing interface according to the received rendering vertical synchronization signal to obtain rendering content; wherein the rendering vertical synchronization signal is obtained by processing the vertical synchronization signal sent by the display controller;
[0163] A query module 102, used for requesting to generate a synthetic vertical synchronization signal, and querying the display controller according to the synthetic vertical synchronization signal to obtain a query result; wherein the query result is used to indicate whether the display controller supports synthesis of all the rendering contents;
[0164] The sending module 103 is used to call the user interface of the display controller to send a synthesis command for the rendering content to the display controller according to the query result, so that the display controller synthesizes the rendering content according to the synthesis command and completes the graphic display corresponding to the rendering content.
[0165] Optionally, the device further comprises:
[0166] An application module, used for applying for a first cache area from the display controller to complete the initialization of the preset application;
[0167] The device also includes:
[0168] A storage module is used to store the rendered content in the first cache area.
[0169] Optionally, the sending module 103 is specifically used to apply for a second cache area from the display controller if the query result indicates that part of the rendering content is not supported, or all of the rendering content is not supported; based on the parameter information of the rendering content not supported by the display controller, call the user interface drawing interface to perform editing operations on each layer corresponding to the unsupported rendering content to obtain display information of each layer in the final composite image; use the user interface drawing interface to synthesize each layer into the second cache area according to the display information; and based on the second cache area and the query result, call the user interface of the display controller to send the synthesis command to the display controller.
[0170] Optionally, the sending module 103 is specifically used to associate the second cache area to the main layer plane of the display controller; if the query result indicates that there is supported content in the rendering content, the supported rendering content is bound to the hardware layer plane supported by the display controller; according to the main layer plane and the hardware layer plane, the user interface of the display controller is called to send the synthesis command to the display controller.
[0171] Optionally, the sending module 103 is specifically used to associate the synthesized second cache area to the main layer plane of the display controller; if the query result indicates that there is no supported content in the rendered content, then according to the main layer plane, the user interface of the display controller is called to send the synthesis command to the display controller.
[0172] Optionally, the sending module 103 is specifically used to call the user interface drawing interface to perform rotation, scaling, and cropping operations on each layer according to the parameter information of the unsupported rendering content; calculate the position information and the visible area of each layer in the final composite image; and the display information includes the position information and the visible area.
[0173] Optionally, the sending module 103 is specifically configured to call the user interface of the display controller to bind the rendering content to a corresponding plane and send the synthesis command to the display controller if the query result indicates that the display controller supports all the rendering content.
[0174] Optionally, the sending module 103 is specifically used to call the user interface of the display controller to send a synthesis command for the rendering content to the hardware register in the display controller according to the query result, so that the hardware register simplifies the synthesis command to obtain a simplified synthesis command, and sends the simplified synthesis command to the display controller, so that the display controller performs algorithm overlay processing to complete the graphic display corresponding to the rendering content.
[0175] The above-mentioned device is used to execute the method provided by the aforementioned embodiment, and its implementation principle and technical effect are similar, which will not be repeated here.
[0176] The above modules may be one or more integrated circuits configured to implement the above methods, such as one or more application specific integrated circuits (ASIC), or one or more digital singnal processors (DSP), or one or more field programmable gate arrays (FPGA). For another example, when a module is implemented in the form of a processing element scheduling program code, the processing element may be a general-purpose processor, such as a central processing unit (CPU) or other processor that can call program code. For another example, these modules may be integrated together and implemented in the form of a system-on-a-chip (SOC).
[0177] Fig. 9 A hardware structure diagram of a display controller provided in an embodiment of the present application is shown in FIG. Fig. 9 As shown, the hardware structure of the display controller may include: DRM frame buffer (framebuffer), layer hardware (planes), scanner (CRTC), encoder (encoder), connector (connector), and screen.
[0178] Among them, the DRM frame buffer, scanner, encoder, connector, and screen are connected in sequence, and the layer hardware is connected to the scanner.
[0179] Fig.10 A schematic diagram of a structure of a graphic display device provided in an embodiment of the present application is shown in FIG. Fig.10 As shown, the graphic display device includes: a central processor 201 and a display controller 202, the central processor 201 and the display controller 202 are in communication connection, and the central processor 201 is used to execute the above-mentioned graphic display method. The specific implementation method and technical effect are similar and will not be repeated here.
[0180] Optionally, the present application also provides a program product, such as a computer-readable storage medium, including a program, which is used to execute the above method embodiment when executed by a processor.
[0181] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0182] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0183] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of hardware plus software functional units.
[0184] The above-mentioned integrated unit implemented in the form of a software functional unit can be stored in a computer-readable storage medium. The above-mentioned software functional unit is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor (English: processor) to perform some steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (English: Read-Only Memory, abbreviated: ROM), random access memory (English: Random Access Memory, abbreviated: RAM), disk or optical disk and other media that can store program codes.
[0185] The above are only preferred embodiments of the present application and are not intended to limit the present application. For those skilled in the art, the present application may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims
1. A graphic display method, characterized in that: Applicable to CPU, including: According to the received rendering vertical synchronization signal, a preset user interface drawing interface is used to render the user interface of the preset application program to obtain rendering content; wherein the rendering vertical synchronization signal is obtained by processing the vertical synchronization signal sent by the display controller; Requesting to generate a synthetic vertical synchronization signal, and querying the display controller according to the synthetic vertical synchronization signal to obtain a query result; wherein the query result is used to indicate whether the display controller supports synthesis of all the rendering contents; According to the query result, the user interface of the display controller is called to send a synthesis command for the rendering content to the display controller, so that the display controller synthesizes the rendering content according to the synthesis command and completes the graphic display corresponding to the rendering content.
2. The method according to claim 1, characterized in that Before rendering the user interface of the preset application program using a preset user interface drawing interface according to the received rendering vertical synchronization signal to obtain the rendering content, the method further includes: Applying for a first cache area from the display controller to complete initialization of the preset application; After rendering the user interface of the preset application program using a preset user interface drawing interface according to the received rendering vertical synchronization signal and obtaining the rendering content, the method further includes: The rendered content is stored in the first cache area.
3. The method according to claim 1, characterized in that: The step of calling the user interface of the display controller to send a synthesis command to the display controller according to the query result includes: If the query result indicates that part of the rendered content is not supported, or all of the rendered content is not supported, applying for a second cache area from the display controller; According to the parameter information of the rendering content not supported by the display controller, calling the user interface drawing interface to perform an editing operation on each layer corresponding to the unsupported rendering content, so as to obtain display information of each layer in the final synthesized image; Using the user interface drawing interface, synthesizing each layer into the second cache area according to the display information; According to the second cache area and the query result, the user interface of the display controller is called to send the synthesis command to the display controller.
4. The method according to claim 3, characterized in that The step of calling the user interface of the display controller to send a synthesis command to the display controller according to the second cache area and the query result includes: Associating the second buffer area to the main layer plane of the display controller; If the query result indicates that there is supported content in the rendering content, binding the supported rendering content to a hardware layer plane supported by the display controller; According to the main layer plane and the hardware layer plane, the user interface of the display controller is called to send the synthesis command to the display controller.
5. The method according to claim 3, characterized in that: The step of calling the user interface of the display controller to send a synthesis command to the display controller according to the second cache area and the query result includes: Associating the synthesized second buffer area to the main layer plane of the display controller; If the query result indicates that there is no supported content in the rendering content, then according to the main layer plane, the user interface of the display controller is called to send the synthesis command to the display controller.
6. The method according to claim 3, characterized in that: The step of calling the user interface drawing interface to perform an editing operation on each layer corresponding to the unsupported rendering content according to the parameter information of the rendering content not supported by the display controller to obtain display information of each layer in the final synthesized image includes: Calling the user interface drawing interface to perform rotation, scaling, and cropping operations on each layer according to the parameter information of the unsupported rendering content; The position information and the visible area of each layer in the final composite image are calculated; and the display information includes the position information and the visible area.
7. The method according to claim 1, characterized in that The step of calling the user interface of the display controller to send a synthesis command to the display controller according to the query result includes: If the query result indicates that the display controller supports all the contents in the rendering content, the user interface of the display controller is called to bind the rendering content to the corresponding plane, and the synthesis command is issued to the display controller.
8. The method according to any one of claims 1 to 7, characterized in that: The method of calling the user interface of the display controller according to the query result to issue a synthesis command for the rendering content to the display controller, so that the display controller synthesizes the rendering content according to the synthesis command to complete the graphic display corresponding to the rendering content, includes: According to the query result, the user interface of the display controller is called to send a synthesis command for the rendering content to the hardware register in the display controller, so that the hardware register simplifies the synthesis command to obtain a simplified synthesis command, and the simplified synthesis command is sent to the display controller, so that the display controller performs algorithm overlay processing to complete the graphic display corresponding to the rendering content.
9. A graphic display device, characterized in that: Applicable to CPU, including: A rendering module, configured to render a user interface of a preset application program using a preset user interface drawing interface according to a received rendering vertical synchronization signal, so as to obtain rendering content; wherein the rendering vertical synchronization signal is obtained by processing a vertical synchronization signal sent by a display controller; A query module, used for requesting to generate a synthetic vertical synchronization signal, and querying the display controller according to the synthetic vertical synchronization signal to obtain a query result, wherein the query result is used to indicate whether the display controller supports synthesis of all the rendering contents; The sending module is used to call the user interface of the display controller to send a synthesis command for the rendering content to the display controller according to the query result, so that the display controller synthesizes the rendering content according to the synthesis command and completes the graphic display corresponding to the rendering content.
10. A graphic display device, characterized in that: include: A central processing unit and a display controller, wherein the central processing unit and the display controller are communicatively connected, and the central processing unit is used to execute the graphics display method according to any one of claims 1 to 8.
11. A computer-readable storage medium, characterized in that: The storage medium stores a computer program, and when the computer program is read and executed, the graphic display method according to any one of claims 1 to 8 is implemented.
