Display method and device, electronic equipment and computer program product

Abstract

The embodiment of the invention discloses a display method and device, electronic equipment and a computer program product, and the method comprises the steps: obtaining the operation information of the electronic equipment through a display management module, determining a target time interval of two adjacent frames of Vsync signals according to the operation information, generating a first rendering signal and a first synthesis signal based on the target time interval, and displaying the first rendering signal and the first synthesis signal. And triggering the application program to start to render the next frame of image content and triggering the display management module to perform synthesis operation on the rendered next frame of image content to obtain interface data, and transmitting the interface data to the display panel so as to display an interface image corresponding to the interface data through the display panel. The display management module can determine the target time interval of the two adjacent frames of Vsync signals according to the operation information of the electronic equipment and generate the rendering signal and the composite signal, the display management module does not need to calibrate the rendering signal and the composite signal based on a TE signal, and the display flexibility of the display interface image of the display panel of the electronic equipment is improved.

Description

Technical Field

[0001] The present application relates to the field of display technology, and particularly relates to a display method, apparatus, electronic device, and computer program product. Background Art

[0002] With the improvement of display technology, more and more electronic devices that support higher frame rates are introduced. For example, electronic devices that support 120 Hz (hertz) or even 144 Hz frame rates can make the display of dynamic images smoother, significantly reduce the dynamic blur of the human eye, and bring a smoother experience.

[0003] However, in the related art, electronic devices usually display images based on a fixed frame rate. For example, when displaying at a high frame rate by default, the display flexibility of the display panel of the electronic device for displaying interface images is poor. Summary of the Invention

[0004] Embodiments of the present application disclose a display method, apparatus, electronic device, and computer program product, which can improve the display flexibility of the display panel of the electronic device for displaying interface images.

[0005] Embodiments of the present application disclose a display method applied to an electronic device, where the electronic device includes a display panel, and the method includes:

[0006] Obtaining the operation information of the electronic device through a display management module, and determining a target time interval between two adjacent vertical synchronization Vsync signals according to the operation information, where the Vsync signal includes a rendering signal and a composition signal;

[0007] Generating a first rendering signal and a first composition signal by the display management module according to the target time interval, where the first rendering signal is used to trigger an application program to start rendering the next frame of image content, and the first composition signal is used to trigger the display management module to perform a composition operation on the rendered next frame of image content to obtain interface data;

[0008] Transmitting the interface data to the display panel so that the display panel displays an interface image corresponding to the interface data.

[0009] Embodiments of the present application disclose a display apparatus applied to an electronic device, where the electronic device includes a display panel, and the apparatus includes:

[0010] An interval determination module, configured to obtain the operation information of the electronic device through a display management module, and determine a target time interval between two adjacent vertical synchronization Vsync signals according to the operation information, where the Vsync signal includes a rendering signal and a composition signal;

[0011] A signal generation module, configured to generate a first rendering signal and a first composition signal according to the target time interval through the display management module, where the first rendering signal is used to trigger an application to start rendering the next frame of image content, and the first composition signal is used to trigger the display management module to perform a composition operation on the next frame of image content obtained by rendering to obtain interface data;

[0012] An image display module, configured to transmit the interface data to the display panel so that the display panel displays the interface image corresponding to the interface data.

[0013] An embodiment of the present application discloses an electronic device, including a memory and a processor. A computer program is stored in the memory. When the computer program is executed by the processor, the processor implements any one of the display methods disclosed in the embodiments of the present application.

[0014] An embodiment of the present application discloses a computer program product, including a computer program, where the computer program enables a computer to execute any one of the display methods disclosed in the embodiments of the present application.

[0015] An embodiment of the present application discloses a display method, device, electronic device, and computer program product. The display management module obtains the operation information of the electronic device and determines the target time interval between two adjacent Vsync signals according to the operation information. The display management module can generate a first rendering signal and a first composition signal based on the target time interval, so as to trigger an application to start rendering the next frame of image content and trigger the display management module to perform a composition operation on the next frame of image content obtained by rendering to obtain interface data, and transmit the interface data to the display panel to display the interface image corresponding to the interface data through the display panel. In the embodiment of the present application, the display management module of the electronic device can determine the target time interval between adjacent Vsync signals by itself according to the operation information of the electronic device and generate a rendering signal and a composition signal. The display management module does not need to calibrate the rendering signal and the composition signal based on the TE signal generated by the display panel, so that the refresh rate of the display panel is no longer limited by the generation frequency of the TE signal, realizing a more flexible display mechanism, improving the display flexibility of the display panel of the electronic device for displaying the interface image, and making the refresh rate of the display panel match the operation information of the electronic device, improving the display accuracy. Description of the Drawings

[0016] To more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings required for the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, without creative efforts, other drawings can be obtained according to these drawings.

[0017] Figure 1 It is a block diagram schematic of a display architecture of an electronic device disclosed in an embodiment of the present application;

[0018] Figure 2 It is a schematic diagram of an image display process in the related art;

[0019] Figure 3 It is a schematic flowchart of a display method disclosed in an embodiment of the present application;

[0020] Figure 4 It is a schematic flowchart of a signal generation process disclosed in an embodiment of the present application;

[0021] Figure 5 It is a schematic flowchart of a display process disclosed in an embodiment of the present application;

[0022] Figure 6 It is a schematic diagram of an image display process disclosed in an embodiment of the present application;

[0023] Figure 7 It is a schematic structural diagram of a display device disclosed in an embodiment of the present application;

[0024] Figure 8 It is a schematic structural diagram of an electronic device disclosed in an embodiment of the present application. Detailed implementation manners

[0025] Next, the technical solutions in the embodiments of the present application will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.

[0026] It should be noted that the terms "including" and "having" in the embodiments of the present application and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but may optionally further include steps or units not listed, or may optionally further include other steps or units inherent to these processes, methods, products or devices.

[0027] Figure 1It is a block diagram schematic of a display delivery architecture of an electronic device provided by an embodiment of the present application. This display delivery architecture is a hierarchical architecture, which mainly includes an application layer (also called the app layer), a service framework layer, a hardware abstraction layer (Hardware Abstraction Layer, HAL), and a hardware layer from top to bottom. Hereinafter, the Android system will be taken as an example for introduction.

[0028] Among them, the application layer may include a series of applications, which may include game applications, video playback applications, video call applications, camera applications, and short message applications, etc. The application can perform image drawing operations through the CPU or GPU according to the current interface state, input events, and drawing logic, and render the content of the next frame of image.

[0029] The service framework layer may include SurfaceFlinger. SurfaceFlinger is a key component in the Android system and it acts as a display compositor. Its main responsibility is to manage the graphic buffers of all applications and the system in the Android system and synthesize them onto the physical display screen. In short, SurfaceFlinger is responsible for collecting the content of the next frame of image from different program applications and ensuring that these contents of the next frame of image are correctly combined together to obtain the interface data. SurfaceFlinger can collect the content of the next frame of image rendered by each application, map these contents of the next frame of image into the corresponding layers, and generate corresponding synthesis information according to the layer attributes.

[0030] The hardware abstraction layer may include HWC (Hardware Composer). HWC is a module in the Android system used to hand over the synthesis task to the underlying display hardware for execution. HWC can synthesize the layers received from SurfaceFlinger based on the synthesis information, and HWC sends the synthesized interface data to the display panel.

[0031] The hardware layer may include a display panel. The display panel may include a DDIC (Display Driver IC) and a display screen. Among them, the DDIC is used to obtain the interface data and drive the display screen to display the interface image corresponding to the interface data. Exemplarily, the display screen may include an LCD (Liquid Crystal Display), an OLED (Organic Light-Emitting Diode), a TFT-LCD (Thin film transistor liquid crystal display), etc.

[0032] In the related art, the display panel of an electronic device is configured with several selectable fixed refresh rates, such as 60 Hz (Hertz), 90 Hz, 120 Hz, 144 Hz, etc. When the user selects a certain fixed refresh rate, the display panel will generate a TE (Tearing Effect) signal corresponding to the fixed refresh rate, and the generation frequency of the TE signal is consistent with the fixed refresh rate. SurfaceFlinger will calibrate and generate Vsync (Vertical Synchronization) signals such as Vsync-APP signal and Vsync-SF signal according to the TE signal generated by the display panel. The Vsync-APP signal is the vertical synchronization signal used by the application layer, mainly used to control the rendering timing of the application program, and the Vsync-SF signal is the vertical synchronization signal used by SurfaceFlinger, mainly used to control the composition timing of SurfaceFlinger, thereby providing a display mechanism for each display module (such as the application program, SurfaceFlinger), that is, realizing the synchronization of the rendering of the application program, the composition of SurfaceFlinger, and the refresh of the display panel.

[0033] Figure 2FIG. 0 shows a schematic diagram of an image transmission and display process in the related art. Taking the generation and display of the interface image B as an example, in the related art, SurfaceFlinger predicts the generation time of the TE signal corresponding to the interface image B according to the refresh rate of the display panel and the generation time of the TE signal corresponding to the previous frame image (i.e., the interface image A) (the TE signal used to trigger the display panel to display the interface image A). SurfaceFlinger determines the generation time of the Vsync-SF signal corresponding to the interface image B according to the predicted generation time of the TE signal corresponding to the interface image B and the preset working duration of SurfaceFlinger (the duration required to synthesize one frame of image), and then determines the generation time of the Vsync-APP signal corresponding to the interface image B based on the generation time of the Vsync-SF signal corresponding to the interface image B and the preset working duration of the application program (the duration required to render one frame of image). SurfaceFlinger generates the Vsync-APP signal at the generation time of the Vsync-APP signal corresponding to the interface image B to trigger the application program to start rendering the interface image B, and generates the Vsync-SF signal at the generation time of the Vsync-SF signal corresponding to the interface image B to trigger SurfaceFlinger to synthesize the rendered interface image B, and then sends the synthesized interface image B to the display panel for display. Thus, the Vsync-APP signal and the Vsync-SF signal are calibrated according to the TE signal, and the generation frequencies of the Vsync-APP signal and the Vsync-SF signal are the same as the generation frequency of the TE signal, that is, the frame rate of SurfaceFlinger can only be changed between several fixed frame rates. Among them, the refresh rate can refer to the number of times the display panel of the electronic device refreshes the display screen frame within a unit time (such as 1 second), and the frame rate can refer to the number of frames of images synthesized and output by SurfaceFlinger within a unit time (such as 1 second).

[0034] In the above technical solution, the user can only select between several fixed refresh rates, resulting in that the generation frequencies of the Vsync-APP signal and the Vsync-SF signal can only be switched between several fixed frequencies, and the display flexibility of the display panel for displaying the interface image is poor.

[0035] Embodiments of the present application disclose a display method, device, electronic device, and computer program product, which can improve the display flexibility of the display panel of the electronic device for displaying the interface image.

[0036] Taking the Android system as an example, SurfaceFlinger obtains the running information of the electronic device, determines the target time interval between two adjacent frames of Vsync signals according to the running information, SurfaceFlinger generates a Vsync-APP signal according to the target time interval, and the application starts to render the content of the next frame in response to the Vsync-APP signal. When the time interval from generating the Vsync-APP signal reaches the target time interval, SurfaceFlinger generates a Vsync-SF signal. SurfaceFlinger controls HWC to synthesize the content of the rendered next frame of image in response to the Vsync-SF signal to obtain interface data, and HWC transmits the interface data to the display panel so that the display panel displays the interface image corresponding to the interface data. By improving the original display structure framework of the Android system, the refresh rate is changed from being determined by the TE signal generated by the display panel to being determined by SurfaceFlinger according to the running conditions of the electronic device. The determination of the refresh rate of the display panel changes from hardware to software. The generation of the Vsync-APP signal and the Vsync-SF signal no longer depends on the TE signal, improving the display flexibility of the display panel of the electronic device to display the interface image.

[0037] Figure 3 FIG. shows a schematic flowchart of a display method provided by an embodiment of the present application. As Figure 3 shown, the method may include steps 302 to 306.

[0038] Step 302, obtaining the running information of the electronic device through the display management module, and determining the target time interval between two adjacent frames of Vsync signals according to the running information.

[0039] Among them, the Vsync signal may include a rendering signal and a synthesis signal. The display management module is located in the service framework layer of the electronic device, and the display management module is mainly used to provide services for the display of all application programs. The target time interval refers to the time interval between the generation times of two adjacent frames of Vsync signals, such as the time interval between the generation times of two adjacent rendering signals, or the time interval between the generation times of two adjacent synthesis signals. In this embodiment, the Vsync signal can be used to coordinate the rendering process and the synthesis process of the interface image, control the start time of the rendering process and the start time of the synthesis process through the Vsync signal, and reduce unnecessary calculations and data transmissions to optimize the overall performance of the system.

[0040] It should be noted that the rendering signal can be used to trigger the application to start rendering the image content, and the composition signal can be used to trigger the display management module to start composing the rendered image content. If the target time interval between two adjacent Vsync signals is smaller, the frame rate is higher, the composition frequency is higher, the response speed (smoothness) of the electronic device is higher, the power consumption is higher, and the temperature is higher. That is, the target time interval affects the response speed, power consumption, and temperature of the electronic device. The operation information can be used to describe the operating state of the electronic device, and the emphasis on response speed, power consumption, and temperature is different in different operating states. Therefore, the target time interval can be dynamically adjusted based on the operation information to achieve the balance optimization between the performance and power consumption of the electronic device.

[0041] Optionally, the operation information may include but is not limited to at least one of the application type corresponding to the running application, the remaining battery power, the temperature of the electronic device, and the load of the graphics processing unit.

[0042] It should be noted that the running application may refer to the application that the electronic device is running. Different applications have different requirements for response speed. The target time interval is determined according to the application type corresponding to the application, so that the response speed of the electronic device matches the running application.

[0043] Exemplarily, the application type of the application may include but is not limited to video playback, games, social networking, reading, etc. Among them, video playback and game applications require a higher response speed. If it is detected that the electronic device is running video playback or game applications, it is determined that the target time interval is greater than or equal to the first duration threshold. Social networking and reading applications require a lower response speed. If it is detected that the electronic device is running social networking or reading applications, it is determined that the target time interval is less than the first duration threshold.

[0044] It should be noted that the remaining battery power may refer to the percentage of the battery power or the remaining capacitance of the energy storage device (such as a battery) of the electronic device. In the case of a small remaining battery power, it is necessary to reduce the power consumption of the electronic device to extend the usage time of the electronic device. Exemplarily, if the remaining battery power of the electronic device is less than the battery power threshold, it is determined that the target time interval is greater than the second duration threshold. If the remaining battery power of the electronic device is greater than or equal to the battery power threshold, the target time interval is less than or equal to the second duration threshold.

[0045] It should be noted that the temperature of the electronic device may include the temperature of the display panel and the temperature of the image processing unit, etc. If the temperature of the electronic device is too high, the service life of the electronic device will be reduced. Therefore, in the case of a high temperature of the electronic device, it is necessary to reduce the temperature of the electronic device. Optionally, the image processing unit may include a GPU (Graphic Processing Unit, graphics processor).

[0046] Exemplarily, if the temperature of the electronic device is greater than or equal to the temperature threshold, it is determined that the target time interval is greater than or equal to the third duration threshold to avoid overheating of the electronic device and ensure the lifespan of the electronic device. If the temperature of the electronic device is less than the temperature threshold, it is determined that the target time interval is less than the third duration threshold.

[0047] It should be noted that the load of the graphics processing unit may refer to the current operation load condition of the graphics processing unit, such as occupancy rate, power consumption, etc. When the load of the graphics processing unit is high, if a high frame rate is maintained, frame dropping or frame freezing will occur. Therefore, when the load of the graphics processing unit is high, the frame rate needs to be reduced. Exemplarily, if the load of the image processing unit is greater than or equal to the load threshold, it is determined that the target time interval is greater than or equal to the fourth duration threshold to reduce the frame rate. If the load of the image processing unit is less than the load threshold, it is determined that the target time interval is less than the fourth duration threshold.

[0048] It should be noted that in the case where the operation information includes multiple operation parameters, the target time interval can be comprehensively determined according to the multiple operation parameters. The operation parameters include the application type corresponding to the running application, the remaining battery power, the temperature of the electronic device, or the load of the graphics processing unit, etc.

[0049] In some embodiments, the display management module determines the target parameter interval to which the multiple operation parameters belong, and based on the first mapping relationship, determines the target time interval between two adjacent Vsync signals according to the target interval group including the target parameter interval to which the multiple operation parameters belong.

[0050] It should be noted that the first mapping relationship can be established in advance. The first mapping relationship includes multiple interval groups and multiple time intervals corresponding to the multiple interval groups. The interval group includes multiple parameter intervals corresponding to the first operation parameter, where the first operation parameter is any one of the multiple operation parameters. Exemplarily, the display management module can first determine the target parameter interval to which the first operation parameter belongs, and then find, from the first mapping relationship, the target interval group including the target parameter intervals respectively corresponding to the multiple operation parameters, and use the time interval corresponding to the target interval group as the target time interval.

[0051] In this embodiment, the display management module can obtain multiple operation parameters during operation and determine the target parameter interval to which the multiple operation parameters belong, so as to quickly find the target interval matching the multiple operation parameters, comprehensively consider the multiple operation parameters to determine the target time interval, and improve the adaptability between the frame rate of the electronic device and the running state of the electronic device.

[0052] In some embodiments, the display management module determines a parameter score corresponding to a first operating parameter, determines an operating score corresponding to the electronic device according to the parameter scores of various operating parameters, and determines a target time interval based on the second mapping relationship according to the operating score corresponding to the electronic device.

[0053] The first operating parameter is any one of a plurality of operating parameters. It should be noted that the second mapping relationship can be established in advance. The second mapping relationship includes a plurality of operating scores and a plurality of time intervals corresponding to the plurality of operating scores, that is, the plurality of operating scores and the plurality of time intervals are in one-to-one correspondence.

[0054] Exemplarily, the higher the parameter score corresponding to the first operating parameter, the higher the operating score corresponding to the electronic device, indicating that the electronic device can support a higher frame rate. Taking the operating parameter as the temperature of the electronic device as an example, if the temperature of the electronic device is higher than or equal to the temperature threshold, it is determined that the operating score corresponding to the temperature of the electronic device is very low, the operating score of the electronic device is also low, and the frame rate should be small, that is, the target time interval should be set larger.

[0055] In this embodiment, the display management module determines the parameter scores corresponding to various operating parameters, and then determines the operating score corresponding to the electronic device according to the plurality of parameter scores, thereby improving the matching degree between the operating score and the operating state of the electronic device and ensuring the reliability of the determined target time interval.

[0056] Exemplarily, the rendering signal includes a Vsync-APP signal, and the composition signal includes a Vsync-SF signal. The display management module may include SurfaceFlinger. The Vsync-APP signal is used to trigger the application to start rendering image content, and the Vsync-SF signal is used to trigger SurfaceFlinger to perform a composition operation on the rendered image content. It can be understood that this embodiment takes the Android system as an example. In other operating systems (such as the IOS system, etc.), as long as the functions implemented by each functional module are similar to those of the embodiments of the present application, the solution of the present application can also be implemented.

[0057] Step 304, the display management module generates a first rendering signal and a first composition signal according to the target time interval.

[0058] The first rendering signal is used to trigger the application to start rendering the next frame of image content, and the first composition signal is used to trigger the display management module to perform a composition operation on the rendered next frame of image content to obtain interface data. The next frame of image content may refer to the image content that the application is about to start rendering. Exemplarily, please refer to Figure 2, if at the current moment, the application is rendering the content of frame A or has completed rendering the content of frame A, then frame B is the content of the next frame.

[0059] It should be noted that the time interval between the rendering signals of two adjacent frames generated by the display management module is the target time interval, and the time interval between the synthesis signals of two adjacent frames generated is the target time interval, so that the time interval for triggering the application to render matches the operating state of the electronic device.

[0060] In some embodiments, when the current moment is at a target time interval from the second rendering signal, the display management module generates a first rendering signal, and when the current moment is at a target time interval from the second synthesis signal, the display management module generates a first synthesis signal. Among them, the second rendering signal is used to trigger the application to start rendering the content of the current frame, and the second synthesis signal is used to trigger the display management module to perform a synthesis operation on the rendered content of the current frame.

[0061] In this embodiment, the display management module can generate the first rendering signal and the first synthesis signal according to the target time interval between two adjacent Vsync signals, without relying on the TE signal generated by the display panel. That is, the generation of the first rendering signal and the first synthesis signal is not restricted by the fixed refresh rate of the display panel, improving the display flexibility of the display interface of the display panel.

[0062] It should be noted that in the related art, if the refresh rate of the display panel is adjusted, the display panel needs to generate at least two frames of TE signals first, so that the generation frequency of the Vsync signal generated by the display management module, or the frame rate, matches the updated refresh rate of the display panel. Obviously, there is a delay in the update of the generation frequency of the Vsync signal.

[0063] In this embodiment, the display management module obtains the running information and determines the target time interval between two adjacent Vsync signals according to the running information. Based on this target time interval, a first rendering signal for triggering the application to start rendering the content of the next frame and a first synthesis signal for triggering the display management module to perform a synthesis operation on the rendered content of the next frame can be generated. Obviously, the frequency adjustment delay in this embodiment is very small, improving the real-time performance of the refresh rate adjustment.

[0064] It can be understood that the generation moment of the rendering signal generated by the display management module and the reception moment when the application receives this rendering signal can be considered the same moment, and the generation moment of the synthesis signal generated by the display management module and the reception moment when the display management module receives this synthesis signal can be considered the same moment.

[0065] Step 306: Transmit the interface data to the display panel so that the display panel displays the interface image corresponding to the interface data.

[0066] It should be noted that when the interface data is transmitted to the display panel, the display panel displays the interface image corresponding to the interface data. Exemplarily, in response to the first synthesis signal, the display management module controls the hardware synthesizer to synthesize the next frame of image content obtained by rendering to obtain the interface data. The hardware synthesizer can transmit the interface data to the display panel through the display controller. Exemplarily, the display controller can be connected to the display panel through a MIPI (Mobile Industry Processor Interface) interface.

[0067] It should be noted that in this embodiment, when the display panel receives the interface data, even if the display panel does not generate a TE signal, the display panel can still display the interface image corresponding to the interface data, that is, it can achieve that rendering, synthesis, and display do not depend on the TE signal.

[0068] In some embodiments, when the display panel receives the complete interface data, it displays the interface image corresponding to the interface data. It should be noted that when the display panel receives the complete interface data, it can display the interface image corresponding to the interface data without relying on the trigger of the TE signal.

[0069] In some other embodiments, during the process of synthesizing the next frame of image content obtained by rendering, each time a row of pixel data is synthesized, the obtained row of pixel data is transmitted to the display panel so that the display panel displays the pixels corresponding to the row of pixel data. It should be noted that the interface image can include pixels corresponding to multiple rows of pixel data. In this embodiment, a mechanism of synthesizing while displaying is implemented, so that the display panel can ensure the display effect without setting a display buffer.

[0070] It should be noted that the duration for which the display panel displays each frame of the interface image can be different from the corresponding target time interval. The duration for which the interface image is displayed is mainly related to the completion time of the synthesis of the interface data of two adjacent frames.

[0071] In the embodiments of the present application, the display management module obtains the operating information of the electronic device, and determines the target time interval between two adjacent Vsync signals according to the operating information. The display management module can generate a first rendering signal and a first composition signal based on the target time interval, so as to trigger the application to start rendering the next frame of image content and trigger the display management module to perform a composition operation on the rendered next frame of image content to obtain interface data, and transmit the interface data to the display panel to display the interface image corresponding to the interface data through the display panel. In the embodiments of the present application, the display management module of the electronic device can determine the target time interval between adjacent Vsync signals by itself according to the operating information of the electronic device, and generate a rendering signal and a composition signal. The display management module does not need to calibrate the rendering signal and the composition signal based on the TE signal generated by the display panel, so that the frame rate of the display management module and the refresh rate of the display panel are no longer limited by the generation frequency of the TE signal, realizing a more flexible display mechanism, improving the display flexibility of the display panel of the electronic device to display the interface image, and making the refresh rate of the display panel match the operating information of the electronic device, improving the display accuracy.

[0072] Figure 4 The flowchart of a signal generation process provided by the embodiments of the present application is shown. As Figure 4 shown, the steps of generating a first rendering signal and a first composition signal by the display management module according to the target time interval may include steps 402 to 404.

[0073] Step 402, generating a first rendering signal by the display management module according to the target time interval.

[0074] It should be noted that generating the first rendering signal by the display management module according to the target time interval makes the time difference between the generation time of the first rendering signal and the generation time of the second rendering signal be the target time interval. For example, the time difference obtained by subtracting the generation time of the second rendering signal from the generation time of the first rendering signal is consistent with the target time interval.

[0075] In some embodiments, when the display management module generates a second rendering signal, the timer is triggered to start timing. When the display management module detects that the timing duration of the timer reaches the target time interval, the first rendering signal is generated. In this embodiment, the display management module is triggered to generate the first rendering signal by the timer, thereby improving the accuracy of the generation time of the first rendering signal.

[0076] In some embodiments, the display management module determines the generation time of the first rendering signal according to the target time interval and the generation time of the second rendering signal. If the current time is the generation time of the first rendering signal, the first rendering signal is generated. It should be noted that the display management module can judge whether the current time reaches the generation time of the first rendering signal according to the time information, and generate the first rendering signal when the current time reaches the generation time of the first rendering signal. Exemplarily, the time information may include a system timestamp, which can be obtained by accessing the system clock.

[0077] In some embodiments, the display management module obtains the current operation information of the electronic device. If the actual deviation between the current operation information and the historical operation information is greater than or equal to the deviation threshold, the target time interval between two adjacent Vsync signals is determined according to the operation information. If the actual deviation between the operation information and the historical operation information is less than the deviation threshold, the current target time interval is maintained.

[0078] Wherein, the current operation information may refer to the operation information obtained by the display management module in the current cycle, and the historical operation information may refer to the operation information obtained by the display management module before the current cycle. The historical operation information reflects the historical operation state of the electronic device. The deviation threshold can be used to measure whether the gap between the current operation information and the historical operation information is large. If the actual deviation is greater than or equal to the deviation threshold, it is determined that the current operation state of the electronic device has changed greatly compared with the historical operation state. If the actual deviation is less than the deviation threshold, it is determined that the change in the current operation state of the electronic device compared with the historical operation state is small or even unchanged. It can be understood that the deviation threshold can be set according to actual needs, and this embodiment does not limit it.

[0079] In this embodiment, the acquisition cycle for the display management module to obtain the operation information of the electronic device may be greater than the target time interval, that is, the frequency at which the display management module obtains the operation information is lower than the frequency at which the display management module generates the rendering signal. When the display management module obtains the operation information, it first compares the current operation information with the historical operation information. If the deviation between the current operation information and the historical operation information is greater than or equal to the deviation threshold, that is, the operation state of the electronic device has changed greatly, the target time interval is re-determined according to the current operation information to ensure that the target time interval matches the operation state of the electronic device. If the deviation between the current operation information and the historical operation information is less than the deviation threshold, that is, the change in the operation state of the electronic device is very small or even unchanged, the current target time interval can be maintained to reduce the number of times of determining the target time interval.

[0080] Step 404: When the duration from the generation moment of the first rendering signal to the current moment reaches the target duration through the display management module, generate a first composite signal.

[0081] It should be noted that when the duration of generating the first rendering signal reaches the target duration through the display management module, a first composite signal is generated. By reasonably setting the target duration, it is possible to avoid triggering the display management module to start the composite operation when the next frame of the image is not completely rendered, thereby avoiding incomplete or overly delayed composite interface data, which affects the display effect.

[0082] Exemplarily, the target duration is greater than or equal to the time required to render the content of the next frame of the image, thereby avoiding incomplete composite interface data.

[0083] Exemplarily, the target duration can be a preset rendering duration set in advance. It should be noted that the preset rendering duration required for the application to start rendering the content of the next frame of the image until the rendered next image content is obtained can be determined in advance and stored in the electronic device.

[0084] In some embodiments, the display management module can record the generation moment of the first rendering signal, and determine the generation moment of the first composite signal according to the generation moment of the first rendering signal and the target duration. If the current moment reaches the generation moment of the first composite signal, then generate the first composite signal. It should be noted that the display management module can judge whether the current moment reaches the generation moment of the first composite signal based on the time information, and generate the first composite signal when the generation moment of the first composite signal is reached.

[0085] In some embodiments, the display management module generates composite information and a composite instruction in response to the first composite signal. Among them, the composite information includes the storage address corresponding to the buffer area for storing the content of the next frame of the image. The hardware synthesizer obtains the content of the next frame of the image from the buffer area corresponding to the storage address in response to the composite instruction, and composites the content of the next frame of the image to obtain the interface data. It should be noted that the composite instruction is used to instruct the hardware synthesizer to read the content of the next frame of the image in the buffer area.

[0086] In some embodiments, before the hardware synthesizer obtains the content of the next frame of the image from the buffer corresponding to the storage address, it detects whether the content of the next frame of the image in the buffer corresponding to the storage address is rendered. When the content of the next frame of the image in the buffer corresponding to the storage address is rendered, the hardware synthesizer obtains the content of the next frame of the image from the buffer corresponding to the storage address and synthesizes the content of the next frame of the image to obtain the interface data. It should be noted that by detecting whether the content of the next frame of the image is rendered by the hardware synthesizer before synthesis, it is possible to avoid synthesis errors, image tearing or display anomalies caused by the content of the next frame of the image not being ready yet, and improve the accuracy and stability of the display of the electronic device.

[0087] In the related art, calibrating the Vsync-APP signal and the Vsync-SF signal according to the TE signal is equivalent to predicting the generation time of the next frame of the TE signal based on the generation time of the TE signal and the refresh rate of the display panel, calculating the generation time of the Vsync-SF signal based on a preset time difference, then calculating the generation time of the Vsync-APP signal, and generating the Vsync-APP signal at the corresponding generation time to guide the application program to start rendering the content of the next frame of the image at an appropriate time.

[0088] Compared with the method of calibrating the Vsync-APP signal and the Vsync-SF signal based on the TE signal, in this embodiment, the display management module generates the first rendering signal based on the determined target time interval, and generates the first synthesis signal when the duration from the current moment to the generation time of the first rendering signal reaches the target duration, so that the display management module does not need to calibrate the start time of the rendering process and the start time of the synthesis process according to the TE signal. The display management module actively controls the generation timing of the rendering signal and the synthesis signal, improving the display flexibility of the display interface image of the display panel of the electronic device.

[0089] It should be noted that the rendering duration required for rendering the image content may be different depending on the operating state of the electronic device. In some embodiments, at least two historical time intervals are obtained, and the current target duration is adjusted according to the change trend corresponding to the at least two historical time intervals. The historical time interval is the target time interval between two adjacent historical Vsync signals. The historical time interval may refer to the target time interval determined by the display management module before the current cycle, or the time interval between two adjacent historical Vsync signals.

[0090] It should be noted that the target time interval is obtained based on the operating information of the electronic device. Therefore, the change trends corresponding to at least two historical time intervals of the electronic device reflect the changes in the operating state of the electronic device. If the change trend corresponding to at least two historical time intervals is an increasing trend, it indicates that the electronic device is operating at a lower frame rate. If the change trend corresponding to at least two historical time intervals is a decreasing trend, it indicates that the electronic device should operate at a higher frame rate. If the change trend is a stable trend, the current frame rate is maintained.

[0091] Exemplarily, the at least two historical time intervals may be at least two historical time intervals before the current cycle and with the determined time closest to the current cycle. The number range of the historical time intervals may include 3 to 6. Within this number range, it is possible to avoid an excessive processing volume of the display management module and ensure the accuracy of the determined change trend. Optionally, the number of the obtained historical time intervals may be 3, 4, 5, or 6.

[0092] In some embodiments, if the change trend is an increasing trend, the current target duration is extended, and the extended target duration is used as the new target duration. If the change trend is a decreasing trend, the current target duration is shortened, and the shortened target duration is used as the new target duration. If the change trend is a stable trend, the current target duration is maintained. It should be noted that if the change trend is an increasing trend, it means that the target time interval between two adjacent Vsync signals is gradually increasing. At this time, the electronic device may not be able to achieve a high rendering frequency. Therefore, by extending the target duration, it is possible to avoid triggering the display management module to perform a composition operation before the rendering is completed, ensuring the effectiveness of the composition. If the change trend is a decreasing trend, the electronic device supports high frame rate display. At this time, the target duration can be shortened to increase the refresh rate of the display panel and improve the matching degree between the refresh rate and the frame rate of the display panel. If the change trend is a stable trend, the current target duration can be maintained, reducing the update frequency of the target duration and the processing volume of the display management module.

[0093] Exemplarily, if the change trend is an increasing trend, the current target duration is extended by a preset unit duration to obtain the new target duration. If the change trend is a decreasing trend, the current target duration is shortened by a preset unit duration to obtain the new target duration. In this embodiment, the current target duration is extended or shortened by a preset unit duration according to the change trend to obtain a target duration that is more adapted to the operating state of the electronic device.

[0094] In some other embodiments, the display management module determines an adjustment time according to the change trend of the multi-frame historical time interval, and adjusts the current target duration according to the adjustment time to obtain a new target duration. In this embodiment, the display management module can determine the corresponding adjustment time according to the change trend, and adjust the current target duration according to the adjustment time, so as to improve the accuracy of the obtained target duration.

[0095] Exemplarily, if the change trend is an increasing trend and the increasing amplitude is greater than or equal to the first increasing threshold, the current target duration is extended by a first target duration; if the change trend is an increasing trend and the increasing amplitude is less than the first increasing threshold, the current target duration is extended by a second target duration. Herein, the first target duration is greater than the second target duration.

[0096] Exemplarily, if the change trend is a decreasing trend and the decreasing amplitude is greater than or equal to the first decreasing threshold, the current target duration is shortened by a third target duration; if the change trend is a decreasing trend and the decreasing amplitude is less than the first decreasing threshold, the current target duration is shortened by a fourth target duration. Herein, the third target duration is greater than the fourth target duration.

[0097] It should be noted that the greater the change amplitude is, the greater the change of the current operating state relative to the historical operating state is, and the adjustment amplitude of the target duration needs to be increased, so that the new target duration has a higher matching degree with the current operating state of the electronic device.

[0098] In this embodiment, by obtaining the target time intervals of at least two historical Vsync signals and adjusting the current target duration according to their change trend, the change trend of the target duration is made consistent with the change trend of the target time interval, thereby improving the adaptability of the synthesized signal generated based on the adjusted target duration to the operating state of the electronic device, that is, improving the rationality of the timing for triggering the display management module to perform the synthesis operation, and thus improving the display fluency and stability.

[0099] In some embodiments, the interface data is written into the display buffer corresponding to the display panel. The display management module generates a first read signal and sends the first read signal to the display panel. In response to the first read signal, the display panel reads the interface data from the display buffer. It can be understood that the display buffer corresponding to the display panel may refer to the memory area in the display panel for temporarily storing the interface data, such as Framebuffer (frame buffer).

[0100] Exemplarily, when the display management module stores complete interface data in the display buffer, it generates a first read signal and sends the first read signal to the display panel. In response to the first read signal, the display panel reads the interface data from the display buffer and displays the interface image corresponding to the interface data according to the interface data. It should be noted that the complete interface data may refer to the interface data corresponding to one frame of the interface image.

[0101] In some embodiments, the interface data is written into the display buffer of the display panel through a hardware synthesizer. When the hardware synthesizer writes the complete interface data into the display buffer of the display panel, it feeds back a write success signal to the display management module. In response to the write success signal, the display management module generates a first read signal. It should be noted that the display management module generates a first read signal when receiving the write success signal, which can ensure that the display panel reads the interface data from the display buffer after the hardware synthesizer writes successfully, avoiding the phenomenon of screen tearing and ensuring the display effect of the electronic device. Exemplarily, the hardware synthesizer controls the display controller to write the interface data into the display buffer of the display panel.

[0102] In some other embodiments, the display management module generates a first read signal when the duration from the current moment to the generation moment of the first synthesis signal reaches the synthesis duration. It should be noted that the synthesis duration refers to the time required for the display management module to start synthesizing and rendering the content of the next frame of the image until the display buffer stores complete interface data. In this embodiment, the display management module detects whether the duration from the current moment to the generation moment of the first synthesis signal reaches the synthesis duration, and generates a first read signal when the duration reaches the synthesis duration, which can shorten the duration from the write success to the display panel reading the interface data and improve the display effect.

[0103] It can be understood that the step of determining that the duration from the current moment to the generation moment of the first synthesis signal reaches the synthesis duration can refer to the relevant description of determining that the duration from the current moment to the generation moment of the first synthesis signal reaches the synthesis duration, and will not be elaborated here.

[0104] In this embodiment, when the display management module stores complete interface data in the display buffer, the display management module generates a first read signal to trigger the display panel to read the interface data from the display buffer and display the interface image corresponding to the interface data, which can ensure that the display panel can read a complete frame of interface data and avoid the phenomena of screen tearing and abnormal display caused by the incomplete writing of the interface data.

[0105] Figure 5The figure shows a schematic flowchart of a display process provided by an embodiment of the present application. As Figure 5 shown, the display method may further include steps 502 to 506.

[0106] Step 502, in response to a first synthesis signal through a display management module, controlling a hardware synthesizer to synthesize the next frame of rendered image content.

[0107] It should be noted that the next frame of image content may be pre-rendered by an application and written into the corresponding buffer area of the application. The display management module sends synthesis information and synthesis instructions to the hardware synthesizer according to the first synthesis signal, and the hardware synthesizer synthesizes the next frame of rendered image content, such as performing operations such as overlaying and transparency processing, to generate interface data.

[0108] In this embodiment, synthesizing the next frame of rendered image content through the hardware synthesizer can improve the synthesis efficiency and reduce power consumption.

[0109] Step 504, in the case where the hardware synthesizer synthesizes one row of pixel data each time, encapsulating the obtained one row of pixel data into a data packet through the hardware synthesizer and transmitting the data packet to the display panel.

[0110] Exemplarily, when the hardware synthesizer determines that the rendering of the next frame of image content is completed, it can perform synthesis in the order from top to bottom and from left to right to obtain the pixel data corresponding to each row in turn. It should be noted that the hardware synthesis device processes in row order and processes in column order within each row to obtain the pixel data of each row.

[0111] Exemplarily, the data packet may be obtained by encapsulating one row of pixel data in Video (video) mode based on the MIPI (Mobile Industry Processor Interface) protocol. It should be noted that the Video mode is a data transmission mode dedicated to real-time transmission of video data streams to the display panel. Optionally, the MIPI protocol may include the MIPI DSI (Display Serial Interface) protocol. It should be noted that the MIPI DSI protocol is used for high-speed serial data transmission between the processor and the display panel and supports the Video mode and the Command (instruction) mode.

[0112] Exemplarily, the display controller of the electronic device is located in the hardware layer. The display controller can encapsulate the pixel data of each row into a data packet and transmit the data packet to the display panel through the MIPI interface.

[0113] Step 506: According to the data packet, the display panel displays the pixels corresponding to the obtained row of pixel data.

[0114] It should be noted that the interface data includes multiple rows of pixel data, the display screen includes multiple rows of pixel points, the multiple rows of pixel data correspond to the multiple rows of pixel points one by one, and the pixel data can be used to indicate the pixels to be displayed by the corresponding pixel points. Exemplarily, the DDIC parses the data packet to obtain a row of pixel data in the data packet, and drives the display screen to display the corresponding pixels for a row of pixel points corresponding to the row of pixel data.

[0115] Exemplarily, the display panel determines the target voltage of the target pixel point according to the pixel data corresponding to the target pixel point, and provides the corresponding target voltage for the target pixels of a row, so that a row of pixel points on the display panel displays the corresponding pixels. Optionally, the display screen can be an LCD.

[0116] In this embodiment, each time the hardware synthesizer synthesizes a row of pixel data, the obtained row of pixel data is encapsulated into a data packet and transmitted to the display panel. The display panel displays the pixels corresponding to the row of pixel data encapsulated in the data packet according to the data packet, realizing row-by-row encapsulation, transmission and display, which can achieve real-time transmission and display, and is helpful to improve the response speed and display efficiency of dynamic pictures.

[0117] In some embodiments, the actual refresh rate corresponding to the target time interval is any refresh rate within the refresh rate range supported by the display panel. It should be noted that the refresh rate range supported by the display panel refers to the range enclosed by the lowest refresh rate and the highest refresh rate that the display panel can support. The refresh rate can refer to the number of times the display panel can refresh the screen per second. Exemplarily, if the lowest refresh rate supported by the display panel is 60Hz and the highest refresh rate supported is 150Hz, then the refresh rate range supported by the display panel is from 60Hz to 150Hz.

[0118] In some embodiments, the actual refresh rate of the display panel switches from the first refresh rate to the second refresh rate, where the difference between the first refresh rate and the second refresh rate is less than the preset refresh rate. Optionally, the value range of the preset refresh rate is from 1Hz to 25Hz. Optionally, the preset refresh rate can be 1Hz, 2Hz, 3Hz, 5Hz, 10Hz, 15Hz, 20Hz or 23Hz, etc. In the related art, the fixed refresh rates of the display panel include 60Hz, 90Hz, 120Hz and 144Hz. It can be seen that the gap between adjacent fixed refresh rates is relatively large. In this embodiment, the refresh rate of the display panel can be switched between refresh rates with a relatively small distance, improving the display flexibility of the display panel of the electronic device to display the interface image.

[0119] In this embodiment, the display management module can actively determine the target time interval between two adjacent Vsync signals according to the operating information of the electronic device, and generate a first rendering signal and a first composition signal according to the target time interval. Compared with the method that relies on TE signal calibration, the actual refresh rate of the display panel in this embodiment can be any refresh rate within the refresh rate range supported by the display panel, that is, the display panel can achieve stepless display, which greatly improves the display flexibility of the display interface image of the display panel of the electronic device.

[0120] Figure 6 FIG. shows a schematic diagram of an image transmission and display process provided by an embodiment of the present application. In this embodiment, taking the Android system as an example, the transmission and display architecture performs data transmission based on the Video mode of the MIPI DSI protocol. As Figure 6 shown, the display panel no longer generates a TE signal, that is, it no longer provides a TE signal for SurfaceFlinger to perform calibration. SurfaceFlinger freely generates a Vsync-APP signal and a Vsync-Sf signal according to the operating information of the electronic device, and when the pixel data is synthesized by HWC, the pixel data can be sent to the display panel in real time, and the display panel performs display, and the display time is no longer restricted by hardware or a DPU (Data Processing Unit).

[0121] Exemplarily, the display screen includes an LCD. It should be noted that the LCD includes a plurality of pixel points, and each pixel point may include a horizontal polarizing film, a liquid crystal layer, a color filter, and a vertical polarizing film. When light passes through the horizontal polarizing film, polarized light is formed. The liquid crystal layer rotates the polarization direction by 90 degrees through its optical rotation property, so that the light can pass through the vertical polarizing film, and one of the three primary colors RGB (Red Green Blue) is displayed after passing through the color filter. When a voltage is applied to the liquid crystal, its optical rotation property weakens or disappears, thereby preventing the polarized light from passing through the vertical polarizing film and realizing the turning off of the pixel. By applying different voltages to different pixel points, their light transmittance and color can be adjusted respectively, so that different pixels can be displayed, and image display can be realized.

[0122] Since the liquid crystal material has the ability to maintain its state after applying a voltage, even if the external voltage is removed, its optical rotation state will not change immediately in a short time. Therefore, even if the display process is interrupted, the pixels of the pixel points can still be maintained briefly. This characteristic enables the LCD to have good frame stability and can support the "transmit while display" mechanism in the Video mode. After the display panel receives the pixel data, it can immediately drive the corresponding pixel points for display, and normal display of the electronic device can also be achieved without relying on the TE signal, ensuring the display effect.

[0123] In some embodiments, the display management module obtains user preference information, determines the time interval range corresponding to two adjacent Vsync signals according to the user preference information through the display management module, and determines the target time interval of two adjacent Vsync signals from the time interval range according to the running information through the display management module.

[0124] It should be noted that the user preference information may include at least one of a refresh rate range and a performance mode. According to the user preference information, the frame rate preferred by the user can be determined. Based on the user preference, the refresh rate range supported by the display panel is narrowed down to obtain the corresponding time interval range. The display management module determines the target time interval from the time interval range based on the obtained running information, so that the frame rate can better adapt to the running state of the electronic device while meeting the user preference.

[0125] Exemplarily, the electronic device can determine the selected refresh rate range in response to the user's refresh rate selection operation, and determine the time interval range according to the selected refresh rate range. It should be noted that the electronic device can divide the refresh rate range supported by the display panel into multiple refresh rate ranges, and the user can select one of them. If the selected refresh rate range is large, the determined time interval range is small, so that the frame rate is large to increase the refresh rate of the display panel. If the selected refresh rate range is small, the determined time interval range is large to reduce the refresh rate of the display panel, thereby meeting the user preference.

[0126] Exemplarily, the refresh rate range may include a low refresh rate, a medium refresh rate, and a high refresh rate. Among them, the range of the low refresh rate is 60Hz to 90Hz, the range of the medium refresh rate is 90Hz to 120Hz, and the range of the high refresh rate may be 120Hz to 144Hz. If the user selects the low refresh rate, the time interval range may be 11.1ms (milliseconds) to 16.7ms. If the user selects the medium refresh rate, the time interval range may be 8.3ms to 11.1ms. If the user selects the high refresh rate, the time interval range may be 6.9ms to 8.3ms.

[0127] Exemplarily, the performance mode may include an energy-saving mode and a high-performance mode. If the user selects the energy-saving mode, the determined time interval range is large, such as 9ms to 16.7ms. If the user selects the high-performance mode, the determined time interval range is set small, such as 6ms to 9ms, to support high-frame-rate display. It can be understood that the time interval ranges of different performance modes can partially overlap or not overlap, and can be set according to actual needs. This embodiment does not make any limitations in this regard.

[0128] Exemplarily, if the display management module determines that the running information meets the high frame rate condition, it selects the minimum value within the time interval range as the target time interval. Among them, the high frame rate condition includes that the application type corresponding to the running application is a game type, a video type, etc.

[0129] For example, when the user selects the high performance mode and the application type corresponding to the currently running application is a game type, the display management module selects the minimum value of the time interval range within the time interval range as the target time interval. For example, the time interval range corresponding to the high performance mode is from 6 ms to 9 ms, and the display management module can select 6 ms as the target time interval to maximize the frame rate.

[0130] Exemplarily, if the display management module determines that the running information meets the low frame rate condition, it selects the minimum value within the time interval range as the target time interval. Optionally, the low frame rate condition may include that the temperature of the electronic device is higher than or equal to the temperature threshold, the remaining battery power is lower than the battery power threshold, and the load of the image processing unit is greater than or equal to the load threshold.

[0131] For example, when the user selects the high performance mode and the temperature of the electronic device is higher than the temperature threshold, the display management module selects the maximum value of the time interval range within the time interval range as the target time interval to prevent the electronic device from overheating. For example, the time interval range corresponding to the high performance mode is from 6 ms to 9 ms, and the display management module can select 9 ms as the target time interval to minimize the frame rate.

[0132] In this embodiment, the display management module can jointly determine the target time interval based on the user's subjective preference and the running state of the electronic device, so as to make the rendering frequency and the synthesis frequency match the running state of the electronic device while meeting the user's personalized needs, which can improve the running reliability of the electronic device, enhance the user experience, and optimize the resource utilization efficiency of the electronic device.

[0133] Please refer to Figure 7 , Figure 7 which is a schematic structural diagram of a display device disclosed in an embodiment of the present application. The device can be applied to electronic devices such as laptops, smartphones, tablets, wearable devices, vehicle-mounted devices, etc., and is not specifically limited. Among them, the electronic device includes a display panel, such as Figure 7As shown, the display device 700 may include an interval determination module 710, a signal generation module 720, and an image display module 730. Among them, the interval determination module 710 is configured to obtain the operation information of the electronic device through the display management module, and determine the target time interval between two adjacent vertical synchronization Vsync signals according to the operation information. Among them, the Vsync signal includes a rendering signal and a composition signal. The signal generation module 720 is configured to generate a first rendering signal and a first composition signal through the display management module according to the target time interval. Among them, the first rendering signal is used to trigger the application to start rendering the next frame of image content, and the first composition signal is used to trigger the display management module to perform a composition operation on the next frame of image content obtained by rendering to obtain interface data. The image display module 730 is configured to transmit the interface data to the display panel so that the display panel displays the interface image corresponding to the interface data.

[0134] In some embodiments, the signal generation module 720 includes a first generation unit and a second generation unit. The first generation unit is configured to generate a first rendering signal through the display management module according to the target time interval. The second generation unit is configured to generate a first composition signal through the display management module when the duration from the current moment to the generation moment of the first rendering signal reaches the target duration.

[0135] In some embodiments, the display device 700 may further include an interval acquisition module and a duration adjustment module. Among them, the interval acquisition module is configured to acquire at least two historical time intervals, and the historical time interval is the target time interval between two adjacent historical Vsync signals. The duration adjustment module is configured to adjust the current target duration according to the change trend corresponding to at least two historical time intervals.

[0136] In some embodiments, the actual refresh rate corresponding to the target time interval is any refresh rate within the refresh rate range supported by the display panel.

[0137] In some embodiments, the interface data includes multiple lines of pixel data. The display device 700 may further include an image composition module. The image composition module is configured to, after the display management module generates the first composition signal, in response to the first composition signal through the display management module, control the hardware compositor to perform composition on the next frame of image content obtained by rendering, and each time the hardware compositor composes a line of pixel data, encapsulate the obtained line of pixel data into a data packet through the hardware compositor, and transmit the data packet to the display panel. The image display module 730 is further configured to display the pixels corresponding to the obtained line of pixel data through the display panel according to the data packet.

[0138] In some embodiments, the display device 700 may further include a reading generation module and a data reading module. The image display module 730 is further configured to write the interface data into the corresponding display buffer of the display panel. Among them, the reading generation module is configured to generate a first reading signal through the display management module and send the first reading signal to the display panel. The data reading module is configured to read the interface data from the display buffer through the display panel in response to the first reading signal.

[0139] In some embodiments, the display device 700 may further include a preference acquisition module and a range determination module. Among them, the preference acquisition module is configured to acquire user preference information through the display management module. The range determination module is configured to determine the time interval range corresponding to two adjacent Vsync signals according to the user preference information through the display management module. The interval determination module 710 is further configured to determine the target time interval of two adjacent Vsync signals from the time interval range according to the running information through the display management module.

[0140] In some embodiments, the running information includes at least one of the application type corresponding to the running application, the remaining battery power, the temperature of the electronic device, and the load of the graphics processing unit.

[0141] Please refer to Figure 8 , Figure 8 which is a schematic structural diagram of an electronic device disclosed in an embodiment of the present application.

[0142] As Figure 8 shown, the electronic device 800 may include:

[0143] a memory 810 storing executable program code;

[0144] a processor 820 coupled to the memory 810;

[0145] Among them, the processor 820 calls the executable program code stored in the memory 810 and executes any one of the display methods disclosed in the embodiments of the present application.

[0146] An embodiment of the present application discloses a computer program product, including a computer program, which, when executed by a processor in an electronic device, enables the electronic device to implement any one of the display methods disclosed in the embodiments of the present application.

[0147] An embodiment of the present application discloses a computer-readable storage medium, which stores a computer program, wherein when the computer program is executed by the processor, the processor is enabled to implement any one of the display methods disclosed in the embodiments of the present application.

[0148] It should be understood that the "one embodiment" or "an embodiment" mentioned throughout the specification means that the specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, the appearances of "in one embodiment" or "in an embodiment" throughout the specification do not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. Those skilled in the art should also be aware that the embodiments described in the specification are all optional embodiments, and the actions and modules involved are not necessarily essential to the present application.

[0149] In various embodiments of the present application, it should be understood that the magnitudes of the serial numbers of the above processes do not necessarily mean the inevitable sequence of execution order. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation to the implementation process of the embodiments of the present application.

[0150] The units described as separate components above may or may not be physically separated. The components shown as units may or may not be physical units, that is, they can be located in one place, or can be distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0151] In addition, in each embodiment of the present application, each functional unit can be integrated in a processing unit, or each unit can exist physically alone, or two or more units can be integrated in one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.

[0152] If the above integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-accessible memory. Based on such an understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a memory and includes several instructions for causing a computer device (which can be a personal computer, a server or a network device, etc., specifically, the processor in the computer device) to execute some or all of the steps of the above methods in each embodiment of the present application.

[0153] Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing relevant hardware through a program, and this program can be stored in a computer-readable storage medium. The storage medium includes read-only memory (ROM), random access memory (RAM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), one-time programmable read-only memory (OTPROM), electrically-erasable programmable read-only memory (EEPROM), compact disc read-only memory (CD-ROM) or other optical disc memories, magnetic disk memories, tape memories, or any other computer-readable medium capable of carrying or storing data.

[0154] The above has introduced in detail a display method, device, electronic device, and computer program product disclosed in the embodiments of the present application. Specific examples are used herein to elaborate on the principle and implementation manner of the present application. The description of the above embodiments is only used to help understand the method and its core idea of the present application. At the same time, for those of ordinary skill in the art, according to the idea of the present application, there will be changes in the specific implementation manner and application scope. In summary, the content of this specification should not be construed as a limitation to the present application.

Claims

1. A display method, characterized in that, Applied to an electronic device, the electronic device includes a display panel, and the method includes: Obtain the operation information of the electronic device through a display management module, and determine the target time interval between two adjacent vertical synchronization (Vsync) signals according to the operation information, where the Vsync signal includes a rendering signal and a composition signal; Generate a first rendering signal and a first composition signal according to the target time interval through the display management module, where the first rendering signal is used to trigger an application to start rendering the next frame of image content, and the first composition signal is used to trigger the display management module to perform a composition operation on the next frame of image content obtained by rendering to obtain interface data; Transmit the interface data to the display panel so that the display panel displays the interface image corresponding to the interface data.

2. The method according to claim 1, wherein The step of generating a first rendering signal and a first composition signal according to the target time interval through the display management module includes: Generate a first rendering signal according to the target time interval through the display management module; Generate the first composition signal through the display management module when the duration from the current moment to the generation moment of the first rendering signal reaches the target duration.

3. The method according to claim 2, wherein The method further includes: Obtain at least two historical time intervals, where the historical time interval is the target time interval between two adjacent historical Vsync signals; Adjust the current target duration according to the change trend corresponding to the at least two historical time intervals.

4. The method according to claim 1, wherein The actual refresh rate corresponding to the target time interval is any refresh rate within the refresh rate range supported by the display panel.

5. The method according to claim 1, characterized in that, The interface data includes multiple lines of pixel data; After the display management module generates the first composition signal, the method further includes: Control a hardware compositor to perform composition on the next frame of image content obtained by rendering in response to the first composition signal through the display management module; When the hardware compositor synthesizes one line of pixel data each time, encapsulate the obtained one line of pixel data into a data packet through the hardware compositor and transmit the data packet to the display panel; Display the pixels corresponding to the obtained one line of pixel data through the display panel according to the data packet.

6. The method according to claim 1, wherein The step of transmitting the interface data to the display panel includes: Write the interface data into the display buffer corresponding to the display panel; Generate a first read signal through the display management module and send the first read signal to the display panel; The display panel reads the interface data from the display buffer in response to the first read signal.

7. The method according to claim 1, characterized in that The method further includes: Obtain user preference information through the display management module; Determine the time interval range corresponding to two adjacent Vsync signals according to the user preference information through the display management module; The step of determining the target time interval between two adjacent Vsync signals according to the operation information includes: Determine the target time interval between two adjacent Vsync signals from the time interval range according to the operation information through the display management module.

8. The method according to claim 1, characterized in that The operation information includes at least one of an application type corresponding to a running application, remaining battery power, a temperature of the electronic device, and a load of a graphics processing unit.

9. A display device, characterized in that, Applied to an electronic device, the electronic device includes a display panel, and the apparatus includes: An interval determination module, configured to obtain operation information of the electronic device through a display management module, and determine a target time interval between two adjacent vertical synchronization Vsync signals according to the operation information, where the Vsync signal includes a rendering signal and a composition signal; A signal generation module, configured to generate a first rendering signal and a first composition signal through the display management module according to the target time interval, where the first rendering signal is used to trigger an application to start rendering the next frame of image content, and the first composition signal is used to trigger the display management module to perform a composition operation on the next frame of image content obtained by rendering to obtain interface data; An image display module, configured to transmit the interface data to the display panel so that the display panel displays an interface image corresponding to the interface data.

10. An electronic device, characterized in that, Comprising a memory and a processor, a computer program is stored in the memory, and when the computer program is executed by the processor, the processor implements the method according to any one of claims 1 to 8.

11. A computer program product, characterized in that, Comprising a computer program, which implements the method according to any one of claims 1 to 8 when executed by a processor.

Images