Image display method, electronic equipment and computer storage medium

Abstract

The invention relates to the technical field of display, and provides an image display method, electronic equipment and a computer storage medium, and the method comprises the steps that a display driver of the electronic equipment obtains a display frame rate of an application program and a minimum refresh rate of a display screen; when the display frame rate is greater than the minimum refresh rate, the display driver configures a first refresh rate queue for the display driver chip; the first refresh rate queue comprises at least two refresh rates which are arranged from high to low, and each refresh rate is greater than or equal to a display frame rate and less than or equal to the lowest refresh rate; the display driver controls the display driving chip to refresh pictures to the display screen according to the first refresh rate in the first refresh rate queue; and under the condition that the SF does not send the picture, the display driver controls the display driver chip to refresh the picture to the display screen according to the next refresh rate in the first refresh rate queue according to the arrangement sequence of the refresh rates in the first refresh rate queue. Therefore, under the condition that the upper-layer SF does not send the picture, the DDIC can be prevented from repeatedly refreshing the picture, so that unnecessary power consumption is reduced.

Description

Technical Field

[0001] The embodiments of the present application relate to the technical field of electronic devices, and in particular, to an image display method, an electronic device, and a computer storage medium. Background Art

[0002] With the continuous development of display technology for electronic devices (such as mobile phones), more and more display screens that can support multiple refresh rates have emerged. For example, a display screen that uses low temperature polycrystalline oxide (LTPO) screen technology can support multiple refresh rates such as 120Hz, 90Hz, 60Hz, 40Hz, 30Hz, 10Hz and 1Hz. The higher the refresh rate of the display screen, the higher the display frame rate it can support, and the corresponding picture display is smoother. The lower the refresh rate of the display screen, although the lower the display frame rate that can be supported, it can save more power consumption. Therefore, in order to ensure smooth pictures while saving a certain amount of power consumption as much as possible, adaptive refresh rate technology has emerged.

[0003] However, the principle of traditional adaptive refresh rate technology is mainly to send a refresh rate switching instruction to the digital display indicator control (DDIC) to switch to an adaptive refresh rate based on the running scenario of the application (APP). Therefore, the adaptive refresh rate technology cannot be adapted to the situation where the running scenario cannot be distinguished, and further, the refresh rate of the DDIC cannot be reduced when the running scenario cannot be distinguished, resulting in unnecessary increase in power consumption. Summary of the invention

[0004] The embodiments of the present application provide an image display method, an electronic device, and a computer storage medium, which are used to solve the problem of unnecessary power consumption increase caused by not being able to reduce the refresh rate of the DDIC when the operating scenarios cannot be distinguished.

[0005] To achieve the above objectives, the embodiments of the present application adopt the following technical solutions:

[0006] In a first aspect, a method for displaying an image is provided, which is applied to an electronic device including a display screen and having multiple applications installed thereon, and comprises: a display driver of the electronic device obtains a display frame rate of an application running in the foreground and a minimum refresh rate of the display screen; when the display frame rate is greater than the minimum refresh rate, the display driver configures a first refresh rate queue for a display driver chip of the electronic device; wherein the first refresh rate queue comprises at least two refresh rates and is arranged from high to low, and each refresh rate is greater than or equal to the display frame rate and less than or equal to the minimum refresh rate; the display driver controls the display driver chip to refresh an image to the display screen at the first refresh rate in the first refresh rate queue; when the SF of the electronic device does not send an image to the display driver, the display driver controls the display driver chip to refresh an image to the display screen at the next refresh rate in the first refresh rate queue in the order of arrangement of the refresh rates in the first refresh rate queue.

[0007] It can be seen that, in the first aspect, after the display driver configures the first type of refresh rate queue with a refresh rate distribution from high to low for the DDIC, it can control the DDIC to switch from a high refresh rate to a low refresh rate when the upper SF does not send pictures, so that the DDIC can adaptively reduce the refresh rate based on the picture sending frequency of the upper layer. In this way, when the upper SF does not send pictures, the DDIC can avoid repeated picture refreshes, thereby reducing unnecessary power consumption.

[0008] In a possible implementation manner of the first aspect, it also includes: when the display frame rate is equal to the minimum refresh rate, the display driver configures a second refresh rate queue for the display driver chip of the electronic device; wherein the last refresh rate of the second refresh rate queue is equal to the display frame rate, and the refresh rates before the last refresh rate are all empty; the display driver controls the display driver chip to refresh the image to the display screen according to the last refresh rate in the second refresh rate queue.

[0009] In another possible implementation of the first aspect, the display frame rate of the application running in the foreground and the minimum refresh rate of the display screen are obtained, including: a refresh rate decision module of the application framework layer in the electronic device obtains the display frame rate of the application running in the foreground, and determines the minimum refresh rate based on the display brightness and ambient light brightness of the display screen; the refresh rate decision module sends the display frame rate to the display driver through SF and HWC, and sends the minimum refresh rate to the display driver through the hardware abstraction layer interface.

[0010] Due to human vision problems, the flickering phenomenon of the display screen will be more sensitive to users when the display screen brightness is low or the ambient light brightness is low, and the flickering phenomenon will be more obvious. Therefore, the refresh rate decision module determines the minimum refresh rate based on the display screen brightness and the ambient light brightness, which can avoid serious flickering when the display screen brightness is low or the ambient light brightness is low. At the same time, a new hardware abstraction layer interface is added to send the minimum refresh rate to ensure that the display driver can get the display frame rate and the minimum refresh rate at the same time.

[0011] In another possible implementation of the first aspect, the minimum refresh rate is determined according to the display brightness and ambient light brightness of the display, including: when the display brightness is greater than or equal to 50 nits and the ambient light brightness is greater than or equal to 50 lux, the minimum refresh rate is determined to be 10 Hz or 30 Hz; when the display brightness is greater than or equal to 300 nits and the ambient light brightness is greater than or equal to 50 lux, the minimum refresh rate is determined to be 1 Hz; when the display brightness is less than 50 nits or the ambient light brightness is less than 50 lux, the minimum refresh rate is determined to be 60 Hz.

[0012] In another possible implementation of the first aspect, after the display driver chip refreshes the image to the display screen according to the refresh rate in the first refresh rate queue, it also includes: when SF resumes sending the image to the display driver, the display driver controls the display driver chip to refresh the image to the display screen according to the first refresh rate in the first refresh rate queue.

[0013] In another possible implementation of the first aspect, the display driver chip includes a first display driver chip with a TEI function; the method also includes: when the display driver configures a first type of refresh rate queue for the first display driver chip, synchronously sends instructions to control the first display driver chip to turn off the TE signal shielding function and control the initialization of the TEI function.

[0014] In another possible implementation of the first aspect, the display driver chip includes a second display driver chip without a TEI function; the method also includes: when the display driver configures a first type of refresh rate queue for the second display driver chip, synchronously sends an instruction to control the second display driver chip to turn off the TE signal shielding function, and reports the TE signal generated by the second display driver chip to SF based on the actual working frame rate of SF.

[0015] In another possible implementation manner of the first aspect, the method further includes: when the display driver configures the second type of refresh rate queue for the display driver chip, synchronously sending an instruction to control the display driver chip to enable a TE signal shielding function.

[0016] In another possible implementation of the first aspect, when the display frame rate is greater than the minimum refresh rate, the display driver configures a first type of refresh rate queue for the display driver chip of the electronic device, including: when the display frame rate is greater than the minimum refresh rate, and when the display frame rate is not equal to 120 Hz and the minimum refresh rate is not equal to 60 Hz, the display driver configures a first type of refresh rate queue for the display driver chip of the electronic device, wherein the first refresh rate of the first type of refresh rate queue is less than or equal to the display frame rate, the refresh rates after the first refresh rate are empty, or the refresh rates after the first refresh rate are less than the display frame rate and greater than or equal to the minimum refresh rate; when the display frame rate is greater than the minimum refresh rate, and when the display frame rate is equal to 120 Hz and the minimum refresh rate is equal to 60 Hz, the display driver configures a second type of refresh rate queue for the display driver chip of the electronic device, the last refresh rate of the second type of refresh rate queue is equal to 60 Hz, and the refresh rates before the last refresh rate are all empty.

[0017] In another possible implementation of the first aspect, the display driver chip includes a first display driver chip with a TEI function, and the refresh rate queue length of the first display driver chip is 5; the display driver configures a first type of refresh rate queue for the first display driver chip, including: when the display frame rate is 120 Hz and the minimum refresh rate is 30 Hz, or when the display frame rate is 60 Hz and the minimum refresh rate is 30 Hz, the first refresh rate in the first type of refresh rate queue is set to 60 Hz, the last refresh rate is set to 30 Hz, and the remaining refresh rates are set to empty; when the display frame rate is 120 Hz and the minimum refresh rate is 10 Hz, or when the display frame rate is When the display frame rate is 60Hz and the minimum refresh rate is 10Hz, the first refresh rate in the first refresh rate queue is set to 60Hz, the second refresh rate is set to 30Hz, the third refresh rate is set to 20Hz, the fourth refresh rate is set to empty, and the fifth refresh rate is set to 10Hz; when the display frame rate is 120Hz and the minimum refresh rate is 1Hz, or when the display frame rate is 60Hz and the minimum refresh rate is 1Hz, the first refresh rate in the first refresh rate queue is set to 60Hz, the second refresh rate is set to 30Hz, the third refresh rate is set to 20Hz, the fourth refresh rate is set to 10Hz, and the fifth refresh rate is set to 1Hz.

[0018] In another possible implementation of the first aspect, the display driver chip includes a second display driver chip without a TEI function, and the refresh rate queue length of the second display driver chip is 4; the display driver configures a first type of refresh rate queue for the second display driver chip, including: when the display frame rate is 120 Hz and the minimum refresh rate is 30 Hz, or when the display frame rate is 60 Hz and the minimum refresh rate is 30 Hz, the first refresh rate in the first type of refresh rate queue is set to 60 Hz, the last refresh rate is set to 30 Hz, and the remaining refresh rates are set to empty; when the display frame rate is 120 Hz and the minimum refresh rate is 30 Hz, the refresh rate queue length is 40 Hz, and the refresh rate queue length is 40 Hz. When the display frame rate is 120Hz and the minimum refresh rate is 1Hz, or when the display frame rate is 60Hz and the minimum refresh rate is 10Hz, the first refresh rate in the first refresh rate queue is set to 60Hz, the second refresh rate is set to 30Hz, the third refresh rate is set to empty, and the fourth refresh rate is set to 10Hz; when the display frame rate is 120Hz and the minimum refresh rate is 1Hz, or when the display frame rate is 60Hz and the minimum refresh rate is 1Hz, the first refresh rate in the first refresh rate queue is set to 60Hz, the second refresh rate is set to 30Hz, the third refresh rate is set to 10Hz, and the fourth refresh rate is set to 1Hz.

[0019] In another possible implementation of the first aspect, in order to exclude some situations that are not suitable for configuring a refresh rate queue, when the display frame rate is greater than the minimum refresh rate, a first type of refresh rate queue is configured for the display driver chip of the electronic device, or when the display frame rate is equal to the minimum refresh rate, before configuring a second type of refresh rate queue for the display driver chip, the method also includes: the display driver determines that the display screen corresponding to the display driver chip has been initialized, and the display screen is not currently in all-weather display mode and text user interface mode.

[0020] In another possible implementation of the first aspect, the above-mentioned application includes at least two operating scenarios, and the display frame rates of the above-mentioned application in multiple operating scenarios of the at least two operating scenarios are different. The display driver of the above-mentioned electronic device obtains the display frame rate of the foreground running application, including: the display driver obtains the display frame rate of the application in the current operating scenario. In this implementation, when the display driver configures the refresh rate queue for the display driver chip, it can not only be based on the display frame rates of different applications, but also refer to the current operating scenario of the application. In this way, a refresh rate queue that is more in line with the actual operating conditions of the electronic device can be configured for the display driver chip, which is conducive to reducing the power consumption of the electronic device.

[0021] In a second aspect, the present application provides an electronic device, in which a plurality of applications are installed. The electronic device comprises: a display screen, a memory, a display driver chip, and one or more processors. The display screen, the memory, and the display driver chip are coupled to the processor. The memory stores one or more computer program codes, and the computer program codes include computer instructions. When the processor executes the computer instructions, the electronic device performs the following steps: the display driver obtains the display frame rate of the foreground running application and the minimum refresh rate of the display screen; when the display frame rate is greater than the minimum refresh rate, the display driver configures a first type of refresh rate queue for the display driver chip of the electronic device; wherein the first type of refresh rate queue includes at least two refresh rates and is arranged from high to low, and each refresh rate is greater than or equal to the display frame rate and less than or equal to the minimum refresh rate; the display driver controls the display driver chip to refresh the image to the display screen according to the first refresh rate in the first type of refresh rate queue; when the SF of the electronic device does not send the image to the display driver, the display driver controls the display driver chip to refresh the image to the display screen according to the next refresh rate in the first type of refresh rate queue according to the arrangement order of the refresh rates in the first type of refresh rate queue.

[0022] In a possible implementation of the second aspect, when the above-mentioned computer instructions are executed by the processor, the electronic device also performs the following steps: when the display frame rate is equal to the minimum refresh rate, the display driver configures a second type of refresh rate queue for the display driver chip of the electronic device; wherein the last refresh rate of the second type of refresh rate queue is equal to the display frame rate, and the refresh rates before the last refresh rate are all empty; the display driver controls the display driver chip to refresh the image to the display screen according to the last refresh rate in the second type of refresh rate queue.

[0023] In a possible implementation of the second aspect, when the above-mentioned computer instructions are executed by the processor, the electronic device also performs the following steps: a refresh rate decision module of the application framework layer in the electronic device obtains the display frame rate of the application running in the foreground, and determines the minimum refresh rate based on the display brightness and ambient light brightness of the display screen; the refresh rate decision module sends the display frame rate to the display driver through SF and HWC, and sends the minimum refresh rate to the display driver through the hardware abstraction layer interface.

[0024] In a possible implementation of the second aspect, when the above-mentioned computer instructions are executed by the processor, the electronic device further performs the following steps: when the display screen brightness is greater than or equal to 50 nits and the ambient light brightness is greater than or equal to 50 lux, the minimum refresh rate is determined to be 10 Hz or 30 Hz; when the display screen brightness is greater than or equal to 300 nits and the ambient light brightness is greater than or equal to 50 lux, the minimum refresh rate is determined to be 1 Hz; when the display screen brightness is less than 50 nits or the ambient light brightness is less than 50 lux, the minimum refresh rate is determined to be 60 Hz.

[0025] In a possible implementation of the second aspect, when the above-mentioned computer instructions are executed by the processor, the electronic device further performs the following steps: when SF resumes sending images to the display driver, the display driver controls the display driver chip to refresh the image to the display screen according to the first refresh rate in the first type of refresh rate queue.

[0026] In a possible implementation of the second aspect, when the above-mentioned computer instructions are executed by the processor, the electronic device further performs the following steps: when the display driver configures the first type of refresh rate queue for the first display driver chip, it synchronously sends instructions to control the first display driver chip to turn off the TE signal shielding function and control the TEI function initialization.

[0027] In a possible implementation of the second aspect, when the above-mentioned computer instructions are executed by the processor, the electronic device further performs the following steps: when the display driver configures the first type of refresh rate queue for the second display driver chip, synchronously sends instructions to control the second display driver chip to turn off the TE signal shielding function, and reports the TE signal generated by the second display driver chip to SF based on the actual working frame rate of SF.

[0028] In a possible implementation of the second aspect, when the above-mentioned computer instructions are executed by the processor, the electronic device further performs the following steps: when the display driver configures the second type of refresh rate queue for the display driver chip, it synchronously sends instructions to control the display driver chip to turn on the TE signal shielding function.

[0029] In a possible implementation of the second aspect, when the above-mentioned computer instructions are executed by the processor, the electronic device further performs the following steps: when the display frame rate is greater than the minimum refresh rate, and when the display frame rate is not equal to 120 Hz and the minimum refresh rate is not equal to 60 Hz, the display driver configures a first type of refresh rate queue for the display driver chip of the electronic device, wherein the first refresh rate of the first type of refresh rate queue is less than or equal to the display frame rate, the refresh rates after the first refresh rate are empty, or the refresh rates after the first refresh rate are less than the display frame rate and greater than or equal to the minimum refresh rate; when the display frame rate is greater than the minimum refresh rate, and when the display frame rate is equal to 120 Hz and the minimum refresh rate is equal to 60 Hz, the display driver configures a second type of refresh rate queue for the display driver chip of the electronic device, the last refresh rate of the second type of refresh rate queue is equal to 60 Hz, and the refresh rates before the last refresh rate are all empty.

[0030] In a possible implementation of the second aspect, when the above-mentioned computer instructions are executed by the processor, the electronic device further performs the following steps: when the display frame rate is 120 Hz and the minimum refresh rate is 30 Hz, or when the display frame rate is 60 Hz and the minimum refresh rate is 30 Hz, the first refresh rate in the first refresh rate queue is set to 60 Hz, the last refresh rate is set to 30 Hz, and the remaining refresh rates are set to empty; when the display frame rate is 120 Hz and the minimum refresh rate is 10 Hz, or when the display frame rate is 60 Hz and the minimum refresh rate is 10 Hz, the first refresh rate in the first refresh rate queue is set to 60 Hz, the second refresh rate is set to 30 Hz, the third refresh rate is set to 20 Hz, the fourth refresh rate is set to empty, and the fifth refresh rate is set to 10 Hz; when the display frame rate is 120 Hz and the minimum refresh rate is 1 Hz, or when the display frame rate is 60 Hz and the minimum refresh rate is 1 Hz, the first refresh rate in the first refresh rate queue is set to 60 Hz, the second refresh rate is set to 30 Hz, the third refresh rate is set to 20 Hz, the fourth refresh rate is set to empty, and the fifth refresh rate is set to 1 Hz.

[0031] In a possible implementation of the second aspect, when the above-mentioned computer instructions are executed by the processor, the electronic device further performs the following steps: when the display frame rate is 120 Hz and the minimum refresh rate is 30 Hz, or when the display frame rate is 60 Hz and the minimum refresh rate is 30 Hz, the first refresh rate in the first refresh rate queue is set to 60 Hz, the last refresh rate is set to 30 Hz, and the remaining refresh rates are set to empty; when the display frame rate is 120 Hz and the minimum refresh rate is 10 Hz, or when the display frame rate is 60 Hz and the minimum refresh rate is 10 Hz, the first refresh rate in the first refresh rate queue is set to 60 Hz, the second refresh rate is set to 30 Hz, the third refresh rate is set to empty, and the fourth refresh rate is set to 10 Hz; when the display frame rate is 120 Hz and the minimum refresh rate is 1 Hz, or when the display frame rate is 60 Hz and the minimum refresh rate is 1 Hz, the first refresh rate in the first refresh rate queue is set to 60 Hz, the second refresh rate is set to 30 Hz, the third refresh rate is set to empty, and the fourth refresh rate is set to 1 Hz.

[0032] In a possible implementation of the second aspect, when the above-mentioned computer instructions are executed by the processor, the electronic device further performs the following steps: the display driver determines that the display screen corresponding to the display driver chip has been initialized, and the display screen is not currently in all-weather display mode and text user interface mode.

[0033] In another possible implementation of the second aspect, the application includes at least two running scenarios, and the display frame rates of the application in multiple running scenarios of the at least two running scenarios are different. When the computer instructions are executed by the processor, the electronic device further performs the following steps: the display driver obtains the display frame rate of the application in the current running scenario.

[0034] In a third aspect, the present application provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor in an electronic device, the electronic device executes an image display method as in the first aspect and any possible design thereof.

[0035] In a fourth aspect, the present application provides a computer program product, which, when executed on a computer, enables the computer to execute the method of the first aspect and any possible design thereof. The computer may be the electronic device described above.

[0036] It can be understood that the beneficial effects that can be achieved by the electronic device of any possible design of the second aspect, the computer-readable storage medium of the third aspect, and the computer program product of the fourth aspect can be referred to as the beneficial effects in the first aspect and any possible design of the electronic device, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] Figure 1 A schematic diagram of a refresh rate corresponding to a refresh image method provided in an embodiment of the present application;

[0038] Figure 2 A schematic diagram of an interface of a video scene with bullet screen provided in an embodiment of the present application;

[0039] Figure 3 A schematic diagram of an interface of a video scene without bullet screen provided in an embodiment of the present application;

[0040] Figure 4 A schematic diagram of a DDIC repeated image refresh provided in an embodiment of the present application;

[0041] Figure 5 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application;

[0042] Figure 6 A software structure framework of an electronic device provided in an embodiment of the present application Figure 1 ;

[0043] Figure 7 A schematic diagram of a flow chart of an image display method provided in an embodiment of the present application;

[0044] Figure 8A schematic diagram of system-level interaction of an image display method provided in an embodiment of the present application;

[0045] Fig. 9 A software structure framework of an electronic device provided in an embodiment of the present application Figure 2 ;

[0046] Fig.10 A schematic diagram of a chip system provided in an embodiment of the present application. DETAILED DESCRIPTION

[0047] In order to clearly describe the technical solutions of the embodiments of the present application, some of the terms and technologies involved in the embodiments of the present application are briefly introduced and explained below.

[0048] Frame rate: Also known as frame rate, it is the rate at which bitmap images appear continuously on the display screen in frames, generally measured in frames per second (FPS).

[0049] Refresh rate: It is the number of times the screen is refreshed per second, which can also be called the frame rate of the display screen, measured in Hz. For example, a 60Hz refresh rate means that the display screen can complete 60 refreshes in 1 second. In other words, the refresh rate is a hardware performance parameter of the display screen in an electronic device, which is used to characterize the number of times the display screen can refresh the display screen per second.

[0050] Application display frame rate: The speed at which an application draws the screen (i.e., image data). The application display frame rate can generally be expressed as the number of frames transmitted per second (fps). In other words, the application display frame rate is the rate at which the application outputs image data to the display screen.

[0051] Tearing effect (TE) signal: A signal generated by DDIC to prevent tearing during image display. Tearing refers to the phenomenon that a part of the old and new images are displayed separately when the image is refreshed.

[0052] Adaptive refresh rate technology: dynamically adjust the screen refresh rate according to user usage scenarios (APP operation scenarios) and needs.

[0053] Sending images: The application processor (AP) writes the rendered image data to be displayed into the random access memory (RAM) of the DDIC through the surface flinger (SF).

[0054] Refresh image: DDIC reads the image data to be displayed from RAM according to the refresh rate and refreshes the display to the corresponding display screen.

[0055] The technical solutions of the embodiments of the present application will be described clearly and completely below in conjunction with the drawings in the embodiments of the present application. Among them, in the description of the embodiments of the present application, the terms used in the following embodiments are only for the purpose of describing specific embodiments, and are not intended to limit the present application. In addition, in order to facilitate the clear description of the technical solutions of the embodiments of the present application, in the embodiments of the present application, the words "first", "second" and the like are used to distinguish the same items or similar items with substantially the same functions and effects. It can be understood by those skilled in the art that the words "first", "second" and the like do not limit the quantity and execution order, and the words "first", "second" and the like do not limit certain differences. And, in the description of the embodiments of the present application, unless otherwise specified, the meaning of "multiple" means two or more.

[0056] With the continuous development of display technology for electronic devices (such as mobile phones), more and more display screens that can support multiple refresh rates have emerged. For example, a display screen that uses low temperature polycrystalline oxide (LTPO) screen technology can support multiple refresh rates such as 120Hz, 90Hz, 60Hz, 40Hz, 30Hz, 10Hz and 1Hz. Among them, 120Hz and 90Hz are the base frequencies of LTPO, and other supported refresh rates are generated on the basis of 120Hz through frame skipping, so that the lowest refresh rate can be 1Hz.

[0057] For example, a refresh rate of 120 Hz means that the display screen can be refreshed 120 times in 1 second, so 120 Hz refreshes a frame of image in a cycle of 8.3 ms (milliseconds), and the image of each cycle is an active frame. Figure 1 The 120Hz corresponding diagram is shown in the figure. Among them, the active frame can be understood as the image frame sent from the upper layer SF to the lower layer DDIC.

[0058] Then, the principle of achieving a 60Hz refresh rate based on 120Hz is to use the same 8.3ms cycle, but each active frame is followed by a hold frame. A hold frame is when DDIC keeps one frame without refreshing after refreshing an active frame. It can be understood that the hold frame has no corresponding image content. That is, at a 60Hz refresh rate, there is an active frame every 16.6 milliseconds. Figure 1As shown in the figure below, compared with refreshing an active frame in a cycle of 8.3ms, DDIC implements frame skipping by refreshing one frame and stopping one frame (commonly known as scan 1 stop 1), which extends the refresh time interval between two active frames by half, thus achieving a 60Hz refresh rate on the basis of 120Hz.

[0059] Similarly, to achieve 30Hz based on 120Hz, each active frame will be followed by 3 hold frames, commonly known as scan 1 stop 3, refer to Figure 1 30Hz corresponds to the figure. To achieve 10Hz at 120Hz, each active frame is followed by 11 hold frames, commonly known as scan 1 stop 11. To achieve 1Hz at 120Hz, each active frame is followed by 119 hold frames, commonly known as scan 1 stop 119.

[0060] The higher the refresh rate of a display, the higher the display frame rate it can support, and the corresponding picture display is smoother. The lower the refresh rate of a display, the lower the display frame rate it can support, but it can save more power. Therefore, in order to ensure smooth pictures while saving as much power as possible, adaptive refresh rate technology has emerged.

[0061] That is, usually when running a high frame rate application or sliding operation, the display screen is adaptively set to a high refresh rate by issuing a refresh rate switching instruction to the DDIC. Conversely, when running a low frame rate application, the display screen is adaptively set to a low refresh rate by issuing a refresh rate switching instruction to the DDIC.

[0062] Exemplary, if it is detected that the current running scene of the APP in the electronic device is a high frame rate game scene or a fast sliding scene, in order to improve the smoothness of the game screen or the screen sliding, a refresh rate switching instruction is sent to the DDIC via the display driver to switch the refresh rate of the display screen to a high refresh rate that can match the high frame rate game scene or the fast sliding scene. Assuming that the refresh rate of the current display screen is 60Hz, when it is detected that the APP running scene has changed and the refresh rate needs to be increased (for example, running a high frame rate game), the display driver can send a refresh rate switching instruction to the DDIC to switch the refresh rate to 120Hz. When it is detected that the APP running scene has changed and the refresh rate needs to be reduced (for example, exiting a high frame rate game), the refresh rate switching instruction can be sent to the DDIC through the display driver to switch the refresh rate from 120Hz back to 60Hz.

[0063] It can be seen that compared with the display screen that can only support one refresh rate in the past, the display screen that can support multiple refresh rates can adapt to more APP operation scenarios based on actual application conditions, thereby ensuring smooth picture while saving power consumption.

[0064] However, many apps are currently developed by third parties and are configured to run in electronic devices by downloading and installing. Therefore, there will be compatibility issues between electronic devices and apps. When the compatibility is high, the upper layer of the electronic device can distinguish the running scenarios of the apps very well, so that the refresh rate switching instructions can be directly issued based on the running scenarios to control the lower layer DDIC to switch the refresh rate that matches the running scenarios to implement adaptive refresh rate technology.

[0065] However, when the compatibility between electronic devices and apps is low, the upper layer of the electronic device may not be able to distinguish the app running scenarios well, and thus cannot accurately issue refresh rate switching instructions to the lower layer DDIC based on the running scenarios to switch the refresh rate to match the app running scenarios, resulting in increased power consumption. In other words, traditional adaptive refresh rate technology cannot adapt to situations where the running scenarios cannot be distinguished, and thus cannot reduce the refresh rate of the DDIC when the running scenarios cannot be distinguished, resulting in unnecessary increase in power consumption.

[0066] For example, take a short video APP with a bullet screen function as an example. In the video playback scenario with bullet screen, the short video APP refers to Figure 2 In order to ensure the smoothness of the bullet screen, the display frame rate required by the APP is generally 60Hz. Correspondingly, the refresh rate of the display screen must be adapted to 60Hz to keep the smoothness of the bullet screen running and display. In the video playback scenario without bullet screen, refer to Figure 3 In order to reduce power consumption, the APP display frame rate is generally adapted to 30Hz to ensure smooth video playback. Therefore, when the running scene in the short video APP switches from a video with bullet screen to a video without bullet screen, the SF module on the AP side can reduce the drawing rate to 30Hz based on the 30Hz display frame rate required by the short video APP. However, due to the background adaptability problem, the electronic device and the short video APP cannot distinguish whether the current video scene has bullet screens well, and thus cannot accurately issue a refresh rate switching instruction to the lower-level DDIC to switch to a 30Hz refresh rate when the running scene of the short video APP switches to a video without bullet screen. Therefore, after the upper-level SF has reduced the drawing rate to 30Hz, so that the picture sending frequency has been reduced to 30Hz accordingly, the lower-level DDIC still refreshes the picture at a refresh rate of 60Hz, which increases unnecessary power consumption. The following introduces the above problems in combination with SF drawing and picture sending, as well as the DDIC picture refreshing process:

[0067] refer to Figure 4, the rectangles marked with numbers 1, 2, 3, and 4 represent the 1st frame image, the 2nd frame image, the 3rd frame image, and the 4th frame image, respectively. Among them, the 1st frame image and the 2nd frame image are images drawn at a display frame rate of 60Hz (corresponding to the bullet screen video scene of the short video APP). That is, the time interval between drawing, sending, and refreshing the images of the 1st frame image and the 2nd frame image is two cycles of 16.6ms. When the short video APP switches to the non-bullet screen video scene, SF reduces the drawing rate to 30Hz according to the 30Hz display frame rate requirement of the non-bullet screen video scene, and completes the drawing and sending of the 3rd and 4th frames at a rate of 30Hz. That is, the time interval between drawing, sending, and refreshing the images of the 3rd and 4th frames is four cycles of 33.3ms. However, since the upper layer of the electronic device cannot distinguish the scene at this time and send the instruction to the DDIC to switch to a 30Hz refresh rate, the DDIC still uses a 60Hz refresh rate to refresh the image. Therefore, in the interval when the upper SF does not send images, because no new images (active frames) are transmitted, the DDIC repeatedly refreshes the third and fourth frames (as shown in the rectangle with diagonal lines), thereby increasing unnecessary power consumption.

[0068] In order to solve the problem of unnecessary power consumption increase caused by failure to distinguish APP running scenarios and failure to accurately issue refresh rate switching instructions to DDIC to reduce refresh rate, the embodiment of the present application provides a new adaptive refresh rate method.

[0069] The adaptive refresh rate method provided in the embodiment of the present application is applied to an electronic device, and the main implementation principle is: the upper layer of the electronic device dynamically configures a refresh rate queue SEQ with a refresh rate distribution from high to low for the DDIC based on the data structure of the queue (sequeue, SEQ) used to configure the refresh rate in the DDIC. Then, the display driver controls the DDIC to refresh the image to the display screen based on the configured refresh rate queue SEQ. That is, during the image display process, the display driver can send a refresh rate switching instruction to the DDIC according to the image sending frequency of the SF module on the upper AP side to control the DDIC to switch the refresh rate in the configured refresh rate queue SEQ. When the DDIC switches from a high refresh rate to a low refresh rate based on the image sending frequency, the refresh rate is adaptively reduced, thereby achieving the effect of reducing unnecessary power consumption.

[0070] Specifically, SEQ can be understood as a functional module in DDIC that provides users with refresh rate configuration. Based on the type of DDIC, the length that its queue can support is different. In other words, the length of the refresh rate queue SEQ configured for DDIC depends on the type of DDIC.

[0071] For example, the two DDICs, model 37900 and model 37701A, which are currently the most commonly used in electronic devices, are used as examples. Model 37900 DDIC is a DDIC with a tearing interposition (TEI) function (hereinafter referred to as the first DDIC), and the queue length it can support is 5. That is, the refresh rate queue SEQ of the first DDIC can include 5 queue values, which is equivalent to SEQ=[SEQ1, SEQ2, SEQ3, SEQ4, SEQ5] of the first DDIC. Model 37701A DDIC is a DDIC without a tearing interposition (TEI) function (hereinafter referred to as the second DDIC), and the queue length it can support is 4, that is, SEQ in the second DDIC can include 4 queue values, which is equivalent to SEQ=[SEQ1, SEQ2, SEQ3, SEQ4] of the second DDIC.

[0072] Among them, the electronic device takes a mobile phone as an example. For a mobile phone with only a single display screen, the display screen can apply DDIC of model 37701A or DDIC of model 37900 according to actual needs. For a mobile phone with two displays, such as a folding mobile phone, according to the different requirements of the inner screen (the display screen for users to operate when the folding mobile phone is unfolded) and the outer screen (the display screen for users to operate when the folding mobile phone is folded), you can choose to apply the first DDIC and / or the second DDIC. For example, the existing inner screen often uses DDIC of model 37900, and the outer screen often uses DDIC of model 37701A.

[0073] Each queue value in the refresh rate queue SEQ (such as SEQ i, i=1, 2…n, n=4 or n=5) can be set to a different refresh rate, and different refresh rates correspond to different refresh modes. DDIC refreshes the picture according to SEQ, which means refreshing the picture according to the refresh rate corresponding to SEQ, which is equivalent to working at the refresh rate. For example, if a queue value in SEQ of DDIC is set to a refresh rate of 60Hz, when DDIC works according to the queue value 60Hz, DDIC refreshes the picture in a scan 1 stop 1 manner, thereby achieving a refresh rate of 60Hz. If the queue value in SEQ is set to 30Hz, when DDIC works according to the queue value 30Hz, DDIC refreshes the picture in a scan 1 stop 3 manner, thereby achieving a refresh rate of 30Hz. And, each SEQ i in the refresh rate queue SEQ can be switched according to the order of entering the queue. At the same time, each refresh rate SEQi in the refresh rate queue SEQ in DDIC can only be switched in sequence according to the queue order. And the restriction cannot jump to switch, but can directly switch to SEQ1. That is, DDIC can only switch from SEQ1 to SEQ2, and from SEQ2 to SEQ3, but cannot directly switch from SEQ1 to SEQ3, let alone from SEQ3 to SEQ1. However, it can directly switch from SEQ3 or SEQ2 to SEQ1.

[0074] Based on this, in order to realize adaptive reduction of refresh rate to save unnecessary power consumption when the operation scene cannot be distinguished, the electronic device in the embodiment of the present application can configure a refresh rate queue SEQ with refresh rates distributed from high to low for DDIC through dynamic configuration. For example, the first refresh rate SEQ1 in the refresh rate queue SEQ is set to a high refresh rate, and the other refresh rates are set to low refresh rates lower than the first refresh rate SEQ1.

[0075] For example, taking the SEQ of the first DDIC as an example, SEQ1 is set to a high refresh rate, and SEQ2, SEQ3, SEQ4, and SEQ5 are set to a low refresh rate. For example, SEQ1 is set to 60 Hz, and SEQ2, SEQ3, SEQ4, and SEQ5 are set to 30 Hz.

[0076] Then, DDIC refreshes the image in the refresh rate queue SEQ configured for the upper-layer application based on the running scenario. The refresh process is as follows: DDIC first works in the refresh mode corresponding to the first refresh rate SEQ1 in the queue. While refreshing the image, the display driver determines whether the upper layer has stable image delivery based on the TE signal generated by DDIC and reported to the upper-layer SF.

[0077] In display technology, generally speaking, when DDIC reports a TE signal, it will get a frame of image sent from the upper layer. Therefore, if the corresponding image is not obtained after reporting the TE signal, it means that the SF module may reduce the speed of drawing and sending images according to the display frame rate of the APP running scene (for example, when the display frame rate required by the APP drops from 60Hz to 30Hz after the barrage is completed or closed). In other words, the upper-layer SF currently has no new images that need to be sent for display, so it does not respond to the TE signal reported by DDIC to send images. At this time, if DDIC still works at the refresh rate corresponding to SEQ1, repeated image refresh will occur, resulting in the problem of unnecessary power consumption.

[0078] Therefore, when the display driver determines that there is an unsent image in the upper SF according to the TE signal, it controls the DDIC to switch to the next refresh rate according to the order of the refresh rates SEQi in the refresh rate queue SEQ. For example, switch from SEQ1 to SEQ2. Then the DDIC refreshes the image according to the currently switched refresh rate, that is, the image is refreshed according to the refresh rate corresponding to the currently switched SEQi.

[0079] SEQ2, SEQ3, SEQ4 and SEQ5 are also switched in the same way when it is determined that the upper SF does not send pictures, until they switch to the last SEQ4 or SEQ5, and keep refreshing the pictures at the refresh rate corresponding to the last SEQ4 or SEQ5.

[0080] However, after DDIC reduces the refresh rate, the number of hold frames for DDIC to refresh images will increase. And if the upper layer SF resumes sending images, it will still send images at the original frequency. That is, the frequency of SF sending images after resuming sending images will be higher than the refresh rate of DDIC's current image refresh. Therefore, if the upper layer resumes sending images at this time, the image sent may correspond to the active frame of DDIC or the hold frame. However, if the hold frame corresponds to the moment when DDIC does not refresh images, if the image sent by SF corresponds to the hold frame, it may cause DDIC to be unable to respond to the refresh immediately, and then the new image sent by the upper layer will not be displayed immediately on the display. Therefore, in order to ensure that DDIC can immediately respond to the upper layer SF sending images for refreshing, it is necessary to ensure that the SF sending images corresponds to the active frame of DDIC. Therefore, when DDIC stipulates that it can only jump to SEQ1, the display driver needs to immediately control DDIC to switch back to the first refresh rate SEQ1 when receiving SF sending images.

[0081] In addition, in display technology, the TE signal is generated by the DDIC, and the upper SF usually sends images based on the TE signal reported by the lower display driver. That is, the image sending frequency of the upper SF module is equivalent to the reporting frequency of the TE signal. Therefore, the frequency of the TE signal reported by the display driver needs to be consistent with the working frame rate of the upper SF module (software frame rate synchronization requirement).

[0082] When the refresh rate of a traditional DDIC is directly controlled by the upper layer, the frequency of its reported TE signal usually corresponds to the currently used refresh rate, thereby ensuring consistency with the upper layer frame rate. However, when the embodiment of the present application uses the display driver to control the DDIC to achieve adaptive reduction of the refresh rate with the configured refresh rate queue SEQ, once the DDIC switches from a high refresh rate to a low refresh rate, the corresponding frequency of the reported TE signal will change with the switching of the refresh rate. Then, in the case where the upper layer simply does not respond to the TE signal to send the image, but does not actually reduce the working frame rate, if the TE signal is reported according to the low refresh rate after the switch, the frequency of the TE signal reporting is not synchronized with the working frame rate of the upper layer, which violates the software frame rate synchronization requirement.

[0083] Therefore, in an embodiment of the present application, in order to meet the software frame rate synchronization requirements, during the process of DDIC adaptively reducing the refresh rate using SEQ, the display driver needs to synchronously control DDIC to turn off the TE MASK function, and report the TE signal generated by DDIC based on the upper-layer SF working frame rate, thereby realizing the TE jump function.

[0084] Among them, TE MASK is a function in DDIC that is used to shield the TE signal in the refresh rate SEXi. When the TEMASK function is turned on, the TE signal in the middle of each SEXi will be shielded, that is, the TE signals corresponding to all the hold frames in SEXi will be shielded, and the shielded TE signals cannot be reported. When the TE MASK function is turned off, DDIC will generate a TE signal at a frequency of 120Hz and report it to the display driver and the upper SF.

[0085] The TE skipping function means reporting a TE signal to SF at intervals of one TE signal, which is equivalent to skipping some TE signals that need to be reported. The TE signal that is not reported can be called a TE skipping signal. For example. Because the DDIC will generate a TE signal at a frequency of 120Hz after the TE MASK function is turned off, when the upper layer working frame rate is 120Hz, the display driver can not implement the TE skipping function, and directly report the TE signal generated by the DDIC to the upper layer SF at a frequency of 120Hz to ensure that the frequency of reporting TE is synchronized with the software frame rate. When the upper layer working frame rate is not 120Hz, the TE skipping function needs to be implemented so that the frequency of TE signal reporting is consistent with the upper layer SF working frame rate, so as to meet the software frame rate synchronization requirements.

[0086] The implementation method of the TE jump function is determined by whether the DDIC has a TEI function (a hardware function for implementing TE jump in the DDIC). For a DDIC with a TEI function, such as the first DDIC, since its hardware has a TEI function, the TE jump function can be directly implemented through the TEI function of the DDIC. If the TE jump function needs to be implemented, it is only necessary to send an instruction to the DDIC to control the initialization of the register corresponding to the TEI function.

[0087] For DDICs without TEI function, such as the second DDIC, since its hardware is not equipped with TEI function, the display driver mainly implements the TE jump function through software program control. That is, the display driver implements the TE jump function by reporting one TE signal to the upper SF at intervals for the TE signal generated by the second DDIC. For example, when the working frame rate of the upper SF is 60Hz, the reporting rate of the TE signal needs to be 60Hz. Then after the TE MASK function is turned off, the TE signal cannot be reported to the upper SF at 120Hz. The display driver generates a TE signal at a refresh rate of 120Hz in DDIC, and reports a TE signal to the upper SF at intervals, so that the reporting rate of the TE signal is 60Hz, thereby ensuring synchronization with the working frame rate of the upper layer.

[0088] It can be seen that, by adopting this solution, after the display driver configures the refresh rate queue SEQ with a refresh rate distribution from high to low for DDIC, it can control DDIC to switch from high refresh rate to low refresh rate when the upper SF does not send pictures, so that DDIC can adaptively reduce the refresh rate based on the picture sending frequency of the upper layer. Therefore, when the upper SF does not send pictures, it can avoid DDIC from repeatedly refreshing pictures, thereby reducing unnecessary power consumption. For example, assume that the refresh rate corresponding to SEQ1 is 60Hz, and the refresh rate corresponding to SEQ2 is 30Hz. When DDIC works at the refresh rate of 60Hz corresponding to SEQ1, the display driver determines through the TE signal that the picture sending frequency of the upper SF is reduced. At this time, the display driver controls DDIC to switch from SEQ1 to SEQ2. Correspondingly, the refresh rate of DDIC refreshing is reduced from 60Hz to 30Hz. In other words, the refreshing mode of DDIC is switched from "scan 1 stop 1" to "scan 1 stop 3", so as to avoid Figure 4 The repeated image refresh phenomenon shown in the figure reduces power consumption.

[0089] Exemplary, reference Figure 5 , is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application.

[0090] The electronic device 100 may include at least one of a mobile phone, a foldable electronic device (foldable mobile phone), a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a cellular phone, a personal digital assistant (PDA), an augmented reality (AR) device, a virtual reality (VR) device, an artificial intelligence (AI) device, a wearable device, an in-vehicle device, a smart home device, or a smart city device. The embodiment of the present application does not impose any special restrictions on the specific type of the electronic device 100.

[0091] The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) connector 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera module 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. Among them, the sensor module 180 may include a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, etc.

[0092] It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0093] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0094] The processor 110 can generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions. Specifically in the embodiment of the present application, the processor 110 can control the lower layer DDIC to configure the refresh rate queue SEQ for the DDIC to implement the refresh rate adaptive method described in the embodiment of the present application.

[0095] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 may be a cache memory. The memory may store instructions or data that have been used or are frequently used by the processor 110. If the processor 110 needs to use the instruction or data, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0096] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc. The processor 110 may be connected to a touch sensor, an audio module, a wireless communication module, a display, a camera, and other modules through at least one of the above interfaces.

[0097] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present application is only a schematic illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0098] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as music and videos are stored in the external memory card. Or files such as music and videos are transferred from the electronic device to the external memory card.

[0099] The internal memory 121 can be used to store computer executable program codes, which include instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional methods or data processing of the electronic device 100 by running instructions stored in the internal memory 121, and / or instructions stored in a memory provided in the processor.

[0100] The charging management module 140 is used to receive the charging input of the charger and charge the battery 142. While the charging management module 140 is charging the battery 142, it can also power the electronic device through the power management module 141.

[0101] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the display screen 194, the camera module 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.

[0102] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0103] The antenna 1 and the antenna 2 are used to transmit and receive electromagnetic wave signals. The mobile communication module 150 can provide a solution for wireless communication including 2G / 3G / 4G / 5G etc. applied to the electronic device 100.

[0104] The wireless communication module 160 can provide wireless communication solutions for application in the electronic device 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), Bluetooth low energy (BLE), ultra wide band (UWB), global navigation satellite system (GNSS), frequency modulation (FM), near field communication technology (NFC), infrared technology (IR), etc.

[0105] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, so that electronic device 100 can communicate with a network and other electronic devices through wireless communication technology.

[0106] The electronic device 100 can realize the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or change display information.

[0107] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. In the embodiment of the present application, the display panel can be an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc.

[0108] In some embodiments, the electronic device 100 may include one or more display screens 194. According to actual needs, different display screens may be controlled by different DDICs. Exemplarily, the electronic device 100 includes a first DDIC with a TEI function and a second DDIC without a TEI function. The first DDIC may control the first display screen, and the second DDIC may control the second display screen.

[0109] The electronic device 100 can realize the camera function through the camera module 193, ISP, video codec, GPU, display screen 194, application processor AP, neural network processor NPU, etc.

[0110] refer to Figure 6 , which is a software structure block diagram of the electronic device 100 according to an embodiment of the present application.

[0111] The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: application layer (applications), application framework layer (application framework), hardware abstract layer (HAL) and kernel layer (kernel).

[0112] The application layer can include a series of applications, including desktop, games, camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc.

[0113] The application framework layer provides application programming interface (API) and programming framework for the applications in the application layer. The application framework layer includes some predefined functions. Figure 6 As shown, in the embodiment of the present application, the application framework layer includes a refresh rate decision module.

[0114] The hardware abstraction layer runs in user space, encapsulates kernel layer drivers, and provides a calling interface to the upper layer. Figure 6 As shown, the hardware abstraction layer of the embodiment of the present application includes SF and a hardware composer (HWC). The HWC has the function and ability to combine and display image data using hardware.

[0115] The kernel layer is the layer between hardware and software, such as Figure 6As shown. Specifically in the embodiment of the present application, the kernel layer at least includes a display driver. The hardware involved may include a DDIC and a display panel. The display driver is used to drive the DDIC to complete the processing and implementation of the display. Among them, for a foldable electronic device (for example, a foldable mobile phone including two display screens, an inner screen and an outer screen), Figure 6 The first DDIC corresponding to the inner screen and the second DDIC corresponding to the outer screen are shown, as well as the first panel and the second panel corresponding to the first DDIC and the second DDIC respectively.

[0116] Based on the principle of the above refresh rate adaptive method, the embodiment of the present application provides an image display method, which is applied to an electronic device including a display screen and multiple application programs installed. The electronic device structure of the embodiment of the present application refers to Figure 5 As shown. Software structure diagram reference Figure 6 Hereinafter, the image display method of the embodiment of the present application is described by taking an electronic device as an example.

[0117] Specifically, the display driver of the electronic device obtains the display frame rate of the APP running in the foreground. Among them, the display frame rate is the frame rate required by the APP running scenario. After being obtained from the APP by the refresh rate decision module, it can be sent to the display driver through SF and HWC. At the same time, because different display screens can support different refresh rates, and different refresh rates will bring different display effects to the display. Therefore, when configuring a refresh rate queue that can adaptively reduce the refresh rate for DDIC, in order to avoid the refresh rate after adaptive reduction not being supported by the display screen or bringing poor display effects, the setting of each refresh rate in the queue must not only consider meeting the frame rate required by the APP, but also consider the performance of the display screen.

[0118] Therefore, the display driver needs to obtain the minimum refresh rate while obtaining the APP display frame rate. The minimum refresh rate can be the lowest refresh rate supported by the display screen of the electronic device. It can also be the minimum refresh rate set according to the required display effect.

[0119] After the display driver obtains the display frame rate and the minimum refresh rate of the APP, and determines that the display frame rate of the APP is greater than the minimum refresh rate, it indicates that the current conditions for adapting from a high refresh rate to a low refresh rate are met. Therefore, the display driver can configure a first type of refresh rate queue for the DDIC. Among them, the first type of refresh rate queue refers to a refresh rate queue SEQ including at least two refresh rates and the refresh rates are arranged from high to low. Moreover, each refresh rate in the first type of refresh rate queue is greater than or equal to the display frame rate and less than or equal to the minimum refresh rate. Exemplarily, taking the first DDIC as an example, when the display frame rate of the APP is equal to 120Hz and the minimum refresh rate is equal to 10Hz, the first type of refresh rate sequence can be [120Hz, 60Hz, 30Hz, 20Hz, 10Hz]. Taking the second DDIC as an example, the first type of refresh rate sequence can be [120Hz, 60Hz, 30Hz, 10Hz]. In an embodiment of the present application, the first type of refresh rate queue can also be called an adaptive SEQ.

[0120] After the display driver configures the first refresh rate queue for DDIC, the DDIC can be controlled to refresh the image based on the first refresh rate queue. The display driver first controls the DDIC to refresh the image to the corresponding display screen according to the first refresh rate SEQ1 in the first refresh rate queue. Then, when the display driver determines that the SF module has not sent the image based on the reported TE signal, the display driver controls the DDIC to refresh the image to the display screen according to the next refresh rate in the first refresh rate queue according to the arrangement order of the refresh rates in the first refresh rate queue. In other words, the DDIC is controlled to switch from the first refresh rate SEQ1 to the second refresh rate SEQ2, and the image is refreshed to the display screen according to the second refresh rate SEQ2. Similarly, the display driver can control the DDIC to switch to the third refresh rate SEQ3 again based on the image delivery of SF, and refresh the image to the display screen according to the third refresh rate SEQ3. If the DDIC has been controlled to refresh the image to the display screen according to the last refresh rate SEQ4 or SEQ5, it indicates that the current refresh rate has dropped to the minimum refresh rate that the display screen can support. If the refresh rate is not switched, the DDIC is always operated at the minimum refresh rate.

[0121] It can be seen that the image display method provided in the embodiment of the present application adaptively reduces the refresh rate of the DDIC based on the image sending frequency of the upper SF. Therefore, when the upper SF does not send images, the DDIC can be prevented from repeatedly refreshing the images, thereby reducing unnecessary power consumption and achieving the effect of saving power consumption.

[0122] In some embodiments, when the display frame rate of the APP is equal to the minimum refresh rate, that is, when the display frame rate required for the APP to run is equal to the minimum refresh rate that the display can support, because the smooth operation of the APP and the performance of the display cannot be ignored, it is not suitable to configure the first type of refresh rate queue (adaptive SEQ) for the DDIC at this time, that is, the conditions for adaptively reducing the refresh rate are not met at this time. Therefore, the display driver configures the second type of refresh rate queue for the DDIC whose refresh rate cannot be adaptively reduced. The second type of refresh rate queue can also be called a fixed SEQ. In this type of refresh rate queue, only the last refresh rate SEQ4 or SEQ5 is equal to the display frame rate of the APP, and the other refresh rates are empty.

[0123] That is to say, in the first DDIC, SEQ1, SEQ2, SEQ3, and SEQ4 are empty, and the refresh rate corresponding to SEQ5 is set to the display frame rate. In the second DDIC, SEQ1, SEQ2, and SEQ3 are empty, and the refresh rate corresponding to SEQ4 is set to the display frame rate. For example, assuming that the display frame rate of the APP = the minimum refresh rate = 60Hz, then in the first DDIC, SEQ1, SEQ2, and SEQ3 are empty, and SEQ4 is set to 60Hz. In the second DDIC, SEQ1, SEQ2, SEQ3, and SEQ4 are empty, and SEQ5 is set to 60Hz.

[0124] Since the empty SEQi in the refresh rate queue SEQ will be skipped directly, when the display driver controls DDIC to refresh the image to the display screen with the second refresh rate queue, it is equivalent to directly controlling DDIC to refresh the image to the display screen with the last refresh rate in the second refresh rate queue, indicating that DDIC works at a fixed refresh rate.

[0125] In addition, it should be understood that, as the performance of existing display screens is getting better and better, the refresh rates that can be supported by display screens are also increasing. And there is a need to ensure that the APP runs smoothly, so generally speaking, the display frame rate required by the APP will not be too low. Therefore, there is currently no situation where the display frame rate of the APP is less than the minimum refresh rate. Therefore, when the display driver configures the refresh rate queue for the DDIC, the embodiment of the present application excludes the situation where the display frame rate of the APP is less than the minimum refresh rate.

[0126] In some embodiments, the minimum refresh rate may be the minimum refresh rate that can avoid flickering on the display screen. Because the light-emitting principle of the display screen (such as OLED, AMOLED, FLED, etc.) using diode light emission is mainly realized by applying power to it, which is equivalent to charging the display screen once when the display driver chip DDIC refreshes the image on the display screen to display the corresponding image data. Therefore, if the DDIC refreshes the image at a high refresh rate, due to the high refresh rate, the frequency of refreshing the image is high, so the time interval of refreshing the image is short, which is equivalent to the circuit always charging the display screen, and the brightness of the display screen can be maintained without dimming. However, if the DDIC switches to a low refresh rate, due to the low refresh rate, the frequency of refreshing the image will become lower, so the time interval of refreshing the image will become longer, and during this period, the circuit may dim the brightness of the display screen due to the physical phenomenon of leakage current. For example, assuming that the DDIC makes the refresh rate adaptively reduced to 1Hz according to the configured refresh rate queue, then at a refresh rate of 1Hz, the DDIC will refresh the image once after 1 second, which is equivalent to charging the display screen once in one second. During this 1-second interval, it is obvious that leakage current will occur, causing the display screen to dim. After 1 second, DDIC refreshes the image to charge the display and the display becomes brighter again, causing the display to flicker at 1Hz.

[0127] Therefore, if the DDIC works at a too low refresh rate, it may cause the screen to flicker. In the traditional way, because the refresh rate of the DDIC is directly controlled by the upper layer, if the display screen flickers due to the low refresh rate, the upper layer can solve this problem by switching instructions to control the DDIC to increase the refresh rate.

[0128] However, when the image display method of the embodiment of the present application applies the adaptive refresh rate method provided by the embodiment of the present application, since its main principle is that the display driver controls the DDIC to adaptively reduce the refresh rate based on the refresh rate queue SEQ configured by the upper layer. Therefore, the upper layer of the display driver in the electronic device cannot clearly know the adaptive situation of the current DDIC refresh rate. In other words, in the adaptive process of the DDIC, the upper layer cannot accurately know the specific value of the current refresh rate after the adaptive reduction, and thus cannot know the flickering phenomenon caused by the low refresh rate. Therefore, the traditional method of solving the flickering problem caused by the low refresh rate by controlling the DDIC to increase the refresh rate by the upper layer cannot be adapted to the image display method of the embodiment of the present application.

[0129] Based on this, in order to ensure the synchronization of image display and brightness, the minimum refresh rate can be set under the constraint of not causing flickering on the display. For example, if the refresh rate of the electronic device display is less than 10Hz, flickering is prone to occur, so the minimum refresh rate can be set to 10Hz. The subsequent display driver will not have a refresh rate lower than 10Hz in the refresh rate queue SEQ configured for DDIC based on the display minimum refresh rate, and DDIC will not switch to a refresh rate below 10Hz, thereby avoiding the problem of display flickering.

[0130] In some embodiments, when the display driver configures the first type of refresh rate queue (adaptive SEQ) for DDIC, in order to meet the software frame rate synchronization requirements, the display driver needs to synchronously send instructions to control DDIC to turn off the TE signal masking (TE MASK) function. And based on the upper layer working frame rate, control the reporting frequency of the TE signal generated by DDIC to achieve the TE jump function. Among them, if the DDIC is the first DDIC with a TEI function, the display driver can control the initialization of the TEI function of the first DDIC by sending instructions. If the DDIC is a second DDIC without a TEI function, the display driver reports the TE signal generated by DDIC to SF based on the actual working frame rate of SF. That is, the display driver reports a TE signal to SF every other TE signal.

[0131] In some embodiments, when the display driver configures the second refresh rate queue (fixed SEQ) for the DDIC, the second refresh rate queue is a refresh rate queue that controls the DDIC to refresh images to the display screen at a fixed refresh rate. Therefore, the display driver only needs to synchronously send instructions to control the DDIC to turn on the TE signal shielding (TE MASK function).

[0132] In some embodiments, considering that DDIC works between refresh rates with small differences, it will not have a significant impact on the display. For example, switching the refresh rate from 120Hz to 60Hz will not cause the display to flicker or become unsmooth. Therefore, when the display driver configures the first refresh rate queue for DDIC, in order to reduce power consumption as much as possible, the first refresh rate queue with the lowest power consumption can be configured based on the actual display frame rate and the lowest refresh rate.

[0133] Based on this, when the display frame rate is greater than the minimum refresh rate, the display driver configures a first type of refresh rate queue for the display driver chip of the electronic device, including: when the display frame rate is greater than the minimum refresh rate, and when the display frame rate is not equal to 120Hz and the minimum refresh rate is not equal to 60Hz, the display driver configures a first type of refresh rate queue for the display driver chip of the electronic device, wherein the first refresh rate of the first type of refresh rate queue is less than or equal to the display frame rate, the refresh rates after the first refresh rate are empty, or the refresh rates after the first refresh rate are less than the display frame rate and greater than or equal to the minimum refresh rate. When the display frame rate is greater than the minimum refresh rate, and when the display frame rate is equal to 120Hz and the minimum refresh rate is equal to 60Hz, the display driver configures a second type of refresh rate queue for the display driver chip of the electronic device, the last refresh rate of the second type of refresh rate queue is equal to 60Hz, and the refresh rates before the last refresh rate are all empty.

[0134] That is to say, when the display frame rate of the APP is greater than the minimum refresh rate, and when the display frame rate is not equal to 120Hz and the minimum refresh rate is not equal to 60Hz, the refresh rate corresponding to SEQ1 of SEQ in the first DDIC is greater than or equal to the display frame rate of the APP, and the refresh rates of SEQ2, SEQ3, SEQ4, and SEQ5 can be empty, or less than the display frame rate of the APP and greater than or equal to the minimum refresh rate. Similarly, the refresh rate corresponding to SEQ1 of SEQ in the second DDIC is greater than or equal to the display frame rate of the APP, and the refresh rates of SEQ2, SEQ3, and SEQ4 can be empty, or less than the display frame rate of the APP and greater than or equal to the minimum refresh rate. When the display frame rate of the APP is greater than the minimum refresh rate, but the display frame rate is equal to 120Hz and the minimum refresh rate is equal to 60Hz, the last second-type refresh rate queue with a refresh rate equal to 60Hz can be directly configured for the DDIC.

[0135] That is, when the display frame rate of the APP is equal to 120Hz and the minimum refresh rate is equal to 60Hz, the refresh rate queue SEQ of the first DDIC = [\, \, \, \, 60Hz]. The refresh rate queue SEQ of the second DDIC = [\, \, \, 60Hz]. Among them, "\" means empty. When the refresh rate corresponding to SEQi to which the DDIC currently switches is empty "\", the DDIC can directly switch to the next refresh rate in sequence. Therefore, when the second type of refresh rate queue is configured for the DDIC, it means that the display driver directly controls the DDIC to refresh the image to the display screen according to the last refresh rate. As above, it means that the display driver directly controls the first DDIC and the second DDIC to refresh the image to the display screen at 60Hz.

[0136] In some embodiments, due to the different queue lengths supported by different DDIC models, and in consideration of reducing power consumption as much as possible without affecting the display effect, the embodiments of the present application provide refresh rate queues with display frame rates and minimum refresh rates that can be configured based on different DDICs. As shown in Table 1 below, Table 1 below includes refresh rate queues of the first DDIC and the second DDIC.

[0137] Table 1: Refresh rate queue

[0138]

[0139]

[0140] Among them, "\" represents a blank, and "(n)" after the refresh rate unit "Hz" means maintaining the refresh rate for n times. Different refresh rates correspond to different refresh methods. Maintaining the refresh rate for n times means refreshing the image n times in the refresh method corresponding to the refresh rate. Correspondingly, the number of refresh frames corresponding to maintaining the refresh rate for n times is equal to the product of the number of refresh frames corresponding to the refresh rate and n.

[0141] Take "(3)" shown in Table 1 as an example. That is, when DDIC determines that it can adaptively reduce from 60Hz to 30Hz, DDIC may not switch immediately, but maintain 60Hz for 3 times before switching to 30Hz. Since the 60Hz refresh rate is a 1-scan-1-stop refresh mode, that is, under normal 60Hz, 1 active frame and 1 hold frame are required, for a total of two frames of images, such as Figure 1 Therefore, DDIC can switch from 60Hz to 30Hz after 3 scans, 1 stop, and 1 refresh, for a total of 6 frames (3 active frames and 3 hold frames).

[0142] By maintaining the refresh rate for a certain number of times before switching, the display flickering problem caused by the refresh rate switching can be avoided as much as possible. It should be understood that "(3)" shown in Table 1 is used for example. Since a larger n means a smaller flickering phenomenon, but its power consumption is greater, n can be set according to actual conditions, and the embodiment of the present application is not limited to 3.

[0143] It can be seen from Table 1 above that the refresh rate queues corresponding to serial numbers 2, 3, 4, 7, 8, and 9 are the first type of refresh rate queues, and the refresh rate queues corresponding to serial numbers 1, 5, 6, and 10 are the second type of refresh rate queues. Among them, because the refresh rate is directly reduced from 120Hz to 60Hz, the display screen will not flicker. Therefore, when the display frame rate is 120Hz and the minimum refresh rate is 60Hz, the refresh rate queue configured for DDIC can be directly configured as the second type of refresh rate queue with a fixed refresh rate of 60Hz (corresponding to serial number 1). Similarly, when the display frame rate is 120Hz and the minimum refresh rate is less than 60Hz, when the first type of refresh rate queue is configured for DDIC, the first refresh rate (SEQ1) can be set directly to 60H instead of 120Hz (corresponding to serial numbers 2, 3, and 4). That is, when the first type of refresh rate queue is configured, the first refresh rate is set to be less than the display frame rate.

[0144] In some embodiments, it is not suitable to configure the refresh rate queue when the screen is not initialized, the screen is in always on display (AOD) mode or text-based user interface (TUI) mode.

[0145] Based on this, before the display driver configures the first refresh rate queue for DDIC, or before the display driver configures the second refresh rate queue for DDIC, the display driver needs to make sure that the display screen corresponding to DDIC has been initialized and the display screen is not currently in AOD mode and TUI mode.

[0146] Specifically, before the display driver configures the first refresh rate queue or the second refresh rate queue for DDIC, the display driver further determines whether the display screen corresponding to DDIC is initialized and whether the display screen is currently in AOD mode and TUI mode. If the display screen has been initialized and the display screen is not in AOD mode and TUI mode, the display driver enters the process of configuring the first refresh rate queue or the second refresh rate queue for DDIC. Figure 7 , which is a flowchart of an image display method provided in an embodiment of the present application.

[0147] In some embodiments, when the display driver obtains the new display frame rate and / or minimum refresh rate of the APP, the refresh rate queue SEQ configured for the DDIC should also be updated due to the change in the display frame rate and / or minimum refresh rate. Therefore, the display driver needs to reconfigure a new refresh rate queue for the DDIC based on the new display frame rate and / or minimum refresh rate.

[0148] Specifically, based on different types of refresh rate queues, refresh rate switching includes switching from the first type of refresh rate queue to the second type of refresh rate queue, and switching from the second type of refresh rate queue to the first type of refresh rate queue. At the same time, based on different display frame rates or minimum refresh rates, there are different first type refresh rate queues, or different second type refresh rate queues. Therefore, it also includes switching between different first type refresh rate queues, and switching between different second type refresh rate queues.

[0149] Exemplarily, taking the above Table 1 as an example, the refresh rate queue of DDIC is switched from the refresh rate queue corresponding to sequence number 2 to the refresh rate queue corresponding to sequence number 3, that is, switching between different first-class refresh rate queues. Switching the refresh rate queue of DDIC from the refresh rate queue corresponding to sequence number 2 to the refresh rate queue corresponding to sequence number 5 is switching from the first-class refresh rate queue to the second-class refresh rate queue. Switching the refresh rate queue of DDIC from the refresh rate queue corresponding to sequence number 5 to the refresh rate queue corresponding to sequence number 6 is switching between different second-class refresh rate queues. Switching the refresh rate queue of DDIC from the refresh rate queue corresponding to sequence number 5 to the refresh rate queue corresponding to sequence number 2 is switching from the second-class refresh rate queue to the first-class refresh rate queue.

[0150] Furthermore, when the display driver updates the refresh rate queue configuration for the DDIC, a step can be added to determine whether the refresh rate queue that needs to be updated is the same as the refresh rate queue currently applied by the DDIC. If it is determined that the two refresh rate queues are different, the display driver controls the DDIC to switch to a new refresh rate queue. If it is determined that the two refresh rate queues are the same, the display driver can end the configuration process to save certain resources.

[0151] In some embodiments, due to human vision problems, the flickering phenomenon of the display screen will be more sensitive to the user when the display screen brightness is low or the ambient light brightness is low, and the flickering phenomenon will be more obvious. Therefore, in order to avoid serious flickering phenomenon when the display screen brightness is low or the ambient light brightness is low, the minimum refresh rate can be determined by the refresh rate decision module based on the display screen brightness and the ambient light brightness. Among them, the ambient light brightness can be detected by an ambient light sensor (sensor).

[0152] At the same time, because of the existing electronic equipment software structure (reference Figure 6 ), if the refresh rate decision module determines the minimum refresh rate in the embodiment of the present application, the minimum refresh rate needs to be sent to the display driver via SF and HWC, which will affect the implementation of the adaptive refresh rate method in the embodiment of the present application.

[0153] Exemplary, reference Figure 8 , Figure 8 So Figure 6The first DDIC in the software structure shown is an example of the system-level interaction process of the image display method. Taking the desktop as an example, the image display interaction process includes: the refresh rate decision module first obtains the required display frame rate of 120Hz from the APP, and determines the minimum refresh rate of 1Hz according to the brightness of the display screen and the brightness of the ambient light. After that, the refresh rate decision module needs to determine whether to send the display frame rate of 120Hz to SF or send the minimum refresh rate of 1Hz to SF by judging whether the application is operated (for example, whether the desktop is sliding). SF then notifies HWC to send the issued display frame rate of 120Hz or the minimum refresh rate of 1Hz to the display driver. The display driver then controls DDIC to refresh the image according to the issued display frame rate of 120Hz or the minimum refresh rate of 1Hz. It can be seen that according to the existing electronic equipment software structure, when it is necessary to consider the display brightness and ambient light brightness to control the refresh rate of DDIC, it can only be based on the priority of actual needs. 120Hz or 1Hz corresponding switching instructions are sent to DDIC to control DDIC to switch the refresh rate to 120Hz or 1Hz. The display driver cannot obtain the display frame rate and the minimum refresh rate from the refresh rate decision module at the same time, which is obviously contrary to the image display method of the embodiment of the present application, thereby affecting the implementation of the image display method of the embodiment of the present application.

[0154] Therefore, in order for the display driver to receive the display frame rate and the minimum refresh rate from the refresh rate decision module at the same time, the embodiment of the present application adds a hardware abstraction layer interface definition language (HAL interface definition language, HIDL) interface, and the refresh rate decision module calls the HIDL interface to notify the display driver of the currently determined minimum refresh rate.

[0155] Based on this, the display driver of the electronic device obtains the display frame rate and the minimum refresh rate of the application, including: the refresh rate decision module of the electronic device obtains the display frame rate of the application, and determines the minimum refresh rate according to the brightness of the display screen and the ambient light brightness; the refresh rate decision module sends the display frame rate to the display driver through the layer synthesis service and the hardware writer, and sends the minimum refresh rate to the display driver through the hardware abstraction layer interface.

[0156] refer to Fig. 9 , is a block diagram of the improved software structure of the electronic device 100 provided in the embodiment of the present application, Fig. 9 At the same time, a schematic diagram of the improved system-level interaction in the embodiment of the present application is shown by taking the first DDIC as an example.

[0157] Specifically, the embodiments of the present application are mainly Figure 8Based on the software architecture shown, a refresh rate channel is added by adding a HIDL interface. That is, the display driver is notified of the minimum refresh rate through the HIDL interface, so that the display driver can receive the display frame rate and the minimum refresh rate of the application at the same time. Furthermore, the display driver can configure the first refresh rate queue or the second refresh rate for the DDIC based on the display frame rate and the minimum refresh rate.

[0158] It can be seen that the improved solution of the embodiment of the present application can determine the minimum refresh rate based on the actual display screen brightness and the ambient light brightness by the refresh rate decision module, and then send the minimum refresh rate to the display driver through a new path, so as to achieve refresh rate adaptation while avoiding display flickering under low display screen brightness or low ambient light.

[0159] In some embodiments, the minimum refresh rate is determined based on the display screen brightness and the ambient light brightness, including: when the display screen brightness is greater than or equal to 50 nits and the ambient light brightness is greater than or equal to 50 lux, the minimum refresh rate is determined to be 10 Hz or 30 Hz; when the display screen brightness is greater than or equal to 300 nits and the ambient light brightness is greater than or equal to 50 lux, the minimum refresh rate is determined to be 1 Hz; when the display screen brightness is less than 50 nits or the ambient light brightness is less than 50 nits, the minimum refresh rate is determined to be 60 Hz.

[0160] Specifically, the minimum refresh rate is determined based on different display screen brightness and ambient light brightness, wherein the ambient light brightness can be detected by an ambient light sensor. When the display screen brightness is ≥50nit and the ambient light brightness is greater than or equal to 50lux, it means that the display screen refresh rate can be adapted to 10Hz or 30Hz at the lowest, that is, the minimum refresh rate can be 10Hz or 30Hz. When the display screen brightness is ≥3000nit and the ambient light brightness is greater than or equal to 50lux, it means that the display screen refresh rate can be adapted to 1Hz at the lowest, that is, the minimum refresh rate is equal to 1Hz. Except for the above two cases, that is, when the display screen brightness is ≤5nit or the ambient light is ≤50lux, the minimum refresh rate is equal to 60Hz. Therefore, the embodiment of the present application determines the minimum refresh rate by obtaining the specific display screen brightness and detecting the actual ambient light brightness, which can ensure that when the refresh rate queue SEQ configured based on the minimum refresh rate controls the DDIC to refresh the picture, the problem of display flickering can be avoided.

[0161] Another embodiment of the present application provides an electronic device, in which multiple applications are installed. The electronic device includes: a display screen, a memory, a display driver chip, and one or more processors. The display screen, the memory, and the display driver chip are coupled to the processor. Exemplarily, the display screen, the memory, and the display driver chip can be coupled to the processor via a bus.

[0162] One or more computer programs are stored in the memory. When the processor executes the computer programs, the electronic device can implement the image display method described in any of the above embodiments. The structure of the electronic device can refer to Figure 5 The structure of the electronic device 100 is shown. Specifically, the display driver chip is used to refresh the image to the display screen according to the refresh rate in the first refresh rate queue or the second refresh rate queue.

[0163] Another embodiment of the present application provides a chip system, which may include the above-mentioned display driver chip. Fig.10 As shown, the chip system includes at least one processor and at least one interface circuit.

[0164] The processor and the interface circuit can be interconnected through lines. For example, the interface circuit can be used to receive signals from other devices (such as a memory of an electronic device, a processor of an electronic device). For another example, the interface circuit can be used to send signals to other devices (such as a display screen of an electronic device) (such as brushing a picture to the display screen of an electronic device). Exemplarily, the interface circuit can read the instructions stored in the memory and send the instructions to the processor of the chip system. When the instructions are executed by the processor of the chip system, the electronic device can be used to execute the above-mentioned embodiment according to the refresh rate in the first refresh rate queue or the second refresh rate queue to brush the picture to the display screen of the electronic device. Of course, the chip system may also include other discrete devices, which are not specifically limited in the embodiments of the present application.

[0165] Another embodiment of the present application provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor in an electronic device, the electronic device implements the image display method described in any of the above embodiments.

[0166] The embodiment of the present application also provides a computer program product. When the computer program product is run on a computer, the computer is enabled to execute each function or step in the above method embodiment.

[0167] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0168] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0169] The units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0170] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0171] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium, including several instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to perform all or part of the steps of the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code.

[0172] The above contents are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application shall be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. An image display method, characterized in that: Applied to an electronic device, the electronic device includes a display screen, and a plurality of application programs are installed in the electronic device, the method includes: The display driver of the electronic device obtains the display frame rate of the application running in the foreground and the minimum refresh rate of the display screen; In the case where the display frame rate is greater than the minimum refresh rate, the display driver configures a first type of refresh rate queue for the display driver chip of the electronic device; wherein the first type of refresh rate queue includes at least two refresh rates and is arranged from high to low, and each of the refresh rates is greater than or equal to the display frame rate and less than or equal to the minimum refresh rate; The display driver controls the display driver chip to refresh images to the display screen according to a first refresh rate in the first refresh rate queue; When the SF of the electronic device does not send the image to the display driver, the display driver controls the display driver chip to refresh the image to the display screen at the next refresh rate in the first refresh rate queue according to the arrangement order of the refresh rates in the first refresh rate queue.

2. The method according to claim 1, characterized in that The method further comprises: When the display frame rate is equal to the minimum refresh rate, the display driver configures a second refresh rate queue for the display driver chip of the electronic device; wherein the last refresh rate of the second refresh rate queue is equal to the display frame rate, and the refresh rates before the last refresh rate are all empty; The display driver controls the display driver chip to refresh images to the display screen according to the last refresh rate in the second refresh rate queue.

3. The method according to claim 1 or 2, characterized in that: The obtaining of the display frame rate of the application running in the foreground and the minimum refresh rate of the display screen includes: The refresh rate decision module of the application framework layer in the electronic device obtains the display frame rate of the foreground running application, and determines the minimum refresh rate according to the display brightness of the display screen and the ambient light brightness; The refresh rate decision module sends the display frame rate to the display driver through the SF and HWC, and sends the minimum refresh rate to the display driver through the hardware abstraction layer interface.

4. The method according to claim 3, characterized in that The determining the minimum refresh rate according to the display screen brightness and the ambient light brightness of the display screen includes: When the display screen brightness is greater than or equal to 50 nits and the ambient light brightness is greater than or equal to 50 lux, determining the minimum refresh rate to be 10 Hz or 30 Hz; When the display screen brightness is greater than or equal to 300 nits and the ambient light brightness is greater than or equal to 50 lux, determining that the minimum refresh rate is 1 Hz; When the display screen brightness is less than 50 nits or the ambient light brightness is less than 50 lux, the minimum refresh rate is determined to be 60 Hz.

5. The method according to claim 1, characterized in that After the display driver chip refreshes the image to the display screen according to the refresh rate in the first refresh rate queue, the method further includes: When the SF resumes sending images to the display driver, the display driver controls the display driver chip to refresh images to the display screen according to the first refresh rate in the first refresh rate queue.

6. The method according to any one of claims 1 to 5, characterized in that The display driver chip includes a first display driver chip with a TEI function; the method further includes: When the display driver configures the first type of refresh rate queue for the first display driver chip, it simultaneously sends instructions to control the first display driver chip to turn off the TE signal shielding function and control the TEI function initialization.

7. The method according to any one of claims 1 to 5, characterized in that The display driver chip includes a second display driver chip without a TEI function; and the method further includes: When the display driver configures the first type of refresh rate queue for the second display driver chip, it simultaneously sends instructions to control the second display driver chip to turn off the TE signal shielding function, and reports the TE signal generated by the second display driver chip to the SF based on the actual working frame rate of the SF.

8. The method according to claim 2, characterized in that: The method further comprises: When the display driver configures the second type of refresh rate queue for the display driver chip, an instruction is simultaneously issued to control the display driver chip to turn on the TE signal shielding function.

9. The method according to claim 1 or 2, characterized in that: When the display frame rate is greater than the minimum refresh rate, the display driver configures a first type of refresh rate queue for a display driver chip of the electronic device, including: In the case where the display frame rate is greater than the minimum refresh rate, and in the case where the display frame rate is not equal to 120 Hz and the minimum refresh rate is not equal to 60 Hz, the display driver configures a first type of refresh rate queue for the display driver chip of the electronic device, wherein a first refresh rate of the first type of refresh rate queue is less than or equal to the display frame rate, and a refresh rate after the first refresh rate is empty, or a refresh rate after the first refresh rate is less than the display frame rate and greater than or equal to the minimum refresh rate; When the display frame rate is greater than the minimum refresh rate, and when the display frame rate is equal to 120 Hz and the minimum refresh rate is equal to 60 Hz, the display driver configures a second type of refresh rate queue for the display driver chip of the electronic device, and the last refresh rate of the second type of refresh rate queue is equal to 60 Hz, and the refresh rates before the last refresh rate are all empty.

10. The method according to claim 9, characterized in that The display driver chip includes a first display driver chip with a TEI function, and the refresh rate queue length of the first display driver chip is 5; the display driver configures a first type of refresh rate queue for the first display driver chip, including: When the display frame rate is 120 Hz and the minimum refresh rate is 30 Hz, or when the display frame rate is 60 Hz and the minimum refresh rate is 30 Hz, the first refresh rate in the first refresh rate queue is set to 60 Hz, the last refresh rate is set to 30 Hz, and the remaining refresh rates are set to empty; When the display frame rate is 120 Hz and the minimum refresh rate is 10 Hz, or when the display frame rate is 60 Hz and the minimum refresh rate is 10 Hz, the first refresh rate in the first refresh rate queue is set to 60 Hz, the second refresh rate is set to 30 Hz, the third refresh rate is set to 20 Hz, the fourth refresh rate is set to null, and the fifth refresh rate is set to 10 Hz; When the display frame rate is 120Hz and the minimum refresh rate is 1Hz, or when the display frame rate is 60Hz and the minimum refresh rate is 1Hz, the first refresh rate in the first refresh rate queue is set to 60Hz, the second refresh rate is set to 30Hz, the third refresh rate is set to 20Hz, the fourth refresh rate is set to 10Hz, and the fifth refresh rate is set to 1Hz.

11. The method according to claim 9, characterized in that The display driver chip includes a second display driver chip without a TEI function, and the refresh rate queue length of the second display driver chip is 4; the display driver configures a first type of refresh rate queue for the second display driver chip, including: When the display frame rate is 120 Hz and the minimum refresh rate is 30 Hz, or when the display frame rate is 60 Hz and the minimum refresh rate is 30 Hz, the first refresh rate in the first refresh rate queue is set to 60 Hz, the last refresh rate is set to 30 Hz, and the remaining refresh rates are set to empty; When the display frame rate is 120 Hz and the minimum refresh rate is 10 Hz, or when the display frame rate is 60 Hz and the minimum refresh rate is 10 Hz, the first refresh rate in the first refresh rate queue is set to 60 Hz, the second refresh rate is set to 30 Hz, the third refresh rate is set to null, and the fourth refresh rate is set to 10 Hz; When the display frame rate is 120Hz and the minimum refresh rate is 1Hz, or when the display frame rate is 60Hz and the minimum refresh rate is 1Hz, the first refresh rate in the first refresh rate queue is set to 60Hz, the second refresh rate is set to 30Hz, the third refresh rate is set to 10Hz, and the fourth refresh rate is set to 1Hz.

12. The method according to claim 1 or 2, characterized in that: Before configuring a first type of refresh rate queue for a display driver chip of the electronic device when the display frame rate is greater than the minimum refresh rate, or configuring a second type of refresh rate queue for the display driver chip when the display frame rate is equal to the minimum refresh rate, the method further includes: The display driver determines that the display screen corresponding to the display driver chip has been initialized, and the display screen is not currently in an all-weather display mode and a text user interface mode.

13. The method according to any one of claims 1 to 12, characterized in that The application includes at least two running scenarios, and the display frame rates of the application in multiple running scenarios of the at least two running scenarios are different; The display driver of the electronic device obtains the display frame rate of the application program running in the foreground, including: The display driver obtains the display frame rate of the application in the current running scenario.

14. An electronic device, characterized in that: include: A display screen, a memory, a display driver chip, and one or more processors; the electronic device has multiple applications installed in it; The display screen, the memory, and the display driver chip are coupled to the processor; one or more computer program codes are stored in the memory, and the computer program codes include computer instructions; when the processor executes the computer instructions, the electronic device executes the image display method as described in any one of claims 1 to 13; the display driver chip is used to refresh the image to the display screen according to the refresh rate in the first refresh rate queue or the second refresh rate queue.

15. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor of an electronic device, the electronic device executes the image display method according to any one of claims 1 to 13.

Images