Content display method and related apparatus

Abstract

The present application relates to the field of terminals, and discloses a content display method and a related apparatus. The method may comprise: an electronic device can identify an ROI on an image frame; if the area of the ROI is smaller than the area of a display screen, the electronic device can calculate, on the basis of the current refresh rate of the display screen and the ratio of the area of the display screen to the area of the ROI, a refresh rate corresponding to the ROI; and then the electronic device can perform a partial refresh operation at the calculated refresh rate on an ROI display region corresponding to the ROI on the display screen. The refresh rate corresponding to the ROI is greater than the current refresh rate of the display screen. In this way, the refresh efficiency of the display screen can be improved, and the power consumption of the electronic device can be reduced while the display quality and display stability of image frames are improved.

Description

Content display method and related devices

[0001] This application claims priority to Chinese Patent Application No. 202410940570.2, filed on July 12, 2024, entitled “Content Display Method and Related Apparatus”, the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application relates to the field of terminals, and more particularly to a content display method and related apparatus. Background Technology

[0003] The image display quality of an electronic device's screen is closely related to its refresh rate. The refresh rate can be understood as the number of times the screen updates its display per second. A higher refresh rate results in a more stable, natural, and clearer image. Different usage scenarios have different requirements for the screen's refresh rate. For example, when watching videos on an electronic device, a high refresh rate (such as 120Hz) makes scene transitions smoother and improves the viewing experience; conversely, when browsing the web on an electronic device, a low refresh rate (such as 60Hz) is sufficient for current display needs, resulting in lower power consumption compared to a higher refresh rate.

[0004] However, when electronic devices are used in different scenarios at the same time, such as when a user is watching a video while browsing the web, how to set the refresh rate of the display so that the electronic device can meet the display requirements while reducing power consumption has become an urgent problem to be solved. Summary of the Invention

[0005] This application provides a content display method and related apparatus, which improves the refresh efficiency of the ROI area on the display screen, enhances the image frame display effect and display stability, and reduces the power consumption of electronic devices.

[0006] Firstly, this application provides a content display method applied to an electronic device. The electronic device includes a display screen, which includes a first region and a second region. The method includes: refreshing and displaying first content in the first region at a first refresh frequency; and refreshing and displaying second content in the second region at a second refresh frequency. The first refresh frequency is less than or equal to the refresh frequency of the display screen, the second refresh frequency is greater than the refresh frequency of the display screen, and the first region and the second region are not the same. This improves the refresh efficiency of the ROI region on the display screen, enhancing image frame display quality and stability while reducing the power consumption of the electronic device.

[0007] In one possible implementation, the electronic device further includes a first application and a second application, the first content corresponding to the first application and the second content corresponding to the second application.

[0008] In one possible implementation, the first application is a news application, and the second application is an instant messaging application. In this way, when content from different applications is displayed on the screen, a high refresh rate can be set for applications with rapidly changing image content, improving image frame display quality and stability while also reducing the power consumption of the electronic device.

[0009] In one possible implementation, the first region and the second region have the same area.

[0010] In one possible implementation, the sum of the areas of the first region and the second region is equal to the area of ​​the display screen.

[0011] In one possible implementation, the display has a refresh rate of 120Hz, the first refresh rate is less than or equal to 30Hz, and the second refresh rate is 240Hz.

[0012] In one possible implementation, the period of the hardware Vsync signal is 4.17 milliseconds.

[0013] In one possible implementation, the electronic device further includes a third application, with the first content and the second content corresponding to the third application. In this way, when the display screen shows the content of the same application, a high refresh rate can be set for display areas where image content changes rapidly, improving image frame display quality and stability while also reducing the power consumption of the electronic device.

[0014] In one possible implementation, the third application is a stylus application used to receive and respond to input from a stylus or finger, and to display the corresponding handwriting on the display screen.

[0015] In one possible implementation, the area of ​​the first region is larger than the area of ​​the second region.

[0016] In one possible implementation, the sum of the areas of the first region and the second region is equal to the area of ​​the display screen.

[0017] In one possible implementation, the second refresh rate is related to the refresh rate of the display screen. This allows for convenient and quick calculation of the second refresh rate.

[0018] In one possible implementation, the second refresh rate is determined by the ratio of the refresh rate of the display screen, the area of ​​the display screen, and the area of ​​the second region.

[0019] In one possible implementation, before refreshing and displaying the second content in a second area of ​​the display screen at a second refresh rate, the method includes: determining a first Region of Interest (ROI) of the Nth frame image; determining whether the area of ​​the second area corresponding to the first ROI on the display screen is smaller than the area of ​​the display screen; if the area of ​​the second area is smaller than the area of ​​the display screen, determining the second refresh rate based on the refresh rate of the display screen, the area of ​​the display screen, and the area of ​​the second area. This allows for more precise determination of different refresh rates corresponding to different areas when the ROI changes, making refresh rate adjustments more flexible.

[0020] In one possible implementation, if the area of ​​the second region is smaller than the area of ​​the display screen, the second refresh rate is determined based on the refresh rate of the display screen and the ratio of the area of ​​the display screen to the area of ​​the second region. Specifically, this includes: when the area of ​​the second region is smaller than the area of ​​the display screen, determining whether the first ROI region and the second ROI region in the (N-1)th frame image are the same. If the first ROI region and the second ROI region are not the same, the second refresh rate is determined based on the refresh rate of the display screen and the ratio of the area of ​​the display screen to the area of ​​the second region.

[0021] In one possible implementation, the second content is the content of the first ROI region.

[0022] In one possible implementation, the first ROI region and the second ROI region are not the same, including one or more of the following: the location of the first ROI region and the location of the second ROI region are not the same, and the size of the first ROI region and the size of the second ROI region are not the same.

[0023] Secondly, embodiments of this application provide an electronic device, including: a display screen, one or more processors, and one or more memories. The one or more processors are coupled to the display screen and the one or more memories. The one or more memories are used to store computer instructions, and the one or more processors are used to execute the computer instructions to cause the electronic device to perform the method as described in any of the possible implementations of the first aspect above. This can improve the refresh efficiency of the ROI area on the display screen, enhancing image frame display effects and display stability while also reducing the power consumption of the electronic device.

[0024] Thirdly, embodiments of this application provide a chip system applied to an electronic device. The chip system includes a processing circuit and an interface circuit. The interface circuit receives code instructions and transmits them to the processing circuit. The processing circuit executes the code instructions to cause the electronic device to perform the method described in any of the possible implementations of the first aspect above. This improves the refresh efficiency of the ROI area on the display screen, enhancing image frame display quality and stability while reducing the power consumption of the electronic device.

[0025] Fourthly, embodiments of this application provide a computer-readable storage medium including instructions, characterized in that, when the instructions are executed on an electronic device, the electronic device performs the method as described in any of the possible implementations of the first aspect above. This can improve the refresh efficiency of the ROI area on the display screen, enhancing image frame display quality and stability while reducing the power consumption of the electronic device.

[0026] Fifthly, embodiments of this application provide a computer program product that, when run on an electronic device, causes the electronic device to perform the method described in any of the possible implementations of the first aspect above. This can improve the refresh efficiency of the ROI area on the display screen, enhancing image frame display quality and stability while also reducing the power consumption of the electronic device. Attached Figure Description

[0027] Figure 1 is a schematic diagram of a DDIC-driven display screen provided in an embodiment of this application;

[0028] Figures 2A-2C are schematic diagrams of a method for controlling panel refresh and display of images using DDIC according to an embodiment of this application;

[0029] Figures 3A-3C are schematic diagrams illustrating a method for adjusting the refresh rate of a display screen according to an embodiment of this application;

[0030] Figure 3D is a schematic diagram of an ROI region and an ROI display region provided in an embodiment of this application;

[0031] Figures 4A-4F illustrate a set of application scenarios for the content display method provided in the embodiments of this application;

[0032] Figure 5A is a flowchart illustrating a content display method provided in an embodiment of this application;

[0033] Figures 5B-5C are a set of user interface diagrams provided in the embodiments of this application;

[0034] Figure 5D is a schematic diagram of a partial refresh provided in an embodiment of this application;

[0035] Figure 5E is a schematic diagram of a power loss comparison provided by an embodiment of this application;

[0036] Figure 5F is a schematic diagram of a refresh rate comparison provided by an embodiment of this application;

[0037] Figure 5G is a schematic diagram comparing the refresh rate and overclocked refresh rate of a display screen according to an embodiment of this application;

[0038] Figure 6 is a schematic diagram of the device architecture of an electronic device provided in an embodiment of this application;

[0039] Figure 7 is a schematic diagram of module interaction provided in an embodiment of this application;

[0040] Figure 8 is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0041] The terminology used in the following embodiments of this application is for the purpose of describing particular embodiments only and is not intended to be limiting of this application. As used in the specification and appended claims of this application, the singular expressions “a,” “an,” “the,” “the,” “the,” and “this” are intended to include the plural expressions as well, unless the context clearly indicates otherwise. It should also be understood that the term “and / or” as used in this application refers to any or all possible combinations including one or more of the listed items. In the embodiments of this application, the terms “first” and “second” are used for descriptive purposes only and should not be construed as implying relative importance or implicitly indicating the number of indicated technical features. Thus, a feature defined as “first” or “second” may explicitly or implicitly include one or more of that feature, and in the description of the embodiments of this application, unless otherwise stated, “a plurality” means two or more.

[0042] Figure 1 is a schematic diagram of a DDIC-driven display screen provided in an embodiment of this application.

[0043] As shown in Figure 1, the display driver integrated circuit (DDIC) on an electronic device can be positioned on the side of the display screen (also known as a screen, touchscreen, etc.) to drive the display content. When the electronic device displays an application interface in full screen on the display screen, or when the electronic device displays multiple application interfaces in split-screen mode, the DDIC can control the display screen (also called a panel) to refresh the displayed image at the same refresh rate. That is, the entire display area (referred to as the display screen) uses the same refresh rate for full-screen refresh. The DDIC can also control the panel to refresh the displayed image at different refresh rates for different areas of the display screen. For example, the DDIC can control the panel to refresh the image in area A of the display screen at refresh rate A, and control the panel to refresh the image in area B of the display screen at refresh rate B, where refresh rates A and B are different. The DDIC can also control the panel to refresh the image in only certain areas of the display screen. For example, the DDIC can control the panel to refresh the image in area A of the display screen, but during the process of refreshing the image in area A, the DDIC does not control the panel to refresh the image in area B of the display screen. In other words, this application does not impose any restrictions on the refresh method of the DDIC control panel.

[0044] In this application embodiment, the "refresh frequency" refers to the "refresh frequency of the display screen," which can be understood as the number of times the display screen refreshes per second (i.e., how many frames of images are displayed per second), and the unit is Hertz (Hz). Depending on the fixed parameters of the electronic device's hardware, the refresh frequency can generally be 60Hz, 90Hz, 120Hz, etc.

[0045] In one possible implementation, the DDIC controls the panel to refresh the displayed image; that is, the DDIC scans the pixels on the display screen. This can be understood as the DDIC simultaneously inputting current to both the horizontal and vertical ports of the display screen, causing the pixels to light up under the current excitation. The pixel scanning direction can be from top to bottom and from left to right. In another possible implementation, the DDIC is packaged in a chip-on-flex (COF) package. In yet another possible implementation, when the display screen's resolution exceeds a resolution threshold, electronic devices often configure multiple Display Serial Interfaces (DSIs) to reduce the latency of image data transmission to the DDIC, thus avoiding frame drops and stuttering.

[0046] In this embodiment of the application, Figure 1 is only used as an example to explain the application and does not constitute a limitation on the application.

[0047] Figures 2A-2C are schematic diagrams of a method for controlling panel refresh and display of images using DDIC according to an embodiment of this application.

[0048] As shown in Figure 2A, multiple pixels can be neatly arranged on the display screen. When the application processor (AP) writes the generated image frame (which can be simply referred to as the image) into the graphics random access memory (GRAM) in the DDIC, the DDIC can read the image frame stored in the GRAM and display the content corresponding to the image frame on the display screen by scanning the pixels on the display screen. In this embodiment, the process of the DDIC scanning the pixels on the display screen to display the image can be understood as the process of refreshing the displayed image.

[0049] As shown in Figure 2B, when the DDIC controls the panel to refresh the displayed image, the DDIC can scan the pixels on the screen line by line in a "Z" shape from left to right and from top to bottom, sequentially displaying every pixel of the entire screen. However, this process is so fast that the human eye cannot perceive the change. Taking a 60Hz refresh rate screen as an example, this process is approximately 1000 / 60 ≈ 16ms.

[0050] As shown in Figure 2C, the DDIC can scan the pixels on the display screen based on the source signal and the vertical synchronization (Vsync) signal (also known as the hardware Vsync signal) generated by the DDIC. Wherein:

[0051] 1) The source signal is generated by internal components of the DDIC. Its frequency is typically set at the factory, and this factory-set source signal frequency can be called the reference frequency (or base refresh rate). The source signal frequency is related to the refresh rate of the entire display area; in other words, the refresh rate of the entire display area is determined by the reference frequency, but not necessarily the same (the refresh rate of the entire display area is also controlled by the hardware Vsync signal period). Generally, the reference frequency can be understood as the highest frequency at which the displayed content is refreshed across the entire display area. The reference frequency of the source signal can be set to 120Hz, 144Hz, etc. The refresh rate of the entire display area can be referred to as the display's refresh rate.

[0052] 2) The hardware Vsync signal is generated by internal components of the DDIC and can be used to control the refresh rate of the display screen. The period of the hardware Vsync signal can be less than or equal to the refresh rate of the display screen. The refresh rate of the display screen is determined by both the hardware Vsync signal and the Source signal. When the falling edge of the hardware Vsync signal coincides with the rising edge of the Source signal, the DDIC begins scanning the first pixel at the top left corner of the display screen. For example, the time between two falling edges of the hardware Vsync signal can be the time required to scan the entire display area of ​​the screen once (i.e., scan one frame of image content). Simultaneously, the period of the hardware Vsync signal can also be reported by the DDIC to the AP, triggering the AP to simulate and generate a software Vsync signal based on the frequency of the hardware Vsync signal. The AP then draws and renders the image frame based on the frequency of the software Vsync signal and writes the image frame into the GRAM. When the rising edge of the hardware Vsync signal arrives, the AP writes the image frame into the GRAM.

[0053] In this embodiment of the application, Figures 2A-2C are merely illustrative of the application and do not constitute any limitation.

[0054] Figures 3A-3C are schematic diagrams illustrating a method for adjusting the refresh rate of a display screen according to an embodiment of this application.

[0055] In one possible implementation, the DDIC can adjust the hardware Vsync cycle based on the frequency of the Source signal through frameskipping. In this embodiment, frameskipping refers to the DDIC controlling the panel to refresh and display the image at specified intervals of the Source signal. For example:

[0056] As shown in Figure 3A, each Source signal generated by the DDIC is a high level. Each time a high-level Source signal is generated, the DDIC controls the panel to refresh and display the image. The frequency of the hardware Vsync signal can be the same as the frequency of the Source signal. For example, if the Source signal frequency is 120Hz, the hardware Vsync signal frequency is also 120Hz, and the duration of one hardware Vsync signal is the same as the duration of one Source signal. With the first high-level Source signal, the DDIC controls the panel to refresh and display image frame 1; with the second high-level Source signal, the DDIC controls the panel to refresh and display image frame 2; with the third high-level Source signal, the DDIC controls the panel to refresh and display image frame 3; and with the fourth high-level Source signal, the DDIC controls the panel to refresh and display image frame 4.

[0057] As shown in Figure 3B, when the DDIC generates two Source signals, one of the Source signals is high. When the Source signal is high, the DDIC controls the panel to refresh the displayed image once. The frequency of the hardware Vsync signal can be the same as the frequency of the Source signal. For example, if the frequency of the Source signal is 60Hz, then the frequency of the hardware Vsync signal is 60Hz, and the duration of one hardware Vsync signal is the duration of one Source signal. During the first high-level Source signal, the DDIC can control the panel to refresh and display image frame 1; during the second low-level Source signal, the DDIC does not control the panel to refresh and display the image, and image frame 1 remains displayed on the screen; during the third high-level Source signal, the DDIC can control the panel to refresh and display image frame 2; during the fourth low-level Source signal, the DDIC does not control the panel to refresh and display the image, and image frame 2 remains displayed on the screen.

[0058] As shown in Figure 3C, when the DDIC generates four Source signals, one of them is high. When a Source signal is high, the DDIC controls the panel to refresh the displayed image once. In this case, the frequency of the hardware Vsync signal can be the same as the frequency of the Source signal. For example, if the Source signal frequency is 30Hz, then the hardware Vsync signal frequency is 30Hz, and the duration of one hardware Vsync signal is the same as the duration of one Source signal. During the first high-level Source signal, the DDIC can control the panel to refresh and display image frame 1; during the second low-level Source signal, the third low-level Source signal, and the fourth low-level Source signal, the DDIC does not control the panel to refresh the displayed image, and image frame 1 remains displayed on the screen.

[0059] In this embodiment of the application, "refreshing the display image" as described in Figures 3A-3C refers to refreshing the display image for the entire display area of ​​the screen, that is, scanning the pixels of the entire display area of ​​the screen to display the image. Figures 3A-3C are only used to illustrate this application and do not constitute any limitation. In subsequent embodiments, the entire display area of ​​the screen may be simply referred to as the screen.

[0060] As can be seen from the description of the embodiments shown in Figures 3A-3C above, although this method can adjust the refresh rate of the display screen, its adjustment range is below the reference frequency, and it cannot adjust the refresh rate to exceed the reference frequency; that is, the adjusted refresh rate is less than the reference frequency. Furthermore, since the DDIC can only refresh the displayed image when the falling edge of the hardware Vsync signal and the rising edge of the Source signal coincide, this method can only achieve a refresh rate divisible by the frequency of the Source signal, and its adjustment method is not flexible.

[0061] Therefore, this application provides a content display method in which an electronic device can identify a designated region (also called a region of interest, ROI) on an image frame. If the ROI is smaller than the area of ​​the display screen, the electronic device can calculate the refresh rate corresponding to the ROI based on the current refresh rate of the display screen, the ratio of the display screen area to the ROI area area; that is, the refresh rate corresponding to the ROI is related to the current refresh rate of the display screen. Then, the electronic device can perform a partial refresh operation on the display area (also called the ROI display area) corresponding to the ROI on the display screen based on the calculated refresh rate. The refresh rate corresponding to the ROI is greater than the current refresh rate of the display screen; therefore, the refresh rate corresponding to the ROI can also be called the overclocked refresh rate. It is understood that the refresh rate corresponding to the ROI is also the refresh rate corresponding to the ROI display area, and the refresh rate of non-ROI areas can be lower than the refresh rate of the ROI. In this embodiment, "performing a partial refresh operation on the ROI display area based on an overclocked refresh rate" means that the electronic device only scans the pixels on the ROI display area based on the overclocked refresh rate, refreshing the content of the ROI area in the displayed image within the ROI display area, but does not scan the pixels on non-ROI display areas based on the overclocked refresh rate. The ROI display area can be used to display the content of the ROI area in an image frame.

[0062] In this embodiment of the application, "refresh frequency of the display screen" can be understood as the refresh frequency when refreshing the displayed image on the entire display area of ​​the display screen.

[0063] Figure 3D is a schematic diagram of an ROI region and an ROI display region provided in this application.

[0064] As shown in Figure 3D, electronic devices can identify Regions of Interest (ROIs) in an image frame. When the electronic device refreshes the content of the ROI region onto the display screen for display, the area where the content of the ROI region is located on the display screen is the ROI display area.

[0065] Implementing the content display method provided in this application can improve the refresh efficiency of the display screen, enhance the image frame display quality and display stability, and reduce the power consumption of electronic devices.

[0066] Figures 4A-4F illustrate a set of application scenarios for the content display method provided in the embodiments of this application.

[0067] For example, as shown in Figure 4A, an electronic device can be equipped with a stylus, and the electronic device and the stylus can interact. When the stylus touches or writes on the display screen of the electronic device, the electronic device can display the handwriting at the touch / writing location based on the change in the capacitance value on the display screen. The area where the handwriting is located in the image frame can be considered a Region of Interest (ROI), and the area where the handwriting is displayed on the display screen can be considered an ROI display area. In Figure 4A, this ROI display area is referred to as Region 1. The electronic device can identify and determine the area of ​​the ROI. If the area of ​​the ROI is smaller than the area of ​​the display screen, specifically one-third of the display screen area, the electronic device can calculate the refresh frequency corresponding to the ROI based on the current refresh rate of the display screen, the ratio of the display screen area to the ROI area area, and perform a local refresh operation on Region 1 according to the refresh frequency corresponding to the ROI to refresh the displayed handwriting. The refresh frequency corresponding to the ROI is greater than the current refresh rate of the display screen. For example, if the current refresh rate of the display screen is 120Hz, the refresh rate corresponding to the ROI is 360Hz.

[0068] For example, as shown in Figures 4B-4C, the electronic device can be a foldable screen electronic device. The display screen of the electronic device is a foldable screen, which can be divided into screen A and screen B along the folding edge. Screen A corresponds to display area A, and screen B corresponds to display area B. Display areas A and B can display content from different applications. For example, display area A can display WeChat. Application interface 110, display area B can display news application interface 120.

[0069] As shown in Figure 4C, if the user swipes WeChat Application interface 110, then WeChat The area where the content on application interface 110 is located in the image frame is considered the Region of Interest (ROI), and display area A is the ROI display area. At this time, the area where the content on news application interface 120 is located in the image frame is a non-ROI area. The electronic device can identify the area of ​​the ROI area. If the area of ​​the ROI area is smaller than the display screen area, specifically half the display screen area, the electronic device can calculate the refresh frequency A corresponding to the ROI area based on the current display screen refresh rate, the ratio of the display screen area to the ROI area area, and perform a partial refresh operation on display area A according to this refresh frequency A. At this time, the refresh frequency A is greater than the current display screen refresh rate. For example, if the current display screen refresh rate is 120Hz, then refresh frequency A (e.g., 240Hz) is greater than 120Hz. Since display area B is a non-ROI display area, the refresh frequency B of display area B can be less than or equal to the current display screen refresh rate of 120Hz, and the refresh frequency B of display area B (e.g., 10Hz) is less than the refresh frequency A of display area A.

[0070] As shown in Figure 4D, if the user swipes the news application interface 120, the area where the content on the news application interface 120 is located in the image frame is considered the ROI region, and display area B is the ROI display area. At this time, WeChat... The content on application interface 110 is located in a non-ROI region within the image frame. The electronic device can identify the area of ​​the ROI region. If the area of ​​the ROI region is smaller than the display area, specifically half the display area, the electronic device can calculate the refresh frequency B corresponding to the ROI region based on the current display refresh rate, the ratio of the display area to the ROI region area, and perform a partial refresh operation on display area B according to this refresh frequency B. In this case, the refresh frequency B is greater than the current display refresh rate. For example, if the current display refresh rate is 120Hz, then the refresh frequency B (e.g., 240Hz) is greater than 120Hz. Since display area A is a non-ROI display area, the refresh frequency A of display area A can be less than or equal to the current display refresh rate of 120Hz, and the refresh frequency A of display area A (e.g., 10Hz) is less than the refresh frequency B of display area B.

[0071] For example, as shown in Figure 4E, the display screen of an electronic device can be divided into two areas, namely display area C and display area D. Display area C can display WeChat. Application interface 110, display area D can display news application interface 120.

[0072] If the user swipes WeChat Application interface 110, then WeChat The area where the content on application interface 110 is located in the image frame is considered the Region of Interest (ROI), and display area C is the ROI display area. At this time, the area where the content on news application interface 120 is located in the image frame is a non-ROI area. The electronic device can identify the area of ​​the ROI area. If the area of ​​the ROI area is smaller than the display screen area, specifically half the display screen area, the electronic device can calculate the refresh frequency C corresponding to the ROI area based on the current display screen refresh rate, the ratio of the display screen area to the ROI area area, and perform a partial refresh operation on display area C according to this refresh frequency C. At this time, the refresh frequency C is greater than the current display screen refresh rate. For example, if the current display screen refresh rate is 120Hz, then the refresh frequency C (e.g., 240Hz) is greater than 120Hz. Since display area D is a non-ROI display area, the refresh frequency D of display area D can be less than or equal to the current display screen refresh rate of 120Hz, and the refresh frequency D of display area D (e.g., 10Hz) is less than the refresh frequency C of display area C.

[0073] For example, as shown in Figure 4F, the electronic device can display WeChat in a small window within the news application interface 120. Application interface 110. Among them, WeChat... The display area of ​​application interface 110 is display area E, and the display area of ​​news application interface 120 is display area F. It should be noted that display area F is the area outside of display area E, and can be understood as display area F not including display area E.

[0074] If the user swipes WeChat Application interface 110, then WeChat The area where the content on application interface 110 is located in the image frame is considered the Region of Interest (ROI), and display area E is the ROI display area. At this time, the area where the content on news application interface 120 is located in the image frame is a non-ROI area. The electronic device can identify the area of ​​the ROI area. If the area of ​​the ROI area is smaller than the display screen area, specifically half the display screen area, the electronic device can calculate the refresh frequency E corresponding to the ROI area based on the current display screen refresh rate, the ratio of the display screen area to the ROI area area, and perform a partial refresh operation on display area E according to this refresh frequency E. At this time, the refresh frequency E is greater than the current display screen refresh rate. For example, if the current display screen refresh rate is 120Hz, then the refresh frequency E (e.g., 240Hz) is greater than 120Hz. Since display area F is a non-ROI display area, the refresh frequency F of display area F can be less than or equal to the current display screen refresh rate of 120Hz, and the refresh frequency F of display area F (e.g., 10Hz) is less than the refresh frequency E of display area E.

[0075] In this embodiment of the application, Figures 4A-4F are merely illustrative of the application and do not constitute any limitation.

[0076] Figure 5A is a flowchart illustrating a content display method provided in an embodiment of this application.

[0077] As shown in Figure 5A, the specific flow of this content display method may include:

[0078] S501: The electronic device identifies the ROI region in the Nth frame image of Application 1, as well as the multiple coordinate information included in the ROI region.

[0079] For example, application 1 can be WeChat as shown in Figure 4B. Application interface 110 corresponds to WeChat The application can also be the news application corresponding to the news application interface 120 shown in Figure 4B. The multiple coordinate information included in the ROI region refers to the coordinate information corresponding to multiple pixels in the ROI region.

[0080] In one possible implementation, the electronic device may receive an enable operation for the partial refresh function before executing S501. In response to this enable operation, the electronic device may execute S501. For example, as shown in FIG5B, the electronic device may display a status bar window 210, which may include one or more function options (e.g., Bluetooth function option, flashlight function option, partial refresh function option 211, etc.). The electronic device may receive a touch operation from the user on the partial refresh function option 211 (i.e., the aforementioned enable operation for the partial refresh function), and in response to this touch operation, the electronic device may execute S501.

[0081] S502: The electronic device determines whether the area of ​​the ROI region is smaller than the area of ​​the display screen.

[0082] S503: If the area of ​​the ROI region is smaller than the area of ​​the display screen, the electronic device determines whether the ROI region has changed.

[0083] Specifically, whether the ROI region has changed includes whether the location of the ROI region has changed, and / or whether the area of ​​the ROI region has changed.

[0084] Since DDIC needs to refresh the displayed image on the ROI display area based on the refresh frequency corresponding to the ROI area, if the ROI area identified by the electronic device in this (e.g., the Nth time) changes compared to the ROI area identified by the electronic device in the previous (e.g., the N-1th time) (i.e., the N-1th frame image), that is, the position and / or area of ​​the ROI area in the Nth frame image changes compared to the N-1th frame image, which indicates that the area for performing local refresh has changed, and / or the refresh frequency corresponding to performing local refresh has changed, the electronic device executes subsequent steps S504 to S509, or S504, S511 and S512.

[0085] In this embodiment, if the resolution of the image frame and the resolution of the display screen are the same (i.e., the number of pixels on the vertical coordinate of the image frame is the same as the number of pixels on the vertical coordinate of the display screen, and the number of pixels on the horizontal coordinate of the image frame is the same as the number of pixels on the horizontal coordinate of the display screen), and the area of ​​the ROI region is the same as the area of ​​the ROI display area, then the electronic device directly determines whether the area of ​​the ROI region is smaller than the area of ​​the display screen, and executes subsequent processes based on the determination result. If the resolution of the image frame and the resolution of the display screen are different, and the area of ​​the ROI region and the area of ​​the ROI display area are also different, then the electronic device can map the ROI region to the ROI display area and determine whether the area of ​​the ROI display area is smaller than the area of ​​the display screen. If yes, then step S503 is executed; if no, then step S510 is executed. The specific implementation method of mapping the ROI region to the ROI display area is not limited in this application.

[0086] The embodiments of this application are preferably described with the image frame resolution being the same as the display screen resolution.

[0087] S504: If the ROI region changes, the electronic device determines whether application 1 should enable local overclocking mode.

[0088] In one possible implementation, the electronic device can pre-store a whitelist, which can be used to indicate applications that have enabled local overclocking mode. This whitelist may contain identifiers for one or more applications. If the whitelist includes the identifier for application 1, the electronic device determines that application 1 has enabled local overclocking mode; if the whitelist does not include the identifier for application 1, the electronic device determines that application 1 has not enabled local overclocking mode. Local overclocking mode refers to the electronic device performing a local refresh operation on the ROI display area based on an overclocking refresh frequency determined by the ROI area and the display screen area.

[0089] In one possible implementation, the electronic device can receive a first input from a user to enable a local overclocking mode. In response to this first input, the electronic device can enable the local overclocking mode. For example, as shown in FIG5C, the electronic device can display a status bar window 210, which may include one or more function options (e.g., Bluetooth function option, flashlight function option, local overclocking function option 212, etc.). The electronic device can receive a touch operation (i.e., the aforementioned first input) from a user on the local overclocking function option 212. In response to this touch operation, the electronic device can enable the local overclocking mode.

[0090] S505: If application 1 enables local overclocking mode, the electronic device determines the overclocking refresh frequency 1 of the ROI display area on the display screen based on the area of ​​the ROI region and the area of ​​the display screen.

[0091] In one possible implementation, the formula for calculating the overclocked refresh rate of 1 can be as follows:

[0092] The refresh rate of the current display screen can be the base frequency or a frequency lower than the base frequency.

[0093] It can be seen that the overclocked refresh rate 1 corresponding to the ROI display area is related to the ratio between the display screen area and the ROI area area. That is, in this embodiment, the electronic device increases the refresh rate of the ROI display area not because it increases the pixel scanning speed. In other words, whether refreshing the image for the entire display area or the ROI display area, the scanning speed of each pixel remains fixed and does not change. However, since the ROI display area is smaller than the display screen area, the refresh cycle for the ROI display area can be shorter than the refresh cycle for the entire display area, thus achieving a refresh rate for the ROI display area that is higher than the current display screen refresh rate. This implementation does not increase the pixel scanning speed, therefore it does not increase the power consumption of the DDIC.

[0094] In this embodiment, if the resolution of the image frame and the resolution of the display screen are the same, then the area of ​​the ROI region and the area of ​​the ROI display area are the same, and the ROI region area can be used in the calculation formula of the overclocking refresh rate 1 as in the example above. If the resolution of the image frame and the resolution of the display screen are different, then the area of ​​the ROI region and the area of ​​the ROI display area are different. The electronic device needs to determine the corresponding ROI display area based on the ROI region through a mapping relationship, and map the area of ​​the ROI region to the area of ​​the ROI display area, and then calculate it using the calculation formula of the overclocking refresh rate 1 (that is, the "ROI region area" in the calculation formula of the overclocking refresh rate 1 in the example above is actually the "ROI display area").

[0095] In this embodiment, if the ROI display area includes the area where the front-facing camera is located, when the electronic device 100 refreshes and displays an image on the ROI display area, since the area where the front-facing camera is located has no pixels, no image content is displayed in the area where the front-facing camera is located. However, when calculating the overclocking refresh rate of the ROI display area, in the example of the above calculation formula, the parameter still uses the area of ​​the ROI display area (if the resolution of the image frame and the resolution of the display screen are the same, the area of ​​the ROI area can be directly substituted), and the area of ​​the front-facing camera area is not subtracted. That is, the size of the area where the front-facing camera is located does not affect the calculation of the overclocking refresh rate.

[0096] When the electronic device 100 refreshes and displays an image on the entire display area of ​​the screen, since there are no pixels in the area where the front-facing camera is located, no image content is displayed in the area where the front-facing camera is located.

[0097] S506: Electronic device adjusts the current refresh frequency of DDIC to the overclocked refresh frequency 1.

[0098] Specifically, since the refresh rate is jointly controlled by the Source signal and the hardware Vsync signal, when the falling edge of the hardware Vsync signal coincides with the rising edge of the Source signal, the DDIC starts scanning from the first pixel in the upper left corner of the display screen, thereby controlling the panel to refresh the displayed image. Therefore, the electronic device adjusts both the Source signal frequency in the DDIC and the hardware Vsync signal frequency to an overclocked refresh rate of 1.

[0099] S507: The electronic device determines the multiple coordinate information included in the ROI display area based on the multiple coordinate information included in the current ROI area using DDIC.

[0100] Specifically, since DDIC only needs to perform a partial refresh operation on the ROI display area, it needs to know multiple coordinate information included in the ROI area and determine multiple coordinate information included in the ROI display area based on these coordinates. Then, DDIC can scan the pixels in the ROI display area.

[0101] In this embodiment, if the resolution of the image frame and the resolution of the display screen are the same, then the area of ​​the ROI region and the area of ​​the ROI display area are the same. The multiple coordinate information included in the ROI region is the same as the multiple coordinate information included in the ROI display area. Therefore, the electronic device can directly instruct the DDIC on the multiple coordinate information included in the current ROI region. If the resolution of the image frame and the resolution of the display screen are different, then the area of ​​the ROI region and the area of ​​the ROI display area are also different. The electronic device can map the coordinate information of the current ROI region to the coordinate information of the current ROI display area, and then instruct the DDIC on the coordinate information of the current ROI display area. The specific implementation method of mapping the coordinate information of the current ROI region to the coordinate information of the current ROI display area is not limited in this application.

[0102] S508: The electronic device controls the panel to refresh and display the content of the ROI display area based on the overclocked refresh frequency 1 via DDIC.

[0103] S509: Optional, the electronic device adjusts the frequency of the software Vsync signal to the overclock refresh rate 1.

[0104] In this embodiment, the frequency of the software Vsync signal (also known as the frame rate) refers to the rate at which the electronic device draws, renders, and synthesizes image frames. Having the same frame rate and refresh rate can improve image display stability and reduce the power consumption of the electronic device.

[0105] Another scenario: When the area of ​​the ROI is the same as the area of ​​the display screen.

[0106] S510: If the area of ​​the ROI region is the same as the area of ​​the display screen, the electronic device controls the panel to refresh the displayed image on the entire display area of ​​the display screen at the current refresh rate of the display screen via DDIC.

[0107] In one possible implementation, the DDIC can control the panel to refresh the displayed image across the entire display area based on a fixed refresh rate. For example, the DDIC can control the panel to refresh the entire display area based on a fixed 120Hz or 90Hz.

[0108] In one possible implementation, DDIC can set different refresh rates for the display screen based on different scenarios. For example, the electronic device can pre-store a refresh policy mapping table, which can include a mapping relationship between one or more application identifiers and refresh rates. For example, the identifier of application 1 corresponds to refresh rate 1, the identifier of application 2 corresponds to refresh rate 2, and the identifier of application 3 corresponds to refresh rate 3. The electronic device can control the panel to refresh and display the image corresponding to the application on the entire display area of ​​the screen based on the refresh rate corresponding to different applications through DDIC.

[0109] Another scenario: When application 1 does not have local overclocking mode enabled.

[0110] S511: If application 1 does not enable local overclocking mode, the electronic device determines the multiple coordinate information included in the ROI display area based on the multiple coordinate information included in the current ROI area through DDIC.

[0111] For an explanation of this step, please refer to the aforementioned S507.

[0112] S512: The electronic device controls the panel to refresh and display the content of the ROI display area at the current display refresh rate via DDIC.

[0113] Specifically, because the ROI display area is smaller than the display screen area, the time taken to scan the pixels in the ROI display area is often less than the duration of a hardware Vsync signal at the current display refresh rate. Therefore, when the ROI display area has finished refreshing, but before the duration of a hardware Vsync signal has ended, DDIC can wait.

[0114] For example, as shown in Figure 5D, if the current display refresh rate is 120Hz, the duration of a hardware Vsync signal is 100 / 120 = 8.33 milliseconds. If the refresh time of the ROI display area is 5 milliseconds, the duration of a hardware Vsync signal has not yet ended, with 3.33 milliseconds remaining. During this 3.33 millisecond period, DDIC can wait.

[0115] Another scenario: when the ROI region remains unchanged.

[0116] When the ROI region remains unchanged, meaning that the current refresh rate of the DDIC and the range of the control panel for refreshing the displayed image do not change, the electronic device will execute the subsequent process starting from S501.

[0117] In one possible implementation, the AP can draw, render, and composite only the content of the ROI region based on a frame rate that has been adjusted to an overclocked refresh rate of 1, which can reduce the power consumption of the electronic device.

[0118] As shown in Figure 5E(a), in some embodiments, the HWC can synthesize a complete image frame, that is, synthesize the content of the ROI region and the content of the non-ROI region. Then, the HWC writes the complete image frame into the GRAM of the DDIC. Next, the DDIC can control the panel to refresh and display the image on the entire display area based on the complete image frame in the GRAM. As shown in Figure 5E(b), in some embodiments, the HWC can synthesize a partial image frame, which includes the content of the ROI region, and the content of the non-ROI region is not synthesized. Then, the HWC writes the partial image frame into the GRAM of the DDIC. Next, the DDIC can control the panel to refresh and display the content of the ROI region on the ROI display area based on the partial image frame in the GRAM. It can be seen that the implementation shown in Figure 5E(b) can reduce the power consumption of the electronic device compared to the implementation shown in Figure 5E(a).

[0119] In this embodiment, by implementing steps S501 to S509, the electronic device refreshes the displayed image on the ROI display area at an overclocked refresh rate of 1, which can reduce the power consumption of the electronic device and improve the response time of the display screen.

[0120] As shown in Figure 5F(a), if the electronic device refreshes the displayed image across the entire display area based on the display's refresh rate, and refreshes the displayed image only in the ROI display area based on the display's refresh rate, it will not only increase the power consumption of the electronic device but also reduce the display's response time. However, if S501 to S509 are implemented, as shown in Figure 5F(b), the electronic device refreshes the displayed image across the entire display area at the display's refresh rate. When the electronic device refreshes the displayed image in the ROI display area at an overclocked refresh rate of 1, it can reduce the power consumption of the electronic device and improve the display's response time.

[0121] In this embodiment of the application, experimental data shows that the benefit of the display screen's response time can be:

[0122] Where FPS stands for Frames Per Second, X ROI The number of pixels in the ROI region on the X-axis, Y ROI X represents the number of pixels in the ROI region on the Y-axis. 分辨率 The number of pixels in the entire display area on the X-axis, Y 分辨率The number of pixels in the entire display area on the Y-axis is denoted by 'offset', where 'offset' represents the deviation.

[0123] Figure 5G is a schematic diagram comparing the refresh rate and overclocked refresh rate of a display screen according to an embodiment of this application.

[0124] As shown in Figure 5G(a), by implementing the content display method provided in this application, the electronic device can refresh and display images across the entire display area of ​​the screen at the screen's refresh rate (e.g., 120Hz). When the area of ​​the Region of Interest (ROI) is smaller than the area of ​​the screen, the electronic device can refresh and display the content of the ROI area at an overclocked refresh rate 1 (e.g., 240Hz) corresponding to the ROI area. It can be seen that the overclocked refresh rate 1 corresponding to the ROI area is greater than the screen's refresh rate, thus allowing for a faster response when the electronic device refreshes and displays the content of the ROI area.

[0125] Figure 6 is a schematic diagram of the device architecture of an electronic device provided in an embodiment of this application.

[0126] As shown in Figure 6, the device architecture of an electronic device can be divided into several layers. Each layer has a clear role and division of labor, and the layers communicate with each other through software interfaces. In some embodiments, the device architecture of the electronic device is divided into five layers, from top to bottom: application layer, application framework layer, Android runtime and system libraries, hardware abstraction layer, kernel layer, and hardware layer. Wherein:

[0127] The application layer includes a series of application packages, such as camera, calendar, notes, gallery, browser, etc.

[0128] The application framework layer provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. The application framework layer includes predefined functions, which may include a window manager, content provider, resource manager, notification manager, and graphics system. Specifically: The window manager manages window programs. It can obtain the screen area, determine if a status bar is present, lock the screen, and capture the screen. The content provider stores and retrieves data, making this data accessible to applications. This data may include videos, images, audio, made and received phone calls, browsing history and bookmarks, and phone books. The resource manager provides applications with various resources, such as localized strings, icons, images, layout files, and video files. The notification manager allows applications to display notifications in the status bar. These notifications can be used to convey informational messages and can disappear automatically after a short pause without user interaction. For example, the notification manager can be used to notify of download completion or message alerts. The notification manager can also display notifications as icons or scrollbar text in the system's top status bar, such as notifications from background applications, or as dialog windows on the screen. For example, displaying text messages in the status bar, emitting alert sounds, causing electronic devices to vibrate, and flashing indicator lights. Graphics systems can be used for drawing, rendering, and compositing image frames.

[0129] The Android Runtime consists of core libraries and a virtual machine. The Android runtime is responsible for the scheduling and management of the Android system.

[0130] The core library consists of two parts: one part is the functionalities that need to be called by the Java language, and the other part is the Android core library.

[0131] The application layer and application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.

[0132] The system library can include multiple functional modules. For example, a surface manager, a 3D graphics processing library (e.g., OpenGL ES), and a 2D graphics engine (e.g., SGL). The surface manager manages the display subsystem and provides the blending of 2D and 3D layers for multiple applications. The 3D graphics processing library implements 3D graphics drawing, image rendering, compositing, and layer processing. The 2D graphics engine is the drawing engine for 2D graphics.

[0133] In this embodiment, the system library may further include a Surfaceflinger module and an Advanced Graphics Platform (AGP) module. The Surfaceflinger module may include a frame rate control / synchronization calibration module, and the AGP module may include a Region of Interest (ROI) local refresh control module. The frame rate control / synchronization calibration module can be used to control the rate of image frame drawing, rendering, and compositing; the ROI local refresh control module can be used to determine whether application 1 has enabled local overclocking mode.

[0134] The Hardware Abstraction Layer (HAL) sits between the kernel layer and the application framework layer, playing a crucial role in bridging the two.

[0135] In this embodiment, the hardware abstraction layer may include a hardware composer (HWC) module, which may include a frame rate / overclocking refresh rate management module. The frame rate / overclocking refresh rate management module can identify Region of Interest (ROI) areas and determine their area and coordinate information. It can also obtain the display screen area information. The HWC module can then send the ROI area, display screen area, and coordinate information to the ROI overclocking adjustment module via the ROI overclocking control module in the kernel layer.

[0136] The kernel layer is the layer between hardware and software.

[0137] In this embodiment, the kernel layer includes a direct rendering manager (DRM) driver and an LCD kit. The DRM driver may include a dynamic ROI overclocking control module; the LCD kit may include an ROI overclocking adjustment module and a hardware Vsync signal control module.

[0138] The ROI overclocking control module receives information from the HWC module, including the area of ​​the ROI region, the area of ​​the display screen, and multiple coordinate information included in the ROI region, and then sends this information to the ROI overclocking adjustment module. The ROI overclocking adjustment module calculates the overclocking refresh rate corresponding to the ROI region based on the display screen's refresh rate, the area of ​​the ROI region, and the area of ​​the display screen, and determines the multiple coordinate information included in the ROI display area based on the multiple coordinate information included in the ROI region. The ROI overclocking adjustment module can trigger the hardware Vsync signal control module to adjust the frequencies of the hardware Vsync signal and the Source signal in the DDIC to the overclocking refresh rate. The ROI overclocking adjustment module can also send the multiple coordinate information included in the ROI region to the DDIC.

[0139] In this embodiment of the application, the overclocking refresh frequency corresponding to the ROI region can also be calculated by the frame rate / overclocking refresh rate management module. Then, the frame rate / overclocking refresh rate management module sends the overclocking refresh frequency to the ROI overclocking adjustment module through the ROI overclocking control module.

[0140] The hardware Vsync signal control module can adjust the frequency of the hardware Vsync signal and the Source signal in the DDIC to the overclocking refresh frequency corresponding to the ROI region.

[0141] The hardware layer can include multiple hardware components configured on the electronic device, such as a camera, audio module, DDIC, and display screen. The DDIC can refresh the displayed image on the ROI display area of ​​the display screen at an overclocked refresh rate corresponding to the ROI area, based on multiple coordinate information included in the ROI region.

[0142] In this embodiment of the application, Figure 6 is only used as an example to explain the application and does not constitute any limitation.

[0143] Referring to Figure 6, Figure 7 is a schematic diagram of module interaction provided by an embodiment of this application.

[0144] As shown in Figure 7, the interaction of this module can specifically include:

[0145] S701: The frame rate / overclocking refresh rate management module identifies the ROI region in the Nth frame image of Application 1 and obtains the area of ​​the ROI region and the multiple coordinate information included in the ROI region.

[0146] S702: The frame rate / overclocking refresh rate management module obtains the area of ​​the display screen.

[0147] S703: The frame rate / overclocking refresh rate management module determines whether the area of ​​the ROI region is smaller than the area of ​​the display screen.

[0148] S704: If the area of ​​the ROI region is smaller than the area of ​​the display screen, the frame rate / overclocking refresh rate management module determines whether the ROI region has changed.

[0149] The explanations of S701 to S704 can be found in the aforementioned S501 to S503.

[0150] S705: If the ROI region changes, the frame rate / overclocking refresh rate management module sends a query command to the ROI local refresh control module. This query command carries the identifier of application 1.

[0151] S706: In response to the query command, the ROI partial refresh control module determines whether the whitelist includes the identifier of application 1.

[0152] The whitelist can be pre-stored in the ROI partial refresh control module. For an explanation of the whitelist, please refer to the description in S504 above.

[0153] S707: If the whitelist includes the identifier of application 1, the ROI partial refresh control module sends indication information 1 to the frame rate / overclocking refresh frequency management module. Indication information 1 indicates that the whitelist includes the identifier of application 1.

[0154] S708: When the instruction information 1 is received, the frame rate / overclocking refresh frequency management module determines that application 1 enables the local overclocking mode.

[0155] S709: The frame rate / overclocking refresh rate management module sends the area of ​​the ROI region, the area of ​​the display screen, and the coordinate information of the ROI region to the ROI overclocking adjustment module through the ROI overclocking control module.

[0156] S710: The ROI overclocking adjustment module calculates the overclocking refresh rate 1 based on the display refresh rate, the area of ​​the ROI region, and the area of ​​the display, and determines the multiple coordinate information included in the ROI display area based on the multiple coordinate information included in the ROI region.

[0157] For details on how to calculate the overclocked refresh rate, please refer to the S505 documentation.

[0158] S711: The ROI overclocking adjustment module sends a frequency adjustment command to the hardware Vsync signal control module. This frequency adjustment command includes an overclocking refresh rate of 1.

[0159] S712: In response to the frequency adjustment command, the hardware Vsync signal control module adjusts the frequency of the hardware Vsync signal and the frequency of the Source signal of the DDIC to the overclocking refresh frequency 1.

[0160] S713: The ROI overclocking adjustment module sends multiple coordinate information of the ROI display area to the DDIC.

[0161] S714:DDIC controls the panel to refresh and display the content of the ROI display area by overclocking the refresh rate by 1.

[0162] S711 to S714 can be referenced from the aforementioned S506 to S508.

[0163] S715:DDIC sends frame rate adjustment commands to the frame rate control / synchronization calibration module. These commands include the frequency of the hardware Vsync signal.

[0164] S716: In response to a frame rate adjustment command, the frame rate control / synchronization calibration module adjusts the frame rate to the overclocked refresh rate 1.

[0165] S716 can refer to the aforementioned S509.

[0166] In one possible implementation, the ROI partial refresh control module determines that the whitelist does not include the identifier of application 1, and can send indication information 2 to the frame rate / overclocking refresh frequency management module. Indication information 2 indicates that the whitelist does not include the identifier of application 1. Upon receiving indication information 2, the frame rate / overclocking refresh frequency management module can determine that application 1 has not enabled partial overclocking mode.

[0167] In one possible implementation, the whitelist can be pre-stored in the frame rate / overclocking refresh rate management module. If the ROI region changes, the frame rate / overclocking refresh rate management module can determine whether the whitelist includes the identifier of application 1. If the whitelist includes the identifier of application 1, the frame rate / overclocking refresh rate management module determines that application 1 has enabled partial overclocking mode; if the whitelist does not include the identifier of application 1, the frame rate / overclocking refresh rate management module determines that application 1 has not enabled partial overclocking mode.

[0168] In one possible implementation, if the frame rate / overclocking refresh rate management module receives the user's first input regarding enabling the local overclocking mode, it can determine that application 1 has enabled the local overclocking mode.

[0169] In one possible implementation, if application 1 does not enable local overclocking mode, the frame rate / overclocking refresh rate management module sends the coordinate information of the ROI region to the ROI overclocking control module. Then, the ROI overclocking control module sends the coordinate information of the ROI region to the ROI overclocking adjustment module. Next, the ROI overclocking adjustment module determines multiple coordinates of the ROI display area based on the coordinates of the ROI region and sends these coordinates to the DDIC. The DDIC can then control the panel to refresh and display the content of the ROI display area at the current display refresh rate based on the coordinates of the ROI display area.

[0170] In one possible implementation, if the area of ​​the ROI is the same as the area of ​​the display screen, the frame rate / overclocking refresh rate management module can send a full-screen refresh command to the DDIC. In response to this full-screen refresh command, the DDIC can control the panel to refresh the displayed image across the entire display area.

[0171] When the DDIC controls the panel to refresh the displayed image across the entire display area:

[0172] In some embodiments, the DDIC can control the panel to refresh the displayed image across the entire display area based on a fixed refresh rate. For example, the DDIC can control the panel to refresh the displayed image across the entire display area based on a fixed 120Hz or a fixed 90Hz.

[0173] In some embodiments, the DDIC can set different refresh rates for the display screen based on different scenarios. For example, the DDIC can pre-store a refresh policy mapping table, which may include a mapping relationship between one or more application identifiers and refresh rates. For example, the identifier of application 1 corresponds to refresh rate 1, the identifier of application 2 corresponds to refresh rate 2, and the identifier of application 3 corresponds to refresh rate 3. The DDIC controls the panel to refresh and display the image corresponding to the application on the entire display area of ​​the screen based on the refresh rate corresponding to different applications.

[0174] Figure 8 is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application.

[0175] In this embodiment, the electronic device 100 is the same as the electronic device in the foregoing embodiments.

[0176] As shown in Figure 8, the electronic device 100 may include a processor 801, a memory 802, a wireless communication module 803 (optional), a display screen 804, and a camera 805 (optional). The processor 801, memory 802, wireless communication module 803 (optional), display screen 804, and camera 805 can be connected via a bus.

[0177] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may also include more or fewer components than those shown in FIG. 8, or combine some components, or split some components, or have different component arrangements. The components shown in FIG. 8 may be implemented in hardware, software, or a combination of software and hardware.

[0178] Processor 801 may include one or more processor units, such as an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processing unit (NPU). Different processing units may be independent devices or integrated into one or more processors. The controller can generate operation control signals based on the instruction opcode and timing signals to control instruction fetching and execution.

[0179] The processor 801 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 801 is a cache memory. This memory can store instructions or data that the processor 801 has just used or that are used repeatedly. If the processor 801 needs to use the instruction or data again, it can directly retrieve it from the memory. This avoids repeated accesses, reduces the waiting time of the processor 801, and thus improves the efficiency of the system.

[0180] In some embodiments, the processor 801 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a USB interface, etc.

[0181] The memory 802 is coupled to the processor 801 and is used to store various software programs and / or multiple sets of instructions. In specific implementations, the memory 802 may include volatile memory, such as random access memory (RAM); it may also include non-volatile memory, such as ROM, flash memory, hard disk drive (HDD), or solid state drive (SSD); the memory 802 may also include combinations of the above types of memory. The memory 802 may also store program code so that the processor 801 can call the program code stored in the memory 802 to implement the implementation method of the present application embodiment in the electronic device 100. The memory 802 may store an operating system, such as uCOS, VxWorks, RTLinux, or other embedded operating systems.

[0182] The wireless communication module 803 can provide solutions for wireless communication applications on the electronic device 100, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 803 can be one or more devices integrating at least one communication processing module. The wireless communication module 803 receives electromagnetic waves via an antenna, modulates and filters the electromagnetic wave signals, and sends the processed signal to the processor 801. The wireless communication module 803 can also receive signals to be transmitted from the processor 801, modulate and amplify them, and then convert them into electromagnetic waves for radiation via the antenna. In some embodiments, the electronic device 100 can also use the Bluetooth module (not shown in Figure 8) and the WLAN module (not shown in Figure 8) in the wireless communication module 803 to transmit signals to detect or scan devices near the electronic device 100 and establish wireless communication connections with those devices to transmit data. The Bluetooth module can provide one or more Bluetooth communication solutions, including classic Bluetooth (basic rate / enhanced data rate, BR / EDR) or Bluetooth Low Energy (BLE), and the WLAN module can provide one or more WLAN communication solutions, including Wi-Fi direct, Wi-Fi LAN or Wi-Fi softAP.

[0183] The display screen 804 can be used to display images, videos, etc. The display screen 804 may include a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Mini LED, a MicroLED, a Micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include one or N display screens 804, where N is a positive integer greater than 1.

[0184] Camera 805 is used to capture still images or videos. An object is projected onto a photosensitive element by generating an optical image through the lens. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then passed to an ISP for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into image signals in standard RGB, YUV, or other formats. In some embodiments, the electronic device 100 may include one or N cameras 805, where N is a positive integer greater than 1.

[0185] It should be noted that the electronic device 100 shown in Figure 8 is only used as an example to explain the hardware structure of the electronic device provided in this application, and does not constitute a specific limitation on this application.

[0186] It should be noted that, in this embodiment, the non-ROI display area can be referred to as the first area, the content refreshed and displayed on the non-ROI display area can be referred to as the first content, and the refresh frequency corresponding to the non-ROI display area is the first refresh frequency; the ROI display area can be referred to as the second area, the content refreshed and displayed on the ROI display area can be referred to as the second content, and the refresh frequency corresponding to the ROI display area is the second refresh frequency. The first refresh frequency can be less than or equal to the display screen's refresh frequency, and the second refresh frequency can be greater than the display screen's refresh frequency. The first area and the second area can be different.

[0187] In one possible implementation, the first content can correspond to the first application, and the second content can correspond to the second application. The application corresponding to the non-ROI display area can be the first application, and the application corresponding to the ROI display area can be the second application.

[0188] In one possible implementation, the first application can be a news application, a novel application, a browser application, etc., and the second application can be an instant messaging application, a video application, a game application, etc.

[0189] In one possible implementation, the areas of the first and second regions can be the same.

[0190] In one possible implementation, the refresh rate of the display screen is preferably 120Hz. The first refresh rate can be less than or equal to the refresh rate of the display screen, generally less than or equal to 30Hz, preferably 1Hz or 10Hz. When the area of ​​the ROI display area is half the area of ​​the display screen, the second refresh rate can be 240Hz, in which case the period of the hardware Vsync signal is approximately 4.17 milliseconds.

[0191] In one possible implementation, both the ROI display area and the non-ROI display area correspond to a third application, and the first content and the second content correspond to the third application. The third application can be a stylus application, used to receive and respond to input from a stylus or finger, and display the handwriting corresponding to the input on the display screen. In this case, the second content can be the handwriting, and the first content can be display elements other than the handwriting.

[0192] In one possible implementation, the area of ​​the first region can be larger than the area of ​​the second region. As shown in Figure 4F, the first region is the display area F, and the second region is the display area E.

[0193] In one possible implementation, the sum of the areas of the first region and the second region can be equal to the area of ​​the display screen.

[0194] In one possible implementation, the first region and / or the second region includes the region corresponding to the location of the front-facing camera.

[0195] As used in the above embodiments, depending on the context, the term "when..." can be interpreted as meaning "if...", "after...", "in response to determining...", or "in response to detecting...". Similarly, depending on the context, the phrase "when determining..." or "if (the stated condition or event) is interpreted as meaning "if determining...", "in response to determining...", "when (the stated condition or event) is detected", or "in response to detecting (the stated condition or event)".

[0196] In the above embodiments, implementation can be achieved entirely or partially through software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented entirely or partially in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state drive), etc.

[0197] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. This program can be stored in a computer-readable storage medium, and when executed, it can include the processes described in the above method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.

Claims

1. A content display method, characterized in that, The method is applied to an electronic device, the electronic device including a display screen, the display screen including a first region and a second region, the method comprising: The first content is refreshed and displayed in the first area at a first refresh rate; The second content is refreshed and displayed in the second area at a second refresh rate; wherein the first refresh rate is less than or equal to the refresh rate of the display screen, the second refresh rate is greater than the refresh rate of the display screen, and the first area and the second area are not the same.

2. The method according to claim 1, characterized in that, The electronic device further includes a first application and a second application, wherein the first content corresponds to the first application and the second content corresponds to the second application.

3. The method according to claim 2, characterized in that, The first application is a news application, and the second application is an instant messaging application.

4. The method according to any one of claims 1-3, characterized in that, The first region and the second region have the same area.

5. The method according to claim 4, characterized in that, The sum of the areas of the first region and the second region is equal to the area of ​​the display screen.

6. The method according to claim 4, characterized in that, The display screen has a refresh rate of 120Hz, the first refresh rate is less than or equal to 30Hz, and the second refresh rate is 240Hz.

7. The method according to claim 6, characterized in that, The period of the hardware Vsync signal is 4.17 milliseconds.

8. The method according to claim 1, characterized in that, The electronic device also includes a third application, and the first content and the second content correspond to the third application.

9. The method according to claim 8, characterized in that, The third application is a stylus application, used to receive and respond to input from a stylus or finger, and display the corresponding handwriting on the display screen.

10. The method according to claim 9, characterized in that, The area of ​​the first region is larger than the area of ​​the second region.

11. The method according to claim 10, characterized in that, The sum of the areas of the first region and the second region is equal to the area of ​​the display screen.

12. The method according to claim 1, characterized in that, The second refresh rate is related to the refresh rate of the display screen.

13. The method according to claim 12, characterized in that, The second refresh rate is determined by the ratio of the refresh rate of the display screen, the area of ​​the display screen, and the area of ​​the second region.

14. The method according to claim 13, characterized in that, Before refreshing and displaying the second content in the second area of ​​the display screen at the second refresh frequency, the method includes: The first Region of Interest (ROI) of the Nth frame image was determined; Determine whether the area of ​​the second region corresponding to the first ROI region on the display screen is smaller than the area of ​​the display screen; If the area of ​​the second region is smaller than the area of ​​the display screen, the second refresh rate is determined based on the refresh rate of the display screen, the area of ​​the display screen, and the area of ​​the second region.

15. The method according to claim 14, characterized in that, If the area of ​​the second region is smaller than the area of ​​the display screen, the second refresh rate is determined based on the refresh rate of the display screen, the ratio of the area of ​​the display screen to the area of ​​the second region, specifically including: When the area of ​​the second region is smaller than the area of ​​the display screen, determine whether the first ROI region and the second ROI region in the (N-1)th frame image are the same; If the first ROI region and the second ROI region are not the same, the second refresh rate is determined based on the refresh rate of the display screen, the area of ​​the display screen, and the area of ​​the second region.

16. The method according to claim 14, characterized in that, The second content is the content of the first ROI region.

17. The method according to claim 15, characterized in that, The first ROI region and the second ROI region are not the same, including one or more of the following: the location of the first ROI region and the location of the second ROI region are not the same, and the size of the first ROI region and the size of the second ROI region are not the same.

18. An electronic device, characterized in that, include: A display screen, one or more processors, and one or more memories; wherein the one or more processors are coupled to the display screen and the one or more memories, the one or more memories are used to store computer instructions, and the one or more processors are used to execute the computer instructions to cause the electronic device to perform the method as described in any one of claims 1-17.

19. A chip system, characterized in that, The chip system, applied to an electronic device, includes a processing circuit and an interface circuit. The interface circuit receives code instructions and transmits them to the processing circuit, which then executes the code instructions to perform the method as described in any one of claims 1-17.

20. A computer-readable storage medium comprising instructions, characterized in that, When the instructions are executed on an electronic device, the electronic device causes the electronic device to perform the method as described in any one of claims 1-17.

21. A computer program product, characterized in that, When the computer program product is run on an electronic device, it causes the electronic device to perform the method as described in any one of claims 1-17.

Images