Image display method and related device

Abstract

An image display method and a related device. In a scenario where a partial region (ROI), i.e., a first region (ROI), in a display panel is refreshed, a display processing unit (DPU) acquires third image data for updating the first region (ROI) and corresponding positional information of the first region (ROI) in the display panel, and indicates the first region (ROI) to a display driver integrated circuit (DDIC) and transmits the third image data; and on the basis of the third image data, the DDIC only refreshes the first region (ROI) without refreshing other regions in the display panel. Neither the DPU nor the DDIC is able to process image data for updating regions other than the first region (ROI), and the DDIC also does not refresh regions in the display panel other than the first region (ROI), thereby improving touch responsiveness and reducing display power consumption. Implementing partial screen refresh in video mode without relying on random access memory offers greater universality and practicality than methods in command mode.

Description

Image display methods and related equipment Technical Field

[0001] This application relates to the field of terminal technology, specifically to an image display method and related equipment. Background Technology

[0002] The content displayed on an electronic device's screen can be called the user interface (or simply interface). The content in the user interface is subject to updates. In some scenarios, only certain areas of the user interface typically need updating, while other areas do not.

[0003] Even when only a portion of the content in the user interface needs updating, the electronic device will still refresh the entire user interface on the screen to display the updated interface. Refreshing the entire user interface means that both the screen area displaying the updated content and the screen area displaying the unupdated content need to be refreshed.

[0004] Because updating the content in only certain areas of the user interface requires refreshing the entire screen, electronic devices consume a lot of power when refreshing the screen.

[0005] Summary of the Invention

[0006] This application provides an image display method and related device, which can optimize display performance and display power consumption.

[0007] In a first aspect, an image display method is provided, applied to an electronic device. The electronic device includes a display processing unit and a screen, wherein the screen includes a display driver chip and a display panel. The method includes: displaying first image data in a first area of ​​the display panel, and displaying second image data in a second area of ​​the display panel, wherein the first area (i.e., the portion of the display panel corresponding to the region of interest (ROI) in this application) and the second area (i.e., the portion of the display panel corresponding to the non-ROI in this application) do not overlap; the display processing unit acquires first indication information (e.g., DPU ROI in FIG. 6), the first indication information including the position information of the first area; the display processing unit acquires third image data (e.g., DPU image 1 in FIG. 6), the third image data being the image data to be updated in the first area; the display processing unit transmits the first indication information to the display driver chip; the display processing unit transmits the third image data to the display driver chip; and the display driver chip controls the display panel to display the third image data in the first area and the second image data in the second area according to the first indication information.

[0008] It is understood that in the above scheme, the display processing unit acts as the controller of screen refresh, triggering the display driver chip to refresh the display panel. In other words, the above scheme is executed in video mode. In the scenario where only a portion of the display panel, i.e., the first area, is refreshed, compared to the related technologies described above in video mode, in this application, the display processing unit does not transmit image data to the display driver chip for updating areas other than the first area (e.g., the second area), and the display driver chip does not refresh areas other than the first area, thereby reducing fixed display latency (or improving display performance and responsiveness) and reducing display power consumption.

[0009] In other words, in this application, when refreshing a portion of the display panel, the display driver chip does not start refreshing the display panel from the first row of pixels on the display panel, but directly from the first row of pixels in the first area. The display driver chip does not end refreshing the display panel from the last row of pixels on the display panel, but directly from the last row of pixels in the first area.

[0010] Furthermore, compared to solutions that refresh a portion of the display panel based on command mode in the same scenario, this application can achieve partial screen refresh without relying on random access memory (RAM), making it suitable for both RAMless screens and RAM screens, thus offering greater versatility and practicality.

[0011] In one possible embodiment, the display processing unit transmits third image data to the display driver chip, including: in response to a first Vsync signal, the display processing unit starts transmitting third image data to the display driver chip; after the transmission of the third image data is completed (e.g., at the end of timing 2' in FIG. 4(b)) until the second Vsync signal is received, the display processing unit stops transmitting image data to the display driver chip (e.g., the DPU enters sleep mode in FIG. 4(b)), wherein the first Vsync signal and the second Vsync signal are adjacent (e.g., the two Vsync signals shown in FIG. 4(b)).

[0012] The above solution directly transmits the third image data, enabling direct updates to the content of the first area. Compared to refreshing the entire display panel to update the content of the first area, it can display the updated content in the first area earlier in each screen refresh, thus improving display performance. Furthermore, the display processing unit operates for a shorter time in each screen refresh, stopping operation immediately after transmitting the third image data, thereby saving power.

[0013] In one possible embodiment, the display driver chip controls the display panel to display third image data in a first area and second image data in a second area according to the first instruction information, including: the display driver chip receiving third image data corresponding to a first Vsync signal from the display processing unit; after receiving the third image data, the display driver chip stops receiving image data from the display processing unit until it receives image data corresponding to the second Vsync signal from the display processing unit.

[0014] The above solution directly refreshes the first area. Compared to refreshing the entire display panel and only the content of the first area, it can display the updated content of the first area earlier in each screen refresh, thereby improving display performance. The display driver chip works for a shorter time in each screen refresh, and stops working after refreshing the first area of ​​the display panel, which can save power consumption.

[0015] In one possible embodiment, the display processing unit acquires third image data, including: the display processing unit acquires fourth image data (e.g., the updated system window and surface window in S111) from the graphics processor, the fourth image data being used to update the entire area of ​​the display panel; the display processing unit determines the third image data based on the first instruction information and the fourth image data.

[0016] In the above scheme, the display processing unit, based on the position of the first area, processes the fourth image data corresponding to all areas of the display panel into third image data corresponding to the first area of ​​the display panel, so as to facilitate the subsequent transmission of the third image data to the display driver chip, thereby enabling the display driver chip to refresh only the first area in the display panel.

[0017] In one possible embodiment, the third Vsync signal precedes the first Vsync signal, and the fourth Vsync signal follows the second Vsync signal. A fifth Vsync signal (e.g., the Vsync signal corresponding to the x-frame partial refresh data in Figure 10(b)) between the third and fourth Vsync signals triggers the display processing unit to transmit image data for updating a portion of the display panel. This portion includes the first region. The image data for updating this portion of the display panel includes the third image data. The fifth Vsync signal includes both the first and second Vsync signals. The method further includes: in response to the third Vsync signal, the display processing unit transmits the fifth image data (e.g., the updated system window and surface window in S212) to the display driver chip. The fifth image data is used to update the entire area of ​​the display panel. The display driver chip controls the display panel to display the fifth image data. The display processing unit then retrieves the first indication information (e.g., the DPU in Figure 9). The display processing unit obtains sixth image data (e.g., DPU image 2 in FIG9) from the graphics processor, and the sixth image data is used to update the entire area of ​​the display panel; in response to the fourth Vsync signal, the display processing unit transmits the sixth image data to the display driver chip according to the first indication information, the sixth image data and the seventh indication information, and the seventh indication information indicates to refresh the entire area of ​​the display panel; the display driver chip controls the display panel to display the sixth image data; wherein, the time interval between the first moment of transmitting the fifth image data and the second moment of transmitting the sixth image data is less than or equal to the first interval threshold (that is, one-fifth of the second threshold in this application, or for example, T1 or T1' in this application).

[0018] For example, the third Vsync signal is the Vsync signal corresponding to the full-screen refresh data of frame a in Figure 10(b), and the fourth Vsync signal is the Vsync signal corresponding to the full-screen refresh data of frame b in Figure 10(b). The seventh indication information is the second indication information in this application.

[0019] For example, the third Vsync signal is the Vsync signal corresponding to the full-screen refresh data of frame b in Figure 11(b), and the fourth Vsync signal is the Vsync signal corresponding to the full-screen refresh data of frame b+1 in Figure 11(b). The seventh indication information is the fourth indication information.

[0020] For example, the third Vsync signal is the Vsync signal corresponding to the full-screen refresh data of frame b in Figure 12(b), and the fourth Vsync signal is the Vsync signal corresponding to the full-screen refresh data of frame b+1 in Figure 12(b). The seventh indication information is the fifth indication information and the sixth indication information.

[0021] The above solution, in scenarios where only a portion of the display panel is refreshed, forces a full-screen refresh based on a first interval threshold. This improves responsiveness and reduces display power consumption while ensuring the display quality to guarantee user experience and extend the screen's lifespan.

[0022] In one possible embodiment, the interval between the first Vsync signal and the second Vsync signal is a second interval threshold (that is, one-half of the first threshold in this application), and the first interval threshold is greater than the second interval threshold (that is, the first refresh rate is greater than the second refresh rate, or the second threshold is greater than the first threshold).

[0023] Understandably, compared to the second interval threshold being greater than or equal to the first interval threshold, it can further optimize display performance and display power consumption.

[0024] In one possible embodiment, the first interval threshold is less than or equal to the reciprocal of the screen's lowest refresh rate.

[0025] In other words, using the largest possible first interval threshold within the hardware's allowable range for full-screen refresh can further optimize display performance and power consumption.

[0026] In one possible embodiment, the method further includes: the display driver chip transmitting seventh indication information to the display processing unit based on a first moment and a first interval threshold.

[0027] Among them, the seventh instruction information is the second instruction information, and the first moment is the first moment #1.

[0028] The above solution, in scenarios where a portion of the display panel is refreshed, transmits the seventh instruction information based on the first interval threshold. This can improve responsiveness and reduce display power consumption while ensuring the display effect of the screen to guarantee user experience and extend the screen's lifespan.

[0029] For example, the method further includes: determining a first cutoff time (e.g., cutoff time #1) based on a first moment and a first interval threshold, the first cutoff time being the cutoff time for transmitting the sixth image data (e.g., the full-screen refresh data of the a+1th frame); determining the transmission time of the seventh indication information (e.g., the second indication information) based on the first cutoff time and a preset interval (e.g., T2), wherein the transmission time is before the first cutoff time, and the time interval between the transmission time and the first cutoff time is greater than or equal to the preset interval; wherein the preset interval is greater than or equal to the duration for which the display processing unit transmits the sixth image data to the display driver chip (e.g., T4); or, the preset interval is greater than or equal to the sum of the duration for which the display processing unit processes the sixth image data (e.g., T3) and the duration for which it transmits the sixth image data to the display driver chip (e.g., T4).

[0030] The above solution instructs a full-screen refresh when the time interval before the deadline is greater than or equal to a preset interval. This can improve the success rate of completing a full-screen refresh before the deadline, ensuring the display effect of the screen, guaranteeing the user experience, and extending the lifespan of the screen.

[0031] In one possible embodiment, the sum of the quantities of the third Vsync signal and the fifth Vsync signal is a first quantity, and the interval between the first Vsync signal and the second Vsync signal is a second interval threshold. The method further includes: determining a quantity threshold based on the first interval threshold and the second interval threshold, wherein the ratio of the first interval threshold to the second interval threshold is greater than or equal to the quantity threshold; and when the first quantity is equal to the quantity threshold, the display processing unit transmits seventh indication information to the display driver chip.

[0032] Among them, the seventh instruction information is the fourth instruction information, or the seventh instruction information is the fifth instruction information and the sixth instruction information.

[0033] The above solution, in scenarios where a portion of the display panel is refreshed, transmits the seventh instruction information based on the first interval threshold. This can improve responsiveness and reduce display power consumption while ensuring the display effect of the screen to guarantee user experience and extend the screen's lifespan.

[0034] For example, the method further includes: determining a second cutoff time (e.g., cutoff time #2 in this application) based on the time corresponding to the third Vsync signal (e.g., the Vsync signal corresponding to the full-screen refresh data of the b-th frame in Figure 11(b) or Figure 12(b)) and a first time interval, wherein the second cutoff time is the time corresponding to the fourth Vsync signal (e.g., the Vsync signal corresponding to the full-screen refresh data of the b+1-th frame in Figure 11(b) or Figure 12(b); determining the transmission time of the seventh indication information (e.g., the fourth indication information, or, e.g., the fifth and sixth indication information) based on the second cutoff time and a preset interval (e.g., T2'), wherein the transmission time is before the second cutoff time, and the time interval between the transmission time and the second cutoff time is greater than or equal to the preset interval; wherein the preset interval is greater than or equal to the duration of the display processing unit processing the sixth image data (e.g., T3').

[0035] The above solution instructs a full-screen refresh when the time interval before the deadline is greater than or equal to a preset interval. This can improve the success rate of completing a full-screen refresh before the deadline, ensuring the display effect of the screen, guaranteeing the user experience, and extending the lifespan of the screen.

[0036] In one possible embodiment, the display panel displays the user interface of a video application, wherein video data of the video application, including first image data and third image data, is played in a first area, and other data, including second image data, is displayed in a second area.

[0037] For example, the user interface of a video application is shown in Figure 2(a), where the first area is, for example, the ROI and the second area is, for example, a non-ROI.

[0038] For example, the user interface of a video application is shown in Figure 2(b), where the first region is, for example, ROI1 and / or ROI2, and the second region is, for example, a non-ROI.

[0039] In one possible embodiment, the display panel displays the user interface of the note-taking application, wherein, in response to user operations, note data input by the user is displayed in a first area (e.g., note data obtained by detecting the user writing on the screen with a stylus, or note data obtained by detecting the user inputting text using a keyboard), the note data including first image data and third image data, and other data, including second image data, is displayed in a second area.

[0040] In one possible embodiment, data of a first application is dynamically displayed in a first area in the form of a dynamic capsule, and data of a second application is statically displayed in a second area, wherein the data of the first application includes first image data and third image data, and the data of the second application includes second image data.

[0041] For example, the user interface of a video application is shown in Figure 2(c), where the first area is, for example, the ROI and the second area is, for example, a non-ROI.

[0042] For example, the user interface of a video application is shown in (d) in Figure 2, where the first area is, for example, the ROI and the second area is, for example, a non-ROI.

[0043] In a second aspect, this application provides an electronic device including one or more processors and one or more memories; wherein the one or more memories are coupled to one or more processors, and the one or more memories are used to store computer program code, the computer program code including computer instructions, which, when executed by one or more processors, cause the electronic device to perform the method described in the first aspect and any possible implementation thereof.

[0044] Thirdly, embodiments of this application provide a chip system applied to an electronic device. The chip system includes one or more processors, which are used to invoke computer instructions to cause the electronic device to perform the methods described in the first aspect and any possible implementation thereof.

[0045] Fourthly, this application provides a computer-readable storage medium including instructions that, when executed on an electronic device, cause the electronic device to perform the method described in the first aspect and any possible implementation thereof.

[0046] Fifthly, this application provides a computer program product containing instructions that, when the computer program product is run on an electronic device, cause the electronic device to perform the method described in the first aspect and any possible implementation thereof.

[0047] Understandably, the electronic device provided in the second aspect, the chip system provided in the third aspect, the computer storage medium provided in the fourth aspect, and the computer program product provided in the fifth aspect are all used to execute the method provided in this application. Therefore, the beneficial effects they can achieve can be referred to the beneficial effects in the corresponding methods, and will not be repeated here. Attached Figure Description

[0048] Figure 1 is an architecture diagram of updating the user interface by refreshing the screen via hardware, provided in an embodiment of this application;

[0049] Figure 2 shows an exemplary scenario in which only some areas of the user interface provided in the embodiments of this application need to be updated;

[0050] Figure 3(a) and (c) are schematic diagrams of an example of ROI in a local frame refresh scenario provided by the embodiments of this application, and Figure 3(b) and (d) are timing diagrams of an example of DPU data packet transmission provided by the embodiments of this application;

[0051] Figure 4(a) and (c) are schematic diagrams of another example of ROI in the local frame refresh scenario provided by the embodiments of this application, and Figure 4(b) and (d) are timing diagrams of another example of DPU data transmission provided by the embodiments of this application.

[0052] Figure 5 is a schematic diagram of the hardware and software structure involved in updating the user interface of the electronic device provided in the embodiment of this application;

[0053] Figure 6 is a schematic diagram of the image display method 100 provided in an embodiment of this application;

[0054] Figure 7 is a schematic diagram of indicating the area to be updated on the display panel by using the value of the indicator register according to an embodiment of this application;

[0055] Figure 8 is a schematic diagram of a forced full-screen refresh in a scenario where a portion of the user interface needs to be updated, as provided in an embodiment of this application.

[0056] Figure 9 is a schematic diagram of the image display method 200 provided in an embodiment of this application;

[0057] Figure 10 is a schematic diagram of an example of full-screen refresh triggered by DDIC provided in an embodiment of this application;

[0058] Figure 11 is a schematic diagram of an example of full-screen refresh triggered by DPU provided in an embodiment of this application;

[0059] Figure 12 is a schematic diagram of an example of full-screen refresh triggered by a display driver provided in an embodiment of this application;

[0060] Figure 13 is a schematic diagram of the hardware structure of an electronic device 1000 provided in an embodiment of this application. Detailed Implementation

[0061] To make the objectives, technical solutions, and advantages of this application clearer, the embodiments of this application will be described in further detail below with reference to the accompanying drawings.

[0062] To facilitate understanding of the embodiments of this application, the technical terms involved in this application are described below.

[0063] 1. The user interface of an application displayed on an electronic device. In some scenarios, applications need to update the content of the user interface. The electronic device refreshes the screen via hardware to update the user interface.

[0064] Figure 1 is an architecture diagram of updating the user interface by refreshing the screen via hardware, provided in an embodiment of this application.

[0065] As shown in Figure 1, a graphics processing unit (GPU) is a processor specifically designed for processing graphics and images.

[0066] The display processor unit (DPU) is the core of the display system. The DPU is responsible for processing image and video data, ensuring smooth and clear display content. Its high performance further enhances the display panel's effect and drives the advancement of display technology. The DPU resides in the system-on-chip (SoC) (not shown in the figure), while the application processor (AP) (not shown in the figure) is the part of the SoC responsible for handling application tasks; in this application, the SoC is also referred to as the AP or AP side.

[0067] The DPU connects to the screen via a display serial interface (DSI).

[0068] The screen consists of a display driver integrated circuit (DDIC) and a display panel. The DDIC connects the DPU and the display panel, acting as a bridge.

[0069] In some cases, user interface updates fall under the category of image processing. Image processing is a complex process, and electronic devices can delegate different stages of image processing to different hardware or software. That is, different hardware or software components within the electronic device perform their respective tasks to collaboratively update the user interface. In some situations, the DDIC (Display Interface Designer) refreshes the corresponding area on the display panel based on the updated content in the area to be updated (also called the DDIC ROI or ROI). Updating the content in the DDIC ROI can be accomplished through the DPU (Display Processing Unit). Here, the area to be updated in the DPU (also called the DPU ROI or ROI) can be the same as the DDIC ROI. The electronic device can directly use the DDIC ROI as the DPU ROI. Subsequently, the electronic device can update the content in the DPU ROI through the DPU. Updating the content in the DPU ROI through the DPU can be seen as one way for the electronic device to update the content in the DDIC ROI.

[0070] The process by which electronic devices refresh their screens via hardware to update the user interface can be found in the following descriptions of steps 1-4.

[0071] Step 1: After receiving the user interface update request, the graphics processing unit (GPU) performs a cyclic redundancy check (CRC) on each row of data in each window of the user interface, line by line, to determine the target window containing content to be updated. The GPU then updates the content in the target window, resulting in the updated target window. The GPU then transmits the target window to the display processing unit (DPU).

[0072] Understandably, in many graphical user interface frameworks, the window is the main container of the user interface, and its primary function is to display the content of the user interface.

[0073] It can also be understood that the area in the user interface that needs to be updated can be called the area to be updated, or ROI. ROI includes the target window containing the content to be updated.

[0074] Step 1 corresponds to point ① in Figure 1.

[0075] Step 2: The DPU ROI processing module in the DPU performs CRC verification on each row of data in the target window to determine the updated content in the DPU ROI. The updated content in the DPU ROI is then encapsulated into a data packet and sent to the DSI.

[0076] In some possible cases, the DPU ROI processing module can be placed in the DPU layer mixer.

[0077] It is understandable that the area to be updated that DPU supports processing is called DPU ROI. DPU ROI corresponds to ROI in the user interface, and the DPU ROI processing module is used to process DPU ROI.

[0078] Step 2 corresponds to point ② in Figure 1.

[0079] Step 3: When the DSI in the DPU sends a data packet to the DDIC, it performs a CRC check on the data packet. If the data packet containing the updated content from the DPU ROI is the same as the previously sent data packet to the DDIC, no data is sent to the DDIC. If the data packet containing the updated content from the DPU ROI is different from the previously sent data packet to the DDIC, the data packet is sent to the DDIC.

[0080] Step 3 corresponds to point ③ in Figure 1.

[0081] Step 4: DDIC obtains the updated content in DDIC ROI based on the updated content in DPU ROI. Then, DDIC performs CRC checks on each row in the display panel. If the CRC matches, no refresh is performed; otherwise, the row is refreshed based on the updated content in DDIC ROI, thus achieving screen refresh.

[0082] It is understandable that the area to be updated that DDIC supports processing is called DDIC ROI. DDIC ROI corresponds to the ROI in the user interface, and the DDIC ROI processing module is used to process DDIC ROI.

[0083] Step 4 corresponds to point ④ in Figure 1.

[0084] 2. In some embodiments of this application, only the content of a portion of the user interface needs to be updated; that is, the aforementioned ROI is a portion of the user interface.

[0085] For example, when an electronic device plays a video using a video application, the content of the video playback window needs to be updated. Similarly, when an electronic device displays an application in a capsule format, the content of the capsule window needs to be updated. Finally, when an electronic device detects that a user is writing on the screen with a stylus, the content of the stylus writing window needs to be updated.

[0086] In this application, the user interface may include one or more ROIs.

[0087] Figure 2 shows an exemplary scenario in which only some areas of the user interface provided in this application's embodiment need to be updated.

[0088] Figure 2(a) and (b) illustrate the scenario of an electronic device playing a video using a video application.

[0089] As shown in Figure 2(a), the area in the user interface that needs to be updated is the ROI, and the rest of the user interface is a non-ROI. For example, the ROI is the window where the video is played.

[0090] As shown in Figure 2(b), the areas in the user interface that need to be updated are ROI1 and ROI2, while the rest of the user interface is a non-ROI. For example, ROI1 is the window for playing the video, and ROI2 includes a window for displaying the video creator's avatar and a window for displaying the video creator's introductory information.

[0091] In Figure 2, (c) and (d) illustrate an example of an electronic device displaying a timer application in the form of a flexible capsule. For example, the current timer application is "18:00:49", which is 18 minutes and 49 milliseconds.

[0092] As shown in Figure 2(c), the ROI includes the entire row of pixels encompassing the window displaying the timer application (e.g., including the timer application displayed as a capsule and the status bar content), while the remaining area of ​​the user interface is a non-ROI. This remaining area of ​​the user interface can display content from other applications or the desktop; for example, in Figure 2(c), the non-ROI displays the content of the calling application.

[0093] The reason why the ROI width is the same as the screen width is that DDIC refreshes the display panel line by line. The length of each line is fixed and equal to the screen width.

[0094] It's understandable that the fixed row length, equal to the screen width, is due to hardware design. However, in some cases, while the display driver chip refreshes the screen line by line, the row length doesn't necessarily have to be the same as the screen width. This means the width of the area to be updated doesn't have to be the same as the screen width. In other words, the ROI can be an area of ​​any width within the user interface.

[0095] As shown in Figure 2(d), the ROI is the window that only displays the Dynamic Capsule, while the rest of the user interface is a non-ROI. The rest of the user interface can display content from other applications or the desktop; for example, in Figure 2(d), the non-ROI includes the desktop content.

[0096] Understandably, non-ROIs on the screen do not need to be refreshed and should remain in their state since the last time they were turned on.

[0097] 3. The type of window involved in this application may include a system window or a surface window. That is, the ROI may include a system window and / or a surface window. For example, the request to update the user interface involved in Figure 1 may include a request to update a system window or a request to update a surface window.

[0098] The system window refers to the window drawn based on the system's image rendering engine. The electronic device records the drawing control tree of this system window. Based on this drawing control tree, information about each control in the system window (including whether the control needs to be updated, the control's position in the system window, etc.) can be determined.

[0099] Surface windows, in this context, refer to windows that are not drawn using the system's image rendering engine. Generally, besides the system's image rendering engine, game engines, image codecs, and other modules can also draw surface windows. Common surface windows include SurfaceView or TextureView. These surface windows are typically used to display images or videos.

[0100] In some cases, the surface window itself is a drawable control, and the surface window (internal) does not contain any drawable controls. Surface windows are generally used to draw image content such as video and game graphics. A drawable control is a control whose content can be updated. However, a system window may contain at least one drawable control.

[0101] 4. This application relates to the screen refresh rate.

[0102] The number of frames per second (fps) refers to the number of times a display updates its image content. It's also known as the refresh rate and is usually expressed in Hertz (Hz). Each frame is a static image displayed on the screen. When these static images are updated continuously at a sufficiently fast rate, the human eye perceives a dynamic scene. For example, a 60Hz display means it refreshes 60 times per second, or once every 16.67 milliseconds.

[0103] In some embodiments, the refresh rate involved in this application includes a first refresh rate corresponding to a portion of the updated user interface, or a second refresh rate corresponding to the entire updated user interface.

[0104] Optionally, the first refresh rate can be higher than the second refresh rate.

[0105] In one possible implementation, the first refresh rate is the highest refresh rate of the screen.

[0106] In one possible implementation, the second refresh rate is the lowest refresh rate of the screen.

[0107] The minimum refresh rate of a screen refers to the lowest frequency at which a display can operate stably and virtually eliminate flicker. This value varies depending on the type of display and the technology used. For traditional displays, the minimum refresh rate for stable operation is 60Hz, because a 60Hz refresh rate can essentially eliminate image flicker and jitter, reducing eye strain. However, for low-temperature polycrystalline oxide (LTCO) screen technology, the minimum refresh rate can be as low as 1Hz or even 0.5Hz, saving significant power consumption by reducing the refresh rate.

[0108] 5. The DSI involved in this application (as shown in Figure 1) is mainly illustrated using the Mobile Industry Processor Interface (MIPI) DSI as an example.

[0109] MIPI is an interface standard developed by the Mobile Industry Processor Interface Alliance (MIPI Alliance) and is widely used in mobile devices such as smartphones and tablets. The MIPI standard defines various interfaces, including the MIPI Display Serial Interface (DSI) for connecting display devices.

[0110] MIPIDSI supports two main data transfer modes: Video mode and Command mode. These two modes define how data is transferred between the host device (such as a processor) and the display device (such as a screen). Command mode is typically used for screens with random access memory (RAM), where the display driver chip inside the screen reads data from RAM and automatically refreshes the display.

[0111] Command mode is typically used for screens with RAM. The DPU sends screen refresh data when it needs to change the displayed image, and the DDIC retrieves the data from the internal RAM at other times.

[0112] In video mode, the screen does not require internal RAM; the DPU must continuously send screen data according to the screen's refresh rate.

[0113] In comparison, Command mode consumes less power in static scenarios (such as a page where video playback is paused), but consumes more power in dynamic scenarios (such as when an application refreshes a page); Video mode consumes more power in static scenarios, but consumes less power in dynamic scenarios.

[0114] It is understood that the embodiments of this application are mainly implemented in video mode. That is to say, the embodiments of this application do not rely on RAM for implementation, or in other words, the embodiments of this application are applicable to both screens with RAM and screens without RAM.

[0115] As described in the background section, updating the entire screen to update the user interface when only some areas of the content need to be updated results in high power consumption when electronic devices refresh the screen.

[0116] In Video mode, neither RAM-cached data packets are used for screens with RAM (RAM screens) nor RAMless screens. Therefore, the DPU continuously sends data packets to the DDIC according to the screen's refresh rate so that the DDIC can refresh the display panel line by line. In one related technology, in a scenario where the entire area of ​​the user interface needs to be updated (or a full-screen frame refresh scenario), the DPU sends data packets to the DDIC line by line, starting from the first row of pixels in a frame and ending at the last row. In a scenario where only a portion of the user interface needs to be updated (or a partial frame refresh scenario), the DPU also sends data packets to the DDIC line by line, starting from the first row of pixels in a frame and ending at the last row. That is, when the non-ROI content of the user interface does not need to be updated, since RAM-cached data packets are not used in Video mode, the DPU needs to transmit not only data packets for the ROI to be updated but also data packets for the non-ROI to be updated to the DDIC. The data packets for the non-ROI to be updated in the current frame are not updated compared to the data packets for the non-ROI to be updated in the previous frame.

[0117] In other words, in scenarios requiring updates to the entire or partial area of ​​the user interface, both the DPU ROI processing module and the DDIC ROI processing module need to process the entire user interface area. The DPU transmits data packets to the DDIC to update the entire user interface area. Therefore, in partial frame refresh scenarios, compared to full-screen frame refresh, there is no improvement in refresh efficiency or reduction in refresh time, which is equivalent to wasting power. For example, with a refresh rate of 120Hz, in scenarios requiring updates to the entire or partial area of ​​the user interface, if both the DPU and DDIC process the entire user interface area, then the DPU's time for processing and transmitting data packets per frame is 8.33ms; and the DDIC's time for refreshing the display panel per frame is also 8.33ms.

[0118] Regarding the aforementioned related technologies, Figures 3(a) and (c) are schematic diagrams illustrating an example of a Region of Interest (ROI) in a partial frame refresh scenario provided by an embodiment of this application, and Figures 3(b) and (d) are timing diagrams illustrating an example of DPU data packet transmission provided by an embodiment of this application. In Figures 3(a) to (d), the left-diagonal filled area corresponds to the ROI of the user interface, and the gray filled area corresponds to the non-ROI of the user interface. Both the DPU ROI and the DDIC ROI include both the left-diagonal filled area and the gray filled area, indicating that both the DPU and DDIC process the areas to be updated corresponding to the ROI and non-ROI of the user interface. Figures 3(a) and (b) illustrate the user interface with a single ROI, while Figures 3(c) and (d) illustrate the user interface with multiple ROIs.

[0119] Figure 3(a) shows an example of a partial frame refresh scenario. Both the DPU and DDIC need to process the content of the entire user interface to be updated. The content of non-ROI1 and non-ROI2 corresponding to the gray-filled areas has not been updated compared to the previous frame. During the process of the DPU transmitting the data packet corresponding to the entire user interface to the DDIC, the data corresponding to non-ROI1, ROI0, and non-ROI2 are transmitted sequentially in time sequence 1, time sequence 2, and time sequence 3, respectively.

[0120] As shown in Figure 3(b), the main function of the vertical synchronization (Vsync) signal is to synchronize the display and the graphics processing unit (GPU). It ensures that the display does not begin displaying a new frame until it receives new image data. This avoids image tearing and flickering, providing a smoother and more stable visual experience.

[0121] The time interval between the rising and falling edges of a Vsync signal is called a vertical sync period. This period typically corresponds to the monitor's refresh rate. For example, if the monitor's refresh rate is 60Hz, then the vertical sync period is 1 / 60th of a second, or approximately 16.67 milliseconds. In practical applications, after the GPU renders a frame of image, it waits for the Vsync signal to arrive before transmitting that frame to the DPU, which then transmits it to the screen for display. If the GPU's rendering speed is too fast, exceeding the screen's refresh rate, the GPU will pause rendering until the next Vsync signal arrives. This ensures that the monitor does not experience image tearing or flickering when displaying a new frame.

[0122] Vertical back porch (VBP): The number of invalid lines at the beginning of a frame after the vertical synchronization period. For example, as shown in Figure 3(b), VBP occurs after the falling edge of the Vsync signal.

[0123] Vertical front porch (VFP): The number of invalid lines from the end of the current frame's data output to the start of the next frame's vertical synchronization cycle. For example, as shown in Figure 3(b), the VFP is located after the first Vsync signal, immediately following the rising edge of the second Vsync signal.

[0124] Between VBP and VFP corresponding to the same Vsync signal is the active area corresponding to that Vsync signal, used for processing and transmitting one frame of image corresponding to that Vsync signal.

[0125] The Vsync signal, VBP, and VFP in this application will be explained in a unified manner here, and will not be repeated below.

[0126] Figure 3(b) shows an example of DPU data packet transmission. Taking the DPU transmission of data packets used to refresh one frame of the screen as an example, within the active area, the DPU transmits data packets used to refresh the entire screen, or in other words, the data packets corresponding to the entire user interface, in the order of timing 1, timing 2, and timing 3. Accordingly, DDIC refreshes the display panel corresponding to the entire user interface.

[0127] Figure 3(c) illustrates an example of a partial frame refresh scenario. Both the DPU and DDIC need to process the entire user interface content to be updated. The content corresponding to non-ROI1, non-ROI2, and non-ROI3 in the gray-filled areas remains unchanged compared to the previous frame. During the transmission of one frame of screen refresh data from the DPU to the DDIC, the data corresponding to non-ROI1, ROI1, non-ROI2, ROI2, and non-ROI3 are transmitted sequentially at timings 1, 2, 3, 4, and 5, respectively.

[0128] Figure 3(d) shows an example of DPU data packet transmission. Taking the DPU transmission of data packets used to refresh one frame of the screen as an example, within the active area, the DPU transmits data packets used to refresh the entire screen, or in other words, the data packets corresponding to the entire user interface, in the order of timing 1, timing 2, timing 3, timing 4, and timing 5. Accordingly, DDIC refreshes the display panel corresponding to the entire user interface.

[0129] In summary, reducing power consumption is a pressing issue when only certain areas of the user interface need to be updated.

[0130] In view of this, this application provides a method for displaying an image. In a scenario where a portion of the display panel, namely the first area, is refreshed, the display processing unit obtains third image data for updating the first area and the position information of the first area in the display panel, and instructs the first area and transmits the third image data to the display driver chip. The display driver chip refreshes only the first area and does not refresh other areas of the display panel according to the third image data.

[0131] It is understood that in the above scheme, the display processing unit acts as the controller of screen refresh, triggering the display driver chip to refresh the display panel. That is to say, the above scheme is executed in Video mode. In the scenario of refreshing only a part of the display panel, compared with the above-mentioned related technologies in Video mode, in this application, the display processing unit does not process or transmit image data for updating other areas besides the first area to the display driver chip, and the display driver chip does not refresh other areas of the display panel besides the first area, thereby reducing fixed display latency (or improving display performance and responsiveness) and reducing display power consumption.

[0132] In other words, in this application, when refreshing a portion of the display panel, the starting position of the display driver chip refreshing the display panel does not start from the first row of pixels on the display panel, but directly from the first row of pixels in the first area. The ending position of the display driver chip refreshing the display panel does not end at the last row of pixels on the display panel, but directly at the last row of pixels in the first area.

[0133] Furthermore, compared to solutions that refresh a portion of the display panel based on Command Mode in the same scenario, this application can achieve partial screen refresh without relying on RAM, making it suitable for both RAMless and RAM-based screens, thus offering greater versatility and practicality.

[0134] Regarding the image display method provided in this application, Figures 4(a) and (c) are schematic diagrams of another example of ROI in a local frame refresh scenario provided by an embodiment of this application, and Figures 4(b) and (d) are timing diagrams of another example of DPU data packet transmission provided by an embodiment of this application. In Figures 4(a) to (d), the left-hand diagonal filled area corresponds to the ROI in the user interface. Both the DPU ROI and DDIC ROI only include the left-hand diagonal area, indicating that both DPU and DDIC only process the area corresponding to the ROI of the user interface. Among them, Figures 4(a) and (b) illustrate the user interface including a single ROI, and Figures 4(c) and (d) illustrate the user interface including multiple ROIs.

[0135] Figure 4(a) shows an example of a partial frame refresh scenario. Both the DPU and DDIC only process the content to be updated in ROI0. The DPU transmits the data corresponding to ROI0 to the DDIC at time 2'.

[0136] Figure 4(b) shows an example of DPU transmitting data packets. Within the active area, the DPU directly begins transmitting the data corresponding to ROI0; and after transmitting the data corresponding to ROI0 at time 2', the DPU enters low power (LP) mode and stops processing data. Correspondingly, the DDIC refreshes the area corresponding to ROI0 on the display panel.

[0137] Comparing Figure 4(b) and Figure 3(b), it can be seen that both timing 2' and timing 2 are used to transmit data corresponding to ROI0, but timing 2' is earlier than timing 2. This means that the image display method provided in this application refreshes the area corresponding to ROI0 on the display panel earlier than the aforementioned related technologies, thus significantly improving responsiveness. Comparing Figure 4(b) and Figure 3(b), it can also be seen that the working time of the DPU and DDIC in the image display method provided in this application is the same as the time of timing 2', while the working time of the DPU and DDIC in the aforementioned related technologies is the same as the time of timing 1 to timing 3. Therefore, the image display method provided in this application significantly reduces the working time of the DPU and DDIC and also significantly reduces power consumption compared to the aforementioned related technologies.

[0138] Taking Figure 4(a) and (b) as examples, assuming ROI0 occupies 1 / 3 of the user interface, the time required for the DPU to process and transmit the data corresponding to ROI0 is 2.78ms (8.3ms * 1 / 3), and the time required for the DDIC to refresh the area corresponding to ROI0 in the display panel is also 2.78ms (8.3ms * 1 / 3). Therefore, the responsiveness (display performance) is improved by 3 times. In other words, the actual improvement factor of display performance can vary with the size of the ROI. For example, the display performance improvement factor = the size of the user interface / the size of the ROI, or the display performance improvement factor = the size of the display panel / the size of the area corresponding to the ROI in the display panel.

[0139] As shown in Figure 4(c), this is an example of a partial frame refresh scenario. Both the DPU and DDIC only process the content to be updated for ROI1 and ROI2. The DPU transmits the data corresponding to ROI1 and ROI2 to the DDIC at time 2' and time 4' respectively.

[0140] Figure 4(d) illustrates an example of DPU data packet transmission. Within the active area, the DPU directly begins transmitting the data corresponding to ROI1 and ROI2. After transmitting the data corresponding to ROI1 and ROI2 at times 2' and 4', the DPU enters LP mode and stops processing data. Correspondingly, the DDIC refreshes the display panel showing the areas corresponding to ROI1 and ROI2.

[0141] The conclusions or inferences that can be drawn by comparing (d) in Figure 4 and (d) in Figure 3 are similar to the conclusions or inferences drawn by comparing (b) in Figure 4 and (b) in Figure 3 above, and will not be repeated here.

[0142] In summary, comparing Figures 3 and 4, it can be seen that the image display method provided in this application directly refreshes the screen area corresponding to the ROI in the user interface, thus directly updating the content of the ROI in the user interface. Compared to refreshing the entire screen area to update the content of the ROI in the user interface, it can display the updated content of the ROI earlier in each screen refresh, thereby improving display performance; the hardware and software working time in each screen refresh is shorter, and it enters the LP state immediately after refreshing the area corresponding to the ROI in the display panel, which can save power consumption.

[0143] Figure 5 is a schematic diagram of the hardware and software structure involved in updating the user interface of the electronic device provided in the embodiment of this application.

[0144] As shown in Figure 5, the layered architecture divides the hardware and software structure into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces.

[0145] In some embodiments, the hardware and software architecture is divided into four layers, from top to bottom: application layer, system library, kernel layer, and hardware layer.

[0146] The application layer can include a series of applications, or simply applications.

[0147] An application can provide windows to display content on the screen; all the content displayed on the screen can be called the user interface. The windows included in this user interface can come from different applications. Windows in a user interface can include system windows, surface windows, etc. For more information on system windows and surface windows, please refer to the relevant content above; they will not be repeated here.

[0148] The system library may include image rendering engines and image blending renderers. Common image rendering engines may include hardware user interface (HWUI), and common image blending renderers may include HWC (height-width-channel).

[0149] The image rendering engine includes a Region of Interest (ROI) calculation module. This module determines the system window whose content needs updating within the user interface and the area within the system window that needs updating relative to the user interface. The updated area within the system window, relative to the user interface, is then sent to the image blending renderer. The system window whose content needs updating within the user interface can include one or more windows.

[0150] The image blending renderer includes a DPU ROI calculation module.

[0151] The DPU ROI calculation module can be used to obtain the area to be updated relative to the user interface of the surface window whose content needs to be updated. It can also be used to obtain the area to be updated relative to the display panel, obtained by expanding the areas to be updated relative to the user interface in the system window and the surface window. Based on this area to be updated relative to the display panel in the user interface, the DPU ROI is then calculated.

[0152] The kernel layer may include a display driver. This display driver is typically a software display engine (SDE) driver.

[0153] The display driver can be used to respond to requests to update the user interface, driving the hardware to update and display the user interface.

[0154] The DPU ROI calculation module in the image blending renderer transmits the DPU ROI to the display driver, which can transmit the DPU ROI to the DPU, and optionally to the DDIC.

[0155] The hardware layer may include a graphics processing unit (GPU), a display processing unit (DPU), and a display driver chip (DDIC).

[0156] The image rendering engine and image blending renderer transmit the system window and surface window to the GPU. The GPU can update the system window to obtain the updated system window, and update the surface window to obtain the updated surface window.

[0157] The DPU can be used to blend updated system windows and updated surface windows, determine the updated content in the area to be updated in the blended window, and obtain the DPU image. The DPU then transmits the DPU image to the DDIC.

[0158] Even if the display driver does not transmit the DPU ROI to the DDIC, the DPU will still transmit the DPU ROI to the DDIC. In this application, the DPU ROI is consistent with the DDIC ROI. That is, the DPU and DDIC ROI are aligned.

[0159] DDIC can be used to determine the update content in the DDIC update area of ​​the DPU image based on the DDIC ROI, thus obtaining the DDIC image. The content of the area occupied by the ROI in the user interface is then updated using this DDIC image, resulting in the updated user interface. In other words, DDIC is also used to refresh the display panel area used to display the updated content from the DDIC ROI, while maintaining the pixels displaying content in other areas of the display panel in their state since the last time they were lit, thereby displaying the updated user interface on the display panel.

[0160] The specific interactions at the hardware layer can be found in the relevant description in Figure 1, and will not be elaborated upon here.

[0161] Optionally, some control commands can be transmitted between the DPU and DDIC (not shown in Figure 5), such as the DDIC transmitting the TE signal to the DPU, and the DPU transmitting the cmd command to the DDIC. These will be described in detail below with reference to the interaction diagram between the DPU and DDIC.

[0162] Figure 6 is a schematic diagram of an image display method 100 provided in an embodiment of this application. The image display method 100 is illustrated using an example of a portion of the user interface that needs updating.

[0163] S101, the application requests the image rendering engine to update the system window.

[0164] S102, the application requests an update to the surface window from the image blending renderer.

[0165] Understandably, in specific implementations, the execution of S101 and / or S102 is determined based on whether the ROI of the user interface includes system windows and / or surface windows. This explanation uses the execution of S101 and S102 as an example and does not limit the scope of protection of this application.

[0166] The DPU ROI transfer process (S103 to S108a or S108b) will be introduced first, followed by the DPU image 1 transfer process (S109 to S112). S112 is executed after S107. The numbering of other steps in the DPU ROI transfer process and the DPU image 1 transfer process does not restrict the execution order of the corresponding steps.

[0167] The DPU ROI transfer process includes S103 to S108a or S108b.

[0168] S103, the image rendering engine transmits the system window to the ROI calculation module.

[0169] The ROI calculation module determines the area to be updated in the system window relative to the user interface.

[0170] S104, the image blending renderer transmits the surface window to the DPU ROI calculation module.

[0171] The DPU ROI calculation module determines the area to be updated in the surface window relative to the user interface.

[0172] S105, the ROI calculation module transmits the region to be updated 1 to the DPU ROI calculation module.

[0173] The DPU ROI calculation module calculates the positions of the areas to be updated 1 and the areas to be updated 2 relative to the display panel, and uses these positions as the DPU ROI.

[0174] In other words, the DPU ROI calculation module converts the positions of the regions to be updated 1 and 2 relative to the user interface (e.g., represented by coordinates) into the position of the region to be updated 3 relative to the display panel (e.g., represented by coordinates). The region to be updated 3 is the DPU ROI.

[0175] S106, the DPU ROI calculation module indicates the DPU ROI to the display driver.

[0176] It is understandable that the display driver can be the DPU driver mentioned above.

[0177] S107, the display driver indicates the DPU ROI to the DPU.

[0178] For example, the display driver transmits the position of the DPU ROI relative to the display panel to the DPU. For instance, the position of the DPU ROI relative to the display panel is the row or column number of the DPU ROI relative to the display panel, or the coordinates of the top-left pixel (1) and bottom-right pixel (2) of the DPU ROI.

[0179] For example, the display driver indicates the DPU ROI by transmitting register values ​​to the DPU, and the DPU updates its internal register state upon receiving the register values. Optionally, if the DPU ROI corresponds to multiple independent areas in the display panel, the display driver can instruct multiple sets of register values ​​to indicate the multiple independent areas respectively (e.g., one set of register values ​​indicates one independent area).

[0180] For example, the DPU includes register 1 and register 2, with addresses 2A and 2B respectively; or, the DPU includes register 3, which consists of two parts with addresses 2A and 2B respectively. The register (or part of the register) at address 2A stores the starting and ending column numbers of pixels in the display panel; the register (or part of the register) at address 2B stores the starting and ending row numbers of pixels in the display panel.

[0181] Figure 7 is a schematic diagram of indicating the area to be updated on the display panel by means of the value of the indicator register according to an embodiment of this application.

[0182] As shown in Figure 7(a), taking the area to be updated in the user interface as ROI0 as an example, assuming that ROI0 corresponds to DPU ROI0, the position of DPU ROI0 relative to the display panel is indicated by the starting column number (XS1) and ending column number (XE1) of the pixel corresponding to the register (or part of the register) at address 2A, and the starting row number (YS1) and ending row number (YE1) of the pixel corresponding to the register (or part of the register) at address 2B.

[0183] In other words, the values ​​of the registers indicated by the display driver to the DPU are 2A->XS1, 2A->XE1, 2B->YS1, and 2B->YE1. After receiving the register values, the DPU updates its internal register state and determines the position of DPU ROI0 relative to the display panel.

[0184] As shown in Figure 7(a), taking the user interface update areas ROI1 and ROI2 as an example, assuming ROI1 and ROI2 correspond to DPU ROI1 and DPU ROI2 respectively. The position of DPU ROI1 relative to the display panel is indicated by the start column number (XS2) and end column number (XE2) of the pixel corresponding to the register (or part of the register) at address 2A, and the start row number (YS2) and end row number (YE2) of the pixel corresponding to the register (or part of the register) at address 2B. The position of DPU ROI2 relative to the display panel is indicated by the start column number (XS3) and end column number (XE3) of the pixel corresponding to the register (or part of the register) at address 2A, and the start row number (YS3) and end row number (YE3) of the pixel corresponding to the register (or part of the register) at address 2B.

[0185] In other words, the display driver instructs the DPU to set the values ​​of one set of registers to 2A->XS2, 2A->XE2, 2B->YS2, and 2B->YE2, and the values ​​of another set of registers to 2A->XS3, 2A->XE3, 2B->YS3, and 2B->YE3. After receiving the register values, the DPU updates its internal register state and determines the positions of DPU ROI1 and DPU ROI2 relative to the display panel.

[0186] After S107, execute S108a or S108b.

[0187] S108a, the display driver indicates the DPU ROI to the DDIC.

[0188] DDIC determines its ROI based on DPU ROI. As mentioned above, in this application, the DDIC ROI is consistent with the DPU ROI.

[0189] S108a can refer to the relevant description in S107 where the display driver instructs the DPU ROI to the DPU (including the relevant description in Figure 7), the difference being that the hardware interacting with the display driver is replaced by the DDIC instead of the DPU.

[0190] S108b, the DPU indicates the DPU ROI to the DDIC.

[0191] DDIC determines its ROI based on DPU ROI. As mentioned above, in this application, the DDIC ROI is consistent with the DPU ROI.

[0192] S108b can refer to the relevant description in S108b of the display driver indicating the DPU ROI to the DDIC (including the relevant description in Figure 7), the difference being that the display driver is replaced by the DPU.

[0193] With S108a or S108b, the DPU and DDIC can be aligned with the DPU ROI and DDIC ROI, which means they can be aligned with the position of the area to be updated in the display panel.

[0194] For example, in S108a or S108b, the DPU ROI can be indicated by a first indication message. For example, the first indication message may be a first cmd command, or the DPU ROI may be indicated by other control instructions; this application does not limit this.

[0195] The DPU image 1 transmission process includes steps S109 to S112.

[0196] S109, the image rendering engine transmits the system window to the GPU.

[0197] The GPU updates the system window, resulting in the updated system window.

[0198] S110, the image blending renderer transmits surface windows to the GPU.

[0199] The GPU updates the surface window to obtain the updated surface window.

[0200] S111, the GPU transmits the updated system window and surface window to the DPU.

[0201] The DPU determines the DPU image 1 corresponding to the DPU ROI based on the updated system window, the updated surface window, and the DPU ROI.

[0202] Understandably, when updating only a portion of the user interface, in S109 and S110, the GPU can process only the regions to be updated 1 and 2, obtaining image 1 and image 2 to be updated, respectively. In S111, the GPU can transmit image 3, which corresponds to the entire user interface, to the DPU, where regions to be updated 1 and 2 in image 3 correspond to image 1 and image 2, respectively.

[0203] It is also understandable that the image to be updated, 3, also corresponds to the entire display panel. Based on the DPU ROI, the DPU determines the DPU image 1 corresponding to the ROI of the user interface in the image to be updated, 3.

[0204] S112, DPU transmits DPU image 1 to DDIC.

[0205] DDIC determines DDIC image 1 based on DPU image 1.

[0206] After the DPU ROI transfer process and the DPU image 1 transfer process, S113 is executed.

[0207] S113, DDIC refreshes the display panel area corresponding to DDIC ROI based on DDIC image 1.

[0208] In the above scheme, the DPU and DDIC align the area to be updated to a portion of the display panel. The DPU only transmits the image used to update that portion of the display panel to the DDIC, and the DDIC refreshes that portion of the display panel based on the image. In other words, neither the DPU nor the DDIC processes data corresponding to non-ROIs in the user interface, thereby reducing fixed display latency (or improving display performance and responsiveness) and reducing display power consumption.

[0209] It is understandable that a screen cannot remain in a non-refreshing state indefinitely; for example, prolonged periods without refreshing can damage the screen's hardware. Building upon image display method 100, this application further considers that if an application updates only a portion of the user interface (ROI) for an extended period without refreshing non-ROIs, it may damage the screen, and the non-ROIs of the user interface may display poorly. Therefore, this application refreshes the non-ROIs by forcibly refreshing the entire screen at a certain refresh rate in scenarios requiring updates to a portion of the user interface, thus ensuring normal screen display.

[0210] Assume that the area of ​​the display panel corresponding to the ROI in the user interface is refreshed according to the first refresh rate; and the entire area of ​​the display panel is refreshed according to the second refresh rate.

[0211] Preferably, the first refresh rate is higher than the second refresh rate. This is understandable, as a first refresh rate that is lower than or equal to the second refresh rate can further optimize display performance and power consumption.

[0212] For example, the first refresh rate is less than or equal to a first threshold. For example, the first threshold is the screen's maximum refresh rate.

[0213] For example, the second refresh rate is greater than or equal to the second threshold. For example, the second threshold is the minimum refresh rate of the screen.

[0214] In one possible implementation, the first refresh rate is the screen's highest refresh rate, and the second refresh rate is the screen's lowest refresh rate ≤ second refresh rate ≤ first refresh rate ≤ highest refresh rate. For example, the screen's highest refresh rate is 120Hz, and its lowest refresh rate is 1Hz. This involves partial refresh at 120Hz and full-screen refresh at 1Hz.

[0215] Figure 8 is a schematic diagram of a forced full-screen refresh in a scenario where a portion of the user interface needs to be updated, according to an embodiment of this application. In Figures 8(a) to (c), the areas filled with small squares are the areas processed by the DPU or DDIC.

[0216] As shown in Figures 8(a) and (b), although the areas that the application needs to update in the current frame are ROI0, or ROI1 and ROI2, in order to satisfy the condition that the second refresh rate is greater than or equal to the second threshold, the DPU and DDIC will process the data corresponding to all areas of the user interface, and the DDIC will refresh all areas of the display panel.

[0217] As shown in Figure 8(c), the DPU continuously transmits data corresponding to all areas of the user interface to the DDIC.

[0218] It is also understood that in the scheme of forcing full-screen refresh based on the second refresh rate on the basis of image display method 100, the full-screen refresh can be triggered by different execution entities. These execution entities can be hardware or software. For example, it can be triggered by DDIC or DPU. For example, it can be triggered by the display driver. The following section, with reference to Figure 9, provides a detailed introduction to possible implementation methods.

[0219] It should be noted that the scheme of forcing a full-screen refresh based on the second refresh rate is performed in scenarios where the application requests an update to a portion of the user interface in the current frame. In other words, in the user interface update request corresponding to the frame that performs a full-screen refresh of the entire display panel, the area to be updated for the user interface is only a portion of the area. Therefore, S201 to S207 and S201 to S212 in Figure 9 below can be referred to in the relevant descriptions of S101 to S107 and S109 to S111 above, respectively.

[0220] Furthermore, this application also provides triggering times corresponding to different execution entities. For example, the execution entity mainly determines the triggering time based on a second threshold. Possible implementation methods are described in detail below with reference to Figures 10 to 12.

[0221] Figure 9 is a schematic diagram of the image display method 200 provided in an embodiment of this application.

[0222] It is understood that image display method 200 can be combined with the image display method 100 described above. For example, image display method 200 may be executed before image display method 100, and / or after image display method 100.

[0223] S201 to S202 can be found in the description of S101 to S102 above.

[0224] The following section first describes the forced full-screen refresh step (S203 to step A, B, or C) in the DPU ROI transmission process, followed by the DPU image 2 transmission process (S209 to S213). Step S213 is executed after step A, B, or C, and the numbering of other steps in S201 to S203 does not restrict the execution order. For example, step A, B, or C can be executed before S201, or before S203.

[0225] For S203 to S207, please refer to the description of S103 to S107 above.

[0226] Steps A, B, and C are parallel steps, meaning that method 200 includes one of steps A, B, and C.

[0227] Step A includes: S208a, the DDIC transmits second instruction information to the DPU.

[0228] The second instruction indicates that the entire area of ​​the display panel should be refreshed.

[0229] For example, the second indication information is a tearing effect (TE) signal, or it can be transmitted to the DPU through other control commands to instruct the refresh of the entire area of ​​the display panel, which is not limited in this application.

[0230] Optionally, step A may also include: S209, the DPU transmits third indication information to the DDIC.

[0231] The third instruction indicates that the entire area of ​​the display panel should be refreshed.

[0232] For example, the third instruction information is the second cmd command, or it can also be used to instruct DDIC to refresh the entire area of ​​the display panel through other control instructions, which is not limited in this application.

[0233] In other words, in step A, the entity that triggers the full-screen refresh is DDIC, and the triggering timing can be understood as the timing of the transmission of the second indication information. The following text will also introduce the scheme for DDIC to determine the triggering timing for step A.

[0234] Step B includes: S208b, the DPU transmits the fourth instruction information to the DDIC.

[0235] The fourth instruction indicates that the entire area of ​​the display panel should be refreshed.

[0236] For example, the fourth instruction message is the third cmd command, or it can also be used to instruct DDIC to refresh the entire area of ​​the display panel through other control instructions, which is not limited in this application.

[0237] In other words, in step B, the execution entity that triggers the full-screen refresh is the DPU, and the triggering timing can be understood as the timing of the transmission of the fourth instruction information. The following text will also introduce the scheme for the DPU to determine the triggering timing in step B.

[0238] Step C includes: S208c, display driver transmitting fifth instruction information to DPU; and S208d, display driver transmitting sixth instruction information to DDIC.

[0239] The fifth and sixth indicator messages both indicate that the entire area of ​​the display panel should be refreshed.

[0240] For example, the fifth instruction message is the fourth cmd command, the sixth instruction message is the fifth cmd command, or other control commands can be used to instruct DDIC to refresh the entire area of ​​the display panel; this application does not limit this.

[0241] In other words, in step C, the entity that triggers the full-screen refresh is the display driver. The triggering timing can be understood as the timing of the transmission of the fifth or sixth instruction information. The following section will also introduce the display driver's method for determining the triggering timing in step C.

[0242] Optionally, before step A, step B, or step C, method 200 further includes: the executing entity determining, based on a second threshold, whether to perform a full-screen refresh (not shown in the figure).

[0243] For example, the deadline for a forced fullscreen refresh is determined based on a first time point and a second threshold (hereinafter referred to as R2 for ease of explanation).

[0244] Understandably, a full-screen refresh of the current frame needs to be completed before the deadline.

[0245] In one possible implementation, if there are non-ROIs in the user interface that have not been refreshed after screen initialization, then the first moment is the screen initialization time.

[0246] For example, if the second threshold is 1Hz, then the cutoff time is the 1st second after the screen initialization time.

[0247] In another possible implementation, a full-screen refresh is detected before the current frame, with the first moment being the time of the full-screen refresh in the previous frame (which can be any moment in the full-screen refresh of the previous frame, such as the start time or end time).

[0248] For example, if the second threshold is 0.5Hz, then the cutoff time is the second second after the end time of the previous full-screen refresh.

[0249] It is understandable that the previous full-screen refresh here can be a full-screen refresh performed when the user interface needs to update the entire area, or it can be a full-screen refresh performed when the user interface only needs to update the entire area.

[0250] In other words, the scheme for performing full-screen refresh based on the second refresh rate in this application does not limit the second refresh rate to a fixed value when the second threshold is determined. For example, this scheme can be understood as follows: between the full-screen refresh of the previous frame and the full-screen refresh of the current frame, DDIC only refreshes a portion of the display panel; and the time interval between the first moment corresponding to the previous frame and the second moment corresponding to the current frame is less than or equal to one-half of the second threshold (i.e., The relative position of the first moment in the previous frame is the same as the relative position of the second moment in the current frame.

[0251] Optionally, if a full-screen refresh is to be performed, the triggering timing can be determined. Please refer to Figures 10 to 12 below for relevant solutions.

[0252] S201 to S212 can be referred to the relevant descriptions of S109 to S111 above. The difference is that after S212, the processing of the updated system window and the updated surface window obtained from the GPU by the DPU is different from that in image display method 100.

[0253] After S201, the DPU determines the DPU image 2 corresponding to the entire area of ​​the display panel based on the updated system window, the updated surface window, and step A, step B, or step C.

[0254] For example, corresponding to step A, in response to the second instruction information, the DPU determines DPU image 2.

[0255] For example, corresponding to step B, before transmitting the fourth instruction information, the DPU also determines whether to perform a full-screen refresh. Thus, the DPU determines DPU image 2.

[0256] For example, corresponding to step C, in response to the fifth instruction information, the DPU determines DPU image 2.

[0257] Understandably, when updating only a portion of the user interface, in S210 and S211, the GPU can process only the regions to be updated 1 and 2, obtaining image 1 and image 2 to be updated, respectively. In S212, the GPU can transmit image 3, which corresponds to the entire user interface, to the DPU, where regions to be updated 1 and 2 in image 3 correspond to image 1 and image 2, respectively.

[0258] It is also understood that the image to be updated, 3, also corresponds to the entire display panel. The DPU determines the DPU image 2 corresponding to the entire area of ​​the user interface based on the image to be updated, according to step A, step B, or step C.

[0259] S213, DPU transmits DPU image 2 to DDIC.

[0260] DDIC determines DDIC image 2 based on DPU image 2.

[0261] After the forced full-screen refresh step and the DPU image 2 transmission process, S214 is executed.

[0262] S214, DDIC refreshes the entire area of ​​the display panel according to DDIC image 2.

[0263] The above solution, in scenarios where the application requests to update a portion of the user interface, forces a full-screen refresh based on the second refresh rate. This can improve responsiveness and reduce display power consumption while ensuring the display effect to guarantee user experience and extend the screen's lifespan.

[0264] Figure 10 is a schematic diagram of an example of full-screen refresh triggered by DDIC according to an embodiment of this application. Figure 10 corresponds to step A above.

[0265] Figure 10(a) shows an example of the combination of image display method 200 and image display method 100. An example is given where the TE signal is used as the second indication information, and an example is given where the first cmd command is used as the first indication information.

[0266] As shown in Figure 10(a), each Vsync signal triggers the DPU to process and transmit one frame of data for refreshing the display panel. For example, in Figure 10(a), the three frames of data processed and transmitted by the DPU all correspond to the user interface requesting an update of a portion of the area. For example, the frame of data corresponding to the first cmd command could be the DPU image 1 described above; the frame of data corresponding to the TE signal could be the DPU image 2 described above.

[0267] As shown in Figure 10(a), before the DPU transmits a frame of data, it transmits the first cmd command and TE signal corresponding to that frame of data.

[0268] Additionally, the LP in Figure 10 can be found in the relevant explanation above, and will not be repeated here.

[0269] Figure 10(b) is a schematic diagram of an example of triggering timing. The transmission timing of the TE signal is used as an example of triggering timing for illustration.

[0270] As shown in Figure 10(b), after the DPU and DDIC collaboratively perform a full-screen refresh of frame a (i.e., refresh the entire area of ​​the display panel), they collaboratively perform a partial refresh of frame x (i.e., refresh a portion of the display panel). Then, before the deadline #1, the DDIC transmits a TE signal to the DPU, triggering the DPU and DDIC to collaboratively execute a+1th full-screen refresh. Here, a ≥ 1 and a is an integer, and x ≥ 1 and x is an integer.

[0271] For example, in Figure 10(b), Let's take the first moment #1 as the end time for the DPU to transmit the full-screen refresh data of frame a to the DDIC as an example. Deadline #1 = First moment #1 + T1. The TE signal is transmitted before the deadline #1.

[0272] For example, the third moment #1 of transmitting the TE signal is before the deadline, and the time interval between the transmission and the deadline is greater than or equal to a preset interval.

[0273] The above solution instructs a full-screen refresh when the time interval before the deadline is greater than or equal to a preset interval. This can improve the success rate of completing a full-screen refresh before the deadline, ensuring the display effect of the screen, guaranteeing the user experience, and extending the lifespan of the screen.

[0274] Figure 10(c) is a schematic diagram of an example of triggering timing. Figure 10(c) provides a further example based on Figure 10(b). Specifically, it uses T2 as an example of a preset interval.

[0275] For example, after determining the deadline as described above, the fourth time #1 can be determined based on the deadline and a preset interval (e.g., T2). This fourth time #1 is the latest time to transmit the TE signal. That is, the fourth time #1 = deadline #1 - preset interval. The third time #1 must be earlier than or equal to the fourth time #1.

[0276] As shown in Figure 10(c), one example uses the time corresponding to the rising edge of the TE signal as the third time #1, and another example uses the case where the third time #1 equals the fourth time #1. The time interval between the time corresponding to the rising edge of the TE signal and the cutoff time #1 is T2.

[0277] For example, T2 is the preset value configured for DDIC during the initialization of an electronic device equipped with DDIC, and T2 < T1.

[0278] The following section, in conjunction with Figure 10(c), describes how to determine the preset interval.

[0279] For example, a preset interval is determined based on the time required for the DPU to transmit one frame of data (sixth image data, such as DPU image 2). For instance, the preset interval is greater than or equal to the time required for the DPU to transmit one frame of data.

[0280] For example, a preset interval can be determined based on the time required for the DPU to process and transmit one frame of full-screen refresh data. For instance, the preset interval can be greater than or equal to the time required for the DPU to process and transmit one frame of full-screen refresh data.

[0281] The above solution determines the range of preset intervals based on the time it takes for the display processing unit to process and transmit the sixth image data, thereby further improving the success rate of completing a full-screen refresh before the deadline, ensuring the display effect of the screen to guarantee the user experience, and extending the lifespan of the screen.

[0282] As shown in Figure 10(c), T3 is the time required for the DPU to process the full-screen refresh data of the (a+1)th frame, and T4 is the time required for the DPU to transmit the full-screen refresh data of the (a+1)th frame. T2 ≥ T4. Preferably, T2 ≥ T3 + T4.

[0283] In one possible implementation, the DDIC starts a countdown timer at deadline #1, with an initial countdown duration of T1. During the countdown, a TE signal is transmitted to the DPU at or before the real-time duration of the timer reaches T2.

[0284] In addition, VS in Figures 10 to 12 is the Vsync signal mentioned above, which will be explained here and will not be repeated below.

[0285] Figure 11 is a schematic diagram of an example of full-screen refresh triggered by DPU according to an embodiment of this application. Figure 11 corresponds to step B above.

[0286] Figure 11(a) shows an example of the combination of image display method 200 and image display method 100. An example is illustrated using the first cmd command as the first instruction information.

[0287] For details of Figure 11(a), please refer to the relevant description in Figure 10(a), the difference being that the TE signal is replaced with the fourth indication information.

[0288] Figure 11(b) is a schematic diagram of an example of triggering timing. The transmission timing of the fourth indication information is used as an example of triggering timing for illustration.

[0289] For example, the DPU counts based on the Vsync signal, and if the count reaches a threshold (K), it transmits a fourth indication message.

[0290] For example, the counting rule is as follows: a counting process is performed every time a Vsync signal is detected. This counting process includes: if the Vsync signal corresponds to a full-screen refresh data frame, the count is set to 1 and the counting starts again; if the Vsync signal corresponds to a partial refresh data frame, the count is incremented by 1.

[0291] Optionally, after device initialization, the count starts from 1.

[0292] For example, the DPU starts counting from 1. After starting the count, if the detected Vsync signal corresponds to full-screen refresh data, the count remains at 1. The count is incremented by 1 until a Vsync signal corresponding to partial refresh data is detected. Alternatively, after starting the count, if the first detected Vsync signal corresponds to a frame of partial refresh data, the count is incremented by 1.

[0293] For example, after the count reaches ≥1, if all subsequent detected Vsync signals correspond to locally refreshed data, the count is incremented by 1 for each detected Vsync signal. When the count reaches the threshold, a fourth indication message is transmitted to the DDIC. Then, the count is reset to 1, and counting restarts.

[0294] For example, once the count is ≥1, if all subsequent detected Vsync signals correspond to partially refreshed data, the count is incremented by 1 for each detected Vsync signal. When the count is less than the threshold, if the user interface update request indicates updating the entire user interface area, the count is reset to 1 and the counting restarts when a Vsync signal corresponding to a frame of partially refreshed data is detected.

[0295] Taking Figure 11(a) as an example, when the Vsync signal corresponding to the first fifth indication information is detected, the count is 1. The number of corresponding Vsync signals between the Vsync signal corresponding to the first fifth indication information and the Vsync signal corresponding to the second fifth indication information is at most K-1. That is, there are at most K Vsync signals between the Vsync signal corresponding to the first fifth indication information and the Vsync signal corresponding to the second fifth indication information.

[0296] As can be understood, in Figure 11(b), the example is taken where there are K-1 Vsync signals between the two Vsync signals corresponding to the full-screen refresh data of two adjacent frames.

[0297] As shown in Figure 11(b), after the DPU and DDIC collaboratively perform a full-screen refresh of frame b, they collaboratively perform a partial refresh of frame K-1. Then, before the deadline #2, the DPU transmits the fourth instruction information to the DDIC, and the DPU and DDIC collaboratively perform a full-screen refresh of frame b+1. Here, b ≥ 1 and b is an integer, and K ≥ 2 and K is an integer.

[0298] According to the counting rules described above, in Figure 11(b), when the Vsync signal used to trigger the DPU to transmit the full-screen refresh data of frame b is detected, the count is set to 1, and the counting restarts. Before the Vsync signal used to trigger the DPU to transmit the full-screen refresh data of frame b+1 is detected, the count is K; upon detecting this Vsync signal, the count is reset to 1.

[0299] For example, when the count reaches K, a fourth indication message is transmitted.

[0300] For example, the quantity threshold (K) can be determined based on a first threshold (R1) and a second threshold (R2).

[0301] For example,

[0302] in, Indicates to Round down to the nearest integer.

[0303] For example, if R2 = 1Hz and R1 = 80Hz, then K = 80. Or, if R2 = 0.5Hz and R1 = 70Hz, then K = 140.

[0304] For example, in Figure 11(b), Taking the rising edge of the Vsync signal used to trigger the DPU to transmit the full-screen refresh data of frame b as an example, with the first moment #2 as the starting point, the deadline #2 = first moment #2 + T1'. The deadline #2 is the latest time when the Vsync signal triggers the DPU to transmit the full-screen refresh data of frame b+1, or in other words, the latest time when the rising edge of the Vsync signal used to trigger the DPU to transmit the full-screen refresh data of frame b+1 is.

[0305] For example, the fourth instruction information is transmitted before the deadline #2.

[0306] For example, the third moment #2 for transmitting the fourth instruction information is before the deadline, and the time interval between the second moment and the deadline is greater than or equal to a preset interval.

[0307] The above solution instructs a full-screen refresh when the time interval before the deadline is greater than or equal to a preset interval. This can improve the success rate of completing a full-screen refresh before the deadline, ensuring the display effect of the screen, guaranteeing the user experience, and extending the lifespan of the screen.

[0308] Figure 11(c) is a schematic diagram of an example of triggering timing. Figure 11(c) provides a further example based on Figure 11(b). Specifically, it uses T2' as an example of a preset interval for illustration.

[0309] For example, after determining the deadline #2 as described above, the fourth time #2 can be determined based on the deadline #2 and a preset interval (e.g., T2'). This fourth time #2 is the latest time to transmit the fourth indication information. That is, the fourth time #2 = deadline #2 - preset interval. The third time #2 must be earlier than or equal to the fourth time #2.

[0310] As shown in Figure 11(c), taking the third time point #2 being equal to the fourth time point #2 as an example, the time interval between the rising edge of the fourth indication information and the cutoff time #2 is T2'.

[0311] For example, T2' is the preset value configured for DDIC during the initialization of an electronic device equipped with DDIC, and T2' < T1'.

[0312] The following section, in conjunction with Figure 11(c), describes how to determine the preset interval.

[0313] For example, a preset interval is determined based on the time required for the DPU to process one frame of full-screen refresh data (sixth image data, such as DPU image 2). For example, the preset interval is greater than or equal to the time required for the DPU to process one frame of full-screen refresh data.

[0314] The above solution determines the range of preset intervals based on the time it takes for the display processing unit to process the sixth image data, thereby further improving the success rate of completing a full-screen refresh before the deadline, ensuring the display effect of the screen to guarantee the user experience, and extending the lifespan of the screen.

[0315] As shown in Figure 11(c), T3' is the time required for the DPU to process the full-screen refresh data of the (b+1)th frame, and T2'≥T3'.

[0316] In one possible implementation, the DDIC starts a countdown timer at deadline #2, with an initial countdown duration of T1'. During the countdown, at or before the real-time duration of the timer reaches T2', a fourth indication message is transmitted to the DPU.

[0317] Figure 12 is a schematic diagram of an example of full-screen refresh triggered by a display driver according to an embodiment of this application. Figure 12 corresponds to step C above.

[0318] Figures 12(a) to (c) can be found in the descriptions of Figures 11(a) to (c), with the difference being that the counting execution entity is replaced by the display driver instead of the DPU, and the fourth indication information is replaced by the fifth and / or sixth indication information.

[0319] Figure 13 is a schematic diagram of the hardware structure of an electronic device 1000 provided in an embodiment of this application. Referring to Figure 13, the electronic device 1000 may include a processor 1010, an external memory interface 1020, an internal memory 1021, a universal serial bus (USB) interface 1030, a charging management module 1040, a power management module 1041, a battery 1042, antenna 1, antenna 2, a mobile communication module 1050, a wireless communication module 1060, an audio module 1070, a speaker 1070A, a receiver 1070B, a microphone 1070C, a headphone jack 1070D, a sensor module 1080, buttons 1090, a motor 1091, an indicator 1092, a camera 1093, a display screen 1094, and a subscriber identification module (SIM) card interface 1095, etc. The sensor module 1080 may include a pressure sensor 1080A, a gyroscope sensor 1080B, a barometric pressure sensor 1080C, a magnetic sensor 1080D, an accelerometer sensor 1080E, a distance sensor 1080F, a proximity sensor 1080G, a fingerprint sensor 1080H, a temperature sensor 1080J, a touch sensor 1080K, an ambient light sensor 1080L, a bone conduction sensor 1080M, etc.

[0320] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device 1000. In other embodiments of this application, the electronic device 1000 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0321] The processor 1010 may include one or more processing units, such as an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processing unit (NPU).

[0322] The controller can be the nerve center and command center of the electronic device 1000. The controller can generate operation control signals according to the instruction opcode and timing signals to complete the control of instruction fetching and execution.

[0323] The processor 1010 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 1010 is a cache memory. This memory can store instructions or data that the processor 1010 has just used or that are used repeatedly. If the processor 1010 needs to use the instruction or data again, it can retrieve it directly from this memory. This avoids repeated accesses, reduces the waiting time of the processor 1010, and thus improves the efficiency of the system.

[0324] In some embodiments, the processor 1010 may include one or more interfaces, such as an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0325] The MIPI interface can be used to connect the processor 1010 to peripheral devices such as the display screen 1094 and the camera 1093. The MIPI interface includes a camera serial interface (CSI) and a display serial interface (DSI). In some embodiments, the processor 1010 and the camera 1093 communicate via the CSI interface to enable the electronic device 1000 to perform its shooting function. The processor 1010 and the display screen 1094 communicate via the DSI interface to enable the electronic device 1000 to perform its display function.

[0326] It is understood that the interface connection relationships between the modules illustrated in the embodiments of this application are merely illustrative and do not constitute a structural limitation on the electronic device 1000. In other embodiments of this application, the electronic device 1000 may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.

[0327] The charging management module 1040 receives charging input from a charger, which can be either a wireless or wired charger. The power management module 1041 connects to the battery 1042, the charging management module 1040, and the processor 1010. The power management module 1041 receives input from the battery 1042 and / or the charging management module 1040 to power the processor 1010, internal memory 1021, external memory, display 1094, camera 1093, and wireless communication module 1060, etc.

[0328] It is understood that the interface connection relationships between the modules illustrated in the embodiments of this application are merely illustrative and do not constitute a structural limitation on the electronic device 1000. In other embodiments of this application, the electronic device 1000 may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.

[0329] Electronic device 1000 implements display functions through a GPU, a display screen 1094, and an application processor. The GPU is a microprocessor for image processing, connecting the display screen 1094 and the application processor. The GPU performs mathematical and geometric calculations and is used for graphics rendering. Processor 1010 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0330] The display screen 1094 is used to display images, videos, etc. The display screen 1094 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Miniled LED, a MicroLED, a Micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 1000 may include one or N display screens 1094, where N is an integer greater than 1.

[0331] This application provides a chip system including one or more processors for calling and executing instructions stored in memory, thereby performing the methods described in this application. The chip system may be composed of chips or may include chips and other discrete devices.

[0332] The chip system may include input circuits or interfaces for transmitting information or data, and output circuits or interfaces for receiving information or data.

[0333] This application also provides a computer program product that, when executed by a processor, implements the methods described in any of the method embodiments of this application.

[0334] The computer program product can be stored in memory and, after processes such as preprocessing, compilation, assembly, and linking, is finally converted into an executable object file that can be executed by a processor.

[0335] This application also provides a computer-readable storage medium storing a computer program thereon, which, when executed by a computer, implements the methods described in any of the method embodiments of this application. The computer program may be a high-level language program or an executable object program.

[0336] The computer-readable storage medium can be volatile memory or non-volatile memory, or it can include both volatile and non-volatile memory. The non-volatile memory can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. The volatile memory can be random access memory (RAM), which is used as an external cache. By way of example, but not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous linked dynamic random access memory (SLDRAM), and direct rambus RAM (DR RAM).

[0337] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working process and technical effects of the above-described apparatus and equipment can be referred to the corresponding processes and technical effects in the foregoing method embodiments, and will not be repeated here.

[0338] In the several embodiments provided in this application, the systems, apparatuses, and methods disclosed can be implemented in other ways. For example, some features of the method embodiments described above can be ignored or not performed. The apparatus embodiments described above are merely illustrative; the division of units is only a logical functional division, and in actual implementation, there may be other division methods. Multiple units or components can be combined or integrated into another system. Furthermore, the coupling between units or components can be direct coupling or indirect coupling, including electrical, mechanical, or other forms of connection.

[0339] It should be understood that in the various embodiments of this application, the sequence number of each process does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0340] It should be understood that "multiple" as used in this application refers to two or more. The term "and / or" in this document is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, or B existing alone. Furthermore, the character " / " in this document generally indicates that the preceding and following related objects have an "or" relationship.

[0341] The terms (or numbers) "first," "second," etc., appearing in the embodiments of this application are for descriptive purposes only, that is, only to distinguish different objects, such as different "coordinates," etc., and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Therefore, features defined with "first," "second," etc., may explicitly or implicitly include one or more features. In the description of the embodiments of this application, "at least one (item)" refers to one or more. "Multiple" means two or more. "At least one (item) below" or similar expressions refer to any combination of these items, including any combination of a single (item) or a plurality of (items).

[0342] In summary, the above description is merely a preferred embodiment of the technical solution of this application and is not intended to limit the scope of protection of this application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the scope of protection of this application.

Claims

1. An image display method characterized by, Applied to an electronic device, the electronic device including a display processing unit and a screen, wherein the screen includes a display driver chip and a display panel, the method includes: First image data is displayed in a first area of ​​the display panel, and second image data is displayed in a second area of ​​the display panel, wherein the first area and the second area do not overlap. The display processing unit acquires first indication information, which includes the location information of the first area. The display processing unit acquires third image data, which is the image data to be updated in the first region. The display processing unit transmits the first indication information to the display driver chip; The display processing unit transmits the third image data to the display driver chip; The display driver chip controls the display panel to display the third image data in the first area and the second image data in the second area according to the first instruction information.

2. The method of claim 1, wherein, The display processing unit transmits the third image data to the display driver chip, including: In response to the first Vsync signal, the display processing unit begins to transmit the third image data to the display driver chip; Between the completion of transmitting the third image data and the receipt of the second Vsync signal, the display processing unit stops transmitting image data to the display driver chip, wherein the first Vsync signal and the second Vsync signal are adjacent.

3. The method of claim 2, wherein, The display driver chip controls the display panel to display the third image data in the first area and the second image data in the second area according to the first instruction information, including: The display driver chip receives the third image data corresponding to the first Vsync signal from the display processing unit; After receiving the third image data, the display driver chip stops receiving image data from the display processing unit until it receives image data corresponding to the second Vsync signal from the display processing unit.

4. The method of any one of claims 1 to 3, wherein, The display processing unit acquires third image data, including: The display processing unit obtains fourth image data from the graphics processor, and the fourth image data is used to update the entire area of ​​the display panel; The display processing unit determines the third image data based on the first instruction information and the fourth image data.

5. The method of claim 2, wherein, The third Vsync signal precedes the first Vsync signal, and the fourth Vsync signal follows the second Vsync signal. A fifth Vsync signal between the third and fourth Vsync signals triggers the display processing unit to transmit image data for updating a portion of the display panel, the portion including the first area. The image data for updating the portion of the display panel includes the third image data. The fifth Vsync signal includes both the first and second Vsync signals. The method further includes: In response to the third Vsync signal, the display processing unit transmits fifth image data to the display driver chip, the fifth image data being used to update the entire area of ​​the display panel; The display driver chip controls the display panel to display the fifth image data; The display processing unit acquires the first indication information again, and the display processing unit acquires the sixth image data from the graphics processor. The sixth image data is used to update the entire area of ​​the display panel. In response to the fourth Vsync signal, the display processing unit transmits the sixth image data to the display driver chip according to the first indication information, the sixth image data, and the seventh indication information, wherein the seventh indication information indicates that the entire area of ​​the display panel should be refreshed; The display driver chip controls the display panel to display the sixth image data; The time interval between the first moment of transmitting the fifth image data and the second moment of transmitting the sixth image data is less than or equal to the first interval threshold.

6. The method of claim 5, wherein, The time interval between the first Vsync signal and the second Vsync signal is the second interval threshold, and the first interval threshold is greater than the second interval threshold.

7. The method as described in claim 5 or 6, characterized in that, The first interval threshold is less than or equal to the reciprocal of the lowest refresh rate of the screen.

8. The method of any one of claims 5 to 7, wherein, The method further includes: The display driver chip transmits the seventh indication information to the display processing unit based on the first time and the first interval threshold.

9. The method of any one of claims 5 to 7, wherein, The sum of the quantities of the third Vsync signal and the fifth Vsync signal is a first quantity, and the interval between the first Vsync signal and the second Vsync signal is a second interval threshold. The method further includes: A quantity threshold is determined based on the first interval threshold and the second interval threshold, wherein the ratio of the first interval threshold to the second interval threshold is greater than or equal to the quantity threshold; When the first quantity is equal to the quantity threshold, the display processing unit transmits the seventh indication information to the display driver chip.

10. The method of claim 8, wherein, The method further includes: Based on the first moment and the first interval threshold, a first cutoff time is determined, whereby the first cutoff time is the cutoff time for transmitting the sixth image data. The transmission time of the seventh indication information is determined based on the first deadline and a preset interval, wherein the transmission time is before the first deadline, and the time interval between the transmission time and the first deadline is greater than or equal to the preset interval. Wherein, the preset interval is greater than or equal to the duration for which the display processing unit transmits the sixth image data to the display driver chip; or, the preset interval is greater than or equal to the sum of the duration for which the display processing unit processes the sixth image data and the duration for which it transmits the sixth image data to the display driver chip.

11. The method of claim 9, wherein, The method further includes: Based on the time corresponding to the third Vsync signal and the first time interval, a second cutoff time is determined, wherein the second cutoff time is the time corresponding to the fourth Vsync signal; The transmission time of the seventh indication information is determined based on the second deadline and a preset interval, wherein the transmission time is before the second deadline, and the time interval between the transmission time and the second deadline is... The interval between them is greater than or equal to the preset interval; The preset interval is greater than or equal to the time taken for the display processing unit to process the sixth image data.

12. The method as described in claims 1 to 11, characterized in that, The display panel displays the user interface of the video application, wherein video data of the video application is played in the first area, the video data including the first image data and the third image data, and other data is displayed in the second area, the other data including the second image data.

13. The method as described in claims 1 to 11, characterized in that, The display panel displays the user interface of the note-taking application, wherein, in response to user operations, user-inputted note data is displayed in the first area, the note data including the first image data and the third image data, and other data, including the second image data, is displayed in the second area.

14. The method as described in claims 1 to 11, characterized in that, The data of the first application is dynamically displayed in the first area in the form of a dynamic capsule, and the data of the second application is statically displayed in the second area. The data of the first application includes the first image data and the third image data, and the data of the second application includes the second image data.

15. An electronic device, comprising: The electronic device includes: one or more processors, and memory; The memory is coupled to the one or more processors, the memory being used to store computer program code, the computer program code including computer instructions, the one or more processors invoking the computer instructions to cause the electronic device to perform the method as described in any one of claims 1 to 14.

16. A chip system, characterized by The chip system is applied to an electronic device, the chip system including one or more processors, the one or more processors being used to invoke computer instructions to cause the electronic device to perform the method as described in any one of claims 1 to 14.

17. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes instructions that, when executed on an electronic device, cause the electronic device to perform the method as described in any one of claims 1 to 14.

Images