Display method and foldable electronic equipment

Abstract

The embodiment of the invention provides a display method and foldable electronic equipment, the foldable electronic equipment can perform real power-off on a screen area which does not need to be displayed according to a current folding form instead of adopting black shading processing, controlling a screen to perform partitioned power-on and power-off and partitioned display, the power consumption of the screen side can be saved, and the user experience is improved. And the SoC does not need to process the image data of the whole screen resolution, and the power consumption of the SOC can also be reduced.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of electronics, and in particular to a display method and a foldable electronic device. BACKGROUND

[0002] In recent years, electronic devices with foldable screens, such as foldable-screen mobile phones, have become increasingly popular among consumers. Foldable-screen mobile phones can provide users with a large-screen experience and can also be easily stored after folding. Moreover, the screen form of a foldable-screen mobile phone is variable, which can provide users with more diverse use scenarios. However, a larger screen means higher power consumption, and the power consumption control of a foldable screen is very challenging. SUMMARY

[0003] In a first aspect, an embodiment of the present application provides a display method, which can be applied to a foldable electronic device. The foldable electronic device can include a processor, a display screen, and a display driver integrated circuit (DDIC). The display screen is foldable, the display screen can be connected to the DDIC, and the DDIC can be connected to the processor.

[0004] The method can include the following steps:

[0005] The processor transmits a control instruction to the DDIC, and the control instruction is used to trigger the DDIC to perform partition power-on and power-off on the display screen. The partition power-on and power-off can include powering off a target screen-off area and powering on a target display area, where the target screen-off area is a screen area that does not display a picture, and the target display area is a screen area that displays a picture.

[0006] The processor also performs partition display data transmission to the DDIC, and the partition display data transmission only includes display data of the target display area.

[0007] In the first aspect, the processor can be a SoC mentioned in subsequent embodiments, and the display screen can be a display screen 120 mentioned in subsequent embodiments. The display screen can support partition power-on and power-off in hardware, and each screen area of the display screen can have independent power-on and power-off circuits.

[0008] The display method provided in the first aspect can actually power off a screen area that does not need to display a picture according to the current folding form, instead of using black-out processing, which can reduce screen-side power consumption. Moreover, the display method can also perform partition display data transmission, so that the display data processed by the processor is no longer an integral screen resolution layer, which also reduces processor power consumption. In addition, the display method can also reduce the data transmission amount of the interface between the processor and the DDIC, which reduces data transmission power consumption.

[0009] In conjunction with the first aspect, in some embodiments, the scenario that triggers the processor to transmit control commands to the DDIC may include either a first scenario or a second scenario. The first scenario is when the display screen goes from being completely powered down to displaying an image, and the second scenario is when the display screen undergoes a folding mode switch upon power-up. The first scenario and the second scenario can be scenario 1 and scenario 2 in subsequent embodiments, respectively.

[0010] The first scenario can include the following two sub-scenarios: 1. The display goes from a full-screen power-off to showing an Always-On Display (AOD); 2. The display goes from a full-screen power-off to showing a lock screen, desktop, application interface, etc. The triggering condition for sub-scenario 1 can also be an AOD activation condition, which can include one or more of the following: tapping the screen, lifting the device, the user turning their head to look at the screen, etc. The triggering condition for sub-scenario 2 can include one or more of the following: receiving an incoming call while the entire screen is powered off, receiving a message or notification while the entire screen is powered off, the user pressing the power button while the entire screen is powered off, etc.

[0011] The second scenario, where the display is powered on, can refer to the following: the entire screen is powered on, or one or more portions of the screen are powered on. For example, this scenario could involve displaying a seamless live wallpaper when switching from a folded to an unfolded state. In the folded state, the screen displays an Alert To the Light (AOD), and as the screen gradually unfolds, the display transitions from AOD to the lock screen, and finally to the desktop or the previously opened application interface. Another example of this second scenario is when the folded state changes while displaying the desktop or application interface.

[0012] In conjunction with the first aspect, in some embodiments, there may be multiple control commands. The processor transmits control commands to the DDIC, specifically including: the processor dividing the multiple control commands into multiple groups, and triggering the sequential transmission of multiple groups of control commands through multiple frame synchronization signals of the display screen, wherein one frame synchronization signal is used to trigger the transmission of one group of control commands. In this way, control commands can be quickly sent to the DDIC within multiple frame synchronization signal cycles, triggering the DDIC to control the screen to perform partial power-on / off, etc., efficiently completing zone control.

[0013] In conjunction with the first aspect, in some embodiments, the transmission order of control instructions is determined by the execution order of the control instructions, with control instructions executed earlier being transmitted before those executed later. This ensures that partition control executes correctly.

[0014] In conjunction with the first aspect, in some embodiments, the control instructions may include: a first control instruction and a second control instruction, wherein the first control instruction can be used to turn off the column-start STV signal (including the ESTV signal) of the target screen-off area, such as... FIG. 20BThe first command is to turn off the STV signal in the target screen-off area; the second control command can be used to turn on the STV signal in the target display area but not to turn on the ESTV signal of the light-emitting column in the target display area, such as... FIG. 20B The command to enable STV in the target display area.

[0015] In conjunction with the first aspect, in some embodiments, the control instructions further include: a third control instruction, which can be used to set the refresh range of the target display area in the display's video memory, such as... FIG. 20B The instruction in the GRAM sets the refresh region. The third control instruction can carry information about the start line (2A) and end line (2B) of the refresh range.

[0016] Each storage cell in the GRAM corresponds to a pixel on the display panel. The refresh area in the GRAM that the third control instruction needs to set corresponds to the target display area on the display panel, and the data stored in this refresh area corresponds to the image to be displayed in the target display area. In this way, correct partitioned display can be achieved through partition control instructions.

[0017] In conjunction with the first aspect, in some embodiments, the control instructions may further include: a fourth control instruction and a fifth control instruction, wherein the fourth control instruction is transmitted to the DDIC earlier than the fifth control instruction, and the fourth control instruction is used to trigger the DDIC to enter a first state, such as... FIG. 20B The frame synchronization instruction execution queue enters the (XEQ IN) instruction, and the fifth control instruction can be used to deactivate the first state, such as... FIG. 20B The frame synchronization instruction execution queue exit (XEQ OUT) instruction. During the first state, the DDIC does not execute the control instructions received during the first state. This allows multiple instructions received during this period to be executed together, which can meet the requirement of screen-side initialization and other screen-side settings that require the continuous execution of a series of operations.

[0018] The control instructions received by the DDIC during the first state include: control instructions transmitted from the processor to the DDIC between the fourth and fifth control instructions, such as... FIG. 20B The NL setting command, VFP setting command, and VSR setting command are used to set the Vactive function of the DDIC brush pattern, the VFP setting command is used to set the vertical front-end shading (VFP), and the VSR setting command is used to set the channel that generates typical timing waveforms internally by the DDIC.

[0019] In conjunction with the first aspect, in some embodiments, the control instructions may further include: a sixth control instruction, which can be used to trigger a display screen self-refresh, such as the 0X2C instruction shown in the figure.

[0020] The control commands received by the DDIC during the first state take effect after the DDIC receives the sixth control command. Here, "take effect after the sixth control command" means that it is executed during the display self-refresh triggered by the sixth control command. In other words, after the DDIC exits the first state, it waits to receive the 0x2C command, triggers the display self-refresh upon receiving the 0x2C command, and executes the aforementioned control commands received by the DDIC during the first state during the self-refresh.

[0021] In conjunction with the first aspect, in some embodiments, the control instruction may further include: a seventh control instruction, which is used to activate the ESTV signal of the target display area, such as... FIG. 20B The command to open the target display area ESTV.

[0022] In conjunction with the first aspect, in some embodiments, the transmission order of the first control instruction, the second control instruction, and the third control instruction may precede the transmission order of the fourth control instruction.

[0023] In conjunction with the first aspect, in some embodiments, the transmission order of the sixth control instruction may be after the transmission order of the fifth control instruction.

[0024] In conjunction with the first aspect, in some embodiments, the execution order of the seventh control instruction may be after the transmission order of the fifth control instruction.

[0025] In conjunction with the first aspect, in some embodiments, the control instructions can be divided into two parts: a first part instruction and a second part instruction. The first part instruction is transmitted to the DDIC before partition display is sent, and the second part instruction is transmitted to the DDIC after partition display is sent. The second part instruction may include a seventh control instruction, which is used to enable the ESTV signal of the target display area. In this way, by delaying the activation of the ESTV signal and the subsequent lighting up of the display screen, the ESTV signal can be enabled only after display is completed, thereby avoiding screen flickering issues.

[0026] It is not limited to delaying the ESTV signal; it can also delay other control commands that trigger the screen to light up. In other words, the second part of the command can also include such control commands.

[0027] In conjunction with the first aspect, in some embodiments, if the detected scenario is the first scenario, the transmission of control commands does not need to be divided into two parts; the transmission of control commands can be completed before the partition is sent for display. If the detected scenario is the second scenario, the transmission of control commands can be divided into two parts: the first part of the control commands is transmitted before the partition is sent for display, and the second part of the control commands is transmitted after the partition is sent for display. This avoids screen flickering or image retention issues in the second scenario, and the first scenario, which does not have screen flickering or image retention issues, can complete the issuance of control commands earlier.

[0028] In conjunction with the first aspect, in some embodiments, the processor also performs partitioned display delivery to the DDIC. Specifically, this may include: the processor determining whether the layer specifications of the upper-layer image delivery match the display delivery specifications. If they do not match, the upper-layer image delivery is not used for display initially. Only after the layer specifications of the upper-layer image delivery match the display delivery specifications is the upper-layer image delivered to the DDIC for partitioned display delivery. This ensures that the upper-layer image delivery specifications match the processor's display delivery specifications, preventing display subsystem malfunctions and black flickering issues.

[0029] During the waiting period, the upper-layer rendering thread may send new images, and the SoC display specifications may also be adjusted. The SoC can continue to determine whether the upper-layer image specifications and the SoC display specifications have become consistent, and only use the upper-layer image for display after they have become consistent.

[0030] As mentioned earlier, there are two situations where the upper-layer image transmission specifications and the SoC display transmission specifications are inconsistent:

[0031] Scenario 1: The SoC's display specifications have been updated, but the upper-layer image specifications have not yet been updated;

[0032] Scenario 2: The upper layer has updated the image sending specifications, but the SoC's display sending specifications have not yet been updated.

[0033] Scenario 1 primarily occurs in the second scenario mentioned above. The SoC's image delivery specifications are consistent with the specifications of the target display area after the folded form switch. The black flickering is mainly due to the upper-layer image delivery specifications not having been updated to match the target display area. For Scenario 1, the SoC can determine whether the upper-layer image delivery specifications and the SoC's image delivery specifications are consistent by checking if they match the target display area's specifications. If they do, then the upper-layer image delivery specifications and the SoC's image delivery specifications are consistent; otherwise, they are inconsistent. If inconsistent, the SoC can temporarily refrain from using the new upper-layer image delivery for display, waiting until the upper-layer rendering line receives the folded form switch notification and updates the image delivery specifications before using the new upper-layer image delivery for display. The specifications of the new upper-layer image delivery must match the target display area's specifications.

[0034] Scenario 2 primarily occurs in the first scenario mentioned above. The specifications of the upper-layer image submission are initially consistent with the specifications of the target display area. The black flickering occurs mainly because the SoC's image submission specifications were initially set to the full-screen specification and haven't had time to be updated to match the target display area. For Scenario 2, the SoC can temporarily refrain from using the upper-layer image submission and wait until its specifications are updated to match the target display area before using the new upper-layer image submission. Here, the target display area refers to the screen area where the image is displayed in the actual folded form.

[0035] Secondly, embodiments of this application provide a foldable electronic device, which may include: a processor, a display screen, a display driver integrated circuit (DDIC), and a memory. The display screen is foldable and can be connected to the DDIC. The DDIC can be connected to the processor, and the memory can be connected to the processor. The memory can be used to store a computer program, and the processor executes the computer program to implement the method described in the first aspect or any possible implementation of the first aspect. For a detailed description of the foldable electronic device, please refer to the following embodiments.

[0036] Thirdly, embodiments of this application provide a chip system that can be applied to the foldable electronic device described in the second aspect. The chip system includes one or more processors that invoke computer instructions to cause the terminal device to perform the methods described in the first aspect and any possible implementation thereof.

[0037] Fourthly, this application provides a computer-readable storage medium having a computer program stored thereon, which, when run by a processor, implements the method described in the first aspect or any possible implementation of the first aspect.

[0038] Fifthly, this application provides a computer program product comprising a computer program that, when executed by a processor, implements the method described in the first aspect or any possible implementation thereof. Attached Figure Description

[0039] FIGS. 1A-1B An exemplary illustration is shown of a foldable electronic device 100 provided in an embodiment of this application;

[0040] FIGS. 2A-2D Several folding methods for the display screen are illustrated exemplarily;

[0041] FIGS. 3A-3B An example of a folded state is shown;

[0042] FIGS. 4A-4B This example illustrates yet another folded state;

[0043] FIGS. 5A-5B This example illustrates yet another folded state;

[0044] FIGS. 6A-6B This example illustrates yet another folded state;

[0045] FIGS. 7A-7B This example illustrates yet another folded state;

[0046] FIGS. 8A-8B This example illustrates yet another folded state;

[0047] FIGS. 9A-9B This example illustrates yet another folded state;

[0048] FIGS. 10A-10B This example illustrates yet another folded state;

[0049] FIGS. 11A-11B This example illustrates yet another folded state;

[0050] FIGS. 12A-12B This example illustrates yet another folded state;

[0051] FIG. 13 This illustrates a change in the display area of ​​the screen;

[0052] FIG. 14 This demonstrates another variation in the display area of ​​the screen;

[0053] FIG. 15 This demonstrates another variation in the display area of ​​the screen;

[0054] FIG. 16 This demonstrates another variation in the display area of ​​the screen;

[0055] FIG. 17 A brief flowchart of the screen blackout process is shown;

[0056] FIG. 18 An example of partition power-off and partition display using embodiments of this application is shown;

[0057] FIG. 19 Another example of partition power-off and partition display applying embodiments of this application is shown;

[0058] FIG. 20A The overall flow of a display method provided in an embodiment of this application is illustrated;

[0059] FIG. 20B The sequence of control commands issued in different scenarios is shown;

[0060] FIG. 21 A brief illustration of the display system in the foldable electronic device 100 is shown;

[0061] FIG. 22 An example is shown illustrating the operation timing in a folding mode switching scenario;

[0062] FIG. 23 This invention illustrates one implementation of the display method provided in an embodiment of this application;

[0063] FIG. 24A This illustrates a timing sequence for the SoC to send control commands to the DDIC in batches;

[0064] FIG. 24B This illustrates another timing sequence for the SoC to send control commands to the DDIC in batches;

[0065] FIG. 25 This illustrates another implementation of the display method provided in the embodiments of this application;

[0066] FIG. 26 This application illustrates a foldable electronic device according to an embodiment of the present application;

[0067] FIG. 27 This application illustrates a software system provided in an embodiment;

[0068] FIG. 28 It shows the basis FIG. 27 The software system shown illustrates a process for implementing partition control and partition display. Detailed Implementation

[0069] The terminology used in the following embodiments of this application is for the purpose of describing particular embodiments only and is not intended to be a limitation of this application.

[0070] FIGS. 1A-1B An exemplary embodiment of this application provides a foldable electronic device.

[0071] like FIG. 1A As shown, the foldable electronic device 100 may include a display screen 120. The display screen 120 may be a single flexible screen that can be folded. The display screen 120 may include multiple screen portions, such as the following screen portions: display screen 120A, display screen 120B, and display screen 120C.

[0072] The display screen 120 is foldable at positions 131A and 131B. Specifically, display screens 120A and 120B can be bent around a first folding member at position 131A, and display screens 120B and 120C can be bent around a second folding member at position 131B. The first and second folding members can be, for example, hinges or pivots.

[0073] A front-facing camera 112, an earpiece 113, a proximity sensor (not shown), etc., may also be installed on one or more screen sections (such as display screen 120B). The front-facing camera may also be installed on display screen 120C.

[0074] like FIG. 1BAs shown, the electronic device 100 may further include a rear housing 110. The rear housing 110 supports the display screen 120 and is foldable along with the display screen 120. The rear housing 110 may include the following housing parts: housing 110A, housing 110B, and housing 110C. Housing 110A constitutes the non-display surface of the display screen 120A, housing 110B constitutes the non-display surface of the display screen 120B, and housing 110C constitutes the non-display surface of the display screen 120C.

[0075] The material of the back cover 110 can be a metallic material, such as an aluminum-magnesium alloy, or a non-metallic material. A rear-facing camera can be located on one or more of the cover's surfaces. For example, a rear-facing camera 111 can be located on the surface of the cover 110A. The rear-facing camera 111 can include multiple rear-facing cameras, such as rear-facing camera 111A, rear-facing camera 111B, and rear-facing camera 111C. Rear-facing cameras 111A, 111B, and 111C can be a standard camera, a wide-angle camera, and a telephoto camera, respectively. The side of the back cover of the cover 110A can also have a flash 115, etc.

[0076] Besides supporting the screen, the back cover 110 also serves to protect the internal components of electronic devices. (To be continued...) FIG. 28 The embodiments will describe the electronic structure of the electronic device 100, explaining which components it includes; this will not be elaborated upon here. Besides the display screen 120 and the back cover 110, the circuit board (e.g., a flexible printed circuit (FPC)) inside the foldable electronic device can also be bent at positions 131A and 131B, thereby supporting the entire foldable electronic device to bend at positions 131A and 131B. In this document, due to the presence of three screen sections... FIGS. 1A-1B The exemplary electronic device 100 can also be referred to as a "triple-fold electronic device". Not limited to triple-fold, the foldable electronic device provided in this application embodiment can also be a two-fold, four-fold, five-fold, or other electronic device with other numbers of screens.

[0077] For ease of description of the folded state, open state, and the dynamic switching between them, the electronic device can be divided into multiple surfaces: surface A, surface B, surface C, surface D, surface E, and surface F. Surface A is the non-display surface of display screen 120A (the surface where housing 110A is located), surface B is the non-display surface of display screen 120B (the surface where housing 110B is located), surface C is the non-display surface of display screen 120C (the surface where housing 110C is located), surface D is the display surface of display screen 120A, surface E is the display surface of display screen 120B, and surface F is the display surface of display screen 120C.

[0078] Next, taking a three-fold screen as an example, we will introduce the folding method, folding shape, and display area changes of the display screen 120.

[0079] Folding method

[0080] The folding method of the display 120 may include one or more of the following: inward folding and outward folding. Compared to outward folding, inward folding reduces the screen's exposure to the outside.

[0081] FIG. 2A A simplified illustration shows one outward folding configuration of the display screen 120. For example... FIG. 2A As shown, the display screen 120 folds outward at position 131A. Specifically, the display screen 120A rotates outward around the first folding component, and the direction of rotation is shown as marked 121A. In this way, surface D is no longer on the same surface as surfaces E and F. If the outward folding angle reaches 180°, surfaces A and B will come into contact and overlap together, becoming invisible to the outside.

[0082] FIG. 2B The simplified illustration shows another outward folding method for the display screen 120. (As shown...) FIG. 2B As shown, the display screen 120 folds outward at position 131B. Specifically, the display screen 120C rotates outward around the second folding component, with the rotation direction as indicated by mark 121B. Thus, surface F is no longer on the same plane as surfaces D and E. If the outward folding angle reaches 180°, surfaces B and C will come into contact, overlapping and becoming invisible to the outside.

[0083] FIG. 2C A simplified illustration shows one inward folding configuration of the display screen 120. For example... FIG. 2C As shown, the display screen 120 folds inward at position 131A. Specifically, the display screen 120A rotates inward around the first folding component, with the rotation direction as indicated by mark 122A. Thus, surface A is no longer on the same plane as surfaces B and C. If the inward folding angle reaches 180°, surfaces D and E will come into contact, overlapping and becoming invisible to the outside.

[0084] FIG. 2D The simplified illustration shows another inward folding method for the display screen 120. (As shown...) FIG. 2D As shown, the display screen 120 folds inward at position 131B. Specifically, the display screen 120C rotates inward around the second folding member, with the rotation direction as indicated by mark 122B. Thus, surface C is no longer on the same plane as surfaces A and B. If the inward folding angle reaches 180°, surfaces E and F will come into contact, overlapping and becoming invisible to the outside.

[0085] Some folding shapes

[0086] Open state

[0087] FIGS. 1A-1BThis shows that the electronic device 100 is in the "on" state. For example... FIGS. 1A-1B As shown, when the electronic device 100 is in the open state, the display surfaces of all screens of its display screen 120 are on the same side of the electronic device 100. The angle between the display surfaces of display screen 120A and display screen 120B is very small, for example, equal to or close to 0 degrees, and the angle between the display surfaces of display screen 120B and display screen 120C is also very small, for example, equal to or close to 0 degrees. Therefore, the display surfaces of each screen are fully exposed to the user and can all be used for display.

[0088] Folded state (1)

[0089] FIGS. 3A-3B The folded state (1) is shown, and the folded state (1) can be achieved through... FIG. 2A The folding method shown is a folded state formed by a single outward fold. In this folded state, there is an angle of 180° or nearly 180° between surface D and surfaces E and F. Surfaces D, E, and F are all visible to the user, except that surface D is no longer on the same surface as surfaces E and F. Not limited to this, folded state (1) can also be a derived folded state with more folding positions. More folding positions can be defined by the outward folding angle of the display screen 120A, such as 60°, 90°, 120°, 150°, etc.

[0090] Folded state (2)

[0091] FIGS. 4A-4B The folded state (2) is shown, and the folded state (2) can be achieved through... FIG. 2B The folding method shown is a folded state formed by a single outward fold. In this folded state, there is an angle of 180° or nearly 180° between surface F and surfaces D and E. Surfaces D, E, and F are all visible to the user, except that surface F is no longer on the same surface as surfaces D and E. Not limited to this, folded state (2) can also have derived folded states with more folding positions. More folding positions can be defined by the outward folding angle of display screen 120C, such as 60°, 90°, 120°, 150°, etc.

[0092] Folded state (3)

[0093] FIGS. 5A-5B The folded state (3) is shown, and the folded state (3) can be achieved through... FIG. 2C The folding method shown is a folded state formed by a single inward fold. In this folded state, there is an angle of 180° or nearly 180° between surface D and surfaces E and F. Surfaces D and E are overlapped and not visible to the user, while only surface F is visible to the user. Not limited to this, folded state (3) can also have derived folded states with more folding positions. More folding positions can be defined by the inward folding angle of display screen 120A, such as 60°, 90°, 120°, etc.

[0094] Folded state (4)

[0095] FIGS. 6A-6B The folded state (4) is shown, and the folded state (4) can be achieved through... FIG. 2D The folding method shown is a folded state formed by a single inward fold. In this folded state, there is an angle of 180° or nearly 180° between surface F and surfaces D and E. Surfaces E and F are overlapped and not visible to the user, while only surface D is visible to the user. Not limited to this, folded state (4) can also have derived folded states with more folding positions. More folding positions can be defined by the inward folding angle of display screen 120C, such as 60°, 90°, 150°, etc.

[0096] Folded state (5)

[0097] FIGS. 7A-7B The folded state (5) is shown. The folded state (5) can be formed by passing through sequentially. FIG. 2B , FIG. 2A The folding method shown is formed by two outward folds, as can be seen. FIG. 7B As shown. In this folded state, there is an angle of 180° or nearly 180° between surface D and surface E, and there is also an angle of 180° or nearly 180° between surface F and surface E. Surface F is folded inside and not visible to the user, and only surfaces D and E are visible to the user. Not limited to this, the folded state (5) can also have derived folded states with more folding positions. More folding positions can be defined by the outward folding angle α of display screen 120A and the outward folding angle β of display screen 120C, for example, α = 60° and β = 60°, α = 90° and β = 90°, etc.

[0098] Folded state (6)

[0099] FIGS. 8A-8B The folded state (6) is shown. The folded state (6) can be formed by passing through sequentially. FIG. 2A , FIG. 2B The folding method shown is formed by two outward folds, as can be seen. FIG. 8B As shown. In this folded state, there is an angle of 180° or nearly 180° between surface D and surface E, and there is also an angle of 180° or nearly 180° between surface F and surface E. Surface D is folded inside and not visible to the user, and only surfaces F and E are visible to the user. Not limited to this, the folded state (6) can also have derived folded states with more folding positions. More folding positions can be defined by the outward folding angle α of display screen 120A and the outward folding angle β of display screen 120C, for example, α = 60° and β = 60°, α = 90° and β = 120°, etc.

[0100] Folded state (7)

[0101] FIGS. 9A-9B The folded state (7) is shown. The folded state (7) can be formed by passing through sequentially. FIG. 2C ,FIG. 2D The folding method shown is formed by two inward folds, as can be seen. FIG. 9B As shown. In this folded state, there is an angle of 180° or nearly 180° between surface D and surface E, and there is also an angle of 180° or nearly 180° between surface F and surface E. Surfaces D, E, and F are all overlapped and not visible to the user. At this time, the electronic device 100 does not display anything on the screen. Not limited to this, the folded state (7) can also have derived folded states with more folding positions. More folding positions can be defined by the inward folding angle α of display screen 120A and the inward folding angle β of display screen 120C, for example, α = 90° and β = 60°, α = 120° and β = 150°, etc.

[0102] Folded state (8)

[0103] FIGS. 10A-10B The folded state (8) is shown. The folded state (8) can be formed by passing through sequentially. FIG. 2D , FIG. 2C The folding method shown is formed by two inward folds, as can be seen. FIG. 10B As shown. In this folded state, there is an angle of 180° or nearly 180° between surface D and surface E, and there is also an angle of 180° or nearly 180° between surface F and surface E. Surfaces D, E, and F are all overlapped and not visible to the user. At this time, the electronic device 100 does not display anything on the screen. Not limited to this, the folded state (8) can also have derived folded states with more folding positions. More folding positions can be defined by the inward folding angle α of display screen 120A and the inward folding angle β of display screen 120C, for example, α = 90° and β = 60°, α = 120° and β = 150°, etc.

[0104] Folded state (9)

[0105] FIGS. 11A-11B The folded state (9) is shown. The folded state (9) can be achieved through... FIG. 2A The first outward fold shown and FIG. 2D As shown, it is formed by a single inward fold, which can be like... FIG. 11B As shown. In this folded state, there is an angle of 180° or nearly 180° between surface D and surface E, and there is also an angle of 180° or nearly 180° between surface F and surface E. Surfaces E and F are overlapped and not visible to the user, and only surface D is visible to the user. At this time, the electronic device 100 can only display on the screen on surface D. Not limited to this, the folded state (9) can also have derived folded states with more folding positions. More folding positions can be defined by the outward folding angle α of display screen 120A and the inward folding angle β of display screen 120C, for example, α = 90° and β = 60°, α = 120° and β = 90°, etc.

[0106] Folded state (10)

[0107] FIGS. 12A-12B The folded state (10) is shown. The folded state (10) is achieved through... FIG. 2B The first outward fold shown and FIG. 2C As shown, it is formed by a single inward fold, which can be like... FIG. 12B As shown. In this folded state, there is an angle of 180° or nearly 180° between surface D and surface E, and there is also an angle of 180° or nearly 180° between surface F and surface E. Surfaces D and E are overlapped and not visible to the user, and only surface F is visible to the user. At this time, the electronic device 100 can only display on the screen on surface F. Not limited to this, the folded state (10) can also have derived folded states with more folding positions. More folding positions can be defined by the inward folding angle α of display screen 120A and the outward folding angle β of display screen 120C, for example, α = 90° and β = 60°, α = 120° and β = 120°, etc.

[0108] The electronic device 100 may only have the aforementioned partially folded state. The electronic device 100 may only support inward folding, and therefore may only have a folded state.

[0109] (3), folded state (4), folded state (7), folded state (8). The electronic device 100 may also only support outward folding, and thus may only have folded state (1), folded state (2), folded state (5), folded state (6). The electronic device 100 may also only fold outward at 131A and fold inward at 131B, and thus may only have folded state (1), folded state (4), folded state (9); or it may only fold inward at 131A and fold outward at 131B, and thus may only have folded state (2), folded state (3), folded state (10).

[0110] Changes in display area

[0111] Change (1)

[0112] FIG. 13 The change (1) of the display area of ​​the display screen 120 is shown, which is from displaying only the E and F sides (with the D side black) to displaying the D, E and F sides. The change (1) can be caused by the following folding state switching: switching from the folded state (1) to the open state.

[0113] Change (2)

[0114] FIG. 14 The change in the display area of ​​the display screen 120 is shown (2), which changes from displaying on surfaces D, E, and F to displaying only on surfaces E and F (surface D is black). The change (2) can be caused by the following folding state switching: switching from the open state to the folded state (1).

[0115] Change (3)

[0116] FIG. 15The change in the display area of ​​the display screen 120 (3) is shown, which is from displaying only the D side (with the E and F sides black) to displaying the D, E, and F sides. The change (3) can be caused by the following folding state switching: switching from the folded state (4) to the open state.

[0117] Change (4)

[0118] FIG. 16 The change in the display area of ​​the display screen 120 (4) is shown, which is from displaying on all three sides (D, E, and F) to displaying only on the D side (with the E and F sides black). The change (4) can be caused by the following folding state switching: switching from the open state to the folded state (4).

[0119] FIGS. 13-16 This is only an example of display area variation. In actual applications, the display screen 120 may have more or fewer display area variations, or different display area variations.

[0120] For screen areas that do not need to be displayed, the electronic device 100 can use a layer to mask the black area, making it appear as a black screen. For example... FIG. 17 As shown, screen masking refers to covering screen areas that do not require display with a black layer. For a system-on-chip (SoC), it still needs to process (e.g., rendering and compositing) the display data for the entire screen resolution and transmit it to the screen side for display via a high-speed interface (such as the Mobile Industry Processor Interface, MIPI). The screen side needs to process the entire screen data and refresh it onto the display. The screen side may include the display screen and the display driver integrated circuit (DDIC). Thus, even if only part of the screen is displayed, the cost of transmitting data to the screen side is high, and the non-display areas remain powered on, resulting in high power consumption on the screen side. Moreover, the data processed by the SoC is still the entire screen resolution layer, leading to high power consumption for the SoC as well.

[0121] This application provides a display method that can reduce screen power consumption by controlling the display screen 120 to enable partition power-on / off and display.

[0122] When the foldable electronic device is in different folding states, the display area of ​​the display screen 120 will also be different. This embodiment of the application will ensure that the non-displaying areas are actually powered off, reducing power consumption. For example, as... FIG. 18 As shown, when the tri-fold electronic device is in the folded state (10), only the F side is the display area, while the D and E sides are actually powered off. For example, as... FIG. 19As shown, when the three-fold electronic device is in the folded state (1), only the E and F sides are display areas, and the D side is actually powered off. In addition, the transition area between the display area and the power-off non-display area (the area marked by the dashed box in the figure) can be divided into two parts. The part adjacent to the power-off non-display area can also be powered off, and the part adjacent to the display area can be blacked out.

[0123] In this embodiment, the display screen 120 can support partitioned power-on and power-off in hardware, with each screen area (display screens 120A, 120B, and 120C) having independent power-on and power-off circuits. The electronic device can actually power off screen areas that do not need to display images according to the current folding configuration, instead of using a blackout treatment.

[0124] like FIG. 20A As shown, the overall flow of the display method provided in this application embodiment may include:

[0125] The S51.SoC sends control commands to the DDIC.

[0126] This control command can be used to trigger the DDIC to power on and off the display screen in sections. Sectional power-on and off can mean powering off the target off-screen area and powering on the target display area. The target off-screen area is the screen area that does not display any image, and the target display area is the screen area that displays any image. In this way, in some folded configurations, the screen area that does not display any image can be actually powered off, significantly reducing screen-side power consumption.

[0127] Correspondingly, the DDIC can power on and off the display screen in zones according to the control command.

[0128] The S52.SoC sends partitioned display data to the DDIC.

[0129] The data transmitted from the SoC to the DDIC for partitioned display is only the display data of the target display area, rather than the display data of the entire screen. This reduces the amount of data processing by the SoC, lowers the bandwidth requirements of the communication interface between the SoC and the DDIC, and reduces the power consumption on the SoC side.

[0130] Accordingly, after receiving the data sent by the partition, DDIC can write the data sent by the SOC partition into GRAM. Here, the target display area refers to the screen area used to display the image after the folded mode is switched, for example... FIG. 13 The D, E, and F surfaces in the diagram. FIG. 14 The E and F planes in the middle, FIG. 15 The D, E, and F surfaces in the diagram. FIG. 16 Side D in the middle.

[0131] like FIG. 20BAs shown, scenarios that trigger the above partition power-on / off and partition display execution can include:

[0132] Scenario 1. The display screen goes from being powered off to displaying an image.

[0133] The "display screen" in "from power-off of the entire screen to display screen" can refer to the entire screen display screen, or it can refer to one or more screen portions of the entire screen displaying the screen. Which screen is the display screen can be determined by the folding state. For example, in the unfolded state, the entire screen displays the screen. As another example, in the folded state (9), the D side displays the screen.

[0134] Scenario 1 can include the following two sub-scenarios: 1. The display goes from a full-screen power-off to showing the Always-On Display (AOD); 2. The display goes from a full-screen power-off to showing the lock screen, desktop, application interface, etc. The triggering condition for sub-scenario 1 can also be an AOD activation condition, which can include one or more of the following: tapping the screen, lifting the device, the user turning their head to look at the screen, etc. The triggering conditions for sub-scenario 2 can include one or more of the following: receiving an incoming call while the entire screen is powered off, receiving a message or notification while the entire screen is powered off, the user pressing the power button while the entire screen is powered off, etc.

[0135] Scenario 2. The display screen switches to a folded form when powered on.

[0136] Here, powering on the display can include: the entire screen being powered on, or one or more portions of the screen being powered on. Scenario 2 could be, for example, displaying a seamless live wallpaper when switching from a folded state to an unfolded state. In the folded state, the screen displays an Alert To the View (AOD), and as the screen gradually unfolds, the display transitions from AOD to the lock screen, and then to the desktop. Scenario 2 could also involve a folding mode switch when displaying the desktop or application interface. For an explanation of folding mode switching, please refer to the previous text; it will not be repeated here.

[0137] In this embodiment, the SoC sends multiple control instructions for partition control to the DDIC. The execution order of these multiple control instructions can be used to constrain the order in which they are sent, with the control instruction executed earlier being transmitted before the control instruction executed later.

[0138] These multiple control commands may include: a first control command and a second control command. The first control command can be used to disable the column-start STV signal (including the ESTV signal) of the target screen-off area, such as... FIG. 20B The first command is to turn off the STV signal in the target screen-off area; the second control command can be used to turn on the STV signal in the target display area but not to turn on the ESTV signal of the light-emitting column in the target display area, such as... FIG. 20BThe command to enable STV in the target display area.

[0139] These multiple control commands may also include: a third control command, which can be used to set the refresh range of the target display area in the display's video memory, such as... FIG. 20B The instruction in the GRAM sets the refresh region. The third control instruction can carry information about the start line (2A) and end line (2B) of the refresh range.

[0140] Each storage cell in the GRAM corresponds to a pixel on the display panel. The refresh area in the GRAM that the third control instruction needs to set corresponds to the target display area on the display panel, and the data stored in this refresh area corresponds to the image to be displayed in the target display area. In this way, correct partitioned display can be achieved through partition control instructions.

[0141] These multiple control instructions may also include: a fourth control instruction and a fifth control instruction, wherein the fourth control instruction is transmitted to the DDIC earlier than the fifth control instruction, and the fourth control instruction can be used to trigger the DDIC to enter the first state, such as... FIG. 20B The execution queue of frame-synched commands is entered.

[0142] The XEQ IN instruction, the fifth control instruction, can be used to deactivate the first state, such as... FIG. 20B The frame synchronization instruction execution queue exit (XEQ OUT) instruction. During the first state, the DDIC does not execute the control instructions received during the first state. This allows multiple instructions received during this period to be executed together, which can meet the requirement of screen-side initialization and other screen-side settings that require the continuous execution of a series of operations.

[0143] Control instructions received by the DDIC during the first state may include: control instructions transmitted from the processor to the DDIC between the fourth and fifth control instructions, such as... FIG. 20B The NL setting command, VFP setting command, and VSR setting command are used to set the column direction to be active (Vactive) for DDIC brushing. The VFP setting command can be used to set the vertical front porch (VFP) to be eliminated. The VSR setting command can be used to set the channel for generating typical timing waveforms internally by DDIC.

[0144] These multiple control commands may also include a sixth control command, which can be used to trigger a display self-refresh, as shown by the 0X2C command in the figure. Furthermore, the control commands received by the DDIC during the first state take effect after the DDIC receives the sixth control command. Here, "take effect after the sixth control command" means that it is executed when the display self-refresh is triggered by the sixth control command. That is to say, after the DDIC exits the first state, it waits to receive the 0X2C command, triggers a display self-refresh upon receiving the 0X2C command, and executes the aforementioned control commands received by the DDIC during the first state during the self-refresh.

[0145] These multiple control commands may also include: a seventh control command, which can be used to activate the ESTV signal of the target display area, such as... FIG. 20B The command to open the target display area ESTV.

[0146] like FIG. 20B As shown, the transmission order of the first control instruction, the second control instruction, and the third control instruction can be before the transmission order of the fourth control instruction, the transmission order of the sixth control instruction can be after the transmission order of the fifth control instruction, and the execution order of the seventh control instruction can be after the transmission order of the fifth control instruction.

[0147] like FIG. 20B As shown, these multiple control commands can be divided into multiple groups in the form of command packets and sent sequentially to the DDIC. Each command packet represents a group of control commands. Specifically, the SoC can trigger the successive transmission of multiple groups of control commands through multiple frame synchronization signals of the display screen. One frame synchronization signal is used to trigger the transmission of one group of control commands.

[0148] FIG. 20B This illustrates one method of grouping control instructions. For example, instruction packet A includes the first, second, and third control instructions, instruction packet B includes the fourth instruction, instruction packet D includes the fifth instruction, and so on. However, this is not a limitation; the grouping of these multiple control instructions can also be different.

[0149] The method, order, and other details of issuing control commands will be explained in detail in subsequent embodiments, and will not be elaborated here.

[0150] In this application embodiment, SoC can be replaced with processor; SoC is merely a specific implementation of processor. In this document, the steps or functions executed by SoC can be replaced by those executed by processor.

[0151] In addition, from FIG. 21As can be seen, in the display method provided in this application embodiment, in the scenario where the folding mode changes when the display screen is powered on, the issuance of a certain part of the control commands is later than the partition display. This is to solve the problems of possible screen flickering and image retention.

[0152] In addition to issues such as screen flickering and image retention, in the aforementioned scenarios 1 and 2, the display screen may also experience brief display anomalies such as black flashes. The embodiments of this application will address these problems.

[0153] First, let's explain the causes of abnormal issues such as screen flickering, image retention, and black flashing.

[0154] FIG. 22 A simplified illustration of the display system in the foldable electronic device 100 is provided. This display system may include a display screen 120, a SoC 150, a DDIC 160, and video memory 170. The SoC 150 is connected to the DDIC 160, which in turn is connected to the display screen 120 and the video memory 170. The DDIC 160 serves as the control core of the display screen 120, driving its operation and receiving data, such as image data and instructions, from the SoC 150. The DDIC 160 can send drive signals and data to the display panel of the display screen 120 via electrical signals, thereby controlling screen brightness and color, enabling image information such as letters and pictures to be displayed on the screen, thus completing screen refresh. The video memory 170, also known as GRAM, corresponds to a pixel on the display panel. The data stored in the GRAM is refreshed onto the display 34 according to the frequency of the display's frame synchronization signal, causing each pixel to display a specific color, which, when combined, forms a complete image. This refresh is the display screen's self-refresh. After receiving the data sent by the SoC, the data in the GRAM is updated to the data to be sent for display. The display's frame synchronization signals may include: tearing effect (TE) signal and vertical synchronization (vsync) signal.

[0155] One of the problems: screen flickering or residual images.

[0156] The SoC's display delivery and the display screen 120's self-refreshing according to the frame synchronization signal are two independent timing processes, without coordination. This can lead to the following: in scenario 2 mentioned above, before the SoC has a chance to deliver the display, existing data in the GRAM will be refreshed onto the display screen 120, potentially causing screen flickering or image retention during certain folding mode transitions. This is because, in scenario 2, the display screen 120 is not fully powered down, the DDIC160 is still powered on, and the GRAM has not been cleared.

[0157] If switching from the first folded form to the second folded form introduces a new display area, and this new display area had not displayed any image before entering the first folded form, then, if FIG. 20B As shown, if the SoC has not yet sent the data to the display, the data corresponding to the new display area in the GRAM during the display self-refresh is still an initial random value. When this random value is refreshed onto the display area, it will manifest as a screen flickering problem.

[0158] If a new display area is introduced when switching from the first folding form to the second folding form, and this new display area has displayed an image before entering the first folding form, then, if the SoC has not had time to send the image to the display, the data corresponding to the new display area in the GRAM when the display refreshes will be the data of the most recent image displayed in the new display area. This data being refreshed onto the display area will result in an image retention problem.

[0159] The aforementioned new display area refers to the display area that displays images in the second folded state but not in the first folded state. For example, the new display area introduced when switching from the folded state (10) to the unfolded state is the D-side and the E-side.

[0160] Question 2: Black flash.

[0161] The SoC display specification update and the upper-layer image specification update are two independent processes without coordination. This can lead to situations where the SoC display specification is updated before the upper-layer image specification is updated, or vice versa. Inconsistencies between the SoC display specification and the upper-layer image specification are identified as a display subsystem malfunction. The SoC needs to perform a reset of the display subsystem to handle this malfunction, which can cause a black flickering issue on display 120.

[0162] In scenario 1 (the display goes from full-screen power-off to displaying an image), regardless of the actual folded state when displaying the image, the display initially powers on in its unfolded state (i.e., full-screen power-on), and then powers on only the target display area through partitioned power-on and power-off. The SoC's display specifications also need some time to adjust from adapting to the unfolded state to adapting to the actual folded state. However, the upper-layer image transmission is adapted to the actual folded state from the beginning. This leads to a situation where the image transmission specifications are updated but the SoC's display transmission specifications have not been updated, resulting in inconsistencies between the upper-layer image transmission specifications and the SoC's display transmission specifications, ultimately causing the black flickering issue.

[0163] When scenario 2 (the display switches between folded and unfolded modes upon power-up) occurs, the operating system notifies the upper-layer rendering thread of the change in folded mode. The implementation of this notification will be explained in later embodiments. However, before this notification arrives, the upper-layer rendering thread may have already sent an image according to the display area specifications before the folded mode switch, while the SoC's display specifications have been updated to adapt to the display area specifications after the folded mode switch. This results in a situation where the SoC's display specifications have been updated but the upper-layer image specifications have not, leading to an inconsistency between the upper-layer image specifications and the SoC's display specifications, ultimately causing the black flickering problem.

[0164] To address the screen flickering issue, when the folding mode changes, the SoC can send multiple batches of partition control commands to the DDIC based on the display's frame synchronization signal (i.e., FIG. 20B (Control commands in the text), but the command to turn on the ESTV (EM start vertical) light-up start signal of the target display area is sent to DDIC after the first frame is displayed.

[0165] The ESTV signal is a special type of STV signal, and its function is to control the start-up of light emission. Therefore, delaying the activation of the ESTV signal can delay the lighting up of the display screen, thus avoiding screen flickering issues.

[0166] Partition control commands (i.e., the aforementioned) FIG. 23 The control instructions (in the DDIC) include multiple control instructions. These multiple control instructions exist in an execution order, which refers to the sequence in which the DDIC executes these multiple control instructions to ensure the normal driving and setup of the display screen.

[0167] The execution order of these commands determines the order in which the SoC sends control instructions to the DDIC. That is, the SoC can send these control instructions to the DDIC multiple times in the order they are executed, with the control instructions executed earlier being sent before those executed later. These control instructions can be divided into multiple groups, which are then sent to the DDIC sequentially. Sequential transmission can refer to transmitting these control instructions according to multiple frame synchronization signals, with one frame synchronization signal triggering the transmission of one group of control instructions. The control instruction packets mentioned below refer to groups of control instructions, organized together as instruction packets. Within a control instruction packet, multiple control instructions are arranged according to their execution order to ensure that the DDIC can execute them in sequence upon receipt.

[0168] To resolve the screen flickering issue, the control command that enables the ESTV signal of the target display area can be issued after the partition display is sent, thus delaying the activation of the ESTV signal of the target display area and ensuring that the ESTV signal is activated only after the display is completed.

[0169] In this embodiment, the SoC can send control commands to the DDIC in multiple steps based on the display's frame synchronization signal. Each control command can be time-aligned with the display's frame synchronization signal.

[0170] like FIG. 13 As shown, the specific implementation of the display method provided in this application embodiment may include:

[0171] S11, the arrival of the i-th frame synchronization signal is detected, and the SoC sends instruction packet A to the DDIC.

[0172] The i-th frame synchronization signal can be the first frame synchronization signal after detecting the aforementioned scenario 1 or scenario 2, which can realize partition power-on / off control as early as possible and reduce latency. It is not limited to this, the i-th frame synchronization signal can also be the second or third frame synchronization signal after the folding mode switch.

[0173] Instruction package A may include: STV signal disable instruction, STV signal enable instruction, refresh area setting instruction, etc. Specifically, the STV signal disable instruction can be used for the STV signal (including the ESTV signal) of the target screen-off area; the STV signal enable instruction can be used to enable the STV signal (excluding the ESTV signal) of the target display area; and the refresh area setting instruction can be used for the refresh area corresponding to the target display area in GRAM, and this refresh area setting instruction can carry information about the start and end lines of the refresh area.

[0174] The target screen-off area can be the screen area that does not display images after switching to the folded form.

[0175] The target display area can be the screen area used to display images after the folded form is switched, and it is also the display area that will be powered on soon.

[0176] Correspondingly, after receiving instruction packet A, DDIC can turn off the STV signal (including the ESTV signal) of the target screen-off area according to the above STV signal turn-off instruction, turn on the STV signal (excluding the ESTV signal) of the target display area according to the above STV signal turn-on instruction, and determine which range of data in the GRAM is refreshed to the display screen according to the above refresh area setting instruction.

[0177] In addition to the above-mentioned STV signal off command, STV signal on command, and refresh area setting command, command package A may also include more, fewer, or different control commands.

[0178] S12, the arrival of the (i+1)th frame synchronization signal is detected, and the SoC sends instruction packet B to the DDIC.

[0179] Instruction packet B may include the XEQ IN instruction. The XEQ IN instruction can be used to set DDIC to enter the first state. After DDIC enters the first state, it will not respond to subsequent received control instructions (such as those in instruction packet C) until it receives the fourth control instruction.

[0180] Correspondingly, DDIC can enter the first state according to the XEQ IN instruction, wait for the arrival of the XEQ OUT control instruction, and temporarily cache the control instructions received by the waiting device without executing them.

[0181] Not limited to the (i+1)th frame synchronization signal, the time for issuing the second control command and the time for issuing the first control command (the i-th frame synchronization signal) can also be spaced 2 or 3 frames of synchronization signals apart. The shorter the interval, the more the latency of screen partition control can be reduced.

[0182] In addition to the XEQ IN instruction mentioned above, instruction package B may also include other control instructions.

[0183] S13, the arrival of the (i+2)th frame synchronization signal is detected, and the SoC sends instruction packet C to the DDIC.

[0184] The instruction package C may include: NL setting instruction, VFP setting instruction, and VSR setting instruction.

[0185] Accordingly, the DDIC in the first state first caches instruction packet C. Only upon receiving instruction packet D (XEQ OUT) does the DDIC exit the first state, ensuring that control instructions received during the first state (such as those in instruction packet C) are executed together. After exiting the first state, the DDIC continues to wait until it receives instruction packet E (0X2C instruction) and triggers a display self-refresh before executing the instructions in instruction packet C. In other words, the instructions in instruction packet C only take effect after receiving the 0X2C instruction in instruction packet E; please refer to S14-S15 for details.

[0186] Not limited to the (i+2)th frame synchronization signal, the time for issuing the third control command and the time for issuing the second control command (the (i+1)th frame synchronization signal) can also be spaced 2 or 3 frames of synchronization signals apart. The shorter the interval, the more the latency of screen partition control can be reduced.

[0187] In addition to the NL setting instructions, VFP setting instructions, and VSR setting instructions mentioned above, instruction package C may also include more, fewer, or different control instructions.

[0188] S14, the arrival of the (i+3)th frame synchronization signal is detected, and the SoC sends instruction packet D to the DDIC.

[0189] Instruction package D may include the XEQ OUT instruction, which can be used to deactivate the first state of DDIC.

[0190] Correspondingly, DDIC can release the first state based on the XEQ OUT instruction.

[0191] Not limited to the (i+3)th frame synchronization signal, the time of sending instruction packet D and the time of sending instruction packet C (the (i+2)th frame synchronization signal) can also be spaced 2 or 3 frames of synchronization signals apart. The shorter the interval, the more the latency of screen partition control can be reduced.

[0192] In addition to the XEQ OUT instruction mentioned above, instruction package D may also include other control instructions.

[0193] S15, the arrival of the j-th frame synchronization signal is detected, and the SoC sends instruction packet E to the DDIC.

[0194] The synchronization signal for the j-th frame is later than the synchronization signal for the (i+3)-th frame.

[0195] The instruction package E may include instructions for triggering a self-refresh of the display, whose instruction code may be, for example, 0x2C.

[0196] Correspondingly, DDIC can trigger the display to self-refresh according to the 0X2C instruction, and execute the instructions in instruction package C during the display self-refresh, such as setting the column-direction valid VSR for DDIC refresh, setting the channel for generating typical timing waveforms internally by DDIC, and setting the VSR.

[0197] At this point, the basic instructions for partitioning the display screen 120 have been issued, except for the control instruction used to enable the ESTV signal of the target display area (i.e., the eighth control instruction mentioned later). Next, the SoC can send partitioned display commands to the DDIC, and then enable the ESTV signal of the target display area after the partitioned display commands are sent, in order to avoid screen flickering issues.

[0198] In addition to the above-mentioned instruction (0X2C) for triggering the display screen self-refresh, instruction package E may also include other control instructions.

[0199] S16, the arrival of the k-th frame synchronization signal is detected, and the SoC can send the partitioned display to the DDIC.

[0200] The synchronization signal for the kth frame is later than the synchronization signal for the jth frame.

[0201] The data sent for partitioned display is only the display data for the target display area, not the display data for the entire screen. Correspondingly, DDIC can write the data sent for partitioned display by the SOC into GRAM. Here, the target display area refers to the display area used to display the image after the folded mode is switched, for example... FIG. 14The D, E, and F surfaces in the diagram. FIG. 15 The E and F planes in the middle, FIG. 16 The D, E, and F surfaces in the diagram. FIG. 23 Side D in the middle.

[0202] S17, the arrival of the m-th frame synchronization signal is detected, and the SoC sends instruction packet F to the DDIC.

[0203] Instruction package F may include an instruction to enable the ESTV signal of the target display area. Accordingly, in response to this instruction, DDIC can enable the ESTV signal of the target display area.

[0204] The m-th frame synchronization signal can be the first frame synchronization signal after the partition display is completed, which can realize the partition power-on / off control as early as possible and reduce latency. It is not limited to this, the m-th frame synchronization signal can also be the second, third, etc. frame synchronization signal after the partition display is completed.

[0205] Correspondingly, DDIC can activate the ESTV signal of the target display area according to instruction packet F. At this point, the target display area is lit up, and the display data of the target display area in GRAM is refreshed onto the display screen and becomes visible to the user.

[0206] In addition to the above-mentioned instruction to enable the ESTV signal of the target display area, instruction package F may also include other control instructions.

[0207] In other words, the partition control command can be divided into two parts. The first part can be executed before the partition is sent for display, and the second part can be executed after the partition is sent for display, so as to avoid the screen flickering problem.

[0208] Not limited to FIG. 23 As shown, in practical applications, the control commands issued by the SoC to the DDIC can be more, fewer, or different. FIG. 23 In this application, a single control command can be used to issue one or more control commands. The specific number of control commands in a group is not limited in this embodiment and can be determined based on factors such as the interface bandwidth between the SoC and the DDIC. FIGS. 24A-24B The grouping shown is just one grouping method; multiple control commands can be grouped in different ways.

[0209] FIG. 24A Two timing sequences for issuing control commands in batches are illustrated. FIG. 24B The timing sequence shown is applicable to the aforementioned online handover scenario on the AP side. FIGS. 24A-24B This is applicable to the aforementioned rapid power-on scenario on the AP side. FIG. 24A In the example, the period of the frame synchronization signal is 2.8 milliseconds.

[0210] like FIG. 24BAs shown, during the duration of the first frame synchronization signal after detecting either scenario 1 or scenario 2, the SoC sends instruction packet A to the DDIC, and triggers the subsequent sending of instruction packets B, C, and D through multiple consecutive frame synchronization signals. Adjacent control instruction sending can be spaced one frame synchronization signal cycle apart. Then, when the next frame synchronization signal arrives, the SoC performs display delivery. The display delivery time can be at least a first duration later than the sending time of instruction packet E, thus allowing sufficient execution time for instruction packet C. The first duration can be one vsync cycle, for example, 8.3 milliseconds. After display delivery, the SoC sends instruction packet E to the DDIC again, that is, after display delivery is completed, it controls the DDIC to enable the ESTV signal of the target display area.

[0211] like FIG. 24B As shown, the control command issuance sequence in the AP-side fast power-on scenario is largely the same as that in the AP-side online switching scenario. The difference lies in the following: In the AP-side fast power-on scenario, after issuing the seventh control command (XEQ OUT), at least one time interval is required before issuing the seventh control command (0X2C). Furthermore, after issuing command packet D (0X2C), at least a second time interval is required before partitioned display is performed. This ensures sufficient time to disable the STV signal in the target screen-off area before triggering the display self-refresh based on the 0X2C command, thus preventing users from seeing a flickering image in areas that should be screen-off. In other words, as... FIG. 23 As shown, the issuance time of instruction packet E is b 2.8ms later than the issuance time of the fourth control instruction, and the display transmission is a 2.8ms later than the issuance time of the fifth control instruction. Here, b and a are positive integers, b 2.8ms is greater than or equal to the second duration, and a 2.8ms is greater than or equal to the first duration. The second duration can also be a vsync cycle, such as 8.3 milliseconds.

[0212] The first duration and the second duration can be empirical values, and their values ​​may differ in foldable electronic devices with different hardware and software capabilities. The first duration and the second duration can be different from each other, and this application embodiment does not limit this.

[0213] That is, in scenarios where the AP side powers on quickly, FIG. 23 The synchronization signal of the j-th frame can be at least one time interval later than the synchronization signal of the (i+3)-th frame, and the synchronization signal of the k-th frame can be at least two time intervals later than the synchronization signal of the j-th frame.

[0214] As mentioned earlier, screen flickering will not occur in the AOD (Always On Demand) fast power-on scenario. Therefore, the control command for the ESTV signal used to open the target display area can be issued before the partition is sent for display. That is, in this scenario, FIG. 25S17 can be executed before S16. Of course, in the AOD fast power-on scenario, even if there is no screen flickering problem, foldable electronic devices can execute S16 first and then S17 without affecting the effect of partition control in this scenario.

[0215] To address the black flickering issue, the SoC can determine whether the upper-layer image transmission specifications and the display transmission specifications are compatible. If they are incompatible, the upper-layer image transmission will be discarded, and the display transmission will not proceed for the time being.

[0216] like FIG. 23 As shown, the specific implementation of the display method provided in this application embodiment may include:

[0217] S21, the arrival of the i-th frame synchronization signal is detected, and the SoC sends instruction packet A to the DDIC.

[0218] Command package A may include: STV signal off command, STV signal on command, refresh area setting command, etc.

[0219] Correspondingly, after receiving instruction packet A, DDIC can turn off the STV signal (including the ESTV signal) of the target screen-off area according to the above STV signal turn-off instruction, turn on the STV signal (excluding the ESTV signal) of the target display area according to the above STV signal turn-on instruction, and determine which range of data in the GRAM is refreshed to the display screen according to the above refresh area setting instruction.

[0220] S22, the arrival of the (i+1)th frame synchronization signal is detected, and the SoC sends instruction packet B to the DDIC.

[0221] Instruction packet B may include the XEQ IN instruction. The XEQ IN instruction can be used to set DDIC to enter the first state. After DDIC enters the first state, it will not respond to subsequent received control instructions (such as those in instruction packet C) until it receives the fourth control instruction.

[0222] Correspondingly, DDIC can enter the first state according to the XEQ IN instruction, wait for the arrival of the XEQ OUT control instruction, and temporarily cache the control instructions received by the waiting device without executing them.

[0223] S23, the arrival of the (i+2)th frame synchronization signal is detected, and the SoC sends instruction packet C to the DDIC.

[0224] Command package C may include: NL setting command, VFP setting command, and VSR setting command. The fifth control command can be used to control the screen to display in zones and to power on / off in zones.

[0225] Accordingly, the DDIC in the first state first caches instruction packet C. Only when instruction packet D (XEQ OUT) is received will the DDIC exit the first state and continue to wait. The instructions in instruction packet C will only be executed when instruction packet E (0X2C instruction) is received and the display self-refresh is triggered.

[0226] S24, the arrival of the (i+3)th frame synchronization signal is detected, and the SoC sends instruction packet D to the DDIC.

[0227] Instruction package D may include the XEQ OUT instruction, which can be used to deactivate the first state of DDIC.

[0228] Correspondingly, DDIC can release the first state based on the XEQ OUT instruction.

[0229] S25, at the time of the j-th frame synchronization signal, the SoC sends instruction packet E to the DDIC.

[0230] The synchronization signal for the j-th frame is later than the synchronization signal for the (i+3)-th frame.

[0231] The instruction package E may include instructions for triggering a self-refresh of the display, whose instruction code may be, for example, 0x2C.

[0232] Correspondingly, DDIC can trigger the display to self-refresh according to the 0X2C instruction, and execute the instructions in instruction package C during the display self-refresh, such as setting the column-direction valid VSR for DDIC refresh, setting the channel for generating typical timing waveforms internally by DDIC, and setting the VSR.

[0233] For specific details regarding S21-S25, please refer to [link / reference]. FIGS. 1A-1B The detailed explanations in S11-S15 are not repeated here.

[0234] At this point, the basic instructions for partitioning the display screen 120 have been issued, except for the control instructions used to enable the ESTV signal of the target display area (i.e., the eighth control instruction mentioned later).

[0235] Next, the SoC will send the display according to the specifications of the display area after the folding mode switch, and then turn on the ESTV signal of the display area after sending the display to avoid screen flickering or image retention issues. After executing S21-S25, the operating system will notify the upper-layer rendering thread of the folding mode change, and the implementation of this notification will be explained in later embodiments. However, before this notification arrives, the upper layer may have just sent an image according to the display area specifications before the folding mode switch, which will cause the upper layer image sending specifications to be inconsistent with the SoC's display sending specifications. The SoC will then trigger a display subsystem exception and start an online reset procedure to handle the exception. This exception handling will cause the display to flicker, which is undesirable. To avoid the flickering problem, the SoC needs to check the layer specifications of the upper layer image sent after S27. If the layer specifications are inconsistent with the display sending specifications, the layer from the upper layer will be discarded. Please refer to steps S26-S29 below for details.

[0236] S26: After issuing the 0X2C instruction, the upper-layer rendering thread sends an image. In response, the SoC can determine whether the upper-layer image sending specifications are compatible with the SoC's display output. If so, S27-S28 can be executed; otherwise, S29 can be executed. The upper-layer image sending specifications refer to the layer specifications of the image sent by the upper-layer rendering thread.

[0237] Here, "fit" means having the same specifications. FIG. 13 Taking the foldable electronic device shown as an example, if the upper layer of the image is a full-screen layer, while the SoC's display specification is only the D-side, then this is considered a mismatch.

[0238] S27, during the time of the k-th frame synchronization signal, the SoC can use this upper-layer image transmission to send partitioned display data to the DDIC.

[0239] The k-th frame synchronization signal is later than the j-th frame synchronization signal. The k-th frame synchronization signal can be the first frame synchronization signal after the upper-level rendering thread sends the image, in order to execute partitioned display as early as possible. It is not limited to this; the k-th frame synchronization signal can also be the second, third, etc., frame synchronization signal after the upper-level rendering thread sends the image.

[0240] Specifically, partitioned display is based on the specifications of the display area after the folded form is switched. That is, the data sent for partitioned display is only the display data for the target display area, not the display data for the entire screen. Here, the target display area refers to the display area used to display the image after the folded form is switched, for example... FIG. 14 The D, E, and F surfaces in the diagram. FIG. 15 The E and F planes in the middle, FIG. 16 The D, E, and F surfaces in the diagram. FIG. 26 Side D in the middle.

[0241] Correspondingly, DDIC can write the data sent by the SOC partition to GRAM, and the written data can be used to achieve partitioned display of the display through display self-refresh.

[0242] S28, at the time of the m-th frame synchronization signal, the SoC sends instruction packet F to the DDIC.

[0243] Instruction package F may include an instruction to enable the ESTV signal of the target display area. Accordingly, in response to this instruction, DDIC can enable the ESTV signal of the target display area.

[0244] Correspondingly, DDIC can activate the ESTV signal of the target display area according to instruction packet F. At this point, the target display area is lit up, and the display data of the target display area in GRAM is refreshed onto the display screen and becomes visible to the user.

[0245] S29, the SoC discards the upper-layer image and does not use it to send partitioned display to the DDIC. It performs a short wait until the upper-layer image specifications are consistent with the SoC display specifications before executing S27-S28 to realize partitioned display.

[0246] During the waiting period, the upper-layer rendering thread may send new images, and the SoC display specifications may also be adjusted. The SoC can continue to execute S26 to determine whether the upper-layer image sending specifications and the SoC display specifications have become consistent.

[0247] As mentioned earlier, there are two situations where the upper-layer image transmission specifications and the SoC display transmission specifications are inconsistent:

[0248] Scenario 1: The SoC's display specifications have been updated, but the upper-layer image specifications have not yet been updated;

[0249] Scenario 2: The upper layer has updated the image sending specifications, but the SoC's display sending specifications have not yet been updated.

[0250] Scenario 1 primarily occurs in scenario 2 described above. The SoC's image delivery specifications are consistent with the specifications of the target display area after the folded form switch. The black flickering is mainly due to the upper-layer image delivery specifications not being updated to match the target display area. For scenario 1, the SoC can determine whether the upper-layer image delivery specifications and the SoC's image delivery specifications are consistent by checking if they match the target display area's specifications. If they do, then the upper-layer image delivery specifications and the SoC's image delivery specifications are consistent; otherwise, they are inconsistent. If inconsistent, the SoC can temporarily refrain from using the new upper-layer image delivery and wait until the upper-layer rendering layer receives the folded form switch notification and updates its image delivery specifications before using the new upper-layer image delivery. The specifications of the new upper-layer image delivery will then match the target display area's specifications.

[0251] Scenario 2 primarily occurs in scenario 1 described above. The specifications of the upper-layer image submission are initially consistent with the specifications of the target display area. The black flickering occurs mainly because the SoC's image submission specifications were initially set to the full-screen specification and haven't had time to be updated to match the target display area. For scenario 2, the SoC can temporarily refrain from submitting the upper-layer image and wait until its specifications are updated to match the target display area before using the new upper-layer image submission. Here, the target display area refers to the screen area where the image is displayed in the actual folded state.

[0252] FIG. 26 The composition of a foldable electronic device 100 provided in an embodiment of this application is illustrated by way of example. FIGS. 1A-1B As shown, the electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, antenna 1, antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a sensor module 180, a camera 193, and a display screen 194. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a proximity sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0253] Processor 110 may include one or more processing units, such as application processors (APs), modem processors, graphics processing units (GPUs), image signal processors (ISPs), controllers, video codecs, digital signal processors (DSPs), baseband processors, and / or neural network processing units (NPUs). These different processing units may be independent devices or integrated into one or more processors.

[0254] The controller can generate operation control signals based on the instruction opcode and timing signals to complete the control of instruction fetching and execution.

[0255] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0256] In some embodiments, the processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0257] The charging management module 140 is used to receive charging input from the charger. The charger can be a wireless charger or a wired charger.

[0258] The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110.

[0259] The wireless communication function of electronic device 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.

[0260] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with tuning switches.

[0261] The mobile communication module 150 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1. In some embodiments, at least some functional modules of the mobile communication module 150 may be housed in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be housed in the same device.

[0262] The modem processor may include a modulator and a demodulator. The modulator modulates the low-frequency baseband signal to be transmitted into a mid-to-high frequency signal. The demodulator demodulates the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After processing by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs sound signals through an audio device (not limited to speaker 170A, receiver 170B, etc.) or displays images or videos through the display screen 194. In some embodiments, the modem processor may be a separate device. In other embodiments, the modem processor may be independent of the processor 110 and may be housed in the same device as the mobile communication module 150 or other functional modules.

[0263] The wireless communication module 160 can provide solutions for wireless communication applications on the electronic device 100, including wireless local area networks (WLANs) (such as Wi-Fi networks), Bluetooth (BT), Global Navigation Satellite System (GNSS), Frequency Modulation (FM), Near Field Communication (NFC), and Infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, modulates and filters the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, modulate and amplify them, and then convert them into electromagnetic waves for radiation via antenna 2.

[0264] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling electronic device 100 to communicate with networks and other devices via wireless communication technology. The wireless communication technology may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. The GNSS may include the Global Positioning System (GPS), the Global Navigation Satellite System (GLONASS), the BeiDou Navigation Satellite System (BDS), the Quasi-Zenith Satellite System (QZSS), and / or satellite-based augmentation systems (SBAS).

[0265] Electronic device 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0266] Display screen 194 is used to display images, videos, etc. Display screen 194 is the same as display screen 120 mentioned in the above embodiments, and it may include several screens: display screen 120A, display screen 120B, and display screen 120C, or more screens. The sizes of the screens may be the same or different. Each screen may be several independent screens, with adjacent screens connected by a folding component, allowing them to bend around the folding component at folding positions. Display screen 194 may also be a single flexible screen, with each screen being a part of this single flexible screen. It can be a single flexible screen that can be folded. Display screen 194 may have one or more folding positions, which can divide display screen 194 into multiple screen parts, as described above. FIG. 26 Display screens 120A, 120B, and 120C are shown in the figure.

[0267] Electronic device 100 can perform shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.

[0268] The ISP is used to process data fed back from the camera 193. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, converting it into an image visible to the naked eye.

[0269] Camera 193 is used to capture still images or videos. An object is projected onto a photosensitive element by generating an optical image through the lens. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then transmitted to an ISP for conversion into a digital image signal. In some embodiments, electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1.

[0270] Digital signal processors (DSPs) are used to process digital signals. Besides digital image signals, they can also process other digital signals. For example, when electronic device 100 selects a frequency, the DSP can perform Fourier transforms on the frequency energy.

[0271] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. Thus, electronic device 100 can play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0272] NPU stands for Neural-Network (NN) Computing Processor. By drawing inspiration from the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it can quickly process input information and continuously learn on its own.

[0273] The external storage interface 120 can be used to connect an external storage card, such as a Micro SD card, to expand the storage capacity of the electronic device 100.

[0274] Internal memory 121 can be used to store computer executable program code, which includes instructions. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.), etc. The data storage area may store data created during the use of electronic device 100 (such as audio data, phonebook, etc.). Furthermore, internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc. Processor 110 executes various functional applications and data processing of electronic device 100 by running instructions stored in internal memory 121 and / or instructions stored in memory located in the processor.

[0275] Electronic device 100 can implement audio functions through audio module 170, speaker 170A, receiver 170B, microphone 170C, and application processor, such as music playback and recording. Audio module 170 is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. Audio module 170 can also be used for encoding and decoding audio signals. In some embodiments, audio module 170 can be located in processor 110, or some functional modules of audio module 170 can be located in processor 110.

[0276] Internal memory 121 can be used to store applications for one or more applications, including instructions. When the application is executed by processor 110, it causes the electronic device 100 to generate content for presentation to a user. For example, the application may include an application for managing the head-mounted display device 200, a game application, a conferencing application, a video application, a desktop application, or other applications, etc.

[0277] The GPU can be used to perform mathematical and geometric operations based on data obtained from the processor 110 (e.g., data provided by an application), to render images using computer graphics techniques, computer simulation techniques, etc., and to determine images for display on the head-mounted display device 200. In some embodiments, the GPU can add correction or pre-distortion to the image rendering process to compensate for or correct distortion caused by the optical components of the head-mounted display device 200.

[0278] In this embodiment, the electronic device 100 can send the image processed by the GPU to the head-mounted display device 200 via the mobile communication module 150, the wireless communication module 160, or a wired interface.

[0279] FIG. 27 The illustrated structure does not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0280] FIG. 27 This illustration shows a software system provided in an embodiment of this application. This software system can run on a foldable electronic device 100 and can work in conjunction with the device hardware to implement the display method provided in this embodiment of the application.

[0281] like FIG. 27 As shown, the software system may include the following software modules: SensorFoldStateManager, HWFoldScreenManagerservice, window manager service (WMS), display manager service (DMS), SurfaceFlinger, hardwarecomposer (HWC), high-performance display manager (HDM), and display kernel module driver (DKMD).

[0282] FIG. 27 The LCD KIT in the code is a display driver normalization code architecture that can be used to parse display area parameters, such as the target display area specification.

[0283] FIG. 27 The DDIC in the system can be used to receive various control commands from the software system and perform corresponding operations on the display panel based on the control commands, such as driving the display panel to realize partition power-on and power-off and partition display.

[0284] The following section details each software module in the software system.

[0285] SensorFoldStateManager is a folding state management module that can report folding and unfolding events when the screen is off, and report the folding angle after the screen is powered on, through the folding sensing module. The folding sensing module can be, for example, a Hall sensor.

[0286] The HWFoldScreenManager service can be used to monitor sensor data, calculate the folding shape after switching, and notify the window management service (WMS) of the specifications (such as width and height) of the switched display area.

[0287] Window Management Service (WMS) can be used to manage the display order, size, and position of windows.

[0288] Display Management Service (DMS) can be used to manage multiple logical screens and pass window and display area sizes to SurfaceFlinger. These multiple logical screens refer to the display areas of foldable electronic devices in different folding configurations, and the size and position of the display areas are different in different folding configurations.

[0289] SurfaceFlinger is a display compositing system that handles window management and graphics rendering. It supports the overlay and blending of multiple layers and can communicate with the hardware layer via the hardware compositor (HWC).

[0290] The Hardware Composer (HWC) is a Hardware Abstraction Layer (HAL) module used for window (layer) composition and display. It is device-specific, typically implemented by the display device manufacturer, and provides hardware support for the SurfaceFlinger service.

[0291] High-performance display management (HDM) can be an abstract interface to kernel services, and can be used to receive service requests from the application framework layer.

[0292] The hardware corresponding to the Display Kernel Module Driver (DKMD) is the Display Subsystem (DSS). DKMD may also include a Display Accelerator (DACC). The DACC can be a lightweight kernel (or small kernel) that can respond to frame synchronization signal interrupts (such as TE interrupts), display interrupts, and send control commands to the DDIC in real time.

[0293] FIG. 27 In this system, parameters and data can be transferred between different software modules through interface calls.

[0294] For example, such as FIG. 28 As shown, SensorFoldStateManager can transmit the display area switching event to DACC through a series of interface calls. In response to this event, DACC can send a screen switching command to DDIC, which can be the 0x2C command mentioned earlier. DDIC can then control the STV signal of the display panel according to this screen switching command to achieve partition power-on and power-off.

[0295] For example, such as FIG. 28 As shown, through a series of interface calls, LCD KIT can pass the parsed display area parameters to SurfaceFlinger, so that SurfaceFlinger can perform graphics rendering and compositing based on the display area parameters.

[0296] FIG. 23 The implementation of the display method provided in the embodiments of this application in a software system is illustrated. Further details are provided below.

[0297] Initialization (S31-S36)

[0298] S31-S33. Through interface calls, the Hardware Abstraction Layer (HAL) can report screen information to SurfaceFlinger. This screen information is the range of the display area in various folding modes (indicated by the start and end lines). The HAL can also pass screen information to the LCD driver via the kernel.

[0299] S34. The kernel executes initialization instructions. Initialization instructions are the control instructions mentioned earlier, and their purpose is to prepare for the execution of control instructions, such as allocating space and packaging instructions, which can improve the efficiency of subsequent instruction execution.

[0300] S35-S36. SurfaceFlinger can analyze the folding state based on the screen information reported by HAL and notify the Display Management Service (DMS) of the folding state. The upper-layer rendering thread can then learn about the switched folding form through DMS and send the image according to the specifications of the switched display area.

[0301] Initialization (S37-S43)

[0302] S37-S41. The Display Management Service (DMS) can determine whether a folding mode switch has occurred based on the folding status transmitted by SurfaceFlinger. If a folding mode switch has occurred, the DMS can transmit a folding switch instruction to the kernel through a series of interface calls, triggering the kernel to issue a switch instruction. Once the switch instruction is issued, the SoC's display specifications are updated to match the specifications of the display area in the latest folding mode. The timing of issuing the switch instruction can be considered to avoid black-flickering issues: if a display is currently in progress, the switch instruction can be issued only after the current display is completed, to avoid the current display not conforming to the latest display specifications and thus preventing potential black-flickering issues.

[0303] S42. Based on the folding switching instructions issued by the kernel, the DACC can send control instructions to the DDIC multiple times sequentially, according to the display's frame synchronization signal. Each control instruction can be time-aligned with the display's frame synchronization signal.

[0304] But among them, FIG. 28 As not shown, the ESTV signal enable command for the target display area is sent to the DDIC after the display is sent to the display, to avoid screen flickering issues. For solutions to this problem, please refer to [link to relevant documentation]. FIG. 25 The relevant content in the embodiments will not be repeated here.

[0305] In other words, the partition control command can be divided into two parts. The first part is executed before the data is sent to the display, and the second part is executed after the data is sent to the display to avoid screen flickering. S42 only shows the execution process of the first part.

[0306] S43. After S42 is executed, HAL updates the folding state and updates the display specifications to the specifications of the switched display area.

[0307] After rendering and compositing the upper-layer image, S44-S45.SurfaceFlinger passes the display data to HAL to trigger HAL to update frame information (such as the start and end lines of the target display area) and performs partitioned display according to the latest folding state.

[0308] ​Not shown, before partitioning and displaying, HAL can also determine whether the layer specifications sent by the upper-level rendering thread are consistent with the display area specifications after the folded mode switch. If they are inconsistent, the layer from the upper layer is discarded to avoid the black flickering issue. For solutions to this problem, please refer to [link to relevant documentation]. ​ The relevant content in the embodiments will not be repeated here.

[0309] It should be understood that the steps in the above-described method embodiments provided in this application can be implemented by integrated logic circuits in the processor hardware or by instructions in software form. The method steps disclosed in the embodiments of this application can be directly implemented by a hardware processor, or implemented by a combination of hardware and software modules in the processor.

[0310] This application also provides an electronic device that may include a memory and a processor. The memory may be used to store a computer program; the processor may be used to invoke the computer program in the memory to cause the electronic device to perform the method in any of the above embodiments.

[0311] This application also provides a chip system including at least one processor for implementing the functions involved in the methods performed by the electronic device in any of the above embodiments.

[0312] In one possible design, the chip system also includes a memory for storing program instructions and data, which may be located within or outside the processor.

[0313] The chip system can consist of chips or include chips and other discrete components.

[0314] Optionally, the chip system may contain one or more processors. These processors can be implemented in hardware or software. When implemented in hardware, the processor can be a logic circuit, an integrated circuit, etc. When implemented in software, the processor can be a general-purpose processor, implemented by reading software code stored in memory.

[0315] Optionally, the chip system may contain one or more memories. The memory may be integrated with the processor or disposed separately from it; this application embodiment does not limit this. For example, the memory may be a non-transient processor, such as a read-only memory (ROM), which may be integrated with the processor on the same chip or disposed separately on different chips. This application embodiment does not specifically limit the type of memory or the arrangement of the memory and processor.

[0316] For example, the chip system may be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on chip (SoC), a central processor unit (CPU), a network processor (NP), a digital signal processor (DSP), a micro controller unit (MCU), a programmable logic device (PLD), or other integrated chips.

[0317] This application also provides a computer program product comprising: a computer program (also referred to as code or instructions) that, when run, causes a computer to perform the method executed by the electronic device in any of the above embodiments.

[0318] This application also provides a computer-readable storage medium storing a computer program (also referred to as code or instructions). When the computer program is run, it causes the computer to perform the method executed by the electronic device in any of the above embodiments.

[0319] The various embodiments of this application can be combined arbitrarily to achieve different technical effects.

[0320] In the above embodiments, implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented, in whole or in part, as a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium accessible to a computer or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state drive).

[0321] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. This program can be stored in a computer-readable storage medium, and when executed, it can include the processes described in the above method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.

[0322] In summary, the above description is merely an embodiment of the technical solution of the present invention and is not intended to limit the scope of protection of the present invention. Any modifications, equivalent substitutions, improvements, etc., made according to the disclosure of the present invention should be included within the scope of protection of the present invention.

Claims

1. A display method characterized by comprising: The method is applied to a foldable electronic device, the foldable electronic device comprising a processor, a display screen and a display driving integrated circuit (DDIC), the display screen being foldable, the display screen being connected to the DDIC, and the DDIC being connected to the processor; The method comprises: The processor transmits a control instruction to the DDIC, the control instruction being used to trigger the DDIC to power on and power off the display screen in partitions; the power on and power off in partitions comprises powering off a target screen-out area and powering on a target display area, wherein the target screen-out area is a screen area without displaying a picture, and the target display area is a screen area to display a picture; The processor further performs partitioned display data transmission to the DDIC, and the partitioned display data only comprises display data of the target display area.

2. The method of claim 1, wherein, The conditions under which the processor transmits the control instruction to the DDIC comprise detecting a first scenario or a second scenario; wherein the first scenario is that the display screen is powered off from a full screen to display a picture, and the second scenario is that the display screen is powered on and a folding mode switching occurs.

3. The method of claim 1 or 2, wherein, The control instruction has multiple control instructions; the processor transmits the control instruction to the DDIC, specifically comprising: The processor divides the multiple control instructions into multiple groups, and triggers the transmission of the multiple groups of control instructions successively through multiple frame synchronization signals of the display screen, wherein one frame synchronization signal is used to trigger the transmission of one group of control instructions.

4. The method of any one of claims 1-3, wherein, The transmission order of the control instruction is determined by the execution order of the control instruction, and the control instruction with earlier execution order is transmitted earlier than the control instruction with later execution order.

5. The method of any one of claims 1-4, wherein, The control instruction comprises a first control instruction and a second control instruction, wherein the first control instruction is used to close a column start STV signal of the target screen-out area, and the second control instruction is used to open an STV signal of the target display area but not to open an emission column start ESTV signal of the target display area.

6. The method of claim 5, wherein, The control instruction further comprises a third control instruction, the third control instruction being used to set a corresponding refresh range of the target display area in a display memory of the display screen, and the third control instruction comprising information of a start row and an end row of the refresh range.

7. The method of claim 6, wherein, The control instruction further comprises a fourth control instruction and a fifth control instruction, the fourth control instruction being transmitted to the DDIC earlier than the fifth control instruction, the fourth control instruction being used to trigger the DDIC to enter a first state, and the fifth control instruction being used to release the first state, the DDIC in the first state not executing a control instruction received by the DDIC during the first state; The control instruction received by the DDIC during the first state comprises a control instruction transmitted by the processor to the DDIC between the fourth control instruction and the fifth control instruction.

8. The method of claim 7, wherein, The control instructions further include a sixth control instruction for triggering self-refresh of the display screen; the control instructions received by the DDIC during the first state take effect after the DDIC receives the sixth control instruction; wherein the taking effect after the sixth control instruction includes being executed when self-refresh of the display screen triggered by the sixth control instruction.

9. The method of claim 7 or 8, wherein, The transmission order of the first control instruction, the second control instruction and the third control instruction is before the transmission order of the fourth control instruction.

10. The method of claim 8 or 9, wherein, The transmission order of the sixth control instruction is after the transmission order of the fifth control instruction.

11. The method of any one of claims 8-10, wherein, The control instructions further include a seventh control instruction for turning on the ESTV signal of the target display area.

12. The method of claim 11, wherein, The execution order of the seventh control instruction is after the transmission order of the fifth control instruction.

13. The method of any one of claims 1-12, wherein, The control instructions are divided into two parts: a first part of instructions and a second part of instructions, wherein the first part of instructions is transmitted to the DDIC before the partitioned display, and the second part of instructions is transmitted to the DDIC after the partitioned display.

14. The method of any one of claims 1-13, wherein, The processor transmits control instructions to the DDIC, specifically including: If the detected scene is the first scene, the transmission of the control instructions is completed before the partitioned display; If the detected scene is the second scene, a first part of the control instructions is transmitted before the partitioned display, and a second part of the control instructions is transmitted after the partitioned display.

15. The method of claim 13 or 14, wherein, The second part of instructions includes a seventh control instruction for turning on the ESTV signal of the target display area.

16. The method of claim 15, wherein, The processor further performs partitioned display to the DDIC, specifically including: The processor judges whether the layer specification of the upper-layer picture sending and the display specification are consistent, if not, the upper-layer picture sending is not used for display first, and after the layer specification of the upper-layer picture sending and the display specification are consistent, the layer of the upper-layer picture sending is used for partitioned display to the DDIC.

17. A foldable electronic device, characterized by including: A processor, a display screen, a display driving integrated circuit (DDIC), a memory, the display screen is foldable, the display screen is connected to the DDIC, the DDIC is connected to the processor, the memory is connected to the processor, the memory is used to store a computer program, and the processor executes the computer program to realize the method in any one of claims 1-16.

18. A chip system comprising one or more processors, characterized in that The processor executes the computer program to realize the method in any one of claims 1-16.

19. A computer readable storage medium having stored thereon a computer program, characterized in that, The computer program is executed by the processor to realize the method in any one of claims 1-16.

20. A computer program product comprising a computer program, characterized in that, The computer program is executed by the processor to realize the method in any one of claims 1-16. The computer program is executed by the processor to realize the method in any one of claims 1-16.

Images