Desktop display method and device and storage medium

Abstract

The invention provides a desktop display method and device and a storage medium. According to the method, when the form of the display screen of the outer folding screen equipment is changed, the display screen is frozen, the desktop is subjected to screenshot, the desktop screenshot is displayed before the desktop is switched, the preset desktop layout is drawn according to the layer information obtained by the desktop screenshot, and the remote transition animation is realized by utilizing the preset desktop layout. After the transition animation is played, namely, the desktop is switched, the desktop layout used by the desktop is switched into the real layout, namely, the current desktop layout is used for replacing the preset desktop layout, so that the animation effect of desktop icon movement in the form change process of the display screen can be realized, and the user experience is improved. And the switching of the desktop layout can be realized under the condition that the user does not perceive, so that the conditions of blank screen and interface loading in the switching process are avoided, and the use experience of the user is improved.

Description

Technical Field

[0001] The present application relates to the technical field of folding screen devices, and in particular to a desktop display method, device and storage medium. Background Art

[0002] With the gradual development of flexible screen technology, foldable electronic devices, such as foldable mobile phones, have emerged. Taking a foldable screen mobile phone as an example, when the flexible screen is unfolded to folded, or folded to unfolded, the screen size for users to view will change, so the icons displayed on the desktop will also change.

[0003] Therefore, there is an urgent need to provide a desktop display method with animation effects to enhance user experience. Summary of the invention

[0004] The embodiments of the present application provide a desktop display method, device and storage medium, which are intended to enable an external folding screen device, such as an external folding screen mobile phone, to display a moving animation effect on desktop icons when the flexible screen is unfolded to folded, or folded to unfolded, thereby improving the user experience.

[0005] In a first aspect, an embodiment of the present application provides a desktop display method, which is applied to an external folding screen device. The external folding screen device includes a flexible screen, which includes a first display area, a second display area and a third display area. The method includes: when the flexible screen in an unfolded state is folded with the second display area as the folding area and the folding angle reaches a first threshold, registering a remote transition animation; when the folding angle of the flexible screen reaches a second threshold, freezing the flexible screen, capturing the desktop currently displayed on the flexible screen, and displaying the captured first desktop screenshot, the second threshold is greater than the first threshold; according to the first desktop screenshot, obtaining a first desktop layer, a first wallpaper layer and a first window layer, and canceling the freezing of the flexible screen; according to the first desktop layer, the first wallpaper layer and the first window layer, drawing a first preset desktop layout, the first preset desktop layout being the desktop layout corresponding to the flexible screen after switching from the unfolded state to the folded state; according to the first preset desktop layout, starting to play the transition animation, and in the process of playing the transition animation, translating and changing the transparency of the first desktop screenshot until the first desktop screenshot becomes transparent; after the first desktop icon corresponding to the third display area in the first preset layout is moved to the third display area, ending the transition animation, and switching the first preset layout to the desktop layout corresponding to the third area.

[0006] Among them, the first desktop screenshot is a screenshot of the entire desktop corresponding to the flexible screen in the unfolded state.

[0007] The first threshold may be an angle interval.

[0008] Optionally, the angle interval of the first threshold is, for example, (0°, 90°], that is, when the folding angle of the display screen reaches the first threshold, for example, 0°<folding angle≤90°, it can be determined that the folding angle of the display screen reaches the first threshold.

[0009] The first threshold may also be a specific angle value.

[0010] Optionally, the angle value of the first threshold is, for example, 45°, that is, when the folding angle of the display screen reaches the first threshold, for example, the folding angle=45°, it can be determined that the folding angle of the display screen reaches the first threshold.

[0011] Among them, the external folding screen device is, for example, an external folding screen mobile phone.

[0012] Among them, the first display area of ​​the flexible screen of the external folding screen device can be regarded as the secondary screen of the external folding screen device; the third display area can be regarded as the main screen of the external folding screen device.

[0013] Therefore, when the display screen shape of the external folding screen device changes, the display screen is frozen and a screenshot of the desktop is taken. Before the desktop is switched, the desktop screenshot is displayed first, and a preset desktop layout is drawn according to the layer information obtained from the desktop screenshot. The preset desktop layout is used to implement the remote transition animation. After the transition animation is finished, that is, the desktop is switching, the desktop layout used with the desktop is switched to the real layout (pre-stored in the local storage medium of the external folding screen device, such as the desktop layout in the internal memory), that is, the current desktop layout is used to replace the preset desktop layout, thereby realizing the animation effect of the desktop icons moving during the change of the display screen shape, and realizing the switching of the desktop layout without the user's perception, avoiding the black screen and loading interface during the switching process, thereby improving the user experience.

[0014] According to the first aspect, when the flexible screen in the unfolded state is folded with the second display area as the folding area and the folding angle reaches a first threshold, a remote transition animation is registered, including: when it is monitored that the flexible screen in the unfolded state is folded with the second display area as the folding area and the folding angle reaches the first threshold, the current position and size of the desktop element are marked in the remote transition animation function, and the remote interface for converting the overlay suspended application is called to register the remote transition animation.

[0015] Among them, the remote transition animation function is registerRemoteAnimation().

[0016] The call to override the pending application transition remote interface is overridePendingAppTransitionRemote().

[0017] According to the first aspect, or any implementation of the first aspect above, the method also includes: during the desktop startup process, registering a first monitor, the first monitor being used to monitor whether the folding angle reaches a first threshold during the process of folding the flexible screen in the unfolded state with the second display area as the folding area.

[0018] According to the first aspect, or any implementation of the first aspect above, during the desktop startup process, registering a first listener includes: during the desktop startup process, calling a registerContentObserver method to register the first listener.

[0019] Among them, the first monitoring is, for example, specifically used to monitor whether the pre-folding operation is triggered after the user folds the flexible screen of the external folding screen device.

[0020] Optionally, in some possible implementations, the first monitoring may be described as pre-folding monitoring.

[0021] According to the first aspect, or any implementation method of the first aspect above, a first preset desktop layout is drawn according to a first desktop layer, a first wallpaper layer and a first window layer, including: determining the first desktop icons included in the first preset desktop layout according to the first desktop layer, the first wallpaper layer and the first window layer; wherein a portion of the first desktop icons is displayed in a window corresponding to a third display area, and the remaining portion is displayed outside the window; the first desktop icons located outside the window corresponding to the third display area are moved into the window, and each first desktop icon is horizontally compressed; and the window displaying all the first desktop icons is horizontally stretched as a whole to obtain the first preset desktop layout.

[0022] For specific implementation details of this part, please refer to the embodiment for FIG. 8A to FIG. 8D The description part will not be repeated here.

[0023] According to the first aspect, or any implementation method of the first aspect above, the first desktop screenshot is overlaid on the first preset desktop layout, and the desktop icon in the first desktop screenshot is completely aligned with the first desktop icon in the first preset desktop layout; according to the first preset desktop layout, a transition animation is started to be played, and in the process of playing the transition animation, the first desktop screenshot is translated and the transparency is changed until the first desktop screenshot becomes transparent, including: when the transition animation is started, the transparency of the first desktop screenshot that is overlaid on the first preset desktop layout and completely aligned with the first desktop icon in the first preset desktop layout is changed until the first desktop screenshot becomes transparent and displays the first preset desktop layout; during the process of changing the transparency of the first desktop screenshot, the first preset desktop layout and the first desktop screenshot are controlled to translate to the right at the same translation speed and translation distance to the first desktop icon corresponding to the third display area in the first preset layout and move to the third display area.

[0024] For specific implementation details of this part, please refer to the embodiment for Fig.8D and Fig. 8E The description part will not be repeated here.

[0025] According to the first aspect, or any implementation of the first aspect above, the method also includes: in the process of controlling the first preset desktop layout and the first desktop screenshot to translate to the right to the first desktop icon corresponding to the third display area in the first preset layout with the same translation speed and translation distance and moving to the third display area, scaling the first desktop icon moved to the third display area according to the size of the third display area.

[0026] For specific implementation details of this part, please refer to the embodiment for Fig.8D and Fig. 8E The description part will not be repeated here.

[0027] According to the first aspect, or any implementation of the first aspect above, after switching the first preset layout to the desktop layout corresponding to the third area, the method also includes: when the flexible screen in the folded state is unfolded with the second display area as the folding area, and the unfolding angle reaches the third threshold, registering a remote transition animation; when the unfolding angle of the flexible screen reaches a fourth threshold, freezing the flexible screen, capturing the desktop currently displayed on the flexible screen, and displaying the captured second desktop screenshot, the fourth threshold is greater than the third threshold; according to the second desktop screenshot, obtaining the second desktop layer, the second wallpaper layer and the second window layer, and canceling the freezing of the flexible screen; according to the second desktop layer, the second wallpaper layer and the second window layer, drawing the second preset desktop layout, the second preset desktop layout is the desktop layout corresponding to the flexible screen after switching from the unfolded state to the folded state; according to the second preset desktop layout, starting to play the transition animation, and in the process of playing the transition animation, translating and changing the transparency of the second desktop screenshot until the second desktop screenshot becomes transparent; after all the second desktop icons included in the second preset layout are all moved to the display area of ​​the flexible screen, the transition animation is ended, and the second preset layout is switched to the desktop layout corresponding to the flexible screen.

[0028] Therefore, in the process of the flexible screen of the external folding screen device switching from the folded state to the unfolded state, the animation effect of the desktop icons can also be achieved.

[0029] According to the first aspect, or any implementation method of the first aspect above, a second preset desktop layout is drawn according to a second desktop layer, a second wallpaper layer and a second window layer, including: determining the second desktop icons included in the second preset desktop layout according to the second desktop layer, the second wallpaper layer and the second window layer; wherein a part of the second desktop icons is used to be displayed in the left display area of ​​the flexible screen, and the remaining part is used to be displayed in the right display area of ​​the flexible screen; displaying the second desktop icon in the second preset desktop layout that is the same as the desktop icon in the second desktop screenshot in the window corresponding to the third display area, and moving the second desktop icon that is not displayed in the window corresponding to the third display area outside the window to obtain the second preset desktop layout.

[0030] For specific implementation details of this part, please refer to the embodiment for Fig.9A and Fig. 9C The description part will not be repeated here.

[0031] According to the first aspect, or any implementation method of the first aspect above, the second desktop screenshot is overlaid on the second preset desktop layout, and the desktop icons in the second desktop screenshot are completely aligned with the second desktop icons in the second preset desktop layout; according to the second preset desktop layout, the transition animation is started to be played, and in the process of playing the transition animation, the second desktop screenshot is translated and the transparency is changed until the second desktop screenshot becomes transparent, including: when the transition animation is started, the transparency of the second desktop screenshot overlaid on the second preset desktop layout and completely aligned with the second desktop icons in the second preset desktop layout is changed until the second desktop screenshot becomes transparent and displays the second preset desktop layout; in the process of changing the transparency of the second desktop screenshot, the second preset desktop layout and the second desktop screenshot are controlled to translate to the left at the same translation speed and translation distance until all the second desktop icons included in the first preset layout are displayed in the display area of ​​the flexible screen.

[0032] For specific implementation details of this part, please refer to the embodiment for Fig. 9C and Fig.9D The description part will not be repeated here.

[0033] In a second aspect, an embodiment of the present application provides an electronic device. The electronic device includes: a memory and a processor, the memory and the processor are coupled; the memory stores program instructions, and when the program instructions are executed by the processor, the electronic device executes instructions of the method in the first aspect or any possible implementation of the first aspect.

[0034] In a third aspect, an embodiment of the present application provides a computer-readable medium for storing a computer program, wherein the computer program includes instructions for executing the method in the first aspect or any possible implementation of the first aspect.

[0035] In a fourth aspect, an embodiment of the present application provides a computer program, which includes instructions for executing the method in the first aspect or any possible implementation of the first aspect.

[0036] In a fifth aspect, an embodiment of the present application provides a chip, the chip comprising a processing circuit and a transceiver pin, wherein the transceiver pin and the processing circuit communicate with each other through an internal connection path, and the processing circuit executes the method in the first aspect or any possible implementation of the first aspect to control the receiving pin to receive a signal and control the sending pin to send a signal. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] Figure 1 is a schematic diagram showing an exemplary appearance of an external folding screen mobile phone;

[0038] FIG. 2A to FIG. 2CThis is a schematic diagram showing, for example, changes in desktop display content when a foldable phone changes from an unfolded state to a folded state;

[0039] FIG. 3A to FIG. 3C This is a schematic diagram showing the change of the desktop display content when the external folding screen mobile phone is transformed from the folded state to the unfolded state.

[0040] Figure 4 Schematic diagram of the hardware structure of an external folding screen mobile phone shown as an example;

[0041] Figure 5 The software structure diagram of an external folding screen mobile phone is shown as an example;

[0042] Figure 6 A schematic diagram showing the relationship among a window, a window manager and a window management service;

[0043] Figure 7 The following is a schematic diagram of the interaction logic between the window management service and the desktop launcher in the process of controlling the external folding screen mobile phone to change from the unfolded state to the folded state according to the desktop display method provided in the embodiment of the present application;

[0044] FIG. 8A to FIG. 8E A schematic diagram of a user interface involved in the process of an external folding screen mobile phone changing from an unfolded state to a folded state, before the transition animation starts and during the transition animation playing process;

[0045] 9A to 9D This is a schematic diagram of the user interface involved in the process of an external folding screen mobile phone changing from a folded state to an unfolded state, before the transition animation starts and during the playing of the transition animation. DETAILED DESCRIPTION

[0046] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0047] The term "and / or" in this article is merely a description of the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.

[0048] The terms "first" and "second" in the description and claims of the embodiments of the present application are used to distinguish different objects rather than to describe a specific order of objects. For example, a first target object and a second target object are used to distinguish different target objects rather than to describe a specific order of target objects.

[0049] In the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0050] In the description of the embodiments of the present application, unless otherwise specified, the meaning of "multiple" refers to two or more than two. For example, multiple processing units refer to two or more processing units; multiple systems refer to two or more systems.

[0051] In the description of the embodiments of the present application, an external folding screen device, an external folding screen mobile phone, and an external folding screen tablet all refer to electronic devices having a display screen, and the display screen is flexible and foldable outwards. Among them, folding outwards means that the display screen is folded toward one side of the rear shell.

[0052] In order to better understand the technical solutions provided by the embodiments of the present application, before describing the technical solutions of the embodiments of the present application, the styles of electronic devices applicable to the embodiments of the present application and the forms that can be presented are first described in conjunction with the accompanying drawings. For ease of description, the following embodiments are described using folding screen mobile phones as examples.

[0053] See also Figure 1 The external folding screen mobile phone 100 may include Figure 1 The form shown in (1) (hereinafter referred to as the unfolded state), Figure 1 The state shown in (2) (hereinafter referred to as: semi-folded state), and Figure 1 The state shown in (3) (hereinafter referred to as: folded state).

[0054] Continue to see Figure 1 For example, the external folding screen mobile phone 100 may include a complete display screen 194 (specifically a flexible screen). The display screen 194 may include a first display area 194-1 (hereinafter referred to as: secondary screen), a second display area 194-2 and a third display area 194-3 (hereinafter referred to as: main screen).

[0055] Optionally, the second display area 194-2 is a foldable area, that is, the external folding screen mobile phone 100 changes from an unfolded state to a semi-folded state, or a folded state; from a folded state to a semi-folded state, or an unfolded state; from a semi-folded state to an unfolded state, or a folded state, with the second display area 194-2 as the folding axis for folding or unfolding.

[0056] Continue to see Figure 1 Exemplarily, the external folding screen mobile phone 100 also includes a housing. The housing may include a housing area 196 for arranging devices such as a camera, a flash, and an audio module (such as a speaker, a receiver, a microphone, etc.).

[0057] Optionally, the width of the secondary screen+housing area 196 is equal to the width of the primary screen.

[0058] Understandably, when the display screen 194 of the external folding screen mobile phone 100 changes from the unfolded state to the semi-folded state, the operation of switching the display area will be triggered, such as loading the desktop to be displayed on the main screen, controlling the secondary screen to enter a black screen or display the interface of other applications, etc. When the display screen 194 changes from the semi-folded state to the folded state, the switching of the display area is completed, the main screen displays the desktop, and the secondary screen enters a black screen or displays the interface of other applications, etc. On the contrary, when the display screen 194 of the external folding screen mobile phone 100 changes from the folded state to the semi-folded state, the operation of switching the display area will also be triggered, specifically, the display area of ​​the entire display screen 194 is used as the desktop to display icons. When the display screen 194 changes from the semi-folded state to the unfolded state, the desktop icons originally displayed by the main screen are switched to the desktop icons displayed by the display screen 194. Based on this, according to the form presented by the external folding screen mobile phone 100, it can be divided into two major usage scenarios: unfolded state to folded state and folded state to unfolded state.

[0059] In addition, it should be noted that the desktop layout can be a single-row layout or a double-row layout.

[0060] The single-row layout means that the display area of ​​the entire display screen 194 displays the content of one interface, for example Figure 2C Zhong (1) and Figure 3C In (2), the display area of ​​the entire display screen 194 displays the content of interface 3. The double-row layout means that the display area of ​​the entire display screen 194 displays the content of two interfaces, for example Figure 2A Middle (1) Figure 2B Middle (1) Figure 3A Middle (2) Figure 3BIn (2), the display area of ​​the entire display screen 194 is divided into two left and right interfaces. For example, the left display area displays the content of interface 1, and the right display area displays the content of interface 2. That is, in a single-row layout, when a user performs a page-turning operation, the desktop switches to one (page) of interface content; in a double-row layout, when a user performs a page-turning operation, the desktop switches to two (pages) of interface content.

[0061] For example, in a single-row layout, the desktop has a total of three different interfaces, such as the first interface, the second interface and the third interface. When the desktop currently displayed on the display screen 194 is the first interface, the user makes a page turning operation, and the desktop will display the content of the second interface after switching.

[0062] For example, in a double-row layout, the desktop has a total of 4 different interfaces, such as the first interface, the second interface, the third interface and the fourth interface. When the left display area of ​​the desktop currently displayed on the display screen 194 displays the first interface and the right display area displays the second interface, the user makes a page turning operation, and after the desktop is switched, the third interface will be displayed in the left display area and the fourth interface will be displayed in the right display area.

[0063] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.

[0064] Optionally, the usage scenario from the expanded state to the folded state (hereinafter referred to as: usage scenario 1) can be divided into three small usage scenarios (hereinafter referred to as: usage scenario 1.1, usage scenario 1.2 and usage scenario 1.3).

[0065] Among them, usage scenario 1.1 is a usage scenario in which the display screen 194 of the external folding screen mobile phone 100 changes from the unfolded state to the folded state in a double-row layout, and the main screen displays the interface displayed in the display area on the left side of the display screen 194 when the main screen is unfolded. Figure 2A As shown in (1), when the display screen 194 of the external folding screen mobile phone 100 is in the unfolded state, the display area on the left side of the display screen 194 displays the content of interface 1, and the display area on the right side of the display screen 194 displays the content of interface 2. When the user folds the external folding screen mobile phone 100, the external folding screen mobile phone 100 is unfolded. Figure 2A The unfolded state shown in (1) is folded to Figure 2A After the folding state shown in (2), the main screen serves as a desktop for user operation, and displays interface 1' (specifically, the content of interface 1 after adapting to the size of the main screen).

[0066] Among them, usage scenario 1.2 is a usage scenario in which the display screen 194 of the external folding screen mobile phone 100 changes from the unfolded state to the folded state in a double-row layout, and the main screen displays the interface displayed in the display area on the right side of the display screen 194 when the main screen is in the unfolded state. Figure 2B As shown in (1), when the display screen 194 of the external folding screen mobile phone 100 is in the unfolded state, the display area on the left side of the display screen 194 displays the content of interface 1, and the display area on the right side of the display screen 194 displays the content of interface 2. When the user folds the external folding screen mobile phone 100, the external folding screen mobile phone 100 is unfolded. Figure 2B The unfolded state shown in (1) is folded to Figure 2B After the folding state shown in (2), the main screen serves as a desktop for user operation, and displays interface 2' (specifically, the content of interface 2 after adapting to the size of the main screen).

[0067] Among them, usage scenario 1.3 is a usage scenario in which the display screen 194 of the external folding screen mobile phone 100 changes from the unfolded state to the folded state in a single-row layout, and the main screen displays the interface displayed in the entire display area of ​​the display screen 194 when in the unfolded state. Figure 2C As shown in (1), when the display screen 194 of the external folding screen mobile phone 100 is in the unfolded state, the entire display area of ​​the display screen 194 displays the content of interface 3. When the user folds the external folding screen mobile phone 100, the external folding screen mobile phone 100 is unfolded. Figure 2C The unfolded state shown in (1) is folded to Figure 2C After the folding state shown in (2), the main screen serves as a desktop for user operation, and displays interface 3' (specifically, the content of interface 3 after adapting to the size of the main screen).

[0068] It should be understood that Figure 2A , Figure 2B and Figure 2C The desktop styles shown in the figure are merely examples listed for better understanding of the technical solution of this embodiment and are not intended to be the only limitation on this embodiment.

[0069] Optionally, the usage scenario from the folded state to the unfolded state (hereinafter referred to as: usage scenario 2) can be divided into three small usage scenarios (hereinafter referred to as: usage scenario 2.1, usage scenario 2.2 and usage scenario 2.3).

[0070] Among them, usage scenario 2.1 is the reverse operation scenario of usage scenario 1.1. Specifically, the desktop of the external folding screen mobile phone 100 adopts a double-row layout. When the display screen 194 is in the folded state, the desktop displays the interface displayed in the display area on the left side of the display screen 194 when it is in the unfolded state. When the user performs an unfolding operation on the external folding screen mobile phone 100, after the display screen 194 of the external folding screen mobile phone 100 changes from the folded state to the unfolded state, the display area on the left side of the display screen 194 will display the interface content displayed on the main screen in the folded state, and the display area on the right side will display the interface after the interface displayed on the main screen. For example Figure 3A As shown in (1), when the display screen of the external folding screen mobile phone 100 is in the folded state, the main screen displays the content of interface 1'. When the user unfolds the external folding screen mobile phone 100, the external folding screen mobile phone 100 is unfolded. Figure 3A The folded state shown in (1) is unfolded to Figure 3A In the expanded state shown in (2), the entire display screen 194 serves as a desktop for user operation. The display area on the left side of the display screen 194 will display interface 1 (specifically, the content of interface 1' after adapting to the size of the left display area), and the display area on the right side of the display screen 194 will display interface 2, that is, an interface after interface 1.

[0071] Among them, usage scenario 1.2 is the reverse operation scenario of usage scenario 1.2. Specifically, the desktop of the external folding screen mobile phone 100 adopts a double-row layout. When the display screen 194 is in the folded state, the desktop displays the interface displayed in the display area on the right side of the display screen 194 when it is in the unfolded state. When the user performs an unfolding operation on the external folding screen mobile phone 100, and the display screen 194 of the external folding screen mobile phone 100 changes from the folded state to the unfolded state, the display area on the right side of the display screen 194 will display the interface content displayed on the main screen in the folded state, and the display area on the left side will display the interface before the interface displayed on the main screen. For example Figure 3B As shown in (1), when the display screen of the external folding screen mobile phone 100 is in the folded state, the main screen displays the content of interface 2'. When the user unfolds the external folding screen mobile phone 100, the external folding screen mobile phone 100 is unfolded. Figure 3B The folded state shown in (1) is unfolded to Figure 3B In the expanded state shown in (2), the entire display screen 194 serves as a desktop for user operation. The display area on the right side of the display screen 194 will display interface 2 (specifically, the content of interface 2' after adapting to the size of the right display area), and the display area on the left side of the display screen 194 will display interface 1, which is an interface before interface 2.

[0072] Among them, usage scenario 1.3 is the reverse operation scenario of usage scenario 1.3. Specifically, the desktop of the external folding screen mobile phone 100 adopts a single-row layout, and when the display screen 194 is in the folded state, the desktop displays the interface displayed on the entire display screen 194 when it is in the unfolded state. For example Figure 3C As shown in (1), when the display screen 194 of the external folding screen mobile phone 100 is in the folded state, the main screen is used as the desktop for user operation, and the content of the interface 3' is displayed. When the user performs an unfolding operation on the external folding screen mobile phone 100, the external folding screen mobile phone 100 is unfolded. Figure 3C The folded state shown in (1) is unfolded to Figure 3C In the unfolded state shown in (2), the entire display screen 194 serves as a desktop for user operation, and displays the interface 3 (specifically, the content of the interface 3' after adapting to the size of the entire display screen 194).

[0073] It should be noted that for the use scenarios of the double-row layout, such as use scenarios 2.1 and 2.2, when the display screen 194 of the external folding screen mobile phone 100 is in the folded state and the interface displayed on the main screen is an odd page (the corresponding number of the interface is odd), after the external folding screen mobile phone 100 switches to the unfolded state, in order from left to right, the display screen 194 displays the interface content of the odd page displayed on the main screen, and the interface content of the even page (the corresponding number of the interface is even) after the interface of the odd page. Conversely, when the interface displayed on the main screen is an even page, after the external folding screen mobile phone 100 switches to the unfolded state, in order from left to right, the interface content of the odd page before the even page, and the interface content of the even page.

[0074] It should be understood that Figure 3A , Figure 3B and Figure 3C The desktop styles shown in the figure are merely examples listed for better understanding of the technical solution of this embodiment and are not intended to be the only limitation on this embodiment.

[0075] In addition, it should be noted that the above 6 small usage scenarios can be switched among each other.

[0076] Optionally, the single-row layout or the double-row layout can be switched through the desktop layout provided by the desktop setting portal.

[0077] Optionally, when changing from the expanded state to the collapsed state, the interface displayed on the desktop may be switched by default according to the switching rules of usage scenario 1.1.

[0078] Optionally, when the external folding mobile phone 100 is in the folded state, the main screen displays as follows: Figure 2A In the case of the interface 1' shown in (2), in response to the user's page turning operation on the main screen, the main screen may display Figure 2B Optionally, when the desktop display interface 2' is displayed on the main screen, if the user does not perform an unfolding operation on the external folding screen mobile phone 100, the display screen 194 of the external folding screen mobile phone 100 will display the following: Figure 2A Medium (1) or Figure 2BAfter the style shown in (1), no other operations are performed on the desktop, and the external folding screen mobile phone 100 is folded back into the folded state. In this case, the main screen of the external folding screen mobile phone 100 will display interface 2' instead of interface 1'.

[0079] Optionally, Figure 1 The hardware structure of the external folding screen mobile phone 100 of the appearance shown in FIG. Figure 4 shown.

[0080] See also Figure 4 The external folding screen mobile phone 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.

[0081] The antenna 1 and the antenna 2 are used to transmit and receive electromagnetic wave signals.

[0082] Among them, the processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (application processor, AP), a modem processor (Modem), a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and / or a neural-network processing unit (neural-network processing unit, NPU), etc., which are not listed one by one here and the present application does not limit this.

[0083] Optionally, in a specific implementation, different processing units may be independent devices or may be integrated into one or more processors.

[0084] Optionally, in some implementations, the controller may be the nerve center and command center of the external folding screen mobile phone 100. In practical applications, the controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0085] Optionally, a memory may be provided in the processor 110 for storing instructions and data. In some implementations, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0086] Optionally, in some implementations, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0087] Continue to see Figure 4 , the external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the external folding screen mobile phone 100. The external memory card communicates with the processor 110 through the external memory interface 120 to realize the data storage function. The internal memory 121 can be used to store computer executable program code, and the executable program code includes instructions. The processor 110 executes various functional applications and data processing of the external folding screen mobile phone 100 by running the instructions stored in the internal memory 121.

[0088] Specifically in the technical solution provided in the embodiment of the present application, different desktop layouts, and desktop icons and interfaces corresponding to different desktop layouts can be pre-stored in the internal memory 121.

[0089] Continue to see Figure 4, the charging management module 140 is used to receive charging input from the charger. Among them, the charging management module 140 can also power the terminal device through the power management module 141 while charging the battery 142. The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. In other implementations, the power management module 141 and the charging management module 140 can also be set in the same device.

[0090] Continue to see Figure 4 The wireless communication function of the external folding screen mobile phone 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor.

[0091] Continue to see Figure 4 The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the external folding screen mobile phone 100. The wireless communication module 160 can provide solutions for wireless communications including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), nearfield communication technology (NFC), infrared technology (IR), etc. applied to the external folding screen mobile phone 100.

[0092] Continue to see Figure 4 The audio module 170 may include a speaker 170A, a receiver 170B, a microphone 170C, an earphone jack 170D, and the like.

[0093] In addition, regarding the sensor module 180 in the external folding screen mobile phone 100, in some embodiments, it can include pressure sensors, gyroscope sensors, air pressure sensors, magnetic sensors, acceleration sensors, distance sensors, proximity light sensors, fingerprint sensors, temperature sensors, touch sensors, ambient light sensors, bone conduction sensors, etc., which are not listed one by one here, and this application does not impose any restrictions on this.

[0094] Continue to see Figure 4The button 190 includes a power button, a volume button, etc. The button 190 may be a mechanical button. It may also be a touch button. The motor 191 may generate a vibration prompt. The indicator 192 may be an indicator light, which may be used to indicate the charging status, the change of the power, or may be used to indicate messages, missed calls, notifications, etc.

[0095] Continue to see Figure 4 , the camera 193 is used to capture static images or videos. In some implementations, the external folding screen mobile phone 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0096] Continue to see Figure 4 , the display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. In some implementations, the external folding screen mobile phone 100 may include 1 or N display screens 194, where N is a positive integer greater than 1. The external folding screen mobile phone 100 can implement display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connecting the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0097] Specifically in the technical solution provided in the embodiment of the present application, the display screen 194 is a flexible screen.

[0098] Optionally, the flexible screen is a screen that can be folded outwards. Its folded form is, for example, Figure 1 Shown are the unfolded state, the semi-folded state and the folded state.

[0099] Continue to see Figure 4 , exemplarily, the SIM card interface 195 is used to connect a SIM card or a USIM card. The SIM card can be connected to and separated from the external folding screen mobile phone 100 by inserting into or pulling out from the SIM card interface 195. The external folding screen mobile phone 100 can support 1 or N (N is an integer greater than 1) SIM card interfaces 195. That is, multiple SIM cards or USIM cards can be inserted into the terminal.

[0100] This concludes the introduction to the hardware structure of the external folding screen mobile phone 100. It should be understood that Figure 4 The external folding screen mobile phone 100 shown is only an example. In a specific implementation, the external folding screen mobile phone 100 may have more or fewer components than those shown in the figure, may combine two or more components, or may have a different component configuration. Figure 4 The various components shown in the drawings may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application specific integrated circuits.

[0101] For the above six specific usage scenarios, the embodiments of the present application provide a desktop display method, which aims to change the form of an external folding screen mobile phone (or other external folding screen devices), such as from an unfolded state to a folded state, or from a folded state to an unfolded state. The desktop icons can present a moving animation effect rather than abrupt changes in the desktop icons (the change process may involve a brief black screen or a period of waiting for the new interface to be added, affecting the user experience), thereby improving the user experience.

[0102] Specifically in the desktop display method provided in the embodiment of the present application, the animation effect of the desktop icon movement is realized through the interaction of the application layer and the application framework layer in the external folding screen mobile phone 100 system, specifically the desktop launcher in the application layer and the window management service in the application framework layer.

[0103] In order to better understand the desktop display method provided by the embodiment of the present application, the software structure of the external folding screen mobile phone 100 is described below. Before describing the software structure of the external folding screen mobile phone 100, the architecture that can be adopted by the software system of the external folding screen mobile phone 100 is first described.

[0104] Specifically, in actual applications, the software system of the external folding screen mobile phone 100 can adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture.

[0105] In addition, it is understandable that the software systems used by the current mainstream terminal devices include but are not limited to Windows systems, Android systems and iOS systems. For the sake of convenience, the embodiment of the present application takes the layered architecture Android system as an example to illustrate the software structure of the external folding screen mobile phone 100.

[0106] In addition, the desktop display method provided in the subsequent embodiments of the present application is also applicable to other systems in specific implementations.

[0107] See also Figure 5 , which is a software structure block diagram of the external folding screen mobile phone 100 according to an embodiment of the present application.

[0108] like Figure 5As shown, the layered architecture of the external folding screen mobile phone 100 divides the software into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces. In some implementations, the Android system is divided into five layers, from top to bottom, namely, the application (Application, APP) layer, the application framework (Application Framework, FWK) layer, the Android runtime (Android runtime) and system library, the hardware abstraction layer (hardware abstraction layer, HAL), and the kernel layer.

[0109] The application layer can include a series of application packages.

[0110] like Figure 5 As shown, desktop launcher (Launcher), settings, music, Bluetooth, gallery and other applications are not listed here one by one, and this application does not impose any restrictions on this.

[0111] Launcher is the desktop launcher in the Android system. The desktop user interface (UserInterface, UI) of the Android system is collectively referred to as Launcher. Launcher is one of the main program components in the Android system. If there is no Launcher in the Android system, the Android desktop cannot be started.

[0112] Specifically, in the technical solution provided in the embodiment of the present application, the desktop display needs to use Launcher to realize the switching of the displayed content on the desktop and the animation effect.

[0113] The application framework layer provides an application programming interface (API) and a programming framework (these programming interfaces and programming frameworks can be described as functions) for the applications of the application layer. In some embodiments, the application framework layer includes some predefined functions.

[0114] like Figure 5 As shown, the application framework layer may include a window manager, a window management service, a content provider, a view system, a resource manager, and the like.

[0115] The window manager can obtain the display size, determine whether there is a status bar, lock the screen, take screenshots, etc.

[0116] The window management service is used to manage window programs, determine the content to be displayed on the screen that is on or as the desktop, and enable the screen that is on or as the desktop to display.

[0117] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc., which are not listed here and are not limited by this application.

[0118] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.

[0119] The resource manager provides various resources for the application, such as localized strings, icons, images, layout files, video files, etc., which are not listed here one by one and are not limited in this application.

[0120] In order to better understand the technical solution provided by the embodiments of the present application, the concepts and relationships of window (Window), window manager (WindowManager) and window management service (WindowManagerService) are first explained below.

[0121] Specifically, the Window in Android does not refer to a specific mobile phone window, but an abstract concept, which is essentially a view. Figure 6 shown.

[0122] Continue to see Figure 6 , exemplarily, similar to the relationship between the activity manager (ActivityManager) and the activity management service (ActivityManagerService), the implementation of the methods in WindowManager is also achieved by remotely calling WindowManagerService.

[0123] Specifically, in the technical solution provided by the embodiment of the present application, when it is detected that the display screen 194 is folded to a certain angle, that is, the folding operation is triggered, or when it is unfolded to a certain angle, that is, the unfolding operation is triggered, the freezing of the screen, capturing of the screen, passing the desktop layer, wallpaper layer, window layer, etc. to the Launcher, and the cancellation of the freezing of the screen by WindowManager are all realized by remotely calling WindowManagerService. That is, in the technical solution provided by the embodiment of the present application, it is WindowManagerService that actually participates in the processing in the FWK layer and interacts with the Launcher of the APPC layer.

[0124] For the specific interaction logic between Launcher and WindowManagerService, please refer to Figure 7 The description of the illustrated embodiment will not be repeated here.

[0125] The system library and runtime layer include the system library and Android Runtime. Android Runtime includes the core library and the virtual machine. Android runtime is responsible for the scheduling and management of the Android system.

[0126] The core library consists of two parts: one is the function that needs to be called by the Java language, and the other is the Android core library.

[0127] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0128] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), shape manager, etc.

[0129] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0130] The media library supports the playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0131] The shape manager is used to detect changes in the shape of the external folding screen mobile phone, such as whether it is currently in the unfolded state, semi-folded state, or folded state.

[0132] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0133] It can be understood that the 2D graphics engine mentioned above is a drawing engine for 2D drawing.

[0134] The HAL layer is an interface layer between the operating system kernel and the hardware circuit. The HAL layer includes but is not limited to: camera hardware abstraction layer, display driver hardware abstraction layer, and power hardware abstraction layer.

[0135] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, power management driver, and sensor driver. Among them, the display driver can include a secondary screen display driver, a main screen display driver, etc. The sensor driver can include drivers corresponding to gyroscope sensors, acceleration sensors, Hall sensors, etc., which are used to detect the angle change between the main screen and the secondary screen of the external folding screen mobile phone. The camera driver is used to drive the corresponding camera to work. The capacitor management driver is used to drive the power management module to power the display screen.

[0136] This concludes the introduction to the software structure of the external folding screen mobile phone 100. It can be understood that, Figure 5 The layers in the software structure shown and the components contained in each layer do not constitute a specific limitation on the external folding screen mobile phone 100. In other embodiments of the present application, the external folding screen mobile phone 100 may include more or fewer layers than shown in the figure, and each layer may include more or fewer components, which is not limited in the present application.

[0137] In order to better understand the desktop display method provided in the embodiment of the present application, the following embodiment still uses the folding screen mobile phone 100 (such as Figure 1 The appearance shown, Figure 4 The hardware structure shown is Figure 5 As an example, combined with Figure 7 The specific interaction between Launcher and WindowManagerService during the process of the external folding screen mobile phone 100 changing from the unfolded state to the folded state is explained.

[0138] S101, during the desktop startup process, the desktop launcher registers a pre-folding monitor with the window management service.

[0139] Specifically, in the Android system, during the desktop startup process, the desktop launcher will call the onCreate() function to create a window corresponding to the desktop. In order to monitor the display form of the external folding screen mobile phone, the desktop launcher will register a pre-folding monitor in the onCreate() function.

[0140] Optionally, the desktop launcher calls the registerContentObserver method in the onCreate() function to register a pre-folding listener.

[0141] Understandably, registerContentObserver is a method in the Android system, and its main function is to register a content observer (ContentObserver) object so that when the content in the monitored Uniform Resource Identifier (URI) changes, it can be notified in time and make corresponding processing. Therefore, in the technical solution provided in the embodiment of the present application, the desktop launcher calls the registerContentObserver method in the onCreate() function during the desktop startup process, so that it can monitor the shape of the display screen in real time after the desktop is started.

[0142] S102: The window management service determines that the folding angle of the display screen reaches a first threshold.

[0143] Specifically, when the user performs a folding operation on the display screen of the external folding screen mobile phone, that is, in the process of folding the display screen, the angle between the main screen and the secondary screen can be determined according to the data collected by the sensors in the main screen and the secondary screen for detecting the angle between the two, or the folding angle of the current display screen can be determined. In this way, by judging whether the determined angle or folding angle reaches the first threshold, it can be determined whether the pre-folding is triggered. That is, it is determined whether the user is folding the display screen and folding the display screen from the folded state to the folded state.

[0144] Optionally, the first threshold may be an angle interval, for example (0°, 90°].

[0145] In this case, when the window management service determines that the folding angle of the display screen reaches the first threshold, for example, when 0°<folding angle≤90°, it can be determined that the folding angle of the display screen reaches the first threshold.

[0146] Optionally, the first threshold may be a specific angle value, such as any angle value in (0°, 90°], such as 45°.

[0147] In this case, when the window management service determines that the folding angle of the display screen reaches the first threshold, for example, when the folding angle=45°, it can be determined that the folding angle of the display screen reaches the first threshold.

[0148] In addition, it should be noted that when the angle used to determine whether to trigger pre-folding is the angle between the main screen and the sub-screen, that is, not the current folding angle, when the first threshold is an angle range, it can be [90°, 180°), for example.

[0149] In this case, when the window management service determines that the angle of the display screen reaches the first threshold, for example, when 90°≤angle<180°, it can be determined that the angle of the display screen reaches the first threshold.

[0150] Optionally, the first threshold may also be a specific angle value, such as any angle value in [90°, 180°), such as 145°.

[0151] In this case, when the window management service determines that the angle of the display screen reaches the first threshold, for example, when the angle=145°, it can be determined that the angle of the display screen reaches the first threshold.

[0152] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.

[0153] Continue to see Figure 7 For example, when the window management server determines that the folding angle or included angle of the display screen reaches a first threshold, during the desktop startup process, the registered pre-folding monitor will monitor the pre-folding operation.

[0154] Specifically, the desktop launcher obtains the current state of the display screen through the onChange method in the ContentObserver class inherited by the registered pre-folding listener.

[0155] S103: After the desktop launcher detects the pre-folding operation through the pre-folding monitor, it registers the remote transition animation.

[0156] Optionally, when registering a remote transition animation, you first need to mark the position and size of desktop elements (such as desktop icons, signal bars, etc.), and then call the override pending application transition remote interface (overridePendingAppTransitionRemote()).

[0157] Optionally, the above two steps can be implemented in a register remote transition animation function (registerRemoteAnimation()), wherein marking the current position and size of the desktop element is the first step performed in the function, followed by calling overridePendingAppTransitionRemote() to register the remote transition animation (REMOTE ANIM).

[0158] It can be understood that the purpose of marking the current position and size of the desktop elements is to ensure that when drawing the preset desktop layout, the position and size of the desktop elements displayed in the preset desktop layout can be completely aligned with the position and size of the desktop elements in the current desktop (the desktop screenshot obtained later), thereby ensuring that after the remote transition animation starts playing, the desktop elements will not change abruptly, thereby ensuring the user experience.

[0159] S104, while the user continues to fold the display screen, the window management service continues to determine whether the folding angle (or included angle) of the display screen reaches a second threshold, and if it is determined that the second threshold is reached, executes step S105.

[0160] Optionally, the second threshold is, for example, 90°. That is, when the angle between the secondary screen and the primary screen is 90°, the screen that the user can see is the primary screen, and the desktop will be switched from being displayed on the entire display screen to being displayed on the primary screen.

[0161] S105, the window management service freezes the desktop, takes a screenshot of the desktop, and displays the desktop screenshot.

[0162] Among them, the freezing screen mentioned in the embodiment of the present application refers to keeping the content currently displayed on the display screen, but not responding to any operation of the user on the display screen.

[0163] In this way, before the interface that needs to be displayed on the main screen is loaded, by freezing the desktop, taking a screenshot of the desktop, and displaying the desktop screenshot, the user will not see the black screen or loading interface that may appear during the interface loading process, thereby improving the user experience.

[0164] Continue to see Figure 7 Exemplarily, after completing the operation of step S105, the window management service sends a folding configuration change (configchange) instruction to the desktop launcher to inform the desktop manager that the display screen has switched from the expanded state to the folded state (or is about to switch to the folded state).

[0165] Continue to see Figure 7 Exemplarily, after completing the operation of step S105, the window management service will also pass the desktop layer, wallpaper layer, window layer, etc. corresponding to the desktop screenshot to the desktop launcher through the callback of the remote transition animation (REMOTE ANIM) registered by the desktop launcher in step S103, and cancel the freezing of the desktop.

[0166] It is understandable that after the screen is unfrozen, the user can operate the display screen normally, and the display screen can also respond to the user's operations.

[0167] S106, the desktop launcher draws a preset desktop layout according to the desktop layer, wallpaper layer, window layer, etc.

[0168] For example, draw the view of the window that needs to be displayed.

[0169] It should be noted that the preset desktop layout is not visible before the transition animation is played, and is specifically covered by the desktop screenshot.

[0170] In addition, the position and size of the icons in the currently displayed desktop screenshot are completely consistent with the position and size of the desktop icons on the real desktop, thereby ensuring that the user will not perceive the existence of the desktop screenshot when the transition animation is played.

[0171] S107, start playing the transition animation.

[0172] Specifically, when the transition animation begins to play, the preset desktop layout will begin to pan, such as panning outward from the right edge of the screen.

[0173] In addition, during the translation of the preset desktop layout, the desktop screenshot will begin to change its transparency, specifically becoming transparent and invisible, and in the process of becoming transparent and invisible, it will maintain the same translation speed and direction as the preset desktop layout for translation.

[0174] It should be noted that in usage scenario 1.1, the content of the display area on the left side of the preset desktop layout needs to be translated to the main screen. Therefore, when the remote animation starts playing, the preset desktop layout and the desktop screenshot that is completely aligned with it also need to be translated together. In usage scenario 1.2, the content of the display area on the right side of the preset desktop layout is originally in the display area corresponding to the main screen. Therefore, when the remote animation starts playing, the preset desktop layout and the desktop screenshot that are completely aligned with it move less. In usage scenario 1.3, the preset desktop layout and desktop screenshot that are adapted to the main screen need to be translated together. Figure 1 Pan and zoom.

[0175] Continue to see Figure 7 For example, after the transition animation is finished, the desktop launcher will call back onfinish() to inform the window management server that the transition animation is finished, so that the window management service can execute step S108.

[0176] S108: The window management service switches the desktop layout from the preset desktop layout to the desktop layout corresponding to the main screen.

[0177] That is, the layout size is adapted to the desktop layout of the main screen, so that there is no situation where there are undisplayed desktop icons outside the window corresponding to the desktop.

[0178] In order to better understand the preparation process before the transition animation starts (step S106), and the process during the transition animation playback (step S107), the following is combined with FIG. 8A to FIG. 8E Provide specific instructions.

[0179] The following is the content of the preparation process before the transition animation begins:

[0180] See also Fig. 8AFor example, after the user folds the display screen and triggers the pre-folding operation, the window management service freezes the desktop and takes a screenshot of the desktop (including the desktop wallpaper in the specific implementation) to obtain the desktop screenshot. Fig. 8A The desktop screenshot includes desktop icons 1-1 to 1-8 displayed in the left display area of ​​the display screen, and desktop icons 2-1 to 2-8 displayed in the right display area of ​​the display screen.

[0181] Optionally, in actual application, the desktop screenshot may also include the content in the signal bar (not shown in the figure) and the desktop wallpaper set on the current desktop (not shown in the figure).

[0182] Optionally, after receiving the desktop layer, wallpaper layer, and window layer delivered by the window management service through the callback of the remote transition animation, the desktop launcher will draw the preset desktop layout according to these layers, such as Fig. 8A As shown in (2).

[0183] Optionally, in a usage scenario where the display screen changes from an expanded state to a folded state, the preset desktop layout may be implemented, for example, by a predefined desktop layout function, such as prepareLayoutFakeUiFullToMain().

[0184] See also Fig. 8A In (2), illustratively, the drawn preset desktop layout includes two parts, one part is a window matching the display area of ​​the main screen, and the other part is the desktop icon part outside the window.

[0185] In order to realize the transition animation using the preset desktop layout, it is necessary to move the desktop icons outside the window into the window and compress all the desktop icons in the window horizontally, such as Figure 8B Medium (1) to Figure 8B As shown in (2) in the figure, the desktop icons displayed outside the window are moved to the inside of the window for display.

[0186] Since the desktop screenshot is overlaid on the window and the desktop icons are completely aligned, when the desktop icons outside the window are moved to the window for display, the following is obtained: Figure 8B After the window shown in (2) is opened, the entire window needs to be stretched horizontally to obtain a window with the same size as the desktop screenshot and the desktop icons in the window are completely aligned with the desktop icons in the desktop screenshot. Figure 8C The window shown in (1) is stretched horizontally as a whole to obtain Figure 8C The window shown in (2) is shown in the figure.

[0187] In getting Figure 8CAfter the window (preset desktop layout) shown in (2) is opened, the window can be placed under the desktop screenshot, that is, the desktop screenshot is covered on the window, and the desktop screenshot and the window are completely aligned, such as Fig.8D shown.

[0188] Therefore, before playing the transition animation, the preset desktop layout is drawn, completing the preparation work required before the transition animation starts.

[0189] Here is what happens during the transition animation:

[0190] When the transition animation starts playing, the desktop launcher control covers the window, and the desktop screenshot that is completely aligned with it moves and changes its transparency, so that the window covered by the desktop screenshot is displayed, that is, the desktop starts to Fig. 8E (1) becomes Fig. 8E As shown in (2).

[0191] Optionally, it may be specified that the transparency of the desktop screenshot changes from 0% (completely opaque) to 100% (transparent) within a set time.

[0192] Optionally, the change in transparency is accomplished, for example, within a 50 millisecond (ms) window.

[0193] Optionally, in some possible implementations, it may be specified that the transparency changes by 20% every 10 ms, so that transparency is achieved at 50 ms, that is, the desktop screenshot is invisible and the window is fully displayed.

[0194] Continue to see Fig. 8E For example, during the transition animation, the desktop launcher also needs to control the window (including desktop icons, wallpaper, signal bar, etc.) to move to the right as a whole, and each column (desktop) icon in the window moves and scales to the right, for example, the window moves from Fig. 8E (2) Translation transformation to Fig. 8E Chinese (3).

[0195] Optionally, when the entire window is moved to the right and scaled, the desktop icon to be scaled can be determined by setting the size of the desktop icon; the translation distance and the translation time of each column can be set to achieve the window moving to the right.

[0196] Optionally, the size of the desktop icon can be determined by the two parameters setScaleX (corresponding to width) and setScaleY (corresponding to height).

[0197] Optionally, the translation distance can be determined by two parameters: setTranslationX (corresponding to the horizontal movement distance) and setTranslationY (corresponding to the vertical movement distance).

[0198] Optionally, the shifting time of each column can be realized by setDuration(). Optionally, the shifting time of each column is, for example, 50 ms.

[0199] Continue to see Fig. 8E , for example, the window passes from Fig. 8E Middle (2) to Fig. 8E By continuously panning in (3), desktop icons 2-1 to 2-8 are all moved out of the window, and finally desktop icons 1-1 to 1-8 in the window are displayed in the display area corresponding to the main screen, and are scaled to a size that matches the size of the main screen. At this point, the transition animation is played, and the desktop changes from the display screen to the display screen as shown in the figure. Fig. 8A (1) Desktop screenshot style, switch to Fig. 8E The style of the display area on the right side of the (4) window.

[0200] As a result, when the display screen of the external folding screen mobile phone switches from the unfolded state to the folded state, the desktop icons present a moving animation effect, thereby improving the user experience.

[0201] It can be understood that the process of the external folding screen mobile phone 100 changing from the folded state to the unfolded state, the specific interaction between Launcher and WindowManagerService is the same as Figure 7 As shown, the specific interaction between Launcher and WindowManagerService in the process of the folding screen mobile phone 100 changing from the unfolded state to the folded state is similar. The difference is that, to monitor the unfolded state, it is necessary to register the pre-expansion monitor during the desktop startup process. Accordingly, when the window management service determines that the unfolding angle of the display screen reaches a certain threshold, such as the third threshold, the desktop launcher can see the pre-expansion through the pre-expansion monitor, and then perform the operation of registering the remote transition animation. Accordingly, in the process of the user continuing to unfold the display screen, when the desktop management service determines that the unfolding angle of the display screen reaches a certain threshold, such as the fourth threshold, it can freeze the screen, take a screenshot of the desktop, obtain the desktop screenshot, send the unfolded configuration change instruction to the desktop launcher, and execute the callback through the remote transition animation, pass the desktop screenshot, desktop layer, wallpaper layer, and window layer to the desktop launcher, and cancel the freeze screen operation. Accordingly, the desktop launcher will execute the following Figure 7 After the transition animation is finished, the desktop management service will execute the following operations in step S106 and step S107: Figure 7 The specific interaction process is not shown again. The following uses scenario 2.1 as an example to illustrate the preparation process before the transition animation starts and the process of playing the transition animation when the external folding screen mobile phone changes from the folded state to the unfolded state.

[0202] The following is the content of the preparation process before the transition animation begins:

[0203] See also Fig.9A For example, after the user unfolds the display screen and triggers the pre-expansion operation, the window management service freezes the desktop and takes a screenshot of the desktop (including the desktop wallpaper in the specific implementation) to obtain the desktop screenshot. Fig.9A As shown in (1) in the figure, the desktop screenshot includes desktop icons 1-1 to 1-8 displayed in the main screen.

[0204] Optionally, in actual application, the desktop screenshot may also include the content in the signal bar (not shown in the figure) and the desktop wallpaper set on the current desktop (not shown in the figure).

[0205] Optionally, after receiving the desktop layer, wallpaper layer, and window layer delivered by the window management service through the callback of the remote transition animation, the desktop launcher will draw the preset desktop layout according to these layers, such as Fig.9A As shown in (2).

[0206] Optionally, in a usage scenario where the display screen changes from a folded state to an unfolded state, the preset desktop layout may be implemented, for example, by a predefined desktop layout function, such as prepareLayoutFakeUiMainToFull().

[0207] See also Fig.9A In (2), illustratively, the drawn preset desktop layout includes two parts, one part is a window matching the display area of ​​the main screen, and the other part is a desktop icon part not displayed in the main screen.

[0208] In order to use the preset desktop layout to achieve transition animation, you need to move the desktop icons that are not displayed on the main screen outside the window. Fig. 9B The four right columns of desktop icons in the window shown in (1) are moved horizontally outside the window to obtain Fig. 9B In this way, the four columns of desktop icons displayed on the right side of the window are moved out of the window.

[0209] In getting Fig. 9B After opening the window shown in (2), you need to place the window under the desktop screenshot, that is, use Fig.9A The desktop screenshot shown in (1) is overlaid on the window, and the desktop icons in the desktop screenshot are completely aligned with the desktop icons in the window. The aligned desktop screenshot and window can be Fig. 9C As shown in (3).

[0210] Therefore, before playing the transition animation, the preset desktop layout is drawn, completing the preparation work required before the transition animation starts.

[0211] Here is what happens during the transition animation:

[0212] When the transition animation starts playing, the desktop launcher control covers the window, and the desktop screenshot that is completely aligned with it is translated and the transparency changes, so that the window covered by the desktop screenshot is displayed, that is, the desktop is moved from Fig.9D (1) becomes Fig.9D As shown in (2).

[0213] Optionally, it may be specified that the transparency of the desktop screenshot changes from 0% (completely opaque) to 100% (transparent) within a set time.

[0214] Optionally, the change in transparency is accomplished, for example, within a 50 millisecond (ms) window.

[0215] Optionally, in some possible implementations, it may be specified that the transparency changes by 20% every 10 ms, so that transparency is achieved at 50 ms, that is, the desktop screenshot is invisible and the window is fully displayed.

[0216] Continue to see Fig.9D For example, during the transition animation, the desktop launcher also needs to control the window (including desktop icons, wallpaper, signal bar, etc.) to move to the left as a whole, and each column (desktop) icon in the window moves and scales to the left, for example, the window moves from Fig.9D (2) Translation transformation to Fig.9D Chinese (3).

[0217] Optionally, when the entire window is moved to the left and scaled, the desktop icon to be scaled to can be determined by setting the size of the desktop icon; and the translation distance and the translation time of each column can be set to achieve the leftward movement of the window.

[0218] Optionally, the size of the desktop icon can be determined by the two parameters setScaleX (corresponding to width) and setScaleY (corresponding to height).

[0219] Optionally, the translation distance can be determined by two parameters: setTranslationX (corresponding to the horizontal movement distance) and setTranslationY (corresponding to the vertical movement distance).

[0220] Optionally, the shifting time of each column can be realized by setDuration(). Optionally, the shifting time of each column is, for example, 50 ms.

[0221] Continue to see Fig.9D , for example, the window passes from Fig.9D Middle (2) to Fig.9DBy continuously panning in (3), desktop icons 2-1 to 2-8 are all moved into the display area of ​​the display screen. Finally, desktop icons 1-1 to 1-8 in the window are displayed in the display area on the left side of the display screen, and desktop icons 2-1 to 2-8 are displayed in the display area on the right side of the display screen, and are scaled to a size that matches the size of the entire display screen. At this point, the transition animation is played and the desktop changes from the display screen to the display area shown in FIG. Fig.9A (1) Desktop screenshot style, switch to Fig.9D (4) The style of the window.

[0222] As a result, when the display screen of the external folding screen mobile phone switches from a folded state to an unfolded state, the desktop icons present a moving animation effect, thereby improving the user experience.

[0223] In addition, it should be noted that in the embodiment of the present application, the pre-folding monitoring and pre-unfolding monitoring are only used to explain the monitoring of the current state of the external folding screen mobile phone. In actual applications, during the startup of the desktop launcher, only one monitoring can be created, and different thresholds can be used to determine the angle between the main screen and the secondary screen of the external folding screen mobile phone, so as to determine whether the current state is changing from the folded state to the unfolded state, or from the unfolded state to the folded state.

[0224] In addition, it is understandable that, in order to implement the above functions, the electronic device includes hardware and / or software modules corresponding to the execution of each function. In combination with the algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered to be beyond the scope of the present application.

[0225] In addition, it should be noted that the desktop display method provided by the above embodiments implemented by the electronic device in the actual application scenario can also be executed by a chip system included in the electronic device, wherein the chip system may include a processor. The chip system can be coupled to the memory so that when the chip system is running, the computer program stored in the memory is called to implement the steps executed by the above electronic device. The processor in the chip system can be an application processor or a processor other than an application processor.

[0226] In addition, an embodiment of the present application further provides a computer-readable storage medium, in which computer instructions are stored. When the computer instructions are executed on an electronic device, the electronic device executes the above-mentioned related method steps to implement the desktop display method in the above-mentioned embodiment.

[0227] In addition, an embodiment of the present application further provides a computer program product. When the computer program product is run on an electronic device, the electronic device executes the above-mentioned related steps to implement the desktop display method in the above-mentioned embodiment.

[0228] In addition, an embodiment of the present application also provides a chip (which may also be a component or module), which may include one or more processing circuits and one or more transceiver pins; wherein the transceiver pins and the processing circuit communicate with each other through an internal connection path, and the processing circuit executes the above-mentioned related method steps to implement the desktop display method in the above-mentioned embodiment, so as to control the receiving pin to receive a signal, so as to control the sending pin to send a signal.

[0229] In addition, it can be seen from the above description that the electronic device, computer-readable storage medium, computer program product or chip provided in the embodiments of the present application are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be repeated here.

[0230] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A desktop display method, characterized in that: Applied to an external folding screen device, the external folding screen device includes a flexible screen, the flexible screen includes a first display area, a second display area and a third display area, the method includes: When the flexible screen in the unfolded state is folded with the second display area as the folding area and the folding angle reaches a first threshold, registering a remote transition animation; When the folding angle of the flexible screen reaches a second threshold, freezing the flexible screen, capturing a desktop currently displayed on the flexible screen, and displaying the captured first desktop screenshot, the second threshold being greater than the first threshold; According to the first desktop screenshot, a first desktop layer, a first wallpaper layer and a first window layer are obtained, and freezing of the flexible screen is canceled; Drawing a first preset desktop layout according to the first desktop layer, the first wallpaper layer, and the first window layer, wherein the first preset desktop layout is a desktop layout corresponding to when the flexible screen is switched from the unfolded state to the folded state; According to the first preset desktop layout, start playing a transition animation, and during the playing of the transition animation, translate and change the transparency of the first desktop screenshot until the first desktop screenshot becomes transparent; After the first desktop icon corresponding to the third display area in the first preset layout is moved to the third display area, the transition animation is ended, and the first preset layout is switched to the desktop layout corresponding to the third area.

2. The method according to claim 1, characterized in that The method of registering a remote transition animation when the flexible screen in the unfolded state is folded with the second display area as a folding area and the folding angle reaches a first threshold includes: When it is monitored that the flexible screen in the expanded state is folded with the second display area as the folding area and the folding angle reaches the first threshold, the current position and size of the desktop element are marked in the remote transition animation function, and the remote interface for converting the overlay suspended application is called to register the remote transition animation.

3. The method according to claim 2, characterized in that The method further comprises: During the desktop startup process, a first monitor is registered, where the first monitor is used to monitor whether the folding angle reaches the first threshold during the process of folding the flexible screen in the unfolded state with the second display area as the folding area.

4. The method according to claim 3, characterized in that The step of registering a first listener during the desktop startup process includes: During the desktop startup process, the registerContentObserver method is called to register the first listener.

5. The method according to claim 1, characterized in that Drawing a first preset desktop layout according to the first desktop layer, the first wallpaper layer and the first window layer includes: Determining, according to the first desktop layer, the first wallpaper layer, and the first window layer, a first desktop icon included in the first preset desktop layout; wherein a portion of the first desktop icon is displayed in the window corresponding to the third display area, and the remaining portion is displayed outside the window; moving the first desktop icons located outside the window corresponding to the third display area into the window, and horizontally compressing each of the first desktop icons; The window displaying all the first desktop icons is stretched horizontally as a whole to obtain the first preset desktop layout.

6. The method according to claim 1, characterized in that The first desktop screenshot is overlaid on the first preset desktop layout, and the desktop icons in the first desktop screenshot are completely aligned with the first desktop icons in the first preset desktop layout; The step of starting to play a transition animation according to the first preset desktop layout, and during the playing of the transition animation, translating and changing the transparency of the first desktop screenshot until the first desktop screenshot becomes transparent, includes: When the transition animation starts to play, the transparency of the first desktop screenshot that covers the first preset desktop layout and is completely aligned with the first desktop icon in the first preset desktop layout is changed until the first desktop screenshot becomes transparent and displays the first preset desktop layout; During the process of changing the transparency of the first desktop screenshot, the first preset desktop layout and the first desktop screenshot are controlled to translate to the right at the same translation speed and translation distance until the first desktop icon corresponding to the third display area in the first preset layout is moved to the third display area.

7. The method according to claim 6, characterized in that The method further comprises: In the process of controlling the first preset desktop layout and the first desktop screenshot to translate rightward to the first desktop icon corresponding to the third display area in the first preset layout at the same translation speed and translation distance and moving the first desktop icon moved to the third display area, scaling the first desktop icon moved to the third display area according to the size of the third display area.

8. The method according to any one of claims 1 to 7, characterized in that: After switching the first preset layout to the desktop layout corresponding to the third area, the method further includes: When the flexible screen in the folded state is unfolded with the second display area as the folding area and the unfolding angle reaches a third threshold, registering the remote transition animation; When the unfolding angle of the flexible screen reaches a fourth threshold, freezing the flexible screen, capturing a desktop currently displayed on the flexible screen, and displaying the captured second desktop screenshot, the fourth threshold being greater than the third threshold; According to the second desktop screenshot, a second desktop layer, a second wallpaper layer and a second window layer are obtained, and freezing of the flexible screen is canceled; Draw a second preset desktop layout according to the second desktop layer, the second wallpaper layer and the second window layer, where the second preset desktop layout is a desktop layout corresponding to when the flexible screen is switched from the unfolded state to the folded state; According to the second preset desktop layout, start playing a transition animation, and during the playing of the transition animation, translate and change the transparency of the second desktop screenshot until the second desktop screenshot becomes transparent; After all second desktop icons included in the second preset layout are moved to the display area of ​​the flexible screen, the transition animation is ended, and the second preset layout is switched to the desktop layout corresponding to the flexible screen.

9. The method according to claim 8, characterized in that Drawing a second preset desktop layout according to the second desktop layer, the second wallpaper layer and the second window layer includes: Determining, according to the second desktop layer, the second wallpaper layer, and the second window layer, second desktop icons included in the second preset desktop layout; wherein a portion of the second desktop icons is used to be displayed in the left display area of ​​the flexible screen, and the remaining portion is used to be displayed in the right display area of ​​the flexible screen; Display the second desktop icon in the second preset desktop layout that is identical to the desktop icon in the second desktop screenshot in the window corresponding to the third display area, and move the second desktop icon that is not displayed in the window corresponding to the third display area outside the window to obtain the second preset desktop layout.

10. The method according to claim 8, characterized in that The second desktop screenshot is overlaid on the second preset desktop layout, and the desktop icons in the second desktop screenshot are completely aligned with the second desktop icons in the second preset desktop layout; The step of starting to play the transition animation according to the second preset desktop layout, and during the playing of the transition animation, translating and changing the transparency of the second desktop screenshot until the second desktop screenshot becomes transparent, includes: When the transition animation starts to play, the transparency of the second desktop screenshot that covers the second preset desktop layout and is completely aligned with the second desktop icon in the second preset desktop layout is changed until the second desktop screenshot becomes transparent and displays the second preset desktop layout; During the process of changing the transparency of the second desktop screenshot, the second preset desktop layout and the second desktop screenshot are controlled to translate to the left at the same translation speed and translation distance until all second desktop icons included in the first preset layout are displayed in the display area of ​​the flexible screen.

11. An electronic device, characterized in that: The electronic device comprises: a memory and a processor, wherein the memory and the processor are coupled; the memory stores program instructions, and when the program instructions are executed by the processor, the electronic device executes the desktop display method as described in any one of claims 1 to 10.

12. A computer-readable storage medium, characterized in that: It comprises a computer program, and when the computer program is run on an electronic device, the electronic device executes the desktop display method as claimed in any one of claims 1 to 10.

Images