Desktop display method, device and storage medium

Abstract

The application provides a desktop display method, device and storage medium. When the display screen form of an outer folding screen device changes, the method freezes the display screen and takes a screenshot of the desktop, then displays the desktop screenshot before the desktop is switched, draws a preset desktop layout according to the layer information obtained from the desktop screenshot, realizes a remote transition animation by using the preset desktop layout, switches the desktop layout used by the desktop to the real layout after the transition animation is played, that is, replaces the preset desktop layout with the current desktop layout, so that the animation effect of the movement of the desktop icon during the change of the display screen form can be realized, the switching of the desktop layout can be realized without the user's awareness, the black screen and the loading interface during the switching process are avoided, and the user experience is improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of foldable screen devices, and in particular to a desktop display method, a device and a storage medium. BACKGROUND

[0002] With the gradual development of flexible screen technology, foldable electronic devices, such as foldable mobile phones, have emerged. Taking an outer foldable screen mobile phone as an example, the screen size for a user to view will change when the flexible screen changes from being unfolded to being folded, or from being folded to being unfolded, so the icons displayed on the desktop will also change.

[0003] Therefore, there is an urgent need to provide a desktop display method with an animation effect to improve the user experience. SUMMARY

[0004] The embodiments of the present application provide a desktop display method, a device and a storage medium, aiming to make the desktop icons present a moving animation effect during the process of the flexible screen of an outer foldable screen device, such as an outer foldable screen mobile phone, changing from being unfolded to being folded, or from being folded to being unfolded, thereby improving the user experience.

[0005] In a first aspect, the embodiments of the present application provide a desktop display method applied to an outer foldable screen device. The outer foldable screen device includes a flexible screen, and the flexible screen includes a first display area, a second display area and a third display area. The method includes: in a case where the flexible screen in an unfolded state is folded with the second display area as a folding area, and the folding angle reaches a first threshold value, registering a remote transition animation; in a case where the folding angle of the flexible screen reaches a second threshold value, freezing the flexible screen, intercepting a desktop currently displayed on the flexible screen, and displaying a first desktop screenshot intercepted, the second threshold value being greater than the first threshold value; according to the first desktop screenshot, obtaining a first desktop layer, a first wallpaper layer and a first window layer, and canceling the freezing of the flexible screen; according to the first desktop layer, the first wallpaper layer and the first window layer, drawing a first preset desktop layout, the first preset desktop layout being a desktop layout corresponding to the flexible screen after switching from the unfolded state to the folded state; starting to play the transition animation according to the first preset desktop layout, and in the process of playing the transition animation, performing translation and transparency change on the first desktop screenshot until the first desktop screenshot becomes transparent; after the first desktop icon corresponding to the third display area in the first preset desktop layout moves to the third display area, ending the transition animation, and switching the first preset desktop layout to a desktop layout corresponding to the third area.

[0006] The first desktop screenshot is a whole desktop screenshot corresponding to the flexible screen in the unfolded state.

[0007] The first threshold value can be an angle interval.

[0008] Optionally, the angle interval of the first threshold value is, for example, (0°, 90°], that is, when the folding angle of the display screen reaches the first threshold value, for example, 0° < folding angle ≤ 90°, it can be determined that the folding angle of the display screen reaches the first threshold value.

[0009] Wherein, the first threshold value can also be a specific angle value.

[0010] Optionally, the angle value of the first threshold value is, for example, 45°, that is, when the folding angle of the display screen reaches the first threshold value, for example, folding angle = 45°, it can be determined that the folding angle of the display screen reaches the first threshold value.

[0011] Wherein, the outer folding screen device is, for example, an outer folding screen mobile phone.

[0012] Wherein, the first display area of the flexible screen of the outer folding screen device can be regarded as the secondary screen of the outer folding screen device; the third display area can be regarded as the main screen of the outer folding screen device.

[0013] Therefore, when the display screen form of the outer folding screen device changes, by freezing the display screen and taking a screenshot of the desktop, the desktop screenshot is displayed first before the desktop is switched, and the preset desktop layout is drawn according to the layer information obtained from the desktop screenshot, and the remote transition animation is realized by using the preset desktop layout. After the end of the transition animation playing, that is, after the desktop is switched, the desktop layout used by the desktop is switched to the real layout (the desktop layout pre-stored in the local storage medium of the outer folding screen device, such as the internal storage), that is, the current desktop layout is used to replace the preset desktop layout, so that the animation effect of the desktop icon movement during the display screen form change process can be realized, and the switching of the desktop layout can be realized without the user's awareness, avoiding the black screen and the loading interface during the switching process, and improving the user experience.

[0014] According to the first aspect, in the case that the flexible screen in the unfolded state is folded with the second display area as the folding area, and the folding angle reaches the first threshold value, the remote transition animation is registered, including: in the case that the flexible screen in the unfolded state is folded with the second display area as the folding area, and the folding angle reaches the first threshold value, the current position and size of the desktop element are marked in the remote transition animation function, and the remote transition animation is registered by calling the overridePendingAppTransitionRemote() application conversion remote interface.

[0015] Wherein, the remote transition animation function is registerRemoteAnimation().

[0016] Wherein, the overridePendingAppTransitionRemote() application conversion remote interface is called.

[0017] According to the first aspect, or any one of the implementations of the first aspect, the method further includes: registering the first monitoring in the desktop starting process, the first monitoring being used to monitor whether the folding angle reaches the first threshold in the process of folding the flexible screen in the unfolded state with the second display area as the folding area.

[0018] According to the first aspect, or any one of the implementations of the first aspect, the registering the first monitoring in the desktop starting process includes: calling a registerContentObserver method to register the first monitoring in the desktop starting process.

[0019] The first monitoring is, for example, a monitoring specially used to monitor whether a pre-folding operation is triggered after a user folds the flexible screen of an outer folding screen device.

[0020] Optionally, in some possible implementations, the first monitoring can be described as a pre-folding monitoring.

[0021] According to the first aspect, or any one of the implementations of the first aspect, the drawing of the first preset desktop layout according to the first desktop layer, the first wallpaper layer, and the first window layer includes: determining first desktop icons included in the first preset desktop layout according to the first desktop layer, the first wallpaper layer, and the first window layer; wherein a part of the first desktop icons are displayed in a window corresponding to the third display area, and the remaining part is displayed outside the window; moving the first desktop icons outside the window corresponding to the third display area into the window, and horizontally compressing each first desktop icon; and horizontally stretching the window displaying all the first desktop icons as a whole to obtain the first preset desktop layout.

[0022] For specific implementation details of this part, refer to the description of the part in the embodiments of the first desktop layer, the first wallpaper layer, and the first window layer, which will not be described here. Figures 8A-8D

[0023] ​According to the first aspect, or any one of the implementations of the above first aspect, the first desktop screenshot is overlaid on the first preset desktop layout, and the desktop icons in the first desktop screenshot are completely aligned with the first desktop icons in the first preset desktop layout; according to the first preset desktop layout, the transition animation is started to be played, and in the process of playing the transition animation, the first desktop screenshot is subjected to translation and transparency change until the first desktop screenshot becomes transparent, including: in the case of starting to play the transition animation, the first desktop screenshot overlaid on the first preset desktop layout and completely aligned with the first desktop icons in the first preset desktop layout is subjected to transparency change until the first desktop screenshot becomes transparent to display the first preset desktop layout; in the process of subjecting the first desktop screenshot to transparency change, the first preset desktop layout and the first desktop screenshot are controlled to be translated to the right at the same translation speed and translation distance until the first desktop icons in the first preset desktop layout corresponding to the third display area are moved to the third display area.

[0024] The specific implementation details of this part can be referred to the description of the embodiments of the first aspect and the second aspect. Figure 8D Figure 8E The specific implementation details of this part can be referred to the description of the embodiments of the first aspect and the second aspect.

[0025] According to the first aspect, or any one of the implementations of the above first aspect, the method further includes: in the process of controlling the first preset desktop layout and the first desktop screenshot to be translated to the right at the same translation speed and translation distance until the first desktop icons in the first preset desktop layout corresponding to the third display area are moved to the third display area, scaling the first desktop icons moved to the third display area according to the size of the third display area.

[0026] The specific implementation details of this part can be referred to the description of the embodiments of the first aspect and the second aspect. Figure 8D Figure 8E The specific implementation details of this part can be referred to the description of the embodiments of the first aspect and the second aspect.

[0027] ​​According to the first aspect, or any one of the implementations of the first aspect, after the first preset desktop layout is switched to the desktop layout corresponding to the third area, the method further includes: in a case where the flexible screen in the folded state is unfolded with the second display area as the folding area and the unfolding angle reaches a third threshold, registering a remote transition animation; in a case where the unfolding angle of the flexible screen reaches a fourth threshold, freezing the flexible screen, intercepting the desktop currently displayed by the flexible screen, and displaying the intercepted second desktop screenshot, the fourth threshold being greater than the third threshold; according to the second desktop screenshot, obtaining a second desktop layer, a second wallpaper layer, and a second window layer, and canceling the freezing of the flexible screen; according to the second desktop layer, the second wallpaper layer, and the second window layer, drawing a second preset desktop layout, the second preset desktop layout being a desktop layout corresponding to the flexible screen after the flexible screen is switched from the unfolded state to the folded state; according to the second preset desktop layout, starting to play the transition animation, and in the process of playing the transition animation, performing translation and transparency change on the second desktop screenshot until the second desktop screenshot becomes transparent; after all the second desktop icons included in the second preset layout are moved to the display area of the flexible screen, ending the transition animation, and switching the second preset layout to the desktop layout corresponding to the flexible screen.

[0028] Thus, the animation effect of the desktop icons can also be achieved in the process of switching the flexible screen of the outer folding screen device from the folded state to the unfolded state.

[0029] According to the first aspect, or any one of the implementations of the first aspect, according to the second desktop layer, the second wallpaper layer, and the second window layer, drawing the second preset desktop layout includes: according to the second desktop layer, the second wallpaper layer, and the second window layer, determining second desktop icons included in the second preset desktop layout; wherein a part of the second desktop icons are used to be displayed in the left display area of the flexible screen, and the remaining part are used to be displayed in the right display area of the flexible screen; displaying the second desktop icons in the second preset desktop layout that are the same as the desktop icons in the second desktop screenshot in the window corresponding to the third display area, moving the second desktop icons that are not displayed in the window corresponding to the third display area out of the window, to obtain the second preset desktop layout.

[0030] For specific implementation details of this part, refer to the description of the embodiments for Figure 9A and Figure 9C , which will not be described here in detail.

[0031] According to a first aspect, or any possible implementation of the first aspect, the second desktop screenshot is overlaid on the second preset desktop layout, and the desktop icons in the second desktop screenshot are completely aligned with the second desktop icons in the second preset desktop layout; according to the second preset desktop layout, the transition animation is started to be played, and during playing of the transition animation, the second desktop screenshot is subjected to translation and transparency change until the second desktop screenshot becomes transparent, including: in a case where the transition animation is started to be played, the second desktop screenshot overlaid on the second preset desktop layout and completely aligned with the second desktop icons in the second preset desktop layout is subjected to transparency change until the second desktop screenshot becomes transparent to display the second preset desktop layout; during the transparency change of the second desktop screenshot, the second preset desktop layout and the second desktop screenshot are controlled to be translated to the left at the same translation speed and translation distance until all the second desktop icons included in the first preset desktop layout are displayed to the display area of the flexible screen.

[0032] For specific implementation details of this part, refer to the description of the embodiments for Figure 9C and Figure 9D , which will not be described here in detail.

[0033] In a second aspect, the embodiments of the present application provide an electronic device. The electronic device includes a memory and a processor, the memory and the processor are coupled; the memory stores program instructions, the program instructions are executed by the processor, so that the electronic device executes the instructions of the method in the first aspect or any possible implementation manner of the first aspect.

[0034] In a third aspect, the embodiments of the present application provide a computer readable medium for storing a computer program, the computer program includes instructions for executing the method in the first aspect or any possible implementation manner of the first aspect.

[0035] In a fourth aspect, the embodiments of the present application provide a computer program, the computer program includes instructions for executing the method in the first aspect or any possible implementation manner of the first aspect.

[0036] In a fifth aspect, the embodiments of the present application provide a chip, the chip includes a processing circuit, a receiving pin and a sending pin. The receiving pin, the processing circuit and the sending pin communicate with each other through an internal connection path. The processing circuit executes the method in the first aspect or any possible implementation manner of the first aspect to control the receiving pin to receive a signal and control the sending pin to send a signal. BRIEF DESCRIPTION OF DRAWINGS

[0037] Figure 1 A schematic diagram of the appearance of the outer folding screen mobile phone is shown for illustration;

[0038] Figures 2A-2CThe schematic diagram of the change of the desktop display content in the use scenario of the outer folding screen mobile phone changing from the unfolded state to the folded state is shown as an example.

[0039] Figures 3A-3C The schematic diagram of the change of the desktop display content in the use scenario of the outer folding screen mobile phone changing from the folded state to the unfolded state is shown as an example.

[0040] Figure 4 The schematic diagram of the hardware structure of the outer folding screen mobile phone is shown as an example.

[0041] Figure 5 The schematic diagram of the software structure of the outer folding screen mobile phone is shown as an example.

[0042] Figure 6 The schematic diagram of the relationship among the window, the window manager and the window management service is shown as an example.

[0043] Figure 7 The schematic diagram of the interaction logic between the window management service and the desktop launcher in the process of the outer folding screen mobile phone changing from the unfolded state to the folded state based on the desktop display method provided by the embodiments of the present application is shown as an example.

[0044] Figures 8A-8E The schematic diagram of the user interface involved before the transition animation starts and in the process of playing the transition animation in the process of the outer folding screen mobile phone changing from the unfolded state to the folded state is shown as an example.

[0045] Figures 9A-9D The schematic diagram of the user interface involved before the transition animation starts and in the process of playing the transition animation in the process of the outer folding screen mobile phone changing from the unfolded state to the folded state is shown as an example. DETAILED DESCRIPTION

[0046] The technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are some of the embodiments of the present application, but not all the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the scope of the present application.

[0047] The term “and / or” in the present document is only used to describe the association relationship of the associated objects, and represents that there can be three relationships, for example, A and / or B can represent that A exists alone, A and B exist simultaneously, and B exists alone.

[0048] The terms "first" and "second" and the like in the description and claims of the present application are used for distinguishing between similar elements and not necessarily for describing a specific sequential or chronological order. For example, the first target object and the second target object are used for distinguishing between similar objects but not for describing specific sequential or chronological order, unless it is given a specific meaning otherwise.

[0049] In the present application embodiments, the words "exemplary" and "for example" are used to mean serving as an example, instance, or illustration. Any implementation or design scheme described as "exemplary" or "for example" in the present application embodiments should not be construed as being preferred or advantageous over other implementations or design schemes. Rather, the use of the words "exemplary" or "for example" is intended to present concepts in a concrete manner.

[0050] In the description of the present application embodiments, the meaning of "a plurality of" is two or more, unless otherwise specified. For example, a plurality of processing units means two or more processing units; a plurality of systems means two or more systems.

[0051] In the description of the present application embodiments, the outward folding screen device, the outward folding screen mobile phone, and the outward folding screen tablet all refer to electronic devices with one display screen, and the display screen is folded outwardly. Among them, folding outwardly means folding the display screen to the side of the back shell.

[0052] In order to better understand the technical solutions provided by the present application embodiments, before the technical solutions of the present application embodiments are described, first, the style of the electronic device to which the present application embodiments are applicable and the morphologies that can be presented are described in conjunction with the accompanying drawings. For ease of description, the following embodiments are described by taking an outward folding screen mobile phone as an example.

[0053] Referring to Figure 1 , the morphologies that the outward folding screen mobile phone 100 can present can include Figure 1 the morphology shown in (1) (hereinafter referred to as: unfolded state), Figure 1 the morphology shown in (2) (hereinafter referred to as: half-folded state), and Figure 1 the morphology shown in (3) (hereinafter referred to as: folded state).

[0054] Continuing to refer to Figure 1 , for example, the outward folding screen mobile phone 100 can include a whole complete display screen 194 (specifically, a flexible screen). Among them, the display screen 194 can include a first display area 194-1 (hereinafter referred to as: sub-screen), a second display area 194-2, and a third display area 194-3 (hereinafter referred to as: main screen).

[0055] Optionally, the second display area 194-2 is a foldable area, that is, the outer folding screen mobile phone 100 is folded or unfolded with the second display area 194-2 as the folding axis during the process of changing from the unfolded state to the half-folded state, or the folded state; changing from the folded state to the half-folded state, or the unfolded state; changing from the half-folded state to the unfolded state, or the folded state.

[0056] Continuing to refer to Figure 1 , the outer folding screen mobile phone 100 also includes a housing. The housing can include a housing area 196 for disposing camera, flash, audio module (such as speaker, receiver, microphone, etc.), and other devices.

[0057] Optionally, the width of the sub-screen + housing area 196 is equal to the width of the main screen.

[0058] It can be understood that when the display screen 194 of the outer folding screen mobile phone 100 changes from the unfolded state to the half-folded state, the operation of switching the display area will be triggered, such as loading the desktop that needs to be displayed by the main screen, controlling the sub-screen to enter black screen or displaying the interface of other applications, etc. In the case that the display screen 194 changes from the half-folded state to the folded state, the switching of the display area is completed, the main screen displays the desktop, and the sub-screen enters the black screen or displays the interface of other applications, etc. Conversely, when the display screen 194 of the outer folding screen mobile phone 100 changes from the folded state to the half-folded state, the operation of switching the display area will also be triggered, that is, the entire display area of the display screen 194 is used to display the icons of the desktop. In the case that the display screen 194 changes from the half-folded state to the unfolded state, the desktop icons originally displayed by the main screen are switched to the desktop icons displayed by the display screen 194. Based on this, the outer folding screen mobile phone 100 can be divided into two large use scenarios according to the form presented, that is, the unfolded state to the folded state and the folded state to the unfolded state.

[0059] In addition, it should be noted that the desktop layout can be a single-row layout or a double-row layout.

[0060] The single-row layout means that the entire display area of the display screen 194 displays the content of one interface, for example Figure 2C (1) and Figure 3C (2) in the foregoing, the entire display area of the display screen 194 displays the content of interface 3. The double-row layout means that the entire display area of the display screen 194 displays the content of two interfaces, for example Figure 2A (1), Figure 2B (1), Figure 3A (2), Figure 3BIn the middle (2), the display area of the entire display screen 194 is divided into two interfaces on the left and right, for example, the left display area displays the content of interface 1, and the right display area displays the content of interface 2. That is, in the single-row layout, the user makes a page turning operation, and the desktop switches 1 (page) interface content; in the double-row layout, the user makes a page turning operation, and the desktop switches 2 (page) interface content.

[0061] For example, in the single-row layout, the desktop has a total of 3 different interfaces, such as the first interface, the second interface, and the third interface. In the case that the display screen 194 currently displays the first interface, the user makes a page turning operation, and the desktop displays the content of the second interface after switching.

[0062] For another example, in the double-row layout, the desktop has a total of 4 different interfaces, such as the first interface, the second interface, the third interface, and the fourth interface. In the case that the left display area of the display screen 194 currently displays the first interface, and the right display area displays the second interface, the user makes a page turning operation, and the desktop displays the third interface in the left display area and the fourth interface in the right display area after switching.

[0063] It should be understood that the above description is only an example for better understanding the technical solution of the embodiment and is not the only limitation of the embodiment.

[0064] Optionally, the use scenario from the unfolded state to the folded state (hereinafter referred to as: use scenario 1) can be divided into three small use scenarios (hereinafter referred to as: use scenario 1.1, use scenario 1.2, and use scenario 1.3).

[0065] Among them, use scenario 1.1 is a use scenario in which, in the double-row layout, after the display screen 194 of the outer folding screen mobile phone 100 changes from the unfolded state to the folded state, the main screen displays the interface displayed in the left display area of the display screen 194 in the unfolded state. For example Figure 2A As shown in the middle (1), in the unfolded state of the display screen 194 of the outer folding screen mobile phone 100, the left display area of the display screen 194 displays the content of interface 1, and the right display area of the display screen 194 displays the content of interface 2. When the user performs a folding operation on the outer folding screen mobile phone 100, the outer folding screen mobile phone 100 changes from Figure 2A the unfolded state shown in the middle (1) to Figure 2A the folded state shown in the middle (2), the main screen displays interface 1' (specifically, the content of interface 1 adapted to the size of the main screen) as the desktop for the user to operate.

[0066] In the use scenario 1.2, the display screen 194 of the outer folding screen mobile phone 100 displays an interface on the right side of the display screen 194 in the unfolded state. For example Figure 2B As shown in (1) of the unfolded state, the left side of the display screen 194 of the outer folding screen mobile phone 100 displays the content of interface 1, and the right side of the display screen 194 displays the content of interface 2. When the user performs a folding operation on the outer folding screen mobile phone 100, the outer folding screen mobile phone 100 is folded from the unfolded state shown in (1) to the folding state shown in (2). Figure 2B As shown in (2) of the folding state, the main screen displays interface 2' (specifically, the content of interface 2 adapted to the size of the main screen) as a desktop for the user to operate. Figure 2B

[0067] In the use scenario 1.3, the display screen 194 of the outer folding screen mobile phone 100 displays an interface on the entire display screen 194 in the unfolded state. For example Figure 2C As shown in (1) of the unfolded state, the entire display screen 194 of the outer folding screen mobile phone 100 displays the content of interface 3. When the user performs a folding operation on the outer folding screen mobile phone 100, the outer folding screen mobile phone 100 is folded from the unfolded state shown in (1) to the folding state shown in (2). Figure 2C As shown in (2) of the folding state, the main screen displays interface 3' (specifically, the content of interface 3 adapted to the size of the main screen) as a desktop for the user to operate. Figure 2C

[0068] It should be understood that Figure 2A , Figure 2B and Figure 2C The desktop style shown in the above (1) and (2) is only an example for better understanding the technical solutions of the present embodiment, and is not the only limitation of the present embodiment.

[0069] Optionally, the use scenario from the folding state to the unfolded state (hereinafter referred to as use scenario 2) can be divided into three small use scenarios (hereinafter referred to as use scenario 2.1, use scenario 2.2 and use scenario 2.3).

[0070] ​​Among them, usage scenario 2.1 is the reverse operation scenario of usage scenario 1.1. Specifically, the desktop of the external folding screen mobile phone 100 adopts a double-row layout. When the display screen 194 is in the folded state, the desktop displays the interface displayed in the left display area of ​​the display screen 194 when it is in the unfolded state. When the user performs an unfolding operation on the external folding screen mobile phone 100, after the display screen 194 of the external folding screen mobile phone 100 changes from the folded state to the unfolded state, the display area on the left of the display screen 194 will display the interface content displayed on the main screen in the folded state, and the display area on the right will display the interface after the interface displayed on the main screen. For example Figure 3A As shown in (1), when the display screen of the external folding screen mobile phone 100 is in the folded state, the main screen displays the content of interface 1'. When the user performs an unfolding operation on the external folding screen mobile phone 100, the external folding screen mobile phone 100 is unfolded. Figure 3A The folded state shown in (1) is unfolded to Figure 3A After the expanded state shown in (2), the entire display screen 194 serves as a desktop for user operation. The display area on the left side of the display screen 194 will display interface 1 (specifically, the content of interface 1' after adapting to the size of the left display area), and the display area on the right side of the display screen 194 will display interface 2, that is, an interface after interface 1.

[0071] Among them, usage scenario 1.2 is the reverse operation scenario of usage scenario 1.2. Specifically, the desktop of the external folding screen mobile phone 100 adopts a double-row layout. When the display screen 194 is in the folded state, the desktop displays the interface displayed in the display area on the right side of the display screen 194 when it is in the unfolded state. When the user performs an unfolding operation on the external folding screen mobile phone 100, after the display screen 194 of the external folding screen mobile phone 100 changes from the folded state to the unfolded state, the display area on the right side of the display screen 194 will display the interface content displayed on the main screen in the folded state, and the display area on the left will display the interface before the interface displayed on the main screen. For example Figure 3B As shown in (1), when the display screen of the external folding screen mobile phone 100 is in the folded state, the main screen displays the content of interface 2'. When the user performs an unfolding operation on the external folding screen mobile phone 100, the external folding screen mobile phone 100 is unfolded. Figure 3B The folded state shown in (1) is unfolded to Figure 3B After the expanded state shown in (2), the entire display screen 194 serves as a desktop for user operation. The display area on the right side of the display screen 194 will display interface 2 (specifically, the content of interface 2' after adapting to the size of the right display area), and the display area on the left side of the display screen 194 will display interface 1, which is the interface before interface 2.

[0072] Among them, usage scenario 1.3 is the reverse operation scenario of usage scenario 1.3. Specifically, the desktop of the external folding screen mobile phone 100 adopts a single-row layout. When the display screen 194 is in the folded state, the desktop displays the interface displayed on the entire display screen 194 when it is in the unfolded state. For exampleFigure 3C As shown in FIG. 1, in the folded state, the display screen 194 of the outer folding screen mobile phone 100, the main screen as the desktop for user operation, displays the content of interface 3'. When the user makes an unfolding operation on the outer folding screen mobile phone 100, the outer folding screen mobile phone 100 is unfolded from the folded state shown in FIG. 1 to the unfolded state shown in FIG. 2. Figure 3C As shown in FIG. 2, in the unfolded state, the display screen 194 of the outer folding screen mobile phone 100, the main screen as the desktop for user operation, displays the content of interface 3. Figure 3C As shown in FIG. 2, in the unfolded state, the display screen 194 of the outer folding screen mobile phone 100, the main screen as the desktop for user operation, displays the content of interface 3.

[0073] It should be noted that, for the use scenarios of double-row layout, such as use scenario 2.1 and use scenario 2.2, in the case that the display screen 194 of the outer folding screen mobile phone 100 in the folded state, the main screen displays an odd page (the corresponding number of the interface is odd), after the outer folding screen mobile phone 100 is switched to the unfolded state, in the order from left to right, the display screen 194 displays the interface content of the odd page displayed by the main screen, and the interface content of the next even page (the corresponding number of the interface is even) after the odd page. Conversely, in the case that the main screen displays an even page, after the outer folding screen mobile phone 100 is switched to the unfolded state, in the order from left to right, the interface content of the previous odd page before the even page, and the interface content of the even page.

[0074] It should be understood that, Figure 3A , Figure 3B and Figure 3C The desktop styles shown in the above are only examples for better understanding the technical solutions of the embodiments, and are not the only limitation of the embodiments.

[0075] In addition, it should be noted that the above six small use scenarios can be switched to each other.

[0076] Optionally, the single-row layout or the double-row layout can be switched by the desktop layout provided by the desktop setting entry.

[0077] Optionally, in the case of changing from the unfolded state to the folded state, the interface displayed by the desktop can be switched according to the switching rule of use scenario 1.1 by default.

[0078] Optionally, when the outer folding mobile phone 100 is in the folded state, the main screen displays the interface 1' as shown in FIG. 2(2), in response to the page turning operation made by the user on the main screen, the main screen can display the interface 2' as shown in FIG. 2(2). Optionally, in the case that the desktop of the main screen displays the interface 2', if the user does not make an unfolding operation on the outer folding screen mobile phone 100, the display screen 194 of the outer folding screen mobile phone 100 displays the interface 3' as shown in FIG. 1(1) or the interface 3 as shown in FIG. 2(1). Figure 2A Figure 2B Figure 2A Figure 2B ​​​After the folding state of the outer folding screen mobile phone 100 is unfolded to the unfolded state, if no other operation is performed on the desktop in the mode shown in (1), the outer folding screen mobile phone 100 is folded again into the folding state, in which case the main screen of the outer folding screen mobile phone 100 displays interface 2' instead of interface 1'.

[0079] Optionally, Figure 1 The hardware structure of the outer folding screen mobile phone 100 in the outer shape shown can be as shown in Figure 4 .

[0080] Referring to Figure 4 , the outer folding screen mobile phone 100 can include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a sensor module 180, a key 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.

[0081] Among them, the antenna 1 and the antenna 2 are used to emit and receive electromagnetic wave signals.

[0082] Among them, the processor 110 can include one or more processing units, for example: the processor 110 can include an application processor (AP), a modem, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc., which will not be listed one by one here, and the present application does not make any limitation.

[0083] Optionally, in specific implementations, different processing units can be independent devices, or can be integrated in one or more processors.

[0084] Optionally, in some implementations, the controller can be the nerve center and command center of the outer folding screen mobile phone 100. In actual application, the controller can generate operation control signals according to instruction operation codes and timing signals to complete the control of instruction fetching and instruction execution.

[0085] Optionally, the processor 110 can also be provided with a memory for storing instructions and data. In some implementations, the memory in the processor 110 is a cache memory. The memory can hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instructions or data again, it can be directly called from the memory. This avoids repeated access and reduces the waiting time of the processor 110, thereby improving the efficiency of the system.

[0086] Optionally, in some implementations, the processor 110 can include one or more interfaces. The interfaces can include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0087] Continuing to refer to Figure 4 The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the outer folding screen mobile phone 100. The external memory card communicates with the processor 110 through the external memory interface 120 to realize data storage functions. The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the outer folding screen mobile phone 100 by running the instructions stored in the internal memory 121.

[0088] Specifically, in the technical solutions provided in the embodiments of the present application, different desktop layouts, desktop icons corresponding to different desktop layouts, interfaces, etc. can be pre-stored in the internal memory 121.

[0089] Continuing to refer to Figure 4The charging management module 140 is configured to receive charging input from a charger. The charging management module 140 can supply power to the terminal device through the power management module 141 while charging the battery 142. The power management module 141 is configured to connect the battery 142 and the charging management module 140 to the processor 110. In some embodiments, the power management module 141 and the charging management module 140 can be integrated into one device.

[0090] Referring back to FIG. 1, the outer folding screen mobile phone 100 can be configured to support wireless communication functions. The wireless communication functions of the outer folding screen mobile phone 100 can be implemented through the antennas 1 and 2, the mobile communication module 150, the wireless communication module 160, the modem processor, the baseband processor, and the like. Figure 4

[0091] Referring back to FIG. 1, the outer folding screen mobile phone 100 can be configured to support wireless communication functions. The wireless communication functions of the outer folding screen mobile phone 100 can be implemented through the antennas 1 and 2, the mobile communication module 150, the wireless communication module 160, the modem processor, the baseband processor, and the like. Figure 4 The mobile communication module 150 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, and the like, which can be applied to the outer folding screen mobile phone 100. The wireless communication module 160 can provide solutions for wireless communication, including wireless local area networks (WLAN) (e.g., wireless fidelity (Wi-Fi) network), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) technology, and the like, which can be applied to the outer folding screen mobile phone 100.

[0092] Referring back to FIG. 1, the outer folding screen mobile phone 100 can be configured to support wireless communication functions. The wireless communication functions of the outer folding screen mobile phone 100 can be implemented through the antennas 1 and 2, the mobile communication module 150, the wireless communication module 160, the modem processor, the baseband processor, and the like. Figure 4

[0093] In addition, regarding the sensor module 180 in the outer folding screen mobile phone 100, in some embodiments, the sensor module 180 can include a pressure sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, and the like, which are not listed one by one herein, and the present disclosure is not limited in this regard.

[0094] Referring back to FIG. 1, the outer folding screen mobile phone 100 can be configured to support wireless communication functions. The wireless communication functions of the outer folding screen mobile phone 100 can be implemented through the antennas 1 and 2, the mobile communication module 150, the wireless communication module 160, the modem processor, the baseband processor, and the like. Figure 4 ​​The keys 190 include a power key, a volume key, and the like. The keys 190 can be mechanical keys. Alternatively, the keys 190 can be touch keys. The motor 191 can generate a vibration prompt. The indicator 192 can be an indicator light, which can be used to indicate a charging state, a power change, and can also be used to indicate a message, a missed call, a notification, and the like.

[0095] Referring back to Figure 4 The camera 193 is configured to capture still images or videos. In some implementations, the outer folding screen mobile phone 100 can include one or N cameras 193, where N is a positive integer greater than 1.

[0096] Referring back to Figure 4 The display screen 194 is configured to display images, videos, and the like. The display screen 194 includes a display panel. In some implementations, the outer folding screen mobile phone 100 can include one or N display screens 194, where N is a positive integer greater than 1. The outer folding screen mobile phone 100 can implement a display function through a GPU, the display screen 194, and an application processor, and the like. The GPU is a microprocessor for image processing, which is connected to the display screen 194 and the application processor. The GPU is configured to perform mathematical and geometric calculations for graphics rendering. The processor 110 can include one or more GPUs, which execute program instructions to generate or change display information.

[0097] In particular to the technical solutions provided in the embodiments of the present application, the display screen 194 is a flexible screen.

[0098] Optionally, the flexible screen is a screen that can be folded outward. The folding modes thereof are, for example Figure 1 The unfolded state, the half-folded state, and the folded state are shown.

[0099] Referring back to Figure 4 For example, the SIM card interface 195 is configured to connect a SIM card or a USIM card. The SIM card can be inserted into or pulled out of the SIM card interface 195 to realize contact and separation with the outer folding screen mobile phone 100. The outer folding screen mobile phone 100 can support one or N (N is an integer greater than 1) SIM card interfaces 195. That is, multiple SIM cards or USIM cards can be inserted into the terminal.

[0100] The hardware structure of the outer folding screen mobile phone 100 has been introduced. It should be understood that Figure 4 The outer folding screen mobile phone 100 shown in the figure is only an example. In specific implementations, the outer folding screen mobile phone 100 can have more or fewer components than those shown in the figure, can combine two or more components, or can have a different component configuration. Figure 4 The various components shown in the figure can be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application specific integrated circuits.

[0101] For the above six specific use scenarios, the embodiment of the application provides a desktop display method, which aims to change the form of an outer folding screen mobile phone (or other outer folding screen device), such as from an unfolded state to a folded state, or from a folded state to an unfolded state, and the desktop icon can present an animation effect of movement, rather than a sudden change of the desktop icon (there may be a short black screen or a waiting new interface to aggravate the situation, affecting the user experience), thereby improving the user experience.

[0102] Specifically, in the desktop display method provided by the embodiment of the application, the animation effect of the movement of the desktop icon is realized through the interaction of the application program layer and the application program framework layer in the system of the outer folding screen mobile phone 100, and specifically the desktop launcher in the application program layer and the window management service in the application program framework layer.

[0103] In order to better understand the desktop display method provided by the embodiment of the application, the software structure of the outer folding screen mobile phone 100 is described below. Before describing the software structure of the outer folding screen mobile phone 100, first, the architecture that can be used by the software system of the outer folding screen mobile phone 100 is described.

[0104] Specifically, in actual application, the software system of the outer folding screen mobile phone 100 can adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture.

[0105] In addition, it can be understood that the software system currently used by mainstream terminal devices includes but is not limited to Windows system, Android system and iOS system. In order to facilitate the description, the embodiment of the application takes the Android system with a layered architecture as an example to exemplarily describe the software structure of the outer folding screen mobile phone 100.

[0106] In addition, the desktop display method provided by the embodiment of the application is also applicable to other systems in the specific implementation.

[0107] Referring to Figure 5 , the software structure block diagram of the outer folding screen mobile phone 100 of the embodiment of the application.

[0108] As Figure 5As shown, the layered architecture of the external foldable screen mobile phone 100 divides the software into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces. In some implementations, the Android system is divided into five layers: from top to bottom, the application (Application, APP) layer, the application framework (Application Framework, FWK) layer, the Android runtime (Android runtime) and system library, the hardware abstraction layer (HAL), and the kernel layer.

[0109] The application layer can include a series of application packages.

[0110] like Figure 5 As shown, the desktop launcher (Launcher), settings, music, Bluetooth, gallery and other applications are not listed here one by one, and this application does not limit them.

[0111] Launcher is the desktop launcher in the Android system. The desktop user interface (UI) of the Android system is collectively referred to as Launcher. Launcher is one of the main program components in the Android system. Without Launcher, the Android desktop cannot be started.

[0112] Specifically in the technical solution provided in the embodiment of the present application, the desktop display requires the use of Launcher to achieve switching of the displayed content on the desktop and animation effects.

[0113] The application framework layer provides an application programming interface (API) and a programming framework (these programming interfaces and programming frameworks can be described as functions) for the applications of the application layer. In some embodiments, the application framework layer includes some predefined functions.

[0114] like Figure 5 As shown, the application framework layer may include a window manager, a window management service, a content provider, a view system, a resource manager, and the like.

[0115] The window manager can obtain the display size, determine whether there is a status bar, lock the screen, take screenshots, etc.

[0116] The window management service is used to manage window programs, determine the content to be displayed on the screen that is in the bright screen or the screen that serves as the desktop, and enable the screen that is in the bright screen or the screen that serves as the desktop to display.

[0117] The content provider is used to store and obtain data, and make the data accessible to the application program. The data can include video, image, audio, dialed and received phone, browsing history and bookmark, phone book, etc., which are not listed one by one, and the present application does not limit this.

[0118] The view system includes visual controls, such as controls for displaying text, controls for displaying pictures, etc. The view system can be used to build an application program. The display interface can be composed of one or more views. For example, a display interface including a short message notification icon can include a view for displaying text and a view for displaying pictures.

[0119] The resource manager provides various resources for the application program, such as localized strings, icons, pictures, layout files, video files, etc., which are not listed one by one, and the present application does not limit this.

[0120] In order to better understand the technical solutions provided by the embodiments of the present application, the concepts and relationships of Window, WindowManager and WindowManagerService will be described first.

[0121] Specifically, Window in Android does not refer to a specific mobile phone window, but an abstract concept, which is essentially also a view (View), as shown in Figure 6 .

[0122] Referring to Figure 6 , similar to the relationship between ActivityManager and ActivityManagerService, the implementation of the methods in the WindowManager is also realized by remotely calling the WindowManagerService.

[0123] Specifically, in the technical solutions provided by the embodiments of the present application, when it is monitored that the display screen 194 is folded to a certain angle, i.e. a folding operation is triggered, or unfolded to a certain angle, i.e. an unfolding operation is triggered, the operations of the Window Manager, such as freezing the screen, intercepting the screen, transferring the desktop layer, wallpaper layer, window layer, etc. to the Launcher, and canceling the freezing, are all realized by remotely calling the WindowManagerService. That is, in the technical solutions provided by the embodiments of the present application, the Window Manager Service in the FWK layer is the one that really participates in the processing and interacts with the Launcher in the APPC layer.

[0124] For the detailed interaction logic between Launcher and WindowMangerService, please refer to Figure 7 The description of the embodiments shown in FIG. 1 will not be repeated here.

[0125] The system library and the runtime layer include system library and Android runtime. The Android runtime includes core library and virtual machine. The Android runtime is responsible for the scheduling and management of the Android system.

[0126] The core library contains two parts: one part is the function function that the java language needs to call, and the other part is the core library of Android.

[0127] The application layer and the application framework layer run in the virtual machine. The virtual machine executes the java files of the application layer and the application framework layer into binary files. The virtual machine is used to perform the management of object life cycle, stack management, thread management, security and exception management, and garbage collection.

[0128] The system library can include multiple functional modules. For example: surface manager, media library, three-dimensional (3D) graphics processing library (such as OpenGL ES), two-dimensional (2D) graphics engine (such as SGL), form manager, etc.

[0129] The surface manager is used to manage the display subsystem and provides 2D and 3D layer fusion for multiple applications.

[0130] The media library supports playing and recording of multiple commonly used audio, video formats, and static image files. The media library can support multiple audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0131] The form manager is used to detect the change of the form of the outer folding screen mobile phone, such as whether it is currently in an unfolded state, a half-folded state, or a folded state.

[0132] The three-dimensional graphics processing library is used to realize three-dimensional graphics drawing, image rendering, synthesis, and layer processing, etc.

[0133] Understandably, the 2D graphics engine mentioned above is a 2D drawing engine.

[0134] The HAL layer is an interface layer between the operating system kernel and the hardware circuit. The HAL layer includes but is not limited to: camera hardware abstraction layer, display driver hardware abstraction layer, power hardware abstraction layer.

[0135] The kernel layer is a layer between hardware and software. The kernel layer at least contains display drivers, camera drivers, power management drivers, and sensor drivers. The display drivers can include secondary screen display drivers, main screen display drivers, and the like. The sensor drivers can include drivers corresponding to gyro sensors, acceleration sensors, Hall sensors, and the like, and are used to detect the angle change between the main screen and the secondary screen of the outer folding screen mobile phone. The camera drivers are used to drive the corresponding cameras to work. The power management drivers are used to drive the power management module to supply power to the display screen.

[0136] The software structure of the outer folding screen mobile phone 100 is described here. It can be understood that, Figure 5 The layers in the illustrated software structure and the components included in each layer do not constitute a specific limitation on the outer folding screen mobile phone 100. In other embodiments of the present application, the outer folding screen mobile phone 100 can include more or fewer layers than illustrated, and each layer can include more or fewer components, and the present application does not make any limitation.

[0137] In order to better understand the desktop display method provided by the embodiments of the present application, the following embodiments still take the outer folding screen mobile phone 100 (such as Figure 1 the outer shape shown, Figure 4 the hardware structure shown, Figure 5 the software structure shown) as an example, and the specific interaction between Launcher and WindowManagerService during the process of the outer folding screen mobile phone 100 changing from the unfolded state to the folded state is described. Figure 7

[0138] S101, the desktop launcher registers the pre-folding listening to the window management service in the desktop startup process.

[0139] Specifically, in the Android system, the desktop launcher will call the onCreate() function to create the window corresponding to the desktop during the desktop startup process. In order to realize the listening to the display screen form of the outer folding screen mobile phone, the desktop launcher will register the pre-folding listening in the onCreate() function.

[0140] Optionally, the desktop launcher will call the registerContentObserver method in the onCreate() function, thereby realizing the registration of the pre-folding listening.

[0141] ​It can be understood that registerContentObserver is a method in the Android system, and the main function thereof is to register a ContentObserver object, so as to receive a notification in time and make a corresponding processing when the content in a Uniform Resource Identifier (URI) being monitored changes. Therefore, in the technical solution provided in the embodiments of the present application, the desktop launcher can monitor the form of the display screen in real time after the desktop is started, by calling the registerContentObserver method in the onCreate() function during the desktop starting process.

[0142] In S102, the window management service determines that the folding angle of the display screen reaches a first threshold value.

[0143] Specifically, in the process that the user performs a folding operation on the display screen of the outer folding screen mobile phone, that is, the process of folding the display screen, according to the data collected by the sensors in the main screen and the auxiliary screen for detecting the included angle between the two, the included angle between the main screen and the auxiliary screen can be determined, or the folding angle of the current display screen can be determined. In this way, by judging whether the determined included angle or folding angle reaches the first threshold value, it can be determined whether the pre-folding is triggered. That is, it is determined whether the user is folding the display screen from the folded state to the folded state.

[0144] Optionally, the first threshold value can be an angle interval, for example, (0°, 90°].

[0145] For this case, when the window management service determines that the folding angle of the display screen reaches the first threshold value, for example, 0° < folding angle ≤ 90°, it can be determined that the folding angle of the display screen reaches the first threshold value.

[0146] Optionally, the first threshold value can be a specific angle value, for example, any angle value in (0°, 90°], such as 45°.

[0147] For this case, when the window management service determines that the folding angle of the display screen reaches the first threshold value, for example, folding angle = 45°, it can be determined that the folding angle of the display screen reaches the first threshold value.

[0148] In addition, it should be noted that in the case where the angle used to determine whether the pre-folding is triggered is the included angle between the main screen and the auxiliary screen, that is, not the folding angle this time, when the first threshold value is an angle region, for example, it can be [90°, 180°).

[0149] For this case, when the window management service determines that the included angle of the display screen reaches the first threshold value, for example, 90° ≤ included angle < 180°, it can be determined that the included angle of the display screen reaches the first threshold value.

[0150] Optionally, the first threshold value can also be a specific angle value, such as any angle value in [90°, 180°), such as 145°.

[0151] For this case, when the window management service determines that the folding angle of the display reaches the first threshold value, for example, the folding angle = 145°, it can be determined that the folding angle of the display reaches the first threshold value.

[0152] It should be understood that the above description is only an example for better understanding the technical solutions of the embodiments and is not the only limitation of the embodiments.

[0153] Continuing to refer to Figure 7 , for example, in the case where the window management server determines that the folding angle or the folding angle of the display reaches the first threshold value, the registered pre-folding listener will listen to the pre-folding operation during the desktop startup process.

[0154] Specifically, the desktop launcher inherits the onChange method in the ContentObserver class through the registered pre-folding listener to get the current form of the display.

[0155] S103, the desktop launcher registers a remote transition animation after listening to the pre-folding operation through the pre-folding listener.

[0156] Optionally, when registering the remote transition animation, the position and size of the desktop elements (such as desktop icons, signal bars, etc.) need to be marked first, and then the overridePendingAppTransitionRemote() application conversion remote interface is called.

[0157] Optionally, the above two steps can be implemented in the registerRemoteAnimation() function. Among them, marking the current position and size of the desktop elements is the first step executed in the function, and then the overridePendingAppTransitionRemote() remote transition animation (REMOTE ANIM) is registered.

[0158] It can be understood that marking the current position and size of the desktop elements is to enable the positions and sizes of the desktop elements displayed in the preset desktop layout to be completely aligned with the positions and sizes of the desktop elements in the current desktop (subsequently obtained desktop screenshot) when the preset desktop layout is drawn, so as to ensure that the desktop elements do not change abruptly after the remote transition animation starts playing, and to ensure user experience.

[0159] S104, during the process that the user continues to fold the display screen, the window management service continues to determine whether the folding angle (or the included angle) of the display screen reaches a second threshold value, and performs step S105 when it is determined that the second threshold value is reached.

[0160] Optionally, the second threshold value is, for example, 90°. That is, when the included angle between the secondary screen and the primary screen is 90°, the screen that the user can see is the primary screen, at which time the desktop will be switched from being displayed on the entire display screen to being displayed on the primary screen.

[0161] S105, the window management service freezes the desktop, takes a screenshot of the desktop, and displays the desktop screenshot.

[0162] It should be noted that the freezing of the desktop in the embodiments of the present application means that the current display content of the display screen is maintained, but no response is given to any operation of the user on the display screen.

[0163] In this way, before the interface that needs to be displayed on the primary screen is loaded, the user will not see the black screen or the loading interface that may appear during the interface loading process by freezing the desktop, taking a screenshot of the desktop, and displaying the desktop screenshot, thereby improving the user experience.

[0164] Continuing to refer to Figure 7 For example, after completing the operation of step S105, the window management service sends a folding configuration change (configchange) instruction to the desktop launcher to inform the desktop manager that the display screen is switched from the unfolded state to the folded state (or is about to be switched to the folded state).

[0165] Continuing to refer to Figure 7 For example, after completing the operation of step S105, the window management service also transmits the desktop layer, the wallpaper layer, the window layer, etc. corresponding to the desktop screenshot to the desktop launcher through the callback of the remote transition animation (REMOTE ANIM) registered by the desktop launcher in step S103, and cancels the freezing of the desktop.

[0166] Understandably, after the freezing is cancelled, the user can normally operate the display screen, and the display screen can also respond to the operation of the user.

[0167] S106, the desktop launcher draws a preset desktop layout according to the desktop layer, the wallpaper layer, the window layer, etc.

[0168] For example, the view of the window that needs to be displayed is drawn.

[0169] It should be noted that the preset desktop layout is invisible before the transition animation is played, and is specifically covered by the desktop screenshot.

[0170] In addition, the icon positions and sizes in the currently displayed desktop screenshot are exactly the same as those of the real desktop, so that the user will not perceive the existence of the desktop screenshot when the transition animation is played.

[0171] S107, start playing the transition animation.

[0172] Specifically, during the process of starting to play the transition animation, the preset desktop layout will start to translate, such as translating outwards from the right edge of the screen.

[0173] In addition, during the process of translating the preset desktop layout, the desktop screenshot will start to change in transparency, specifically, become transparent and invisible, and during the process of becoming transparent and invisible, keep the same translation speed and direction as the preset desktop layout.

[0174] It should be noted that in the use scenario 1.1, the content of the left display area of the preset desktop layout needs to be translated to the home screen, so during the process of starting to play the remote animation, the preset desktop layout and the desktop screenshot completely aligned therewith also need to be translated. In the use scenario 1.2, the content of the right display area of the preset desktop layout is originally in the display area corresponding to the home screen, so during the process of starting to play the remote animation, the preset desktop layout and the desktop screenshot completely aligned therewith have a smaller translation range. In the use scenario 1.3, the preset desktop layout and the desktop screenshot completely aligned therewith need to be translated and scaled to adapt to the home screen. Figure 1

[0175] Continuing to refer to Figure 7 For example, after the transition animation is played, the desktop launcher will call onfinish() to inform the window management server that the transition animation is played, so that the window management service can execute step S108.

[0176] S108, the window management service switches the desktop layout from the preset desktop layout to the desktop layout corresponding to the home screen.

[0177] That is, the desktop layout is scaled to adapt to the home screen, so that there is no case that there are desktop icons not displayed outside the window corresponding to the desktop.

[0178] In order to better understand the preparation process before the start of the transition animation (step S106) and the process during the playing of the transition animation (step S107), the following will be specifically described in combination with Figures 8A-8E .

[0179] The following is the content of the preparation process before the start of the transition animation:

[0180] Referring to Figure 8A ​, exemplary, after the user folds the display screen, triggering the pre-folding operation, the window management service freezes the desktop, and the desktop screenshot (in the specific implementation, containing the desktop wallpaper) obtained by taking a screenshot of the desktop can be as shown in Figure 8A (1). Among them, the desktop screenshot includes desktop icons 1-1 to 1-8 displayed in the display area on the left side of the display screen, and desktop icons 2-1 to 2-8 displayed in the display area on the right side of the display screen.

[0181] Optionally, in actual application, the desktop screenshot can also include the content in the signal bar (not shown in the figure), and the desktop wallpaper set for the current desktop (not shown in the figure).

[0182] Optionally, after receiving the desktop layer, the wallpaper layer, and the window layer passed by the window management service through the callback of the remote transition animation, the desktop launcher will draw a preset desktop layout according to these layers, as shown in Figure 8A (2).

[0183] Optionally, in the use scenario where the display screen changes from the unfolded state to the folded state, the preset desktop layout can be implemented, for example, by a predefined desktop layout function, such as prepareLayoutFakeUiFullToMain().

[0184] Referring to Figure 8A (2), exemplary, the drawn preset desktop layout includes two parts, one part is the window matching the display area of the main screen, and the other part is the desktop icon part outside the window.

[0185] In order to realize the transition animation by using the preset desktop layout, it is necessary to move the desktop icons outside the window into the window, and horizontally compress all the desktop icons in the window, as shown in Figure 8B (1) to Figure 8B (2). In this way, the desktop icons displayed outside the window are moved to be displayed inside the window.

[0186] Since the desktop screenshot is overlaid on the window, and the desktop icons are completely aligned, after moving the desktop icons outside the window to be displayed inside the window, a window as shown in Figure 8B (2) is obtained. It is still necessary to horizontally stretch the window as a whole to obtain a window with the same size as the desktop screenshot, and the desktop icons in the window are completely aligned with the desktop icons in the desktop screenshot. That is, the window shown in Figure 8C (1) is horizontally stretched as a whole to obtain the window shown in Figure 8C (2).

[0187] After obtaining the window as shown in Figure 8CAfter the window (preset desktop layout) shown in (2) is placed under the desktop screenshot, i.e. the desktop screenshot is overlaid on the window, and the desktop screenshot is completely aligned with the window, as shown in (2). Figure 8D

[0188] Thus, before the transition animation is played, the preset desktop layout is drawn, and the preparation work required before the transition animation starts is completed.

[0189] The following is the content during the playing of the transition animation:

[0190] When the animation starts, i.e. the transition animation starts to play, the desktop launcher controls the translation and transparency change of the desktop screenshot overlaid on the window, so that the window covered by the desktop screenshot is displayed, i.e. the desktop changes from Figure 8E (1) to Figure 8E (2) as shown.

[0191] Optionally, it can be specified that the transparency of the desktop screenshot changes from 0% (completely opaque) to 100% (transparent) within a set time.

[0192] Optionally, the change in transparency is completed within 50 milliseconds (ms), for example.

[0193] Optionally, in some possible implementations, it can also be specified that the transparency changes by 20% every 10 ms, so that at 50 ms, the transparency is achieved, i.e. the desktop screenshot is invisible, and the window is completely displayed.

[0194] Continuing to refer to Figure 8E , for example, during the playing of the transition animation, the desktop launcher also needs to control the overall rightward movement of the window (including the desktop icons, wallpaper, signal bar, etc.), and the rightward movement and scaling of each column (desktop) of icons in the window, e.g. the window is translated from Figure 8E (2) to Figure 8E (3).

[0195] Optionally, when the window is moved and scaled to the right, the size of the desktop icons can be set to determine the desktop icons to be scaled; the translation distance can be set, and the translation time of each column can be set to achieve the rightward movement of the window.

[0196] Optionally, the size of the desktop icons can be determined by the two parameters setScaleX (corresponding to the width) and setScaleY (corresponding to the height).

[0197] Optionally, the translation distance can be determined by the two parameters setTranslationX (corresponding to the horizontal movement distance) and setTranslationY (corresponding to the vertical movement distance). ​

[0198] Optionally, the translation time of each column can be implemented by setDuration(). Optionally, the translation time of each column is, for example, 50 ms.

[0199] Continuing to refer to Figure 8E , the exemplary, the window is constantly translated from Figure 8E (2) to Figure 8E (3), the desktop icons 2-1 to 2-8 are all moved out of the window, and finally the desktop icons 1-1 to 1-8 in the window will be displayed to the display area corresponding to the home screen, and scaled to a size suitable for the size of the home screen for display. At this point, the transition animation is played, and the desktop is switched from the style of the desktop screenshot as shown in Figure 8A (1) to the style of the display area on the right side of the window as shown in Figure 8E (4).

[0200] Thus, in the use scenario where the display screen of the outer folding screen mobile phone is switched from the unfolded state to the folded state, the desktop icons present a moving animation effect, thereby improving the user experience.

[0201] Understandably, the specific interaction between the Launcher and the WindowManagerService in the process of the outer folding screen mobile phone 100 changing from the folded state to the unfolded state is similar to the specific interaction between the Launcher and the WindowManagerService in the process of the outer folding screen mobile phone 100 changing from the unfolded state to the folded state as shown in Figure 7 . The difference is that, for the unfolded state, the pre-unfolding listening needs to be registered in the process of starting the desktop. Correspondingly, when the window management service determines that the unfolding angle of the display screen reaches a certain threshold, such as the third threshold, the desktop launcher can see the pre-unfolding through the pre-unfolding listening, and then perform the operation of registering the remote transition animation. Correspondingly, in the process of the user continuing to unfold the display screen, when the desktop management service determines that the unfolding angle of the display screen reaches a certain threshold, such as the fourth threshold, the operation of freezing the screen, taking a screenshot of the desktop, obtaining the desktop screenshot, sending the unfolded configuration change instruction to the desktop launcher, and performing the callback through the remote transition animation to pass the desktop screenshot, the desktop layer, the wallpaper layer, and the window layer to the desktop launcher and cancel the freezing operation can be performed. Correspondingly, the desktop launcher will perform the operations of steps S106 and S107 as shown in Figure 7 , and after the transition animation ends, the desktop management service will perform the operation of step S108 as shown in Figure 7 . The specific interaction process is not shown again, and the following will be described in combination with the drawings, taking the use scenario 2.1 as an example, to explain the preparation process before the transition animation starts and the process during the playing of the transition animation in the process of the outer folding screen mobile phone changing from the folded state to the unfolded state.

[0202] The following is the content of the preparation process before the transition animation starts:

[0203] Referring to Figure 9A , for example, after the user unfolds the display screen and triggers the pre-unfolding operation, the window management service freezes the desktop, and a desktop screenshot (which includes the desktop wallpaper in the specific implementation) obtained by taking a screenshot of the desktop can be as shown in Figure 9A (1). Among them, the desktop screenshot includes desktop icons 1-1 to 1-8 displayed in the main screen.

[0204] Optionally, in actual applications, the desktop screenshot can also include the content in the signal bar (not shown in the figure), and the desktop wallpaper set for the current desktop (not shown in the figure).

[0205] Optionally, after receiving the desktop layer, wallpaper layer, and window layer passed by the window management service through the callback of the remote transition animation, the desktop launcher will draw a preset desktop layout according to these layers, as shown in Figure 9A (2).

[0206] Optionally, in the use scenario where the display screen changes from the folded state to the unfolded state, the preset desktop layout can be implemented, for example, by a predefined desktop layout function such as prepareLayoutFakeUiMainToFull().

[0207] Referring to Figure 9A (2), for example, the drawn preset desktop layout includes two parts, one part is the window matching the display area of the main screen, and the other part is the desktop icon part not displayed in the main screen.

[0208] In order to realize the transition animation by using the preset desktop layout, it is necessary to move the desktop icons in the window that are not displayed in the main screen to outside the window, that is, to translate the 4 columns of desktop icons on the right side of the window shown in Figure 9B (1) to outside the window to obtain the window shown in Figure 9B (2). In this way, the 4 columns of desktop icons displayed on the right side of the window are moved out of the window.

[0209] After obtaining the window shown in Figure 9B (2), it is necessary to place the window under the desktop screenshot, that is, to cover the window with the desktop screenshot as shown in Figure 9A (1), and ensure that the desktop icons in the desktop screenshot are completely aligned with the desktop icons in the window. The aligned desktop screenshot and window can be as shown in Figure 9C (3).

[0210] Therefore, before playing the transition animation, the preset desktop layout is drawn, and the preparation work required before the start of the transition animation is completed.

[0211] The following is the content during the playing of the transition animation:

[0212] When the animation starts, i.e. the transition animation starts playing, the desktop launcher controls the window and the desktop screenshot that is fully aligned with the window to translate and change the transparency, so that the window that is covered by the desktop screenshot is shown, i.e. the desktop changes from Figure 9D (1) to Figure 9D (2).

[0213] Optionally, it can be specified that the desktop screenshot changes from 0% (fully opaque) to 100% (transparent) in a set time.

[0214] Optionally, the change of the transparency is completed within 50 milliseconds (ms), for example.

[0215] Optionally, in some possible implementations, it can also be specified that the transparency changes by 20% every 10 ms, so that at 50 ms, the transparency is achieved, i.e. the desktop screenshot is invisible, and the window is fully shown.

[0216] Continuing to refer to Figure 9D , exemplary, during the playing of the transition animation, the desktop launcher also needs to control the window (including the desktop icons, wallpaper, signal bar, etc.) to move left as a whole, and each column (desktop) of icons in the window to move left and scale, for example, the window is translated from Figure 9D (2) to Figure 9D (3).

[0217] Optionally, when the window moves left as a whole and scales, the size of the desktop icon can be set to determine the desktop icon to be scaled; the translation distance can be set, and the translation time of each column can be set to achieve the left movement of the window.

[0218] Optionally, the size of the desktop icon can be determined by the two parameters setScaleX (corresponding to the width) and setScaleY (corresponding to the height).

[0219] Optionally, the translation distance can be determined by the two parameters setTranslationX (corresponding to the horizontal movement distance) and setTranslationY (corresponding to the vertical movement distance).

[0220] Optionally, the translation time of each column can be achieved by setDuration(). Optionally, the translation time of each column is 50 ms, for example.

[0221] Continuing to refer to Figure 9D , exemplary, the window is translated from Figure 9D (2) to Figure 9DWith the continuous translation of the middle (3), the desktop icons 2-1 to 2-8 are all moved into the display area of the display screen, and finally the desktop icons 1-1 to 1-8 in the window will be displayed to the display area on the left side of the display screen, and the desktop icons 2-1 to 2-8 will be displayed to the display area on the right side of the display screen, and scaled to the size suitable for the size of the entire display screen for display. At this point, the transition animation is played, and the desktop displayed on the display screen is as follows Figure 9A The style of the middle (1) desktop screenshot is switched to Figure 9D The style of the middle (4) window.

[0222] Therefore, in the use scenario of switching the display screen of the outer folding screen mobile phone from the folded state to the unfolded state, the desktop icons present a moving animation effect, thereby improving the user experience.

[0223] In addition, it should be noted that in the embodiments of the present application, the pre-folding monitoring and the pre-unfolding monitoring are only for monitoring the current state of the outer folding screen mobile phone. In actual application, only one monitoring can be created during the startup of the desktop launcher, and the angle between the main screen and the auxiliary screen of the outer folding screen mobile phone can be determined by different thresholds, so that it can be determined whether it is changed from the folded state to the unfolded state or from the unfolded state to the folded state.

[0224] In addition, it can be understood that the electronic device includes hardware and / or software modules corresponding to each function to implement the above functions. The algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in hardware or a combination of hardware and computer software. Whether a certain function is implemented in hardware or computer software driven hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in conjunction with the embodiments, but such implementation should not be considered beyond the scope of the present application.

[0225] In addition, it should be noted that the desktop display method provided by each of the above embodiments implemented by the electronic device in the actual application scenario can also be executed by a chip system included in the electronic device, wherein the chip system can include a processor. The chip system can be coupled with a memory, so that the chip system invokes the computer program stored in the memory when running, and implements the steps executed by the above electronic device. The processor in the chip system can be an application processor or a processor other than an application processor.

[0226] In addition, the embodiments of the present application also provide a computer readable storage medium, which stores computer instructions, and when the computer instructions run on the electronic device, the electronic device executes the above related method steps to implement the desktop display method in the above embodiments.

[0227] In addition, the embodiment of the present application further provides a computer program product, which, when running on an electronic device, causes the electronic device to execute the above related steps to implement the desktop display method in the above embodiment.

[0228] In addition, the embodiment of the present application further provides a chip (which can also be a component or a module), which can include one or more processing circuits and one or more transceiver pins; wherein the transceiver pins and the processing circuits communicate with each other through internal connection paths, and the processing circuits execute the above related method steps to implement the desktop display method in the above embodiment to control the receiving pins to receive signals and control the sending pins to send signals.

[0229] In addition, as can be known from the above description, the electronic device, the computer readable storage medium, the computer program product or the chip provided by the embodiment of the present application are all used to execute the corresponding method provided above, and thus the beneficial effects that can be achieved are referable to the beneficial effects in the corresponding method provided above, which will not be described here again.

[0230] The above embodiments are only used to illustrate the technical solutions of the present application, rather than limit them; although the foregoing embodiments of the present application have been described in detail, those skilled in the art should understand that the technical solutions recorded in the foregoing embodiments can still be modified, or some technical features can be replaced by equivalents; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A desktop display method, characterized in that: Applied to an external folding screen device, the external folding screen device includes a flexible screen, the flexible screen includes a first display area, a second display area and a third display area, the method includes: When the flexible screen in the unfolded state is folded with the second display area as a folding area and the folding angle reaches a first threshold, registering a remote transition animation; When the folding angle of the flexible screen reaches a second threshold, freezing the flexible screen, capturing a desktop currently displayed on the flexible screen, and displaying the captured first desktop screenshot, wherein the second threshold is greater than the first threshold; According to the first desktop screenshot, obtaining a first desktop layer, a first wallpaper layer, and a first window layer, and unfreezing the flexible screen; Draw a first preset desktop layout based on the first desktop layer, the first wallpaper layer, and the first window layer, and place the first preset desktop layout below the first desktop screenshot, wherein the first preset desktop layout is used to implement a remote transition animation; wherein the size of the first preset desktop layout is the same as the size of the first desktop screenshot, and the positions and sizes of desktop elements displayed in the first preset desktop layout are completely aligned with the positions and sizes of desktop elements in the first desktop screenshot, and the positions and sizes of the desktop elements are marked and obtained when registering the remote transition animation; Starting to play a transition animation according to the first preset desktop layout, and during the playing of the transition animation, translating and changing the transparency of the first desktop screenshot until the first desktop screenshot becomes transparent; After the first desktop icon corresponding to the third display area in the first preset desktop layout is moved to the third display area, the transition animation ends, and the first preset desktop layout is switched to the desktop layout corresponding to the third display area, and the desktop layout corresponding to the third display area is pre-stored in the local storage medium.

2. The method according to claim 1, characterized in that The method of registering a remote transition animation when the flexible screen in the unfolded state is folded with the second display area as a folding area and the folding angle reaches a first threshold includes: When it is detected that the flexible screen in the expanded state is folded with the second display area as the folding area and the folding angle reaches the first threshold, the current position and size of the desktop element are marked in the remote transition animation function, and the remote interface for overlaying the suspended application conversion is called to register the remote transition animation.

3. The method according to claim 2, characterized in that The method further comprises: During the desktop startup process, a first monitor is registered, where the first monitor is used to monitor whether the folding angle reaches the first threshold during the process of folding the flexible screen in the unfolded state with the second display area as the folding area.

4. The method according to claim 3, characterized in that The step of registering a first listener during the desktop startup process includes: During the desktop startup process, the registerContentObserver method is called to register the first listener.

5. The method according to claim 1, wherein Drawing a first preset desktop layout according to the first desktop layer, the first wallpaper layer, and the first window layer includes: Determining, based on the first desktop layer, the first wallpaper layer, and the first window layer, a first desktop icon included in the first preset desktop layout; wherein a portion of the first desktop icon is displayed in the window corresponding to the third display area, and the remaining portion is displayed outside the window; moving the first desktop icons outside the window corresponding to the third display area into the window, and horizontally compressing each of the first desktop icons; The window displaying all the first desktop icons is stretched horizontally as a whole to obtain the first preset desktop layout.

6. The method according to claim 1, characterized in that The first desktop screenshot is overlaid on the first preset desktop layout, and the desktop icons in the first desktop screenshot are completely aligned with the first desktop icons in the first preset desktop layout; The step of starting to play a transition animation according to the first preset desktop layout, and translating and changing the transparency of the first desktop screenshot during the transition animation until the first desktop screenshot becomes transparent, includes: When the transition animation starts playing, changing the transparency of the first desktop screenshot that is overlaid on the first preset desktop layout and is completely aligned with the first desktop icon in the first preset desktop layout, until the first desktop screenshot becomes transparent and displays the first preset desktop layout; During the process of changing the transparency of the first desktop screenshot, the first preset desktop layout and the first desktop screenshot are controlled to move to the right at the same translation speed and translation distance until the first desktop icon corresponding to the third display area in the first preset desktop layout is moved to the third display area.

7. The method according to claim 6, characterized in that The method further comprises: In the process of controlling the first preset desktop layout and the first desktop screenshot to move to the right at the same translation speed and distance to the first desktop icon corresponding to the third display area in the first preset desktop layout and moving it to the third display area, the first desktop icon moved to the third display area is scaled according to the size of the third display area.

8. The method according to any one of claims 1 to 7, characterized in that After switching the first preset desktop layout to the desktop layout corresponding to the third display area, the method further includes: When the flexible screen in the folded state is unfolded with the second display area as the folding area and the unfolding angle reaches a third threshold, registering the remote transition animation; When the unfolded angle of the flexible screen reaches a fourth threshold, freezing the flexible screen, capturing a desktop currently displayed on the flexible screen, and displaying the captured second desktop screenshot, wherein the fourth threshold is greater than the third threshold; According to the second desktop screenshot, obtaining a second desktop layer, a second wallpaper layer, and a second window layer, and unfreezing the flexible screen; Drawing a second preset desktop layout according to the second desktop layer, the second wallpaper layer, and the second window layer, where the second preset desktop layout is a desktop layout corresponding to when the flexible screen switches from the unfolded state to the folded state; According to the second preset desktop layout, starting to play a transition animation, and during the playing of the transition animation, translating and changing the transparency of the second desktop screenshot until the second desktop screenshot becomes transparent; After all second desktop icons included in the second preset desktop layout are moved to the display area of ​​the flexible screen, the transition animation is ended, and the second preset desktop layout is switched to the desktop layout corresponding to the flexible screen.

9. The method according to claim 8, characterized in that Drawing the second preset desktop layout according to the second desktop layer, the second wallpaper layer, and the second window layer includes: Determining, based on the second desktop layer, the second wallpaper layer, and the second window layer, second desktop icons included in the second preset desktop layout; wherein a portion of the second desktop icons is used to be displayed in a left display area of ​​the flexible screen, and the remaining portion is used to be displayed in a right display area of ​​the flexible screen; Display the second desktop icon in the second preset desktop layout that is identical to the desktop icon in the second desktop screenshot in the window corresponding to the third display area, and move the second desktop icon that is not displayed in the window corresponding to the third display area outside the window to obtain the second preset desktop layout.

10. The method according to claim 8, characterized in that The second desktop screenshot is overlaid on the second preset desktop layout, and the desktop icons in the second desktop screenshot are completely aligned with the second desktop icons in the second preset desktop layout; The step of starting to play a transition animation according to the second preset desktop layout, and translating and changing the transparency of the second desktop screenshot during the transition animation until the second desktop screenshot becomes transparent, includes: When the transition animation starts playing, changing the transparency of the second desktop screenshot that is overlaid on the second preset desktop layout and is completely aligned with the second desktop icon in the second preset desktop layout, until the second desktop screenshot becomes transparent and displays the second preset desktop layout; During the process of changing the transparency of the second desktop screenshot, the second preset desktop layout and the second desktop screenshot are controlled to move to the left at the same translation speed and translation distance until all second desktop icons included in the first preset desktop layout are displayed in the display area of ​​the flexible screen.

11. An electronic device, characterized in that: The electronic device includes: a memory and a processor, the memory and the processor are coupled; the memory stores program instructions, and when the program instructions are executed by the processor, the electronic device executes the desktop display method according to any one of claims 1 to 10.

12. A computer-readable storage medium, characterized in that The method comprises a computer program, which, when executed on an electronic device, enables the electronic device to execute the desktop display method according to any one of claims 1 to 10.

Images