Display method and device of electronic equipment and storage medium
Patent Information
- Application Number
- CN202380050896.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-06-30
- Filing Date
- 2023-06-28
- Publication Date
- 2025-02-18
AI Technical Summary
Existing foldable displays lack dynamic effects during the unfolding or folding process, resulting in a limited user experience and the inability to dynamically display wallpapers during changes in the physical state of the screen.
Provides a display method for an electronic device, by playing animation during the physical state change process of the foldable display screen, the size and position of the wallpaper area in the animation are related to the unfolding angle, and the wallpaper position change information and dynamic effect parameters are used to generate animation frames, Realize the dynamic change effect of wallpaper.
During the change of the physical state of the foldable display, the dynamic changing effect of the wallpaper is achieved, improving the user's visual experience and enhancing the user's interactive experience.
Smart Images

Figure CN119487488A_ABST
Abstract
Description
Display method, device and storage medium of electronic device
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS
[0002] This application claims priority to the Chinese patent application filed with the China Patent Office on June 30, 2022, with application number 202210772715.3 and application name “A display method, device and storage medium for an electronic device”, the entire contents of which are incorporated by reference into this application. Technical Field
[0003] The present application relates to the field of terminal technology, and in particular to a display method, device, and storage medium for an electronic device. Background Art
[0004] Foldable displays, including flexible organic light-emitting diode (OLED) screens, are thinner and lighter than traditional screens, allowing for easier bending. Currently, foldable displays are being used in electronic devices such as mobile phones and tablets.
[0005] When using an electronic device with a foldable display, users can fold or unfold the screen. However, the screen currently lacks dynamic effects during the folding or unfolding process. For example, the wallpaper cannot dynamically display effects that match the unfolding or folding process, which limits the user experience.
[0006] Summary of the Invention
[0007] Embodiments of the present application provide a display method, device, and storage medium for an electronic device, which are applied to an electronic device with a foldable display screen, and are used to display a dynamic change effect of a wallpaper during a change in the physical state of the foldable display screen.
[0008] In a first aspect, a display method for an electronic device is provided, which is applied to an electronic device having a foldable display screen, the method comprising:
[0009] When the foldable display of the electronic device is in a first physical state, the wallpaper displayed on the foldable display is the first area of the first wallpaper; during the process of the foldable display changing from the first physical state to the second physical state, a first animation is played, the first animation includes a first frame and a second frame, the wallpaper in the first frame is the second area of the first wallpaper, the wallpaper in the second frame is the third area of the first wallpaper, the size of the second area and the third area and the position in the first wallpaper are related to the unfolding angle of the foldable display; when the foldable display is in the second physical state, the wallpaper displayed on the foldable display is the fourth area of the first wallpaper, and the fourth area is the wallpaper in the last animation frame in the first animation.
[0010] In the above implementation, the first animation is played during the process of the foldable display screen of the electronic device changing from the first physical state to the second physical state, so that the animation can be displayed when the physical state of the screen changes. For any two animation frames (the first frame and the second frame) in the first animation, the wallpaper in the first frame is the second area of the first wallpaper (such as the full-screen wallpaper), and the wallpaper in the second frame is the third area of the first wallpaper. The size of the second area and the third area and the position in the first wallpaper are related to the unfolding angle of the foldable display screen. Therefore, as the unfolding angle of the foldable display screen gradually changes, the size of the wallpaper displayed on the screen and its position in the full-screen wallpaper also change, thereby achieving a dynamic change effect of the wallpaper during the change of the physical state of the foldable display screen.
[0011] In a possible implementation, the method further includes: generating the first animation in response to the foldable display changing from the first physical state to a second physical state.
[0012] In the above implementation, the first animation is triggered by the foldable display changing from a first physical state to a second physical state, so that the wallpaper in the animation frame in the first animation can match the changing process (such as the expansion angle during the changing process).
[0013] In one possible implementation, generating the first animation includes: determining wallpaper position change information based on a first position and a second position; wherein the first position is a position of the wallpaper displayed on the first screen portion of the foldable display screen in the first wallpaper under the first physical state, and the second position is a position of the wallpaper displayed on the first screen portion in the first wallpaper under the second physical state; generating the first animation based on the wallpaper position change information, the unfolding angle of the foldable display screen, and the motion effect parameters of the first animation.
[0014] Optionally, when the first physical state is a folded state, the first position is a preset position in the first wallpaper; when the first physical state is an unfolded state, the first position is the rightmost position of the first wallpaper; when the first physical state is an intermediate state, the first position is between the preset position and the rightmost position in the first screen, and is related to the unfolding angle of the foldable display screen corresponding to the first physical state.
[0015] In the above implementation, based on the position change from the first position (the position of the wallpaper displayed on the main screen among the wallpapers on the first screen before the physical state changes) to the second position (the position of the wallpaper displayed on the main screen among the wallpapers on the first screen after the physical state changes), the position change of the wallpaper in each animation frame in the first animation can be determined, and then each animation frame in the first animation is generated, so that the animation frames in the first animation match the change process from the first physical state to the second physical state.
[0016] In a possible implementation, the generating of the first animation according to the wallpaper position change information, the unfolding angle of the foldable display, and the motion effect parameters of the first animation includes: determining the size of the wallpaper in each animation frame according to the unfolding angle corresponding to each animation frame in the first animation in the process from the first physical state to the second physical state; determining the position of the wallpaper in each animation frame in the first wallpaper according to the wallpaper position change information, the unfolding angle corresponding to each animation frame in the first animation, and the motion effect parameters of the first animation; determining the area of the wallpaper in each animation frame in the first wallpaper according to the size of the wallpaper in each animation frame in the first animation and the position of the wallpaper in each animation frame in the first wallpaper; generating the first animation according to the area of the wallpaper in each animation frame in the first wallpaper.
[0017] In the above implementation, the size of the wallpaper in each animation frame in the first animation is related to the expansion angle, and the position of the wallpaper in each animation frame in the first animation is related to the address position change information, so that the animation frames in the first animation match the change process from the first physical state to the second physical state, and can achieve the process of the foldable display changing from the first physical state to the second physical state. The size of the wallpaper displayed on the screen and its position in the first wallpaper (such as a full-screen wallpaper) change accordingly, achieving a dynamic display effect.
[0018] In a possible implementation, determining the area of the wallpaper in each animation frame in the first wallpaper based on the size of each animation frame in the first animation and the position of the wallpaper in each animation frame in the first wallpaper includes: changing the position and size of the mask in the display plane where the first wallpaper is located based on the size of each animation frame in the first animation and the position of the wallpaper in each animation frame in the first wallpaper, to obtain the wallpaper in each animation frame, wherein the wallpaper in each animation frame is the visible area outside the area blocked by the mask in the display plane where the first wallpaper is located.
[0019] In the above implementation, by changing the position and size of the mask in the display plane (surface) where the first wallpaper is located, the visible area in the display plane can be changed. The visible area is the wallpaper in the animation frame. In this way, on the one hand, by changing the position of the mask in the display plane (surface) where the first wallpaper is located, the visual effect of moving the wallpaper can be achieved. On the other hand, the operation of repeatedly drawing the wallpaper for each animation frame can be saved, thereby reducing system overhead.
[0020] In a possible implementation, the wallpaper is a dynamic wallpaper, the dynamic wallpaper includes a wallpaper frame sequence, and the wallpaper frame sequence includes at least two wallpaper animation frames; generating the first animation includes:
[0021] Determine wallpaper position change information based on the first position and the second position; wherein the first position is the position of the wallpaper displayed on the first screen portion of the foldable display in the first wallpaper under the first physical state, and the second position is the position of the wallpaper displayed on the first screen portion in the second physical state; determine the correspondence between the wallpaper in each animation frame in the first animation and the wallpaper animation frames in the wallpaper frame sequence; generate the first animation based on the wallpaper position change information, the unfolding angle of the foldable display, the motion effect parameters of the first animation, and the correspondence between each animation frame in the first animation and the wallpaper animation frames in the wallpaper sequence.
[0022] The above implementation method can achieve a dynamic display effect of the wallpaper when using a dynamic wallpaper and when the physical state of the foldable display changes, thereby improving the user experience.
[0023] Optionally, the correspondence between the wallpaper in each animation frame in the first animation and the wallpaper animation frames in the wallpaper sequence is: the animation frames in the first animation correspond one-to-one to the wallpaper animation frames in the wallpaper frame sequence, the wallpaper of the first animation frame in the first animation is the m-th frame in the wallpaper frame sequence, the m-th frame is the wallpaper displayed on the foldable display in the first physical state, and m is an integer greater than or equal to 1.
[0024] Optionally, if the wallpaper of the kth animation frame in the first animation is the last wallpaper animation frame in the wallpaper frame sequence, then the wallpaper of the k+1th animation frame in the first animation is the first wallpaper animation frame in the wallpaper frame sequence.
[0025] In a possible implementation, the first screen portion is a main screen in the foldable display screen.
[0026] In a possible implementation, the motion effect parameters include at least one of the following: playback duration, motion effect curve, and motion effect mode.
[0027] In a possible implementation, when the first physical state is a folded state, the first position is a preset position in the first wallpaper.
[0028] In a possible implementation, the method further includes: obtaining the dynamic effect parameters set by the system. In the above implementation, the dynamic effect parameters are set by the system, which can achieve a unified dynamic display effect for different applications.
[0029] In a possible implementation, the method further includes: obtaining the motion effect parameters set by the application. In the above implementation, the motion effect parameters are set by the application, so that different applications can set the motion effect parameters as needed, thereby improving flexibility.
[0030] In a possible implementation, the foldable display screen includes any one of the following: an outward folding screen, an inward folding screen, and a scroll screen.
[0031] In one possible implementation, when the foldable display screen is an outward-folding screen or an inward-folding screen, the first physical state is a folded state, an intermediate state, or an unfolded state, where the intermediate state is a state between the folded state and the unfolded state, and the intermediate state includes at least one of a first intermediate state and a second intermediate state;
[0032] When the first physical state is a folded state, the second physical state is an intermediate state or an unfolded state;
[0033] When the first physical state is an unfolded state, the second physical state is an intermediate state or a folded state;
[0034] When the first physical state is the first intermediate state, the second physical state is the unfolded state or the folded state or the second intermediate state.
[0035] In a second aspect, an electronic device is provided, comprising: a foldable display, and one or more processors; the one or more memories storing one or more computer programs, the one or more computer programs including instructions, which, when executed by the one or more processors, enable the electronic device to execute a method as described in any one of the methods described in the first aspect above.
[0036] According to a third aspect, a computer-readable storage medium is provided, comprising a computer program. When the computer program is run on an electronic device, the electronic device executes the method according to any one of the first aspects.
[0037] In a fourth aspect, a computer program product is provided, which, when executed on an electronic device, enables the electronic device to execute the method described in any one of the first aspects above.
[0038] In the fifth aspect, a chip system is provided, comprising: a memory for storing a computer program; a processor; when the processor calls and runs the computer program from the memory, the electronic device equipped with the chip system executes the method described in any one of the above-mentioned first aspects.
[0039] For the beneficial effects of the second to fifth aspects above, please refer to the beneficial effects of the first aspect and will not be repeated. BRIEF DESCRIPTION OF THE DRAWINGS
[0040] FIG1A is an exemplary diagram of an outward-folding foldable display screen according to an embodiment of the present application;
[0041] FIG1B is an exemplary diagram of an outward-folding foldable display screen according to an embodiment of the present application;
[0042] FIG1C is an exemplary diagram of an outward-folding foldable display screen according to an embodiment of the present application;
[0043] FIG1D is an exemplary diagram of an inward-folding foldable display screen according to an embodiment of the present application;
[0044] FIG2A is a schematic diagram illustrating an exemplary screen display principle in an embodiment of the present application;
[0045] FIG2B is an example diagram of a screen display effect in an embodiment of the present application;
[0046] FIG3 is a schematic diagram of a user interface in an embodiment of the present application;
[0047] FIG4 is a schematic diagram of the hardware structure of an electronic device in an embodiment of the present application;
[0048] FIG5 is a schematic diagram of a software architecture of an electronic device in an embodiment of the present application;
[0049] FIG6 a is a schematic diagram of a flow chart of a display method provided in an embodiment of the present application;
[0050] FIG6 b is a schematic diagram of the generation process of the first animation in an embodiment of the present application;
[0051] FIG6 c is a schematic diagram of a process of generating a first animation according to wallpaper position change information, an unfolding angle of the foldable display screen, and motion effect parameters of the first animation in an embodiment of the present application;
[0052] FIG7 is a schematic diagram of wallpaper displayed on the foldable display screen in the unfolded state, intermediate state, and folded state according to an embodiment of the present application;
[0053] FIG8 is a schematic diagram showing the principle and effect of dynamic wallpaper display during the unfolding of the foldable display screen according to an embodiment of the present application;
[0054] FIG9 is a schematic diagram showing the principle and effect of dynamic wallpaper display during folding of the foldable display screen according to an embodiment of the present application;
[0055] FIG10 is a schematic diagram of a display method during a process of changing the physical state of a foldable display screen according to an embodiment of the present application;
[0056] FIG11 is a flow chart of a display method during a physical state change of a foldable display screen in an embodiment of the present application. DETAILED DESCRIPTION
[0057] The technical solutions in the embodiments of the present application will be described clearly and completely below in conjunction with the drawings in the embodiments of the present application. The terms used in the following embodiments are only for the purpose of describing specific embodiments and are not intended to be limiting of the present application. As used in the specification and appended claims of the present application, the singular expressions "one", "a kind of", "said", "above", "the" and "this" are intended to also include expressions such as "one or more", unless there is a clear contrary indication in the context. It should also be understood that in the embodiments of the present application, "one or more" refers to one, two or more; "and / or" describes the association relationship of associated objects, indicating that three relationships may exist; for example, A and / or B can represent: the existence of A alone, the existence of A and B at the same time, and the existence of B alone, where A and B can be singular or plural. The character " / " generally indicates that the related objects before and after are in an "or" relationship.
[0058] References to "one embodiment" or "some embodiments" in this specification mean that a particular feature, structure, or characteristic described in conjunction with that embodiment is included in one or more embodiments of the present application. Thus, phrases such as "in one embodiment," "in some embodiments," "in other embodiments," and "in yet other embodiments" appearing in various places in this specification do not necessarily refer to the same embodiment, but rather mean "one or more but not all embodiments," unless otherwise specifically emphasized. The terms "including," "comprising," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.
[0059] In the description of the embodiments of the present application, the terms "first" and "second" are used only for the purpose of distinguishing descriptions and should not be understood as indicating or implying relative importance or order.
[0060] This application provides a display method for an electronic device with a foldable display screen and related electronic devices, which are used to display a dynamic wallpaper effect during the process of the foldable display screen's physical state changing, thereby improving the user's visual experience. The method and electronic device are based on the same technical concept. Since the method and electronic device solve similar problems, the implementation of the electronic device and the method can refer to each other, and the repeated parts will not be repeated.
[0061] In the solution provided in an embodiment of the present application, during the physical state switching process of the foldable display screen of the electronic device, the electronic device displays a first animation, and the wallpapers in different animation frames in the first animation are different areas of the full-screen wallpaper, so that the changes in the wallpaper can be dynamically displayed during the physical state switching process of the foldable display screen, thereby improving the user's visual experience.
[0062] Below, some terms in this application are explained to facilitate understanding by those skilled in the art.
[0063] (1) An electronic device is a device equipped with a foldable display screen and capable of human-computer interaction through the foldable display screen. For example, the electronic device may be a mobile phone, a tablet computer, a laptop computer, a netbook, a vehicle-mounted device, a business intelligent terminal (including: videophone, conference desktop intelligent terminal, etc.), a personal digital assistant (PDA), an augmented reality (AR) or virtual reality (VR) device, etc. The embodiments of this application do not limit the specific form of the electronic device.
[0064] (2) A foldable display screen refers to a screen that can change shape by external force, and includes at least two screen parts. The sizes of the screen parts can be different or the same. In the following embodiments, "screen" and "screen part" refer to part or all of the foldable display screen. In some cases, a foldable display screen is also called a flexible screen.
[0065] Among them, a screen part of the foldable display can be an independent complete screen (or an independent display unit, such as one that can be controlled by a processor as a whole), or it can refer to a display area of a part of a complete screen. The electronic device can control the display status of different screen parts separately. Based on the control, the display status of each screen part can be specifically a display-on state (also called a display state, such as a bright screen state) or a display-off state (such as a black screen state).
[0066] Two adjacent screen portions can be movably connected based on a bend (e.g., a hinge or flexible material). In some implementations, the exterior of the connecting portion is also covered with a display screen (also referred to as a connecting screen or folding edge). In this way, the different screen portions of the foldable display can be flattened into a full screen for display based on external force (e.g., a user manually unfolding the display), or folded into a single screen for display based on external force (e.g., a user manually folding the display). For example, when the foldable display is unfolded to full screen, it can display an 8-inch full screen, and when folded, it can display a 6.6-inch or 6.38-inch screen portion.
[0067] In summary, the foldable display screen includes: at least one bending portion, and multiple screen portions located on both sides of the bending portion.
[0068] Foldable displays generally have two folding methods: outward-folding and inward-folding. As shown in Figures 1A and 1B, in an outward-folding foldable display, the different screen parts of the foldable display face each other after folding.
[0069] For example, referring to the foldable display shown in FIG1A , the foldable display has three parts: a bending part and a first screen part and a second screen part on both sides of the bending part.
[0070] When the bent portion is bent or deformed, the angle between the first screen portion and the second screen portion (hereinafter referred to as the unfolded angle) changes, as shown in FIG. 1A b and FIG.
[0071] In practical applications, a foldable display typically has two physical states: an unfolded state, as shown in Figure 1A (a), and a folded state, as shown in Figure 1A (d). During the state change process of switching the foldable display from one physical state to another (hereinafter referred to as the state change process), the foldable display may also exhibit an intermediate, semi-folded state, as shown in Figures 1A (b) and 1A (c).
[0072] In some scenarios, the electronic device can determine the physical state of the foldable display by the unfolding angle. For example, when the unfolding angle is within the interval formed by the first threshold and 180 degrees (i.e., the preset unfolded state condition), the electronic device determines that the physical state of the foldable display is the unfolded state; when the unfolding angle is within the interval formed by 0 degrees and the second threshold (i.e., the preset folded state condition), the electronic device determines that the physical state of the foldable display is the folded state; when the unfolding angle is within the interval formed by the second threshold and the first threshold (i.e., the preset intermediate state condition), the electronic device determines that the physical state of the foldable display is the intermediate state. Wherein, the value of the first threshold is greater than the value of the second threshold, and the first threshold and the second threshold can be set according to the actual application. For example, the first threshold is 180 degrees, 170 degrees, 150 degrees, etc., and the second threshold is 0 degrees, 5 degrees, 45 degrees, 90 degrees, etc.
[0073] In the example shown in FIG1A , the foldable display screen is folded left and right (i.e., longitudinally). In other embodiments, the foldable display screen can also be folded up and down (i.e., transversely), as shown in FIG1B . The present embodiment of the present application does not limit the folding method of the foldable display screen.
[0074] The foldable display shown in Figures 1A and 1B includes two screen parts. It is understood that the method provided in the embodiments of the present application can also be applied to foldable displays with three or more screen parts. For example, Figure 1C shows a foldable display with three screen parts. When the unfolding angles of any two adjacent screen parts meet the preset folding state conditions, the physical state of the foldable display is the folded state; when all two adjacent screen parts meet the preset unfolding state conditions, the physical state of the foldable display is the unfolded state, and other cases are intermediate states.
[0075] Referring to FIG1D , the foldable display screen folds inwards. After folding, the different screen portions of the foldable display screen face each other. This application does not limit the folding form of the folding screen, for example, it can be a tri-fold screen or other folding form.
[0076] In addition to the above-mentioned external folding screen and internal folding screen, the foldable display screen in the embodiment of the present application can also be a scroll screen. The embodiment of the present application does not limit the type and folding method of the foldable display screen.
[0077] In the following embodiments of this application, the methods provided herein are described using an outward-folding display screen as an example. An outward-folding display screen is one in which, after folding, at least one portion of the screen is visible on the front and at least one portion of the screen is visible on the back. In other embodiments, the methods provided herein are not limited to applications using outward-folding display screens.
[0078] The following continues to describe the physical state and display state changes of the foldable display screen shown in FIG. 1A .
[0079] As shown in Figure 1A (a), the physical state of the foldable display is the unfolded state. When the foldable display is in the operating state (display state), the first screen portion, the second screen portion, and the bent portion are all in the display state. In this way, the entire foldable display screen can be used to display content.
[0080] As shown in Figure d of FIG1A , the physical state of the foldable display screen is the folded state. When the foldable display screen is in the working state, the default main screen (e.g., the first screen portion) is in the display state and can display content, while the default secondary screen (e.g., the second screen portion) is in the non-display state, does not display content or is a black screen. Of course, the user can operate the electronic device, the main screen or the secondary screen (e.g., flip the electronic device, double-click the secondary screen, etc.) to set the secondary screen to the display state and the main screen to the non-display state. Among them, the default main screen and the default secondary screen in the foldable display screen can be set by the user according to actual usage, or can be the default setting of the electronic device when it leaves the factory.
[0081] As shown in Figure d of FIG1A , the physical state of the foldable display is the folded state. When the foldable display is in the working state, the electronic device can determine which part of the screen is visible to the user. For example, it can detect whether there is a face in front of the camera through a camera located in a certain part of the screen, or determine whether there is a user in front of the infrared sensor by the user's operation method when folding the foldable display, or determine whether there is a user in front of the infrared sensor through an infrared sensor located in a certain part of the screen. When the electronic device determines that the first screen part is visible to the user, it sets the first screen part to the display state so that it can display content, and then sets the second screen part to the non-display state so that it does not display content or is a black screen. In other embodiments, the second screen part can also display content and / or have the ability to control the second screen part.
[0082] In some embodiments, in a scenario where the foldable display is in the folded state shown in Figure d in Figure 1A, the electronic device can set a certain screen portion to a display state while also setting a bent portion connected to the screen portion to a display state for displaying content.
[0083] In an embodiment of the present application, the display state of the foldable display changes as the physical state of the foldable display changes. For example, when the physical state and display state of the foldable display are as shown in Figure 1A (a), the user can fold the foldable display to change the physical state and display state of the foldable display to that shown in Figure 1A (d). For another example, when the physical state and display state of the foldable display are as shown in Figure 1A (d), the user can unfold the foldable display to change the physical state and display state of the foldable display to that shown in Figure 1A (a).
[0084] (3) Screen display area: The area of the screen in the display state of the foldable display used for drawing and displaying the interface. The size and position of the screen display area may be the same or different for different physical states of the foldable display. Generally, the size of the screen display area is the same as the size of the screen in the current display state.
[0085] For example, when the foldable display is in the unfolded state, the size of the screen display area is the same as the size of the entire foldable display, as shown in Figure a in Figure 1A; when the foldable display is in the folded state, the size of the screen display area is the same as the size of the main screen, as shown in Figure d in Figure 1A.
[0086] The following describes the display principle of the screen display area. It should be understood that the following display principle is only an exemplary description for the purpose of understanding the implementation process of this application. However, in other technologies or future technologies, there may be other display methods, and this application does not limit them.
[0087] The screen display area includes one or more display surfaces, as shown in FIG2A . Optionally, each surface is the same size as the screen display area, and when the screen display area includes multiple surfaces, the multiple surfaces may overlap. Each surface is used to draw an interface, and the interface ultimately displayed in the screen display area is essentially the interface superimposed on the interfaces of the various surfaces it contains.
[0088] Referring to FIG. 2B , for example, when the screen display area includes two display planes, surface 1 and surface 2. When the interface in the upper layer of surface 1 is opaque, the interface actually displayed in the screen display area (i.e., visible to the user) is the interface in surface 1, as shown in FIG. a in FIG. 2B . When the interface in the upper layer of surface 1 is translucent and the interface in the lower layer of surface 2 is opaque, the interfaces actually displayed in the screen display area are the interface in surface 1 and the interface in surface 2, as shown in FIG. b in FIG. 2B . When the interface in the upper layer of surface 1 is transparent and the interface in the lower layer of surface is opaque, the interface actually displayed in the screen display area is the interface in surface 2, as shown in FIG. c in FIG. 2B . It will be understood that some areas in surface 1 or surface 2 may be transparent, and some areas may be opaque or translucent.
[0089] The foldable display described in the above embodiments and related drawings is intended only to explain the technical solution of this application and is not intended to be limiting. This application does not limit the shape, appearance, material, number of screen parts, connection method between screen parts, or folding method of each screen part of the foldable display.
[0090] (4) Interface, also known as user interface (UI), is presented on the foldable display and is the medium for interaction and information exchange between the electronic device and the user. It can realize the conversion between the internal data form of the device and the visual form of the user.
[0091] The specific form of the interface can be an image or a window. When the displayed interface is an image, the user usually cannot perform any editing on the image, but can exit the interface through some operations. The window is responsible for displaying and processing information, and the user can operate within the window. Taking a mobile phone as an example, the windows include: the main interface window (such as the launcher window), the application window, etc., and also the window in the lock screen state. Among them, the main interface window contains wallpaper and icons of multiple applications displayed on the wallpaper, such as the icon of the camera application, the icon of the gallery application, etc., as shown in Figure a in Figure 3. The window in the lock screen state can include wallpaper and other display information (such as time), as shown in Figure b in Figure 3.
[0092] The wallpaper is a background image set by an electronic device. The wallpaper may include static wallpaper, dynamic wallpaper, etc., which is not limited in the present embodiment.
[0093] Referring to Figure 4, a schematic diagram of the internal hardware structure of an electronic device provided in an embodiment of the present application is shown. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone jack 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display 194, and a subscriber identification module (SIM) card interface 195.
[0094] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, a display processing unit (DPU), and / or a neural-network processing unit (NPU), etc. Among them, different processing units can be independent devices or integrated into one or more processors. In some embodiments, the electronic device 100 may also include one or more processors 110. Among them, the processor is the nerve center and command center of the electronic device 300. The processor can generate an operation control signal based on the instruction opcode and timing signal to complete the control of instruction fetching and execution. A memory can also be set in the processor 110 for storing instructions and data.
[0095] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface. Among them, the USB interface 130 is an interface that complies with the USB standard specification, and specifically can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transmit data between the electronic device 100 and peripheral devices. It can also be used to connect headphones to play audio through the headphones.
[0096] The sensor module 180 may include one or more of the following: a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, and a bone conduction sensor 180M. In the embodiment of the present application, the sensor may optionally detect the unfolding angle of the foldable display screen, so that the processor 110 may display a dynamic change effect of the user interface wallpaper in the display area of the foldable display screen according to the change in the unfolding angle.
[0097] The charging management module 140 is configured to receive charging input from a charger. The power management module 141 is configured to connect the battery 142, the charging management module 140, and the processor 110. The wireless communication function of the electronic device 100 can be implemented through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, a modem processor, and a baseband processor.
[0098] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.
[0099] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some functional modules of the mobile communication module 150 can be set in the processor 110.
[0100] The modem processor may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.) or displays an image or video through the display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.
[0101] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as Wi-Fi networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc. applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.
[0102] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, so that electronic device 100 can communicate with a network and other devices via wireless communication technology. Electronic device 100 can implement a shooting function through an ISP, camera 193, video codec, GPU, display 194, and application processor.
[0103] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 via the external memory interface 120 to implement data storage functions. For example, files such as music and videos can be stored on the external memory card.
[0104] Electronic device 100 implements display functionality through a GPU, display screen 194, and an application processor (AP). Display screen 194 is used to display images, videos, and the like. Display screen 194 in the present embodiment is a foldable display screen, and related descriptions can be made with reference to the screens shown in Figures 1A, 1B, 1C, and 1D.
[0105] The electronic device 100 can implement audio functions such as music playback and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.
[0106] It should be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0107] The software system of the electronic device can adopt a layered architecture, event-driven architecture, micro-core architecture, micro-service architecture, or cloud architecture. system) as an example to illustrate the software structure of the electronic device.
[0108] Refer to Figure 5, which is a schematic diagram of the layered software structure of an electronic device provided in an embodiment of the present application. The layered architecture divides the software system of an electronic device into several layers, each with clear roles and divisions of labor. The layers communicate with each other through software interfaces.
[0109] In some embodiments, the Android system can be divided into four layers, namely, the application layer (applications), the application framework layer (application framework), the Android runtime (Android runtime), the system library, and the kernel layer (kernel). The embodiments of the present application do not limit the layering of the software structure of the electronic device. The Android runtime, the system library, and the kernel layer can be regarded as one layer, referred to as the system layer. It should be understood that Figure 5 also adds the hardware layer of the electronic device on the basis of the Android system.
[0110] It should be understood that the modules included in each layer shown in Figure 5 are modules involved in the embodiments of this application. The modules included in each layer below do not constitute a limitation on the structure of the electronic device and the hierarchy of module deployment (illustrative example). In one embodiment, the modules shown in Figure 5 can be deployed separately, or several modules can be deployed together. The division of modules in Figure 5 is an example. The names of the modules shown in Figure 5 are illustrative examples.
[0111] The application layer includes a series of application packages. These include applications such as camera, gallery, calendar, call, map, navigation, Bluetooth, music, video, and short messaging. Applications can include both system applications and third-party applications. Figure 5 shows an example of system applications including desktop applications and wallpaper applications.
[0112] The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer can include some predefined functions. Referring to Figure 5 , the application framework layer can include: a system service module, a window manager service (WMS), a drawing module, a rendering module, and a surface flinger (SF) compositor.
[0113] Among them, the system service module can provide monitoring services for applications, such as monitoring changes in the physical state of the foldable display, and can generate a first animation during the change of the physical state of the foldable display to achieve a dynamic change effect of the wallpaper. The wallpaper setting service module is used to determine the change information of the wallpaper during the change of the physical state of the foldable display, and provide the information to the system service module. The window management service is used to manage the user interface. The drawing module is used to draw the user interface. The rendering module is used to render the user interface drawn by the drawing module. The layer synthesizer is used to synthesize the rendered layers to obtain the user interface to be displayed.
[0114] Because the Android runtime and system library, as well as the kernel layer are regarded as one layer in the embodiment of the present application, the system layer may include the Android runtime and system library, as well as the functional modules in the kernel layer. Referring to Figure 5, the system layer may include multiple functional modules, such as: a state monitoring service, a surface manager, a media library, a three-dimensional graphics processing library (for example: OpenGL ES), a 2D graphics engine (for example: SGL), etc. Among them, the state monitoring service is used to determine the orientation of the electronic device, the physical state of the foldable display, etc. based on the monitoring data reported by the kernel layer. It should be understood that Figure 5 is illustrated by taking the system layer including the state monitoring service as an example. Among them, the system layer also includes: a hinge detection module, which is used to obtain the angle of the hinge and report it to the state monitoring service, so that the state monitoring service determines the physical state and the unfolding angle of the foldable display based on the angle of the hinge.
[0115] In addition, the system layer also includes hardware drivers for driving hardware operations. For example, the driver layer includes: sensor drivers, display drivers (display drivers), graphics processing unit drivers (GPU drivers), etc., which are not limited in this embodiment of the present application. It should be understood that Figure 5 shows the display driver involved in the embodiment of the present application. The display driver is used to drive the foldable display screen to display the user interface.
[0116] The hardware layer includes the hardware in the electronic device. It should be understood that the hardware layer in FIG5 shows the hinge and display screen involved in the following embodiments for supporting the opening and closing of the foldable display screen.
[0117] The display method of the electronic device provided by the embodiment of the present application is described below with reference to the accompanying drawings. The following embodiments can be combined with each other, and the same or similar concepts or processes may not be described in detail in some embodiments.
[0118] Refer to Figure 6a, which is a flow chart of a display method for an electronic device with a foldable display provided by an embodiment of the present application. As shown in the figure, the flow may include the following steps:
[0119] S61: When the foldable display screen of the electronic device is in a first physical state, the foldable display screen displays a first area of a first wallpaper.
[0120] Optionally, the first wallpaper can be a full-screen wallpaper, i.e., the screen background displayed by the foldable display in the unfolded state. When the foldable display is in the unfolded state, the size of the full-screen wallpaper is equivalent to the size of the screen display area in the unfolded state, and the size of the screen display area is equivalent to the size of the screen in the unfolded state. The size of the first wallpaper can also be larger than the size of the full-screen wallpaper.
[0121] Taking the foldable display as an outward-folding screen or an inward-folding screen as an example, the first physical state of the foldable display may be one of the following states:
[0122] - expanded state; for example, as shown in Figure a of Figure 1A, or as shown in Figure a of Figure 1B;
[0123] - folded state; for example, as shown in Figure d in Figure 1A, or as shown in Figure d in Figure 1B;
[0124] -Intermediate state; for example, as shown in Figure b or Figure c in Figure 1A, or as shown in Figure b or Figure c in Figure 1B.
[0125] For example, if the first wallpaper is a full-screen wallpaper, when the foldable display is in the unfolded state, the first area of the global wallpaper is the entire area of the full-screen wallpaper. In other words, in a user interface displayed on the unfolded foldable display, the wallpaper of that user interface is the entire area of the full-screen wallpaper.
[0126] Taking the foldable display shown in FIG1A as an example, FIG7 a shows a schematic diagram of the wallpaper in the user interface displayed on the screen in the expanded state. In the expanded state, the wallpaper of the user interface is the entire area 701 of the full-screen wallpaper. FIG7 b shows a schematic diagram of the wallpaper in the user interface displayed on the screen in the intermediate state. In the intermediate state, the wallpaper of the user interface is a local area 702 at a certain position of the full-screen wallpaper. FIG7 c shows a schematic diagram of the wallpaper in the user interface displayed on the screen in the folded state. In the folded state, the wallpaper of the user interface is a local area 703 at a specified position of the full-screen wallpaper. Optionally, the user interface can be a main interface (launcher interface) or a lock screen interface, etc. In addition to the wallpaper, the user interface may also include other interface elements, such as text, pictures, desktop widgets (such as desktop widgets for displaying time or schedule), etc., and may also include a media operation window (for performing simple control operations on the media being played).
[0127] According to FIG7 above, it can be seen that when the physical state of the foldable display screen is the folded state, the first area of the full-screen wallpaper is a local area of the full-screen wallpaper, and the size of the local area is comparable to the size of the screen display area in the folded state. In other words, in the user interface displayed by the folding display screen in the folded state, the wallpaper of the user interface is a local area of the full-screen wallpaper, and the size of the local area is comparable to the size of the screen display area in the folded state, or comparable to the size of the main screen display area. Optionally, the local wallpaper displayed in the folded state can be any local area in the full-screen wallpaper that is comparable in size to the screen display area in the folded state (such as the display area of the main screen in the foldable display screen), such as the local area on the right side of the full-screen wallpaper, or the local area on the left side, or the local area in the middle part (as shown in FIG7 c). Optionally, the position of the wallpaper displayed in the folded state in the full-screen wallpaper can be pre-set.
[0128] When the physical state of the foldable display is an intermediate state, the first area of the full-screen wallpaper is a local area of the full-screen wallpaper (as shown in Figure b in Figure 7), and the size of the local area is comparable to the size of the screen display area in the intermediate state. In other words, in the user interface displayed by the foldable display in the intermediate state, the wallpaper of the user interface is a local area of the full-screen wallpaper, and the size of the local area is comparable to the size of the screen display area in the intermediate state, for example, it may be equal to the size of the main screen display area, or it may be larger than the size of the main screen display area. Optionally, the local wallpaper displayed in the intermediate state may be a local area in the full-screen wallpaper that is comparable in size to the screen display area in the intermediate state (such as the display area of the main screen in the foldable display), and the position of the local area in the full-screen wallpaper is related to the position of the wallpaper displayed in the folded state in the full-screen wallpaper, and the unfolding angle of the foldable display in the intermediate state.
[0129] S62: Play a first animation while the foldable display screen changes from the first physical state to the second physical state.
[0130] The second physical state of the foldable display may be one of the following states: unfolded state, folded state, intermediate state. Taking the foldable display as an external folding screen or an internal folding screen as an example, when the first physical state is the folded state, the second physical state is the intermediate state or the unfolded state, and accordingly, the process of changing from the first physical state to the second physical state is the unfolding process of the foldable display; when the first physical state is the unfolded state, the second physical state is the intermediate state or the folded state, and accordingly, the process of changing from the first physical state to the second physical state is the folding process of the foldable display; when the first physical state is a certain intermediate state (the first intermediate state), the second physical state is the unfolded state or the folded state or another intermediate state (the second intermediate state). Among them, the unfolding angles of the foldable display in the first intermediate state and the second intermediate state are different. When the unfolding angle of the first intermediate state is less than the unfolding angle of the second intermediate state, the process of changing from the first physical state to the second physical state is the unfolding process of the foldable display, and vice versa.
[0131] In one possible implementation of an embodiment of the present application, the electronic device may generate a first animation in response to a change in a foldable display from a first physical state to a second physical state. In this way, each animation frame in the first animation is related to the change in the physical state of the foldable display, so that the first animation can match the current change in the physical state of the foldable display.
[0132] The first animation includes multiple animation frames arranged in chronological order, each animation frame being a user interface, wherein the user interface includes wallpaper and, optionally, may further include one or more interface elements (e.g., desktop icons, desktop widgets, text, images, etc.). The multiple animation frames are displayed one by one in chronological order to achieve an animated display effect of the user interface.
[0133] In the embodiment of the present application, the first animation frame in the first animation is the user interface displayed in the first physical state, and the wallpaper in the user interface is the first area of the first wallpaper. The last animation frame is the user interface displayed in the second physical state, and the wallpaper in the user interface is the fourth area of the first wallpaper. Accordingly, as the foldable display changes from the first physical state to the second physical state, the wallpaper displayed on the screen gradually changes from the first area of the first wallpaper to the fourth area of the first wallpaper.
[0134] For example, with reference to FIG7 , during the unfolding process of the foldable display screen, the wallpapers in the first animation frame and the last animation frame in the first animation may include the following situations:
[0135] Scenario 1: When the first physical state changes from the folded state to the expanded state, the wallpaper of the first animation frame in the first animation is shown as wallpaper area 703 in Figure 7c (i.e., the first area of the first wallpaper), and the wallpaper of the last animation frame in the first animation is shown as wallpaper area 701 in Figure 7a (i.e., the fourth area of the first wallpaper);
[0136] Scenario 2: When the first physical state changes from the folded state to the intermediate state, the wallpaper of the first animation frame in the first animation is wallpaper area 703 (i.e., the first area of the first wallpaper) as shown in FIG. 7 c, and the wallpaper of the last animation frame is wallpaper area 702 (i.e., the fourth area of the first wallpaper) as shown in FIG. 7 b;
[0137] Scenario 3: When the first physical state changes from the intermediate state to the expanded state, the wallpaper of the first animation frame in the first animation is shown as wallpaper area 702 in FIG. 7 b (i.e., the first area of the first wallpaper), and the last animation frame is shown as wallpaper area 701 in FIG. 7 a (i.e., the fourth area of the first wallpaper);
[0138] Scenario 4: When the first physical state changes from the expanded state to the folded state, the wallpaper of the first animation frame in the first animation is shown as wallpaper area 701 in FIG. 7 a (i.e., the first area of the first wallpaper), and the last animation frame is shown as wallpaper area 703 in FIG. 7 c (i.e., the fourth area of the first wallpaper);
[0139] Scenario 5: When the first physical state changes from the expanded state to the intermediate state (i.e., the first area of the first wallpaper), the wallpaper of the first animation frame in the first animation is shown as wallpaper area 701 in Figure 7a, and the last animation frame is shown as wallpaper area 702 in Figure 7b (i.e., the fourth area of the first wallpaper);
[0140] Case 6: When the first physical state changes from the intermediate state to the folded state, the wallpaper of the first animation frame in the first animation is shown as wallpaper area 702 in Figure 7b (i.e., the fourth area of the first wallpaper), and the last animation frame is shown as wallpaper area 703 in Figure 7c (i.e., the fourth area of the first wallpaper);
[0141] Case 7: When the first physical state changes from the first intermediate state to the second physical state, the wallpaper of the first animation frame in the first animation is a local area of the first wallpaper (i.e., the fourth area of the first wallpaper), and the wallpaper of the last animation frame is another local area of the first wallpaper (i.e., the fourth area of the first wallpaper).
[0142] Optionally, for any two animation frames in the first animation, such as the first frame and the second frame (the first frame and the second frame may be adjacent animation frames or non-adjacent animation frames), the wallpaper in the first frame is the second area of the first wallpaper, and the wallpaper in the second frame is the third area of the first wallpaper, and the sizes of the second area and the third area and the positions in the first wallpaper are related to the unfolding angle of the foldable display. Optionally, the greater the unfolding angle of the foldable display, the larger the screen display area, and accordingly, the larger the size of the wallpaper in the user interface displayed on the screen.
[0143] Taking the unfolding process of the above-mentioned scenario 1 (i.e., changing from the first physical state of the folded state to the second physical state of the unfolded state) as an example, FIG8 shows the principle and effect of the dynamic display of the wallpaper during the unfolding process of the foldable display screen, wherein the schematic diagrams in the left column of FIG8 are the position and size of the wallpaper in each animation frame relative to the full-screen wallpaper, and the schematic diagrams in the right column are the screen display effects corresponding to each animation frame. As shown in FIG8 , the first animation includes n animation frames in chronological order: animation frame 1, animation frame 2, animation frame 3, ..., animation frame n-2, animation frame n-1, animation frame n. If the position of the wallpaper boundary displayed on the right side of the main screen in the full-screen wallpaper is used to represent the position of the wallpaper in the animation frame relative to the full-screen wallpaper, then:
[0144] Animation frame 1: The screen display area where this frame is located only includes the first screen portion (main screen) display area. The right edge of the wallpaper in animation frame 1 is located at designated position 1 in the full-screen wallpaper. That is, the wallpaper in animation frame 1 is area 1 in the full-screen wallpaper (such as the diagonal filled area in the figure);
[0145] Animation Frame 2: The screen display area where this frame is located includes the first screen portion (main screen) and a small portion of the second screen portion (auxiliary screen). The right edge of the wallpaper in Animation Frame 2 is located at Position 2 in the full-screen wallpaper. That is, the wallpaper in Animation Frame 2 is Area 2 in the full-screen wallpaper (such as the diagonal filled area in the figure); Position 2 is to the right of Position 1, and the size of Area 2 is larger than that of Area 1.
[0146] Animation Frame 3: The screen display area where this frame is located includes the first screen portion (main screen) display area and a small portion of the second screen portion (auxiliary screen). The right edge of the wallpaper in Animation Frame 3 is located at Position 3 in the full-screen wallpaper. That is, the wallpaper in Animation Frame 3 is Area 3 in the full-screen wallpaper (such as the diagonal filled area in the figure); Position 3 is to the right of Position 2, and the size of Area 3 is larger than that of Area 2.
[0147] Similarly, animation frame n-1: the screen display area where this frame is located includes the display area of the first screen part (main screen) and a large part of the second screen part (auxiliary screen). The right edge of the wallpaper in animation frame n-1 is located at position n-1 in the full-screen wallpaper, that is, the wallpaper in animation frame n-1 is area n-1 in the full-screen wallpaper (such as the diagonal filled area in the figure); among which, position n-1 is to the right of position n-2, and the size of area n-1 is larger than the size of area n-2;
[0148] Animation frame n: The screen display area where this frame is located includes the first screen part and the second screen part. The right edge of the wallpaper in animation frame n is aligned with the right edge of the full-screen wallpaper, that is, the wallpaper in animation frame n is the entire area of the full-screen wallpaper (such as the diagonal filled area in the figure).
[0149] Optionally, the sizes of two adjacent animation frames may be the same, and accordingly, the sizes of the wallpapers in these two animation frames are also the same. For example, when the unfolding angle of the foldable display increases by a set increment (e.g., each increase of 1 degree), the screen display size increases by a corresponding size. If the change in the unfolding angle within the time interval between two adjacent animation frames does not reach the set increment, then the sizes of the two adjacent animation frames are the same.
[0150] In the screen display effect shown in the schematic diagram on the right side of Figure 8, the black filled area is the area blocked by the mask. According to the wallpaper dynamic display principle shown in the schematic diagram on the left side, combined with the screen display effect shown in the schematic diagram on the right side, from the user's visual perspective, as the foldable display gradually unfolds, the wallpaper displayed on the screen gradually moves to the left (that is, the right part of the full-screen wallpaper gradually enters the main screen, that is, enters the user's field of view), and the size of the wallpaper gradually increases until, after full unfolding, the rightmost edge of the full-screen wallpaper coincides with the right edge of the display area of the first screen portion, and the size of the wallpaper is the size of the full-screen wallpaper, thereby realizing the dynamic display effect of the wallpaper during the unfolding of the foldable display, thereby improving the user experience.
[0151] In the folding manner shown in Figure 1A, in the folded state, the wallpaper displayed on the main screen of the foldable display is located at the rightmost part of the full-screen wallpaper (that is, the right side of the displayed wallpaper coincides with the right side of the full-screen wallpaper). During the expansion process, in each animation frame in the first animation, the position of the wallpaper remains unchanged (that is, the right side of the wallpaper in the animation frame always coincides with the right side of the full-screen wallpaper). However, as the expansion angle gradually increases, the screen display area gradually increases, and the left side of the full-screen wallpaper gradually appears, until it is fully expanded, and the entire area of the full-screen wallpaper is all presented in the screen display area, realizing the dynamic display effect of the wallpaper during the expansion of the foldable display.
[0152] Taking the folding process of scenario 4 above (i.e., changing from the first physical state, the expanded state, to the second physical state, the folded state) as an example, Figure 9 illustrates the principle and effect of the dynamic wallpaper display during the folding process of the foldable display. The left column of schematic diagrams in Figure 9 shows the position and size of the wallpaper in each animation frame relative to the full-screen wallpaper, and the right column of schematic diagrams shows the screen display effect corresponding to each animation frame. As shown in Figure 9, the first animation includes n animation frames in chronological order: animation frame 1, animation frame 2, animation frame 3, ..., animation frame n-2, animation frame n-1, animation frame n. During this folding process, the position and size changes of the wallpaper in each animation frame of the first animation are opposite to those of the unfolding process shown in Figure 8. That is, the wallpaper position gradually moves until it reaches the wallpaper position displayed on the main screen in the folded state, and the wallpaper size gradually decreases from the full-screen size to the small-screen size in the folded state.
[0153] In the screen display effect shown in the right column of schematic diagrams in Figure 9, the black filled area is the area blocked by the mask. According to the wallpaper dynamic display principle shown in the left column of schematic diagrams, combined with the screen display effect shown in the right column of schematic diagrams, from the user's visual perspective, as the foldable display gradually folds, the wallpaper displayed on the screen gradually moves to the right (that is, the right part of the full-screen wallpaper gradually exits the main screen, that is, exits the user's field of view), and the size of the wallpaper gradually becomes smaller, until after it is completely folded, the first screen part displays the local area at the specified position in the full-screen wallpaper, thereby realizing the dynamic display effect of the wallpaper during the folding process of the foldable display, thereby improving the user experience.
[0154] In the folding method shown in Figure 1A, in the folded state, the wallpaper displayed on the main screen of the foldable display is located at the rightmost part of the full-screen wallpaper (that is, the right side of the displayed wallpaper coincides with the right side of the full-screen wallpaper). During the folding process, in each animation frame in the first animation, the position of the wallpaper remains unchanged (that is, the right side of the wallpaper in the animation frame always coincides with the right side of the full-screen wallpaper). However, as the unfolding angle gradually decreases, the screen display area gradually decreases, and the left side of the full-screen wallpaper is gradually blocked by the mask. Until it is completely folded, only the rightmost area of the full-screen wallpaper is presented in the screen display area, thereby realizing the dynamic display effect of the wallpaper during the unfolding process of the foldable display.
[0155] According to the same principle, when the first physical state and the second physical state are other states, a similar dynamic wallpaper display effect can also be achieved in the process of changing from the first physical state to the second physical state.
[0156] The above description is based on the folding method shown in FIG1A as an example. Based on the same principle, in other folding methods, such as the folding method shown in FIG1B or FIG1C , the dynamic display effect of the wallpaper can also be achieved.
[0157] S63: When the foldable display screen is in the second physical state, the foldable display screen displays a fourth area of the full-screen wallpaper, where the fourth area of the full-screen wallpaper is the wallpaper in the last animation frame of the first animation.
[0158] Since the first frame in the first animation frame corresponds to the first physical state, it is the user interface displayed in the first physical state (i.e., the starting state of the change), and the last frame corresponds to the second physical state, it is the user interface displayed in the second physical state (i.e., the ending state of the change), and the position and size of the wallpaper gradually change from the first frame to the last frame. Therefore, from the user's visual perspective, the change process is smooth and coherent, which can bring a good user experience to the user.
[0159] It will be appreciated that in the process shown in Figure 6a, the operation of generating the first animation can be implemented in the application framework layer of the electronic device software architecture, for example, by the system service module in the application framework layer. Implementing the wallpaper animation effect in the application framework layer, rather than by the application, eliminates the need for additional application adaptation work in the application layer and is beneficial to its promotion and use.
[0160] In the process shown in Figure 6a above, the first animation is played during the process of the foldable display screen of the electronic device changing from the first physical state to the second physical state, so that the animation can be displayed when the physical state of the screen changes. For any two animation frames (first frame and second frame) in the first animation, the wallpaper in the first frame is the second area of the first wallpaper (such as full-screen wallpaper), and the wallpaper in the second frame is the third area of the first wallpaper. The size of the second area and the third area and the position in the first wallpaper are related to the expansion angle of the foldable display screen. Therefore, as the expansion angle of the foldable display screen gradually changes, the size of the wallpaper displayed on the screen and its position in the full-screen wallpaper also change, thereby achieving a dynamic change effect of the wallpaper during the change of the physical state of the foldable display screen.
[0161] In a possible implementation, the process of generating the first animation in step 62 in FIG. 6 a can refer to the process shown in FIG. 6 b .
[0162] Optionally, as shown in FIG6b , the process of generating the first animation may include:
[0163] S621: Determine wallpaper position change information based on the first position and the second position, wherein the first position is the position of the wallpaper displayed on the first screen portion (e.g., the main screen) of the foldable display screen in the first physical state within the first wallpaper, and the second position is the position of the wallpaper displayed on the first screen portion (e.g., the main screen) in the second physical state within the first wallpaper.
[0164] The wallpaper position change information may include: a displacement size and a displacement direction from a first position to a second position.
[0165] Taking the expansion process shown in Figure 8 as an example, the first position is the position of the right border of the wallpaper displayed on the main screen in the folded state in the full-screen wallpaper, and the second position is the position of the right border of the wallpaper displayed on the main screen in the expanded state in the full-screen wallpaper. Based on the first position and the second position, it can be determined that the displacement direction is to the right, and the total displacement size is the distance between "position 1" and "position n" in Figure 8.
[0166] Taking the folding process shown in Figure 9 as an example, the first position is the position of the right border of the wallpaper displayed on the main screen in the expanded state in the full-screen wallpaper, and the second position is the position of the right border of the wallpaper displayed on the main screen in the folded state in the full-screen wallpaper. Based on the first position and the second position, it can be determined that the displacement direction is to the left, and the total displacement size is the distance between "position 1" and "position n" in Figure 9.
[0167] S622: Generate a first animation according to the wallpaper position change information, the unfolding angle of the foldable display screen, and the motion effect parameters of the first animation.
[0168] Optionally, the animation parameters include but are not limited to parameters such as playback duration, animation curve, and animation mode. Among them, playback duration can be understood as: the duration used to play the animation corresponding to the entire unfolding process from the unfolded state to the folded state, or the duration used to play the animation corresponding to the entire folding process from the folded state to the unfolded state. The animation curve represents the dynamic display effect of the animation. Exemplarily, the animation curve can be a straight line, such as the displacement of the same element on two adjacent animation frames in the animation is the same; or, the animation curve can be a curve (such as a parabola), such as the displacement of the same element on two adjacent animation frames in the first animation is different. For example, the displacement of the same content on the first two adjacent animation frames is small, and as the number of frames increases, the displacement of the same content on the two adjacent animation frames gradually increases, and the displacement of the same content on the last few adjacent animation frames gradually becomes smaller. The animation mode may include a transparency change mode. Exemplarily, the animation mode may include fade in and fade out, etc.
[0169] The number of frames of the first animation is related to the change in the unfolding angle of the foldable display. The electronic device can determine the playback duration of the first animation based on the animation effect parameters including the playback duration and the degree of state change (the degree of state change represents the degree of change in the unfolding angle of the foldable display).
[0170] In one possible implementation method of determining the playback duration of the first animation, when the second physical state is a folded state or an expanded state, regardless of whether the first physical state is an intermediate state or a non-intermediate state (such as a folded state or an expanded state), the playback duration of the first animation is equal to the playback duration included in the animation parameters.
[0171] In another possible implementation method of determining the playback duration of the first animation, when the second physical state is a folded state or an unfolded state, when the first physical state is an intermediate state, because the unfolding angle of the foldable display screen does not change by 180°, but is less than 180°, in order to adapt to the change in the unfolding angle of the foldable display screen, the playback duration of the first animation can be adaptively reduced. Exemplarily, the electronic device can first obtain the angle difference of the unfolding angle from the first physical state (such as the folded state or the unfolded state) to the intermediate state, determine the ratio of the angle difference to the maximum span, and then multiply the playback duration in the motion effect parameter by the ratio to obtain the playback duration of the first animation. The maximum span refers to the change in the degree of expansion of the foldable display screen from the folded state to the unfolded state, or the change in the unfolding angle of the foldable display screen from the unfolded state to the folded state, and the maximum span is usually 180 degrees.
[0172] In another possible implementation method of determining the playback duration of the first animation, when the first physical state and the second physical state are both intermediate states, the electronic device can first obtain the angle difference between the expansion angles from the first physical state (such as the first intermediate state) to the second physical state (such as the second intermediate state), determine the ratio of the angle difference to the maximum expansion, and then multiply the playback duration in the motion effect parameters by the ratio to obtain the playback duration of the first animation.
[0173] After obtaining the playback duration of the first animation, the electronic device can determine the number of frames of the first animation based on the playback duration of the first animation and the refresh rate of the electronic device. It can be understood that the refresh rate of an electronic device is related to the number of frames that the electronic device can display in a unit time. For example, if the refresh rate of the electronic device is 60Hz, the electronic device can display one frame every 16.67ms. For example, the number of frames of the first animation is equal to the quotient obtained by dividing the playback duration of the first animation by the refresh rate of the electronic device. Furthermore, the quotient can be rounded, and the rounded value is the number of frames of the first animation. For example, if the refresh rate of the electronic device is 60Hz and the playback duration of the first animation is 500ms, the number of frames of the first animation is 29.
[0174] Optionally, after obtaining the playback duration and number of frames of the first animation, in S622, the electronic device generates a possible implementation of the first animation based on the wallpaper position change information, the unfolding angle of the foldable display, and the motion effect parameters of the first animation, as shown in FIG6c, including:
[0175] S6221: Determine a wallpaper size in each animation frame of the first animation according to an unfolding angle of the foldable display screen during a process of changing from the first physical state to the second physical state.
[0176] The wallpaper size of the animation frame in the first animation is related to the unfolding angle of the foldable display. In one possible implementation, a correspondence between various unfolding angles and the size of the screen display area can be pre-set. The electronic device can query this correspondence based on the unfolding angle of the foldable display to obtain the corresponding screen display area size, which is the wallpaper size.
[0177] In another possible implementation, the electronic device can multiply the size of the screen display area in the expanded state by a ratio value related to the current expansion angle to obtain the size of the screen display area at the current expansion angle, and the screen display area size is also the wallpaper size in the animation frame at the current expansion angle. The ratio value is the ratio of the current expansion angle to the expansion angle (180 degrees) in the expanded state. For example, the relationship between the expansion angle and the screen display area size may include (where S is the size of the screen display area in the expanded state):
[0178] Expand angle 180 degrees, S*100%;
[0179] Deployment angle 150 degrees, S*92%;
[0180] The expansion angle is 120 degrees, S*84%;
[0181] The expansion angle is 90 degrees, S*75%;
[0182] Deployment angle 60 degrees, S*67%;
[0183] Deployment angle 30 degrees, S*59%;
[0184] The expansion angle is 0 degrees, S*50%.
[0185] S6222: Determine the position of the wallpaper in each animation frame in the first animation in the first wallpaper according to the wallpaper position change information and the motion effect parameters of the first animation.
[0186] After obtaining the number of frames of the first animation, the electronic device can determine the position of the wallpaper in each animation frame in the first animation relative to the first wallpaper based on the number of frames of the first animation, the motion curve, and the wallpaper position change information obtained in S621. For example, when the motion curve is a straight line, the electronic device divides the displacement from the first position to the second position determined in S621 by the number of frames of the first animation to obtain the position of the wallpaper in each animation frame relative to the first wallpaper, wherein the position difference of the wallpaper in two adjacent animation frames relative to the first wallpaper is equal; for another example, when the motion curve is a curve, in chronological order, the position difference of the wallpaper in two adjacent animation frames relative to the first wallpaper may gradually increase or decrease, or first gradually increase and then gradually decrease, or conform to other change rules, which depends on the type of motion curve (such as parabola or other curve types).
[0187] S6223: Determine an area of the wallpaper in each animation frame in the first wallpaper according to the size of each animation frame in the first animation and the position of the wallpaper in each animation frame in the first wallpaper.
[0188] For example, during the unfolding process of the foldable display, the position of the wallpaper in each animation frame in the first animation relative to the full-screen wallpaper and the size of the wallpaper can be seen in Figure 8; during the folding process of the foldable display, the position of the wallpaper in each animation frame in the first animation relative to the full-screen wallpaper and the size of the wallpaper can be seen in Figure 9.
[0189] Taking the motion effect curve as a straight line as an example, from the folded state to the unfolded state, the total displacement of the wallpaper position d = the distance between position 1 and position n, and the wallpaper displacement Δ corresponding to each animation frame = total displacement d / number of frames n of the first animation. In the process from the folded state to the unfolded state, when the unfolding angle reaches 30 degrees, if the current animation frame is the i-th frame, the wallpaper displacement corresponding to the i-th frame can be calculated according to the above method. In addition, the current wallpaper size can be determined as S*59% through the above correspondence. In this way, when the unfolding angle reaches 30 degrees, the position of the wallpaper on the display screen relative to the full-screen wallpaper and the size of the wallpaper can be determined. In other words, at this unfolding angle, which part of the display screen needs to display the entire wallpaper can be determined.
[0190] S6224: Generate a first animation according to the area of the wallpaper in each animation frame in the first wallpaper.
[0191] In one possible implementation, when generating the first animation, the electronic device may not need to repeatedly draw the wallpaper in each animation frame. Instead, the electronic device may change the position and size of the mask in the display plane (surface) where the first wallpaper is located according to the area of the wallpaper in each animation frame in the first animation. Correspondingly, the visible area in the display plane also changes. The visible area is the wallpaper in the animation frame, so that the wallpaper in each animation frame can be obtained. In this way, on the one hand, the visual effect of moving wallpaper can be achieved by changing the position of the mask in the display plane (surface) where the first wallpaper is located. On the other hand, the processing delay of the animation frame can be shortened, the processing overhead can be reduced, and the generation efficiency can be improved. Among them, in the display plane (surface) where the first wallpaper is located, the part that is not blocked by the "mask" is the visible part, and the part blocked by the mask is usually invisible. The operation of repeatedly drawing the wallpaper for each animation frame can be saved, thereby reducing system overhead.
[0192] For example, taking the unfolding process of the foldable display shown in Figure 8 and the folding process shown in Figure 9 as examples, the size of the display plane (surface) where the full-screen wallpaper is located is the same as the size of the full-screen wallpaper. In the display plane (surface) where the full-screen wallpaper corresponding to each animation frame is located, the white filled area is the area where the mask is located.
[0193] In one possible implementation, the electronic device, in the process of generating the first animation, can determine the transparency of the wallpaper in each animation frame of the first animation based on the number of frames of the first animation and the motion curve. For example, if the motion curve is a straight line, the difference in transparency of the wallpaper in two adjacent animation frames is equal. For example, in the process of unfolding the foldable display from the folded state to the unfolded state, the electronic device can process the wallpaper in the animation frame so that the transparency gradually increases and then gradually decreases, so as to achieve the effect of the wallpaper gradually becoming blurred and gradually becoming clear.
[0194] In a possible implementation, if the user interface includes other interface elements in addition to the wallpaper, the electronic device further determines the positions and / or sizes of these elements in each animation frame and includes these elements in the generated animation frame.
[0195] In one possible implementation, after obtaining the position and / or size of elements in each animation frame of the first animation, the electronic device may synthesize the elements into a single animation frame through layer synthesis to obtain each animation frame. For example, for a single animation frame, the layer synthesis module may synthesize the rendered elements in the animation frame through layer synthesis to obtain the animation frame. Following the same processing method, multiple consecutive animation frames may be obtained, thereby generating the first animation.
[0196] In one possible implementation, the system sets the motion parameters used to generate the first animation. These parameters serve as the system's default motion parameters and are used to generate the first animation when the foldable display changes from a first physical state to a second physical state. During the unfolding or folding process of the foldable display, the system service module in the electronic device can generate the first animation based on the system's default motion parameters. The system sets the motion parameters, enabling consistent dynamic display effects across different applications.
[0197] In one possible implementation, the motion effect parameters used to generate the first animation are provided by an application (such as a third-party application), so that the application can control the dynamic effects of the first animation through the motion effect parameters. For example, after the desktop launcher is started, the system service module is notified to turn off the system default motion effect function, and the wallpaper's motion effect parameters (such as motion effect time, motion effect curve, mask parameters, etc.) are notified to the system service module, so that the system service module can generate the first animation according to the motion effect parameters set by the application during the process of the foldable display changing from the first physical state to the second physical state. The motion effect parameters are set by the application, so that different applications can set the motion effect parameters as needed, thereby improving flexibility.
[0198] In one possible implementation, the wallpaper displayed on the foldable display is a dynamic wallpaper. The dynamic wallpaper includes a wallpaper frame sequence, which includes at least two wallpaper animation frames. The wallpaper animation frames in the wallpaper frame sequence are displayed sequentially at a set frame rate to produce an animation effect. Optionally, the wallpaper animation frames in the wallpaper frame sequence are of the same size. Optionally, the size of the wallpaper animation frames in the wallpaper frame sequence is the screen display size of the foldable display when it is unfolded.
[0199] When using dynamic wallpaper, the position of the wallpaper in each animation frame in the first animation relative to the full-screen wallpaper and the size of the wallpaper can be determined according to the method in the aforementioned embodiment. In addition, it is also necessary to determine the correspondence between the wallpaper in each animation frame in the first animation and the wallpaper animation frame in the wallpaper frame sequence, that is, it is necessary to determine which wallpaper animation frame in the wallpaper frame sequence is used in each animation frame in the first animation.
[0200] Exemplarily, in the process of generating the first animation, in addition to determining the wallpaper position change information in the manner of the aforementioned embodiment, it is also necessary to determine the correspondence between the wallpaper in each animation frame in the first animation and the wallpaper animation frames in the wallpaper frame sequence. When generating the first animation, it is necessary to generate the first animation based on the wallpaper position change information, the unfolding angle of the foldable display, the motion effect parameters of the first animation, and the correspondence between each animation frame in the first animation and the wallpaper animation frames in the wallpaper sequence.
[0201] Optionally, the correspondence between the wallpaper in each animation frame in the first animation and the wallpaper animation frames in the wallpaper sequence is as follows: the animation frames in the first animation correspond one-to-one to the wallpaper animation frames in the wallpaper frame sequence, and the wallpaper of the first animation frame in the first animation is the mth frame (m is an integer greater than or equal to 1) in the wallpaper frame sequence, and the mth frame is the wallpaper displayed when the foldable display is in the first physical state. In other words, the wallpaper of the first animation frame in the first animation is the mth frame in the wallpaper frame sequence, and the kth animation frame after the first animation frame in the first animation is the m+(k-1)th frame in the wallpaper frame sequence.
[0202] Optionally, if the wallpaper of the kth animation frame in the first animation is the last wallpaper animation frame in the wallpaper frame sequence, then the wallpaper of the k+1th animation frame in the first animation is the first wallpaper animation frame in the wallpaper frame sequence. In other words, if the wallpaper of a certain animation frame in the first animation is already the last wallpaper animation frame in the wallpaper frame sequence, then the wallpaper of the next animation frame in the first animation will use the first wallpaper animation in the wallpaper frame sequence, and so on.
[0203] The following example illustrates the correspondence between the animation frames in the first animation and the wallpaper animation frames in the wallpaper frame sequence during the physical state change of the foldable display when using dynamic wallpaper. In this example, the dynamic wallpaper's wallpaper frame sequence includes 5 wallpaper animation frames, the first animation includes 10 animation frames, and the wallpaper displayed on the foldable display in the first physical state is the second wallpaper animation frame. The correspondence between the animation frames in the first animation and the wallpaper animation frames in the wallpaper frame sequence is as follows:
[0204] The first animation frame in the first animation uses the second wallpaper animation frame in the wallpaper frame sequence;
[0205] The second animation frame in the first animation uses the third wallpaper animation frame in the wallpaper frame sequence;
[0206] The third animation frame in the first animation uses the fourth wallpaper animation frame in the wallpaper frame sequence;
[0207] The 4th animation frame in the first animation uses the 5th wallpaper animation frame in the wallpaper frame sequence;
[0208] The fifth animation frame in the first animation uses the first wallpaper animation frame in the wallpaper frame sequence;
[0209] The 6th animation frame in the first animation uses the 2nd wallpaper animation frame in the wallpaper frame sequence;
[0210] The 7th animation frame in the first animation uses the 3rd wallpaper animation frame in the wallpaper frame sequence;
[0211] The 8th animation frame in the first animation uses the 4th wallpaper animation frame in the wallpaper frame sequence;
[0212] The 9th animation frame in the first animation uses the 5th wallpaper animation frame in the wallpaper frame sequence;
[0213] The 10th animation frame in the first animation uses the 1st wallpaper animation frame in the wallpaper frame sequence.
[0214] According to the above description, when using dynamic wallpaper, the above embodiments of the present application can also achieve a dynamic display effect of the wallpaper during the process of the physical state of the foldable display changing, thereby improving the user experience.
[0215] The following describes the display process provided in the embodiment of the present application based on the process shown in FIG6 a and in combination with the system architecture shown in FIG5 .
[0216] 10 is a flowchart of a display method for a foldable display screen during a physical state change process provided by an embodiment of the present application. As shown in the figure, the flowchart may include the following steps:
[0217] Step 1: In response to a first operation, the physical state of the foldable display changes.
[0218] The first operation is used to trigger the foldable display to unfold or fold, that is, to trigger the foldable display to change from a first physical state to a second physical state. Exemplarily, the first operation can be one of the following operations:
[0219] -The user manually expands or folds the screen;
[0220] -The user operates a control on the interface or a physical button on the electronic device to trigger the screen to expand or fold.
[0221] -User voice instructions, such as the user saying "unfold the screen", to trigger the screen unfolding by voice.
[0222] Step 2: During the change of the physical state of the foldable display, the angle detection module detects the unfolding angle of the foldable display.
[0223] Optionally, the unfolding angle of the foldable display can be obtained by detecting the angle of the hinge. For example, the hinge detection module collects the angle of the hinge, and the hinge movement (such as the opening and closing of the hinge) will cause the opening and closing state of the foldable display to change, that is, the physical state of the foldable display to change. Therefore, in the process of the foldable display changing from the first physical state to the second physical state, the hinge detection module can collect the angle of the hinge to facilitate monitoring the physical state of the foldable display. It should be understood that the angle of the hinge can represent the unfolding angle of the foldable display.
[0224] Step 3: The angle monitoring module sends the detected deployment angle to the status monitoring service.
[0225] Step 4: The status monitoring service obtains the physical status of the foldable display and the physical status change information of the foldable display based on the unfolding angle.
[0226] When the foldable display changes from a first physical state to a second physical state, the state monitoring service determines the second physical state of the foldable display based on the angle detected by the angle detection module. For example, when the angle is 0°, the second physical state of the foldable display can be determined to be a folded state; when the angle is 180°, the second physical state of the foldable display can be determined to be an unfolded state; and when the angle is greater than 0° and less than 180°, the second physical state of the foldable display can be determined to be an intermediate state.
[0227] It is conceivable that when the foldable display changes from other physical states to the first physical state, based on the above description, the angle detection module can also send the unfolding angle to the state monitoring service, so the state monitoring service can store the unfolding angle of the foldable display when it is in the first physical state. The state monitoring service can obtain the physical state change information of the foldable display based on the unfolding angle of the foldable display when it is in the first physical state (referred to as the first angle) and the unfolding angle of the foldable display when it is in the second physical state (referred to as the second angle), and the physical state change information is used to characterize whether the foldable display is unfolded or folded. Among them, when the second angle is greater than the first angle, the state monitoring service can determine that the screen is unfolded, and accordingly, the physical state change information of the screen is used to characterize the unfolding of the screen. When the second angle is less than the first angle, the state monitoring service can determine that the screen is folded, and accordingly, the physical state change information of the screen is used to characterize the folding of the screen.
[0228] Step 5: The status monitoring service sends a first message to the wallpaper setting service module.
[0229] The first message may include information about changes in the physical state of the screen. Furthermore, the first message may also include an unfolding angle of the foldable display screen.
[0230] Step 6: The wallpaper setting service module determines the first position, the second position, and the wallpaper position change information from the first position to the second position based on the physical state change information, the unfolding angle of the foldable display screen, and other information included in the first message.
[0231] The first position is the position of the wallpaper displayed on the first screen portion (e.g., the main screen) of the foldable display screen in the first physical state within the first wallpaper. The second position is the position of the wallpaper displayed on the first screen portion (e.g., the main screen) in the second physical state within the first wallpaper. The wallpaper position change information may include: the displacement magnitude and displacement direction from the first position to the second position.
[0232] Step 7: The wallpaper setting service module sends a second message to the system service module. The second message includes the first position, the second position, and wallpaper position change information from the first position to the second position.
[0233] Step 8: The system service module obtains the system default motion effect parameters in response to the second message, and generates a first animation according to the position change information, motion effect parameters, expansion angle, etc.
[0234] Optionally, the system service module can obtain the window handle (WindowToken) of the wallpaper through the wallpaper controller (WallpaperController), and the window handle is used to uniquely identify the window; the system service module moves the display plane (surface) of the wallpaper according to the WindowToken of the wallpaper, so that the position of the wallpaper displayed on the first screen part (such as the main screen) in the foldable display screen in the first wallpaper is the first position in the first physical state; then, according to the motion effect time of the first animation and the screen expansion angle, the size of each animation frame in the first animation is determined, as well as the position of the wallpaper in each animation frame relative to the full-screen wallpaper, or in other words, the moving distance of the wallpaper surface is determined, thereby generating the first animation.
[0235] The system service module can generate each animation frame in the first animation according to the unfolding angle of the foldable display screen and the system default animation parameters (such as animation duration, animation curve, etc.). The generation method of the first animation can be referred to the above embodiment.
[0236] Step 9: The system service module plays the first animation.
[0237] After generating the first animation, the system service module can control the foldable display to display the first animation. For example, each animation frame of the first animation can be displayed so that the display driver drives the display to play the first animation, thereby playing the first animation during the opening and closing process of the foldable display.
[0238] Exemplarily, the layer synthesis module synthesizes the background and other elements in the animation frame into layers, and after obtaining an animation frame, the animation frame can be stored in the buffer of the layer synthesis module. Sending each animation frame of the first animation for display can be understood as follows: the layer synthesis module stores the animation frame obtained by layer synthesis in the buffer every 16.67ms (for example, when the refresh rate of the electronic device is 60Hz), and the display driver takes an animation frame from the buffer of the layer synthesis module every 16.67ms, and after taking the animation frame, drives the display screen to display the animation frame. In this way, the foldable display screen can continuously display the animation frames in the first animation, that is, the foldable display screen can play the first animation.
[0239] It should be noted that the process shown in FIG. 10 is only an example, and some steps in the above process may be optional steps, and some steps in the above process may also be recombined, and the application embodiment does not impose any restrictions on this.
[0240] The following describes the display process provided in the embodiment of the present application based on the process shown in FIG6 a and in combination with the system architecture shown in FIG5 .
[0241] 11 , which shows a flow chart of a display method for a foldable display screen during a physical state change process provided by an embodiment of the present application.
[0242] In the scenario applicable to this process, the system opens an interface for enabling the generation of a first animation based on the motion effect parameters set by the application to the application (such as a third-party application). The application can set the motion effect parameters through this interface and provide them to the system, so that the system can achieve a dynamic wallpaper effect during the physical state change of the foldable display according to the motion effect parameters set by the application. Exemplarily, the motion effect parameters set by the application through this interface may include motion effect time, motion effect curve, motion effect mask, etc.
[0243] As shown in Figure 11, the process may include the following steps:
[0244] Step 0: After the desktop launcher is started, notify the system to turn off the default animation function and provide the animation parameters set by the application to the system service module.
[0245] After the Launcher is started, if the application determines that it needs to enable the wallpaper animation function when the physical state of the screen changes, and the dynamic effect depends on the animation parameters set by the application, the system will be notified to turn off the default animation function, and the animation parameters set by the application will be provided to the system service module; if the application does not need to enable the above function, there is no need to notify the system to turn off the default animation function, nor will the animation parameters be provided to the system service module. In this way, when the physical state of the foldable display changes, the system service module can generate a first animation and play the first animation in the manner shown in Figure 10.
[0246] The specific implementation method of steps 1 to 9 in Figure 11 is basically the same as the corresponding steps in Figure 10, except that: in step 8, the system service module obtains the motion effect parameters set by the application and generates the first animation based on the motion effect parameters set by the application.
[0247] An embodiment of the present application further provides a computer-readable storage medium, which is used to store a computer program. When the computer program is executed by a computer, the computer can implement the method provided in the above method embodiment.
[0248] An embodiment of the present application further provides a computer program product, which is used to store a computer program. When the computer program is executed by a computer, the computer can implement the method provided in the above method embodiment.
[0249] An embodiment of the present application also provides a chip, including a processor, which is coupled to a memory and is used to call a program in the memory so that the chip implements the method provided by the above method embodiment.
[0250] Those skilled in the art will appreciate that the embodiments of the present application can be provided as methods, systems, or computer program products. Therefore, the present application can adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application can adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.
[0251] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the present application. It should be understood that each flow and / or box in the flow chart and / or block diagram, as well as the combination of the flow chart and / or box in the flow chart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device produce a device for implementing the functions specified in one or more flow charts and / or one or more boxes in the block diagram.
[0252] These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a product including an instruction device that implements the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.
[0253] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, so that the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.
[0254] Obviously, those skilled in the art may make various changes and modifications to the present application without departing from the scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is intended to include these modifications and variations.
Claims
1. A display method for an electronic device, applied to an electronic device with a foldable display screen, characterized in that: The method comprises: When the foldable display screen of the electronic device is in a first physical state, the wallpaper displayed on the foldable display screen is a first area of the first wallpaper; During the process of the foldable display changing from the first physical state to the second physical state, playing a first animation, the first animation including a first frame and a second frame, the wallpaper in the first frame is the second area of the first wallpaper, the wallpaper in the second frame is the third area of the first wallpaper, and the size and position of the second area and the third area in the first wallpaper are related to the unfolding angle of the foldable display; When the foldable display is in the second physical state, the wallpaper displayed on the foldable display is the fourth area of the first wallpaper, and the fourth area is the wallpaper in the last animation frame of the first animation.
2. The method according to claim 1, wherein The method further comprises: In response to the foldable display changing from the first physical state to a second physical state, the first animation is generated.
3. The method according to claim 2, wherein Generating the first animation includes: Determining wallpaper position change information based on a first position and a second position; wherein the first position is a position of the wallpaper displayed on the first screen portion of the foldable display screen within the first wallpaper in the first physical state, and the second position is a position of the wallpaper displayed on the first screen portion within the first wallpaper in the second physical state; The first animation is generated according to the wallpaper position change information, the unfolding angle of the foldable display screen, and the motion effect parameters of the first animation.
4. The method according to claim 3, wherein: Generating the first animation according to the wallpaper position change information, the unfolding angle of the foldable display screen, and the motion effect parameters of the first animation includes: determining a size of the wallpaper in each animation frame according to an expansion angle corresponding to each animation frame in the first animation during a process from the first physical state to the second physical state; determining, according to the wallpaper position change information, an expansion angle corresponding to each animation frame in the first animation, and a motion effect parameter of the first animation, a position of the wallpaper in each animation frame in the first animation within the first wallpaper; determining an area of the wallpaper in each animation frame in the first wallpaper according to a size of the wallpaper in each animation frame in the first animation and a position of the wallpaper in each animation frame in the first wallpaper; The first animation is generated according to the area of the wallpaper in each animation frame in the first wallpaper.
5. The method according to claim 4, wherein The determining, based on the size of each animation frame in the first animation and the position of the wallpaper in each animation frame in the first wallpaper, of an area of the wallpaper in each animation frame in the first wallpaper includes: The position and size of the mask in the display plane where the first wallpaper is located are changed according to the size of each animation frame in the first animation and the position of the wallpaper in each animation frame in the first wallpaper to obtain the wallpaper in each animation frame. The wallpaper in each animation frame is the visible area outside the mask-blocked area in the display plane where the first wallpaper is located.
6. The method according to claim 2, wherein The wallpaper is a dynamic wallpaper, and the dynamic wallpaper includes a wallpaper frame sequence, and the wallpaper frame sequence includes at least two wallpaper animation frames; Generating the first animation includes: Determining wallpaper position change information based on a first position and a second position; wherein the first position is a position of the wallpaper displayed on the first screen portion of the foldable display screen within the first wallpaper in the first physical state, and the second position is a position of the wallpaper displayed on the first screen portion within the first wallpaper in the second physical state; determining a correspondence between wallpaper in each animation frame in the first animation and wallpaper animation frames in the wallpaper frame sequence; The first animation is generated according to the wallpaper position change information, the unfolding angle of the foldable display, the motion effect parameters of the first animation, and the correspondence between each animation frame in the first animation and the wallpaper animation frames in the wallpaper sequence.
7. The method according to claim 6, wherein The corresponding relationship between the wallpaper in each animation frame in the first animation and the wallpaper animation frame in the wallpaper sequence is: The animation frames in the first animation correspond one-to-one to the wallpaper animation frames in the wallpaper frame sequence. The wallpaper of the first animation frame in the first animation is the m-th frame in the wallpaper frame sequence. The m-th frame is the wallpaper displayed on the foldable display in the first physical state, and m is an integer greater than or equal to 1.
8. The method according to claim 7, wherein If the wallpaper of the kth animation frame in the first animation is the last wallpaper animation frame in the wallpaper frame sequence, then the wallpaper of the k+1th animation frame in the first animation is the first wallpaper animation frame in the wallpaper frame sequence.
9. The method according to any one of claims 3 to 8, wherein: The first screen portion is the main screen in the foldable display screen.
10. The method according to any one of claims 3 to 9, characterized in that The animation parameters include at least one of the following: playback duration, animation curve, and animation method.
11. The method according to any one of claims 3 to 10, wherein: When the first physical state is the folded state, the first position is a preset position in the first wallpaper.
12. The method according to any one of claims 3 to 11, wherein: The method further comprises: Get the animation parameters set by the system.
13. The method according to any one of claims 3 to 11, wherein: The method further comprises: Get the animation parameters set by the application.
14. The method according to any one of claims 1 to 13, characterized in that The foldable display screen includes any one of the following: an outward folding screen, an inward folding screen, and a scroll screen.
15. The method according to claim 14, characterized in that When the foldable display screen is an outward-folding screen or an inward-folding screen, the first physical state is a folded state, an intermediate state, or an unfolded state, wherein the intermediate state is a state between the folded state and the unfolded state, and the intermediate state includes at least one of a first intermediate state and a second intermediate state; When the first physical state is a folded state, the second physical state is an intermediate state or an unfolded state; When the first physical state is an unfolded state, the second physical state is an intermediate state or a folded state; When the first physical state is the first intermediate state, the second physical state is the unfolded state or the folded state or the second intermediate state.
16. An electronic device, characterized in that: include: A foldable display, one or more processors; the one or more memories storing one or more computer programs, the one or more computer programs including instructions, which, when executed by the one or more processors, enable the electronic device to execute the method described in any one of claims 1-15.
17. A computer-readable storage medium, characterized in that The method comprises a computer program, which, when running on an electronic device, enables the electronic device to execute the method according to any one of claims 1 to 15.
18. A computer program product, characterized in that When the method is run on an electronic device, the electronic device is enabled to execute the method according to any one of claims 1 to 15.
19. A chip system, characterized in that: include: a memory for storing computer programs; a processor; When the processor calls and runs the computer program from the memory, the electronic device equipped with the chip system executes the method according to any one of claims 1 to 15.