Display method, device and storage medium of electronic device
By playing animated wallpapers during the physical state changes of the foldable display screen, the problem of wallpaper lacking dynamic effects in the existing technology is solved, and the matching of wallpaper and screen state changes is achieved, improving the user experience.
Patent Information
- Application Number
- CN202210772715.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-06-30
- Publication Date
- 2025-03-14
- Estimated Expiration
- 2042-06-30
AI Technical Summary
The existing foldable display lacks dynamic effects during expansion or folding, and cannot match the wallpaper with changes in physical state, limiting the user experience.
By playing an animation wallpaper during the physical state change of the foldable display, the area and position of the animation wallpaper are related to the expansion angle of the screen, the dynamic change effect of the wallpaper is achieved.
The dynamic change effect of wallpaper during the physical state changes of the foldable display screen, improving the user's visual experience.
Smart Images

Figure CN117369758B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of terminal technology, and in particular to a display method, device and storage medium of an electronic device. Background Art
[0002] Foldable displays include flexible organic light emitting diode (OLED) and other types of screens. Compared with traditional screens, foldable displays are thinner and easier to bend. Currently, foldable displays have been used in electronic devices such as mobile phones and tablets.
[0003] When using an electronic device with a foldable display, users can fold or unfold the screen. Currently, during the process of unfolding or folding the screen, the screen display lacks dynamic effects. For example, during the process of unfolding or folding the screen, the wallpaper cannot present a dynamic display effect that matches the unfolding or folding process, which limits the user experience. Summary of the invention
[0004] Embodiments of the present application provide a display method, device, and storage medium for an electronic device, which are applied to an electronic device with a foldable display screen, and are used to display a dynamic change effect of a wallpaper during a change in the physical state of the foldable display screen.
[0005] In a first aspect, a display method of an electronic device is provided, which is applied to an electronic device having a foldable display screen, and the method comprises:
[0006] When the foldable display of the electronic device is in a first physical state, the wallpaper displayed on the foldable display is the first area of the first wallpaper; during the process of the foldable display changing from the first physical state to the second physical state, a first animation is played, the first animation includes a first frame and a second frame, the wallpaper in the first frame is the second area of the first wallpaper, the wallpaper in the second frame is the third area of the first wallpaper, and the sizes of the second area and the third area and the positions in the first wallpaper are related to the unfolding angle of the foldable display; when the foldable display is in the second physical state, the wallpaper displayed on the foldable display is the fourth area of the first wallpaper, and the fourth area is the wallpaper in the last animation frame in the first animation.
[0007] In the above implementation, the first animation is played during the process of the foldable display screen of the electronic device changing from the first physical state to the second physical state, so that the animation can be displayed when the physical state of the screen changes. For any two animation frames (the first frame and the second frame) in the first animation, the wallpaper in the first frame is the second area of the first wallpaper (such as the full-screen wallpaper), and the wallpaper in the second frame is the third area of the first wallpaper. The size of the second area and the third area and the position in the first wallpaper are related to the unfolding angle of the foldable display screen. Therefore, as the unfolding angle of the foldable display screen gradually changes, the size of the wallpaper displayed on the screen and its position in the full-screen wallpaper also change, thereby achieving a dynamic change effect of the wallpaper during the change of the physical state of the foldable display screen.
[0008] In a possible implementation, the method further includes: generating the first animation in response to the foldable display changing from the first physical state to a second physical state.
[0009] In the above implementation, the first animation is triggered by the foldable display changing from a first physical state to a second physical state, so that the wallpaper in the animation frame in the first animation can match the changing process (such as the unfolding angle during the changing process).
[0010] In a possible implementation, generating the first animation includes: determining wallpaper position change information based on the first position and the second position; wherein the first position is the position of the wallpaper displayed on the first screen portion of the foldable display screen in the first wallpaper in the first physical state, and the second position is the position of the wallpaper displayed on the first screen portion in the first wallpaper in the second physical state; generating the first animation based on the wallpaper position change information, the unfolding angle of the foldable display screen, and the motion effect parameters of the first animation.
[0011] Optionally, when the first physical state is a folded state, the first position is a preset position in the first wallpaper;
[0012] When the first physical state is the unfolded state, the first position is the rightmost position of the first wallpaper;
[0013] When the first physical state is an intermediate state, the first position is between the preset position and the rightmost position in the first screen, and is related to the unfolding angle of the foldable display screen corresponding to the first physical state.
[0014] In the above implementation, based on the position change from the first position (the position of the wallpaper displayed on the main screen among the wallpapers on the first screen before the physical state changes) to the second position (the position of the wallpaper displayed on the main screen among the wallpapers on the first screen after the physical state changes), the position change of the wallpaper in each animation frame in the first animation can be determined, and then each animation frame in the first animation is generated, so that the animation frames in the first animation match the change process from the first physical state to the second physical state.
[0015] In a possible implementation, the generating the first animation according to the wallpaper position change information, the unfolding angle of the foldable display screen, and the motion effect parameters of the first animation includes: determining the size of the wallpaper in each animation frame according to the unfolding angle corresponding to each animation frame in the first animation in the process from the first physical state to the second physical state; determining the position of the wallpaper in each animation frame in the first wallpaper according to the wallpaper position change information, the unfolding angle corresponding to each animation frame in the first animation, and the motion effect parameters of the first animation; determining the area of the wallpaper in each animation frame in the first wallpaper according to the size of the wallpaper in each animation frame in the first animation and the position of the wallpaper in each animation frame in the first wallpaper; generating the first animation according to the area of the wallpaper in each animation frame in the first wallpaper.
[0016] In the above implementation, the size of the wallpaper in each animation frame in the first animation is related to the expansion angle, and the position of the wallpaper in each animation frame in the first animation frame in the first wallpaper is related to the address position change information, so that the animation frame in the first animation matches the change process from the first physical state to the second physical state, and can be implemented in the process of the foldable display changing from the first physical state to the second physical state. The size of the wallpaper displayed on the screen and its position in the first wallpaper (such as a full-screen wallpaper) change accordingly to achieve a dynamic display effect.
[0017] In a possible implementation, determining the area of the wallpaper in each animation frame in the first wallpaper according to the size of each animation frame in the first animation and the position of the wallpaper in each animation frame in the first wallpaper, includes: changing the position and size of the mask in the display plane where the first wallpaper is located according to the size of each animation frame in the first animation and the position of the wallpaper in each animation frame in the first wallpaper, to obtain the wallpaper in each animation frame, wherein the wallpaper in each animation frame is a visible area outside the masked area in the display plane where the first wallpaper is located.
[0018] In the above implementation, by changing the position and size of the mask in the display plane (surface) where the first wallpaper is located, the visible area in the display plane can be changed, and the visible area is the wallpaper in the animation frame. In this way, on the one hand, by changing the position of the mask in the display plane (surface) where the first wallpaper is located, the visual effect of moving the wallpaper can be achieved. On the other hand, the operation of repeatedly drawing the wallpaper for each animation frame can be saved, thereby reducing system overhead.
[0019] In a possible implementation, the wallpaper is a dynamic wallpaper, the dynamic wallpaper includes a wallpaper frame sequence, and the wallpaper frame sequence includes at least two wallpaper animation frames; and generating the first animation includes:
[0020] Determine wallpaper position change information based on the first position and the second position; wherein the first position is the position of the wallpaper displayed on the first screen portion of the foldable display screen in the first wallpaper under the first physical state, and the second position is the position of the wallpaper displayed on the first screen portion in the first wallpaper under the second physical state; determine the correspondence between the wallpaper in each animation frame in the first animation and the wallpaper animation frame in the wallpaper frame sequence; generate the first animation based on the wallpaper position change information, the unfolding angle of the foldable display screen, the motion effect parameters of the first animation, and the correspondence between each animation frame in the first animation and the wallpaper animation frame in the wallpaper frame sequence.
[0021] The above implementation method can achieve a dynamic display effect of the wallpaper when the physical state of the foldable display screen changes when using a dynamic wallpaper, thereby improving the user experience.
[0022] Optionally, the correspondence between the wallpaper in each animation frame in the first animation and the wallpaper animation frames in the wallpaper frame sequence is: the animation frames in the first animation correspond one-to-one to the wallpaper animation frames in the wallpaper frame sequence, the wallpaper of the first animation frame in the first animation is the m-th frame in the wallpaper frame sequence, the m-th frame is the wallpaper displayed on the foldable display screen in the first physical state, and m is an integer greater than or equal to 1.
[0023] Optionally, if the wallpaper of the kth animation frame in the first animation is the last wallpaper animation frame in the wallpaper frame sequence, then the wallpaper of the k+1th animation frame in the first animation is the first wallpaper animation frame in the wallpaper frame sequence.
[0024] In a possible implementation, the first screen portion is a main screen in the foldable display screen.
[0025] In a possible implementation, the motion effect parameter includes at least one of the following: playback duration, motion effect curve, and motion effect mode.
[0026] In a possible implementation manner, when the first physical state is a folded state, the first position is a preset position in the first wallpaper.
[0027] In a possible implementation, the method further includes: obtaining the dynamic effect parameters set by the system. In the above implementation, the dynamic effect parameters are set by the system, and a unified dynamic display effect can be achieved for different applications.
[0028] In a possible implementation, the method further includes: obtaining the motion effect parameters set by the application. In the above implementation, the motion effect parameters are set by the application, so that different applications can set the motion effect parameters as needed, thereby improving flexibility.
[0029] In a possible implementation, the foldable display screen includes any one of the following: an outer folding screen, an inner folding screen, and a scroll screen.
[0030] In a possible implementation manner, when the foldable display screen is an outer folding screen or an inner folding screen, the first physical state is a folded state, an intermediate state, or an unfolded state, the intermediate state is a state between the folded state and the unfolded state, and the intermediate state includes at least one of a first intermediate state and a second intermediate state;
[0031] When the first physical state is a folded state, the second physical state is an intermediate state or an unfolded state;
[0032] When the first physical state is an unfolded state, the second physical state is an intermediate state or a folded state;
[0033] When the first physical state is the first intermediate state, the second physical state is the unfolded state or the folded state or the second intermediate state.
[0034] In a second aspect, an electronic device is provided, comprising: a foldable display screen and one or more processors; the one or more memories storing one or more computer programs, the one or more computer programs comprising instructions, which, when executed by the one or more processors, enable the electronic device to execute a method as described in any one of the methods described in the first aspect above.
[0035] According to a third aspect, a computer-readable storage medium is provided, comprising a computer program. When the computer program is executed on an electronic device, the electronic device executes the method according to any one of the above-mentioned first aspects.
[0036] According to a fourth aspect, a computer program product is provided, which, when executed on an electronic device, enables the electronic device to execute the method described in any one of the first aspects above.
[0037] In a fifth aspect, a chip system is provided, comprising: a memory for storing a computer program; a processor; when the processor calls and runs the computer program from the memory, an electronic device equipped with the chip system executes a method as described in any one of the above-mentioned first aspects.
[0038] For the beneficial effects of the second to fifth aspects above, please refer to the beneficial effects of the first aspect and will not be repeated. BRIEF DESCRIPTION OF THE DRAWINGS
[0039] Figure 1A This is an example diagram of an outward-folding foldable display screen in an embodiment of the present application;
[0040] Figure 1B This is an example diagram of an outward-folding foldable display screen in an embodiment of the present application;
[0041] Figure 1C This is an example diagram of an outward-folding foldable display screen in an embodiment of the present application;
[0042] Figure 1D This is an example diagram of an inwardly foldable foldable display screen in an embodiment of the present application;
[0043] Figure 2A This is an example diagram of the screen display principle schematic diagram in the embodiment of the present application;
[0044] Figure 2B This is an example diagram of the screen display effect in the embodiment of the present application;
[0045] Figure 3 A schematic diagram of a user interface in an embodiment of the present application;
[0046] Figure 4 A schematic diagram of the hardware structure of an electronic device in an embodiment of the present application;
[0047] Figure 5 A schematic diagram of the software architecture of an electronic device in an embodiment of the present application;
[0048] Figure 6a A flow chart of a display method provided in an embodiment of the present application;
[0049] Figure 6b is a schematic diagram of a generation process of a first animation in an embodiment of the present application;
[0050] Figure 6cIt is a schematic diagram of a process of generating a first animation according to wallpaper position change information, an unfolding angle of a foldable display screen, and a motion effect parameter of the first animation in an embodiment of the present application;
[0051] Figure 7 Schematic diagram of wallpaper displayed on the foldable display screen in the unfolded state, intermediate state, and folded state in the embodiment of the present application;
[0052] Figure 8 A schematic diagram of the principle and effect of dynamic display of wallpaper during the unfolding of the foldable display screen in an embodiment of the present application;
[0053] Fig. 9 A schematic diagram of the principle and effect of dynamic display of wallpaper during folding of the foldable display screen in an embodiment of the present application;
[0054] Fig.10 This is a flow chart of a display method during a physical state change of a foldable display screen in an embodiment of the present application;
[0055] Fig.11 Schematic diagram of the display method flow during the physical state change of the foldable display screen in the embodiment of the present application. DETAILED DESCRIPTION
[0056] The technical solutions in the embodiments of the present application will be described clearly and completely below in conjunction with the drawings in the embodiments of the present application. The terms used in the following embodiments are only for the purpose of describing specific embodiments and are not intended to be used as limitations on the present application. As used in the specification and the appended claims of the present application, the singular expressions "one", "a kind", "said", "above", "the" and "this" are intended to also include expressions such as "one or more", unless there is a clear contrary indication in the context. It should also be understood that in the embodiments of the present application, "one or more" refers to one, two or more; "and / or" describes the association relationship of the associated objects, indicating that three relationships may exist; for example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the objects associated before and after are in an "or" relationship.
[0057] References to "one embodiment" or "some embodiments" etc. described in this specification mean that a particular feature, structure or characteristic described in conjunction with the embodiment is included in one or more embodiments of the present application. Thus, the phrases "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear at different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.
[0058] The multiple involved in the embodiments of the present application means greater than or equal to two. It should be noted that in the description of the embodiments of the present application, the words "first", "second", etc. are only used for the purpose of distinguishing the description, and cannot be understood as indicating or implying relative importance, nor can they be understood as indicating or implying an order.
[0059] The present application provides a display method of an electronic device with a foldable display screen and related electronic devices, which are used to display a dynamic change effect of wallpaper during the process of the physical state of the foldable display screen changing, thereby improving the user's visual experience. The method and the electronic device are based on the same technical concept. Since the principles of the method and the electronic device to solve the problem are similar, the implementation of the electronic device and the method can refer to each other, and the repeated parts will not be repeated.
[0060] In the solution provided in an embodiment of the present application, during the physical state switching process of the foldable display screen of the electronic device, the electronic device displays a first animation, and the wallpapers in different animation frames in the first animation are different areas of the full-screen wallpaper, so that during the physical state switching process of the foldable display screen, the changes of the wallpaper can be dynamically displayed, thereby improving the user's visual experience.
[0061] Below, some terms in this application are explained to facilitate understanding by those skilled in the art.
[0062] (1) Electronic devices are devices equipped with a foldable display screen and capable of human-computer interaction through the foldable display screen. For example, the electronic device may be a mobile phone, a tablet computer, a laptop computer, a netbook, a vehicle-mounted device, a business intelligent terminal (including: videophone, conference desktop intelligent terminal, etc.), a personal digital assistant (PDA), an augmented reality (AR) or virtual reality (VR) device, etc. The specific form of the electronic device is not limited in the embodiments of the present application.
[0063] (2) A foldable display screen refers to a screen that can change its shape by external force, including at least two screen parts. The sizes of the various screen parts can be different or the same. In the following embodiments, "screen" and "screen part" refer to part or all of the foldable display screen. In some cases, a foldable display screen is also called a flexible screen.
[0064] Among them, a screen part of the foldable display can be an independent complete screen (or an independent display unit, such as can be controlled by the processor as a whole), or it can refer to a display area of a part of a complete screen. The electronic device can control the display status of different screen parts separately. Based on the control, the display status of each screen part can be specifically a state of turning on the display (also called a display state, such as a bright screen state), or a state of turning off the display (such as a black screen state).
[0065] Two adjacent screen parts can be movably connected based on a bending part (for example, a hinge or a flexible material). In some implementations, the outside of the connecting part is also covered with a display screen (also referred to as a connecting screen or a folding edge). In this way, different screen parts of the foldable display screen can be flattened and unfolded into a full screen for display based on external force (such as a user unfolding it with his hands), or can be folded into a single screen for display based on external force (such as a user folding it with his hands). For example, when the foldable display screen is unfolded into a full screen, it can be an 8-inch full screen for display, and after being folded, it can be a 6.6-inch or 6.38-inch screen portion for display.
[0066] In summary, the foldable display screen includes: at least one bending portion, and multiple screen portions located on both sides of the bending portion.
[0067] There are generally two folding methods for foldable displays: outward folding and inward folding. Figure 1A and Figure 1B As shown, the outward-folding folding screen, after folding, the different screen parts of the foldable display will appear opposite to each other.
[0068] For example, see Figure 1A The foldable display screen shown has three parts: a bending part and a first screen part and a second screen part on both sides of the bending part.
[0069] When the bending portion is bent or deformed, the angle between the first screen portion and the second screen portion (hereinafter referred to as the unfolding angle) changes, such as Figure 1A As shown in Figures b and c.
[0070] In practical applications, foldable displays usually have two physical states: Figure 1A The expanded state shown in Figure a, and Figure 1AIn the state change process of switching the foldable display screen from one physical state to another physical state (hereinafter referred to as the state change process), the foldable display screen also presents a semi-folded intermediate state, such as Figure 1A As shown in Figures b and c.
[0071] In some scenarios, the electronic device can determine the physical state of the foldable display screen by the unfolding angle. Exemplarily, when the unfolding angle is within the interval formed by the first threshold and 180 degrees (i.e., the preset unfolded state condition), the electronic device determines that the physical state of the foldable display screen is the unfolded state; when the unfolding angle is within the interval formed by 0 degrees and the second threshold (i.e., the preset folded state condition), the electronic device determines that the physical state of the foldable display screen is the folded state; when the unfolding angle is within the interval formed by the second threshold and the first threshold (i.e., the preset intermediate state condition), the electronic device determines that the physical state of the foldable display screen is the intermediate state. Among them, the value of the first threshold is greater than the value of the second threshold, and the first threshold and the second threshold can be specifically set according to the actual application. For example, the first threshold is 180 degrees, 170 degrees, 150 degrees, etc., and the second threshold is 0 degrees, 5 degrees, 45 degrees, 90 degrees, etc.
[0072] It should be noted that in Figure 1A In the example shown, the foldable display screen is folded left and right (i.e., folded vertically). In other embodiments, the foldable display screen can also be folded up and down (i.e., folded horizontally), such as Figure 1B As shown, the embodiment of the present application does not limit the folding method of the foldable display screen.
[0073] It should be noted that Figure 1A and Figure 1B The foldable display screen shown in the figure includes two screen parts. The method provided in the embodiment of the present application can also be applied to a foldable display screen having three or more screen parts. For example Figure 1C The foldable display screen with three screen parts is shown. When the unfolding angle of any two adjacent screen parts meets the preset folding state condition, the physical state of the foldable display screen is the folded state; when all two adjacent screen parts meet the preset unfolding state condition, the physical state of the foldable display screen is the unfolded state, and the other cases are intermediate states.
[0074] See also Figure 1D As shown, the foldable display screen folds inwards, and after folding, different screen parts of the foldable display screen will face each other. The present application does not limit the folding form of the folding inwards, for example, it can be other folding forms such as a three-fold screen.
[0075] In addition to the above-mentioned external folding screen and internal folding screen, the foldable display screen in the embodiment of the present application can also be a scroll screen. The embodiment of the present application does not limit the type and folding method of the foldable display screen.
[0076] In the following embodiments of the present application, the method provided by the present application is described by taking an outward folding display screen as an example. The outward folding mode means that after the foldable display screen is folded, at least one screen portion is visible on the front and at least one screen portion is on the back. In other embodiments, the method provided by the embodiments of the present application is not limited to being applied to the outward folding display screen scenario.
[0077] Continue below Figure 1A The foldable display shown describes the physical state of the foldable display and the changes in the display state.
[0078] like Figure 1A As shown in Figure a, the physical state of the foldable display screen is the unfolded state. When the foldable display screen is in the working state (display state), the first screen portion, the second screen portion and the bent portion are all in the display state. In this way, the entire screen of the foldable display screen can be used to display content.
[0079] like Figure 1A As shown in Figure d in , the physical state of the foldable display screen is a folded state. When the foldable display screen is in working state, the default main screen (such as the first screen part) is in a display state and can display content, while the default secondary screen (such as the second screen part) is set to a non-display state, does not display content or is a black screen. Of course, the user can operate the electronic device, the main screen or the secondary screen (for example, flip the electronic device, double-click the secondary screen, etc.) to set the secondary screen to a display state and the main screen to a non-display state. Among them, the default main screen and the default secondary screen in the foldable display screen can be set by the user according to actual usage, or can be the default setting of the electronic device when it leaves the factory.
[0080] like Figure 1A As shown in Figure d in the figure, the physical state of the foldable display screen is the folded state. When the foldable display screen is in the working state, the electronic device can determine which part of the screen is visible to the user, for example, by detecting whether there is a face in front of the camera through a camera located in a certain screen part, or by the operation method when the user folds the foldable display screen, or by an infrared sensor located in a certain screen part to determine whether there is a user in front of the infrared sensor. When the electronic device determines that the first screen part is visible to the user, the first screen part is set to a display state, capable of displaying content, and then the second screen part is set to a non-display state, not displaying content or being a black screen. In other embodiments, the second screen part can also display content and / or have the ability to control the second screen part.
[0081] In some embodiments, when the foldable display is in Figure 1A In the folded state scenario shown in Figure d, when the electronic device sets a certain screen portion to a display state, it can also set a bent portion connected to the screen portion to a display state for displaying content.
[0082] In the embodiment of the present application, the display state of the foldable display changes with the change of the physical state of the foldable display. For example, when the physical state and display state of the foldable display are Figure 1A As shown in Figure a, the user can fold the foldable display to change the physical state and display state of the foldable display to Figure 1A As shown in Figure d in FIG. For another example, when the physical state and display state of the foldable display are Figure 1A As shown in Figure d in the figure, the user can unfold the foldable display screen to change the physical state and display state of the foldable display screen to Figure 1A As shown in Figure a.
[0083] (3) Screen display area: The area of the screen in the display state of the foldable display screen used to draw and display the interface. The size and position of the screen display area may be the same or different for different physical states of the foldable display screen. Generally, the size of the screen display area is the same as the size of the screen currently in the display state.
[0084] For example, when the foldable display is in the unfolded state, the size of the screen display area is the same as the size of the entire foldable display; when the foldable display is in the folded state, the size of the screen display area is the same as the size of the main screen, see Figure 1A As shown in Figure a.
[0085] The following is an explanation of the display principle of the screen display area. It should be understood that the following display principle is only an exemplary explanation for the purpose of understanding the implementation process of this application, but in other technologies or future technologies, there may be other display methods, which are not limited by this application.
[0086] The screen display area includes one or more display planes (surfaces), such as Figure 2A As shown. Optionally, the size of each surface is the same as the size of the screen display area, and when the screen display area contains multiple surfaces, the multiple surfaces optionally overlap each other. Each surface is used to draw an interface, and the interface finally displayed in the screen display area is actually the interface of the interfaces in each surface it contains superimposed.
[0087] See also Figure 2BAs shown, for example, when the screen display area includes two display planes, surface 1 and surface 2. When the interface in the upper layer surface 1 is opaque, the interface actually displayed in the screen display area (ie, visible to the user) is the interface in surface 1, such as Figure 2B When the interface in the upper layer surface 1 is semi-transparent and the interface in the lower layer surface 2 is opaque, the interface actually displayed in the screen display area is the interface in surface 1 and the interface in surface 2, as shown in Figure a. Figure 2B When the interface in the upper layer surface 1 is transparent and the interface in the lower layer surface is opaque, the interface actually displayed in the screen display area is the interface in surface2, as shown in Figure b. Figure 2B It should be noted that, in surface 1 or surface 2, some areas may be transparent, and some areas may be opaque or semi-transparent.
[0088] It should be noted that the foldable display screen described in the above embodiments and related drawings is only used to explain the technical solution of the present application and is not intended to be limiting. The present application does not limit the shape, appearance, material, number of screen parts, connection method between screen parts, and folding method of each screen part of the foldable display screen.
[0089] (4) Interface, also known as user interface (UI), is presented on the foldable display and is the medium for interaction and information exchange between the electronic device and the user. It can realize the conversion between the internal data form of the device and the visual form of the user.
[0090] The specific form of the interface can be an image or a window. When the displayed interface is an image, the user usually cannot edit the image, but can exit the interface through some operations. The window is responsible for displaying and processing information, and the user can operate within the window. Taking a mobile phone as an example, the windows include: the main interface window (such as the launcher window), the application window, etc., and also the window in the lock screen state. Among them, the main interface window contains the wallpaper and the icons of multiple applications displayed on the wallpaper, such as the icon of the camera application, the icon of the gallery application, etc. Figure 3 The window in the lock screen state may include wallpaper and other display information (such as time), such as Figure 3 As shown in Figure b.
[0091] The wallpaper is a background image set by the electronic device. The wallpaper may include static wallpaper, dynamic wallpaper, etc., which is not limited in the embodiment of the present application.
[0092] See also Figure 4 , exemplarily showing a schematic diagram of the internal hardware structure of an electronic device provided in an embodiment of the present application. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.
[0093] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, a display processing unit (DPU), and / or a neural-network processing unit (NPU). Among them, different processing units may be independent devices or integrated into one or more processors. In some embodiments, the electronic device 100 may also include one or more processors 110. Among them, the processor is the nerve center and command center of the electronic device 300. The processor can generate an operation control signal according to the instruction opcode and the timing signal to complete the control of fetching and executing instructions. A memory may also be set in the processor 110 for storing instructions and data.
[0094] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc. Among them, the USB interface 130 is an interface that complies with the USB standard specification, and can specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transmit data between the electronic device 100 and a peripheral device. It can also be used to connect headphones and play audio through the headphones.
[0095] The sensor module 180 may include one or more of the following: a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, and a bone conduction sensor 180M. In the embodiment of the present application, optionally, the unfolding angle of the foldable display screen can be detected by the sensor, so that the processor 110 can display the dynamic change effect of the user interface wallpaper in the display area of the foldable display screen according to the change of the unfolding angle.
[0096] The charging management module 140 is used to receive charging input from the charger. The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.
[0097] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.
[0098] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some functional modules of the mobile communication module 150 can be set in the processor 110.
[0099] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays an image or video through a display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.
[0100] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as Wi-Fi networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of the signal, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.
[0101] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology. The electronic device 100 can realize the shooting function through the ISP, camera 193, video codec, GPU, display screen 194 and application processor.
[0102] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function, such as storing music, video and other files in the external memory card.
[0103] The electronic device 100 can realize the display function through the GPU, the display screen 194, and the application processor AP. The display screen 194 is used to display images, videos, etc. The display screen 194 in the embodiment of the present application is a foldable display screen. For related introduction, please refer to Figure 1A , Figure 1B , Figure 1C , Figure 1D The screen shown in .
[0104] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.
[0105] It is understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.
[0106] The software system of the electronic device can adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. System) as an example to illustrate the software structure of the electronic device.
[0107] See also Figure 5 , is a schematic diagram of the hierarchical software structure of the electronic device provided in the embodiment of the present application. The hierarchical architecture divides the software system of the electronic device into several layers, each layer has a clear role and division of labor. The layers communicate with each other through software interfaces.
[0108] In some embodiments, the Android system can be divided into four layers, namely, application layer (applications), application framework layer (application framework), Android runtime (Android runtime), system library and kernel layer (kernel). The present application embodiment does not limit the layering of the software structure of the electronic device. The Android runtime, system library and kernel layer can be regarded as one layer, called the system layer. It should be understood that Figure 5 On the basis of Android system, a hardware layer in electronic devices is also added.
[0109] It should be understood that Figure 5 The modules included in each layer shown are modules involved in the embodiments of the present application. The modules included in each layer below do not constitute a limitation on the structure of the electronic device and the level of module deployment (illustration). In one embodiment, Figure 5 The modules shown in can be deployed individually, or several modules can be deployed together. Figure 5 The division of modules in is an example. In one embodiment, Figure 5 The names of the modules shown in are examples.
[0110] The application layer can include a series of application packages. The application layer can include: camera, gallery, calendar, call, map, navigation, Bluetooth, music, video, short message and other applications. Applications can include system applications and third-party applications. Among them, Figure 5 The system applications including desktop applications and wallpaper applications are taken as an example.
[0111] The application framework layer can provide application programming interface (API) and programming framework for the applications in the application layer. The application framework layer can include some predefined functions. Figure 5 The application framework layer may include: a system service module, a window management service (window manager service, WMS), a drawing module, a rendering module, and a layer synthesizer (Surface Flinger, SF).
[0112] Among them, the system service module can provide monitoring services for the application, such as monitoring the change of the physical state of the foldable display screen, and can generate a first animation during the change of the physical state of the foldable display screen to achieve the dynamic change effect of the wallpaper. The wallpaper setting service module is used to determine the change information of the wallpaper during the change of the physical state of the foldable display screen, and provide the information to the system service module. The window management service is used to manage the user interface. The drawing module is used to draw the user interface. The rendering module is used to render the user interface drawn by the drawing module. The layer synthesizer is used to perform layer synthesis on each rendered layer to obtain the user interface to be displayed.
[0113] Because the Android runtime and system library, as well as the kernel layer, are considered as one layer in the embodiments of the present application, the system layer may include the Android runtime and system library, as well as the functional modules in the kernel layer. Figure 5 The system layer may include multiple functional modules, such as: state monitoring service, surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc. Among them, the state monitoring service is used to determine the orientation of the electronic device, the physical state of the foldable display screen, etc. according to the monitoring data reported by the kernel layer. It should be understood that Figure 5 The system layer includes a state monitoring service as an example for explanation. The system layer also includes: a hinge detection module, which is used to obtain the angle of the hinge and report it to the state monitoring service, so that the state monitoring service determines the physical state and unfolding angle of the foldable display screen based on the angle of the hinge.
[0114] In addition, the system layer also includes hardware drivers for driving hardware operations. For example, the driver layer includes: sensor driver, display driver, graphics processing unit driver (GPU driver), etc., which are not limited in the present embodiment of the application. It should be understood that Figure 5The display driver involved in the embodiment of the present application is shown in the figure, and the display driver is used to drive the foldable display screen to display a user interface.
[0115] The hardware layer includes the hardware in the electronic device. It should be understood that Figure 5 The hardware layer in FIG. 1 shows the hinge and display screen involved in the following embodiments for supporting the opening and closing of the foldable display screen.
[0116] The display method of the electronic device provided by the embodiment of the present application is described below in conjunction with the accompanying drawings. The following embodiments can be combined with each other, and the same or similar concepts or processes may not be described in detail in some embodiments.
[0117] See also Figure 6a , is a flow chart of a display method for an electronic device with a foldable display screen provided in an embodiment of the present application. As shown in the figure, the process may include the following steps:
[0118] S61: When the foldable display screen of the electronic device is in a first physical state, the foldable display screen displays a first area of a first wallpaper.
[0119] Optionally, the first wallpaper may be a full-screen wallpaper, i.e., the screen background displayed by the foldable display screen in the unfolded state. When the foldable display screen is in the unfolded state, the size of the full-screen wallpaper is equivalent to the size of the screen display area in the unfolded state, and the size of the screen display area is equivalent to the size of the screen in the unfolded state. The size of the first wallpaper may also be larger than the size of the full-screen wallpaper.
[0120] Taking the foldable display screen as an outer foldable screen or an inner foldable screen as an example, the first physical state of the foldable display screen may be one of the following states:
[0121] - Expanded state; for example, Figure 1A As shown in Figure a, or as Figure 1B As shown in Figure a;
[0122] - folded state; for example, Figure 1A As shown in Figure d, or as Figure 1B As shown in Figure d;
[0123] -Intermediate state; for example, Figure 1A As shown in Figure b or Figure c, or as Figure 1B As shown in Figure b or Figure c.
[0124] Taking the first wallpaper as a full-screen wallpaper as an example, when the physical state of the foldable display is the unfolded state, the first area of the global wallpaper is the entire area of the full-screen wallpaper. In other words, in the user interface displayed by the foldable display in the unfolded state, the wallpaper of the user interface is the entire area of the full-screen wallpaper.
[0125] by Figure 1A Take the foldable display shown as an example. Figure 7 Figure a in the figure shows a schematic diagram of the wallpaper in the user interface displayed on the screen in the expanded state. In the expanded state, the wallpaper of the user interface is the entire area 701 of the full-screen wallpaper. Figure 7 Figure b in the figure shows a schematic diagram of the wallpaper in the user interface displayed on the screen in the intermediate state. In the intermediate state, the wallpaper of the user interface is a local area 702 at a certain position of the full-screen wallpaper. Figure 7 Figure c in the figure shows a schematic diagram of the wallpaper in the user interface displayed on the screen in the folded state. In the folded state, the wallpaper of the user interface is a local area 703 of a specified position of the full-screen wallpaper. Optionally, the user interface can be a main interface (launcher interface) or a lock screen interface, etc. In addition to the wallpaper, the user interface may also include other interface elements, such as text, pictures, desktop widgets (such as desktop widgets for displaying time or schedule), etc., and may also include a media operation window (for simple control operations on the media being played), etc.
[0126] According to the above Figure 7 It can be seen that when the physical state of the foldable display is the folded state, the first area of the full-screen wallpaper is a local area of the full-screen wallpaper, and the size of the local area is comparable to the size of the screen display area in the folded state. In other words, in the user interface displayed on the folding display in the folded state, the wallpaper of the user interface is a local area of the full-screen wallpaper, and the size of the local area is comparable to the size of the screen display area in the folded state, or comparable to the size of the main screen display area. Optionally, the local wallpaper displayed in the folded state may be any local area of the full-screen wallpaper that is comparable in size to the screen display area in the folded state (such as the display area of the main screen in the foldable display), such as the local area on the right side of the full-screen wallpaper, or the local area on the left side, or the local area in the middle (such as Figure 7 Optionally, the position of the wallpaper displayed in the folded state in the full-screen wallpaper can be preset.
[0127] When the physical state of the foldable display screen is an intermediate state, the first area of the full-screen wallpaper is a local area of the full-screen wallpaper (such as Figure 7(as shown in Figure b in the figure), the size of the local area is comparable to the size of the screen display area in the intermediate state. In other words, in the user interface displayed on the folding display screen in the intermediate state, the wallpaper of the user interface is a local area of the full-screen wallpaper, and the size of the local area is comparable to the screen display area in the intermediate state, for example, it may be equal to the size of the main screen display area, or it may be larger than the size of the main screen display area. Optionally, the local wallpaper displayed in the intermediate state may be a local area in the full-screen wallpaper that is comparable in size to the screen display area in the intermediate state (such as the display area of the main screen in the foldable display screen), and the position of the local area in the full-screen wallpaper is related to the position of the wallpaper displayed in the folded state in the full-screen wallpaper, and the unfolding angle of the foldable display screen in the intermediate state.
[0128] S62: Play a first animation while the foldable display screen changes from a first physical state to a second physical state.
[0129] The second physical state of the foldable display screen may be one of the following states: unfolded state, folded state, intermediate state. Taking the foldable display screen as an outer folding screen or an inner folding screen as an example, when the first physical state is a folded state, the second physical state is an intermediate state or an unfolded state, and accordingly, the process of changing from the first physical state to the second physical state is the unfolding process of the foldable display screen; when the first physical state is an unfolded state, the second physical state is an intermediate state or a folded state, and accordingly, the process of changing from the first physical state to the second physical state is the folding process of the foldable display screen; when the first physical state is a certain intermediate state (the first intermediate state), the second physical state is an unfolded state or a folded state or another intermediate state (the second intermediate state). Among them, the unfolding angles of the foldable display screens in the first intermediate state and the second intermediate state are different. When the unfolding angle of the first intermediate state is less than the unfolding angle of the second intermediate state, the process of changing from the first physical state to the second physical state is the unfolding process of the foldable display screen, otherwise it is the folding process of the foldable display screen.
[0130] In a possible implementation of an embodiment of the present application, an electronic device may generate a first animation in response to a change of a foldable display screen from a first physical state to a second physical state, such that each animation frame in the first animation is related to the change of the physical state of the foldable display screen, so that the first animation may match the current change of the physical state of the foldable display screen.
[0131] The first animation includes multiple animation frames arranged in chronological order, each animation frame is a user interface, and the user interface includes wallpaper, and optionally, may also include one or more interface elements (such as desktop icons, desktop widgets, text, pictures, etc.). The multiple animation frames are displayed one by one in chronological order to achieve an animation display effect of the user interface.
[0132] In the embodiment of the present application, the first animation frame in the first animation is the user interface displayed in the first physical state, and the wallpaper in the user interface is the first area of the first wallpaper. The last animation frame is the user interface displayed in the second physical state, and the wallpaper in the user interface is the fourth area of the first wallpaper. Accordingly, during the change of the foldable display screen from the first physical state to the second physical state, the wallpaper displayed on the screen gradually changes from the first area of the first wallpaper to the fourth area of the first wallpaper.
[0133] Exemplary, combined Figure 7 , during the unfolding process of the foldable display screen, the wallpaper in the first animation frame and the last animation frame in the first animation may include the following situations:
[0134] Case 1: When the first physical state changes from the folded state to the expanded state, the wallpaper of the first animation frame in the first animation is as follows: Figure 7 The wallpaper area 703 (i.e., the first area of the first wallpaper) shown in FIG. c in FIG. 1 and the wallpaper of the last animation frame in the first animation are as follows: Figure 7 The wallpaper area 701 shown in FIG. a (i.e., the fourth area of the first wallpaper);
[0135] Case 2: When the first physical state changes from the folded state to the intermediate state, the wallpaper of the first animation frame in the first animation is as follows: Figure 7 The wallpaper area 703 (i.e., the first area of the first wallpaper) shown in FIG. c in FIG. Figure 7 The wallpaper area 702 shown in FIG. b (i.e., the fourth area of the first wallpaper);
[0136] Case 3: When the first physical state changes from the intermediate state to the expanded state, the wallpaper of the first animation frame in the first animation is as follows: Figure 7 The wallpaper area 702 (i.e., the first area of the first wallpaper) shown in FIG. b, the last animation frame is as follows Figure 7 The wallpaper area 701 shown in FIG. a (i.e., the fourth area of the first wallpaper);
[0137] Case 4: When the first physical state changes from the expanded state to the folded state, the wallpaper of the first animation frame in the first animation is as follows: Figure 7 The wallpaper area 701 (i.e., the first area of the first wallpaper) shown in FIG. a, the last animation frame is as follows Figure 7 The wallpaper area 703 shown in Figure c (i.e., the fourth area of the first wallpaper);
[0138] Case 5: When the first physical state changes from the expanded state to the intermediate state (i.e., the first area of the first wallpaper), the wallpaper of the first animation frame in the first animation is as follows: Figure 7 The wallpaper area 701 shown in Figure a in FIG. Figure 7 The wallpaper area 702 shown in FIG. b (i.e., the fourth area of the first wallpaper);
[0139] Case 6: When the first physical state changes from the intermediate state to the folded state, the wallpaper of the first animation frame in the first animation is as follows: Figure 7 The wallpaper area 702 (i.e., the first area of the first wallpaper) shown in FIG. b, the last animation frame is as follows Figure 7 The wallpaper area 703 shown in Figure c (i.e., the fourth area of the first wallpaper);
[0140] Situation 7: When the first physical state changes from being a first intermediate state to being a second intermediate state, the wallpaper of the first animation frame in the first animation is a local area of the first wallpaper (i.e., the first area of the first wallpaper), and the wallpaper of the last animation frame is another local area of the first wallpaper (i.e., the fourth area of the first wallpaper).
[0141] Optionally, for any two animation frames in the first animation, such as the first frame and the second frame (the first frame and the second frame may be adjacent animation frames or non-adjacent animation frames), the wallpaper in the first frame is the second area of the first wallpaper, and the wallpaper in the second frame is the third area of the first wallpaper, and the size of the second area and the third area and the position in the first wallpaper are related to the unfolding angle of the foldable display. Optionally, the larger the unfolding angle of the foldable display, the larger the screen display area, and accordingly, the larger the size of the wallpaper in the user interface displayed on the screen.
[0142] Taking the unfolding process of the above-mentioned situation 1 (i.e., changing from the first physical state of the folded state to the second physical state of the unfolded state) as an example, Figure 8 The principle and effect of dynamic wallpaper display during the unfolding of the foldable display are shown, wherein: Figure 8 The left column of diagrams shows the position and size of the wallpaper in each animation frame relative to the full-screen wallpaper, and the right column of diagrams shows the screen display effects corresponding to each animation frame. Figure 8 As shown, the first animation includes n animation frames in chronological order: animation frame 1, animation frame 2, animation frame 3, ..., animation frame n-2, animation frame n-1, animation frame n. If the position of the wallpaper boundary displayed on the right side of the main screen in the full-screen wallpaper is used to represent the position of the wallpaper in the animation frame relative to the full-screen wallpaper, then:
[0143] Animation frame 1: the screen display area where this frame is located only includes the first screen part (main screen) display area, and the right side of the wallpaper in animation frame 1 is located at the designated position 1 in the full-screen wallpaper, that is, the wallpaper in animation frame 1 is area 1 in the full-screen wallpaper (such as the oblique line filled area in the figure);
[0144] Animation frame 2: The screen display area where this frame is located includes the first screen part (main screen) and a small part of the second screen part (auxiliary screen). The right side of the wallpaper in animation frame 2 is located at position 2 in the full-screen wallpaper, that is, the wallpaper in animation frame 2 is area 2 in the full-screen wallpaper (such as the oblique line filled area in the figure); wherein, position 2 is to the right of position 1, and the size of area 2 is larger than that of area 1;
[0145] Animation frame 3: the screen display area where this frame is located includes the first screen part (main screen) display area and a small part of the second screen part (auxiliary screen). The right side of the wallpaper in animation frame 3 is located at position 3 in the full-screen wallpaper, that is, the wallpaper in animation frame 3 is area 3 in the full-screen wallpaper (such as the oblique line filled area in the figure); wherein, position 3 is to the right of position 2, and the size of area 3 is larger than that of area 2;
[0146] Similarly, animation frame n-1: the screen display area where this frame is located includes the first screen part (main screen) display area and a large part of the second screen part (auxiliary screen), and the right side of the wallpaper in animation frame n-1 is located at position n-1 in the full-screen wallpaper, that is, the wallpaper in animation frame n-1 is area n-1 in the full-screen wallpaper (such as the oblique line filled area in the figure); wherein, position n-1 is to the right of position n-2, and the size of area n-1 is larger than the size of area n-2;
[0147] Animation frame n: The screen display area where this frame is located includes the first screen part and the second screen part. The right edge of the wallpaper in animation frame n is aligned with the right edge of the full-screen wallpaper, that is, the wallpaper in animation frame n is the entire area of the full-screen wallpaper (such as the diagonal filled area in the figure).
[0148] Optionally, the sizes of two adjacent animation frames may be the same, and accordingly, the sizes of the wallpapers in the two animation frames are also the same. For example, when the unfolding angle of the foldable display increases by a set increment (for example, by 1 degree), the screen display size increases by a corresponding size, and if the change in the unfolding angle in the time interval between two adjacent animation frames does not reach the set increment, the sizes of the two adjacent animation frames are the same.
[0149] Figure 8In the screen display effect shown in the right column of schematic diagrams, the black filled area is the area blocked by the mask. According to the wallpaper dynamic display principle shown in the left column of schematic diagrams, combined with the screen display effect shown in the right column of schematic diagrams, from the user's visual perspective, as the foldable display screen gradually unfolds, the wallpaper displayed on the screen gradually moves to the left (that is, the right part of the full-screen wallpaper gradually enters the main screen, that is, enters the user's field of view), and the size of the wallpaper gradually increases until it is fully unfolded, the rightmost edge of the full-screen wallpaper coincides with the right edge of the display area of the first screen portion, and the size of the wallpaper is the size of the full-screen wallpaper, thereby achieving the dynamic display effect of the wallpaper during the unfolding of the foldable display screen, thereby improving the user experience.
[0150] It should be noted that in Figure 1A In the folding method shown, in the folded state, the wallpaper displayed on the main screen of the foldable display is located at the rightmost part of the full-screen wallpaper (that is, the right side of the displayed wallpaper coincides with the right side of the full-screen wallpaper). During the expansion process, in each animation frame in the first animation, the position of the wallpaper remains unchanged (that is, the right side of the wallpaper in the animation frame always coincides with the right side of the full-screen wallpaper). However, as the expansion angle gradually increases, the screen display area gradually increases, and the left side of the full-screen wallpaper gradually appears, until it is fully expanded, and the entire area of the full-screen wallpaper is all presented in the screen display area, thereby realizing the dynamic display effect of the wallpaper during the expansion of the foldable display.
[0151] Taking the folding process of the above-mentioned situation 4 (i.e., changing from the first physical state of the unfolded state to the second physical state of the folded state) as an example, Fig. 9 The principle and effect of dynamic wallpaper display during the folding process of the foldable display are shown, wherein: Fig. 9 The left column of diagrams shows the position and size of the wallpaper in each animation frame relative to the full-screen wallpaper, and the right column of diagrams shows the screen display effects corresponding to each animation frame. Fig. 9 As shown, the first animation includes n animation frames in chronological order: animation frame 1, animation frame 2, animation frame 3, ..., animation frame n-2, animation frame n-1, animation frame n. During the folding process, the position and size of each animation frame in the first animation change as Figure 8 The unfolding process shown is the opposite, that is, the position of the wallpaper gradually moves until it moves to the wallpaper position displayed on the main screen in the folded state, and the size of the wallpaper gradually decreases from the full-screen size to the small-screen size in the folded state.
[0152] Fig. 9In the screen display effect shown in the right column of schematic diagrams, the black filled area is the area blocked by the mask. According to the wallpaper dynamic display principle shown in the left column of schematic diagrams, combined with the screen display effect shown in the right column of schematic diagrams, from the user's visual perspective, as the foldable display is gradually folded, the wallpaper displayed on the screen gradually moves to the right (that is, the right part of the full-screen wallpaper gradually exits the main screen, that is, exits the user's field of view), and the size of the wallpaper gradually becomes smaller, until after it is completely folded, the first screen part displays the local area of the specified position in the full-screen wallpaper, thereby realizing the dynamic display effect of the wallpaper during the folding process of the foldable display, thereby improving the user experience.
[0153] It should be noted that in Figure 1A In the folding method shown, in the folded state, the wallpaper displayed on the main screen of the foldable display is located at the rightmost part of the full-screen wallpaper (that is, the right side edge of the displayed wallpaper coincides with the right side edge of the full-screen wallpaper). During the folding process, in each animation frame in the first animation, the position of the wallpaper remains unchanged (that is, the right side edge of the wallpaper in the animation frame always coincides with the right side edge of the full-screen wallpaper). However, as the unfolding angle gradually decreases, the screen display area gradually decreases, and the left side of the full-screen wallpaper is gradually blocked by the mask, until it is completely folded, and only the rightmost area of the full-screen wallpaper is presented in the screen display area, thereby realizing the dynamic display effect of the wallpaper during the unfolding process of the foldable display.
[0154] According to the same principle, when the first physical state and the second physical state are other states, a similar wallpaper dynamic display effect can also be achieved in the process of changing from the first physical state to the second physical state.
[0155] It should be noted that the above is based on Figure 1A The folding method shown is described as an example. Based on the same principle, in other folding methods, such as Figure 1B or Figure 1C In the folding method shown, a dynamic display effect of the wallpaper can also be achieved.
[0156] S63: When the foldable display screen is in the second physical state, the foldable display screen displays a fourth area of the full-screen wallpaper, where the fourth area of the full-screen wallpaper is the wallpaper in the last animation frame of the first animation.
[0157] Since the first frame in the first animation frame corresponds to the first physical state, it is the user interface displayed in the first physical state (i.e., the starting state of the change), and the last frame corresponds to the second physical state, it is the user interface displayed in the second physical state (i.e., the ending state of the change), and from the first frame to the last frame, the position and size of the wallpaper gradually change, so from the user's visual perspective, the change process is smooth and coherent, which can bring a good user experience to the user.
[0158] It should be noted that Figure 6a In the process shown, the operation of generating the first animation can be implemented in the application framework layer in the electronic device software architecture, for example, it can be implemented by the system service module in the application framework layer. Implementing the wallpaper animation effect in the application framework layer instead of implementing the animation effect by the application can avoid increasing the adaptation work of the application in the application layer, and is beneficial to promotion and use.
[0159] Above Figure 6a In the process shown, the first animation is played during the process of the foldable display screen of the electronic device changing from the first physical state to the second physical state, so that the animation can be displayed when the physical state of the screen changes. For any two animation frames (the first frame and the second frame) in the first animation, the wallpaper in the first frame is the second area of the first wallpaper (such as the full-screen wallpaper), and the wallpaper in the second frame is the third area of the first wallpaper. The size of the second area and the third area and the position in the first wallpaper are related to the unfolding angle of the foldable display screen. Therefore, as the unfolding angle of the foldable display screen gradually changes, the size of the wallpaper displayed on the screen and its position in the full-screen wallpaper also change, thereby realizing the dynamic change effect of the wallpaper during the change of the physical state of the foldable display screen.
[0160] In one possible implementation, Figure 6a The process of generating the first animation in step 62 can be seen in Figure 6b The process shown.
[0161] Optional, such as Figure 6b As shown, the process of generating the first animation may include:
[0162] S621: Determine wallpaper position change information according to the first position and the second position, wherein the first position is the position of the wallpaper displayed on the first screen portion (such as the main screen) of the foldable display screen in the first physical state in the first wallpaper, and the second position is the position of the wallpaper displayed on the first screen portion (such as the main screen) in the first wallpaper in the second physical state.
[0163] The wallpaper position change information may include: a displacement size and a displacement direction from a first position to a second position.
[0164] by Figure 8 Taking the unfolding process shown in the figure as an example, the first position is the position of the right border of the wallpaper displayed on the main screen in the folded state in the full-screen wallpaper, and the second position is the position of the right border of the wallpaper displayed on the main screen in the unfolded state in the full-screen wallpaper. According to the first position and the second position, it can be determined that the displacement direction is moving to the right, and the total displacement size is Figure 8The distance between "position 1" and "position n" in .
[0165] by Fig. 9 Taking the folding process shown in the figure as an example, the first position is the position of the right border of the wallpaper displayed on the main screen in the expanded state in the full-screen wallpaper, and the second position is the position of the right border of the wallpaper displayed on the main screen in the folded state in the full-screen wallpaper. According to the first position and the second position, it can be determined that the displacement direction is moving to the left, and the total displacement size is Fig. 9 The distance between "position 1" and "position n" in .
[0166] S622: Generate a first animation according to the wallpaper position change information, the unfolding angle of the foldable display screen, and the motion effect parameters of the first animation.
[0167] Optionally, the animation parameters include but are not limited to parameters such as playback duration, animation curve, and animation mode. Among them, the playback duration can be understood as: the duration used to play the animation corresponding to the entire unfolding process from the unfolded state to the folded state, or the duration used to play the animation corresponding to the entire folding process from the folded state to the unfolded state. The animation curve represents the dynamic display effect of the animation. Exemplarily, the animation curve can be a straight line, such as the displacement of the same element on two adjacent animation frames in the animation is the same; or, the animation curve can be a curve (such as a parabola), such as the displacement of the same element on two adjacent animation frames in the first animation is different, for example, the displacement of the same content on the first two adjacent animation frames is small, and as the number of frames increases, the displacement of the same content on the two adjacent animation frames gradually increases, and the displacement of the same content on the last few adjacent animation frames gradually decreases. The animation mode may include a transparency change mode, and for example, the animation mode may include fade in and fade out.
[0168] The number of frames of the first animation is related to the change in the unfolding angle of the foldable display screen. The electronic device can determine the playback duration of the first animation according to the playback duration and the degree of state change (the degree of state change represents the degree of change in the unfolding angle of the foldable display screen) included in the motion effect parameters.
[0169] In a possible implementation method of determining the playback duration of the first animation, when the second physical state is a folded state or an unfolded state, regardless of whether the first physical state is an intermediate state or a non-intermediate state (such as a folded state or an unfolded state), the playback duration of the first animation is equal to the playback duration included in the animation parameters.
[0170] In another possible implementation of determining the playback duration of the first animation, when the second physical state is a folded state or an unfolded state, when the first physical state is an intermediate state, because the unfolding angle of the foldable display screen does not change by 180°, but is less than 180°, in order to adapt to the change in the unfolding angle of the foldable display screen, the playback duration of the first animation can be adaptively reduced. Exemplarily, the electronic device can first obtain the angle difference of the unfolding angle from the first physical state (such as the folded state or the unfolded state) to the intermediate state, determine the ratio of the angle difference to the maximum span, and then multiply the playback duration in the motion effect parameter by the ratio to obtain the playback duration of the first animation. Among them, the maximum span refers to the change in the degree of unfolding of the foldable display screen from the folded state to the unfolded state, or the change in the unfolding angle of the foldable display screen from the unfolded state to the folded state, and the maximum span is usually 180 degrees.
[0171] In another possible implementation method of determining the playback duration of the first animation, when the first physical state and the second physical state are both intermediate states, the electronic device can first obtain the angle difference of the expansion angle from the first physical state (such as the first intermediate state) to the second physical state (such as the second intermediate state), determine the ratio of the angle difference to the maximum expansion width, and then multiply the playback duration in the motion effect parameters by the ratio to obtain the playback duration of the first animation.
[0172] After obtaining the playback duration of the first animation, the electronic device can determine the number of frames of the first animation according to the playback duration of the first animation and the refresh rate of the electronic device. It can be understood that the refresh rate of an electronic device is related to the number of frames that the electronic device can display within a unit time. For example, if the refresh rate of an electronic device is 60Hz, the electronic device can display a frame every 16.67ms. For example, the number of frames of the first animation is equal to the quotient obtained by dividing the playback duration of the first animation by the refresh rate of the electronic device. Further, the quotient can be rounded, and the rounded value is the number of frames of the first animation. For example, if the refresh rate of the electronic device is 60Hz and the playback duration of the first animation is 500ms, the number of frames of the first animation is 29.
[0173] Optionally, after obtaining the playback duration and number of frames of the first animation, in S622, the electronic device generates a possible implementation of the first animation according to the wallpaper position change information, the unfolding angle of the foldable display screen, and the motion effect parameters of the first animation, such as Figure 6c As shown, including:
[0174] S6221: Determine a wallpaper size in each animation frame in the first animation according to an unfolding angle of the foldable display screen during a process from the first physical state to the second physical state.
[0175] The wallpaper size of the animation frame in the first animation is related to the unfolding angle of the foldable display. In a possible implementation, the correspondence between various unfolding angles and the size of the screen display area can be preset, and the electronic device can query the correspondence according to the unfolding angle of the foldable display to obtain the corresponding screen display area size, which is the size of the wallpaper.
[0176] In another possible implementation, the electronic device can multiply the size of the screen display area in the unfolded state by a ratio value related to the current unfolding angle to obtain the size of the screen display area at the current unfolding angle, and the screen display area size is also the wallpaper size in the animation frame at the current unfolding angle. The ratio value is the ratio of the current unfolding angle to the unfolding angle (180 degrees) in the unfolded state. For example, the relationship between the unfolding angle and the screen display area size may include (where S is the size of the screen display area in the unfolded state):
[0177] Expand angle 180 degrees, S*100%;
[0178] The unfolding angle is 150 degrees, S*92%;
[0179] The unfolding angle is 120 degrees, S*84%;
[0180] The expansion angle is 90 degrees, S*75%;
[0181] The unfolding angle is 60 degrees, S*67%;
[0182] The unfolding angle is 30 degrees, S*59%;
[0183] Expand angle 0 degrees, S*50%.
[0184] S6222: Determine the position of the wallpaper in each animation frame in the first animation in the first wallpaper according to the wallpaper position change information and the motion effect parameters of the first animation.
[0185] After obtaining the number of frames of the first animation, the electronic device can determine the position of the wallpaper in each animation frame in the first animation relative to the first wallpaper according to the number of frames of the first animation, the motion curve, and the wallpaper position change information obtained in S621. For example, when the motion curve is a straight line, the electronic device divides the displacement from the first position to the second position determined in S621 by the number of frames of the first animation to obtain the position of the wallpaper in each animation frame relative to the first wallpaper, wherein the position difference of the wallpaper in two adjacent animation frames relative to the first wallpaper is equal; for another example, when the motion curve is a curve, in chronological order, the position difference of the wallpaper in two adjacent animation frames relative to the first wallpaper may gradually increase or decrease, or first increase gradually and then decrease gradually, or conform to other change rules, which depends on the type of motion curve (such as parabola or other curve types).
[0186] S6223: Determine the area of the wallpaper in each animation frame in the first wallpaper according to the size of each animation frame in the first animation and the position of the wallpaper in each animation frame in the first wallpaper.
[0187] For example, during the unfolding process of the foldable display screen, the position of the wallpaper in each animation frame in the first animation relative to the full-screen wallpaper and the size of the wallpaper can be referred to in Figure 8 ; During the folding process of the foldable display screen, the position of the wallpaper in each animation frame in the first animation relative to the full-screen wallpaper and the size of the wallpaper can be found in Fig. 9 .
[0188] Taking the dynamic effect curve as a straight line as an example, from the folded state to the unfolded state, the total displacement of the wallpaper position d = the distance between position 1 and position n, and the wallpaper displacement Δ corresponding to each animation frame = total displacement d / number of frames n of the first animation. In the process from the folded state to the unfolded state, when the unfolding angle reaches 30 degrees, if the current animation frame is the i-th frame, the wallpaper displacement corresponding to the i-th frame can be calculated according to the above method. In addition, the current wallpaper size can be determined as S*59% through the above correspondence. In this way, when the unfolding angle reaches 30 degrees, the position of the wallpaper in the display screen relative to the full-screen wallpaper and the size of the wallpaper can be determined. In other words, at this unfolding angle, which part of the display screen needs to display the entire wallpaper can be determined.
[0189] S6224: Generate a first animation according to an area of the wallpaper in each animation frame in the first wallpaper.
[0190] In a possible implementation, in the process of generating the first animation, the electronic device may not need to repeatedly draw the wallpaper in each animation frame, but may change the position and size of the mask in the display plane (surface) where the first wallpaper is located according to the area of the wallpaper in each animation frame in the first animation in the first wallpaper, and accordingly, the visible area in the display plane also changes, and the visible area is the wallpaper in the animation frame, so that the wallpaper in each animation frame can be obtained. In this way, on the one hand, by changing the position of the mask in the display plane (surface) where the first wallpaper is located, the visual effect of moving the wallpaper can be achieved, and on the other hand, the processing delay of the animation frame can be shortened, the processing overhead can be reduced, and the generation efficiency can be improved. Among them, in the display plane (surface) where the first wallpaper is located, the part that is not blocked by the "mask" is the visible part, and the part blocked by the mask is usually invisible. The operation of repeatedly drawing the wallpaper for each animation frame can be saved, thereby reducing the system overhead.
[0191] For example, Figure 8 The unfolding process of the foldable display is shown and Fig. 9 Taking the folding process shown as an example, the size of the display plane (surface) where the full-screen wallpaper is located is the same as the size of the full-screen wallpaper. In the display plane (surface) where the full-screen wallpaper corresponding to each animation frame is located, the white filled area is the area where the mask is located.
[0192] In one possible implementation, the electronic device may determine the transparency of the wallpaper in each animation frame of the first animation according to the number of frames of the first animation and the motion curve in the process of generating the first animation. Exemplarily, if the motion curve is a straight line, the difference in transparency of the wallpaper in two adjacent animation frames is equal. Exemplarily, in the process of the foldable display screen unfolding from the folded state to the unfolded state, the electronic device may process the wallpaper in the animation frame so that the transparency gradually increases and then gradually decreases, so as to achieve the effect of the wallpaper gradually blurring and gradually becoming clear.
[0193] In a possible implementation, if the user interface includes other interface elements in addition to the wallpaper, the electronic device further determines the positions and / or sizes of these elements in each animation frame, and includes these elements in the generated animation frame.
[0194] In a possible implementation, after obtaining the position and / or size of the elements in each animation frame in the first animation, the electronic device can synthesize the elements into one animation frame by layer synthesis to obtain each animation frame. For example, for one animation frame, the layer synthesis module can perform layer synthesis on the elements rendered in the animation frame to obtain the animation frame. According to the same processing method, multiple continuous animation frames can be obtained, that is, the first animation is generated.
[0195] In a possible implementation, the motion effect parameters used to generate the first animation are set by the system, and the motion effect parameters are used as the system default motion effect parameters to generate the first animation when the foldable display changes from the first physical state to the second physical state. During the unfolding process or folding process of the foldable display, the system service module in the electronic device can generate the first animation according to the system default motion effect parameters. The motion effect parameters are set by the system, and a unified dynamic display effect can be achieved for different applications.
[0196] In a possible implementation, the motion effect parameters used to generate the first animation are provided by an application (such as a third-party application), so that the application can control the dynamic effects of the first animation through the motion effect parameters. Exemplarily, after the desktop launcher is started, the system service module is notified to turn off the system default motion effect function, and the wallpaper's motion effect parameters (such as motion effect time, motion effect curve, mask parameters, etc.) are notified to the system service module, so that the system service module can generate the first animation according to the motion effect parameters set by the application during the process of the foldable display changing from the first physical state to the second physical state. The motion effect parameters are set by the application, so that different applications can set the motion effect parameters as needed, thereby improving flexibility.
[0197] In a possible implementation, the wallpaper displayed on the foldable display is a dynamic wallpaper. The dynamic wallpaper includes a wallpaper frame sequence, and the wallpaper frame sequence includes at least two wallpaper animation frames. The wallpaper animation frames in the wallpaper frame sequence are displayed in sequence at a set frame rate to produce an animation effect. Optionally, the wallpaper animation frames in the wallpaper frame sequence have the same size. Optionally, the size of the wallpaper animation frame in the wallpaper frame sequence is the screen display size when the foldable display is unfolded.
[0198] When using dynamic wallpaper, the position of the wallpaper in each animation frame in the first animation relative to the full-screen wallpaper and the size of the wallpaper can be determined according to the method in the aforementioned embodiment. In addition, it is also necessary to determine the correspondence between the wallpaper in each animation frame in the first animation and the wallpaper animation frame in the wallpaper frame sequence, that is, it is necessary to determine which wallpaper animation frame in the wallpaper frame sequence is used in each animation frame in the first animation.
[0199] Exemplarily, in the process of generating the first animation, in addition to determining the wallpaper position change information in the manner of the aforementioned embodiment, it is also necessary to determine the correspondence between the wallpaper in each animation frame in the first animation and the wallpaper animation frame in the wallpaper frame sequence. When generating the first animation, it is necessary to generate the first animation based on the wallpaper position change information, the unfolding angle of the foldable display screen, the motion effect parameters of the first animation, and the correspondence between each animation frame in the first animation and the wallpaper animation frame in the wallpaper frame sequence.
[0200] Optionally, the correspondence between the wallpaper in each animation frame in the first animation and the wallpaper animation frame in the wallpaper frame sequence is: the animation frames in the first animation correspond one-to-one to the wallpaper animation frames in the wallpaper frame sequence, and the wallpaper of the first animation frame in the first animation is the mth frame in the wallpaper frame sequence (m is an integer greater than or equal to 1), and the mth frame is the wallpaper displayed when the foldable display is in the first physical state. In other words, the wallpaper of the first animation frame in the first animation is the mth frame in the wallpaper frame sequence, and the kth animation frame after the first animation frame in the first animation frame is the m+(k-1)th frame in the wallpaper frame sequence.
[0201] Optionally, if the wallpaper of the kth animation frame in the first animation is the last wallpaper animation frame in the wallpaper frame sequence, then the wallpaper of the k+1th animation frame in the first animation is the first wallpaper animation frame in the wallpaper frame sequence. In other words, if the wallpaper in a certain animation frame in the first animation is already the last wallpaper animation frame in the wallpaper frame sequence, then the wallpaper in the next animation frame in the first animation uses the first wallpaper animation in the wallpaper frame sequence, and so on.
[0202] The following is a specific example to illustrate the correspondence between the animation frames in the first animation and the wallpaper animation frames in the wallpaper frame sequence when the physical state of the foldable display changes when using dynamic wallpaper. In this example, the wallpaper frame sequence of the dynamic wallpaper includes 5 wallpaper animation frames, the first animation includes 10 animation frames, and the wallpaper displayed on the foldable display in the first physical state is the second wallpaper animation frame. The correspondence between each animation frame in the first animation and each wallpaper animation frame in the wallpaper frame sequence is:
[0203] The first animation frame in the first animation uses the second wallpaper animation frame in the wallpaper frame sequence;
[0204] The second animation frame in the first animation uses the third wallpaper animation frame in the wallpaper frame sequence;
[0205] The third animation frame in the first animation uses the fourth wallpaper animation frame in the wallpaper frame sequence;
[0206] The 4th animation frame in the first animation uses the 5th wallpaper animation frame in the wallpaper frame sequence;
[0207] The fifth animation frame in the first animation uses the first wallpaper animation frame in the wallpaper frame sequence;
[0208] The sixth animation frame in the first animation uses the second wallpaper animation frame in the wallpaper frame sequence;
[0209] The 7th animation frame in the first animation uses the 3rd wallpaper animation frame in the wallpaper frame sequence;
[0210] The 8th animation frame in the first animation uses the 4th wallpaper animation frame in the wallpaper frame sequence;
[0211] The 9th animation frame in the first animation uses the 5th wallpaper animation frame in the wallpaper frame sequence;
[0212] The 10th animation frame in the first animation uses the 1st wallpaper animation frame in the wallpaper frame sequence.
[0213] According to the above description, when using dynamic wallpaper, the above embodiments of the present application can also achieve a dynamic display effect of the wallpaper during the process of the physical state of the foldable display changing, thereby improving the user experience.
[0214] The following is based on Figure 6a The process shown, combined with Figure 5 The system architecture shown illustrates the display process provided in the embodiment of the present application.
[0215] See also Fig.10 , is a process of a display method during a physical state change of a foldable display screen provided in an embodiment of the present application. As shown in the figure, the process may include the following steps:
[0216] Step 1: In response to a first operation, a physical state of the foldable display changes.
[0217] The first operation is used to trigger the foldable display to unfold or fold, that is, to trigger the foldable display to change from a first physical state to a second physical state. Exemplarily, the first operation may be one of the following operations:
[0218] -The user manually expands or folds the screen;
[0219] -The user operates a control on the interface or a physical button on the electronic device to trigger the screen to expand or fold.
[0220] -User's voice instructions, such as the user saying "unfold the screen", to trigger the screen to unfold by voice.
[0221] Step 2: During the change of the physical state of the foldable display screen, the angle detection module detects the unfolding angle of the foldable display screen.
[0222] Optionally, the unfolding angle of the foldable display can be obtained by detecting the angle of the hinge. For example, the hinge detection module collects the angle of the hinge, and the hinge movement (such as the opening and closing of the hinge) will cause the opening and closing state of the foldable display to change, that is, the physical state of the foldable display will change. Therefore, in the process of the foldable display changing from a first physical state to a second physical state, the hinge detection module can collect the angle of the hinge to facilitate monitoring the physical state of the foldable display. It should be understood that the angle of the hinge can characterize the unfolding angle of the foldable display.
[0223] Step 3: The angle monitoring module sends the detected deployment angle to the status monitoring service.
[0224] Step 4: The state monitoring service obtains the physical state of the foldable display and the physical state change information of the foldable display according to the unfolding angle.
[0225] In the process of the foldable display changing from the first physical state to the second physical state, the state monitoring service determines the second physical state of the foldable display according to the angle detected by the angle detection module. For example, when the angle is 0°, the second physical state of the foldable display can be determined to be the folded state, when the angle is 180°, the second physical state of the foldable display can be determined to be the unfolded state, and when the angle is greater than 0° and less than 180°, the second physical state of the foldable display can be determined to be the intermediate state.
[0226] It is conceivable that when the foldable display changes from other physical states to the first physical state, based on the above description, the angle detection module can also send the unfolding angle to the state monitoring service, so the state monitoring service can store the unfolding angle of the foldable display when it is in the first physical state. The state monitoring service can obtain the physical state change information of the foldable display according to the unfolding angle of the foldable display when it is in the first physical state (referred to as the first angle) and the unfolding angle of the foldable display when it is in the second physical state (referred to as the second angle), and the physical state change information is used to characterize the unfolding or folding of the foldable display. Among them, when the second angle is greater than the first angle, the state monitoring service can determine that the screen is unfolded, and accordingly, the physical state change information of the screen is used to characterize the unfolding of the screen. When the second angle is less than the first angle, the state monitoring service can determine that the screen is folded, and accordingly, the physical state change information of the screen is used to characterize the folding of the screen.
[0227] Step 5: The status monitoring service sends a first message to the wallpaper setting service module.
[0228] The first message may include information about a change in the physical state of the screen. Furthermore, the first message may also include an unfolding angle of the foldable display screen.
[0229] Step 6: The wallpaper setting service module determines the first position, the second position, and the wallpaper position change information from the first position to the second position according to the physical state change information, the unfolding angle of the foldable display screen and other information included in the first message.
[0230] The first position is the position of the wallpaper displayed on the first screen portion (such as the main screen) of the foldable display screen in the first physical state, and the second position is the position of the wallpaper displayed on the first screen portion (such as the main screen) in the first wallpaper in the second physical state. The wallpaper position change information may include: the displacement size and displacement direction from the first position to the second position.
[0231] Step 7: The wallpaper setting service module sends a second message to the system service module, where the second message includes the first position, the second position, and wallpaper position change information from the first position to the second position.
[0232] Step 8: The system service module obtains the system default motion effect parameters in response to the second message, and generates the first animation according to the position change information, motion effect parameters, expansion angle, etc.
[0233] Optionally, the system service module can obtain the window handle (WindowToken) of the wallpaper through the wallpaper controller (WallpaperController), and the window handle is used to uniquely identify the window; the system service module moves the display plane (surface) of the wallpaper according to the WindowToken of the wallpaper, so that the position of the wallpaper displayed on the first screen part (such as the main screen) in the foldable display screen in the first wallpaper is the first position in the first physical state; then, according to the animation time of the first animation and the screen expansion angle, the size of each animation frame in the first animation is determined, as well as the position of the wallpaper in each animation frame relative to the full-screen wallpaper, or in other words, the moving distance of the wallpaper surface is determined, thereby generating the first animation.
[0234] The system service module can generate each animation frame in the first animation according to the unfolding angle of the foldable display screen and the system default animation parameters (such as animation duration, animation curve, etc.). The generation method of the first animation can refer to the above embodiment.
[0235] Step 9: The system service module plays the first animation.
[0236] After generating the first animation, the system service module can control the foldable display to display the first animation. For example, each animation frame of the first animation can be displayed so that the display driver drives the display to play the first animation, thereby playing the first animation during the opening and closing process of the foldable display.
[0237] Exemplarily, the layer synthesis module synthesizes the background and other elements in the animation frame into layers, and after obtaining an animation frame, the animation frame can be stored in the buffer of the layer synthesis module. Displaying each animation frame of the first animation can be understood as follows: the layer synthesis module stores the animation frame obtained by layer synthesis in the buffer every 16.67ms (for example, when the refresh rate of the electronic device is 60Hz), and the display driver takes an animation frame from the buffer of the layer synthesis module every 16.67ms, and after taking the animation frame, drives the display screen to display the animation frame. In this way, the foldable display screen can continuously display the animation frames in the first animation, that is, the foldable display screen can play the first animation.
[0238] It should be noted that the above Fig.10 The process shown is only an example, and some steps in the above process may be optional steps. Some steps in the above process may also be recombined, and the application embodiment does not limit this.
[0239] The following is based on Figure 6a The process shown, combined with Figure 5 The system architecture shown illustrates the display process provided in the embodiment of the present application.
[0240] See also Fig.11 , which is a process of a display method during a physical state change of a foldable display screen provided in an embodiment of the present application.
[0241] In the scenario to which this process applies, the system opens an interface for enabling the generation of the first animation according to the motion effect parameters set by the application to the application (such as a third-party application). The application can set the motion effect parameters through the interface and provide them to the system, so that the system can realize the wallpaper dynamic effect during the physical state change of the foldable display according to the motion effect parameters set by the application. Exemplarily, the motion effect parameters set by the application through the interface may include motion effect time, motion effect curve, motion effect mask, etc.
[0242] like Fig.11 As shown, the process may include the following steps:
[0243] Step 0: After the desktop launcher is started, notify the system to turn off the default animation function and provide the animation parameters set by the application to the system service module.
[0244] After Launcher is started, if the application determines that it needs to enable the wallpaper dynamic effect function when the physical state of the screen changes, and the dynamic effect depends on the dynamic effect parameters set by the application, the system is notified to turn off the default dynamic effect function, and the dynamic effect parameters set by the application are provided to the system service module; if the application does not need to enable the above function, there is no need to notify the system to turn off the default dynamic effect function, and the dynamic effect parameters will not be provided to the system service module. In this way, during the process of the physical state of the foldable display changing, the system service module can adopt the following Fig.10 The first animation is generated in the manner shown and played.
[0245] Fig.11 The specific implementation of steps 1 to 9 in Fig.10 The corresponding steps in are basically the same, except that: in step 8, the system service module obtains the dynamic effect parameters set by the application, and generates the first animation according to the dynamic effect parameters set by the application.
[0246] An embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium is used to store a computer program. When the computer program is executed by a computer, the computer can implement the method provided in the above method embodiment.
[0247] An embodiment of the present application further provides a computer program product, which is used to store a computer program. When the computer program is executed by a computer, the computer can implement the method provided in the above method embodiment.
[0248] An embodiment of the present application also provides a chip, including a processor, wherein the processor is coupled to a memory and is used to call a program in the memory so that the chip implements the method provided by the above method embodiment.
[0249] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that include computer-usable program code.
[0250] The present application is described with reference to the flowchart and / or block diagram of the method, device (system), and computer program product according to the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the process and / or box in the flowchart and / or block diagram can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device produce a device for implementing the function specified in one process or multiple processes in the flowchart and / or one box or multiple boxes in the block diagram.
[0251] These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device that implements the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.
[0252] These computer program instructions may also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, whereby the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.
[0253] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.
Claims
1. A display method for an electronic device, applied to an electronic device with a foldable display screen, characterized in that: The method comprises: When the foldable display screen of the electronic device is in a first physical state, the wallpaper displayed on the foldable display screen is a first area of a first wallpaper; During the process of the foldable display changing from the first physical state to the second physical state, a first animation is generated and played, wherein the first animation includes a first frame and a second frame, the wallpaper in the first frame is the second area of the first wallpaper, the wallpaper in the second frame is the third area of the first wallpaper, and the sizes of the second area and the third area and the positions in the first wallpaper are related to the unfolding angle of the foldable display; wherein, during the process of the foldable display changing from the first physical state to the second physical state, the position of the wallpaper area displayed by the frames in the first animation in the first wallpaper gradually moves in a first direction, and in the first direction, the same-side boundaries of the second area and the third area are at different positions in the first wallpaper; When the foldable display screen is in the second physical state, the wallpaper displayed on the foldable display screen is the fourth area of the first wallpaper, and the fourth area is the wallpaper in the last animation frame in the first animation; The step of generating the first animation includes: In response to the foldable display changing from the first physical state to the second physical state, determining wallpaper position change information according to the first position and the second position; wherein the first position is the position of the wallpaper displayed on the first screen portion of the foldable display in the first wallpaper in the first physical state, and the second position is the position of the wallpaper displayed on the first screen portion in the first wallpaper in the second physical state; determining a size of the wallpaper in each animation frame according to an expansion angle corresponding to each animation frame in the first animation during a process from the first physical state to the second physical state; Determine the position of the wallpaper in each animation frame in the first animation in the first wallpaper according to the wallpaper position change information, the expansion angle corresponding to each animation frame in the first animation, and the motion effect parameters of the first animation; Determining the area of the wallpaper in each animation frame in the first wallpaper according to the size of the wallpaper in each animation frame in the first animation and the position of the wallpaper in each animation frame in the first wallpaper; The first animation is generated according to the area of the wallpaper in each animation frame in the first wallpaper.
2. The method according to claim 1, characterized in that The determining the area of the wallpaper in each animation frame in the first wallpaper according to the size of each animation frame in the first animation and the position of the wallpaper in each animation frame in the first wallpaper includes: According to the size of each animation frame in the first animation and the position of the wallpaper in each animation frame in the first wallpaper, the position and size of the mask in the display plane where the first wallpaper is located are changed to obtain the wallpaper in each animation frame, where the wallpaper in each animation frame is the visible area outside the masked area in the display plane where the first wallpaper is located.
3. The method according to claim 1, characterized in that The wallpaper is a dynamic wallpaper, and the dynamic wallpaper includes a wallpaper frame sequence, and the wallpaper frame sequence includes at least two wallpaper animation frames; The generating the first animation comprises: Determine wallpaper position change information according to the first position and the second position; wherein the first position is the position of the wallpaper displayed on the first screen portion of the foldable display screen in the first wallpaper in the first physical state, and the second position is the position of the wallpaper displayed on the first screen portion in the first wallpaper in the second physical state; Determining a correspondence between the wallpaper in each animation frame in the first animation and the wallpaper animation frame in the wallpaper frame sequence; The first animation is generated according to the wallpaper position change information, the unfolding angle of the foldable display screen, the motion effect parameters of the first animation, and the correspondence between each animation frame in the first animation and the wallpaper animation frame in the wallpaper frame sequence.
4. The method according to claim 3, characterized in that The corresponding relationship between the wallpaper in each animation frame in the first animation and the wallpaper animation frame in the wallpaper frame sequence is: The animation frames in the first animation correspond one-to-one to the wallpaper animation frames in the wallpaper frame sequence. The wallpaper of the first animation frame in the first animation is the mth frame in the wallpaper frame sequence. The mth frame is the wallpaper displayed on the foldable display screen in the first physical state, and m is an integer greater than or equal to 1.
5. The method according to claim 4, characterized in that If the wallpaper of the kth animation frame in the first animation is the last wallpaper animation frame in the wallpaper frame sequence, then the wallpaper of the k+1th animation frame in the first animation is the first wallpaper animation frame in the wallpaper frame sequence.
6. The method according to any one of claims 1 to 5, characterized in that: The first screen portion is a main screen in the foldable display screen.
7. The method according to any one of claims 1 to 6, characterized in that: The animation parameters include at least one of the following: playback duration, animation curve, and animation method.
8. The method according to any one of claims 1 to 7, characterized in that: When the first physical state is a folded state, the first position is a preset position in the first wallpaper.
9. The method according to any one of claims 1 to 8, characterized in that The method further comprises: Get the animation parameters set by the system.
10. The method according to any one of claims 1 to 8, characterized in that The method further comprises: Get the animation parameters set by the application.
11. The method according to any one of claims 1 to 10, characterized in that The foldable display screen includes any one of the following: an outer folding screen, an inner folding screen, and a scroll screen.
12. The method according to claim 11, characterized in that When the foldable display screen is an outer folding screen or an inner folding screen, the first physical state is a folded state, an intermediate state or an unfolded state, the intermediate state is a state between the folded state and the unfolded state, and the intermediate state includes at least one of a first intermediate state and a second intermediate state; When the first physical state is a folded state, the second physical state is an intermediate state or an unfolded state; When the first physical state is an unfolded state, the second physical state is an intermediate state or a folded state; When the first physical state is the first intermediate state, the second physical state is the unfolded state or the folded state or the second intermediate state.
13. An electronic device, characterized in that: include: Foldable display, one or more processors; The one or more memories store one or more computer programs, and the one or more computer programs include instructions. When the instructions are executed by the one or more processors, the electronic device executes the method according to any one of claims 1 to 12.
14. A computer-readable storage medium, characterized in that: The method comprises a computer program, and when the computer program is run on an electronic device, the electronic device is caused to execute the method according to any one of claims 1 to 12.
15. A computer program product, characterized in that When the method is executed on an electronic device, the electronic device is enabled to execute the method according to any one of claims 1 to 12.
16. A chip system, characterized in that: include: a memory for storing computer programs; a processor; When the processor calls and runs the computer program from the memory, the electronic device equipped with the chip system executes the method as described in any one of claims 1 to 12.
Citation Information
Patent Citations
Display method and electronic equipment
CN112558898A
Display method and device, computer readable medium and electronic equipment
CN113206915A