Interface display method and foldable electronic device
By setting the connection between the image frame sequence and the video frame in the interface display method of the foldable electronic device, the problem of the unsmooth connection between the modeling model and the video is solved, the smooth display of the 3D wallpaper in the foldable device is achieved, and the user's visual experience is improved.
Patent Information
- Application Number
- CN202410116056.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-01-26
- Publication Date
- 2025-09-05
- Estimated Expiration
- 2044-01-26
AI Technical Summary
When foldable electronic devices use 3D wallpaper, the connection between the model and the video is not smooth, resulting in an unsmooth display and affecting the user's visual experience.
By setting the connection between the image frame sequence and the video frame in the interface display method of the foldable electronic device, using sensors to detect the folding angle and posture angle of the device, and dynamically adjusting the viewing angle of the three-dimensional model, a smooth connection between the modeling model and the video is achieved.
When a foldable electronic device changes from a folded state to an unfolded state or vice versa, the 3D wallpaper can be displayed smoothly, enhancing the user's visual experience.
Smart Images

Figure CN119254866B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of electronic devices, and in particular to an interface display method and a foldable electronic device. Background Art
[0002] 3D wallpaper is a three-dimensional wallpaper that requires special modeling and rendering technologies to produce. Since the modeling model has the property of being non-deformable, when electronic devices use 3D wallpaper, they can only present the effect of changing the perspective based on the modeling model, but cannot change the size of the modeling model to present dynamic effects such as zooming in and out.
[0003] When using 3D wallpaper on foldable electronic devices, the inner and outer screens need to be switched when switching between folded and unfolded states, and the display content on the inner and outer screens has different sizes. Therefore, it is necessary to provide video-based zooming and shrinking effects in the 3D wallpaper to achieve the connection between the different-sized models on the inner and outer screens.
[0004] Currently, when applying 3D wallpapers to foldable electronic devices, there is a problem of unsmooth connection between the modeling model and the video, resulting in unsmooth display of the 3D wallpaper. Summary of the Invention
[0005] The embodiments of the present application provide an interface display method and a foldable electronic device, which can solve the problem of unsmooth connection between modeling model and video in the process of applying 3D wallpaper in current foldable electronic devices, resulting in unsmooth display of 3D wallpaper, thereby improving the user experience.
[0006] In a first aspect, an embodiment of the present application provides an interface display method, which is applied to a foldable electronic device, including: when the foldable electronic device is at a first folding angle, in response to the foldable electronic device lighting up the screen, the foldable electronic device displays a first image; in response to the foldable electronic device being folded from the first folding angle to a first angle interval, the foldable electronic device displays a first image frame sequence, and the content of the first image frame of the first image frame sequence is connected with the content of the first image, wherein the first folding angle is greater than any angle in the first angle interval; in response to the foldable electronic device being folded from the first angle interval to the second angle interval, the foldable electronic device plays a first video, and the content of the last image frame of the first image frame sequence is connected with the content of the first video frame, wherein any angle in the first angle interval is greater than any angle in the second angle interval.
[0007] The interface display method illustrated in the embodiment of the present application provides a smooth transition between the modeling model of the first image and the first video by placing a first image frame sequence between the first image and the first video. This allows the 3D wallpaper to be displayed smoothly as the foldable electronic device transitions from a fully unfolded state to a folded state.
[0008] In one implementation, in response to the foldable electronic device being folded from a first angle interval to a second angle interval, after the foldable electronic device plays a first video, the further method further includes: in response to the foldable electronic device being folded from the second angle interval to a third angle interval, the foldable electronic device displays a second image frame sequence, wherein the content of the last video frame of the first video is connected to the content of the first image frame of the second image frame sequence, wherein any angle in the second angle interval is greater than any angle in the third angle interval; and in response to the foldable electronic device being folded from the third angle interval to the second folding angle, the foldable electronic device displays a second image, wherein the content of the last image frame of the second image frame sequence is connected to the content of the second image, wherein any angle in the third angle interval is greater than the second folding angle. With this implementation, by setting the second image frame sequence between the second image and the first video, the modeling model of the second image is smoothly connected to the first video, so that the 3D wallpaper can be smoothly displayed during the process of the foldable electronic device further folding to the fully folded state.
[0009] In one implementation, a foldable electronic device displays a first image, including: determining, by the foldable electronic device, a first viewing angle of a first three-dimensional model based on a first posture angle, the first posture angle comprising a pitch angle, a roll angle, and a yaw angle when the foldable electronic device is at the first folded angle, the first three-dimensional model being used to generate the first image; and displaying, by the foldable electronic device, the first image based on the first viewing angle. This implementation illustrates a specific method for rendering the first image.
[0010] In one implementation, a foldable electronic device displays a second image, including: determining, by the foldable electronic device, a second viewing angle of a second three-dimensional model based on a second posture angle, the second posture angle comprising a pitch angle, a roll angle, and a yaw angle when the foldable electronic device is at the second folded angle, the second three-dimensional model being used to generate a second image; and displaying, by the foldable electronic device, the second image based on the second viewing angle. This implementation illustrates a specific method for rendering the second image.
[0011] In one implementation, after the foldable electronic device displays the first image according to the first perspective, the further step includes: in response to a change in the first posture angle of the foldable electronic device, the foldable electronic device acquiring a third posture angle, and determining a third perspective of the first three-dimensional model according to the third posture angle; and the foldable electronic device displaying the updated first image according to the third perspective. With this implementation, when the foldable electronic device is in a fully unfolded state, the foldable electronic device can render first images corresponding to different perspectives based on the same three-dimensional model based on different posture angles, thereby providing a 3D visual effect to the user and enhancing the user's visual experience.
[0012] In one implementation, in response to a foldable electronic device being folded from a first folding angle to a first angle interval, the foldable electronic device displays a first image frame sequence, including: when the foldable electronic device displays an updated first image according to a third viewing angle, the foldable electronic device displays the first image frame sequence, wherein the content of the first image frame of the first image frame sequence is connected to the content of the updated first image. With this implementation, when the foldable electronic device is in a fully unfolded state, based on different posture angles, the foldable electronic device can match the first image frame sequence with the first image at different angles, so that the first image and the first image frame sequence can be smoothly connected.
[0013] In one implementation, after the foldable electronic device displays the second image based on the second perspective, the further step includes: in response to a change in the second posture angle of the foldable electronic device, the foldable electronic device acquiring a fourth posture angle, and determining a fourth perspective of the second three-dimensional model based on the fourth posture angle; and the foldable electronic device displaying the updated second image based on the fourth perspective. With this implementation, when the foldable electronic device is in a fully folded state, the foldable electronic device can render second images from different perspectives based on the same three-dimensional model based on different posture angles, thereby providing a 3D visual effect to the user and enhancing the user's visual experience.
[0014] In one implementation, in response to a foldable electronic device being folded from a first angle interval to a second angle interval, the foldable electronic device plays a first video, including: the foldable electronic device sequentially playing the first to last video frames of the first video, the first video frame including an image of a first three-dimensional model at a preset perspective, the last video frame including an image of a second three-dimensional model at a preset perspective, and the depth of field of the first three-dimensional model in the first video frame being less than the depth of field of the second three-dimensional model in the last video frame of the first video. Using this implementation, the 3D wallpaper provided by the foldable electronic device can display a zooming effect in conjunction with the foldable screen changing from an unfolded state to a folded state, thereby enhancing the user's visual experience.
[0015] In one implementation, in response to the foldable electronic device turning on the screen, before the foldable electronic device displays a first image, the method further includes: in response to an operation of a first application on the foldable electronic device, the first application setting a target wallpaper; after the target wallpaper is set, the first application interacts with a first component to launch a first module of the first component, the first module being configured to render the target wallpaper; and the first module invokes at least one sensor of the foldable electronic device to obtain a target folding angle and a target posture angle of the foldable electronic device. This implementation illustrates a method for setting the target wallpaper, based on which the interface display method of the present application embodiment can be implemented.
[0016] In one implementation, a first application interacts with a first component, including: the first application invoking at least one first service to interact with the first component based on the first service, wherein the first service includes a theme manager and a wallpaper management service provided at the framework layer. This implementation illustrates a specific method for the first application to interact with the first component.
[0017] In one implementation, the target wallpaper includes a first image, a first image frame sequence, a first video, a second image frame sequence, and a second image, which are displayed in sequence. Using this implementation, the foldable electronic device can smoothly display the 3D wallpaper while transitioning from a fully unfolded state to a fully folded state.
[0018] In a second aspect, an embodiment of the present application provides an interface display method, which is applied to a foldable electronic device, including: when the foldable electronic device is at a second folding angle, in response to the foldable electronic device lighting up the screen, the foldable electronic device displays a second image; in response to the foldable electronic device being unfolded from the second folding angle to a third angle interval, the foldable electronic device displays a third image frame sequence, and the content of the first image frame of the third image frame sequence is connected with the content of the second image, wherein the second folding angle is smaller than any angle in the third angle interval; in response to the foldable electronic device being unfolded from the third angle interval to the second angle interval, the foldable electronic device plays a second video, and the content of the last image frame of the third image frame sequence is connected with the content of the first video frame of the second video, wherein any angle in the third angle interval is smaller than any angle in the second angle interval.
[0019] The interface display method shown in the embodiment of the present application sets a third image frame sequence between the second image and the second video, so that the modeling model of the second image is smoothly connected with the second video. In this way, when the foldable electronic device changes from a fully folded state to an unfolded state, the 3D wallpaper can be displayed smoothly.
[0020] In one implementation, in response to the foldable electronic device being unfolded from a third angle interval to a second angle interval, after the foldable electronic device plays a second video, the further method further includes: in response to the foldable electronic device being unfolded from the second angle interval to the first angle interval, the foldable electronic device displaying a fourth image frame sequence, wherein the content of the last image frame of the second video is connected to the content of the first image frame of the fourth image frame sequence, wherein any angle in the second angle interval is less than any angle in the first angle interval; and in response to the foldable electronic device being unfolded from the first angle interval to the first folding angle, the foldable electronic device displaying a first image, wherein the content of the last image frame of the fourth image frame sequence is connected to the content of the first image, wherein any angle in the first angle interval is less than the first folding angle. With this implementation, by setting the fourth image frame sequence between the first image and the second video, the modeling model of the first image is smoothly connected to the second video, so that the 3D wallpaper can be smoothly displayed as the foldable electronic device further unfolds to a fully unfolded state.
[0021] In one implementation, a foldable electronic device displays a second image, including: determining, by the foldable electronic device, a second viewing angle of a second three-dimensional model based on a second posture angle, the second posture angle comprising a pitch angle, a roll angle, and a yaw angle when the foldable electronic device is at the second folded angle, the second three-dimensional model being used to generate a second image; and displaying, by the foldable electronic device, the second image based on the second viewing angle. This implementation illustrates a specific method for rendering the second image.
[0022] In one implementation, a foldable electronic device displays a first image, including: determining, by the foldable electronic device, a first viewing angle of a first three-dimensional model based on a first posture angle, the first posture angle comprising a pitch angle, a roll angle, and a yaw angle when the foldable electronic device is at the first folded angle, the first three-dimensional model being used to generate the first image; and displaying, by the foldable electronic device, the first image based on the first viewing angle. This implementation illustrates a specific method for rendering a second image.
[0023] In one implementation, after the foldable electronic device displays the second image based on the second perspective, the further process includes: in response to a change in the second posture angle of the foldable electronic device, the foldable electronic device acquiring a fourth posture angle, and determining a fourth perspective of the second three-dimensional model based on the fourth posture angle; and the foldable electronic device displaying the updated second image based on the fourth perspective. With this implementation, when the foldable electronic device is in a fully folded state, the foldable electronic device can render second images corresponding to different perspectives based on the same three-dimensional model based on different posture angles, thereby providing a 3D visual effect to the user and enhancing the user's visual experience.
[0024] In one implementation, in response to the foldable electronic device being unfolded from a second folding angle to a third angle interval, the foldable electronic device displays a third image frame sequence, including: when the foldable electronic device displays an updated second image according to a fourth viewing angle, the foldable electronic device displays the third image frame sequence, wherein the content of the first image frame of the third image frame sequence is connected to the content of the updated second image. Using this implementation, when the foldable electronic device is in a fully folded state, based on different posture angles, the foldable electronic device can match the third image frame sequence to the second image at different angles, so that the second image and the third image frame sequence can be smoothly connected.
[0025] In one implementation, after the foldable electronic device displays the first image according to the first perspective, the further step includes: in response to a change in the first posture angle of the foldable electronic device, the foldable electronic device acquiring a third posture angle, and determining a third perspective of the first three-dimensional model based on the third posture angle; and the foldable electronic device displaying the updated first image according to the third perspective. With this implementation, when the foldable electronic device is in a fully unfolded state, the foldable electronic device can render first images from different perspectives based on the same three-dimensional model at different posture angles, thereby providing a 3D visual effect to the user and enhancing the user's visual experience.
[0026] In one implementation, in response to a foldable electronic device being unfolded from a third angle interval to a second angle interval, the foldable electronic device plays a second video, including: the foldable electronic device sequentially playing the first to last video frames of the second video, the first video frame of the second video including an image of a second 3D model at a preset perspective, the last video frame of the second video including an image of the first 3D model at a preset perspective, and the depth of field of the second 3D model in the first video frame of the second video being greater than the depth of field of the first 3D model in the last video frame of the second video. Using this implementation, the 3D wallpaper provided by the foldable electronic device can display a magnifying effect in conjunction with the transition of the foldable screen from a folded state to an unfolded state, thereby enhancing the user's visual experience.
[0027] In one implementation, in response to the foldable electronic device lighting up its screen, before the foldable electronic device displays a second image, the method further includes: in response to an operation of a first application on the foldable electronic device, the first application setting a target wallpaper; after the target wallpaper is set, the first application interacts with a first component to launch a first module of the first component, the first module being configured to render the target wallpaper; and the first module invokes at least one sensor of the foldable electronic device to obtain a target folding angle and a target posture angle of the foldable electronic device. This implementation illustrates a method for setting the target wallpaper, based on which the interface display method of the present application embodiment can be implemented.
[0028] In one implementation, a foldable electronic device interacts with a first component via a first application. This includes the first application invoking at least one first service to interact with the first component based on the first service. The first service includes a theme manager and a wallpaper management service provided at a framework layer. This implementation illustrates a specific method for interacting with the first component.
[0029] In one implementation, the target wallpaper includes a second image, a third image frame sequence, a second video, a fourth image frame sequence, and the first image, which are displayed in sequence. Using this implementation, the foldable electronic device can smoothly display the 3D wallpaper while transitioning from a fully folded state to a fully unfolded state.
[0030] In a third aspect, an embodiment of the present application provides a foldable electronic device, comprising: a processor and a memory; the memory stores program instructions, and when the program instructions are executed by the processor, the foldable electronic device executes the interface display method as described in the first aspect, the second aspect, and any implementation method above.
[0031] In a fourth aspect, an embodiment of the present application provides a chip system comprising: a memory and a processor; the memory stores program instructions, and when the program instructions are executed by the processor, the chip system executes the interface display method as described in the first aspect, the second aspect, and any implementation method above.
[0032] In a fifth aspect, an embodiment of the present application provides a computer storage medium, in which program instructions are stored. When the program instructions are run on a computer, the computer executes the interface display method as described in the first aspect, the second aspect, and any implementation method mentioned above.
[0033] In a sixth aspect, an embodiment of the present application provides a computer program product. When the computer program product is run on a foldable electronic device, the foldable electronic device executes the interface display method as described in the first aspect, the second aspect, and any implementation method above.
[0034] It can be understood that the foldable electronic devices, chip systems, computer storage media and computer program products provided in the above aspects are all applied to the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0035] Figure 1 This is a schematic diagram of the usage scenarios of 3D wallpaper;
[0036] Figure 2 This is a schematic diagram of the types of foldable screen mobile phones;
[0037] Figure 3 This is a schematic diagram of the first scenario of the switching state of an outward-folding folding screen mobile phone;
[0038] Figure 4 This is a schematic diagram of the second scenario of the switching state of an outward-folding folding screen mobile phone;
[0039] Figure 5 It is a schematic diagram of the connection process between the modeling model and the video in an outward-folding folding screen mobile phone;
[0040] Figure 6 Schematic diagram of the hardware structure of the foldable electronic device provided in an embodiment of the present application;
[0041] Figure 7 Schematic diagram of the software structure of the foldable electronic device provided in an embodiment of the present application;
[0042] Figure 8 This is the first flow chart of the interface display method provided in the embodiment of the present application;
[0043] Figure 9 This is the first interactive diagram of the interface display method provided in the embodiment of the present application;
[0044] Figure 10 This is a schematic diagram of a method for setting a target wallpaper provided in an embodiment of the present application;
[0045] Figure 11 This is a schematic diagram of the interaction process of the software structure provided in the embodiment of the present application;
[0046] Figure 12 is a schematic diagram of target folding angle and target posture angle provided in an embodiment of the present application;
[0047] Figure 13 This is the second flow chart of the interface display method provided in the embodiment of the present application;
[0048] Figure 14 This is the second interactive diagram of the interface display method provided in the embodiment of the present application;
[0049] Figure 15 This is a schematic diagram of a first usage scenario of a foldable electronic device provided in an embodiment of the present application;
[0050] Figure 16 This is a schematic diagram of a second usage scenario of the foldable electronic device provided in an embodiment of the present application;
[0051] Figure 17 This is a schematic diagram of a third usage scenario of the foldable electronic device provided in an embodiment of the present application;
[0052] Figure 18This is a schematic diagram of a fourth usage scenario of the foldable electronic device provided in an embodiment of the present application;
[0053] Figure 19 This is a schematic diagram of a fifth usage scenario of the foldable electronic device provided in an embodiment of the present application;
[0054] Figure 20 This is a schematic diagram of a sixth usage scenario of the foldable electronic device provided in an embodiment of the present application;
[0055] Figure 21 This is the third flow chart of the interface display method provided in the embodiment of the present application;
[0056] Figure 22 This is the third interactive diagram of the interface display method provided in the embodiment of the present application;
[0057] Figure 23 This is a schematic diagram of a seventh usage scenario of the foldable electronic device provided in an embodiment of the present application;
[0058] Figure 24 This is a schematic diagram of an eighth usage scenario of the foldable electronic device provided in an embodiment of the present application;
[0059] Figure 25 This is a schematic diagram of a ninth usage scenario of the foldable electronic device provided in an embodiment of the present application;
[0060] Figure 26 This is a schematic diagram of the tenth usage scenario of the foldable electronic device provided in an embodiment of the present application;
[0061] Figure 27 It is a structural diagram of the interface display device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0062] The following will clearly describe the technical solutions of the embodiments of the present application in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments of the present application, other embodiments obtained by ordinary technicians in this field without making any creative work are all within the scope of protection of this application.
[0063] In the description of this application, unless otherwise specified, " / " means "or", for example, A / B can mean A or B. "And / or" in this article is merely a description of the association relationship of associated objects, indicating that three relationships can exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, "at least one" means one or more, and "a plurality" means two or more. Words such as "first" and "second" do not limit the quantity and execution order, and words such as "first" and "second" do not limit them to be necessarily different.
[0064] In addition, in this application, directional terms such as "upper", "lower", "inner" and "outer" are defined relative to the orientation of the components in the drawings. It should be understood that these directional terms are relative concepts. They are used for relative description and clarification, and they can change accordingly according to changes in the orientation of the components in the drawings.
[0065] It should be noted that, in this application, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described in this application as "exemplary" or "for example" should not be construed as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.
[0066] The following first describes the application scenarios of the embodiments of the present application.
[0067] Electronic devices are usually provided with wallpapers on their display interfaces to enhance the aesthetics of the electronic devices and provide users with good visual enjoyment.
[0068] Wallpapers include three-dimensional (3D) wallpapers. 3D wallpapers have three dimensions: length, width, and height, giving them a three-dimensional feel. When the user shakes the device or moves their finger across the display, the 3D wallpaper changes perspective in response to the user's actions, creating a more realistic and immersive visual experience. These wallpapers require specialized modeling and rendering techniques, such as rendering onto an immutable model.
[0069] Figure 1 This is a schematic diagram of the usage scenarios of 3D wallpaper.
[0070] like Figure 1As shown in A in FIG, the electronic device displays a first model 102 in the first display interface 101. The first model 102 is a non-deformable model on which a first texture can be attached. When the user shakes the electronic device, since the first model 102 is non-deformable, the first model 102 can only present the effect of changing the viewing angle to display the first texture at different positions, but cannot present the effects of zooming in or out based on deformation. Among them, the zooming out effect is caused by Figure 1 A in Figure 1 If the electronic device needs to present a zooming effect by modeling a model, it is necessary to sequentially establish multiple modeling models similar to the first model 102 from large to small, and the zooming effect cannot be presented by directly changing the size of the first model 102. It should be noted that the size involved in the zooming in and out effect in this application is defined based on the visual effect that objects that are closer are larger and objects that are farther away are smaller.
[0071] 3D wallpapers can be applied to various types of electronic devices. For example, mobile phones include flat screen phones, curved screen phones, and foldable screen phones. When using 3D wallpapers on flat screen and curved screen phones, it is usually sufficient to keep the model in the 3D wallpaper at a fixed size, for example Figure 1 The first model 102 in the image. When a foldable phone uses 3D wallpaper, since it involves switching between the folded and unfolded states, the phone needs to display dynamic effects such as zooming in and out based on deformation during the state switching process to maintain the smoothness of the wallpaper display. These dynamic effects cannot be achieved based on the modeling model and can only be displayed in the form of a video. Therefore, during the state switching process, the foldable phone needs to implement the modeling model-video-modeling model connection process in the 3D wallpaper to display the 3D wallpaper.
[0072] The following is a detailed description of the scenario in which a foldable screen phone displays 3D wallpaper.
[0073] Figure 2 This is a schematic diagram of the types of foldable screen mobile phones.
[0074] like Figure 2 As shown, foldable screen mobile phones usually include Figure 2 The inward-folding folding screen mobile phone shown in A, Figure 2 The outward folding screen mobile phone shown in B and Figure 2 The foldable screen mobile phone shown in C is a foldable screen mobile phone. It should be noted that any type of foldable screen mobile phone can be used in the application scenarios shown in this application, and this application does not limit this.
[0075] This application is only Figure 2 The outward-folding folding screen mobile phone shown in B is used as an example.
[0076] Figure 3 This is a schematic diagram of the first scenario of the switching state of an outward-folding folding screen mobile phone.
[0077] The outward folding screen mobile phone can be switched from the folded state to the unfolded state, such as Figure 3 As shown in A in the figure, when in the folded state, the outward folding screen mobile phone displays the second model 104 in the second display interface 103. The second model 104 is a non-deformable model. Figure 3 As shown in B in the figure, during the switching state, the second display interface 103 displays the first animation 105. The first animation 105 is a video generated by multiple video frames. Each video frame can display an image of a model. In the video frames displayed in sequence, the image of the model is gradually enlarged. In this way, the first animation 105 presents an enlarged dynamic effect to connect with the second model 104. Figure 3 As shown in C in FIG, after the state switching is completed, the third model 106 is displayed in the second display interface 103. The third model 106 is an indeformable model, which has different content and depth of field from the second model 104. The depth of field of the third model 106 is usually smaller than that of the second model 104. Figure 3 As shown in D in FIG, when the user shakes the outward-folding folding screen mobile phone or the user's finger moves on the folding screen in the unfolded state, the folding screen mobile phone can change the viewing angle of the third model 106 on the folding screen in its unfolded state. Figure 3 As shown in FIG. 1E , the third model 106 before the perspective is changed and the third model 106 after the perspective is changed are superimposed to more clearly show the change in the perspective of the third model 106 .
[0078] Figure 4 This is a schematic diagram of the second scenario of the switching state of an outward-folding folding screen mobile phone.
[0079] Correspondingly, the outward folding screen mobile phone can be switched from the unfolded state to the folded state, such as Figure 4 As shown in A in FIG, when in the unfolded state, the outward folding screen mobile phone displays the third model 106 in the second display interface 103. Figure 4 As shown in B in the figure, during the switching state, the second display interface 103 displays the second animation 107. The second animation 107 is a video generated by multiple video frames. Each video frame can display an image of a model. In the video frames displayed in sequence, the image of the model gradually shrinks. In this way, the second animation 107 presents a shrinking effect to connect with the third model 106. It should be noted here that the difference between the second animation 107 and the first animation 105 in the aforementioned scene can be the different playback order of the video frames. Figure 4 As shown in C in FIG, after the state switching is completed, the second display interface 103 displays the second model 104. Figure 4 As shown in D in the figure, when the user shakes the outward-folding folding screen mobile phone or the user's finger moves on the folding screen in the unfolded state, the folding screen mobile phone can change the viewing angle of the second model 104 on the folding screen in its folded state.
[0080] However, the following problems exist in the above-mentioned switching state scenario.
[0081] Figure 5 It is a schematic diagram of the connection process between the modeling model and the video in an outward-folding folding screen mobile phone.
[0082] like Figure 3 and Figure 5 As shown, taking the scene of playing the first animation 105 in the 3D wallpaper as an example, based on the own properties of the first animation 105, the first animation 105 will not switch the perspective in the outward-folding folding screen mobile phone, and its display perspective matches the conventional display perspective of the folding screen (hereinafter referred to as the forward perspective).
[0083] Thus, when switching from the fully folded state to the unfolded state, the outward-folding foldable screen mobile phone switches from displaying the second model 104 to displaying the first animation 105. Because the second model 104 can switch perspectives, in the current state of the foldable electronic device, the second model 104 is not necessarily in the normal viewing angle of the foldable screen. When the perspective of the second model 104 deviates significantly from the normal viewing angle of the foldable screen, the angle of deviation between the second model 104 and the model image in the first image frame of the first animation 105 is large. Therefore, during the state switching process, the second model 104 will quickly jump to the first image frame of the first animation 105, resulting in an unsmooth transition between the second model 104 and the first animation 105. Accordingly, when switching from the unfolded state to the fully unfolded state, the third model 106 may also deviate significantly from the model image in the last image frame of the first animation 105, resulting in an unsmooth transition between the first animation 105 and the third model 106. This unsmooth transition creates a visual discontinuity for the user, impacting the user's viewing experience.
[0084] In order to solve the above problems, an embodiment of the present application provides an interface display method.
[0085] The interface display method provided in the embodiments of the present application can be applied to foldable electronic devices. Foldable electronic devices include, but are not limited to, mobile phones, tablet computers, personal computers, workstations, large-screen devices (e.g., smart screens, smart TVs), wearable devices (e.g., smart bracelets, smart watches), handheld game consoles, home game consoles, virtual reality devices, augmented reality devices, mixed reality devices, and in-vehicle smart terminals.
[0086] In the following embodiments of this application, the foldable electronic devices are all exemplified by outward-folding folding screen mobile phones, but outward-folding folding screen mobile phones do not constitute a limitation on the foldable electronic devices.
[0087] Figure 6 Schematic diagram of the hardware structure of the foldable electronic device provided in an embodiment of the present application.
[0088] like Figure 6 As shown, the foldable electronic device 100 may include a processor 110, a memory 120, an antenna 1, an antenna 2, a mobile communication module 130, a wireless communication module 140, a sensor module 150, a display screen 160, and the like. The sensor module 150 may include a touch sensor 150A, a gyroscope sensor 150B, an air pressure sensor 150C, a geomagnetic sensor 150D, an acceleration sensor 150E, a distance sensor 150F, a proximity light sensor 150G, and the like. The gyroscope sensor 150B, the geomagnetic sensor 150D, the acceleration sensor 150E, and the like may be integrated into an inertial measurement unit (IMU) sensor. An IMU sensor is a device that can integrate multiple sensors to measure and track the posture, motion, and acceleration of the foldable electronic device 100, providing the foldable electronic device 100 with accurate posture, direction, and motion information.
[0089] It should be understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the foldable electronic device 100. In other embodiments of this application, the foldable electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0090] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processing unit (NPU). Different processing units may be independent devices or integrated into one or more processors.
[0091] The memory 120 can be used to store computer executable program code, and the executable program code includes instructions. The memory 120 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the foldable electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the memory 120 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the foldable electronic device 100 by running instructions stored in the memory 120 and / or instructions stored in a memory provided in the processor.
[0092] The wireless communication function of the foldable electronic device 100 can be implemented through antenna 1, antenna 2, mobile communication module 130, wireless communication module 140, modem processor and baseband processor.
[0093] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in foldable electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.
[0094] The mobile communication module 130 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the foldable electronic device 100. The mobile communication module 130 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 130 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 130 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 130 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 130 can be set in the same device as at least some of the modules of the processor 110.
[0095] The modem processor may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is passed to the application processor. The application processor outputs the sound signal through the audio device or displays an image or video through the display screen 160. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 130 or other functional modules.
[0096] Wireless communication module 140 can be one or more devices that integrate at least one communication processing module. Wireless communication module 140 receives electromagnetic waves via antenna 2, frequency-modulates and filters the electromagnetic wave signals, and transmits the processed signals to processor 110. Wireless communication module 140 can also receive signals to be transmitted from processor 110, frequency-modulate and amplify them, and then convert them into electromagnetic waves for radiation via antenna 2.
[0097] In some embodiments, the antenna 1 of the foldable electronic device 100 is coupled to the mobile communication module 130, and the antenna 2 is coupled to the wireless communication module 160, so that the foldable electronic device 100 can communicate with the network and other devices through wireless communication technology.
[0098] Foldable electronic device 100 implements display functionality through a GPU, display 160, and an application processor. The GPU is a microprocessor for image processing that connects display 160 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.
[0099] The display screen 160 is used to display images, videos, etc. The display screen 160 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLed, a Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the foldable electronic device 100 may include one or N display screens 160, where N is a positive integer greater than 1. In the embodiment of the present application, the display screen 160 may be a folding screen.
[0100] The touch sensor 150A is also called a "touch control device". The touch sensor 150A can be set on the display screen 160, and the touch sensor 150A and the display screen 160 form a touch screen, also called a "touch screen". The touch sensor 150A is used to detect touch operations acting on or near it. The touch sensor 150A can pass the detected touch operation to the application processor to determine the type of touch event. The display screen 160 can provide visual output related to the touch operation. In other embodiments, the touch sensor 150A can also be set on the surface of the foldable electronic device 100, at a different position from the display screen 160. In the embodiment of the present application, after detecting the touch operation, the touch sensor 150A can pass the touch operation to the application processor to determine whether the touch event is used to change the viewing angle of the 3D wallpaper, and the display screen 160 provides a viewing angle change effect of the 3D wallpaper related to the touch operation. The touch sensor 150A can also detect changes in the touch position to calculate the folding angle of the display screen 160 through a software algorithm.
[0101] The gyroscope sensor 150B can be used to determine the motion posture of the foldable electronic device 100. In some embodiments, the angular velocity of the foldable electronic device 100 around three axes (i.e., x, y, and z axes) can be determined by the gyroscope sensor 150B. The gyroscope sensor 150B can be used for anti-shake shooting. For example, when the shutter is pressed, the gyroscope sensor 150B detects the angle of the shaking of the foldable electronic device 100, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to offset the shaking of the foldable electronic device 100 through reverse movement to achieve anti-shake. The gyroscope sensor 180B can also be used for navigation and somatosensory game scenes. In an embodiment of the present application, the gyroscope sensor 150B can detect the angle of shaking of the foldable electronic device 100, so that the display screen 160 provides a perspective change effect of 3D wallpaper based on the shaking angle.
[0102] The air pressure sensor 150C is used to measure air pressure. In some embodiments, the foldable electronic device 100 calculates altitude using the air pressure value measured by the air pressure sensor 150C to assist in positioning and navigation.
[0103] The geomagnetic sensor 150D includes a Hall sensor. The foldable electronic device 100 can use the geomagnetic sensor 150D to detect the opening and closing of the flip cover. In some embodiments, when the foldable electronic device 100 is a flip phone, the foldable electronic device 100 can detect the opening and closing of the flip cover based on the geomagnetic sensor 150D. Based on the detected opening and closing state of the leather case or the flip cover, features such as automatic unlocking of the flip cover can be set. In this embodiment of the present application, the foldable electronic device 100 can use the geomagnetic sensor 150D to detect the opening and closing of the foldable screen phone.
[0104] The accelerometer 150E can detect the magnitude of the acceleration of the foldable electronic device 100 in all directions (generally three axes). When the foldable electronic device 100 is stationary, it can detect the magnitude and direction of gravity. It can also be used to identify the posture of the foldable electronic device 100, which is applied to applications such as landscape and portrait screen switching and pedometers. In the embodiment of the present application, the accelerometer 150E can detect the posture of the foldable electronic device 100, so that the display screen 160 can provide a 3D wallpaper perspective change effect based on the posture of the foldable electronic device 100.
[0105] Distance sensor 150F is used to measure distance. Foldable electronic device 100 can measure distance using infrared or laser. In some embodiments, when photographing a scene, foldable electronic device 100 can use distance sensor 150F to measure distance for rapid focusing.
[0106] The proximity light sensor 150G may include, for example, a light emitting diode and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The foldable electronic device 100 emits infrared light outward through the light emitting diode. The foldable electronic device 100 uses the photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the foldable electronic device 100. When insufficient reflected light is detected, the foldable electronic device 100 can determine that there is no object near the foldable electronic device 100. The foldable electronic device 100 can use the proximity light sensor 150G to detect when the user holds the foldable electronic device 100 close to the ear to talk, so as to automatically turn off the screen to save power. The proximity light sensor 150G can also be used in leather case mode and pocket mode to automatically unlock and lock the screen. In the embodiment of the present application, the foldable electronic device 100 can monitor the curvature and shape changes of the display screen 160 through the proximity light sensor to calculate the angle change of the foldable screen.
[0107] The software system of the foldable electronic device 100 can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a microservice architecture, or a cloud architecture. In the embodiment of the present application, the Android system with a layered architecture is used as an example to illustrate the software structure of the foldable electronic device 100.
[0108] Figure 7 Schematic diagram of the software structure of the foldable electronic device provided in an embodiment of the present application.
[0109] A layered architecture divides software into several layers, each with distinct roles and responsibilities. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer.
[0110] The application layer can include a series of application packages.
[0111] like Figure 7 As shown, the application package may include applications such as battery management, camera, gallery, calendar, call, map, navigation, music, video, short message, theme, wallpaper, etc.
[0112] A theme application is an application that can change multiple appearance elements at once. In addition to the wallpaper, a theme application can change the icons, fonts, system interface style, and other elements of the foldable electronic device 100. The theme application can create a complete theme style and apply it to the foldable electronic device 100.
[0113] Wallpaper applications typically include a selection of wallpaper images and provide a user interface and functionality so that users can select, set, and change wallpapers. Such applications may also include additional features, such as wallpaper categorization, foldable wallpapers, dynamic wallpapers, super wallpapers, 3D wallpapers, and wallpaper editing tools, to enhance the user's wallpaper experience.
[0114] The application framework layer provides an application programming interface (API) and programming framework for the applications in the application layer. The application framework layer includes some predefined functions.
[0115] like Figure 7 As shown, the application framework layer may include a window manager, an input manager InputManager, a sensor manager SensorManager, a phone manager, a resource manager, a notification manager, a theme manager ThemeManager, a wallpaper management service WallpaperManagerService, and the like.
[0116] The input manager can be used to monitor user input events, such as click events and slide events performed by the user's finger on the display screen 160 of the foldable electronic device 100. By monitoring input events, the foldable electronic device 100 can determine whether the foldable electronic device 100 is being used.
[0117] The sensor manager is used to monitor data returned by various sensors in the foldable electronic device 100, such as motion sensor data, proximity sensor data, temperature sensor data, etc. Using the data returned by each sensor, the foldable electronic device 100 can determine whether it is shaking or whether the display screen 160 is blocked.
[0118] The theme manager is used to manage themes and skins on the foldable electronic device 100, and generally includes functions such as theme browsing, theme downloading, theme installation, and theme management. When the foldable electronic device 100 performs the theme browsing function, the user can browse various themes and skins through the theme manager and preview their effects. When the foldable electronic device 100 performs the theme downloading function, the user can download favorite themes and skins through the theme manager. When the foldable electronic device 100 performs the theme installation function, the user can install and use the themes and skins through the theme manager. When the foldable electronic device 100 performs the theme management function, the user can manage the installed themes and skins through the theme manager.
[0119] The wallpaper manager is used to provide wallpaper resources and manage wallpapers, usually including wallpaper resources, wallpaper browsing, wallpaper downloading, wallpaper management, wallpaper recommendation and other functions.
[0120] It should be noted here that although both the Theme Manager and the Wallpaper Management Service are related to appearance customization, the Theme Manager is more comprehensive and provides more appearance customization options, including multiple elements including wallpapers, while the Wallpaper Management Service focuses more on the acquisition and management of wallpaper resources.
[0121] Android Runtime includes core libraries and a virtual machine. Android runtime is responsible for scheduling and management of the Android system.
[0122] The core library consists of two parts: one is the function that needs to be called by the Java language, and the other is the Android core library.
[0123] The application layer and application framework layer run in a virtual machine. The virtual machine executes Java files in the application layer and application framework layer as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.
[0124] The system library can include multiple functional modules, such as the surface manager, media libraries, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.
[0125] The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.
[0126] The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library can support a variety of audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
[0127] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
[0128] A 2D graphics engine is a drawing engine for 2D drawings.
[0129] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, and sensor driver.
[0130] It should be understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the foldable electronic device 100. In other embodiments of this application, the foldable electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0131] Figure 8 This is the first flow chart of the interface display method provided in the embodiment of the present application.
[0132] Figure 9 This is the first interactive diagram of the interface display method provided in the embodiment of the present application.
[0133] like Figure 8 and Figure 9 As shown, the method includes the following steps S101-S103.
[0134] In step S101, in response to an operation of a first application on the foldable electronic device 100, the first application sets a target wallpaper, wherein the target wallpaper is a 3D wallpaper.
[0135] The operation of the first application program acting on the foldable electronic device 100 may be a series of continuous operations or a single operation. The first application program may be a theme application program.
[0136] Taking the operation of the first application program acting on the foldable electronic device 100 as a continuous operation as an example, the manner of setting the target wallpaper of the foldable electronic device 100 is exemplarily described.
[0137] Figure 10 This is a schematic diagram of a method for setting a target wallpaper provided in an embodiment of the present application.
[0138] like Figure 10 As shown, the foldable electronic device 100 enters the setting page 12 in response to the user's operation on the setting application 11.
[0139] The setting page 12 may include a plurality of setting options, such as a desktop and wallpaper option 13. In response to the user's operation on the desktop and wallpaper option 13, the foldable electronic device 100 displays a theme page 14.
[0140] It should be noted here that the theme application can usually be pre-installed in the foldable electronic device 100 when leaving the factory, and the desktop and wallpaper option 13 can serve as an access entrance to the theme application. In this way, the foldable electronic device 100 can access the theme application in response to the user's operation on the desktop and wallpaper option 13 to enter the theme page 14.
[0141] The theme page 14 may include wallpapers with multiple attributes, such as a first wallpaper 15 that is a 3D wallpaper, a second wallpaper 16 that is a dynamic wallpaper, and a third wallpaper 17 that is a 2D wallpaper. The target wallpaper may be the first wallpaper 15. In response to a user's operation on the first wallpaper 15, the foldable electronic device 100 may select the first wallpaper 15 and display a preview page 18 for the first wallpaper 15.
[0142] The preview page 18 may include an apply button 19. In response to the user operating the apply button 19, the foldable electronic device 100 may set the first wallpaper 15 as the current wallpaper.
[0143] In one implementation, the foldable electronic device 100 may set the first wallpaper 15 as the current wallpaper in response to the user's operation on the wallpaper changing component (this method is not shown in the drawings).
[0144] That is, the operation of the first application on the foldable electronic device 100 may include a series of continuous operations such as the operation of the settings application 11, the operation of the desktop and wallpaper options 13, the operation of the first wallpaper 15, and the operation of the apply button 19, or a single operation of the operation of the wallpaper replacement component. The embodiment of the present application does not limit the specific operation method of the operation of the first application on the foldable electronic device 100.
[0145] In this way, the foldable electronic device 100 completes the setting of the target wallpaper.
[0146] Step S102: After the target wallpaper is set, the first application interacts with the first component to start the first module of the first component, and the first module is used to render the target wallpaper.
[0147] Specifically, the first application program may call at least one first service to interact with the first component based on the first service.
[0148] The first service may include a theme manager and wallpaper management service in the application framework layer. The first component may be an Android Application Package (APK). The first module may be a 3D wallpaper module in the wallpaper APK, which is used to display, render, and control the code and resources of the 3D wallpaper.
[0149] Figure 11 It is a schematic diagram of the interactive process of the software structure provided in the embodiment of the present application.
[0150] like Figure 11As shown, when the first application is a theme application and the first component is a wallpaper APK, the theme application and the wallpaper APK involve software interaction between the application layer and the application framework layer.
[0151] Theme applications are typically used to provide foldable electronic device 100 with different icons, interface styles, fonts, and wallpapers. Wallpapers are an important component of theme applications. To provide a wider range of wallpapers, theme applications can collaborate with wallpaper APKs. In this way, the wallpaper APK can serve as an auxiliary component of the theme application, providing the wallpapers required by the theme application.
[0152] The wallpaper APK contains the installation files for the wallpaper application. This APK file contains the wallpaper application's code, resources, and other information, enabling the wallpaper application to run on the foldable electronic device 100. The wallpaper APK provides all the functions and features of the wallpaper application. Once the wallpaper APK is installed on the foldable electronic device 100, the various wallpaper modules provided by the wallpaper APK can be run, such as the foldable wallpaper module, dynamic wallpaper module, super wallpaper module, and 3D wallpaper module.
[0153] Specifically, the theme application and wallpaper APK are both set in the application layer. Because the foldable electronic device 100 usually has a preset wallpaper before selecting the target wallpaper, the theme application can first call the theme manager to switch the preset wallpaper to the target wallpaper. After switching to the target wallpaper, it calls the wallpaper management service, which uses the wallpaper management service to enable the wallpaper APK to run the 3D wallpaper module.
[0154] In step S103 , the first module calls at least one sensor of the foldable electronic device 100 to obtain a target folding angle of the foldable electronic device 100 and a target posture angle of the foldable electronic device 100 .
[0155] The at least one sensor may include a first sensor and a second sensor.
[0156] In one implementation, step S103 may include the following steps S1031 - S1032 .
[0157] Step S1031: The first sensor obtains a target folding angle and reports the target folding angle to the first module in the first component.
[0158] Step S1032: The second sensor obtains the target posture angle and reports the target posture angle to the first module in the first component.
[0159] Specifically, the first module can register the first sensor to obtain the target folding angle of the foldable electronic device 100, and register the second sensor to obtain the target attitude angle of the foldable electronic device 100, wherein the target attitude angle includes at least one of the pitch angle, roll angle, and yaw angle of the foldable electronic device 100. Registration in the embodiments of the present application refers to the act of associating the first module with the sensor through a callback function or other means so that the first module can access or control the sensor.
[0160] Figure 12 It is a schematic diagram of the target folding angle and target posture angle provided in the embodiment of the present application.
[0161] like Figure 12 As shown, the first sensor can be an angle sensor integrated based on at least one of a touch sensor 150A, a geomagnetic sensor 150D, an acceleration sensor 150E, and a proximity light sensor 150G. The present embodiment of the application does not limit the type of sensor included in the first sensor. In response to a user's operation to adjust the angle of the foldable screen, the foldable electronic device 100 can detect the start touch position and the end touch position corresponding to the operation via the touch sensor 150A, and calculate the coordinates of the start touch position and the end touch position via the application processor to obtain the target folding angle of the foldable screen. Furthermore, the foldable electronic device 100 can also detect the change in the direction of the Earth's magnetic field corresponding to the adjustment operation via the geomagnetic sensor 150D, and calculate the change in the magnetic field direction via the application processor to obtain the target folding angle of the foldable screen. Furthermore, the foldable electronic device 100 can also detect the change in linear acceleration and tilt angle corresponding to the adjustment operation via the acceleration sensor 150E, and calculate the change in linear acceleration and tilt angle via the application processor to obtain the target folding angle of the foldable screen. Furthermore, the foldable electronic device 100 can also detect the change in the degree of bending and shape of the folding screen caused by the adjustment operation through the proximity light sensor 150G to obtain the target folding angle of the folding screen.
[0162] That is to say, the first sensor can integrate one or more of the above-mentioned sensors to obtain the detection data provided by the integrated sensors, and send these detection data to the application processor, so that the application processor calculates the detection data based on the software algorithm, and then obtains the target folding angle of the folding screen.
[0163] The second sensor may be an IMU sensor integrated based on at least one of the gyroscope sensor 150B, the geomagnetic sensor 150D, and the acceleration sensor 150E. The embodiment of the present application does not limit the type of sensor included in the second sensor.
[0164] To facilitate the description of the foldable electronic device 100, in the embodiments of the present application, a three-dimensional coordinate system is established with the width direction of the foldable electronic device 100 as the x-axis, the length direction as the y-axis, and the thickness direction as the z-axis.
[0165] The target attitude angle of the foldable electronic device 100 can be obtained by the pitch angle, roll angle and yaw angle ( Figure 12 (not shown in the figure). Specifically, the pitch angle can be used to represent the angle of rotation of the foldable electronic device 100 around the x-axis. For example, when the foldable electronic device 100 rotates upward along the horizontal plane, the pitch angle is a positive value, and when the foldable electronic device 100 rotates downward along the horizontal plane, the pitch angle is a negative value. The roll angle can be used to represent the angle of rotation of the foldable electronic device 100 around the y-axis. For example, when the foldable electronic device 100 rotates to the left along the horizontal plane, the roll angle is a positive value, and when the foldable electronic device 100 rotates to the right along the horizontal plane, the roll angle is a negative value. The yaw angle can be used to represent the angle of rotation of the foldable electronic device 100 around the z-axis. For example, when the foldable electronic device 100 rotates clockwise around the z-axis, the yaw angle is a negative value, and when the foldable electronic device 100 rotates counterclockwise around the z-axis, the yaw angle is a positive value.
[0166] In this way, the foldable electronic device 100 can determine the target posture angle of the foldable electronic device 100 according to the pitch angle, the roll angle, and the yaw angle.
[0167] The first sensor and the second sensor are usually provided at the hardware layer of the foldable electronic device 100. The application framework layer can provide a sensor interface for the first sensor and the second sensor at the hardware layer to implement interaction between the application layer and the first sensor and the second sensor.
[0168] Further Figure 11 As shown, the foldable electronic device 100 can register and monitor the sensor interface of the application framework layer based on the 3D wallpaper module, and then register the first sensor and the second sensor of the hardware layer ( Figure 11The hardware layer is not shown in the figure), the registration process may be, for example, providing an identifier to the sensor interface so that the sensor interface can correctly identify and manage the sensor. In this way, the 3D wallpaper module can obtain the permissions of the first sensor and the second sensor through the sensor interface, and receive the angle change event reported by the sensor interface after obtaining the permissions. The angle change event includes the target folding angle change event reported by the first sensor to the sensor interface, and the target posture angle change event reported by the second sensor to the sensor interface. It should be noted here that the sensor interface may include multiple interfaces, for example, an interface corresponding to the first sensor and an interface corresponding to the second sensor. The embodiment of the present application does not limit the number of interfaces and the type of interfaces included in the sensor interface.
[0169] After the first module completes registration of the first sensor and the second sensor, if the registration is not cancelled, the first module can continue to receive angle change events reported by the first sensor and the second sensor, and obtain the target folding angle and the target posture angle in real time.
[0170] In the embodiment of the present application, after the target wallpaper is set, the folding screen of the foldable electronic device 100 can display the target wallpaper in any state, such as folded state, unfolded state, horizontal state, and vertical state.
[0171] Thus, with the aforementioned Figure 5 The 3D wallpaper shown in the figure presents a different connection effect of the second model 104-first animation 105-third model 106. In this embodiment, the target wallpaper can present a connection effect of the first image-first image frame sequence-first video-second image frame sequence-second image to ensure the user's visual continuity.
[0172] The following describes in detail the process of the foldable electronic device 100 displaying the target wallpaper.
[0173] Figure 13 This is the second flow chart of the interface display method provided in the embodiment of the present application.
[0174] Figure 14 This is the second interactive diagram of the interface display method provided in the embodiment of the present application.
[0175] like Figure 13 and Figure 14 As shown, the method further includes the following steps S201-S203.
[0176] Step S201: When the foldable electronic device 100 is at a first folding angle, in response to the foldable electronic device 100 turning on the screen, the foldable electronic device 100 displays a first image.
[0177] The target folding angle includes a first folding angle, which is the angle at which the foldable electronic device 100 is in a fully unfolded state, for example, 180 degrees.
[0178] In one implementation, the foldable electronic device 100 determines a first viewing angle of the first three-dimensional model based on a first posture angle, where the first posture angle includes a pitch angle, a roll angle, and a yaw angle when the foldable electronic device 100 is at the first folded angle. The foldable electronic device 100 displays a first image based on the first viewing angle.
[0179] Figure 15 This is a schematic diagram of a first usage scenario of a foldable electronic device provided in an embodiment of the present application.
[0180] like Figure 15 As shown, the user can place the foldable electronic device 100 in a fully unfolded state at a certain location. After a period of time, the foldable electronic device 100 automatically enters the screen-off state. Furthermore, the foldable electronic device 100 can enter the screen-on state in response to the user's click operation at any position on the foldable screen.
[0181] It should be noted here that the foldable electronic device 100 can also enter the screen-on state through other operating methods. For example, the foldable electronic device 100 can enter the screen-on state in response to the user pressing the power button. The embodiment of the present application does not limit the specific method of the foldable electronic device 100 entering the screen-on state.
[0182] After the foldable electronic device 100 enters the screen-on state, the IMU mode is activated. The IMU mode is a mode in which the foldable electronic device 100 uses the IMU sensor to obtain the target posture angle and renders the image according to the target posture angle. The foldable electronic device 100 can activate the IMU mode by default in the screen-on state after the target wallpaper is set, or it can activate the IMU mode by default when the device is turned on. The embodiments of the present application do not limit the specific method of activating the IMU mode of the foldable electronic device 100.
[0183] The foldable electronic device 100 can render the first image when it is in IMU mode. The essence of the first image is an IMU animation generated based on the first three-dimensional model, and the rendering process of the IMU animation can be implemented based on the 3D engine built into the 3D wallpaper module. After the 3D wallpaper module obtains the target folding angle and target posture angle of the foldable electronic device 100 in real time, the 3D wallpaper module updates the posture of the first three-dimensional model in real time according to the target posture angle at the target folding angle. The 3D engine can use a three-dimensional graphics processing library or other similar graphics processing library to render the IMU animation and send it to the display after rendering. In this way, the foldable electronic device 100 can display the first image.
[0184] It should be noted that the first image is not necessarily in the front view of the foldable screen. Therefore, the foldable electronic device 100 needs to further provide a first image frame sequence so that the first image and the first video can be smoothly connected.
[0185] In step S202 , in response to the foldable electronic device 100 being folded from the first folding angle to the first angle interval, the foldable electronic device 100 displays a first image frame sequence, wherein the content of the first image frame of the first image frame sequence is connected with the content of the first image.
[0186] The foldable electronic device 100 transitions from a fully unfolded state to a folded state, and thus transitions from a first usage scenario to a second usage scenario within a first angle interval. The second usage scenario provided in the embodiment of the present application is a transition scenario between the foldable electronic device 100 displaying a first image and playing a first video.
[0187] The target folding angle also includes any angle in the first angle interval. For example, the first angle interval can be greater than 175 degrees and less than 180 degrees. The embodiment of the present application does not limit the specific numerical range of the first angle interval. The first folding angle is greater than any angle in the first angle interval.
[0188] The first image frame sequence can be a plurality of image frames preset in the foldable electronic device 100, and each image frame can correspond to a model image of the first three-dimensional model at different viewing angles. In this way, no matter which target posture angle the foldable electronic device 100 is in, the foldable electronic device 100 can select a first image frame sequence with a preset number of frames for rendering and display, so that the content of the first image frame sequence is used to connect the content of the first image and the content of the first video frame of the first video.
[0189] Figure 16 This is a schematic diagram of a second usage scenario of the foldable electronic device provided in an embodiment of the present application.
[0190] like Figure 16 As shown, the user can fold the foldable electronic device 100 in the fully unfolded state, so that the foldable electronic device 100 gradually changes from 180 degrees to 175 degrees.
[0191] For example, the foldable electronic device 100 is 180 degrees and is in a Figure 16 When the target posture angle is shown in A, the first image 20 is displayed. Since the first video is preset in the foldable electronic device 100, Figure 16The image angle of the first zoomed-out video frame 21 in the first video shown in Figure B is fixed and matches the forward viewing angle. It should be noted that the first zoomed-out video frame 21 is the first video frame of the first video and is used to make the first video present a zooming-out animation. In this way, when the preset number of frames is 3, the foldable electronic device 100 renders the first image frame sequence as follows: Figure 16 The first sub-image 22 shown in C, as shown in FIG. Figure 16 The second sub-image 23 shown in D and Figure 16 The third sub-image 24 shown in Figure E causes the content of the first sub-image 22, the second sub-image 23, and the third sub-image 24 to gradually change between the content of the first image 20 and the content of the first reduced video frame 21. This prevents the foldable electronic device 100 from experiencing a jerky transition between the first image 20 and the first video.
[0192] In step S203 , in response to the foldable electronic device 100 being folded from the first angle interval to the second angle interval, the foldable electronic device 100 plays the first video, and the content of the last image frame of the first image frame sequence is connected to the content of the first video frame of the first video.
[0193] The foldable electronic device 100 is further folded, so that the foldable electronic device 100 enters the third usage scenario from the second usage scenario in the second angle range, that is, from the transition scene between displaying the first image and playing the first video to the scene of playing the first video.
[0194] The target folding angle also includes any angle in the second angle interval. For example, the second angle interval can be greater than or equal to 10 degrees and less than or equal to 175 degrees. The embodiment of the present application does not limit the specific numerical range of the second angle interval. Any angle in the first angle interval is greater than any angle in the second angle interval.
[0195] The first video may be generated by a plurality of video frames preset in the foldable electronic device 100. Specifically, the playback process of the first video may be implemented based on the 3D wallpaper module. After the 3D wallpaper module determines that the foldable electronic device 100 enters the second angle interval, for example, when it is determined that the folding angle of the foldable electronic device 100 is 175 degrees, the 3D wallpaper module decodes the first video, and renders the decoded video frames through a 3D engine to generate a first video consisting of multiple video frames, and plays it. It should be noted here that the first video matches the forward viewing angle of the folding screen.
[0196] In one implementation, the foldable electronic device 100 plays the first video frame to the last video frame of the first video in sequence, the first video frame of the first video includes an image of the first three-dimensional model at a preset perspective, the last video frame of the first video includes an image of the second three-dimensional model at a preset perspective, and the depth of field of the first three-dimensional model in the first video frame of the first video is smaller than the depth of field of the second three-dimensional model in the last video frame of the first video.
[0197] Among them, the preset perspective can be the forward perspective of the folding screen, the first video frame of the first video can display the image content of the first three-dimensional model at the first depth of field, the second video frame of the first video can display the image content of a similar model slightly smaller than the first three-dimensional model at the second depth of field,…, the Nth video frame of the first video can display the image content of the second three-dimensional model at the Nth depth of field, N is greater than or equal to 1, that is, in the first video, the video frames can be displayed in sequence as image contents of three-dimensional models with gradually increasing depth of field and different model sizes, so that the first video displays a zoom-out effect.
[0198] Figure 17 This is a schematic diagram of a third usage scenario of the foldable electronic device provided in an embodiment of the present application.
[0199] like Figure 17 As shown in A in FIG, the foldable electronic device 100 can play the first reduced video frame 21 of the forward viewing angle at 175 degrees. Furthermore, in the process of changing from 175 degrees to 10 degrees, the second reduced video frame, the third reduced video frame, ..., the Nth reduced video frame are played in sequence, where N is a positive integer greater than or equal to 1.
[0200] like Figure 17 As shown in B in FIG, when the foldable electronic device 100 is folded to an angle of 10 degrees, the video frame is played, and the foldable screen displays the Nth reduced video frame 25 in the forward viewing angle.
[0201] In this way, the foldable electronic device 100 achieves a gradually shrinking motion effect by playing the first video.
[0202] Further Figure 13 As shown, in one implementation, after step S203, steps S204-S205 are further included.
[0203] In step S204 , in response to the foldable electronic device 100 being folded from the second angle interval to the third angle interval, the foldable electronic device 100 displays a second image frame sequence, where the content of the last video frame of the first video is connected to the content of the first image frame of the second image frame sequence.
[0204] The foldable electronic device 100 is further folded, so that the foldable electronic device 100 enters the fourth usage scenario from the third usage scenario in the third angle interval. The fourth usage scenario provided by the embodiment of the present application is a transition scenario of the foldable electronic device 100 between playing the first video and displaying the second image.
[0205] The target folding angle also includes any angle in a third angle interval. For example, the third angle interval can be greater than 0 degrees and less than 10 degrees. The embodiment of the present application does not limit the specific numerical range of the third angle interval. Any angle in the second angle interval is greater than any angle in the third angle interval.
[0206] The second image frame sequence can be a plurality of image frames preset in the foldable electronic device 100, and each image frame can correspond to a model image of the second three-dimensional model at different viewing angles. In this way, no matter which target posture angle the foldable electronic device 100 is in, the foldable electronic device 100 can select a second image frame sequence with a preset number of frames for rendering and display, so that the content of the second image frame sequence is used to connect the content of the last video frame of the first video and the content of the second image.
[0207] The user can further fold the foldable electronic device 100 so that the foldable electronic device 100 gradually changes from 10 degrees to 0 degrees.
[0208] Figure 18 This is a schematic diagram of the fourth usage scenario of the foldable electronic device provided in an embodiment of the present application.
[0209] like Figure 18 As shown in A in FIG, when the folding angle of the foldable electronic device 100 is 10 degrees, the Nth zoomed-out video frame 25 of the first video is displayed, and the Nth zoomed-out video frame 25 matches the forward viewing angle. Figure 18 As shown in B in FIG, when the folding angle of the foldable electronic device 100 is 0 degrees, the second image 26 is displayed. In this way, when the preset number of frames is 3 frames, the foldable electronic device 100 renders the second image frame sequence as follows Figure 18 The fourth sub-image 27 shown in C, as shown in FIG. Figure 18 The fifth sub-image 28 shown in D and Figure 18 The sixth sub-image 29 shown in Figure E causes the content of the fourth sub-image 27, the fifth sub-image 28, and the sixth sub-image 29 to gradually change between the content of the Nth reduced video frame 25 and the second image 26. This prevents the foldable electronic device 100 from experiencing a jerky transition between the first video and the second image 26.
[0210] In step S205 , in response to the foldable electronic device 100 being folded from the third angle range to the second folding angle, the foldable electronic device 100 displays a second image, and the content of the last image frame of the second image frame sequence is connected to the content of the second image.
[0211] The target folding angle includes a second folding angle, which is an angle at which the foldable electronic device 100 is in a fully folded state, for example, 0 degrees. Any angle in the third angle range is greater than the second folding angle.
[0212] In one implementation, the foldable electronic device 100 determines a second viewing angle of the second three-dimensional model based on a second posture angle, where the second posture angle includes a pitch angle, a roll angle, and a yaw angle when the foldable electronic device 100 is at the second folded angle. The foldable electronic device 100 displays a second image based on the second viewing angle.
[0213] Specifically, when the foldable electronic device 100 is at the second folding angle, the IMU mode is started again to render the second image in this mode. The second image is essentially an IMU animation generated based on the second three-dimensional model, and the rendering process of the IMU animation can be implemented based on the 3D engine built into the 3D wallpaper module. After the 3D wallpaper module obtains the target folding angle and target posture angle of the foldable electronic device 100 in real time, the 3D wallpaper module updates the posture of the second three-dimensional model in real time according to the target posture angle at the target folding angle. The 3D engine can use a three-dimensional graphics processing library or other similar graphics processing library to render the IMU animation and send it to the display after rendering. In this way, the foldable electronic device 100 can display the second image.
[0214] It should be noted that the second folding angle includes but is not limited to 0 degrees. When the foldable electronic device 100 is in an approximately fully folded state, the IMU mode can also be activated. For example, the second folding angle can also be greater than 0 degrees and less than 5 degrees. The embodiment of the present application is only exemplified by the second folding angle of 0 degrees. In fact, the embodiment of the present application does not limit the specific numerical range of the second folding angle. When the second folding angle has other values other than 0 degrees, the range of each angle interval needs to be adjusted accordingly.
[0215] In this way, the foldable electronic device 100 completes the process of switching from a fully unfolded state to a fully folded state. The target wallpaper includes the first image, the first image frame sequence, the first video, the second image frame sequence and the second image displayed in sequence, with a good connection effect, avoiding the problem that the deviation angle is too large in the connection process of the first image, the first video and the second image, resulting in an unsmooth connection, making the user's vision incoherent and affecting the user's visual experience.
[0216] In some other embodiments, step S201 may be followed by steps S206-S207.
[0217] Step S206: In response to the change in the first posture angle of the foldable electronic device 100, the foldable electronic device 100 obtains a third posture angle and determines a third viewing angle of the first three-dimensional model according to the third posture angle.
[0218] In step S207 , the foldable electronic device 100 displays the updated first image according to the third viewing angle.
[0219] Figure 19 This is a schematic diagram of the fifth usage scenario of the foldable electronic device provided in an embodiment of the present application.
[0220] like Figure 19 As shown, when the foldable electronic device 100 is in a fully unfolded state, it can change from displaying the first image 20 to displaying the third image 30 in response to a user's operation to freely change the target posture angle. The first image 20 and the third image 30 are images of the same three-dimensional model, but from different perspectives. At different third posture angles, the foldable electronic device 100 can produce different third images 30.
[0221] It should be noted here that, since changing the target posture angle of the foldable electronic device 100 is a continuous process, the foldable electronic device 100 can render the third image 30 at the first frame rate.
[0222] Among them, the frame rate refers to the number of image frames displayed by the foldable electronic device 100 in one second, and the unit is (Frames per second, fps). A higher frame rate can provide a smooth visual experience, and a lower frame rate may cause the picture to be stuck or incoherent. For example, the first frame rate can be 60fps. In the embodiment of the present application, the value of the first frame rate is only used for exemplary description, and the first frame rate can also be 30fps. The embodiment of the present application does not limit the specific value of the first frame rate.
[0223] In one implementation, the foldable electronic device 100 can dynamically adjust the first frame rate based on the third posture angle. If the third posture angle deviates significantly from the first posture angle, the first frame rate can be set to 60 fps, thus providing the user with a smooth visual experience. If the third posture angle deviates slightly from the first posture angle, the first frame rate can be set to 30 fps. This ensures a smooth visual experience for the user while also reducing power consumption.
[0224] In one implementation, after the foldable electronic device 100 executes step S207, the implementation of step S202 may be: when the foldable electronic device 100 displays the updated first image according to the third perspective, the foldable electronic device 100 displays a first image frame sequence, and the content of the first image frame of the first image frame sequence is connected with the content of the updated first image.
[0225] That is to say, in response to the change in viewing angle of the third image, the first image frame sequence needs to be adaptively matched to ensure smooth connection.
[0226] In one implementation, after step S205, steps S208-S209 may also be included.
[0227] Step S208 : In response to the change in the second posture angle of the foldable electronic device 100 , the foldable electronic device 100 acquires a fourth posture angle, and determines a fourth viewing angle of the second three-dimensional model according to the fourth posture angle.
[0228] In step S209 , the foldable electronic device 100 displays the updated second image according to the fourth viewing angle.
[0229] Figure 20 This is a schematic diagram of the sixth usage scenario of the foldable electronic device provided in an embodiment of the present application.
[0230] like Figure 20 As shown, when the foldable electronic device 100 is in a fully folded state, it can change from displaying the second image 26 to displaying the fourth image 31 in response to a user's operation to freely change the target posture angle. The second image 26 and the fourth image 31 are images of the same three-dimensional model, but from different perspectives. At different fourth posture angles, the foldable electronic device 100 can produce different fourth images 31.
[0231] In this way, the foldable electronic device 100 can continue to maintain the smooth display of the target wallpaper when in the fully folded state.
[0232] Figure 21 This is the third flow chart of the interface display method provided in the embodiment of the present application.
[0233] Figure 22 This is the third interactive diagram of the interface display method provided in the embodiment of the present application.
[0234] like Figure 21 and Figure 22 As shown, the method further includes the following steps S301-S303.
[0235] Step S301: When the foldable electronic device 100 is at a second folding angle, in response to the foldable electronic device 100 turning on the screen, the foldable electronic device 100 displays a second image.
[0236] In one implementation, the foldable electronic device 100 determines a second viewing angle of the second three-dimensional model based on a second posture angle, where the second posture angle includes a pitch angle, a roll angle, and a yaw angle when the foldable electronic device 100 is at the second folded angle. The foldable electronic device 100 displays the first image based on the second viewing angle.
[0237] Figure 23 This is a schematic diagram of the seventh usage scenario of the foldable electronic device provided in an embodiment of the present application.
[0238] like Figure 23 As shown, the user can place the foldable electronic device 100 in a fully folded state at a certain location. After a period of time, the foldable electronic device 100 automatically enters the screen-off state. Furthermore, the foldable electronic device 100 can enter the screen-on state in response to the user's click operation at any position on the foldable screen.
[0239] After the foldable electronic device 100 enters the bright screen state, the IMU mode is activated. When the foldable electronic device 100 is in the IMU mode, the second image 26 can be rendered and displayed after rendering. The rendering process of the second image 26 can be referred to in the above embodiment, and this application will not be repeated here.
[0240] It should be noted that the second image is not necessarily in the forward viewing angle of the foldable screen. Therefore, the foldable electronic device 100 needs to further provide a third image frame sequence so that the second image and the second video can be smoothly connected.
[0241] In step S302 , in response to the foldable electronic device 100 being unfolded from the second folding angle to a third angle range, the foldable electronic device 100 displays a third image frame sequence, wherein the content of the first image frame of the third image frame sequence is connected with the content of the second image.
[0242] The foldable electronic device 100 transitions from a fully folded state to an unfolded state, and thus, the foldable electronic device 100 transitions from the seventh usage scenario to the eighth usage scenario within the third angle interval. The eighth usage scenario provided in the embodiment of the present application is a transition scenario between the foldable electronic device 100 displaying a second image and playing a second video.
[0243] The value range of the third angle interval can be found in the above embodiments, and this application will not elaborate on it.
[0244] The third image frame sequence can be a plurality of image frames preset in the foldable electronic device 100, and each image frame can correspond to a model image of the second three-dimensional model at different viewing angles. In this way, no matter which target posture angle the foldable electronic device 100 is in, the foldable electronic device 100 can select a third image frame sequence of a preset number of frames for rendering and display, so that the content of the third image frame sequence is used to connect the content of the second image and the content of the first video frame of the second video.
[0245] Figure 24 This is a schematic diagram of the eighth usage scenario of the foldable electronic device provided in an embodiment of the present application.
[0246] like Figure 24 As shown, the user can unfold the foldable electronic device 100 in the fully folded state, so that the foldable electronic device 100 gradually changes from 0 degrees to 10 degrees.
[0247] For example, the foldable electronic device 100 is at 0 degrees and is in a Figure 24 When the target posture angle is shown in A, the second image 26 is displayed. Since the second video is preset in the foldable electronic device 100, Figure 24 The image angle of the first enlarged video frame 32 in the second video shown in Figure B is fixed and matches the forward viewing angle. It should be noted that the first enlarged video frame 32 is the first video frame of the second video and is used to make the second video present an enlarged dynamic effect. In this way, when the preset number of frames is 3, the foldable electronic device 100 renders the third image frame sequence as follows: Figure 24 The seventh sub-image 33 shown in C, as shown in FIG. Figure 24 The eighth sub-image 34 shown in FIG. Figure 24 The ninth sub-image 35 shown in FIG. 3E causes the contents of the seventh, eighth, and ninth sub-images 33, 34, and 35 to gradually transition between the second image 26 and the first enlarged video frame 32. This prevents the foldable electronic device 100 from experiencing a jerky transition between the second image 26 and the second video.
[0248] In step S303 , in response to the foldable electronic device 100 being unfolded from the third angle interval to the second angle interval, the foldable electronic device 100 plays the second video, and the content of the last image frame of the third image frame sequence is connected to the content of the first video frame of the second video.
[0249] The foldable electronic device 100 is further unfolded, so that the foldable electronic device 100 enters the ninth usage scenario from the eighth usage scenario in the second angle interval, that is, from the transition scene between displaying the second image and playing the second video to the scene of playing the second video.
[0250] It should be noted here that the second video may have the same video frame content as the first video, but the playback order of the video frames is opposite.
[0251] The value range of the second angle interval can be found in the above embodiment, and this application will not elaborate on it.
[0252] In one implementation, the foldable electronic device plays the first video frame to the last video frame of the second video in sequence, the first video frame of the second video includes an image of the second three-dimensional model at a preset perspective, the last video frame of the second video includes an image of the first three-dimensional model at a preset perspective, and the depth of field of the second three-dimensional model in the first video frame of the second video is greater than the depth of field of the first three-dimensional model in the last video frame of the second video.
[0253] The setting method of the second video can refer to the first video, and this embodiment will not go into details about it.
[0254] Figure 25 This is a schematic diagram of the ninth usage scenario of the foldable electronic device provided in an embodiment of the present application.
[0255] like Figure 25 As shown in A in FIG, the foldable electronic device 100 can play the first enlarged video frame 32 of the forward viewing angle at 10 degrees. Furthermore, in the process of changing from 10 degrees to 175 degrees, the second enlarged video frame, the third enlarged video frame, ..., the Nth enlarged video frame are played in sequence, where N is a positive integer greater than or equal to 1.
[0256] like Figure 25 As shown in B in FIG, when the foldable electronic device 100 is folded to an angle of 175 degrees, the video frame is played, and the foldable screen displays the Nth enlarged video frame 36 in the forward viewing angle.
[0257] In this way, the foldable electronic device 100 achieves a gradually enlarging motion effect by playing the second video.
[0258] Further Figure 21 As shown, in one implementation, after step S303, steps S304-S305 are further included.
[0259] In step S304 , in response to the foldable electronic device 100 being unfolded from the second angle interval to the first angle interval, the foldable electronic device 100 displays a fourth image frame sequence, where the content of the last video frame of the second video is connected to the content of the first image frame of the fourth image frame sequence.
[0260] The foldable electronic device 100 is further unfolded, so that the foldable electronic device 100 enters the tenth usage scenario from the ninth usage scenario in the first angle interval. The tenth usage scenario provided in the embodiment of the present application is a transition scenario between the foldable electronic device 100 playing the second video and rendering the first image.
[0261] The value range of the first angle interval can be found in the above embodiment, and this application will not elaborate on it.
[0262] The fourth image frame sequence can be a plurality of image frames preset in the foldable electronic device 100, and each image frame can correspond to a different target posture angle of the foldable electronic device 100. In this way, no matter which target posture angle the foldable electronic device 100 is in, the foldable electronic device 100 can select a fourth image frame sequence of a preset number of frames for rendering and display it, so that the content of the fourth image frame sequence is used to connect the content of the last video frame of the second video and the content of the first image.
[0263] The user can further unfold the foldable electronic device 100, so that the foldable electronic device 100 gradually changes from 175 degrees to 180 degrees.
[0264] Figure 26 This is a schematic diagram of the tenth usage scenario of the foldable electronic device provided in an embodiment of the present application.
[0265] like Figure 26 As shown in A in FIG, when the folding angle of the foldable electronic device 100 is 175 degrees, the Nth enlarged video frame 36 of the second video is displayed, and the Nth enlarged video frame 36 matches the forward viewing angle. Figure 26 As shown in B in FIG, when the folding angle of the foldable electronic device 100 is 180 degrees, the first image 20 is displayed. In this way, when the preset number of frames is 3 frames, the foldable electronic device 100 renders the fourth image frame sequence as follows Figure 26 The tenth sub-image 37 shown in C, as shown in FIG. Figure 26 The eleventh sub-image 38 shown in FIG. Figure 26 The twelfth sub-image 39 shown in FIG. 5E causes the tenth sub-image 37, the eleventh sub-image 38, and the twelfth sub-image 39 to gradually change between the Nth magnified video frame 36 and the first image 20. As a result, the foldable electronic device 100 does not experience a smooth transition between the second video and the first image 20.
[0266] In step S305 , in response to the foldable electronic device 100 being unfolded from the first angle range to the first folded angle, the foldable electronic device 100 displays the first image, and the content of the last image frame of the fourth image frame sequence is connected with the content of the first image.
[0267] In one implementation, the foldable electronic device 100 determines a first viewing angle of the first three-dimensional model based on a first posture angle, where the first posture angle includes a pitch angle, a roll angle, and a yaw angle when the foldable electronic device 100 is at the first folded angle. The foldable electronic device 100 displays a first image based on the first viewing angle.
[0268] The specific manner in which the foldable electronic device 100 displays the first image can be found in the above embodiments, and this application will not elaborate on this.
[0269] In this way, the foldable electronic device 100 completes the process of switching from a fully folded state to a fully unfolded state. The target wallpaper includes the second image, the third image frame sequence, the second video, the fourth image frame sequence and the first image displayed in sequence, with a good connection effect, avoiding the problem that the deviation angle is too large in the connection process of the second image, the second video and the first image, resulting in an unsmooth connection, making the user's vision incoherent and affecting the user's visual experience.
[0270] In some other embodiments, step S301 may be followed by steps S306-S307.
[0271] Step S306: In response to the change in the second posture angle of the foldable electronic device 100, the foldable electronic device 100 obtains a fourth posture angle and determines a fourth viewing angle of the second three-dimensional model according to the fourth posture angle.
[0272] In step S307 , the foldable electronic device 100 displays the updated second image according to the fourth viewing angle.
[0273] The process of the foldable electronic device 100 displaying the updated second image can be referred to the above embodiment, and this application will not elaborate on it.
[0274] In one implementation, after the foldable electronic device 100 executes step S307, the implementation of step S302 may be: when the foldable electronic device displays the updated second image according to the fourth perspective, the foldable electronic device displays a third image frame sequence, and the content of the first image frame of the third image frame sequence is connected with the content of the updated second image.
[0275] In one implementation, after step S305, steps S308-S309 may also be included.
[0276] Step S308: In response to the change in the first posture angle of the foldable electronic device 100, the foldable electronic device 100 obtains a third posture angle, and determines a third viewing angle of the first three-dimensional model according to the third posture angle.
[0277] In step S309 , the foldable electronic device 100 displays the updated first image according to the third viewing angle.
[0278] The process of the foldable electronic device 100 displaying the updated first image can be referred to the above embodiment, and this application will not elaborate on it.
[0279] In this way, the foldable electronic device 100 can continue to maintain the smooth display of the target wallpaper when in the fully unfolded state.
[0280] In summary, the interface display method provided in the embodiment of the present application can provide users with a smooth visual experience when the 3D wallpaper function is applied to a foldable screen mobile phone, and the foldable screen mobile phone is in any state, such as folded state, unfolded state, folded-unfolded switching state, unfolded-folded state, etc.
[0281] The above mainly introduces the solution provided by the embodiment of the present application from the perspective of the foldable electronic device 100. It can be understood that in order to realize the above functions, the foldable electronic device 100 includes hardware structures and / or software modules corresponding to the execution of each function. Those skilled in the art should easily realize that, in combination with the steps of an interface display method of each example described in the embodiment disclosed in this application, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or foldable electronic device software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.
[0282] In the embodiment of the present application, the functional modules or functional units of the foldable electronic device 100 can be divided according to the above method example. For example, each functional module or functional unit can be divided according to each function, or two or more functions can be integrated into one processing module. The above integrated module can be implemented in the form of hardware or in the form of software functional modules or functional units. Among them, the division of modules or units in the embodiment of the present application is schematic and is only a logical functional division. There may be other division methods in actual implementation.
[0283] Other embodiments of the present application provide an interface display device.
[0284] Figure 27 It is a structural diagram of the interface display device provided in an embodiment of the present application.
[0285] like Figure 27As shown, the interface display device may include: a display screen 1001, a memory 1002, a processor 1003, and a communication module 1004. The aforementioned components may be connected via one or more communication buses 1005. Display screen 1001 may include a display panel 10011 and a touch sensor 10012. Display panel 10011 is used to display images, and touch sensor 10012 may transmit detected touch operations to an application processor to determine the type of touch event and provide visual output related to the touch operation via display panel 10011. Processor 1003 may include one or more processing units, such as an application processor, a modem processor, a graphics processor, an image signal processor, a controller, a video codec, a digital signal processor, a baseband processor, and / or a neural network processor. The various processing units may be independent devices or integrated into one or more processors. Memory 1002 is coupled to processor 1003 and is used to store various software programs and / or computer instructions. Memory 1002 may include volatile memory and / or non-volatile memory. When the processor executes the computer instructions, the interface display device can perform the various functions or steps performed by the above method embodiments.
[0286] When the software program and / or multiple groups of instructions in the memory 1002 are executed by the processor 1003, the interface display device implements the following method steps: in a case where the foldable electronic device is at a first folding angle, in response to the foldable electronic device lighting up the screen, the foldable electronic device displays a first image; in response to the foldable electronic device being folded from the first folding angle to the first angle interval, the foldable electronic device displays a first image frame sequence, and the first image frame of the first image frame sequence is connected with the first image, wherein the first folding angle is greater than any angle in the first angle interval; in response to the foldable electronic device being folded from the first angle interval to the second angle interval, the foldable electronic device plays a first video, and the content of the last image frame of the first image frame sequence is connected with the content of the first video frame, wherein any angle in the first angle interval is greater than any angle in the second angle interval.
[0287] The present application also provides a foldable electronic device, including: a processor, a memory and a touch screen; the memory stores program instructions, and when the program instructions are executed by the processor, the foldable electronic device executes the interface display method in any implementation method of the above embodiments.
[0288] An embodiment of the present application also provides a chip system, which includes at least one processor and at least one interface circuit. The processor and the interface circuit can be interconnected through lines. For example, the interface circuit can be used to receive signals from other devices (such as the memory of a foldable electronic device). For another example, the interface circuit can be used to send signals to other devices. Exemplarily, the interface circuit can read instructions stored in the memory and send the instructions to the processor. When the instructions are executed by the processor, the foldable electronic device can perform the various steps in the above embodiments. Of course, the chip system can also include other discrete devices, which is not specifically limited in the embodiment of the present application.
[0289] An embodiment of the present application also provides a computer-readable storage medium, which includes computer instructions. When the computer instructions are executed on the above-mentioned foldable electronic device, the foldable electronic device performs the various functions or steps performed by the above-mentioned method embodiment.
[0290] The embodiment of the present application further provides a computer program product, which, when executed on a computer, enables the computer to execute the functions or steps executed by the mobile phone in the above method embodiment.
[0291] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.
[0292] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the modules or units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0293] The units described as separate components may or may not be physically separate, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple places. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0294] In addition, the functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.
[0295] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for enabling a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.
[0296] The above content is only a specific embodiment of this application, but the scope of protection of this application is not limited to this. Any changes or replacements within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.
Claims
1. An interface display method, characterized in that: Applications in foldable electronic devices, including: When the foldable electronic device is at a first folded angle, in response to the foldable electronic device lighting up its screen, the foldable electronic device determines a first viewing angle of a first three-dimensional model according to a first posture angle, where the first posture angle includes a pitch angle, a roll angle, and a yaw angle of the foldable electronic device when the foldable electronic device is at the first folded angle, and the first three-dimensional model is used to generate a first image; The foldable electronic device displays the first image according to the first viewing angle; In response to the foldable electronic device being folded from the first folding angle to a first angle interval, the foldable electronic device displays a first image frame sequence, wherein the content of a first image frame of the first image frame sequence is connected to the content of the first image, wherein the first folding angle is greater than any angle in the first angle interval, the first image frame sequence is a plurality of image frames preset in the foldable electronic device, and each of the first image frames corresponds to a model image of the first three-dimensional model at a different viewing angle; In response to the foldable electronic device being folded from the first angle interval to the second angle interval, the foldable electronic device plays a first video, wherein content of a last image frame of the first image frame sequence is connected to content of a first video frame of the first video, wherein any angle in the first angle interval is greater than any angle in the second angle interval; In response to the foldable electronic device being folded from the second angle interval to a third angle interval, the foldable electronic device displays a second image frame sequence, where content of a last video frame of the first video is connected to content of a first image frame of the second image frame sequence, wherein any angle in the second angle interval is greater than any angle in the third angle interval; In response to the foldable electronic device being folded from the third angle range to the second folding angle, the foldable electronic device displays a second image, and the content of the last image frame of the second image frame sequence is connected with the content of the second image, wherein any angle in the third angle range is greater than the second folding angle.
2. The interface display method according to claim 1, characterized in that: The foldable electronic device displays a second image, comprising: The foldable electronic device determines a second viewing angle of a second three-dimensional model according to a second posture angle, where the second posture angle includes a pitch angle, a roll angle, and a yaw angle when the foldable electronic device is at the second folded angle, and the second three-dimensional model is used to generate the second image; The foldable electronic device displays the second image according to the second viewing angle.
3. The interface display method according to claim 1, characterized in that: After the foldable electronic device displays the first image according to the first viewing angle, the further comprising: In response to a change in the first posture angle of the foldable electronic device, the foldable electronic device acquires a third posture angle, and determines a third viewing angle of the first three-dimensional model according to the third posture angle; The foldable electronic device displays the updated first image according to the third viewing angle.
4. The interface display method according to claim 3, characterized in that: In response to the foldable electronic device being folded from the first folding angle to a first angle interval, the foldable electronic device displays a first image frame sequence, comprising: When the foldable electronic device displays the updated first image according to the third viewing angle, the foldable electronic device displays the first image frame sequence, and the content of the first image frame of the first image frame sequence is connected with the content of the updated first image.
5. The interface display method according to claim 2, characterized in that: After the foldable electronic device displays the second image according to the second viewing angle, the further comprising: In response to a change in the second posture angle of the foldable electronic device, the foldable electronic device acquires a fourth posture angle, and determines a fourth viewing angle of the second three-dimensional model according to the fourth posture angle; The foldable electronic device displays the updated second image according to the fourth viewing angle.
6. The interface display method according to claim 2, characterized in that: In response to the foldable electronic device being folded from the first angle interval to the second angle interval, the foldable electronic device playing a first video includes: The foldable electronic device plays the first video frame to the last video frame of the first video in sequence, the first video frame of the first video includes an image of the first three-dimensional model at a preset perspective, the last video frame of the first video includes an image of the second three-dimensional model at the preset perspective, and the depth of field of the first three-dimensional model in the first video frame of the first video is smaller than the depth of field of the second three-dimensional model in the last video frame of the first video.
7. The interface display method according to claim 2, characterized in that: In response to the foldable electronic device lighting up the screen, before the foldable electronic device displays the first image, the method further includes: In response to an operation of a first application on the foldable electronic device, the first application sets a target wallpaper; After the target wallpaper is set, the first application interacts with the first component to start a first module of the first component, where the first module is used to render the target wallpaper; The first module calls at least one sensor of the foldable electronic device to obtain a target folding angle of the foldable electronic device and a target posture angle of the foldable electronic device.
8. The interface display method according to claim 7, characterized in that: The first application interacts with the first component, including: The first application calls at least one first service to interact with the first component based on the first service, wherein the first service includes a theme manager and a wallpaper management service set in the framework layer.
9. The interface display method according to claim 7, characterized in that: The target wallpaper includes the first image, the first image frame sequence, the first video, the second image frame sequence, and the second image, which are displayed in sequence.
10. An interface display method, characterized in that: Applications in foldable electronic devices, including: When the foldable electronic device is at a second folding angle, in response to the foldable electronic device lighting up its screen, the foldable electronic device determines a second viewing angle of a second three-dimensional model according to a second posture angle, where the second posture angle includes a pitch angle, a roll angle, and a yaw angle of the foldable electronic device when the foldable electronic device is at the second folding angle, and the second three-dimensional model is used to generate the second image; The foldable electronic device displays the second image according to the second viewing angle; In response to the foldable electronic device being unfolded from the second folding angle to a third angle interval, the foldable electronic device displays a third image frame sequence, wherein the content of a first image frame of the third image frame sequence is connected to the content of the second image, wherein the second folding angle is less than any angle in the third angle interval, the third image frame sequence is a plurality of image frames preset in the foldable electronic device, and each of the third image frames corresponds to a model image of the second three-dimensional model at a different viewing angle; In response to the foldable electronic device being unfolded from the third angle interval to the second angle interval, the foldable electronic device plays a second video, where content of a last image frame of the third image frame sequence is connected to content of a first video frame of the second video, wherein any angle in the third angle interval is smaller than any angle in the second angle interval; In response to the foldable electronic device being unfolded from the second angle interval to the first angle interval, the foldable electronic device displays a fourth image frame sequence, where content of a last image frame of the second video is connected to content of a first image frame of the fourth image frame sequence, wherein any angle in the second angle interval is smaller than any angle in the first angle interval; In response to the foldable electronic device being unfolded from the first angle range to the first folding angle, the foldable electronic device displays a first image, and the content of the last image frame of the fourth image frame sequence is connected with the content of the first image, wherein any angle in the first angle range is smaller than the first folding angle.
11. The interface display method according to claim 10, characterized in that: The foldable electronic device displays a first image, including: The foldable electronic device determines a first viewing angle of a first three-dimensional model according to a first posture angle, where the first posture angle includes a pitch angle, a roll angle, and a yaw angle when the foldable electronic device is at the first folded angle, and the first three-dimensional model is used to generate the first image; The foldable electronic device displays the first image according to the first viewing angle.
12. The interface display method according to claim 10, characterized in that: After the foldable electronic device displays the second image according to the second viewing angle, the further comprising: In response to a change in the second posture angle of the foldable electronic device, the foldable electronic device acquires a fourth posture angle, and determines a fourth viewing angle of the second three-dimensional model according to the fourth posture angle; The foldable electronic device displays the updated second image according to the fourth viewing angle.
13. The interface display method according to claim 12, characterized in that: In response to the foldable electronic device being unfolded from the second folding angle to a third angle interval, the foldable electronic device displays a third image frame sequence, comprising: When the foldable electronic device displays the updated second image according to the fourth viewing angle, the foldable electronic device displays the third image frame sequence, and the content of the first image frame of the third image frame sequence is connected with the content of the updated second image.
14. The interface display method according to claim 11, characterized in that: After the foldable electronic device displays the first image according to the first viewing angle, the further comprising: In response to a change in the first posture angle of the foldable electronic device, the foldable electronic device acquires a third posture angle, and determines a third viewing angle of the first three-dimensional model according to the third posture angle; The foldable electronic device displays the updated first image according to the third viewing angle.
15. The interface display method according to claim 11, characterized in that: In response to the foldable electronic device being unfolded from the third angle interval to the second angle interval, the foldable electronic device playing a second video includes: The foldable electronic device plays the first video frame to the last video frame of the second video in sequence, the first video frame of the second video includes an image of the second three-dimensional model at a preset perspective, the last video frame of the second video includes an image of the first three-dimensional model at the preset perspective, and the depth of field of the second three-dimensional model in the first video frame of the second video is greater than the depth of field of the first three-dimensional model in the last video frame of the second video.
16. The interface display method according to claim 11, characterized in that: In response to the foldable electronic device lighting up the screen, before the foldable electronic device displays the second image, the method further includes: In response to an operation of a first application on the foldable electronic device, the first application sets a target wallpaper; After the target wallpaper is set, the first application interacts with the first component to start a first module of the first component, where the first module is used to render the target wallpaper; The first module calls at least one sensor of the foldable electronic device to obtain a target folding angle of the foldable electronic device and a target posture angle of the foldable electronic device.
17. The interface display method according to claim 16, characterized in that: The foldable electronic device interacts with the first component through the first application, including: The first application calls at least one first service to interact with the first component based on the first service, wherein the first service includes a theme manager and a wallpaper management service set in the framework layer.
18. The interface display method according to claim 16, characterized in that: The target wallpaper includes the second image, the third image frame sequence, the second video, the fourth image frame sequence, and the first image, which are displayed in sequence.
19. A foldable electronic device, characterized in that: include: processor and memory; The memory stores program instructions, and when the program instructions are executed by the processor, the foldable electronic device executes the interface display method according to any one of claims 1 to 18.
20. A chip system, characterized in that: include: memory and processor; The memory stores program instructions, and when the program instructions are executed by the processor, the chip system executes the interface display method according to any one of claims 1 to 18.
21. A computer storage medium, characterized in that The computer storage medium stores program instructions, and when the program instructions are executed on the computer, the computer executes the interface display method according to any one of claims 1 to 18.
Citation Information
Patent Citations
Wallpaper display method and device, equipment, storage medium and program product
CN115543159A
Dynamic wallpaper display method and related equipment
CN116414328A