Interface display method and foldable electronic equipment

Abstract

The invention provides an interface display method and foldable electronic equipment. The method comprises the steps that when the foldable electronic equipment is at a first folding angle, the foldable electronic equipment displays a first image in response to the fact that the screen of the foldable electronic equipment is turned on; in response to the folding of the foldable electronic equipment from a first folding angle to a first angle interval, the foldable electronic equipment displays a first image frame sequence, the content of the first image frame of the first image frame sequence is connected with the content of the first image, and the first folding angle is greater than any angle in the first angle interval; in response to the folding of the foldable electronic equipment from the first angle interval to a second angle interval, the foldable electronic equipment plays a first video, and the content of the last image frame of the first image frame sequence is connected with the content of the first video frame of the first video, any angle in the first angle interval is larger than any angle in the second angle interval. According to the technical scheme, the problem that 3D wallpaper display is not smooth can be solved.

Description

Technical Field

[0001] The present application relates to the technical field of electronic devices, and in particular to an interface display method and a foldable electronic device. Background Art

[0002] 3D wallpaper is a three-dimensional wallpaper that needs to be produced based on special modeling and rendering technologies. Since the modeling model has the property of being non-deformable, when an electronic device uses 3D wallpaper, it can only present the effect of changing the perspective based on the modeling model, but cannot change the size of the modeling model to present dynamic effects such as zooming in or out.

[0003] When foldable electronic devices use 3D wallpapers, the inner and outer screens need to be switched when the foldable electronic devices switch between the folded state and the unfolded state, and the display contents on the inner and outer screens have different sizes. Therefore, it is necessary to provide dynamic effects such as zooming in and out based on the video in the 3D wallpaper to achieve the connection between the modeling models of different sizes on the inner and outer screens.

[0004] At present, when applying 3D wallpapers on foldable electronic devices, there is a problem that the modeling model and the video are not smoothly connected, resulting in an unsmooth display of the 3D wallpaper. Summary of the invention

[0005] The embodiments of the present application provide an interface display method and a foldable electronic device, which can solve the problem that in the process of applying 3D wallpaper in current foldable electronic devices, the connection between the modeling model and the video is not smooth, resulting in the unsmooth display of the 3D wallpaper, thereby improving the user experience.

[0006] In a first aspect, an embodiment of the present application provides an interface display method, which is applied to a foldable electronic device, including: when the foldable electronic device is at a first folding angle, in response to the foldable electronic device lighting up the screen, the foldable electronic device displays a first image; in response to the foldable electronic device being folded from the first folding angle to a first angle interval, the foldable electronic device displays a first image frame sequence, and the content of the first image frame of the first image frame sequence is connected with the content of the first image, wherein the first folding angle is greater than any angle in the first angle interval; in response to the foldable electronic device being folded from the first angle interval to the second angle interval, the foldable electronic device plays a first video, and the content of the last image frame of the first image frame sequence is connected with the content of the first video frame, wherein any angle in the first angle interval is greater than any angle in the second angle interval.

[0007] The interface display method shown in the embodiment of the present application sets a first image frame sequence between the first image and the first video so that the modeling model of the first image and the first video are smoothly connected. In this way, when the foldable electronic device changes from a fully unfolded state to a folded state, the 3D wallpaper can be displayed smoothly.

[0008] In one implementation, in response to the foldable electronic device being folded from a first angle interval to a second angle interval, after the foldable electronic device plays a first video, the method further includes: in response to the foldable electronic device being folded from the second angle interval to a third angle interval, the foldable electronic device displays a second image frame sequence, the content of the last video frame of the first video is connected with the content of the first image frame of the second image frame sequence, wherein any angle in the second angle interval is greater than any angle in the third angle interval; in response to the foldable electronic device being folded from the third angle interval to a second folding angle, the foldable electronic device displays a second image, the content of the last image frame of the second image frame sequence is connected with the content of the second image, wherein any angle in the third angle interval is greater than the second folding angle. With this implementation, by setting a second image frame sequence between the second image and the first video, the modeling model of the second image is smoothly connected with the first video, so that the 3D wallpaper can be displayed smoothly during the process of the foldable electronic device being further folded to a fully folded state.

[0009] In one implementation, a foldable electronic device displays a first image, including: the foldable electronic device determines a first viewing angle of a first three-dimensional model according to a first posture angle, the first posture angle includes a pitch angle, a roll angle, and a yaw angle when the foldable electronic device is at the first folding angle, and the first three-dimensional model is used to generate a first image; the foldable electronic device displays the first image according to the first viewing angle. This implementation shows a specific rendering method of the first image.

[0010] In one implementation, the foldable electronic device displays a second image, including: the foldable electronic device determines a second viewing angle of a second three-dimensional model according to a second posture angle, the second posture angle includes a pitch angle, a roll angle, and a yaw angle when the foldable electronic device is at the second folding angle, and the second three-dimensional model is used to generate a second image; the foldable electronic device displays the second image according to the second viewing angle. This implementation shows a specific rendering method of the second image.

[0011] In one implementation, after the foldable electronic device displays the first image according to the first viewing angle, the further step includes: in response to a change in the first posture angle of the foldable electronic device, the foldable electronic device acquires a third posture angle, and determines a third viewing angle of the first three-dimensional model according to the third posture angle; the foldable electronic device displays the updated first image according to the third viewing angle. With this implementation, when the foldable electronic device is in a fully unfolded state, based on different posture angles, the foldable electronic device can render first images corresponding to different viewing angles based on the same three-dimensional model, so as to provide a 3D visual effect to the user and enhance the user's visual experience.

[0012] In one implementation, in response to the foldable electronic device being folded from a first folding angle to a first angle interval, the foldable electronic device displays a first image frame sequence, including: when the foldable electronic device displays an updated first image according to a third viewing angle, the foldable electronic device displays the first image frame sequence, and the content of the first image frame of the first image frame sequence is connected with the content of the updated first image. With this implementation, when the foldable electronic device is in a fully unfolded state, based on different posture angles, the foldable electronic device can make the first image frame sequence match the first image at different angles, so that the first image and the first image frame sequence can be smoothly connected.

[0013] In one implementation, after the foldable electronic device displays the second image according to the second viewing angle, the method further includes: in response to a change in the second posture angle of the foldable electronic device, the foldable electronic device acquires a fourth posture angle, and determines a fourth viewing angle of the second three-dimensional model according to the fourth posture angle; the foldable electronic device displays the updated second image according to the fourth viewing angle. With this implementation, when the foldable electronic device is in a fully folded state, based on different posture angles, the foldable electronic device can render second images of different viewing angles based on the same three-dimensional model, so as to provide a 3D visual effect to the user and enhance the user's visual experience.

[0014] In one implementation, in response to the foldable electronic device being folded from a first angle interval to a second angle interval, the foldable electronic device plays a first video, including: the foldable electronic device sequentially plays the first video frame to the last video frame of the first video, the first video frame of the first video includes an image of a first three-dimensional model at a preset viewing angle, the last video frame of the first video includes an image of a second three-dimensional model at a preset viewing angle, and the depth of field of the first three-dimensional model in the first video frame of the first video is less than the depth of field of the second three-dimensional model in the last video frame of the first video. With this implementation, the 3D wallpaper provided by the foldable electronic device can present a shrinking animation effect in conjunction with the change of the folding screen from an unfolded state to a folded state, thereby enhancing the user's visual experience.

[0015] In one implementation, in response to the foldable electronic device lighting up the screen, before the foldable electronic device displays the first image, it also includes: in response to the operation of the first application acting on the foldable electronic device, the first application sets the target wallpaper; after the target wallpaper is set, the first application interacts with the first component to start the first module of the first component, and the first module is used to render the target wallpaper; the first module calls at least one sensor of the foldable electronic device to obtain the target folding angle of the foldable electronic device and the target posture angle of the foldable electronic device. Using this implementation, the setting method of the target wallpaper is shown, and the interface display method of the embodiment of the present application can be implemented based on this setting method.

[0016] In one implementation, the first application interacts with the first component, including: the first application calls at least one first service to interact with the first component based on the first service, wherein the first service includes a theme manager and a wallpaper management service set in the framework layer. This implementation is used to illustrate a specific method for the first application to interact with the first component.

[0017] In one implementation, the target wallpaper includes a first image, a first image frame sequence, a first video, a second image frame sequence, and a second image displayed in sequence. With this implementation, the foldable electronic device can smoothly display the 3D wallpaper during the process of changing from a fully unfolded state to a fully folded state.

[0018] In a second aspect, an embodiment of the present application provides an interface display method, which is applied to a foldable electronic device, including: when the foldable electronic device is at a second folding angle, in response to the foldable electronic device lighting up the screen, the foldable electronic device displays a second image; in response to the foldable electronic device being unfolded from the second folding angle to a third angle interval, the foldable electronic device displays a third image frame sequence, and the content of the first image frame of the third image frame sequence is connected with the content of the second image, wherein the second folding angle is less than any angle in the third angle interval; in response to the foldable electronic device being unfolded from the third angle interval to the second angle interval, the foldable electronic device plays a second video, and the content of the last image frame of the third image frame sequence is connected with the content of the first video frame of the second video, wherein any angle in the third angle interval is less than any angle in the second angle interval.

[0019] The interface display method shown in the embodiment of the present application sets a third image frame sequence between the second image and the second video, so that the modeling model of the second image is smoothly connected with the second video. In this way, when the foldable electronic device changes from a fully folded state to an unfolded state, the 3D wallpaper can be displayed smoothly.

[0020] In one implementation, in response to the foldable electronic device being unfolded from the third angle interval to the second angle interval, after the foldable electronic device plays the second video, the method further includes: in response to the foldable electronic device being unfolded from the second angle interval to the first angle interval, the foldable electronic device displays a fourth image frame sequence, the content of the last image frame of the second video is connected with the content of the first image frame of the fourth image frame sequence, wherein any angle in the second angle interval is smaller than any angle in the first angle interval; in response to the foldable electronic device being unfolded from the first angle interval to the first folding angle, the foldable electronic device displays the first image, the content of the last image frame of the fourth image frame sequence is connected with the content of the first image, wherein any angle in the first angle interval is smaller than the first folding angle. With this implementation, by setting the fourth image frame sequence between the first image and the second video, the modeling model of the first image is smoothly connected with the second video, so that the 3D wallpaper can be smoothly displayed in the process of the foldable electronic device further unfolding to the fully unfolded state.

[0021] In one implementation, the foldable electronic device displays a second image, including: the foldable electronic device determines a second viewing angle of a second three-dimensional model according to a second posture angle, the second posture angle includes a pitch angle, a roll angle, and a yaw angle when the foldable electronic device is at the second folding angle, and the second three-dimensional model is used to generate a second image; the foldable electronic device displays the second image according to the second viewing angle. This implementation shows a specific rendering method of the second image.

[0022] In one implementation, a foldable electronic device displays a first image, including: the foldable electronic device determines a first viewing angle of a first three-dimensional model according to a first posture angle, the first posture angle includes a pitch angle, a roll angle, and a yaw angle when the foldable electronic device is at the first folding angle, and the first three-dimensional model is used to generate a first image; the foldable electronic device displays the first image according to the first viewing angle. Using this implementation, a specific rendering method of the second image is shown.

[0023] In one implementation, after the foldable electronic device displays the second image according to the second viewing angle, the further step includes: in response to a change in the second posture angle of the foldable electronic device, the foldable electronic device acquires a fourth posture angle, and determines a fourth viewing angle of the second three-dimensional model according to the fourth posture angle; the foldable electronic device displays the updated second image according to the fourth viewing angle. With this implementation, when the foldable electronic device is in a fully folded state, based on different posture angles, the foldable electronic device can render second images corresponding to different viewing angles based on the same three-dimensional model, so as to provide a 3D visual effect to the user and enhance the user's visual experience.

[0024] In one implementation, in response to the foldable electronic device being unfolded from the second folding angle to the third angle interval, the foldable electronic device displays a third image frame sequence, including: when the foldable electronic device displays the updated second image according to the fourth viewing angle, the foldable electronic device displays the third image frame sequence, and the content of the first image frame of the third image frame sequence is connected with the content of the updated second image. With this implementation, when the foldable electronic device is in a fully folded state, based on different posture angles, the foldable electronic device can make the third image frame sequence match the second image at different angles, so that the second image and the third image frame sequence can be smoothly connected.

[0025] In one implementation, after the foldable electronic device displays the first image according to the first viewing angle, the further method includes: in response to a change in the first posture angle of the foldable electronic device, the foldable electronic device acquires a third posture angle, and determines a third viewing angle of the first three-dimensional model according to the third posture angle; the foldable electronic device displays the updated first image according to the third viewing angle. With this implementation, when the foldable electronic device is in a fully unfolded state, based on different posture angles, the foldable electronic device can render first images of different viewing angles based on the same three-dimensional model, so as to provide a 3D visual effect to the user and enhance the user's visual experience.

[0026] In one implementation, in response to the foldable electronic device being unfolded from the third angle interval to the second angle interval, the foldable electronic device plays the second video, including: the foldable electronic device sequentially plays the first video frame to the last video frame of the second video, the first video frame of the second video includes an image of the second three-dimensional model at a preset viewing angle, the last video frame of the second video includes an image of the first three-dimensional model at a preset viewing angle, and the depth of field of the second three-dimensional model in the first video frame of the second video is greater than the depth of field of the first three-dimensional model in the last video frame of the second video. With this implementation, the 3D wallpaper provided by the foldable electronic device can present a magnification effect in conjunction with the change of the folding screen from the folded state to the unfolded state, thereby enhancing the user's visual experience.

[0027] In one implementation, in response to the foldable electronic device lighting up the screen, before the foldable electronic device displays the second image, it also includes: in response to the operation of the first application acting on the foldable electronic device, the first application sets the target wallpaper; after the target wallpaper is set, the first application interacts with the first component to start the first module of the first component, and the first module is used to render the target wallpaper; the first module calls at least one sensor of the foldable electronic device to obtain the target folding angle of the foldable electronic device and the target posture angle of the foldable electronic device. Using this implementation, the setting method of the target wallpaper is shown, and the interface display method of the embodiment of the present application can be implemented based on this setting method.

[0028] In one implementation, the foldable electronic device interacts with the first component through a first application, including: the first application calls at least one first service to interact with the first component based on the first service, wherein the first service includes a theme manager and a wallpaper management service set in a framework layer. This implementation is used to illustrate a specific method for the first application to interact with the first component.

[0029] In one implementation, the target wallpaper includes a second image, a third image frame sequence, a second video, a fourth image frame sequence, and a first image displayed in sequence. With this implementation, the foldable electronic device can smoothly display the 3D wallpaper during the process of changing from a fully folded state to a fully unfolded state.

[0030] In a third aspect, an embodiment of the present application provides a foldable electronic device, comprising: a processor and a memory; the memory stores program instructions, and when the program instructions are executed by the processor, the foldable electronic device executes the interface display method in the first aspect, the second aspect and any implementation method mentioned above.

[0031] In a fourth aspect, an embodiment of the present application provides a chip system, comprising: a memory and a processor; the memory stores program instructions, and when the program instructions are executed by the processor, the chip system executes the interface display method in the first aspect, the second aspect and any implementation method mentioned above.

[0032] In a fifth aspect, an embodiment of the present application provides a computer storage medium, in which program instructions are stored. When the program instructions are run on a computer, the computer executes the interface display method in the first aspect, the second aspect, and any implementation method described above.

[0033] In a sixth aspect, an embodiment of the present application provides a computer program product. When the computer program product is run on a foldable electronic device, the foldable electronic device executes the interface display method in the first aspect, the second aspect and any implementation method described above.

[0034] It can be understood that the foldable electronic devices, chip systems, computer storage media and computer program products provided in the above-mentioned aspects are all applied to the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] Figure 1 This is a schematic diagram of the usage scenarios of 3D wallpaper;

[0036] Figure 2 This is a schematic diagram of the types of foldable screen mobile phones;

[0037] Figure 3 This is a schematic diagram of the first scenario of the switching state of an outward-folding folding screen mobile phone;

[0038] Figure 4 This is a schematic diagram of the second scenario of the switching state of the outward-folding folding screen mobile phone;

[0039] Figure 5 It is a schematic diagram of the connection process between the modeling model and the video in an outward-folding folding screen mobile phone;

[0040] Figure 6 is a schematic diagram of the hardware structure of a foldable electronic device provided in an embodiment of the present application;

[0041] Figure 7 is a schematic diagram of the software structure of a foldable electronic device provided in an embodiment of the present application;

[0042] Figure 8 This is the first flow chart of the interface display method provided in the embodiment of the present application;

[0043] Fig. 9 This is the first interactive diagram of the interface display method provided in the embodiment of the present application;

[0044] Fig.10 is a schematic diagram of a method for setting a target wallpaper provided in an embodiment of the present application;

[0045] Fig.11 It is a schematic diagram of the interaction process of the software structure provided in the embodiment of the present application;

[0046] Fig.12 is a schematic diagram of a target folding angle and a target posture angle provided in an embodiment of the present application;

[0047] Fig.13 is a second flow chart of the interface display method provided in an embodiment of the present application;

[0048] Fig.14 This is the second interaction diagram of the interface display method provided in the embodiment of the present application;

[0049] Fig.15 This is a schematic diagram of a first usage scenario of a foldable electronic device provided in an embodiment of the present application;

[0050] Fig.16 This is a schematic diagram of a second usage scenario of a foldable electronic device provided in an embodiment of the present application;

[0051] Fig.17 This is a schematic diagram of a third usage scenario of the foldable electronic device provided in an embodiment of the present application;

[0052] Fig.18This is a schematic diagram of a fourth usage scenario of a foldable electronic device provided in an embodiment of the present application;

[0053] Fig.19 This is a schematic diagram of a fifth usage scenario of a foldable electronic device provided in an embodiment of the present application;

[0054] Fig. 20 This is a schematic diagram of a sixth usage scenario of a foldable electronic device provided in an embodiment of the present application;

[0055] Fig.21 This is the third flow chart of the interface display method provided in the embodiment of the present application;

[0056] Fig. 22 It is the third interaction diagram of the interface display method provided in the embodiment of the present application;

[0057] Fig.23 This is a schematic diagram of a seventh usage scenario of a foldable electronic device provided in an embodiment of the present application;

[0058] Fig.24 This is a schematic diagram of an eighth usage scenario of a foldable electronic device provided in an embodiment of the present application;

[0059] Fig.25 is a schematic diagram of a ninth usage scenario of a foldable electronic device provided in an embodiment of the present application;

[0060] Fig.26 This is a schematic diagram of the tenth usage scenario of the foldable electronic device provided in an embodiment of the present application;

[0061] Fig. 27 It is a structural schematic diagram of the interface display device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0062] The technical scheme of the embodiment of the present application will be clearly described below in conjunction with the drawings in the embodiment of the present application. Obviously, the described embodiment is a part of the embodiment of the present application, not all of the embodiments. Based on the embodiment of the present application, other embodiments obtained by ordinary technicians in this field without making creative work are all within the scope of protection of the present application.

[0063] In the description of this application, unless otherwise specified, " / " means "or", for example, A / B can mean A or B. "And / or" in this article is merely a description of the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, "at least one" means one or more, and "plurality" means two or more. The words "first", "second", etc. do not limit the quantity and execution order, and the words "first", "second", etc. do not limit them to be different.

[0064] In addition, in the present application, directional terms such as "upper", "lower", "inner" and "outer" are defined relative to the orientation of the components schematically placed in the drawings. It should be understood that these directional terms are relative concepts. They are used for relative description and clarification, and they can change accordingly according to the changes in the orientation of the components placed in the drawings.

[0065] It should be noted that, in this application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in this application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0066] The following first describes the application scenarios of the embodiments of the present application.

[0067] Electronic devices are usually provided with wallpapers on their display interfaces to enhance the aesthetics of the electronic devices and provide users with good visual enjoyment.

[0068] Wallpapers include three-dimensional (3D) wallpapers. 3D wallpapers include three dimensions: length, width, and height, and have a three-dimensional feel. When a user shakes an electronic device or moves a finger on the display screen, the 3D wallpaper changes the viewing angle in response to the user's operation to present a better sense of realism and give the user an immersive visual experience. This type of wallpaper needs to be produced based on special modeling and rendering technologies, and the specific method can be to render a map on an indeformable modeling model.

[0069] Figure 1 This is a schematic diagram of the usage scenarios of 3D wallpaper.

[0070] like Figure 1As shown in A in FIG. 1 , the electronic device displays a first model 102 in the first display interface 101. The first model 102 is a non-deformable model, on which a first texture can be attached. When the user shakes the electronic device, since the first model 102 is non-deformable, the first model 102 can only present the effect of changing the viewing angle to display the first texture at different positions, but cannot present the effects of zooming in or out based on deformation. Among them, the zooming out effect is caused by Figure 1 A in Figure 1 If the electronic device needs to present a zoom-out effect by modeling a model, it is necessary to sequentially establish multiple modeling models similar to the first model 102 from large to small, and the zoom-out effect cannot be presented by directly changing the size of the first model 102. It should be noted here that the size involved in the zoom-in and zoom-out effects in this application is defined based on the visual effect of large near and small far away.

[0071] 3D wallpapers can be applied to many types of electronic devices. For example, mobile phones include flat screen phones, curved screen phones, and foldable screen phones. When using 3D wallpapers on flat screen and curved screen phones, the modeling model in the 3D wallpaper is usually kept at a fixed size, for example Figure 1 The first model 102 in the figure. In the process of applying 3D wallpapers on foldable screen mobile phones, since it involves switching between the folded state and the unfolded state, the foldable screen mobile phone needs to make the wallpaper present dynamic effects such as enlargement and reduction based on deformation during the state switching process to maintain the smoothness of the wallpaper display. These dynamic effects cannot be realized based on the modeling model and can only be displayed in the form of video. Therefore, in the process of switching states, the foldable screen mobile phone needs to realize the connection process of modeling model-video-modeling model in the 3D wallpaper to display the 3D wallpaper.

[0072] The following is a detailed description of the scenario in which a foldable screen mobile phone displays 3D wallpaper.

[0073] Figure 2 This is a schematic diagram of the types of foldable screen mobile phones.

[0074] like Figure 2 As shown, foldable screen mobile phones usually include Figure 2 The inward-folding screen mobile phone shown in A, Figure 2 The outward folding screen mobile phone shown in B and Figure 2 The foldable screen mobile phone shown in C. It should be noted here that any type of foldable screen mobile phone can be applied to the application scenarios shown in this application, and this application does not limit this.

[0075] This application is only Figure 2 The outward-folding folding screen mobile phone shown in B is used as an example for illustration.

[0076] Figure 3 This is a schematic diagram of the first scenario of the switching state of an outward-folding folding screen mobile phone.

[0077] The outward folding screen mobile phone can be switched from the folded state to the unfolded state, such as Figure 3 As shown in A in the figure, when in the folded state, the outward folding screen mobile phone displays the second model 104 in the second display interface 103, and the second model 104 is a non-deformable modeling model. Figure 3 As shown in B in the figure, during the switching state, the second display interface 103 displays the first animation 105. The first animation 105 is a video generated by multiple video frames. Each video frame can display an image of a model. In the video frames displayed in sequence, the image of the model is gradually enlarged. In this way, the first animation 105 presents an enlarged dynamic effect to connect with the second model 104. Figure 3 As shown in C in FIG. 1 , after the state switching is completed, the third model 106 is displayed in the second display interface 103. The third model 106 is a non-deformable modeling model, which has different content and depth of field from the second model 104. The depth of field of the third model 106 is usually smaller than that of the second model 104. Figure 3 As shown in D in FIG. 1 , when the user shakes the outward-folding folding screen mobile phone or the user's finger moves on the unfolded folding screen, the folding screen mobile phone can change the viewing angle of the third model 106 on the unfolded folding screen. Figure 3 As shown in FIG. 8E , the third model 106 before the perspective is changed and the third model 106 after the perspective is changed are superimposed to more clearly show the change in the perspective of the third model 106 .

[0078] Figure 4 This is a schematic diagram of the second scenario of the outward-folding folding screen mobile phone switching state.

[0079] Correspondingly, the outward folding screen mobile phone can be switched from the unfolded state to the folded state, such as Figure 4 As shown in A in FIG. 1 , when in the unfolded state, the external folding screen mobile phone displays the third model 106 in the second display interface 103. Figure 4 As shown in B, during the switching state, the second display interface 103 displays the second animation 107. The second animation 107 is a video generated by multiple video frames. Each video frame can display an image of a model. In the video frames displayed in sequence, the image of the model gradually shrinks. In this way, the second animation 107 presents a shrinking effect to connect with the third model 106. It should be noted here that the difference between the second animation 107 and the first animation 105 in the aforementioned scene can be that the playback order of the video frames is different. Figure 4 As shown in C in FIG. 1 , after the state switching is completed, the second display interface 103 displays the second model 104. Figure 4 As shown in D in FIG. 1 , when a user shakes an outward-folding folding screen mobile phone or a user's finger moves on the folding screen in the unfolded state, the folding screen mobile phone can change the viewing angle of the second model 104 on the folding screen in its folded state.

[0080] However, there are the following problems in the above-mentioned switching state scenario.

[0081] Figure 5 It is a schematic diagram of the connection process between the modeling model and the video in an outward-folding folding screen mobile phone.

[0082] like Figure 3 and Figure 5 As shown, taking the scene of playing the first animation 105 in the 3D wallpaper as an example, based on the properties of the first animation 105 itself, the first animation 105 will not switch the viewing angle in the outward-folding folding screen mobile phone, and its display viewing angle matches the conventional display viewing angle of the folding screen (hereinafter referred to as the forward viewing angle).

[0083] In this way, when switching from the fully folded state to the unfolded state, the external folding screen mobile phone switches from displaying the second model 104 to displaying the first animation 105. Since the second model 104 can switch the viewing angle, the second model 104 is not necessarily in the forward viewing angle of the folding screen in the current state of the foldable electronic device. When the viewing angle of the second model 104 deviates from the forward viewing angle of the folding screen to a large extent, the deviation angle between the second model 104 and the model image in the first image frame of the first animation 105 is large. Therefore, during the state switching process, the second model 104 will quickly jump to the first image frame of the first animation 105, resulting in the problem of unsmooth connection between the second model 104 and the first animation 105. Correspondingly, when further switching from the unfolded state to the fully unfolded state, the third model 106 may also have a large deviation angle from the model image in the last image frame of the first animation 105, resulting in the problem of unsmooth connection between the first animation 105 and the third model 106. This unsmooth connection problem makes the user's vision incoherent and affects the user's visual experience.

[0084] In order to solve the above problems, an embodiment of the present application provides an interface display method.

[0085] The interface display method provided in the embodiment of the present application can be applied to foldable electronic devices. Among them, foldable electronic devices include but are not limited to mobile phones, tablet computers, personal computers, workstation devices, large-screen devices (such as smart screens, smart TVs, etc.), wearable devices (such as smart bracelets, smart watches), handheld game consoles, home game consoles, virtual reality devices, augmented reality devices, mixed reality devices, etc., in-vehicle smart terminals, etc.

[0086] In the following embodiments of the present application, the foldable electronic devices are all exemplified by outward-folding folding screen mobile phones, but the outward-folding folding screen mobile phones do not constitute a limitation on the foldable electronic devices.

[0087] Figure 6 It is a schematic diagram of the hardware structure of the foldable electronic device provided in an embodiment of the present application.

[0088] like Figure 6 As shown, the foldable electronic device 100 may include a processor 110, a memory 120, an antenna 1, an antenna 2, a mobile communication module 130, a wireless communication module 140, a sensor module 150, a display screen 160, etc. Among them, the sensor module 150 may include a touch sensor 150A, a gyroscope sensor 150B, an air pressure sensor 150C, a geomagnetic sensor 150D, an acceleration sensor 150E, a distance sensor 150F, a proximity light sensor 150G, etc. Among them, the gyroscope sensor 150B, the geomagnetic sensor 150D, the acceleration sensor 150E, etc. can be integrated into an inertial measurement unit (IMU) sensor. The IMU sensor is a device that can integrate multiple sensors, which is used to measure and track the posture, movement and acceleration of the foldable electronic device 100, and provide the foldable electronic device 100 with accurate posture, direction and movement information.

[0089] It is understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the foldable electronic device 100. In other embodiments of the present application, the foldable electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0090] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0091] The memory 120 can be used to store computer executable program codes, and the executable program codes include instructions. The memory 120 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the foldable electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the memory 120 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (Universal flash storage, UFS), etc. The processor 110 executes various functional applications and data processing of the foldable electronic device 100 by running instructions stored in the memory 120, and / or instructions stored in a memory provided in the processor.

[0092] The wireless communication function of the foldable electronic device 100 can be implemented through antenna 1, antenna 2, mobile communication module 130, wireless communication module 140, modem processor and baseband processor.

[0093] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the foldable electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0094] The mobile communication module 130 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the foldable electronic device 100. The mobile communication module 130 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 130 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 130 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 130 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 130 can be set in the same device as at least some of the modules of the processor 110.

[0095] The modem processor may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device, or displays an image or video through the display screen 160. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 130 or other functional modules.

[0096] The wireless communication module 140 may be one or more devices integrating at least one communication processing module. The wireless communication module 140 receives electromagnetic waves via the antenna 2, modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 140 may also receive signals to be sent from the processor 110, modulate the frequencies of the signals, amplify the signals, and convert the signals into electromagnetic waves for radiation via the antenna 2.

[0097] In some embodiments, the antenna 1 of the foldable electronic device 100 is coupled to the mobile communication module 130, and the antenna 2 is coupled to the wireless communication module 160, so that the foldable electronic device 100 can communicate with the network and other devices through wireless communication technology.

[0098] The foldable electronic device 100 implements the display function through a GPU, a display screen 160, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 160 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0099] The display screen 160 is used to display images, videos, etc. The display screen 160 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the foldable electronic device 100 may include 1 or N display screens 160, where N is a positive integer greater than 1. In the embodiment of the present application, the display screen 160 may be a folding screen.

[0100] The touch sensor 150A is also called a "touch control device". The touch sensor 150A can be arranged on the display screen 160, and the touch sensor 150A and the display screen 160 form a touch screen, also called a "touch control screen". The touch sensor 150A is used to detect touch operations acting on or near it. The touch sensor 150A can pass the detected touch operation to the application processor to determine the type of touch event. The visual output related to the touch operation can be provided by the display screen 160. In other embodiments, the touch sensor 150A can also be arranged on the surface of the foldable electronic device 100, which is different from the position of the display screen 160. In the embodiment of the present application, the touch sensor 150A can pass the touch operation to the application processor after detecting the touch operation to determine that the touch event is used to change the viewing angle of the 3D wallpaper, and the display screen 160 provides the viewing angle change effect of the 3D wallpaper related to the touch operation. The touch sensor 150A can also detect changes in the touch position to calculate the folding angle of the display screen 160 through a software algorithm.

[0101] The gyro sensor 150B can be used to determine the motion posture of the foldable electronic device 100. In some embodiments, the angular velocity of the foldable electronic device 100 around three axes (i.e., x, y, and z axes) can be determined by the gyro sensor 150B. The gyro sensor 150B can be used for anti-shake shooting. Exemplarily, when the shutter is pressed, the gyro sensor 150B detects the angle of the shaking of the foldable electronic device 100, calculates the distance that the lens module needs to compensate according to the angle, and allows the lens to offset the shaking of the foldable electronic device 100 through reverse movement to achieve anti-shake. The gyro sensor 180B can also be used for navigation and somatosensory game scenes. In an embodiment of the present application, the gyro sensor 150B can detect the angle of shaking of the foldable electronic device 100 so that the display screen 160 provides a perspective change effect of 3D wallpaper based on the shaking angle.

[0102] The air pressure sensor 150C is used to measure air pressure. In some embodiments, the foldable electronic device 100 calculates the altitude through the air pressure value measured by the air pressure sensor 150C to assist in positioning and navigation.

[0103] The geomagnetic sensor 150D includes a Hall sensor. The foldable electronic device 100 can use the geomagnetic sensor 150D to detect the opening and closing of the flip leather case. In some embodiments, when the foldable electronic device 100 is a flip phone, the foldable electronic device 100 can detect the opening and closing of the flip according to the geomagnetic sensor 150D. Then, according to the detected opening and closing state of the leather case or the opening and closing state of the flip, the characteristics such as automatic unlocking of the flip are set. In the embodiment of the present application, the foldable electronic device 100 can use the geomagnetic sensor 150D to detect the opening and closing of the folding screen mobile phone.

[0104] The acceleration sensor 150E can detect the magnitude of the acceleration of the foldable electronic device 100 in all directions (generally three axes). When the foldable electronic device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the foldable electronic device 100, and is applied to applications such as horizontal and vertical screen switching and pedometers. In the embodiment of the present application, the acceleration sensor 150E can detect the posture of the foldable electronic device 100, so that the display screen 160 provides a perspective change effect of a 3D wallpaper based on the posture of the foldable electronic device 100.

[0105] The distance sensor 150F is used to measure the distance. The foldable electronic device 100 can measure the distance by infrared or laser. In some embodiments, when shooting a scene, the foldable electronic device 100 can use the distance sensor 150F to measure the distance to achieve fast focusing.

[0106] The proximity light sensor 150G may include, for example, a light emitting diode and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The foldable electronic device 100 emits infrared light outward through the light emitting diode. The foldable electronic device 100 uses a photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the foldable electronic device 100. When insufficient reflected light is detected, the foldable electronic device 100 can determine that there is no object near the foldable electronic device 100. The foldable electronic device 100 can use the proximity light sensor 150G to detect that the user holds the foldable electronic device 100 close to the ear to talk, so as to automatically turn off the screen to save power. The proximity light sensor 150G can also be used in the leather case mode, and the pocket mode automatically unlocks and locks the screen. In the embodiment of the present application, the foldable electronic device 100 can monitor the bending degree and shape changes of the display screen 160 through the proximity light sensor to calculate the angle change of the folding screen.

[0107] The software system of the foldable electronic device 100 can adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes the Android system of the layered architecture as an example to illustrate the software structure of the foldable electronic device 100.

[0108] Figure 7 It is a schematic diagram of the software structure of the foldable electronic device provided in an embodiment of the present application.

[0109] The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system library, and the kernel layer.

[0110] The application layer can include a series of application packages.

[0111] like Figure 7 As shown, the application package may include applications such as battery management, camera, gallery, calendar, call, map, navigation, music, video, short message, theme, wallpaper, etc.

[0112] Among them, the theme application is an application that can change multiple appearance elements at one time. In addition to the wallpaper, the theme application can change the icons, fonts, system interface style and other elements of the foldable electronic device 100. The theme application can create a complete theme style and apply it to the foldable electronic device 100.

[0113] Wallpaper applications usually contain a series of wallpaper images and provide a user interface and functions so that users can select, set and change wallpapers. Such applications may also contain other additional functions, such as wallpaper classification, folding wallpapers, dynamic wallpapers, super wallpapers, 3D wallpapers, wallpaper editing tools, etc., to enhance the user's wallpaper experience.

[0114] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0115] like Figure 7 As shown, the application framework layer may include a window manager, an input manager InputManager, a sensor manager SensorManager, a phone manager, a resource manager, a notification manager, a theme manager ThemeManager, a wallpaper management service WallpaperManagerService, and the like.

[0116] The input manager may be used to monitor user input events, such as click events and slide events performed by the user's finger on the display screen 160 of the foldable electronic device 100. By monitoring input events, the foldable electronic device 100 may determine whether the foldable electronic device 100 is being used.

[0117] The sensor manager is used to monitor the data returned by various sensors in the foldable electronic device 100, such as motion sensor data, proximity light sensor data, temperature sensor data, etc. Using the data returned by various sensors, the foldable electronic device 100 can determine whether it is shaking or whether the display screen 160 is blocked.

[0118] The theme manager is used to manage themes and skins on the foldable electronic device 100, and generally includes functions such as theme browsing, theme downloading, theme installation, and theme management. When the foldable electronic device 100 performs the theme browsing function, the user can browse various themes and skins through the theme manager and preview their effects. When the foldable electronic device 100 performs the theme downloading function, the user can download favorite themes and skins through the theme manager. When the foldable electronic device 100 performs the theme installation function, the user can install and use the themes and skins through the theme manager. When the foldable electronic device 100 performs the theme management function, the user can manage the installed themes and skins through the theme manager.

[0119] The wallpaper manager is used to provide wallpaper resources and manage wallpapers, usually including wallpaper resources, wallpaper browsing, wallpaper downloading, wallpaper management, wallpaper recommendation and other functions.

[0120] It should be noted here that although both the Theme Manager and the Wallpaper Management Service are related to appearance customization, the Theme Manager is more comprehensive and provides more appearance customization options, including multiple elements including wallpapers, while the Wallpaper Management Service focuses more on the acquisition and management of wallpaper resources.

[0121] Android Runtime includes core libraries and virtual machines. Android runtime is responsible for scheduling and management of the Android system.

[0122] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.

[0123] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0124] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0125] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0126] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0127] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0128] A 2D graphics engine is a drawing engine for 2D drawings.

[0129] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

[0130] It is understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the foldable electronic device 100. In other embodiments of the present application, the foldable electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0131] Figure 8 This is the first flow chart of the interface display method provided in the embodiment of the present application.

[0132] Fig. 9 This is the first interactive diagram of the interface display method provided in the embodiment of the present application.

[0133] like Figure 8 and Fig. 9 As shown, the method includes the following steps S101-S103.

[0134] Step S101, in response to an operation of a first application on the foldable electronic device 100, the first application sets a target wallpaper, wherein the attribute of the target wallpaper is a 3D wallpaper.

[0135] The operation of the first application program acting on the foldable electronic device 100 may be a series of continuous operations or a single operation. The first application program may be a theme application program.

[0136] Taking the operation of the first application program acting on the foldable electronic device 100 as a continuous operation as an example, the manner of setting the target wallpaper of the foldable electronic device 100 is exemplarily described.

[0137] Fig.10 It is a schematic diagram of a method for setting a target wallpaper provided in an embodiment of the present application.

[0138] like Fig.10 As shown, the foldable electronic device 100 enters the setting page 12 in response to the user's operation on the setting application 11 .

[0139] The setting page 12 may include a plurality of setting options, such as a desktop and wallpaper option 13. In response to the user's operation on the desktop and wallpaper option 13, the foldable electronic device 100 displays a theme page 14.

[0140] It should be noted here that the theme application can usually be pre-installed in the foldable electronic device 100 when leaving the factory, and the desktop and wallpaper option 13 can serve as an access entrance to the theme application. In this way, the foldable electronic device 100 can access the theme application in response to the user's operation on the desktop and wallpaper option 13 to enter the theme page 14.

[0141] The theme page 14 may include wallpapers with multiple attributes, such as a first wallpaper 15 with the attribute of a 3D wallpaper, a second wallpaper 16 with the attribute of a dynamic wallpaper, a third wallpaper 17 with the attribute of a 2D wallpaper, etc. The target wallpaper may be the first wallpaper 15. The foldable electronic device 100 may select the first wallpaper 15 in response to the user's operation on the first wallpaper 15, and display a preview page 18 of the first wallpaper 15.

[0142] The preview page 18 may include an apply button 19. In response to the user operating the apply button 19, the foldable electronic device 100 may set the first wallpaper 15 as the current wallpaper.

[0143] In one implementation, the foldable electronic device 100 can set the first wallpaper 15 as the current wallpaper in response to the user's operation on the wallpaper replacement component (this method is not shown in the drawings).

[0144] That is, the operation of the first application acting on the foldable electronic device 100 may include a series of continuous operations such as the operation of the setting application 11, the operation of the desktop and wallpaper option 13, the operation of the first wallpaper 15, and the operation of the application button 19, or may be a single operation of operating the wallpaper replacement component. The embodiment of the present application does not limit the specific operation method of the operation of the first application acting on the foldable electronic device 100.

[0145] In this way, the foldable electronic device 100 completes the setting of the target wallpaper.

[0146] Step S102, after the target wallpaper is set, the first application interacts with the first component to start the first module of the first component, and the first module is used to render the target wallpaper.

[0147] Specifically, the first application may call at least one first service to interact with the first component based on the first service.

[0148] The first service may include a theme manager and a wallpaper management service in the application framework layer. The first component may be a wallpaper application package (Android Appliaction Package, APK). The first module may be a 3D wallpaper module in the wallpaper APK, which can be used to display, render and control the code and resources of the 3D wallpaper.

[0149] Fig.11 It is a schematic diagram of the interaction process of the software structure provided in the embodiment of the present application.

[0150] like Fig.11As shown, when the first application is a theme application and the first component is a wallpaper APK, the theme application and the wallpaper APK involve software interaction between the application layer and the application framework layer.

[0151] The theme application is usually used to provide different icons, interface styles, fonts and wallpapers for the foldable electronic device 100. Wallpapers are an important part of the theme application. In order to provide more wallpapers, the theme application can cooperate with the wallpaper APK. In this way, the wallpaper APK can be used as an auxiliary component of the theme application to provide the wallpapers required by the theme application.

[0152] The wallpaper APK includes the installation file of the wallpaper application, which includes the code, resources, etc. of the wallpaper application so that the wallpaper application can run in the foldable electronic device 100. The wallpaper APK provides all the functions and features of the wallpaper application. After the wallpaper APK is installed in the foldable electronic device 100, the various wallpaper modules provided by the wallpaper APK can be run, such as the folding wallpaper module, the dynamic wallpaper module, the super wallpaper module, and the 3D wallpaper module.

[0153] Specifically, the theme application and the wallpaper APK are both set in the application layer. Because the foldable electronic device 100 usually has a preset wallpaper before selecting the target wallpaper, the theme application can first call the theme manager to switch the preset wallpaper to the target wallpaper, and after switching to the target wallpaper, call the wallpaper management service to enable the wallpaper APK to run the 3D wallpaper module through the wallpaper management service.

[0154] Step S103 : The first module calls at least one sensor of the foldable electronic device 100 to obtain a target folding angle of the foldable electronic device 100 and a target posture angle of the foldable electronic device 100 .

[0155] The at least one sensor may include a first sensor and a second sensor.

[0156] In one implementation, step S103 may include the following steps S1031 - S1032 .

[0157] Step S1031: The first sensor obtains a target folding angle and reports the target folding angle to the first module in the first component.

[0158] Step S1032: The second sensor obtains the target posture angle and reports the target posture angle to the first module in the first component.

[0159] Specifically, the first module can register the first sensor to obtain the target folding angle of the foldable electronic device 100, and register the second sensor to obtain the target attitude angle of the foldable electronic device 100, wherein the target attitude angle includes at least one of the pitch angle, roll angle, and yaw angle of the foldable electronic device 100. Registration in the embodiment of the present application refers to the act of associating the first module with the sensor through a callback function or other means so that the first module can access or control the sensor.

[0160] Fig.12 It is a schematic diagram of the target folding angle and target posture angle provided in the embodiment of the present application.

[0161] like Fig.12 As shown, the first sensor may be an angle sensor integrated based on at least one of a touch sensor 150A, a geomagnetic sensor 150D, an acceleration sensor 150E, and a proximity light sensor 150G. The embodiment of the present application does not limit the type of sensor included in the first sensor. The foldable electronic device 100 may detect the start touch position and the end touch position corresponding to the operation of adjusting the angle of the folding screen by the user through the touch sensor 150A, and calculate the coordinates of the start touch position and the coordinates of the end touch position through the application processor to obtain the target folding angle of the folding screen. Further, the foldable electronic device 100 may also detect the change in the direction of the earth's magnetic field corresponding to the adjustment operation through the geomagnetic sensor 150D, and calculate the change in the direction of the magnetic field through the application processor to obtain the target folding angle of the folding screen. Further, the foldable electronic device 100 may also detect the change in the linear acceleration and tilt angle corresponding to the adjustment operation through the acceleration sensor 150E, and calculate the change in the linear acceleration and tilt angle through the application processor to obtain the target folding angle of the folding screen. Furthermore, the foldable electronic device 100 can also detect the change in the bending degree and shape of the folding screen caused by the adjustment operation through the proximity light sensor 150G to obtain the target folding angle of the folding screen.

[0162] That is to say, the first sensor can integrate one or more of the above-mentioned sensors to obtain the detection data provided by the integrated sensors, and send the detection data to the application processor, so that the application processor calculates the detection data based on the software algorithm, and then obtains the target folding angle of the folding screen.

[0163] The second sensor may be an IMU sensor integrated based on at least one of the gyro sensor 150B, the geomagnetic sensor 150D, and the acceleration sensor 150E. The embodiment of the present application does not limit the type of sensor included in the second sensor.

[0164] To facilitate the description of the foldable electronic device 100, in the embodiments of the present application, a three-dimensional coordinate system is established with the width direction of the foldable electronic device 100 as the x-axis, the length direction as the y-axis, and the thickness direction as the z-axis.

[0165] The target attitude angle of the foldable electronic device 100 can be obtained by measuring the pitch angle, roll angle and yaw angle of the foldable electronic device 100 ( Fig.12 ). Specifically, the pitch angle can be used to indicate the angle at which the foldable electronic device 100 rotates around the x-axis. For example, when the foldable electronic device 100 rotates upward along the horizontal plane, the pitch angle is a positive value, and when the foldable electronic device 100 rotates downward along the horizontal plane, the pitch angle is a negative value. The roll angle can be used to indicate the angle at which the foldable electronic device 100 rotates around the y-axis. For example, when the foldable electronic device 100 rotates to the left along the horizontal plane, the roll angle is a positive value, and when the foldable electronic device 100 rotates to the right along the horizontal plane, the roll angle is a negative value. The yaw angle can be used to indicate the angle at which the foldable electronic device 100 rotates around the z-axis. For example, when the foldable electronic device 100 rotates clockwise around the z-axis, the yaw angle is a negative value, and when the foldable electronic device 100 rotates counterclockwise around the z-axis, the yaw angle is a positive value.

[0166] In this way, the foldable electronic device 100 can determine the target posture angle of the foldable electronic device 100 according to the pitch angle, the roll angle and the yaw angle.

[0167] The first sensor and the second sensor are usually arranged at the hardware layer of the foldable electronic device 100. The application framework layer can provide a sensor interface for the first sensor and the second sensor at the hardware layer to realize the interaction between the application layer and the first sensor and the second sensor.

[0168] Further Fig.11 As shown, the foldable electronic device 100 can register and monitor the sensor interface of the application framework layer based on the 3D wallpaper module, and then register the first sensor and the second sensor of the hardware layer ( Fig.11The hardware layer is not shown in the figure), the registration process may, for example, be to provide an identifier to the sensor interface so that the sensor interface can correctly identify and manage the sensor, so that the 3D wallpaper module can obtain the permissions of the first sensor and the second sensor through the sensor interface, and receive the angle change event reported by the sensor interface after obtaining the permissions, the angle change event includes the target folding angle change event reported by the first sensor to the sensor interface, and the target posture angle change event reported by the second sensor to the sensor interface. It should be noted here that the sensor interface may include multiple interfaces, for example, including an interface corresponding to the first sensor and an interface corresponding to the second sensor, and the embodiment of the present application does not limit the number of interfaces and interface types included in the sensor interface.

[0169] After the first module completes the registration of the first sensor and the second sensor, if the registration is not cancelled, the first module can continue to receive angle change events reported by the first sensor and the second sensor, and obtain the target folding angle and the target posture angle in real time.

[0170] In the embodiment of the present application, after the target wallpaper is set, the folding screen of the foldable electronic device 100 can display the target wallpaper in any state, such as folded state, unfolded state, horizontal state, vertical state, etc.

[0171] Thus, Figure 5 The connection effect of the second model 104-first animation 105-third model 106 presented in the 3D wallpaper shown in the figure is different. In this embodiment, the target wallpaper can present the connection effect of the first image-first image frame sequence-first video-second image frame sequence-second image to ensure the user's visual continuity.

[0172] The process of the foldable electronic device 100 displaying the target wallpaper is described in detail below.

[0173] Fig.13 This is the second flow chart of the interface display method provided in the embodiment of the present application.

[0174] Fig.14 This is the second interaction diagram of the interface display method provided in the embodiment of the present application.

[0175] like Fig.13 and Fig.14 As shown, the method also includes the following steps S201-S203.

[0176] Step S201: When the foldable electronic device 100 is at a first folding angle, in response to the foldable electronic device 100 lighting up the screen, the foldable electronic device 100 displays a first image.

[0177] The target folding angle includes a first folding angle, which is an angle when the foldable electronic device 100 is in a fully unfolded state, for example, 180 degrees.

[0178] In one implementation, the foldable electronic device 100 determines a first viewing angle of the first three-dimensional model according to a first posture angle, wherein the first posture angle includes a pitch angle, a roll angle, and a yaw angle when the foldable electronic device 100 is at the first folding angle. The foldable electronic device 100 displays a first image according to the first viewing angle.

[0179] Fig.15 This is a schematic diagram of a first usage scenario of a foldable electronic device provided in an embodiment of the present application.

[0180] like Fig.15 As shown, the user can place the foldable electronic device 100 in a fully unfolded state at a certain location. After a period of time, the foldable electronic device 100 automatically enters the screen-off state. Furthermore, the foldable electronic device 100 can enter the screen-on state in response to a user clicking operation at any position on the foldable screen.

[0181] It should be noted here that the foldable electronic device 100 can also enter the screen-on state through other operating methods. For example, the foldable electronic device 100 can enter the screen-on state in response to the user pressing the power button. The embodiment of the present application does not limit the specific method for the foldable electronic device 100 to enter the screen-on state.

[0182] After the foldable electronic device 100 enters the screen-on state, the IMU mode is started. The IMU mode is a mode in which the foldable electronic device 100 uses the IMU sensor to obtain the target attitude angle and renders the image according to the target attitude angle. Among them, the foldable electronic device 100 can start the IMU mode by default in the screen-on state after the target wallpaper is set, or it can start the IMU mode by default when it is turned on. The embodiment of the present application does not limit the specific way in which the foldable electronic device 100 starts the IMU mode.

[0183] The foldable electronic device 100 can render the first image when it is in IMU mode. The essence of the first image is an IMU animation generated based on the first three-dimensional model, and the rendering process of the IMU animation can be implemented based on the 3D engine built into the 3D wallpaper module. After the 3D wallpaper module obtains the target folding angle and target posture angle of the foldable electronic device 100 in real time, the 3D wallpaper module updates the posture of the first three-dimensional model in real time according to the target posture angle at the target folding angle. The 3D engine can use a three-dimensional graphics processing library or other similar graphics processing library to render the IMU animation and send it to the display after rendering. In this way, the foldable electronic device 100 can display the first image.

[0184] It should be noted that the first image is not necessarily in the forward viewing angle of the folding screen. Therefore, the foldable electronic device 100 needs to further provide a first image frame sequence so that the first image and the first video can be smoothly connected.

[0185] Step S202, in response to the foldable electronic device 100 being folded from the first folding angle to the first angle interval, the foldable electronic device 100 displays a first image frame sequence, and the content of the first image frame of the first image frame sequence is connected with the content of the first image.

[0186] The foldable electronic device 100 enters the folded state from the fully unfolded state, so that the foldable electronic device 100 enters the second usage scenario from the first usage scenario in the first angle interval. The second usage scenario provided by the embodiment of the present application is a transition scenario between the foldable electronic device 100 displaying the first image and playing the first video.

[0187] The target folding angle also includes any angle in the first angle interval. For example, the first angle interval can be greater than 175 degrees and less than 180 degrees. The embodiment of the present application does not limit the specific numerical range of the first angle interval. The first folding angle is greater than any angle in the first angle interval.

[0188] The first image frame sequence may be a plurality of image frames preset in the foldable electronic device 100, and each image frame may correspond to a model image of the first three-dimensional model at different viewing angles. In this way, no matter at which target posture angle the foldable electronic device 100 is located, the foldable electronic device 100 may select a first image frame sequence of a preset number of frames for rendering and display, so that the content of the first image frame sequence is used to connect the content of the first image and the content of the first video frame of the first video.

[0189] Fig.16 This is a schematic diagram of a second usage scenario of the foldable electronic device provided in an embodiment of the present application.

[0190] like Fig.16 As shown, the user can fold the foldable electronic device 100 in the fully unfolded state, so that the foldable electronic device 100 gradually changes from 180 degrees to 175 degrees.

[0191] For example, the foldable electronic device 100 is 180 degrees and is in a Fig.16 When the target posture angle shown in A is 0, the first image 20 is displayed. Since the first video is preset in the foldable electronic device 100, Fig.16The image angle of the first zoomed-out video frame 21 in the first video shown in B is fixed and matches the forward viewing angle. It should be noted that the first zoomed-out video frame 21 is the first video frame of the first video and is used to make the first video present a zoomed-out animation. In this way, when the preset number of frames is 3, the foldable electronic device 100 renders the first image frame sequence as follows: Fig.16 The first sub-image 22 shown in C, as shown in FIG. Fig.16 The second sub-image 23 shown in D and Fig.16 The third sub-image 24 shown in E makes the contents of the first sub-image 22, the second sub-image 23 and the third sub-image 24 gradually change between the contents of the first image 20 and the first reduced video frame 21. Based on this, the foldable electronic device 100 will not have the problem of unsmooth connection between the first image 20 and the first video.

[0192] Step S203, in response to the foldable electronic device 100 being folded from the first angle interval to the second angle interval, the foldable electronic device 100 plays the first video, and the content of the last image frame of the first image frame sequence is connected with the content of the first video frame of the first video.

[0193] The foldable electronic device 100 is further folded, so that the foldable electronic device 100 enters the third usage scenario from the second usage scenario in the second angle interval, that is, from the transition scene between displaying the first image and playing the first video to the scene of playing the first video.

[0194] The target folding angle also includes any angle in the second angle interval. For example, the second angle interval can be greater than or equal to 10 degrees and less than or equal to 175 degrees. The embodiment of the present application does not limit the specific numerical range of the second angle interval. Any angle in the first angle interval is greater than any angle in the second angle interval.

[0195] The first video may be generated by a plurality of video frames preset in the foldable electronic device 100. Specifically, the playback process of the first video may be implemented based on the 3D wallpaper module. After the 3D wallpaper module determines that the foldable electronic device 100 enters the second angle interval, for example, when it is determined that the folding angle of the foldable electronic device 100 is 175 degrees, the 3D wallpaper module decodes the first video, and renders the decoded video frames through a 3D engine to generate a first video composed of a plurality of video frames, and plays it. It should be noted here that the first video matches the forward viewing angle of the folding screen.

[0196] In one implementation, the foldable electronic device 100 plays the first video frame to the last video frame of the first video in sequence, the first video frame of the first video includes an image of the first three-dimensional model at a preset viewing angle, the last video frame of the first video includes an image of the second three-dimensional model at a preset viewing angle, and the depth of field of the first three-dimensional model in the first video frame of the first video is smaller than the depth of field of the second three-dimensional model in the last video frame of the first video.

[0197] Among them, the preset viewing angle can be the forward viewing angle of the folding screen, the first video frame of the first video can display the image content of the first three-dimensional model at the first depth of field, the second video frame of the first video can display the image content of a similar model slightly smaller than the first three-dimensional model at the second depth of field,…, the Nth video frame of the first video can display the image content of the second three-dimensional model at the Nth depth of field, N is greater than or equal to 1, that is, in the first video, the video frames can be displayed in sequence as image contents of three-dimensional models with gradually increasing depth of field and different model sizes, so that the first video displays a zoom-out effect.

[0198] Fig.17 This is a schematic diagram of a third usage scenario of the foldable electronic device provided in an embodiment of the present application.

[0199] like Fig.17 As shown in A in the figure, the foldable electronic device 100 can play the first reduced video frame 21 of the forward viewing angle at 175 degrees. Further, in the process of changing from 175 degrees to 10 degrees, the second reduced video frame, the third reduced video frame, ..., the Nth reduced video frame are played in sequence, where N is a positive integer greater than or equal to 1.

[0200] like Fig.17 As shown in B, when the foldable electronic device 100 is folded at an angle of 10 degrees, the video frame is played, and the foldable screen displays the Nth reduced video frame 25 in the forward viewing angle.

[0201] In this way, the foldable electronic device 100 achieves a gradually shrinking motion effect by playing the first video.

[0202] Further Fig.13 As shown, in one implementation, after step S203, steps S204-S205 are also included.

[0203] Step S204, in response to the foldable electronic device 100 being folded from the second angle interval to the third angle interval, the foldable electronic device 100 displays a second image frame sequence, and the content of the last video frame of the first video is connected with the content of the first image frame of the second image frame sequence.

[0204] The foldable electronic device 100 is further folded, so that the foldable electronic device 100 enters the fourth usage scenario from the third usage scenario in the third angle interval. The fourth usage scenario provided by the embodiment of the present application is a transition scenario of the foldable electronic device 100 between playing the first video and displaying the second image.

[0205] The target folding angle also includes any angle in the third angle interval. For example, the third angle interval can be greater than 0 degrees and less than 10 degrees. The embodiment of the present application does not limit the specific numerical range of the third angle interval. Any angle in the second angle interval is greater than any angle in the third angle interval.

[0206] The second image frame sequence may be a plurality of image frames preset in the foldable electronic device 100, and each image frame may correspond to a model image of the second three-dimensional model at different viewing angles. In this way, no matter at which target posture angle the foldable electronic device 100 is located, the foldable electronic device 100 may select a second image frame sequence with a preset number of frames for rendering and display, so that the content of the second image frame sequence is used to connect the content of the last video frame of the first video and the content of the second image.

[0207] The user can further fold the foldable electronic device 100, so that the foldable electronic device 100 gradually changes from 10 degrees to 0 degrees.

[0208] Fig.18 This is a schematic diagram of a fourth usage scenario of the foldable electronic device provided in an embodiment of the present application.

[0209] like Fig.18 As shown in A in FIG. 1 , when the folding angle of the foldable electronic device 100 is 10 degrees, the Nth reduced video frame 25 of the first video is displayed, and the Nth reduced video frame 25 matches the forward viewing angle. Fig.18 As shown in B in FIG. 1 , when the folding angle of the foldable electronic device 100 is 0 degrees, the second image 26 is displayed. In this way, when the preset number of frames is 3 frames, the foldable electronic device 100 renders the second image frame sequence as follows: Fig.18 The fourth sub-image 27 shown in C, as shown in FIG. Fig.18 The fifth sub-image 28 shown in D and Fig.18 The sixth sub-image 29 shown in E makes the contents of the fourth sub-image 27, the fifth sub-image 28 and the sixth sub-image 29 gradually change between the contents of the Nth reduced video frame 25 and the second image 26. Based on this, the foldable electronic device 100 will not have the problem of unsmooth connection between the first video and the second image 26.

[0210] Step S205, in response to the foldable electronic device 100 being folded from the third angle interval to the second folding angle, the foldable electronic device 100 displays a second image, and the content of the last image frame of the second image frame sequence is connected with the content of the second image.

[0211] The target folding angle includes a second folding angle, which is an angle at which the foldable electronic device 100 is in a fully folded state, for example, 0 degrees. Any angle in the third angle range is greater than the second folding angle.

[0212] In one implementation, the foldable electronic device 100 determines a second viewing angle of the second three-dimensional model according to a second posture angle, wherein the second posture angle includes a pitch angle, a roll angle, and a yaw angle when the foldable electronic device 100 is at the second folding angle. The foldable electronic device 100 displays a second image according to the second viewing angle.

[0213] Specifically, when the foldable electronic device 100 is at the second folding angle, the IMU mode is started again to render the second image in this mode. The second image is essentially an IMU animation generated based on the second three-dimensional model, and the rendering process of the IMU animation can be implemented based on the 3D engine built into the 3D wallpaper module. After the 3D wallpaper module obtains the target folding angle and target posture angle of the foldable electronic device 100 in real time, the 3D wallpaper module updates the posture of the second three-dimensional model in real time according to the target posture angle at the target folding angle. The 3D engine can use a three-dimensional graphics processing library or other similar graphics processing library to render the IMU animation and send it to the display after rendering. In this way, the foldable electronic device 100 can display the second image.

[0214] It should be noted here that the second folding angle includes but is not limited to 0 degrees. When the foldable electronic device 100 is in an approximately fully folded state, the IMU mode can also be started. For example, the second folding angle can also be greater than 0 degrees and less than 5 degrees. The embodiment of the present application is only exemplified by the second folding angle of 0 degrees. In fact, the embodiment of the present application does not limit the specific numerical range of the second folding angle. When the second folding angle has a value other than 0 degrees, the range of each angle interval needs to be adjusted accordingly.

[0215] In this way, the foldable electronic device 100 completes the process of switching from a fully unfolded state to a fully folded state. The target wallpaper includes the first image, the first image frame sequence, the first video, the second image frame sequence and the second image displayed in sequence, and has a good connection effect. It avoids the problem that the deviation angle is too large in the connection process of the first image, the first video and the second image, resulting in unsmooth connection, discontinuous vision for the user, and affecting the user's visual experience.

[0216] In some other embodiments, step S206 - S207 may be further included after step S201 .

[0217] Step S206: in response to the first posture angle of the foldable electronic device 100 changing, the foldable electronic device 100 acquires a third posture angle, and determines a third viewing angle of the first three-dimensional model according to the third posture angle.

[0218] Step S207: The foldable electronic device 100 displays the updated first image according to the third viewing angle.

[0219] Fig.19 This is a schematic diagram of the fifth usage scenario of the foldable electronic device provided in an embodiment of the present application.

[0220] like Fig.19 As shown, when the foldable electronic device 100 is in a fully unfolded state, it can respond to the user's operation of freely changing the target posture angle to change from displaying the first image 20 to displaying the third image 30. The first image 20 and the third image 30 are images of the same three-dimensional model with different viewing angles. At different third posture angles, the foldable electronic device 100 can obtain different third images 30.

[0221] It should be noted here that, since changing the target posture angle of the foldable electronic device 100 is a continuous process, the foldable electronic device 100 can render the third image 30 at the first frame rate.

[0222] Among them, the frame rate refers to the number of image frames displayed by the foldable electronic device 100 in one second, and the unit is (Frames per second, fps). A higher frame rate can provide a smooth visual experience, and a lower frame rate may cause the picture to freeze or be incoherent. For example, the first frame rate can be 60fps. In the embodiment of the present application, the value of the first frame rate is only used for exemplary description, and the first frame rate can also be 30fps. The embodiment of the present application does not limit the specific value of the first frame rate.

[0223] In one implementation, the foldable electronic device 100 can dynamically adjust the first frame rate according to the third posture angle. If the third posture angle is offset to a greater extent relative to the first posture angle, the first frame rate can be made equal to 60fps, so that the user can obtain a delicate visual experience. If the third posture angle is offset to a lesser extent relative to the first posture angle, the first frame rate can be made equal to 30fps, so that the foldable electronic device 100 can not only ensure that the user has a smooth visual experience, but also reduce power consumption.

[0224] In one implementation, after the foldable electronic device 100 executes step S207, the implementation method of step S202 may be: when the foldable electronic device 100 displays the updated first image according to the third perspective, the foldable electronic device 100 displays a first image frame sequence, and the content of the first image frame of the first image frame sequence is connected with the content of the updated first image.

[0225] That is to say, in response to the change in viewing angle of the third image, the first image frame sequence needs to be adaptively matched to ensure smooth connection.

[0226] In one implementation, after step S205, steps S208-S209 may also be included.

[0227] Step S208, in response to the second posture angle of the foldable electronic device 100 changing, the foldable electronic device 100 acquires a fourth posture angle, and determines a fourth viewing angle of the second three-dimensional model according to the fourth posture angle.

[0228] Step S209: the foldable electronic device 100 displays the updated second image according to the fourth viewing angle.

[0229] Fig. 20 This is a schematic diagram of the sixth usage scenario of the foldable electronic device provided in an embodiment of the present application.

[0230] like Fig. 20 As shown, when the foldable electronic device 100 is in a fully folded state, it can respond to the user's operation of freely changing the target posture angle to change from displaying the second image 26 to displaying the fourth image 31. The second image 26 and the fourth image 31 are images of the same three-dimensional model with different viewing angles. At different fourth posture angles, the foldable electronic device 100 can obtain different fourth images 31.

[0231] In this way, the foldable electronic device 100 can continue to maintain the smooth display of the target wallpaper when it is in a fully folded state.

[0232] Fig.21 This is the third flow chart of the interface display method provided in the embodiment of the present application.

[0233] Fig. 22 This is the third interaction diagram of the interface display method provided in the embodiment of the present application.

[0234] like Fig.21 and Fig. 22 As shown, the method also includes the following steps S301-S303.

[0235] Step S301: When the foldable electronic device 100 is at a second folding angle, in response to the foldable electronic device 100 lighting up the screen, the foldable electronic device 100 displays a second image.

[0236] In one implementation, the foldable electronic device 100 determines a second viewing angle of the second three-dimensional model according to a second posture angle, wherein the second posture angle includes a pitch angle, a roll angle, and a yaw angle when the foldable electronic device 100 is at the second folding angle. The foldable electronic device 100 displays the first image according to the second viewing angle.

[0237] Fig.23 This is a schematic diagram of the seventh usage scenario of the foldable electronic device provided in an embodiment of the present application.

[0238] like Fig.23 As shown, the user can place the foldable electronic device 100 in a fully folded state at a certain location. After a period of time, the foldable electronic device 100 automatically enters the screen-off state. Furthermore, the foldable electronic device 100 can enter the screen-on state in response to a user clicking operation at any position on the foldable screen.

[0239] After the foldable electronic device 100 enters the screen-on state, the IMU mode is started. When the foldable electronic device 100 is in the IMU mode, the second image 26 can be rendered and displayed after rendering. The rendering process of the second image 26 can refer to the above embodiment, and this application will not be repeated.

[0240] It should be noted that the second image is not necessarily in the forward viewing angle of the folding screen. Therefore, the foldable electronic device 100 needs to further provide a third image frame sequence so that the second image and the second video can be smoothly connected.

[0241] Step S302, in response to the foldable electronic device 100 being unfolded from the second folding angle to the third angle interval, the foldable electronic device 100 displays a third image frame sequence, and the content of the first image frame of the third image frame sequence is connected with the content of the second image.

[0242] The foldable electronic device 100 enters the unfolded state from the fully folded state, so that the foldable electronic device 100 enters the eighth usage scenario from the seventh usage scenario in the third angle interval. The eighth usage scenario provided in the embodiment of the present application is a transition scenario between the foldable electronic device 100 displaying the second image and playing the second video.

[0243] The value range of the third angle interval can be found in the above embodiments, and this application will not elaborate on it.

[0244] The third image frame sequence may be a plurality of image frames preset in the foldable electronic device 100, and each image frame may correspond to a model image of the second three-dimensional model at different viewing angles. In this way, no matter at which target posture angle the foldable electronic device 100 is located, the foldable electronic device 100 may select a third image frame sequence of a preset number of frames for rendering and display, so that the content of the third image frame sequence is used to connect the content of the second image and the content of the first video frame of the second video.

[0245] Fig.24 This is a schematic diagram of the eighth usage scenario of the foldable electronic device provided in an embodiment of the present application.

[0246] like Fig.24 As shown, the user can unfold the foldable electronic device 100 in the fully folded state, so that the foldable electronic device 100 gradually changes from 0 degrees to 10 degrees.

[0247] For example, the foldable electronic device 100 is at 0 degrees and is in a Fig.24 When the target posture angle shown in A is reached, the second image 26 is displayed. Since the second video is preset in the foldable electronic device 100, Fig.24 The image angle of the first enlarged video frame 32 in the second video shown in B is fixed and matches the forward viewing angle. It should be noted that the first enlarged video frame 32 is the first video frame of the second video and is used to make the second video present an enlarged dynamic effect. In this way, when the preset number of frames is 3, the foldable electronic device 100 renders the third image frame sequence as follows: Fig.24 The seventh sub-image 33 shown in C, as shown in FIG. Fig.24 The eighth sub-image 34 shown in D and Fig.24 The ninth sub-image 35 shown in E makes the contents of the seventh sub-image 33, the eighth sub-image 34 and the ninth sub-image 35 gradually change between the second image 26 and the first enlarged video frame 32. Based on this, the foldable electronic device 100 will not have the problem of unsmooth connection between the second image 26 and the second video.

[0248] Step S303, in response to the foldable electronic device 100 being unfolded from the third angle interval to the second angle interval, the foldable electronic device 100 plays the second video, and the content of the last image frame of the third image frame sequence is connected with the content of the first video frame of the second video.

[0249] The foldable electronic device 100 is further unfolded, so that the foldable electronic device 100 enters the ninth usage scenario from the eighth usage scenario in the second angle interval, that is, from the transition scene between displaying the second image and playing the second video to the scene of playing the second video.

[0250] It should be noted here that the second video may have the same video frame content as the first video, but the playback order of the video frames is opposite.

[0251] The value range of the second angle interval can be found in the above embodiment, and this application will not elaborate on it.

[0252] In one implementation, the foldable electronic device plays the first video frame to the last video frame of the second video in sequence, the first video frame of the second video includes an image of the second three-dimensional model at a preset viewing angle, the last video frame of the second video includes an image of the first three-dimensional model at a preset viewing angle, and the depth of field of the second three-dimensional model in the first video frame of the second video is greater than the depth of field of the first three-dimensional model in the last video frame of the second video.

[0253] The setting method of the second video can refer to the first video, and this embodiment will not be repeated here.

[0254] Fig.25 This is a schematic diagram of the ninth usage scenario of the foldable electronic device provided in an embodiment of the present application.

[0255] like Fig.25 As shown in A in the figure, the foldable electronic device 100 can play the first enlarged video frame 32 of the forward viewing angle at 10 degrees. Further, in the process of changing from 10 degrees to 175 degrees, the second enlarged video frame, the third enlarged video frame, ..., the Nth enlarged video frame are played in sequence, where N is a positive integer greater than or equal to 1.

[0256] like Fig.25 As shown in B, when the foldable electronic device 100 is folded at an angle of 175 degrees, the video frame is played, and the foldable screen displays the Nth enlarged video frame 36 in the forward viewing angle.

[0257] In this way, the foldable electronic device 100 achieves a gradually enlarging motion effect by playing the second video.

[0258] Further Fig.21 As shown, in one implementation, after step S303, steps S304-S305 are also included.

[0259] Step S304, in response to the foldable electronic device 100 being unfolded from the second angle interval to the first angle interval, the foldable electronic device 100 displays a fourth image frame sequence, and the content of the last video frame of the second video is connected with the content of the first image frame of the fourth image frame sequence.

[0260] The foldable electronic device 100 is further unfolded, so that the foldable electronic device 100 enters the tenth usage scenario from the ninth usage scenario in the first angle interval. The tenth usage scenario provided by the embodiment of the present application is a transition scenario of the foldable electronic device 100 between playing the second video and rendering the first image.

[0261] The value range of the first angle interval can be found in the above embodiment, and this application will not elaborate on it.

[0262] The fourth image frame sequence can be a plurality of image frames preset in the foldable electronic device 100, and each image frame can correspond to a different target posture angle of the foldable electronic device 100. In this way, no matter which target posture angle the foldable electronic device 100 is in, the foldable electronic device 100 can select a fourth image frame sequence with a preset number of frames for rendering and display it, so that the content of the fourth image frame sequence is used to connect the content of the last video frame of the second video and the content of the first image.

[0263] The user can further unfold the foldable electronic device 100, so that the foldable electronic device 100 gradually changes from 175 degrees to 180 degrees.

[0264] Fig.26 This is a schematic diagram of the tenth usage scenario of the foldable electronic device provided in an embodiment of the present application.

[0265] like Fig.26 As shown in A in FIG. 1 , when the folding angle of the foldable electronic device 100 is 175 degrees, the Nth enlarged video frame 36 of the second video is displayed, and the Nth enlarged video frame 36 matches the forward viewing angle. Fig.26 As shown in B in FIG. 1 , when the folding angle of the foldable electronic device 100 is 180 degrees, the first image 20 is displayed. In this way, when the preset number of frames is 3 frames, the foldable electronic device 100 renders the fourth image frame sequence as follows: Fig.26 The tenth sub-image 37 shown in C, as shown in FIG. Fig.26 The eleventh sub-image 38 shown in FIG. Fig.26 The twelfth sub-image 39 shown in E makes the tenth sub-image 37, the eleventh sub-image 38 and the twelfth sub-image 39 gradually change between the Nth enlarged video frame 36 and the first image 20. Based on this, the foldable electronic device 100 will not have the problem of unsmooth connection between the second video and the first image 20.

[0266] Step S305, in response to the foldable electronic device 100 being unfolded from the first angle range to the first folded angle, the foldable electronic device 100 displays the first image, and the content of the last image frame of the fourth image frame sequence is connected with the content of the first image.

[0267] In one implementation, the foldable electronic device 100 determines a first viewing angle of the first three-dimensional model according to a first posture angle, wherein the first posture angle includes a pitch angle, a roll angle, and a yaw angle when the foldable electronic device 100 is at the first folding angle. The foldable electronic device 100 displays a first image according to the first viewing angle.

[0268] The specific manner in which the foldable electronic device 100 displays the first image can be found in the above embodiment, and this application will not elaborate on it.

[0269] In this way, the foldable electronic device 100 completes the process of switching from a fully folded state to a fully unfolded state. The target wallpaper includes the second image, the third image frame sequence, the second video, the fourth image frame sequence and the first image displayed in sequence, and has a good connection effect. It avoids the problem that the deviation angle is too large in the connection process of the second image, the second video and the first image, resulting in unsmooth connection, which makes the user's vision incoherent and affects the user's visual experience.

[0270] In some other embodiments, step S301 may be followed by steps S306 - S307 .

[0271] Step S306: in response to the second posture angle of the foldable electronic device 100 changing, the foldable electronic device 100 acquires a fourth posture angle, and determines a fourth viewing angle of the second three-dimensional model according to the fourth posture angle.

[0272] Step S307: The foldable electronic device 100 displays the updated second image according to the fourth viewing angle.

[0273] The process of the foldable electronic device 100 displaying the updated second image can refer to the above embodiment, and this application will not elaborate on it.

[0274] In one implementation, after the foldable electronic device 100 executes step S307, the implementation method of step S302 may be: when the foldable electronic device displays the updated second image according to the fourth perspective, the foldable electronic device displays a third image frame sequence, and the content of the first image frame of the third image frame sequence is connected with the content of the updated second image.

[0275] In one implementation, after step S305, steps S308-S309 may also be included.

[0276] Step S308, in response to the first posture angle of the foldable electronic device 100 changing, the foldable electronic device 100 acquires a third posture angle, and determines a third viewing angle of the first three-dimensional model according to the third posture angle.

[0277] Step S309: the foldable electronic device 100 displays the updated first image according to the third viewing angle.

[0278] The process of the foldable electronic device 100 displaying the updated first image can refer to the above embodiment, and this application will not elaborate on it.

[0279] In this way, the foldable electronic device 100 can continue to maintain the smooth display of the target wallpaper when it is in the fully unfolded state.

[0280] In summary, the interface display method provided in the embodiment of the present application can provide users with a smooth visual experience when the 3D wallpaper function is applied to a foldable screen mobile phone, and the foldable screen mobile phone is in any state such as folded state, unfolded state, folded-unfolded switching state, unfolded-folded state, etc.

[0281] The above mainly introduces the solution provided by the embodiment of the present application from the perspective of the foldable electronic device 100. It can be understood that in order to realize the above functions, the foldable electronic device 100 includes hardware structures and / or software modules corresponding to the execution of each function. Those skilled in the art should easily realize that, in combination with the steps of an interface display method of each example described in the embodiment disclosed in this application, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in hardware or in a foldable electronic device software-driven hardware manner depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0282] The embodiment of the present application can divide the above-mentioned foldable electronic device 100 into functional modules or functional units according to the above-mentioned method example. For example, each functional module or functional unit can be divided corresponding to each function, or two or more functions can be integrated into one processing module. The above-mentioned integrated module can be implemented in the form of hardware or in the form of software functional modules or functional units. Among them, the division of modules or units in the embodiment of the present application is schematic, which is only a logical function division. There may be other division methods in actual implementation.

[0283] Some other embodiments of the present application provide an interface display device.

[0284] Fig. 27 It is a structural schematic diagram of the interface display device provided in an embodiment of the present application.

[0285] like Fig. 27As shown, the interface display device may include: a display screen 1001, a memory 1002, a processor 1003 and a communication module 1004. The above-mentioned components may be connected via one or more communication buses 1005. The display screen 1001 may include a display panel 10011 and a touch sensor 10012, wherein the display panel 10011 is used to display an image, and the touch sensor 10012 may pass the detected touch operation to the application processor to determine the type of touch event, and provide visual output related to the touch operation through the display panel 10011. The processor 1003 may include one or more processing units, for example: the processor 1003 may include an application processor, a modem processor, a graphics processor, an image signal processor, a controller, a video codec, a digital signal processor, a baseband processor, and / or a neural network processor, etc. Among them, different processing units may be independent devices or integrated in one or more processors. The memory 1002 is coupled to the processor 1003 and is used to store various software programs and / or computer instructions. The memory 1002 may include a volatile memory and / or a non-volatile memory. When the processor executes the computer instructions, the interface display device can perform each function or step performed by the above method embodiment.

[0286] When the software program and / or multiple groups of instructions in the memory 1002 are executed by the processor 1003, the interface display device implements the following method steps: when the foldable electronic device is at a first folding angle, in response to the foldable electronic device lighting up the screen, the foldable electronic device displays a first image; in response to the foldable electronic device being folded from the first folding angle to the first angle interval, the foldable electronic device displays a first image frame sequence, and the first image frame of the first image frame sequence is connected with the first image, wherein the first folding angle is greater than any angle in the first angle interval; in response to the foldable electronic device being folded from the first angle interval to the second angle interval, the foldable electronic device plays a first video, and the content of the last image frame of the first image frame sequence is connected with the content of the first video frame, wherein any angle in the first angle interval is greater than any angle in the second angle interval.

[0287] The present application also provides a foldable electronic device, including: a processor, a memory and a touch screen; the memory stores program instructions, and when the program instructions are executed by the processor, the foldable electronic device executes the interface display method in any implementation method of the above embodiments.

[0288] The embodiment of the present application also provides a chip system, which includes at least one processor and at least one interface circuit. The processor and the interface circuit can be interconnected by lines. For example, the interface circuit can be used to receive signals from other devices (such as the memory of a foldable electronic device). For another example, the interface circuit can be used to send signals to other devices. Exemplarily, the interface circuit can read instructions stored in the memory and send the instructions to the processor. When the instructions are executed by the processor, the foldable electronic device can perform the various steps in the above embodiments. Of course, the chip system may also include other discrete devices, which is not specifically limited in the embodiment of the present application.

[0289] An embodiment of the present application also provides a computer-readable storage medium, which includes computer instructions. When the computer instructions are executed on the above-mentioned foldable electronic device, the foldable electronic device executes each function or step executed by the above-mentioned method embodiment.

[0290] The embodiment of the present application also provides a computer program product. When the computer program product is run on a computer, the computer is enabled to execute each function or step executed by the mobile phone in the above method embodiment.

[0291] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0292] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0293] The units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0294] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0295] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium, including several instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code.

[0296] The above contents are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application shall be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. An interface display method, characterized in that: Applications in foldable electronic devices, including: When the foldable electronic device is at a first folding angle, in response to the foldable electronic device lighting up the screen, the foldable electronic device displays a first image; In response to the foldable electronic device being folded from the first folding angle to a first angle interval, the foldable electronic device displays a first image frame sequence, wherein the content of a first image frame of the first image frame sequence is connected with the content of the first image, wherein the first folding angle is greater than any angle in the first angle interval; In response to the foldable electronic device being folded from the first angle interval to the second angle interval, the foldable electronic device plays a first video, and the content of the last image frame of the first image frame sequence is connected with the content of the first video frame of the first video, wherein any angle in the first angle interval is greater than any angle in the second angle interval.

2. The interface display method according to claim 1, characterized in that: In response to the folding of the foldable electronic device from the first angle interval to the second angle interval, after the foldable electronic device plays the first video, the method further includes: In response to the foldable electronic device being folded from the second angle interval to a third angle interval, the foldable electronic device displays a second image frame sequence, wherein the content of the last video frame of the first video is connected to the content of the first image frame of the second image frame sequence, wherein any angle in the second angle interval is greater than any angle in the third angle interval; In response to the foldable electronic device being folded from the third angle range to a second folding angle, the foldable electronic device displays a second image, and the content of the last image frame of the second image frame sequence is connected with the content of the second image, wherein any angle in the third angle range is greater than the second folding angle.

3. The interface display method according to claim 2, characterized in that: The foldable electronic device displays a first image, comprising: The foldable electronic device determines a first viewing angle of a first three-dimensional model according to a first posture angle, wherein the first posture angle includes a pitch angle, a roll angle, and a yaw angle when the foldable electronic device is at the first folding angle, and the first three-dimensional model is used to generate the first image; The foldable electronic device displays the first image according to the first viewing angle.

4. The interface display method according to claim 3, characterized in that: The foldable electronic device displays a second image, comprising: The foldable electronic device determines a second viewing angle of a second three-dimensional model according to a second posture angle, wherein the second posture angle includes a pitch angle, a roll angle, and a yaw angle when the foldable electronic device is at the second folding angle, and the second three-dimensional model is used to generate the second image; The foldable electronic device displays the second image according to the second viewing angle.

5. The interface display method according to claim 3, characterized in that: After the foldable electronic device displays the first image according to the first viewing angle, the further comprising: In response to a change in the first posture angle of the foldable electronic device, the foldable electronic device acquires a third posture angle, and determines a third viewing angle of the first three-dimensional model according to the third posture angle; The foldable electronic device displays the updated first image according to the third viewing angle.

6. The interface display method according to claim 5, characterized in that: In response to the foldable electronic device being folded from the first folding angle to a first angle interval, the foldable electronic device displays a first image frame sequence, comprising: When the foldable electronic device displays the updated first image according to the third viewing angle, the foldable electronic device displays the first image frame sequence, and the content of the first image frame of the first image frame sequence is connected with the content of the updated first image.

7. The interface display method according to claim 4, characterized in that: After the foldable electronic device displays the second image according to the second viewing angle, the further comprising: In response to a change in the second posture angle of the foldable electronic device, the foldable electronic device acquires a fourth posture angle, and determines a fourth viewing angle of the second three-dimensional model according to the fourth posture angle; The foldable electronic device displays the updated second image according to the fourth viewing angle.

8. The interface display method according to claim 4, characterized in that: In response to the foldable electronic device being folded from the first angle interval to the second angle interval, the foldable electronic device playing a first video, comprising: The foldable electronic device plays the first video frame to the last video frame in sequence, the first video frame of the first video includes an image of the first three-dimensional model at a preset viewing angle, the last video frame of the first video includes an image of the second three-dimensional model at the preset viewing angle, and the depth of field of the first three-dimensional model in the first video frame of the first video is smaller than the depth of field of the second three-dimensional model in the last video frame of the first video.

9. The interface display method according to claim 4, characterized in that: In response to the foldable electronic device lighting up the screen, before the foldable electronic device displays the first image, the method further includes: In response to an operation of a first application program acting on the foldable electronic device, the first application program sets a target wallpaper; After the target wallpaper is set, the first application interacts with the first component to start a first module of the first component, where the first module is used to render the target wallpaper; The first module calls at least one sensor of the foldable electronic device to obtain a target folding angle of the foldable electronic device and a target posture angle of the foldable electronic device.

10. The interface display method according to claim 9, characterized in that: The first application interacts with the first component, including: The first application calls at least one first service to interact with the first component based on the first service, wherein the first service includes a theme manager and a wallpaper management service set in a framework layer.

11. The interface display method according to claim 9, characterized in that: The target wallpaper includes the first image, the first image frame sequence, the first video, the second image frame sequence, and the second image, which are displayed in sequence.

12. An interface display method, characterized in that: Applications in foldable electronic devices, including: When the foldable electronic device is at a second folding angle, in response to the foldable electronic device lighting up the screen, the foldable electronic device displays a second image; In response to the foldable electronic device being unfolded from the second folding angle to a third angle interval, the foldable electronic device displays a third image frame sequence, wherein the content of a first image frame of the third image frame sequence is connected with the content of the second image, wherein the second folding angle is smaller than any angle in the third angle interval; In response to the foldable electronic device unfolding from the third angle interval to the second angle interval, the foldable electronic device plays a second video, and the content of the last image frame of the third image frame sequence is connected with the content of the first video frame of the second video, wherein any angle in the third angle interval is smaller than any angle in the second angle interval.

13. The interface display method according to claim 12, characterized in that: In response to the foldable electronic device being unfolded from the third angle interval to the second angle interval, after the foldable electronic device plays the second video, the method further includes: In response to the foldable electronic device being unfolded from the second angle interval to the first angle interval, the foldable electronic device displays a fourth image frame sequence, wherein the content of the last image frame of the second video is connected to the content of the first image frame of the fourth image frame sequence, wherein any angle in the second angle interval is smaller than any angle in the first angle interval; In response to the foldable electronic device being unfolded from the first angle range to the first folding angle, the foldable electronic device displays a first image, and the content of the last image frame of the fourth image frame sequence is connected with the content of the first image, wherein any angle in the first angle range is smaller than the first folding angle.

14. The interface display method according to claim 13, characterized in that: The foldable electronic device displays a second image, comprising: The foldable electronic device determines a second viewing angle of a second three-dimensional model according to a second posture angle, wherein the second posture angle includes a pitch angle, a roll angle, and a yaw angle when the foldable electronic device is at the second folding angle, and the second three-dimensional model is used to generate the second image; The foldable electronic device displays the second image according to the second viewing angle.

15. The interface display method according to claim 14, characterized in that: The foldable electronic device displays a first image, comprising: The foldable electronic device determines a first viewing angle of a first three-dimensional model according to a first posture angle, wherein the first posture angle includes a pitch angle, a roll angle, and a yaw angle when the foldable electronic device is at the first folding angle, and the first three-dimensional model is used to generate the first image; The foldable electronic device displays the first image according to the first viewing angle.

16. The interface display method according to claim 14, characterized in that: After the foldable electronic device displays the second image according to the second viewing angle, the further comprising: In response to a change in the second posture angle of the foldable electronic device, the foldable electronic device acquires a fourth posture angle, and determines a fourth viewing angle of the second three-dimensional model according to the fourth posture angle; The foldable electronic device displays the updated second image according to the fourth viewing angle.

17. The interface display method according to claim 16, characterized in that: In response to the foldable electronic device being unfolded from the second folding angle to a third angle interval, the foldable electronic device displays a third image frame sequence, comprising: When the foldable electronic device displays the updated second image according to the fourth viewing angle, the foldable electronic device displays the third image frame sequence, and the content of the first image frame of the third image frame sequence is connected with the content of the updated second image.

18. The interface display method according to claim 15, characterized in that: After the foldable electronic device displays the first image according to the first viewing angle, the further comprising: In response to a change in the first posture angle of the foldable electronic device, the foldable electronic device acquires a third posture angle, and determines a third viewing angle of the first three-dimensional model according to the third posture angle; The foldable electronic device displays the updated first image according to the third viewing angle.

19. The interface display method according to claim 15, characterized in that: In response to the foldable electronic device being unfolded from the third angle interval to the second angle interval, the foldable electronic device playing a second video, comprising: The foldable electronic device plays the first video frame to the last video frame of the second video in sequence, the first video frame of the second video includes an image of the second three-dimensional model at a preset viewing angle, the last video frame of the second video includes an image of the first three-dimensional model at the preset viewing angle, and the depth of field of the second three-dimensional model in the first video frame of the second video is greater than the depth of field of the first three-dimensional model in the last video frame of the second video.

20. The interface display method according to claim 15, characterized in that: In response to the foldable electronic device lighting up the screen, before the foldable electronic device displays the second image, the method further includes: In response to an operation of a first application program acting on the foldable electronic device, the first application program sets a target wallpaper; After the target wallpaper is set, the first application interacts with the first component to start a first module of the first component, where the first module is used to render the target wallpaper; The first module calls at least one sensor of the foldable electronic device to obtain a target folding angle of the foldable electronic device and a target posture angle of the foldable electronic device.

21. The interface display method according to claim 20, characterized in that: The foldable electronic device interacts with the first component through the first application, including: The first application calls at least one first service to interact with the first component based on the first service, wherein the first service includes a theme manager and a wallpaper management service set in a framework layer.

22. The interface display method according to claim 20, characterized in that: The target wallpaper includes the second image, the third image frame sequence, the second video, the fourth image frame sequence, and the first image, which are displayed in sequence.

23. A foldable electronic device, characterized in that: include: Processor and memory; The memory stores program instructions, and when the program instructions are executed by the processor, the foldable electronic device executes the interface display method according to any one of claims 1 to 22.

24. A chip system, characterized in that: include: Memory and processor; The memory stores program instructions, and when the program instructions are executed by the processor, the chip system executes the interface display method described in any one of claims 1-22.

25. A computer storage medium, characterized in that The computer storage medium stores program instructions, and when the program instructions are executed on a computer, the computer executes the interface display method according to any one of claims 1 to 22.

Images