Interface processing method, electronic device, readable storage medium and program product

Abstract

The present application relates to the technical field of computer, in particular to an interface processing method, electronic equipment, readable storage medium and program product. The method can select a part of display elements with higher user perception to execute dynamic effect processing according to the degree of user perception of each display element before executing dynamic effect processing on a plurality of display elements on the current displayed interface, while another part of display elements with lower user perception do not participate in dynamic effect processing, for example, skipping the execution of dynamic effect instructions of the corresponding display elements. The user perception of each display element can include the user perception of each display element determined at any moment in the dynamic effect process, including the start moment and the end moment of the dynamic effect. In this way, the consumption of algorithm resource for processing a large number of display elements during the execution of dynamic effect processing can be reduced, which is beneficial to reducing the power consumption of the equipment.

Description

Technical Field

[0001] This invention relates to the field of computer technology, and more specifically to an interface processing method, an electronic device, a readable storage medium, and a program product. Background Technology

[0002] On electronic devices that support multi-window display, users can open multiple applications, and the electronic device can display the windows of multiple applications in a split-screen or overlay manner. For example, when the electronic device receives a user's instruction to enter the task center or display multiple desktops, or an instruction to display the windows of multiple applications in a split-screen manner, or when the user performs a one-click return to the desktop, the windows of the multiple applications that have been opened will appear or disappear with preset animation effects (hereinafter referred to as animation effects).

[0003] However, when there are many display windows on electronic devices such as computers, the amount of computation required to execute the above-mentioned preset animation effects on multiple windows is also greater. This will lead to excessive consumption of the computing resources of electronic devices, resulting in problems such as increased power consumption and reduced performance. Summary of the Invention

[0004] This application provides an interface processing method, an electronic device, a readable storage medium, and a program product, which can reduce the computational resource consumption involved in processing a large number of display elements during the execution of animation processing, thereby reducing device power consumption and improving device performance.

[0005] In a first aspect, this application provides an interface processing method applied to an electronic device. The method includes: displaying a first interface, the first interface including multiple display elements, a first element among the multiple display elements having a first element attribute; displaying animation effects during the process of switching from the first interface to a second interface, wherein the animation effects include animation effects corresponding to a first part of the multiple display elements, the animation effects corresponding to the first part of the display elements including a first animation effect corresponding to the first element, and the first animation effect is used to demonstrate the process of the first element attribute of the first element changing to a second element attribute, and the second interface includes a first element having a second element attribute.

[0006] For example, the aforementioned electronic device may include computers, such as laptops, tablets, etc., and mobile phones and other terminal electronic devices. The first interface displayed by the electronic device may be the desktop or other software / application interface currently displayed on the computer with multiple windows open. Correspondingly, the multiple display elements included in the first interface may include windows, desktop images, and dock bars. In some embodiments, the dock bar may also be the taskbar and / or status bar, which is not limited here. Based on this, the interface processing method provided in the first aspect above can control the display of only a portion of the display elements on the current interface during the process of switching interfaces on the electronic device, such as the animation corresponding to the first portion of display elements. In this way, the number of display elements that need to be processed for animation can be reduced, the consumption of computing resources can be reduced, and the power consumption of the device can be reduced, thereby improving the device performance.

[0007] It is understandable that the animations corresponding to the aforementioned display elements, such as the first animation corresponding to the first element in the first part of the display elements, correspond to the process of the element's attribute changing from the first element attribute to the second element attribute. This change in element attribute can include, for example, changes in window size, window display position, desktop icon display position, and dock bar display position, etc., as described below. Figures 1a to 1c The example of the interface change process is further illustrated in the following text. Figures 6a to 6c , Figures 7a to 7c The interface change process illustrated here is not limited.

[0008] It can be understood that the first element with the second element attribute included in the second interface mentioned above can include the elements described below. Figure 1c The icons of the relevant applications displayed in the dock on the desktop as shown in the example may also include those mentioned below. Figure 6c The display elements shown on the example task center interface, such as Window 1 and Window 2, may also include those mentioned below. Figure 7c The number of windows 1, 2, ..., n displayed on the example two-screen split-screen interface is not limited here.

[0009] In one possible implementation of the first aspect described above, the plurality of display elements further includes a second part of display elements, and the animation does not include the animation corresponding to the second part of display elements.

[0010] The interface processing method provided in this application allows for the control of not displaying another part of the display elements, such as the second part of the display elements mentioned above, during the switching of interfaces on an electronic device. Correspondingly, an electronic device implementing the interface processing method provided in this application can avoid drawing, rendering, or other processing of the second part of the display elements, thereby reducing the consumption of computing resources, reducing device power consumption, and improving device performance.

[0011] In one possible implementation of the first aspect described above, the user perception of a first portion of the display elements among the plurality of display elements satisfies a preset condition, while the user perception of a second portion of the display elements does not satisfy the preset condition.

[0012] For example, during the process of switching interfaces on an electronic device, by identifying whether the user perception of each display element meets preset conditions, a portion of the display elements that are perceptible to the user (such as the first portion of display elements mentioned above) can be selected from multiple display elements for animation processing. Correspondingly, the first portion of display elements whose user perception meets the preset conditions can be, for example, a portion of display elements whose user perception is greater than a relevant threshold, determined based on the element attributes of each display element. The specific type of the relevant threshold will be introduced below and will not be elaborated here.

[0013] In one possible implementation of the first aspect above, before displaying the animation during the process of switching from the first interface to the second interface, the method further includes: detecting a first operation instruction, wherein the first operation instruction is used to instruct the switching of the first interface to the second interface; and determining that the user perception of the second part of the display elements among a plurality of display elements does not meet a preset condition.

[0014] For example, the first operation instruction mentioned above may include the instruction generated corresponding to the user's instruction to "return to desktop with one click," which can trigger the following... Figures 1a to 1c The example interface change process; the first operation instruction mentioned above may also include the instruction generated corresponding to the user's instruction to "enter the task center", which can trigger the following... Figures 6a to 6c The example interface change process; the aforementioned first operation instruction may also include an instruction generated corresponding to the user's instruction to "enter split screen," which can trigger the following... Figures 7a to 7cThe example illustrates the interface change process. In other embodiments, the first operation instruction described above may also be an instruction generated corresponding to other operations performed by the user on the electronic device, which is not limited here. When the first operation instruction is detected, the electronic device may first filter out the display elements that do not participate in the animation processing from among the multiple display elements of the current interface, such as the second part of the display elements described above. Specific filtering methods may be implemented, for example, by ensuring that the user perception of the second part of the display elements does not meet preset conditions, such as the values ​​corresponding to the relevant element attributes of the display elements not meeting the preset conditions corresponding to the relevant thresholds, etc. These will be described in detail below and will not be repeated here.

[0015] In one possible implementation of the first aspect above, displaying animation effects during the transition from the first interface to the second interface includes: adding a first marker to a second element in the second part of the display elements, wherein the first marker is used to indicate that no animation effect processing is performed on the second element; executing a first animation effect instruction corresponding to the first element, and skipping or deleting a second animation effect instruction corresponding to the second element, wherein the first animation effect instruction is used to indicate that animation effect processing is performed on the first element, and the second animation effect instruction is used to indicate that animation effect processing is performed on the second element.

[0016] The interface processing method provided in this application controls the display of animation effects of a portion of interface elements (such as the first portion of interface elements mentioned above). This can be achieved by adding a first marker, such as "false" or "fork=0", to another portion of interface elements whose user perception does not meet the preset conditions (such as the second portion of interface elements mentioned above). This allows the electronic device to skip the execution of animation effect instructions corresponding to these display elements when refreshing the interface.

[0017] In some embodiments, the first marker described above can be added to the corresponding node in the UI node tree corresponding to the current display interface of the electronic device, without limitation. In this way, the UI node tree of the current display interface can be controlled by the electronic device, accurately controlling the drawing, rendering and other processing of the display elements corresponding to each node, reducing device power consumption in a timely manner, and improving device performance.

[0018] In one possible implementation of the first aspect above, after detecting the first operation instruction, the method further includes: determining that the user perception of a first portion of the display elements among a plurality of display elements meets a preset condition.

[0019] In one possible implementation of the first aspect above, displaying animation effects during the transition from the first interface to the second interface includes: adding a first marker to a second element in the second part of the display elements, wherein the first marker is used to indicate that no animation effect processing is performed on the second element; executing a first animation effect instruction corresponding to the first element, wherein the first animation effect instruction is used to indicate that animation effect processing is performed on the first element; and skipping the execution or deleting a second animation effect instruction corresponding to the second element, wherein the second animation effect instruction is used to indicate that animation effect processing is performed on the second element.

[0020] In other embodiments, the interface processing method provided in this application controls the implementation of the animation effects of a portion of interface elements (such as the first portion of interface elements mentioned above). It can also add a second marker, such as "true" or "fork=1", to a portion of interface elements whose user perception meets preset conditions. This allows the electronic device to execute the animation effects corresponding to the displayed elements when executing the animation effect instructions for each displayed element during interface refresh, while skipping or deleting the animation effects corresponding to another portion of displayed elements (such as the second portion of displayed elements mentioned above).

[0021] In some embodiments, the second marker described above may also be added to the corresponding node in the UI node tree corresponding to the current display interface of the electronic device, without limitation.

[0022] In one possible implementation of the first aspect above, before displaying the animation during the process of switching from the first interface to the second interface, the method further includes: responding to the first operation instruction, identifying the switching scenario corresponding to the process of switching from the first interface to the second interface; and determining the element type of multiple display elements based on the switching scenario, wherein the element type includes one or more of windows, icons, and dock bars.

[0023] In one possible implementation of the first aspect above, the element types of multiple display elements are determined based on the switching scenario, including: for a first type of switching scenario, the element types of multiple display elements include windows; for a second type of switching scenario, and the first interface includes the desktop, the element types of multiple display elements include windows, desktop icons, and dock bars.

[0024] In the process of switching interfaces in response to a first operation command on an electronic device, the current display scenario can be identified first, such as whether it is a first-type scenario or a second-type scenario. Then, the filtering results for the first part of the display elements in the current interface (e.g., the first interface mentioned above) that require animation processing are determined, as well as the filtering results for the second part of the display elements in the current interface that do not require animation processing are determined. The first-type scenario can be a display scenario that does not involve screen rotation, such as a user instruction to "enter the task center," a user instruction to "enter the task center," or a user instruction to "enter a split-screen mode." In this scenario, the type of the first part of the display elements in the current interface that require animation processing can include only windows, and may not include desktop icons and the dock. The second-type scenario can be a display scenario triggered when an electronic device that supports screen rotation rotates the screen under the user's operation. In this scenario, the type of the first part of the display elements in the current interface that require animation processing can include windows, desktop icons, and the dock.

[0025] In one possible implementation of the first aspect above, the first element corresponds to a first window, and the second element includes a second window, wherein the first window attribute corresponding to the first window is different from the second window attribute corresponding to the second window; or, the first element corresponds to a first window, and the second element includes the icon of the first application to which the first window belongs.

[0026] For example, in display scenarios where the user instructs "Enter Task Center" or "Enter Split Screen," the element attributes (i.e., window attributes) of the first element, such as the first window, can change to the window attributes of the other window after the user instructs "Enter Task Center." Similarly, when the user instructs "Enter Task Center," the element attributes (i.e., window attributes) of the first element, such as the first window, can change to the element attributes of the icon of the application corresponding to that first window; this is not restricted here.

[0027] In one possible implementation of the first aspect above, the user perception of the first window is related to at least one of the following: the degree to which the first window is occluded; the background transparency of the first window; the magnitude of the change in the window attributes of the first window from the first window attribute to the second window attribute; and the size of the display area occupied by the first window on the screen of the electronic device.

[0028] In one possible implementation of the first aspect above, the user perception of the first part of the display element satisfies preset conditions, including the following: detecting that the degree of occlusion of the first window is lower than a first threshold, and determining that the user perception of the first window satisfies preset conditions; detecting that the background transparency of the first window is higher than a second threshold, and determining that the user perception of the first window satisfies preset conditions; detecting that the change range of the window attributes of the first window is higher than a third threshold, and determining that the user perception of the first window satisfies preset conditions; detecting that the size of the display area occupied by the first window on the screen of the electronic device is higher than a fourth threshold, and determining that the user perception of the first window satisfies preset conditions.

[0029] In one possible implementation of the first aspect above, the method for determining the degree of occlusion of the first window includes: obtaining the third window attributes of the second window in multiple windows; and determining the degree to which the first window is occluded by the second window based on the first window attributes and the third window attributes.

[0030] In one possible implementation of the first aspect described above, the first window attribute includes at least one of the following: first coordinate information indicating the display position of the first window; a first alpha value indicating the background transparency of the first window; first size information indicating the display area occupied by the first window on the screen of the electronic device; and first priority information indicating the display priority of the first window.

[0031] In one possible implementation of the first aspect above, determining the degree to which the first window is occluded by the second window based on the first window attributes and the third window attributes includes: determining the degree to which the first window is occluded by the second window based on the first coordinate information and the first alpha value in the first window attributes, and the second coordinate information and the second alpha value in the third window attributes.

[0032] In one possible implementation of the first aspect above, the first window attribute corresponding to the first window is different from the second window attribute corresponding to the second window, including at least one of the following: the second coordinate information in the second window attribute indicating the display position of the second window is different from the first coordinate information; the second alpha value in the second window attribute indicating the background transparency of the second window is different from the first alpha value; the second size information in the second window attribute indicating the display area occupied by the second window on the screen of the electronic device is different from the first size information.

[0033] In one possible implementation of the first aspect described above, the second part of the display element includes a third window, and the user perception of the second part of the display element does not meet the preset conditions, including at least one of the following: detecting that the degree of occlusion of the third window is lower than a first threshold, and determining that the user perception of the first window meets the preset conditions; detecting that the background transparency of the third window is higher than a second threshold, and determining that the user perception of the first window meets the preset conditions; detecting that the change range of the window attributes of the first window is higher than a third threshold, and determining that the user perception of the first window meets the preset conditions; detecting that the size of the display area occupied by the third window on the screen of the electronic device is higher than a fourth threshold, and determining that the user perception of the first window meets the preset conditions.

[0034] For example, in some embodiments, the first threshold, second threshold, third threshold, and fourth threshold can all be set to 5%, etc.

[0035] For example, in some embodiments, the first threshold can be set to 5%, corresponding to a higher user perception of the window or desktop icon if the degree of occlusion is less than 5%. Similarly, the second threshold can be set to 5% of the maximum value, such as 0.05, corresponding to a higher user perception of the window if the alpha value is greater than 0.05. The third threshold can be set to 5%, corresponding to a higher user perception of the window if the change in window attributes before and after the animation is greater than 5%. The fourth threshold can also be set to 5%, corresponding to a higher user perception of the window if the percentage of the window's screen display area is greater than 5%. In other embodiments, the first to fourth thresholds can be set to values ​​different from the examples above, which are not limited herein.

[0036] In other embodiments, thresholds can be set to identify windows or desktop icons with low perceived user engagement. For example, a threshold of 95% can be set for the degree of occlusion of a window or desktop icon; if the occlusion degree is greater than 95%, the user engagement of that window or desktop icon is considered low. Similarly, a threshold of 0.05 (5% of the maximum value) can be set for the alpha value of a window; if the alpha value is less than 0.05, the user engagement of that window is considered low. A threshold of 5% can be set for the degree of change in window attributes before and after an animation; if the change is less than 5%, the user engagement of that window is considered low. A threshold of 5% can be set for the percentage of the screen display area occupied by the window; if the percentage is less than 5%, the user engagement of that window is considered low.

[0037] In one possible implementation of the first aspect above, the first element corresponds to a first icon displayed on the desktop, and the second element includes a second icon, wherein the first icon attribute corresponding to the first icon is different from the second icon attribute corresponding to the second icon.

[0038] In one possible implementation of the first aspect described above, the user perception of the first icon is related to the degree to which the first icon is obscured. The degree to which the first icon is obscured may include the extent to which the icon, such as an application icon, is obscured by one or more windows.

[0039] In one possible implementation of the first aspect above, the user perception of the first part of the display element satisfies a preset condition, including: detecting that the degree of occlusion of the first icon is higher than a fifth threshold, and determining that the user perception of the first icon satisfies the preset condition; or, detecting that the degree of occlusion of the first icon is lower than the fifth threshold, and determining that the user perception of the first icon satisfies the preset condition.

[0040] In one possible implementation of the first aspect above, the animation during the transition from the first interface to the second interface includes: the animation corresponding to the third element when the user perception meets the preset conditions at the first moment, wherein the third element belongs to the first part of the display elements; and the animation corresponding to the fourth element when the user perception does not meet the preset conditions at the second moment, wherein the fourth element belongs to the second part of the display elements, the first moment and the second moment are different, and the third element and the fourth element are the same or different display elements.

[0041] In other words, the user perception of each display element in the first interface can be determined by comprehensively analyzing the user perception of the corresponding display element from the start time to the end time of the animation effect. The aforementioned first time and second time can include the user perception of each display element determined at any time during the animation process (including the start time and the end time of the animation effect). For example, the first time includes the start time of the animation effect, and the second time includes the end time of the animation effect, etc. In this way, the computational resources consumed in processing a large number of display elements during the animation processing can be reduced in a timely manner, which is highly timely and also helps to improve the timeliness of reducing device power consumption and improving device performance.

[0042] In a second aspect, this application provides an electronic device, including: one or more processors; one or more memories; the one or more memories storing one or more programs, which, when executed by one or more processors, cause the electronic device to perform the interface processing methods provided in the first aspect and various possible implementations of the first aspect.

[0043] Thirdly, this application provides a computer-readable storage medium storing instructions that, when executed on a computer, cause the computer to perform the interface processing methods provided in the first aspect and various possible implementations of the first aspect.

[0044] Fourthly, this application provides a computer program product, including a computer program / instruction that, when executed by a processor, implements the interface processing method provided in the first aspect and various possible implementations of the first aspect.

[0045] The beneficial effects of the second to fourth aspects mentioned above can be referred to the relevant descriptions in the first aspect and various possible implementations of the first aspect, which will not be repeated here. Attached Figure Description

[0046] Figure 1a The image shown is a schematic diagram of the computer desktop before switching in a motion effect display scene provided in an embodiment of this application.

[0047] Figure 1b The diagram shown is a schematic diagram of an animation display scene provided in an embodiment of this application.

[0048] Figure 1c The image shown is a schematic diagram of a computer desktop after switching, which is part of an animated display scene provided in an embodiment of this application.

[0049] Figure 2a The diagram shows the number of windows displayed by an electronic device before performing animation effects in an embodiment where the interface processing method provided in this application is not applied.

[0050] Figure 2b The diagram shows the principle of an electronic device executing motion effect instructions corresponding to an image frame in an embodiment where the interface processing method provided in this application is not applied.

[0051] Figure 2c The diagram shows the number of windows displayed on the electronic device before the animation is executed after the interface display method provided in this embodiment of the application is applied.

[0052] Figure 2d The diagram shown is a schematic representation of the principle by which an electronic device executes motion effect instructions corresponding to an image frame after the interface display method provided in this embodiment of the application is applied.

[0053] Figure 3 The diagram shown is a schematic representation of the software structure of an operating system provided in an embodiment of this application.

[0054] Figure 4a The diagram shown is a data structure diagram of a UI node tree provided in an embodiment of this application.

[0055] Figure 4b The diagram shown is a schematic representation of the result of adding markers to some rendered nodes in a UI node tree according to an embodiment of this application.

[0056] Figure 4c The diagram shown is a schematic diagram of the result of adding markers to another part of the UI node tree based on the dependency relationship provided in the embodiment of this application.

[0057] Figure 4d The diagram shown is a data structure diagram of a UI node tree in actual execution according to an embodiment of this application.

[0058] Figure 5 The diagram shown is an interactive implementation flowchart of an interface processing method provided in an embodiment of this application.

[0059] Figure 6a The image shown is a schematic diagram of a first interface in the animation display scene of entering the task center provided in an embodiment of this application.

[0060] Figure 6b The image shown is a schematic diagram of an animation interface in the animation display scene of entering the task center provided in an embodiment of this application.

[0061] Figure 6c The image shown is a schematic diagram of a task center interface in an animated display scene of entering the task center provided in an embodiment of this application.

[0062] Figure 7a The diagram shown is a first interface schematic of a two-screen animation display scenario provided in an embodiment of this application.

[0063] Figure 7b The image shown is a schematic diagram of an animation interface in a two-screen animation display scenario provided in an embodiment of this application.

[0064] Figure 7c The image shown is a schematic diagram of a two-screen interface in a two-screen animation display scenario provided in an embodiment of this application.

[0065] Figure 8 The diagram shown is a schematic representation of the implementation process of another interface processing method provided in this application embodiment.

[0066] Figure 9 The figure shown is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application.

[0067] Figure 10 The diagram shown is a hardware structure schematic of another electronic device provided in an embodiment of this application. Detailed Implementation

[0068] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions in the embodiments of this application will be described in detail below with reference to the accompanying drawings and specific implementation methods.

[0069] The interface processing method provided in this application can be applied to any electronic device, including but not limited to mobile stations (MS) and mobile terminals (MT). For example, electronic devices can be laptops, tablets, desktop computers, laptops, mobile phones, smart TVs, wearable devices, virtual reality (VR) devices, augmented reality (AR) devices, terminals in industrial control, self-driving, remote medical surgery, smart grids, transportation safety, smart cities, smart homes, and so on. This application does not limit the specific form of the electronic device.

[0070] The following uses a laptop computer (hereinafter referred to as a computer) as an example of an electronic device that implements the interface processing method provided in this application to introduce the specific implementation process of the method.

[0071] It should also be stated that the steps in the methods and processes in this application are numbered for ease of reference, not to limit the order of steps. If there is an order between the steps, the textual description shall prevail.

[0072] As mentioned earlier, when electronic devices execute animations on multiple windows, the more windows there are, the greater the computational load required to execute the animations. This can lead to excessive consumption of the computing resources of electronic devices, resulting in increased power consumption and reduced performance.

[0073] Taking a user's one-click return to the desktop on a computer as an example, refer to... Figures 1a to 1c As shown, when computer 10 detects that the user has performed a one-click return to the desktop (such as pressing the "Home+D" key combination on the keyboard), it can perform corresponding window hiding animations on windows 1, 2, ..., m displayed on the computer desktop 101.

[0074] For example, each window can be... Figure 1aThe window sizes and positions displayed on the computer desktop 101 are gradually reduced and moved until all windows are completely hidden. For example, first change to... Figure 1b The dimensions and positions of each window displayed on the animated interface 102 shown continue to change. Figure 1c All windows displayed on the computer desktop 103 shown are completely hidden. Figures 1a to 1c During the animation process shown, multiple windows displayed on computer 10 require animation processing. When the number of windows 1 to m is large, performing animations on a large number of windows causes the electronic device to perform a large number of animation calculations. This includes graphic drawing and rendering of the content displayed in each window, as well as calculations of the size and position of each window at various moments in the animation process, the occlusion relationships between windows, and the transparency of each window. The various processing steps involved in performing the above-mentioned animation calculations can lead to excessive consumption of the electronic device's computing resources, resulting in increased power consumption and reduced performance.

[0075] To address the aforementioned issues, this application provides an interface processing method. Before performing animation processing on multiple display elements on the currently displayed interface (hereinafter referred to as the first interface), the method can select a subset of display elements with higher user perception for animation processing based on their user awareness levels, while excluding other display elements with lower user perception levels from the animation processing, for example, by skipping the execution of animation instructions for those elements. The user perception level of each display element can be determined through comprehensive analysis based on the user perception level of that element from the start to the end of the animation process, and can include the user perception level of each display element determined at any point during the animation process (including the start and end times of the animation). This effectively reduces the computational resource consumption involved in processing a large number of display elements during animation processing, providing strong timeliness and contributing to faster reduction of device power consumption and improved device performance.

[0076] Furthermore, for different types of display elements, such as application windows, docks, and desktop icons, the appropriate display element for executing animation effects can be selected based on different animation display scenarios and the display priority of various display elements. In some operating systems (OS), the dock may correspond to the taskbar and / or status bar. Desktop icons can be, for example, icons of software or applications displayed on the computer's desktop, and are not limited here.

[0077] For example, for electronic devices that support screen rotation (such as mobile phones and tablets), when the screen is detected rotating from landscape to portrait or vice versa, the dock can be given higher display priority, and corresponding rotation effects can be applied to the dock. For application windows and desktop icons, the rotation effects can be selected based on factors such as the degree of occlusion. Similarly, in the scenario of returning to the desktop with a single click, since the dock and desktop icons are part of the desktop's display elements, the electronic device can determine the degree of occlusion of each window based on the occlusion relationships between currently displayed application windows, and then select some windows to apply the rotation effects.

[0078] In other embodiments, the scenarios where the electronic device to which the interface processing method provided in this application applies performs animation effects on the displayed multi-window display may also include user instructions to enter the task center or display multiple desktops, instructions to display multiple application windows in split-screen mode, unlocking to enter the desktop, entering hibernation or sleep mode, instructions to switch from desktop 1 to desktop 2 or to return to the desktop with one click and then resume displaying multiple windows, etc. For some electronic devices that support switching between landscape and portrait display modes, such as foldable laptops or tablets, the user's screen rotation operation can also cause the electronic device to display animation effects that change the size and position of each window. This application does not impose any limitations on these scenarios. Some scenarios will be described below with reference to the accompanying drawings; other scenarios will not be described in detail here.

[0079] The degree of occlusion of the window in the above application can be determined based on window attributes. This degree of occlusion can include whether it is fully occluded, partially occluded, or not occluded, and is not limited here. For example, the degree of occlusion of the first window can be determined by calculating the percentage of the area of ​​the first window covered by the second window. In this embodiment, the aforementioned window attributes may include the coordinates corresponding to the window's display position, the window's size (e.g., aspect ratio or width, height, etc.), and an Alpha value indicating the window's background transparency, and are not limited here. The Alpha value can range from [0,1]. A lower Alpha value indicates higher background transparency and lower user perception, while a higher Alpha value indicates lower background transparency and higher user perception. In other embodiments, the Alpha value indicating the window's background transparency can also be any value in the range [0,255], and is not limited here.

[0080] In some embodiments, the degree of occlusion described above may also be related to the window's blur and shadow intensity, etc., and is not limited here. The window's blur refers to the sharpness of the edges of the window's background or content. The window's shadow intensity refers to the depth of the shadow at the edges of the window or control.

[0081] It is understandable that, for the aforementioned user perception, corresponding judgment conditions (hereinafter referred to as preset conditions) can be preset. Electronic devices can then select a subset of display elements to perform animation processing by detecting whether the user perception of each display element on the current display interface meets the preset conditions, while not performing animation processing on the remaining display elements that do not meet the preset conditions. Given the various factors affecting the user perception of display elements, the preset conditions may include, but are not limited to: a first threshold corresponding to the degree of occlusion of windows or desktop icons; a second threshold corresponding to the alpha value of a window; a third threshold corresponding to the degree of change in window attributes before and after the animation; a fourth threshold corresponding to the percentage of the screen display area occupied by the window, and so on.

[0082] As an example, in some embodiments, the first threshold can be set to 5%, for example. Correspondingly, if the degree of occlusion of a window or desktop icon is less than 5%, it can be determined that the user perception of the corresponding window or desktop icon is high. Similarly, the second threshold can be set to 5% of the maximum value, for example, 0.05. Correspondingly, if the alpha value of the window is higher than 0.05, it can be determined that the user perception of the corresponding window is high. The third threshold can be set to 5%, for example. Correspondingly, if the degree of change in window attributes before and after the animation is executed is higher than 5%, it can be determined that the user perception of the corresponding window is high. The fourth threshold can also be set to 5%, for example. Correspondingly, if the percentage of the window occupying the screen display area is higher than 5%, it can be determined that the user perception of the corresponding window is high. In other embodiments, the first to fourth thresholds can be set to other values ​​different from the examples above, which are not limited herein.

[0083] In other embodiments, thresholds can be set to identify windows or desktop icons with low perceived user engagement. For example, a threshold of 95% can be set for the degree of occlusion of a window or desktop icon; if the occlusion degree is greater than 95%, the user engagement of that window or desktop icon is considered low. Similarly, a threshold of 0.05 (5% of the maximum value) can be set for the alpha value of a window; if the alpha value is less than 0.05, the user engagement of that window is considered low. A threshold of 5% can be set for the degree of change in window attributes before and after an animation; if the change is less than 5%, the user engagement of that window is considered low. A threshold of 5% can be set for the percentage of the screen display area occupied by the window; if the percentage is less than 5%, the user engagement of that window is considered low.

[0084] The interface processing method provided in this application is applied to electronic devices such as computers to achieve the purpose of saving computing resources and reducing device power consumption. The process is illustrated below with reference to the accompanying drawings.

[0085] As an example, Figures 2a to 2d The diagram illustrates the animation processing process before and after applying the interface processing method provided in this application.

[0086] in, Figure 2a and Figure 2b This paper illustrates a motion effect processing procedure that does not apply the interface processing method provided in this application.

[0087] refer to Figure 2a Before the electronic device executes the animation effect, the windows displayed include, for example, window 1, window 2, ..., window n and window n+1, ..., window m, where m > n. Window 1 to window n are windows with high user perception (hereinafter referred to as perceptible windows), and window n+1 to window m are windows with low user perception (hereinafter referred to as imperceptible windows). Before applying the interface processing method provided in this application, when the electronic device receives an operation that triggers the display of window animation effects from the user, such as receiving the above-mentioned instruction to return to the desktop with one click, all m displayed windows need to participate in the animation effect. Correspondingly, the electronic device needs to generate animation effect instructions corresponding to m frames of windows for windows 1 to m, referring to... Figure 2b The A1 to Am symbols indicate the animation instructions corresponding to the image frames. These animation instructions can instruct the System UI in the operating system of an electronic device to call the graphics processing unit to perform the drawing, rendering, and display processes of the corresponding image frames.

[0088] Figure 2c and Figure 2d This paper illustrates a motion effect processing procedure using the interface processing method provided in this application.

[0089] refer to Figure 2cAfter applying the interface processing method provided in this application, when the electronic device receives a user-triggered window animation effect, such as receiving the aforementioned instruction to return to the desktop with one click, only n windows out of the displayed m windows can participate in the animation effect. These n windows are perceptible windows, and the other (mn) windows are controlled not to participate in the animation effect. Correspondingly, the electronic device can generate n frames of animation effect instructions corresponding to only windows 1 to n, as shown in the reference. Figure 2d The A1 to An symbols indicate the motion effect commands corresponding to the image frames. For imperceptible windows such as windows n+1 to m, the electronic device can control these windows to not participate in the motion effect during execution, as shown in the reference. Figure 2d An shown +1 ~Am indicates the (mn) image frames that do not participate in the motion effects.

[0090] Thus, for the (mn) image frames that do not participate in the animation, the computational resources required for electronic devices to process drawing, rendering, and display can be reduced. This helps to reduce the amount of computation required for electronic devices to execute the corresponding animation, thereby saving computational resources, reducing device power consumption, and improving device performance.

[0091] The specific implementation process of the interface processing method provided in this application will be described in detail below with reference to the accompanying drawings.

[0092] The following section, in conjunction with the accompanying drawings, describes the operating system composition of the computer and other electronic devices to which the interface processing method provided in this application is applicable.

[0093] Figure 3 A schematic diagram of the software structure of an operating system is shown according to an embodiment of this application.

[0094] like Figure 3 As shown, the operating system running on an electronic device, such as a computer 10, can adopt a layered architecture. This layered architecture may include an application layer 310, an application framework layer 320, a system service layer 330, and a kernel layer 340.

[0095] The application layer 310 may include a series of installed applications, including system applications and third-party applications. System applications include memos, photo galleries, etc., while third-party applications include document (Word) applications, presentation (PowerPoint, PPT) applications, spreadsheet (Excel) applications, etc. The computer 10 can respond to user instructions to run applications, run multiple applications simultaneously and display multiple application windows, or display multiple windows of the same application; there is no limitation on this.

[0096] The application layer 310 may also include a system user interface (UI) 311, which is used by the aforementioned system applications, third-party applications, etc., to call the user interface framework 322 to provide the graphics subsystem 331 with element attribute-related data (hereinafter referred to as attribute data) and motion effect instructions for each currently displayed element. In this embodiment, the attribute data includes, for example, the attribute data of the application window (i.e., the aforementioned window attributes), the attribute data of the desktop icons, and the attribute data corresponding to the priority of the dock. The motion effect instructions can be used to instruct the graphics subsystem 331 to execute the interface processing method provided in this application on each displayed element on the current interface of the computer 10, so as to achieve the purpose of performing motion effect processing on a selected portion of the displayed elements. That is to say, the graphics subsystem 331 can implement the interface processing method provided in this application based on the aforementioned attribute data and motion effect instructions, which will be described in detail below and will not be repeated here.

[0097] It can be understood that the aforementioned animation commands issued by the system user interface 311 can correspond to the commands of each node in the user interface node tree (UI node tree) corresponding to the currently displayed interface. The number of nodes at each level of the UI node tree can be determined by the number of screens on the computer 10, the number of application windows displayed on each screen, and the number of display elements such as desktop icons and the dock. The data structure of the UI node tree will be described exemplarily below with reference to relevant accompanying drawings.

[0098] The application framework layer 320 can provide the application layer 310 with an capability framework 321, a user interface (UI) framework 322, and a user program framework 323, etc. In some embodiments, these frameworks may also be referred to as distributed frameworks. The capability framework 321 provides various capabilities required for the application to implement corresponding functions, which are then called by the application applications of the application layer 310. In this embodiment, the system applications and third-party applications of the application layer 310 can call the interfaces provided by the capability framework 321 and the user interface framework 322 through the system user interface 311, and then call the relevant graphics processing capabilities of the graphics subsystem 331 to perform animation processing on the windows, desktop icons, and taskbar of the applications currently displayed on the computer 10.

[0099] The system service layer 330 can provide services to the applications in the application layer 310 through the application framework layer 320. The system service layer 330 can also provide distributed task scheduling, distributed data management, and distributed soft bus, etc., to support the purpose of performing distributed tasks using the capabilities of different devices, which will not be elaborated here.

[0100] The application framework layer 320 and the system service layer 330 may also include basic capability subsystems such as the graphics subsystem 331 and the multi-modal input subsystem 332. As mentioned above, the graphics subsystem 331 can provide graphics processing capabilities to perform animation processing on each currently displayed element.

[0101] Specifically, the graphics subsystem 331 mainly includes modules such as UI components, layout, animation, fonts, input events, window management, and rendering (not shown in the figure). The graphics service provides graphics rendering and display output functions, and internally, through the rational utilization of system hardware resources, it provides a smooth and efficient display experience for the system. In this embodiment, the graphics subsystem 331 may include a perceptual analysis module d11, a motion effect calculation module d12, a preprocessing module d13, and a rendering module d14, each of which can be deployed within the aforementioned graphics service.

[0102] The perception analysis module d11 can receive the aforementioned animation instructions and, in response to these instructions, analyze the user perception of each display element on the currently displayed interface of the computer 10. For example, the perception analysis module d11 can comprehensively determine the user perception of each display element based on its attribute data, such as window size, display position (e.g., corresponding coordinates), background transparency, blur, and shadow intensity; desktop icon size, display position, quantity, and transparency; and taskbar display priority. In some embodiments, the perception analysis module d11 can also identify the user scenario that triggers the display animation, such as a user instructing a one-click return to the desktop, entering the task center, or entering a split-screen mode; or a user rotating the screen. Based on the identified user scenario and the display priority and element attributes of each display element in the corresponding scenario's interface, the user perception of each display element can be determined.

[0103] In this embodiment, the perceptibility analysis module d11 can also be used to add corresponding markers, such as "false" or "fork=0", to the corresponding nodes in the UI node tree for display elements with low user perceptibility (corresponding to elements that do not meet preset conditions). This indicates that the display element corresponding to the node is an imperceptible element, i.e., an element that does not need or can skip the execution of animation processing, such as the aforementioned imperceptible window. In some embodiments, the perceptibility analysis module d11 can also be used to leave the corresponding nodes in the corresponding UI node tree blank, or add a "true" or "fork=1" marker to the corresponding nodes for display elements with high user perceptibility (corresponding to elements that meet preset conditions). This indicates that the display element corresponding to the node is a perceptible element, i.e., an element that needs to perform animation processing, such as the aforementioned perceptible window.

[0104] For ease of description, the flags added above, such as "false" or "fork=0", indicating that the user's perception does not meet the preset conditions, will be referred to as imperceptible flags below. The flags added above, such as "true" or "fork=1", indicating that the user's perception meets the preset conditions, will be referred to as perceptible flags below.

[0105] The motion effect calculation module d12 can receive the aforementioned motion effect instructions and, in response to the instructions indicating the motion effect duration, motion effect curve, and the start / end state of each display element participating in the motion effect, calculate the motion effect trajectory. The motion effect duration, as the name suggests, refers to the duration of the motion effect corresponding to the relevant display element. The motion effect curve indicates the path the display element moves along during the motion effect display process. The start / end state corresponds to the user's perception of the relevant display element from the start to the end of the motion effect. Based on this, the motion effect calculation module d12 can further predict the position attributes of each display element on the interface at the current refresh time, such as the coordinate information of the display position of the relevant display element on the screen of the electronic device at that refresh time, based on the calculated motion effect trajectory. The refresh time can be related to the interface refresh time corresponding to the display frame rate of the corresponding interface, or it can be related to the screen display content refresh time corresponding to the screen refresh rate of the electronic device; no limitation is imposed here.

[0106] In this embodiment of the application, the aforementioned motion effect start / end state, such as the user perception of the corresponding display element from the start time to the end time of the motion effect, may include any of the following situations:

[0107] The user perception of the corresponding display elements is higher at the beginning of the animation and lower at the end of the animation.

[0108] The user perception of the corresponding display elements is low at the beginning of the animation and high at the end of the animation.

[0109] The corresponding display elements have a high user perception at the beginning of the animation and a high user perception at the end of the animation;

[0110] The user perception of the corresponding display elements is low at the beginning of the animation and remains low at the end of the animation.

[0111] As mentioned earlier, the user perception of a displayed element can be related to its attribute data, such as window size, display position (e.g., corresponding coordinates), background transparency, blur, and shadow intensity; desktop icon size, display position, and transparency; or taskbar display priority. Correspondingly, the change in the user perception of each displayed element from the start to the end of the animation effect can also be caused by changes in one or more of the aforementioned attribute data that affect user perception, and this is not limited here.

[0112] The preprocessing module d13 can obtain the UI node tree with imperceptible or perceptible markers added by the perceptibility analysis module d11, and obtain the position attributes of each display element predicted by the motion effect calculation module d12 at the current refresh time. Based on the obtained data, it determines the nodes that do not participate in motion effect processing and / or the nodes that do participate in motion effect processing from the UI node tree, and performs preprocessing on the display elements corresponding to each node. This preprocessing may include scene management, resource (e.g., textures, vertex data, shader programs, and other graphics resources) loading, calculation of opacity, blur, shadow intensity, etc., and state settings. Scene management may include, for example, skipping or deleting motion effect instructions for display elements corresponding to nodes that do not participate in motion effect processing, or executing motion effect instructions for display elements corresponding to nodes that do participate in motion effect processing, such as performing the aforementioned resource loading preprocessing first.

[0113] Thus, display elements whose corresponding animation instructions are skipped or deleted will not undergo the animation drawing and rendering process, and therefore will not display the animation of these display elements on the interface that is refreshed at the current refresh time. This process can reduce the processing of these display elements, which is conducive to improving the timeliness of saving the computing resources of electronic devices, thereby helping to reduce device power consumption and improve device performance.

[0114] The rendering module d14 can be used to obtain the preprocessing results of the preprocessing module d13 mentioned above, and control the drawing and rendering of corresponding graphics for display elements that have completed resource loading and other preprocessing. It can be understood that the drawing process of the corresponding graphics for each display element executed by the rendering module d14 can be controlled by the system's rendering service (renderservice, RS, not shown in the figure); the rendering process of the completed graphics executed by the rendering module d14 can also be controlled by the rendering service mentioned above, and will not be elaborated here.

[0115] In this embodiment of the application, the multimodal input subsystem 332 can support processing multimodal data input by the user, such as text, images, voice, video, etc., into input data that can be recognized by other software structures of the system, and then provide it to the graphics subsystem 331 or other subsystems or frameworks, system services, etc. for further processing.

[0116] Kernel layer 340 is the layer between hardware and software. Figure 3 The kernel layer 340 of the operating system shown may include a kernel subsystem and a driver subsystem. The kernel subsystem, given that distributed operating systems can employ a multi-kernel design, supports the selection of a suitable OS kernel for different resource-constrained devices, and is not limited to Linux. TM kernel, HarmonyOS TM Kernel, LiteOS, etc. Therefore, the kernel subsystem supports selecting the appropriate operating system (OS) kernel for different resource-constrained devices.

[0117] The kernel abstract layer (KAL) on the kernel subsystem provides basic kernel capabilities to the upper layers by shielding the differences between multiple kernels, including process / thread management, memory management, file system, network management, and peripheral management.

[0118] The driver subsystem provides a driver framework that forms the foundation for the open hardware ecosystem of some distributed systems, offering unified peripheral access capabilities and a framework for driver development and management. The kernel layer includes at least display drivers, camera drivers, audio drivers, and sensor drivers.

[0119] To facilitate understanding of the interface processing method provided in this application, the following description, in conjunction with the accompanying drawings, illustrates the control process by which the perception analysis module d11 adds markers to some nodes in the UI node tree, and the preprocessing module d13 performs preprocessing based on the marked UI node tree.

[0120] Figure 4a A schematic diagram of the data structure of a UI node tree is shown according to an embodiment of this application.

[0121] like Figure 4a As shown, the root node of the UI node tree can control the rendering nodes corresponding to screen 1 and screen 2. Screen 1 can be, for example, the computer's own display screen, and screen 2 can be an external extended screen connected to the computer 10; there are no restrictions here. The rendering node corresponding to screen 1 can control the rendering nodes corresponding to n windows, mn windows (m > n), desktop 1, and dock 1, etc. The rendering node corresponding to screen 2 can control the rendering nodes corresponding to desktop 2 and dock 2. The aforementioned n windows can be referenced in the above example. Figure 2cThe example of a perceptible window, for example, mn windows, can be referenced above. Figure 2c The example shows an imperceptible window. Correspondingly, the rendering nodes corresponding to the above n windows can control the rendering nodes corresponding to windows 1 to n, and the rendering nodes corresponding to the above mn windows can control the rendering nodes corresponding to windows n+1 to m.

[0122] In some embodiments, Figure 4a In the UI node tree shown, a node at the next level can be described as a child node of a node at the previous level, and a node at the previous level can be described as a parent node of a node at the next level; this is not a limitation. The dependency relationship between a parent node and a child node can be that the child node depends on the parent node. In this embodiment, the drawing, rendering, and other graphics processing of the display element corresponding to the child node can be triggered by the completion of the drawing, rendering, and other graphics processing of the display element corresponding to the parent node.

[0123] As mentioned earlier, the data structure of the UI node tree can be related to the number of screens available on electronic devices such as computers, the number of windows displayed on each screen, and the desktop icons and dock displayed on each screen, etc., and is not limited here. In other embodiments, the data structure of the UI node tree may also be different. Figure 4a Other tree structures or topologies exemplified are not limited here.

[0124] Figure 4b An embodiment of this application illustrates a schematic diagram of the result of adding markers to some rendered nodes in a UI node tree.

[0125] like Figure 4b As shown, for example, when computer 10 is currently only using screen 1 to display the interface, based on the interface processing method provided in this application, the rendering node corresponding to screen 2 can be marked with the aforementioned imperceptible marker. Furthermore, in the m windows opened by computer 10 in response to user operations, if mn windows are minimized, or some of the mn windows are minimized while others are completely obscured by n windows, or mn windows are completely obscured by n windows, then based on the interface processing method provided in this application, the rendering nodes corresponding to the mn windows can be marked with an imperceptible marker. Thus, Figure 4b Other nodes in the example UI node tree, such as the rendering node corresponding to screen 1 and the n windows it controls, the rendering nodes corresponding to desktop 1 and dock bar 1, etc., may not have any markers added or may have the aforementioned perceptible markers added.

[0126] Continue to refer to Figure 4c , Figure 4cAn embodiment of this application illustrates the result of adding markers to the rendering of another part of the UI node tree based on dependencies.

[0127] Given the dependency relationship between the rendering nodes corresponding to windows n+1 to m and the rendering nodes corresponding to the aforementioned mn windows, or in other words, the control relationship between the rendering nodes corresponding to the aforementioned mn windows and the rendering nodes corresponding to windows n+1 to m, when the rendering nodes corresponding to the mn windows are marked with an imperceptible flag indicating that they do not participate in animation processing, the process of performing animation processing dependent on this UI node tree will no longer process the animations corresponding to windows n+1 to m. Therefore, as Figure 4c As shown, the rendering nodes corresponding to windows n+1 to m have also been marked with the aforementioned imperceptible markers. Similarly, the rendering nodes corresponding to desktop 2 and dock 2, controlled by the rendering node corresponding to screen 2, have also been marked with the aforementioned imperceptible markers. Based on this, the data structure of the UI node tree actually used to control the execution of animation processing can be found in [reference needed]. Figure 4d As shown.

[0128] Figure 4d According to an embodiment of this application, a schematic diagram of the data structure of an actual UI node tree is shown.

[0129] like Figure 4d As shown, when computer 10 detects a user's relevant operation (such as rotating screen 1) and performs animation processing, it can first use the root node to control the drawing, rendering and other graphics processing of some basic layers and other display elements displayed on screen 1, and then use the rendering node corresponding to screen 1 to control the drawing, rendering and other graphics processing of n windows, desktop 1 and dock bar 1 and other display elements. The rendering node corresponding to the n windows can control the drawing, rendering and other graphics processing of display elements of each window type, from window 1 to window n.

[0130] Thus, during the execution of motion effect processing, computer 10 can reduce the impact on the aforementioned aspects by using the interface processing method provided in this application. Figure 4c The animation processing of screen 2 and the desktop 2, dock bar 2 and mn windows that are dependent on screen 2, as well as windows n+1 to m that are dependent on screen 2 (such as the above graphics processing process) is beneficial to save computing resources, reduce device power consumption and improve device performance.

[0131] Based on the above Figure 3 The software structure shown is as follows: Figure 5 An interactive implementation flowchart of an interface processing method is shown according to an embodiment of this application.

[0132] Understandable. Figure 5 The interactive implementation process shown may involve the above. Figure 3 The system user interface 311 shown interacts with the perceptual analysis module d11, motion calculation module d12, preprocessing module d13, and rendering module d14 in the graphics subsystem 331. In other embodiments, Figure 5 The interactive implementation process shown can also involve interactions between other software structures with corresponding functions, and there are no restrictions here.

[0133] Specifically, such as Figure 5 As shown, the process may include:

[0134] S501: System User Interface 311 controls the first interface of the display.

[0135] For example, the system user interface 311 can respond to calls from system applications or third-party applications in the application layer 310 to display an interface containing multiple windows, desktop icons, and a dock bar, denoted as the first interface. The first interface may include multiple display elements, some of which may be multiple stacked windows.

[0136] In some embodiments, the first interface may include the desktop, or it may include the interface after a certain window is displayed in full screen. For example, the computer 10 may respond to user instructions to run installed software or applications, and open multiple windows, as described above. Figure 1a As shown, these windows can cover the desktop, partially or completely obscuring it. In other embodiments, among the multiple windows opened, some windows can be displayed in full screen, while others are displayed on top of the full-screen windows; or some windows may be displayed in a split-screen manner, while others may be displayed as floating windows, etc., without limitation.

[0137] S502: The system user interface 311 detected the first operation command.

[0138] For example, the aforementioned first operation instruction may be an instruction generated corresponding to a user's instruction to return to the desktop with one click, an instruction generated corresponding to a user's instruction to enter the task center, or an instruction generated corresponding to a user's instruction to perform a two-screen or three-screen operation, etc. In other embodiments, the aforementioned first operation instruction may also be an instruction generated corresponding to a user's instruction to rotate the screen on some electronic devices that support screen rotation, etc., and there is no limitation here.

[0139] S503: The system user interface 311 generates animation instructions for the display elements corresponding to the first interface.

[0140] For example, the above-mentioned motion effect instructions may be, for example, the above-mentioned... Figure 2b The example demonstrates an animation instruction that operates on all image frames A1 to Am corresponding to all windows. This animation instruction can carry control information such as animation duration, animation curve, and the start / end state of the animation for each participating display element. This control information can be used to calculate the animation trajectory of each display element on the first interface, and further used to predict the display position of each display element at each refresh time.

[0141] It is understood that the above-mentioned motion effect instructions may be the control instructions generated by the system user interface 311 in response to the above-mentioned first operation instructions, such as the desktop application of the computer 10 and other electronic devices. This will not be elaborated here.

[0142] It is understandable that before generating the aforementioned animation instructions, the system user interface 311 can first identify the corresponding animation display scene based on the detected first operation instruction. This animation display scene is categorized according to whether desktop icons and the dock participate in the animation, and can include animation display scenes with and without screen rotation. In the screen rotation animation display scene, the types of display elements participating in the animation processing on the first interface can include windows and desktop icons, the dock, etc. At this time, the animation instructions generated by the system user interface 311 can carry control information for executing animation processing on different types of display elements. Furthermore, given the high display priority and high user awareness of the dock, animation processing can be prioritized for the dock in this scene.

[0143] In non-rotating screen animation display scenarios, such as the animation display scenario corresponding to the one-click return to desktop, the animation display scenario corresponding to entering a task, and the animation display scenario corresponding to split-screen, the type of display elements participating in the animation processing on the first interface can only include windows. In this case, desktop icons and the dock bar can not participate in the animation processing. At this time, the animation command generated by the system user interface 311 can carry the control information for performing animation processing for each window. It can be understood that in this scenario, the animation of desktop icons and the dock bar can be omitted during the process of the first interface changing to the interface switched by the first operation command (hereinafter referred to as the second interface).

[0144] S504a: The system user interface 311 sends motion effect commands to the perception analysis module d11 of the graphics subsystem 331.

[0145] For example, refer to the above Figure 3The system's software structure allows the system user interface 311 to send the generated motion effect commands to the graphics subsystem 331 via the service call interface provided by the user program framework 323, etc. In this embodiment, the motion effect commands can be simultaneously sent to the perception analysis module d11 and the motion effect calculation module d12 within the graphics subsystem 331 for response. The motion effect commands sent to the perception analysis module d11 can trigger the perception analysis module d11 to execute the following steps S505a to S507a.

[0146] In other embodiments, the perception analysis module d11 and the motion effect calculation module d12 in the graphics subsystem 331 can also be implemented by a single functional module or service, such as a motion effect processing module. Correspondingly, the motion effect commands sent by the system user interface 311 to the graphics subsystem 331 can also be sent only to that functional module or service for response, without any limitation.

[0147] It is understandable that the system user interface 311 can send motion effect commands to the graphics subsystem 331 in the following ways: either by sending motion effect commands corresponding to each display element sequentially in the form of a data stream or a task queue; or by processing the motion effect commands corresponding to some or all display elements into one or more data packets and then sending the data packets containing the motion effect commands. No limitation is made here. For the latter, after receiving the data packet containing the motion effect commands, the graphics subsystem 331 can parse and obtain the motion effect commands, and add them to the task queues of the perception analysis module d11 and the motion effect calculation module d12 for sequential execution.

[0148] S505a: The perception analysis module d11 of the graphics subsystem 331 analyzes the user perception of each display element based on the attribute data of each display element.

[0149] For example, the perception analysis module d11 of the graphics subsystem 331 can determine the user perception of each display element on the currently displayed first interface based on the attribute data of each display element, such as the window attribute corresponding to the window, the icon attribute corresponding to the desktop icon, and the priority of each display element (such as the priority of the dock bar).

[0150] For example, for a window, the perception analysis module d11 can preset thresholds corresponding to factors affecting the user's perception of the window, such as size, display position, and background transparency. These thresholds include a first threshold for the degree of window occlusion, a second threshold for background transparency, a third threshold for the magnitude of changes in window attributes during animation, and a fourth threshold for size. Whether the user's perception meets the preset conditions can be determined based on these thresholds.

[0151] The degree of window obstruction can be calculated based on factors such as the size, display position, and transparency of each window. For example, the degree to which the first window is obstructed by the second window can be calculated. This degree of obstruction can be a ratio, such as the proportion of the area of ​​the first window obscured by the second window to the total display area of ​​the first window. If the degree of obstruction of the first window is higher than the aforementioned first threshold (e.g., 95%), it can be determined that the user perception of the first window is low and does not meet the preset conditions.

[0152] Background transparency can be determined based on the alpha value of the background of the corresponding window. The lower the alpha value, the higher the background transparency of the window and the lower the user perception; the higher the alpha value, the lower the background transparency of the window and the higher the user perception. If the first alpha value of the first window is lower than the second threshold mentioned above (e.g., 5% of the maximum value or 0.05), it can be determined that the user perception of the first window is low and does not meet the preset conditions.

[0153] The magnitude of changes in window attributes during the animation process, such as the magnitude of changes in the attributes of the first window, can be determined by comparing the size and display position of the first window on the currently displayed first interface with the size and display position of the first window at the expected next refresh time. If the magnitude of changes in the window attributes of the first window during the animation process is lower than the aforementioned third threshold (e.g., 5%), it can be determined that the user perception of the first window is low and does not meet the preset conditions.

[0154] Furthermore, the size of the aforementioned window can be the width and height of the corresponding window, or the proportion of the display area occupied by the corresponding window on the screen of the electronic device such as the computer 10. In other embodiments, it can also be described as the degree of overlap between the window and the screen display area, which is not limited here. If the size of the display area occupied by the first window on the screen of the electronic device is lower than the aforementioned fourth threshold (e.g., 5%), it can be determined that the user perception of the first window is low and does not meet the preset conditions.

[0155] If the degree of occlusion of the first window is lower than the first threshold (e.g., 95%), the first alpha value of the first window is higher than the second threshold (e.g., 5% or 0.05 of the maximum value), the change in the window attributes of the first window during the animation process is higher than the third threshold (e.g., 5%), and the size of the display area occupied by the first window on the screen of the electronic device is lower than the fourth threshold (e.g., 5%), then the user perception of the first window can be considered to meet the preset conditions.

[0156] In other embodiments, the first threshold, second threshold, third threshold, fourth threshold, etc., mentioned above can also be set to other values, which are not limited here.

[0157] S506a: The perception analysis module d11 of the graphics subsystem 331 adds an imperceptible mark to the rendering node corresponding to the display element whose user perception does not meet the preset conditions.

[0158] For example, display elements whose user perception does not meet the preset conditions, i.e., display elements with low user perception, or low-perception elements, etc.

[0159] In some embodiments, the perceptuality analysis module d11 can also add perceptible markers to the rendering nodes corresponding to display elements whose user perceptuality meets preset conditions. Display elements whose user perceptuality meets preset conditions are, in other words, display elements with high user perceptuality, or low perceptuality elements, etc.

[0160] S507a: The perceptual analysis module d11 of the graphics subsystem 331 synchronizes the labeling results to the preprocessing module d13.

[0161] For example, the perception analysis module d11 of the graphics subsystem 331 can synchronously send the result of adding an imperceptible mark to the rendering node corresponding to the display element whose user perception does not meet the preset conditions, i.e., the marking result, to the preprocessing module d13. In this way, the preprocessing module d13 can skip executing or delete the animation instructions of the display element corresponding to the rendering node based on the imperceptible mark on the rendering node.

[0162] In some embodiments, if the perceptuality analysis module d11 adds a perceptible marker to the rendering node corresponding to a display element whose user perception meets preset conditions, the perceptuality analysis module d11 can also synchronize the marker result to the preprocessing module d13. Thus, the preprocessing module d13 can also execute the animation instructions for the display element corresponding to the rendering node based on the perceptible marker on the rendering node, such as performing graphic drawing, rendering, and other graphic processing procedures on the display element. No limitations are imposed here, nor will further details be provided.

[0163] S504b: The system user interface 311 sends motion effect instructions to the motion effect calculation module d12 of the graphics subsystem 331.

[0164] For example, refer to the above Figure 3 The system's software structure allows the system user interface 311 to send generated animation instructions to the animation calculation module d12 of the graphics subsystem 331 via the service call interface provided by the user program framework 323, etc. The specific sending process can be found in the relevant description in S504a above, and will not be elaborated upon here.

[0165] It is understandable that the motion effect instructions sent to the motion effect calculation module d12 can trigger the motion effect calculation module d12 to execute the following S505b to S507b.

[0166] S505b: The motion calculation module d12 of the graphics subsystem 331 responds to motion commands to calculate motion trajectory and predict the position attributes of each displayed element at each refresh time during the motion process.

[0167] For example, after receiving the motion effect command sent by the system user interface 311, the motion effect calculation module d12 of the graphics subsystem 331 can obtain the motion effect duration, motion effect curve, and motion start / end state of each display element participating in the motion effect carried in the motion effect command, and calculate the motion effect trajectory of the relevant display elements on the first interface in response to the motion effect command. The motion effect trajectory can be used to predict the display position of each display element at each refresh moment in the motion effect process, such as the coordinate information of each display element, i.e., the aforementioned position attributes.

[0168] S506b: The motion effect calculation module d12 of the graphics subsystem 331 synchronizes the motion effect trajectory and position attributes with the perception analysis module d11.

[0169] S507b: The motion effect calculation module d12 of the graphics subsystem 331 synchronizes the motion effect trajectory and position attributes with the preprocessing module d13.

[0170] For example, the motion effect calculation module d12 of the graphics subsystem 331 can synchronize the motion effect trajectory calculated by the motion effect calculation module d12 or the predicted position attributes of each display element at each refresh time to the perception analysis module d11, so that the perception analysis module d11 can use it when calculating the user perception of each display element. At the same time, the motion effect calculation module d12 can also transmit the above-mentioned motion effect trajectory or position attributes.

[0171] In some embodiments, the execution processes of S504a to S507a can be performed synchronously with the execution processes of S504b to S507b. In this case, the motion effect calculation module d12 synchronizes the motion effect trajectory and position attributes to the perception analysis module d11, which can be used to influence the user perception of each display element analyzed by the perception analysis module d11 at the next refresh time. In other embodiments, the execution processes of S504a to S507a can also be performed later than the execution processes of S504b to S507b. In this case, the motion effect calculation module d12 synchronizes the motion effect trajectory and position attributes to the perception analysis module d11, which can be used to influence the user perception of each display element analyzed by the perception analysis module d11 at the current refresh time. No limitations are imposed here.

[0172] S508: The preprocessing module d13 of the graphics subsystem 331 removes display elements that do not participate in the execution of motion effects based on the acquired marking results and position attributes.

[0173] For example, the preprocessing module d13 of the graphics subsystem 331 can comprehensively determine whether to execute the animation instructions for each display element to trigger the preprocessing process for the corresponding display element based on the marking results synchronized by the perception analysis module d11 and the animation trajectory and predicted position attributes synchronized by the animation calculation module d12. This includes determining whether to execute the animation instructions for the first part of the display elements and whether to skip the execution of the animation instructions for the second part of the display elements. The first part of the display elements can be display elements on the first interface whose user perception meets preset conditions, and the second part of the display elements can be display elements on the first interface whose user perception does not meet preset conditions. Therefore, the method of eliminating display elements that do not participate in the animation processing can include, but is not limited to, skipping the execution of the animation instructions for the second part of the display elements or deleting the received animation instructions for the second part of the display elements.

[0174] It is understandable that after removing the display elements that do not participate in the animation processing, the corresponding animation instructions executed by computer 10 can be, for example, the above-mentioned... Figure 2d The animation instructions that apply to image frames A1 to An corresponding to windows 1 to n, but do not participate in the animation, can be skipped or deleted based on the interface processing method provided in this application.

[0175] S509: The preprocessing module d13 of the graphics subsystem 331 preprocesses the display elements involved in the motion effect processing.

[0176] For example, the aforementioned preprocessing may include scene management, resource (e.g., graphics resources such as textures, vertex data, shader programs, etc.) loading, calculation of opacity, blur, shadow intensity, etc., and state settings. Scene management may include, for example, skipping or deleting animation instructions for display elements corresponding to nodes that do not participate in animation processing, or executing animation instructions for display elements corresponding to nodes that do participate in animation processing, for example, by first performing the aforementioned resource loading preprocessing.

[0177] In this way, display elements whose corresponding animation instructions are skipped or deleted will not undergo the animation drawing and rendering process, and thus will not display the animation of these display elements on the interface that is refreshed at the current refresh time. This process can reduce the processing of these display elements, save the computing resources of electronic devices, and thus help reduce device power consumption and improve device performance.

[0178] S510: The preprocessing module d13 of the graphics subsystem 331 sends the preprocessed data to the rendering module d14.

[0179] S511: The rendering module d14 of the graphics subsystem 331 performs graphics processing such as drawing and rendering on the corresponding display elements based on the preprocessed relevant data.

[0180] For example, it can be used to obtain the preprocessing result of the preprocessing module d13 mentioned above, and control the drawing, rendering and other graphics processing processes of the display elements (such as the second part of the display elements mentioned above) that have completed preprocessing such as resource loading.

[0181] It is understandable that display elements whose corresponding animation instructions are skipped or deleted during the preprocessing process, such as the first part of the display elements mentioned above, will not receive the preprocessed data corresponding to these display elements by the rendering module d14. Therefore, no drawing, rendering, or other graphics processing will be performed on these display elements. This also helps to save the computing resources of electronic devices, thereby reducing device power consumption and improving device performance.

[0182] S512: The rendering module d14 of the graphics subsystem 331 sends the graphics processing results to the system user interface 311.

[0183] For example, the rendering module d14 of the graphics subsystem 331 can send the graphics processing results of the second part of the display elements to the system user interface 311, and then control the display of the dynamic effect screen at the corresponding refresh time through the system user interface 311.

[0184] S513: The system user interface 311 controls the animation effects during the process of switching from the first interface to the second interface based on the graphics processing results.

[0185] It is understandable that at different refresh times during the animation process, the computer 10 can display different continuously changing animation frames during the transition from the first interface to the second interface. The first interface can be the interface displayed by the computer 10 or other electronic devices at the start of the animation or before that moment. During the interface change process from the first interface to the second interface, the computer 10 or other electronic devices can display multiple continuously changing animation frames.

[0186] Based on the above Figure 5 The interactive implementation flow shown in this application illustrates that the interface processing method provided can, in a motion effect display scenario, control the execution of motion effect processing (including the aforementioned preprocessing and graphics processing processes) on the first part of the display elements with higher user perception, while not executing motion effect processing on the second part of the display elements with lower user perception. Based on this, electronic devices such as computers, using the interface processing method provided in this application, can display the motion effects of the first part of the display elements but not the motion effects of the second part. This helps save the computing resources of electronic devices, thereby reducing device power consumption and improving device performance.

[0187] The following section provides an example of the interface change process when switching from the first interface to the second interface, using some animated display scenarios as examples.

[0188] Figures 6a to 6c The diagram illustrates the interface changes during the animated display scene when entering the task center.

[0189] in, Figure 6a This diagram illustrates a first interface in a motion-effect display scene when entering the task center.

[0190] like Figure 6a As shown, the first interface displayed by computer 10 is, for example, computer desktop 610, which displays window 1, window 2, ..., window m, etc. When computer 10 detects a user's instruction to enter the task center, it can display an animated screen, which may be, for example, the screen described below. Figure 6b The animated interface 620 is shown. In some embodiments, the user's instruction to enter the task center may be, for example, the user pressing the "Home+Tab" key combination on the keyboard of the computer 10, or the user clicking the multitasking control in the dock with the mouse, etc., and there are no restrictions here.

[0191] Figure 6b This diagram illustrates a motion effect interface in a scene where characters enter the task center.

[0192] like Figure 6b As shown, the animation interface 620 can be the interface at any refresh moment during the display of animation effects on the computer 10. The animation interface 620 can display window 1, window 2, ..., window n, which are the windows mentioned above. Figure 2c The perceptible window shown. Compared to the above. Figure 6a The computer desktop 610 shown does not display windows n+1, ..., m, which have low user perception, in the animated interface 620. Figure 2c The window shown is imperceptible. Furthermore, at the next refresh time, the display positions of windows 1, 2, ..., n displayed on the animated interface 620 can move towards the edge of the computer 10 screen, and the size of each window can gradually decrease. If the computer desktop 610 displayed by the computer 10 is one of multiple desktops, the animated desktop 620 displayed by the computer 10 can also display a multi-desktop area 621 including multiple desktops. This multi-desktop area 621 can display desktop options such as "Desktop 1," "Desktop 2," and "New Desktop." During the animation process, this multi-desktop area 621 can gradually move upwards and expand its size. This change can also be described as floating or appearing in some embodiments, which is not limited here.

[0193] Figure 6c This diagram illustrates a task center interface in a scene with animated effects when entering the task center.

[0194] At the moment when the animation ends on computer 10, computer 10 can display... Figure 6c The task center interface shown is 630. (As shown in the image...) Figure 6c As shown, the Task Center interface 630 can display rearranged windows 1, 2, ..., n. These windows can be displayed at the same size and are evenly spaced. If the computer desktop 610 displayed by computer 10 is one of multiple desktops, the Task Center interface 630 can also display the complete multi-desktop area 631. Corresponding to windows 1, 2, ..., n being windows opened on desktop 1, the desktop option indicating "Desktop 1" in the multi-desktop area 631 can be displayed in a more prominent manner.

[0195] It is understandable that the above Figure 6a The computer desktop shown is 610 relative to Figure 6b The animated interface 620 shown can be the first interface, as mentioned above. Figure 6c The task center interface 630 shown can be a second interface. That is to say, in this embodiment of the application, the first interface can generally refer to the interface before the switch, and the second interface can generally refer to the interface after the switch.

[0196] Refer to the above Figures 6a to 6c As shown in the interface changes, when computer 10 responds to the user's instruction to enter the task center and displays the corresponding animation effects, it can control the display of animation effects on a portion of windows with higher user perception (e.g., windows 1 to n), while not displaying animation effects on another portion of windows with lower user perception (e.g., windows n+1 to m), that is, not performing animation effect processing.

[0197] Figures 7a to 7c The diagram illustrates the interface changes in a two-screen animated display scene.

[0198] in, Figure 7a This diagram illustrates a first interface in a two-screen animation display scenario.

[0199] like Figure 7a As shown, the first interface displayed by computer 10 is, for example, computer desktop 710, which displays window 1, window 2, ..., window m, etc. When computer 10 detects a user's instruction to split the screen, it can display animated effects, such as those described below. Figure 7bThe animated interface 720 is shown. The aforementioned user-instructed split-screen operation command could, for example, be the command generated when the user operates the mouse on the computer desktop 710 and clicks "Show window on the left side of the screen" in the split-screen option box 711 corresponding to "Window 1". This command instructs the computer 10 to display Window 1 in the left-hand display area of ​​the computer 10 screen. In other embodiments, the aforementioned user-instructed split-screen operation command could also be the command generated when the user clicks "Show window on the right side of the screen". This command instructs the computer 10 to display Window 1 in the right-hand display area of ​​the computer 10 screen; this is not limited to any particular embodiment.

[0200] Figure 7b This diagram illustrates a dynamic interface in a two-screen dynamic display scenario.

[0201] like Figure 7b As shown, the animation interface 720 can be the interface at any refresh moment during the display of animation effects on the computer 10. The animation interface 720 can display windows 1, ..., n, which are the windows mentioned above. Figure 2c The perceptible window shown. Compared to the above. Figure 7a The computer desktop 710 shown does not display windows n+1, ..., m, which have low user perception, i.e., the aforementioned... Figure 2c The window shown is imperceptible. If window 1 is the topmost window displayed on the computer desktop 710, then at the next refresh time, window 1 displayed by the animation interface 720 can move to one side (e.g., the left side) of the computer screen 10, and the display positions of the other windows, including windows 2 to n, can move to the other side (e.g., the right side) of the computer screen 10. Furthermore, the size of windows 2 to n can gradually decrease, while the size of window 1 can gradually increase.

[0202] Figure 7c This diagram illustrates a split-screen interface in a dynamic display scenario.

[0203] At the moment when the animation ends on computer 10, computer 10 can display... Figure 7c The dual-screen interface shown is 730. (As shown in the image...) Figure 7c As shown, the split-screen interface 730 can display windows 1, 2, ..., n after the layout has been rearranged. Window 1 can occupy a portion (e.g., 50%) of the screen of computer 10, while windows 2 to n can evenly occupy the other portion (e.g., 50%) of the screen, forming a split-screen window layout.

[0204] It is understandable that the above Figure 7a The computer desktop shown is 710 relative to Figure 7b The animated interface 720 shown can be the first interface, as mentioned above. Figure 7c The split-screen interface 730 shown can be the second interface. That is to say, in this embodiment of the application, the first interface can generally refer to the interface before switching, and the second interface can generally refer to the interface after switching.

[0205] Refer to the above Figures 7a to 7c As shown in the interface changes, when computer 10 responds to the user's instruction to split the screen and displays the corresponding animation effects, it can control the display of animation effects on a portion of windows with higher user perception (e.g., windows 1 to n), while not displaying animation effects on another portion of windows with lower user perception (e.g., windows n+1 to m), that is, not performing animation effect processing.

[0206] Figure 8 An embodiment of this application illustrates a schematic diagram of the implementation flow of another interface processing method. In this implementation flow, the executing entity for each step can be a computer 10, and no limitation is imposed.

[0207] like Figure 8 As shown, the implementation process may include:

[0208] S801: Display a first interface, which includes multiple display elements.

[0209] For example, the first interface may include the desktop, or it may include the interface after a certain window is displayed in full screen. For details, please refer to the relevant description in S501 above, which will not be repeated here.

[0210] S802: A first operation instruction is detected, which is used to instruct the first interface to be switched to the second interface.

[0211] For example, the target display element may include one or more windows displayed on the first interface. In some embodiments, the target display element may also include desktop icons and a dock bar displayed on the first interface. For a detailed description of the first operation instruction, please refer to the relevant description in S502 above, which will not be repeated here.

[0212] It is understandable that the process of executing motion effect instructions by electronic devices such as computers can be carried out in the form of a task queue.

[0213] S803: Analyze the user perception of the (next) target display element among multiple display elements.

[0214] For example, computer 10 can analyze the user perception of each of the multiple display elements in the currently displayed first interface, that is, calculate the user perception of the target display element. The target display element can be any one of the multiple display elements. The specific analysis process can be referred to the relevant description in S505a above, and will not be repeated here.

[0215] It is understandable that if the judgment result of computer 10 in the following S807 judgment process is negative, it can proceed to S803 to continue analyzing the user perception of the next target display element among multiple display elements. Therefore, the execution content described in S803 can be described as a process of analyzing the user perception of multiple display elements one by one.

[0216] S804: Determine whether the user perception of the target display element meets the preset conditions.

[0217] If the judgment result is yes, then computer 10 can enter the judgment process of S807 below.

[0218] If the judgment result is negative, then computer 10 can enter the following S805 to add an imperceptible mark for rendering nodes with low user perception.

[0219] For example, computer 10 can determine whether the user perception of each target display element meets preset conditions based on the analysis results of the user perception of each target display element in S803 above. The preset conditions corresponding to the user perception settings can be exemplary relevant thresholds used to measure whether the user perception is high or low. Specifically, based on whether the user perception meets the preset conditions, computer 10 can classify the multiple display elements on the first interface into a portion of display elements with higher user perception (i.e., the first portion of display elements) and a portion of display elements with lower user perception (i.e., the second portion of display elements). The first portion of display elements can be exemplarily described using a first element as a representative; that is, based on the user perception of the first element, it can be determined that the first element is a display element whose user perception meets the preset conditions, and animation processing needs to be performed on the first element. Correspondingly, the second portion of display elements can be exemplarily described using a second element as a representative; that is, based on the user perception of the second element, it can be determined that the second element is a display element whose user perception does not meet the preset conditions, and animation processing needs to be performed on the first element.

[0220] Computer 10 executes S804, which can control the first part of the display elements to not be marked or processed, and directly enter the process of displaying the animation of the first part of the display elements (e.g., the first element) in S808 below. Furthermore, computer 10 executes S804, which can control the second part of the display elements to perform the process of adding marks as exemplified in S805 below.

[0221] In other embodiments, when the computer 10 determines that the user perception of the target display element meets the preset conditions, that is, when the determination result of S804 is yes, it performs marking and other processing on the first part of the display element, such as controlling the addition of perceptible markings to the first part of the display element, etc., without limitation.

[0222] S805: Add an imperceptible marker to the rendering node corresponding to the target display element.

[0223] For example, when computer 10 executes S804 above, if it determines that the user perception of the target display element does not meet the preset conditions, it can execute S805 to add an imperceptible marker to the rendering node corresponding to the display element whose user perception does not meet the preset conditions, such as the second element in the second part of the display elements. This marker can be recorded as the first marker. Correspondingly, the target display element corresponding to the rendering node to which the imperceptible marker is added can be an element in the second part of the display elements mentioned above.

[0224] For a detailed explanation of the process of adding the imperceptible marker, please refer to the relevant description in S506a above, which will not be repeated here.

[0225] S806: Perform animation processing based on the marked rendering nodes.

[0226] For example, based on the execution result of S805 above, the computer 10 determines the marked rendering nodes, such as the marked UI node tree, skips or deletes the animation instructions of the display elements corresponding to the nodes with imperceptible marks, executes the animation instructions of the display elements corresponding to the unmarked nodes or nodes with perceptible marks, and performs animation processing on these display elements.

[0227] For details on the specific process of performing motion effect processing, please refer to the processing procedures described in S508 to S511 above, which will not be repeated here.

[0228] S807: Determine whether the target display element is the last display element to be processed among multiple display elements participating in the animation.

[0229] If the judgment result is yes, then execute the following S808 to display animation during the interface switching process.

[0230] If the result is negative, the process can return to step S803 above and continue calculating the user perception of the next target display element.

[0231] S808: Display animation during the process of switching from the first interface to the second interface. The animation includes the animation corresponding to the first part of the display elements among multiple display elements. The animation corresponding to the first part of the display elements includes the first animation corresponding to the first element. The first animation is used to show the process of the first element's first element attribute changing to the second element attribute. The second interface includes the first element with the second element attribute.

[0232] For example, the first part of the display elements mentioned above may include one or more display elements whose user perception meets preset conditions (or whose user perception is relatively high). The element types of these display elements may also include windows, desktop icons, and dock bars, etc. For the specific animation effects during the transition from the first interface to the second interface, please refer to the relevant description in S513 above, which will not be repeated here.

[0233] It is understood that the aforementioned multiple display elements may also include a second set of display elements, and the animation effects during the transition from the first interface to the second interface do not include the animation effects corresponding to this second set of display elements. The display elements corresponding to the rendering nodes marked with imperceptible markers may belong to the second set of display elements.

[0234] Based on the implementation process of S801 to S808 described above, the interface processing method provided in this application can control the display of only a portion of the display elements' animation effects during the switching of interfaces on an electronic device. For example, the animation effects corresponding to the first portion of display elements mentioned above. Furthermore, it can control the display of another portion of display elements, such as the second portion of display elements mentioned above, to be hidden. Correspondingly, an electronic device implementing the interface processing method provided in this application can avoid drawing, rendering, or other processing of the second portion of display elements. This reduces the number of display elements requiring animation processing, reduces computational resource consumption, and helps reduce device power consumption and improve device performance.

[0235] Figure 9 A schematic diagram of the hardware structure of an electronic device is shown according to an embodiment of this application. Wherein, Figure 9 The electronic device 100 shown in this embodiment can be the computer 10 described above. In other embodiments, the electronic device can also be other electronic devices, which are not limited here.

[0236] like Figure 9 As shown, the electronic device 100 includes a bus 902, a processor 904, a memory 906, and a communication interface 908. The processor 904, the memory 906, and the communication interface 908 communicate with each other via the bus 902. The electronic device 100 can be a server or a terminal device. It should be understood that this application does not limit the number of processors and memories in the electronic device 100.

[0237] The 902 bus can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. Buses can be categorized as address buses, data buses, control buses, etc. For ease of representation, Figure 3The bus 904 is represented by a single line, but this does not mean that there is only one bus or one type of bus. The bus 904 may include a path for transmitting information between various components of the electronic device 100 (e.g., memory 906, processor 904, communication interface 908).

[0238] Processor 904 may include any one or more processors such as a central processing unit (CPU), a graphics processing unit (GPU), a microprocessor (MP), or a digital signal processor (DSP).

[0239] The memory 906 may include volatile memory, such as random access memory (RAM). The processor 904 may also include non-volatile memory, such as read-only memory (ROM), flash memory, hard disk drive (HDD), or solid state drive (SSD).

[0240] The memory 906 stores executable program code, and the processor 904 executes the executable program code to implement the aforementioned interface processing methods. That is, the memory 906 stores instructions for executing the aforementioned interface processing methods.

[0241] Alternatively, the memory 906 stores executable code, which the processor 904 executes to enable the electronic device 100, such as the computer 10 described above, to implement the interface processing method provided in this application, thereby achieving the goals of saving computing resources, reducing device power consumption, and improving device performance in some motion effect display scenarios. In other words, the memory 906 stores instructions for executing the interface processing method provided in this application.

[0242] The communication interface 903 uses transceiver modules such as, but not limited to, network interface cards and transceivers to enable communication between the electronic device 100 and other devices or communication networks.

[0243] Figure 10 A schematic diagram of the hardware structure of another electronic device is shown according to an embodiment of this application. In some embodiments, Figure 10 The electronic devices shown can be mobile phones or other electronic devices, including foldable phones with bi-fold or tri-fold screens. There are no restrictions on this.

[0244] like Figure 10 As shown, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identity module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0245] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0246] Processor 110 may include one or more processing units, such as application processors (APs), modem processors, graphics processing units (GPUs), image signal processors (ISPs), controllers, video codecs, digital signal processors (DSPs), baseband processors, and / or neural network processing units (NPUs). These different processing units may be independent devices or integrated into one or more processors.

[0247] The controller can generate operation control signals based on the instruction opcode and timing signals to complete the control of instruction fetching and execution.

[0248] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the aforementioned memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0249] In this embodiment, the processor 110 can generate an operation control signal through the controller to control the implementation of the above-mentioned... Figure 9 The instructions corresponding to each step in the implementation process shown enable the control and execution of motion effect instructions corresponding to display elements in the motion effect display scene, thereby realizing the interface processing method provided in this application, saving 100% of the computing resources of electronic devices, reducing device power consumption, and improving device performance.

[0250] In some embodiments, the processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a SIM card interface, and / or a universal serial bus (USB) interface, etc.

[0251] USB port 130 is a USB standard compliant interface, specifically a Mini USB port, Micro USB port, USB Type-C port, etc. USB port 130 can be used to connect a charger to charge electronic device 100, and can also be used for data transfer between electronic device 100 and peripheral devices. It can also be used to connect headphones for audio playback. This interface can also be used to connect other electronic devices, such as AR devices.

[0252] It is understood that the interface connection relationships between the modules illustrated in the embodiments of this application are merely illustrative and do not constitute a structural limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.

[0253] The charging management module 140 receives charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 receives charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 receives wireless charging input via the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also supply power to the electronic device via the power management module 141.

[0254] The power management module 141 connects the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, providing power to the processor 110, internal memory 121, display screen 194, camera 193, and wireless communication module 160, etc. The power management module 141 can also monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage current, impedance). In some other embodiments, the power management module 141 may also be located within the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may be located in the same device.

[0255] The wireless communication function of electronic device 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.

[0256] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with tuning switches.

[0257] The mobile communication module 150 can provide wireless communication solutions, including 2G / 3G / 4G / 5G, for use on electronic devices 100.

[0258] The wireless communication module 160 can provide solutions for wireless communication applications on the electronic device 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) technology, etc.

[0259] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, so that electronic device 100 can communicate with networks and other devices through wireless communication technology.

[0260] Electronic device 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0261] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. In some embodiments, the electronic device 100 may include one or N display screens 194, where N is a positive integer greater than 1.

[0262] Electronic device 100 can perform shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.

[0263] The ISP (Image Signal Processor) is used to process data fed back from the camera 193. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits this electrical signal to the ISP for processing, transforming it into an image visible to the naked eye. The ISP can also perform algorithmic optimization of image noise, brightness, and skin tone. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.

[0264] Camera 193 is used to capture still images or videos. In some embodiments, electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1.

[0265] The external storage interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, music, video, and other files can be saved on the external memory card.

[0266] Internal memory 121 can be used to store computer executable program code, including instructions. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system, application programs required for at least one function (such as sound playback, image playback, etc.), etc. The data storage area may store data created during the use of electronic device 100 (such as audio data, phonebook, etc.). In addition, internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc. Processor 110 executes various functional applications and data processing of electronic device 100 by running instructions stored in internal memory 121 and / or instructions stored in memory disposed in the processor.

[0267] Electronic device 100 can implement audio functions, such as music playback and recording, through audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.

[0268] The audio module 170 is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. The audio module 170 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 170 may be located in the processor 110, or some functional modules of the audio module 170 may be located in the processor 110.

[0269] The loudspeaker 170A, also known as a "loudspeaker", is used to convert audio electrical signals into sound signals.

[0270] The receiver 170B, also known as the "earpiece", is used to convert audio electrical signals into sound signals.

[0271] The microphone 170C, also known as a "microphone" or "voice transducer," is used to convert sound signals into electrical signals.

[0272] The 170D headphone jack is used to connect wired headphones. The 170D headphone jack can be a USB 130 interface or a 3.5mm Open Mobile Terminal Platform (OMTP) standard interface, a CTIA (Cellular Telecommunications Industry Association of the USA) standard interface.

[0273] Buttons 190 include a power button, volume buttons, etc. Buttons 190 can be mechanical buttons or touch-sensitive buttons. Electronic device 100 can receive button input and generate key signal inputs related to user settings and function control of electronic device 100.

[0274] Motor 191 can generate vibration alerts. Motor 191 can be used for incoming call vibration alerts or for touch vibration feedback. For example, different vibration feedback effects can correspond to touch operations performed on different applications (such as taking photos, playing audio, etc.). Motor 191 can also correspond to different vibration feedback effects for touch operations performed on different areas of the display screen 194. Different application scenarios (such as time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also be customized.

[0275] Indicator 192 can be an indicator light, used to indicate charging status, power changes, or to indicate messages, missed calls, notifications, etc.

[0276] The SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to achieve contact and separation with the electronic device 100. In some embodiments, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from it.

[0277] This application also provides a computer program product for implementing the interface processing methods provided in the above embodiments.

[0278] Various embodiments of the mechanisms disclosed in this application can be implemented in hardware, software, firmware, or combinations of these implementation methods. Embodiments of this application can be implemented as computer program modules or module code executable on a programmable system, the programmable system including at least one processor, a storage system (including volatile and non-volatile memory and / or storage elements), at least one input device, and at least one output device.

[0279] Computer program modules or module code can be applied to input instructions to perform the functions described in this application and generate output information. The output information can be applied to one or more output devices in a known manner. For the purposes of this application, the processing system includes any system having a processor such as, for example, a digital signal processor (DSP), a microcontroller, an application-specific integrated circuit (ASIC), or a microprocessor.

[0280] Module code can be implemented using a high-level modular language or an object-oriented programming language to communicate with the processing system. Assembly language or machine language can also be used to implement module code when needed. In fact, the mechanisms described in this application are not limited to any particular programming language. In either case, the language can be a compiled language or an interpreted language.

[0281] In some cases, the disclosed embodiments may be implemented in hardware, firmware, software, or any combination thereof. The disclosed embodiments may also be implemented as instructions carried or stored thereon on one or more temporary or non-temporary machine-readable (e.g., computer-readable) storage media, which may be read and executed by one or more processors. For example, the instructions may be distributed via a network or via other computer-readable storage media. Therefore, machine-readable storage media may include any mechanism for storing or transmitting information in a machine-readable (e.g., computer-readable) form, including but not limited to floppy disks, optical disks, optical discs, magneto-optical disks, read-only memory (ROM), random access memory (RAM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), magnetic cards or optical cards, flash memory, or tangible machine-readable storage for transmitting information (e.g., carrier waves, infrared signals, digital signals, etc.) using the Internet in the form of electrical, optical, acoustic, or other forms of propagated signals. Therefore, machine-readable storage media include any type of machine-readable storage media suitable for storing or transmitting electronic instructions or information in a machine-readable (e.g., computer-readable) form.

[0282] In this specification, the reference to "an embodiment" or "an embodiment" means that a specific feature, structure, or characteristic described in connection with the embodiment is included in at least one exemplary implementation or technology disclosed according to an embodiment of this application. The appearance of the phrase "in an embodiment" in various places in the specification does not necessarily refer to the same embodiment.

[0283] The disclosure of embodiments of this application also relates to means for performing operations in text. This means may be specifically constructed for the claimed purpose or may include a general-purpose computer selectively activated or reconfigured by a computer program stored in a computer. Such a computer program may be stored in a computer-readable storage medium, such as, but not limited to, any type of disk, including floppy disks, optical disks, CD-ROMs, magneto-optical disks, read-only memory (ROM), random access memory (RAM), EPROM, EEPROM, magnetic or optical cards, application-specific integrated circuits (ASICs), or any type of medium suitable for storing electronic instructions, and each may be coupled to a computer system bus. Furthermore, the computer mentioned in the specification may include a single processor or may be an architecture employing multiple processors for increased computing power.

[0284] Furthermore, the language used in this specification has been primarily chosen for readability and instructional purposes and may not have been chosen to depict or limit the disclosed subject matter. Therefore, the embodiments disclosed herein are intended to illustrate, and not limit, the scope of the concepts discussed herein.

Claims

1. An interface processing method applied to electronic devices, characterized in that, The method includes: Display a first interface, which includes multiple display elements, and the first element among the multiple display elements has a first element attribute; The animation effects displayed during the transition from the first interface to the second interface include animation effects corresponding to a first part of the display elements among the plurality of display elements. The animation effects corresponding to the first part of the display elements include a first animation effect corresponding to the first element. The first animation effect is used to demonstrate the process of the first element's first element attribute changing to a second element attribute. The second interface includes a first element having the second element attribute.

2. The method according to claim 1, characterized in that, The plurality of display elements also includes a second part of display elements, and the animation effect does not include the animation effect corresponding to the second part of display elements.

3. The method according to claim 2, characterized in that, The user perception of the first part of the plurality of display elements meets the preset conditions, while the user perception of the second part of the display elements does not meet the preset conditions.

4. The method according to claim 3, characterized in that, Before displaying the animation during the transition from the first interface to the second interface, the method further includes: A first operation instruction is detected, wherein the first operation instruction is used to instruct the first interface to be switched to the second interface; It is determined that the user perception of the second part of the display elements among the plurality of display elements does not meet the preset conditions.

5. The method according to claim 4, characterized in that, The animation effects during the transition from the first interface to the second interface include: Add a first marker to the second element in the second part of the display elements, wherein the first marker is used to indicate that no motion effects are performed on the second element; Execute a first motion effect instruction corresponding to the first element, wherein the first motion effect instruction is used to instruct motion effect processing to be performed on the first element; and Skip execution or delete the second motion effect instruction corresponding to the second element, wherein the second motion effect instruction is used to instruct motion effect processing to be performed on the second element.

6. The method according to claim 4 or 5, characterized in that, The method further includes displaying animations during the transition from the first interface to the second interface: The user perception of the first part of the multiple display elements is determined to meet a preset condition.

7. The method according to claim 6, characterized in that, The animation effects during the transition from the first interface to the second interface include: Add a second marker to the first element in the first part of the displayed elements; Execute a first motion effect instruction corresponding to the first element, and skip or delete a second motion effect instruction corresponding to the second element, wherein the first motion effect instruction is used to instruct motion effect processing to be performed on the first element, and the second motion effect instruction is used to instruct motion effect processing to be performed on the second element.

8. The method according to claim 4, characterized in that, Before displaying the animation during the transition from the first interface to the second interface, the method further includes: In response to the first operation command, identify the switching scenario corresponding to the process of switching from the first interface to the second interface; Based on the switching scenario, the element type to which the plurality of display elements belong is determined, wherein the element type includes one or more of the following: window, icon, dock.

9. The method according to claim 8, characterized in that, The step of determining the element type of the plurality of display elements based on the switching scenario includes: The switching scenario corresponds to the first type of scenario, and the element type to which the multiple display elements belong includes windows; The switching scenario corresponds to the second type of scenario, and the first interface includes the desktop, and the element types to which the multiple display elements belong include windows, desktop icons and dock bars.

10. The method according to claim 9, characterized in that, Corresponding to the first element being a first window, the second element including a second window, wherein the first window attributes corresponding to the first window are different from the second window attributes corresponding to the second window; or, Corresponding to the first element being the first window, the second element includes the icon of the first application to which the first window belongs.

11. The method according to claim 10, characterized in that, The user perception of the first window is related to at least one of the following: The degree to which the first window is obscured; The background transparency of the first window; The range of change in the window attributes of the first window from the first window attributes to the second window attributes; The size of the display area occupied by the first window on the screen of the electronic device.

12. The method according to claim 11, characterized in that, The user perception of the first part of the displayed elements meets preset conditions, including the following: If the degree of occlusion of the first window is detected to be lower than a first threshold, it is determined that the user perception of the first window meets the preset conditions. If the background transparency of the first window is detected to be higher than the second threshold, it is determined that the user perception of the first window meets the preset conditions. If the change in the window attributes of the first window is detected to be higher than the third threshold, it is determined that the user perception of the first window meets the preset conditions. If the size of the display area occupied by the first window on the screen of the electronic device is detected to be higher than a fourth threshold, it is determined that the user perception of the first window meets the preset conditions.

13. The method according to claim 12, characterized in that, The method for determining the degree of occlusion of the first window includes: Obtain the third window attributes possessed by the second window among the multiple windows; Based on the first window attributes and the third window attributes, the degree to which the first window is obscured by the second window is determined.

14. The method according to claim 13, characterized in that, The first window property includes at least one of the following: First coordinate information indicating the display position of the first window; The first alpha value indicating the background transparency of the first window; First size information indicating the display area occupied by the first window on the screen of the electronic device; First priority information indicating the display priority of the first window.

15. The method according to claim 14, characterized in that, Determining the degree to which the first window is obscured by the second window based on the first window attributes and the third window attributes includes: Based on the first coordinate information and first alpha value in the first window attributes, and the second coordinate information and second alpha value in the third window attributes, the degree to which the first window is obscured by the second window is determined.

16. The method according to claim 15, characterized in that, The first window's attributes are different from the second window's attributes, including at least one of the following: The second coordinate information in the second window properties that indicates the display position of the second window is different from the first coordinate information; The second alpha value in the second window properties, which indicates the background transparency of the second window, is different from the first alpha value; The second window properties indicate a second size information, which is different from the first size information, indicating the display area occupied by the second window on the screen of the electronic device.

17. The method according to claim 12, characterized in that, The second part of the display elements includes a third window, and the user perception of the second part of the display elements does not meet the preset conditions, including at least one of the following: If the degree of occlusion of the third window is detected to be lower than the first threshold, it is determined that the user perception of the first window meets the preset conditions. If the background transparency of the third window is detected to be higher than the second threshold, it is determined that the user perception of the first window meets the preset conditions. If the change in the window attributes of the first window is detected to be higher than the third threshold, it is determined that the user perception of the first window meets the preset conditions. If the size of the display area occupied by the third window on the screen of the electronic device is detected to be higher than the fourth threshold, it is determined that the user perception of the first window meets the preset conditions.

18. The method according to claim 9, characterized in that, Corresponding to the first element being a first icon displayed on the desktop, the second element includes a second icon, wherein the first icon attribute corresponding to the first icon is different from the second icon attribute corresponding to the second icon.

19. The method according to claim 18, characterized in that, The user perception of the first icon is related to the degree to which the first icon is obscured.

20. The method according to claim 19, characterized in that, The user perception of the first part of the displayed elements meets preset conditions, including: If the degree of occlusion of the first icon is detected to be higher than the fifth threshold, it is determined that the user perception of the first icon meets the preset condition; or, If the degree of obstruction of the first icon is detected to be lower than the fifth threshold, it is determined that the user perception of the first icon meets the preset conditions.

21. The method according to any one of claims 4 to 20, characterized in that, The animation effects during the transition from the first interface to the second interface include: The animation effect corresponding to the third element whose user perception meets the preset conditions at the first moment, wherein the third element belongs to the first part of the display elements; and, The animation corresponding to the fourth element when the user perception does not meet the preset conditions at the second moment, wherein the fourth element belongs to the second part of the display elements, the first moment is different from the second moment, and the third element and the fourth element are the same or different display elements.

22. An electronic device, characterized in that, include: One or more processors; One or more memories; the one or more memories storing one or more programs, which, when executed by the one or more processors, cause the electronic device to perform the interface processing method of any one of claims 1 to 21.

23. A computer-readable storage medium, characterized in that, The readable storage medium stores instructions that, when executed on a computer, cause the computer to perform the interface processing method according to any one of claims 1 to 21.

24. A computer program product, characterized in that, It includes a computer program / instruction that, when executed by a processor, implements the interface processing method according to any one of claims 1 to 21.

Images