Dynamic effect display method and electronic device

By obtaining and updating the interface layer information of the application window, dynamically generate gesture animation effects, solving the problem of dull gesture animation effects in the existing technology, and achieving a more flexible and efficient user experience.

CN117724783BActive Publication Date: 2024-11-19HONOR DEVICE CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202310854682.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-07-12
Publication Date
2024-11-19
Estimated Expiration
2043-07-12

AI Technical Summary

Technical Problem

In the prior art, the gesture animation effect of electronic devices when displaying multiple application windows is rigid, and the user experience is poor, so how to improve the display effect of gesture animation.

Method used

By obtaining the interface layer information of the application window, dynamically generate and update gesture dynamic effects are avoided, and a large amount of occupation of image processor resources is realized. The dynamic interface display of the application window during dragging and position exchange is realized.

Benefits of technology

Improves user experience, more flexible gestures and faster response speed, avoiding the power consumption and performance burden caused by frequent screenshot processing.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117724783B_ABST
    Figure CN117724783B_ABST
Patent Text Reader

Abstract

The present application provides a method for displaying dynamic effects and an electronic device, which relate to the field of terminals. The electronic device displays a first application window in a first area on the screen, and the first application window plays video content; displays a second application window in a second area on the screen; in response to a drag event on the first application window, the electronic device obtains the interface layer information of the first application window, and controls the first application window to move following the drag event through the interface layer information of the first application window; during the movement of the first application window, the first application window continues to play video content. Since the display content of the first application window is updated in real time according to the actual content of the interface layer, the display effect is more flexible; and when the application window displays dynamic images, a large amount of screenshot processing is not required, which avoids a large amount of image processor resources.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of terminals, and in particular to a motion effect display method and an electronic device. Background Art

[0002] As electronic devices continue to develop, more and more applications (applications, Apps) are installed on electronic devices. In order to meet the needs of users, more and more electronic devices support running and displaying multiple application windows at the same time.

[0003] When multiple application windows are displayed, the user can switch application windows through gestures; for example, exchanging the display positions of multiple application windows, such as switching the window mode of the application window (for example, switching the floating window mode to split screen mode, switching the split screen mode to floating window mode, etc.).

[0004] In order to improve the user experience, gesture effects are usually displayed in the application window when switching application windows. At present, the form of gesture effects is relatively rigid and the user experience is poor. How to improve the display effect of gesture effects is a problem that needs to be solved. Summary of the invention

[0005] The embodiments of the present application provide a method for displaying a dynamic effect and an electronic device. When the electronic device responds to a gesture operation made by a user in an application window to move an application window, the electronic device can display a more flexible gesture dynamic effect, thereby improving the user's experience.

[0006] To achieve the above objectives, the embodiments of the present application adopt the following technical solutions:

[0007] In the first aspect, a method for displaying a dynamic effect is provided, the method comprising: an electronic device displays a first application window in a first area on the screen, and displays a second application window in a second area on the screen; wherein the first application window plays video content. In response to a drag event on the first application window, the electronic device obtains the interface layer information of the first application window, and controls the first application window to move following the drag event through the interface layer information of the first application window; in response to a lift event acting on the first application window falling within a third area on the screen of the electronic device, the first application window is displayed in the second area, and the second application window is displayed in the first area; that is, the first application window and the second application window exchange display positions. In the process of moving the first application window, the first application window continues to play video content.

[0008] In one implementation, the electronic device further controls the first application window to adjust its size according to the position of the drag event through the interface layer information of the first application window.

[0009] In this method, in the process of exchanging the positions of two split-screen application windows in response to a user gesture, the gesture effect displayed in the application window is not a static image, but a dynamic playback interface. There is no need to take a screenshot of the interface of the application window, but the gesture effect of the application window is generated according to the interface layer of the application window. The gesture effect can be updated according to the actual content of the interface layer, and the display effect of the gesture effect is more flexible. Moreover, when generating dynamic gesture effects, there is no need to take a large number of screenshots, which avoids a large amount of image processor resources.

[0010] In combination with the first aspect, in one implementation, in response to a drag event on the first application window, the interface layer information only needs to be obtained once, and during subsequent movement of the application window, the interface layer information can be used directly without repeated acquisition, thereby improving efficiency.

[0011] In combination with the first aspect, in one embodiment, the interface layer information of the first application window includes the handle of the interface layer corresponding to the task of the first application window. The handle of the interface layer is used to uniquely point to an interface layer, and the information of all the interface layers of the application window can be obtained according to the handle of the interface layer corresponding to the task of the application window. In this way, the interface layer of the application window can be operated, such as specifying the display position of the interface layer, modifying the display size of the interface layer, etc. By obtaining the handle of the interface layer corresponding to the task of the first application window, the interface layer of the first application window can be displayed as the gesture effect of the first application window. The gesture effect is updated in real time with the interface layer, and the display effect is more flexible.

[0012] In one implementation, obtaining the handle of the interface layer of the first application window includes: obtaining the handles of all visible interface layers in split-screen mode; the visible interface layers in split-screen mode include the interface layer of the first application window.

[0013] In combination with the first aspect, in one implementation, the second area includes a third area (for example, the third area is hot zone 5), and a hand-raising operation on the first application window is detected in the third area.

[0014] That is, if the operation of releasing the first application window is detected in the third area, the first application window and the second application window are swapped.

[0015] In combination with the first aspect, in one implementation, in response to a drag event acting on the first application window falling within a fourth area on the screen of the electronic device, the aspect ratio of the first application window changes and a blurred image is displayed. In one implementation, in response to a drag event acting on the first application window falling within a fourth area on the screen of the electronic device, the aspect ratio of the second application window changes and a blurred image is displayed.

[0016] For example, in response to the user's dragging operation on the first application window, the display position of the first application window enters hot zone 4 or hot zone 6, the shape of the application window changes greatly, and the electronic device displays a blurred image in the first application window instead of displaying the playback interface. This can avoid displaying a distorted image and improve the user's viewing experience.

[0017] The blurred image can be any of the following:

[0018] A preset blurred image; or an image after blurring the first image, where the first image is the last frame of video image played by the first application window before the drag event falls on the fourth area.

[0019] In combination with the first aspect, in one implementation, the electronic device displays a blurred image in a first application window, including: the electronic device obtains a wallpaper layer; the wallpaper layer is used to draw the blurred image; and the electronic device generates the blurred image according to the wallpaper layer.

[0020] That is to say, the blurred image is also generated according to the interface layer.

[0021] In combination with the first aspect, in one implementation, in response to a lift event acting on the first application window falling within the fourth area, the first application window is displayed as a floating window and continues to play video content, and the second application window is displayed in full screen.

[0022] In a second aspect, an electronic device is provided, which has the function of implementing the method described in the first aspect. The function can be implemented by hardware, or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions.

[0023] In a third aspect, an electronic device is provided, comprising: a processor and a memory; the memory is used to store computer execution instructions, and when the electronic device is running, the processor executes the computer execution instructions stored in the memory to enable the electronic device to perform a method as described in any one of the above-mentioned first aspects.

[0024] In a fourth aspect, an electronic device is provided, comprising: a processor; the processor is used to couple with a memory, and after reading instructions in the memory, execute a method as described in any one of the above-mentioned first aspects according to the instructions.

[0025] In a fifth aspect, a computer-readable storage medium is provided, wherein instructions are stored in the computer-readable storage medium, and when the computer-readable storage medium is executed on a computer, the computer can execute any of the methods described in the first aspect.

[0026] In a sixth aspect, a computer program product comprising instructions is provided, which, when executed on a computer, enables the computer to execute any of the methods described in the first aspect.

[0027] In a seventh aspect, a device (for example, the device may be a chip system) is provided, the device including a processor for supporting an electronic device to implement the functions involved in the first aspect above. In one possible design, the device also includes a memory for storing program instructions and data necessary for the electronic device. When the device is a chip system, it may be composed of a chip, or may include a chip and other discrete devices.

[0028] Among them, the technical effects brought about by any design method in the second to seventh aspects can refer to the technical effects brought about by different design methods in the first aspect, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] Figure 1 A schematic diagram of a scenario applicable to the dynamic effect display method provided in an embodiment of the present application;

[0030] Figure 2A A schematic diagram of another scenario applicable to the dynamic effect display method provided in an embodiment of the present application;

[0031] Figure 2B A schematic diagram of another scenario applicable to the dynamic effect display method provided in the embodiment of the present application;

[0032] Figure 2C A schematic diagram of another scenario applicable to the dynamic effect display method provided in the embodiment of the present application;

[0033] Figure 3 A schematic diagram of a scenario example of the motion effect display method provided in an embodiment of the present application;

[0034] Figure 4 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application;

[0035] Figure 5 A schematic diagram of a software architecture of an electronic device provided in an embodiment of the present application;

[0036] Figure 6 A schematic diagram of an example of a screen hot zone division method in the motion effect display method provided in an embodiment of the present application;

[0037] Figure 7 A schematic diagram of a flow chart of a method for displaying dynamic effects provided in an embodiment of the present application;

[0038] Figure 8 A schematic diagram of a scenario example of the motion effect display method provided in an embodiment of the present application;

[0039] Fig. 9 A schematic diagram of a scenario example of the motion effect display method provided in an embodiment of the present application;

[0040] Fig.10 A schematic diagram of a scenario example of the motion effect display method provided in an embodiment of the present application;

[0041] Fig.11 A schematic diagram of a scenario example of the motion effect display method provided in an embodiment of the present application;

[0042] Fig.12 A schematic diagram of a scenario example of the motion effect display method provided in an embodiment of the present application;

[0043] Fig.13 A schematic diagram of the structural composition of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0044] In the description of the embodiments of the present application, the terms used in the following embodiments are only for the purpose of describing specific embodiments, and are not intended to be used as limitations to the present application. As used in the specification and the appended claims of the present application, the singular expressions "a", "said", "above", "the" and "this" are intended to also include such expressions as "one or more", unless there is a clear contrary indication in the context. It should also be understood that in the following embodiments of the present application, "at least one", "one or more" refer to one or more (including two). The term "and / or" is used to describe the association relationship of associated objects, indicating that three relationships can exist; for example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the associated objects before and after are a kind of "or" relationship.

[0045] References to "one embodiment" or "some embodiments" etc. described in this specification mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Thus, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways. The term "connection" includes direct connection and indirect connection, unless otherwise specified. "First" and "second" are used for descriptive purposes only and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated.

[0046] In the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0047] When an electronic device displays an application window, the user can switch the display mode of the application window by dragging the application window. In one example, two application windows are displayed in split screen on the screen of the electronic device. The user can use gestures to make the two application windows displayed in split screen exchange their display positions on the screen. For example, application window one is displayed on the left side of the screen, and application window two is displayed on the right side of the screen. The user long presses the top of application window one so that application window one is picked up, and after application window one is picked up, the display position can be moved; then the user drags application window one to the right so that application window one and application window two exchange display positions. The user can also long press the top of application window two so that application window two is picked up; then drag application window two to the left so that application window one and application window two exchange display positions.

[0048] For example, Figure 1 As shown in (a), the mobile phone screen displays a window 10 of a video application and a window 20 of a calculator application in split screen, with window 10 displayed on the left side of the screen and window 20 displayed on the right side of the screen. The user long presses Bar 11 at the top of window 10. Figure 1 As shown in (b), the mobile phone responds to the user's gesture of long pressing the top Bar 11 of the window 10 and picks up the window 10; the user continues to press the top Bar 11 and moves it to the right. Figure 1As shown in (c), the user's rightward drag gesture is received, and the window 10 moves along the dragging trajectory. When the window 10 moves to the right side of the screen, the user's hand-raising gesture is detected. Figure 1 As shown in (d), window 10 and window 20 exchange display positions, window 20 is displayed on the left side of the screen, and window 10 is displayed on the right side of the screen. For another example, application window 1 is on the upper side of the screen, and application window 2 is on the lower side of the screen. The user long presses the top of application window 1 so that the window is picked up, and then drags application window 1 downward so that application window 1 and application window 2 exchange display positions. The user can also long press the top of application window 2 so that application window 2 is picked up, and then drag application window 2 upward so that application window 1 and application window 2 exchange display positions.

[0049] In another example, the electronic device screen displays application window 1 in full screen, and displays application window 2 in the form of a floating window. The user can use gestures to make application window 1 and application window 2 displayed on the screen in split screens. Figure 2A As shown, the mobile phone screen displays the video application window 10 in full screen, and displays the calculator application window 20 in the form of a floating window. In response to the user's long press gesture of the top Bar 21 of the window 20, the mobile phone picks up the window 20; the user's gesture of pressing the top Bar 21 to drag to the left side of the screen is detected, and the window 20 moves along the dragging track. When the window 20 moves to the left side of the screen, the user's hand-raising gesture is detected, and the window 10 and the window 20 are displayed in split screens, with the window 20 displayed on the left side of the screen and the window 10 displayed on the right side of the screen.

[0050] In another example, the electronic device displays application window one in the form of a floating window, and also displays application window two and application window three in a split screen. In response to a user gesture, it switches to displaying application window one and application window two in a split screen; or, in response to a user gesture, it switches to displaying application window one and application window three in a split screen.

[0051] In another example, the electronic device screen displays application window 1 in full screen. The user can switch the display mode of application window 1 through a drag gesture. Figure 2B , the mobile phone displays the window 10 of the video application in full screen, and in response to the drag gesture applied to the window 10, the window 10 moves along the drag track. Upon detecting the user's hand-raising operation, the window 10 is displayed in mini window mode. In another example, the mobile phone displays the window 10 of the video application in full screen, and in response to the drag gesture applied to the window 10, the window 10 moves along the drag track. In response to the user's hand-raising operation, the mobile phone displays a split-screen launcher. In another example, referring to Figure 2C, the mobile phone displays the window 10 of the video application in full screen, and in response to the drag gesture acting on the window 10, the window 10 moves along the drag track. In response to the user's hand raising operation, the window 10 is displayed in split screen mode.

[0052] It should be noted that the dynamic effect display method provided in the embodiment of the present application can be applied to various scenarios in which the application window is dragged to switch the display mode of the application window. Figure 1 The following description is made using the scenario shown in the figure as an example.

[0053] by Figure 1 Take the scenario shown as an example. The electronic device displays application window 1 and application window 2 in split screen, application window 1 is displayed in the first area of ​​the screen, and application window 2 is displayed in the second area of ​​the screen. In response to receiving the first gesture of the user, application window 1 is picked up. Exemplarily, the first gesture is a gesture of long pressing the top of the application window (such as the Bar at the top of the window).

[0054] After the application window 1 is picked up, the user can move the display position of the application window 1 through the second gesture. Exemplarily, the second gesture is a gesture of dragging the application window. In response to receiving the second gesture of the user, the display position of the application window 1 moves on the screen along the moving track of the second gesture.

[0055] In response to detecting a third gesture of the user within the preset area of ​​the screen, application window one is displayed in the second area of ​​the screen, and application window two is displayed in the first area of ​​the screen; that is, application window one and application window two are swapped in display position. Exemplarily, the third gesture is a gesture of the user releasing the application window (a hand-raising gesture). In one implementation, when the electronic device detects a hand-raising gesture of the user, if it is determined that the execution position of the hand-raising gesture is within the preset area of ​​the screen, application window one is displayed in the second area of ​​the screen, and application window two is displayed in the first area of ​​the screen (that is, the display positions of application window one and application window two are swapped). If the execution position of the hand-raising gesture is not within the preset area of ​​the screen, the swapping of the display positions of application window one and application window two is canceled. Exemplarily, if Figure 1 As shown in (c), window 10 moves its display position along the moving track of the user's second gesture (gesture of dragging window 10). When Bar 11 at the top of window 10 moves to the top area of ​​window 20, a hand-raising gesture is detected, that is, the execution position of the hand-raising gesture is within the top area of ​​window 20, and the display positions of window 10 and window 20 are swapped, and window 20 is displayed on the left side of the screen, and window 10 is displayed on the right side of the screen. If the execution position of the hand-raising gesture is not within the top area of ​​window 20, the display position swap of window 10 and window 20 is canceled, and window 10 is still displayed on the left side of the screen, and window 20 is displayed on the right side of the screen.

[0056] When the electronic device displays multiple application windows, the application windows are switched in response to a user's gesture in one of the application windows. In the process of switching application windows, animations are displayed in each application window. In the embodiment of the present application, the animation is referred to as a gesture animation. For example, when the user's first gesture (such as a long press gesture on the top of the application window) is detected, the gesture animation begins to be displayed, and when the third gesture (such as a hand-raising gesture) is detected, the gesture animation stops being displayed.

[0057] In one embodiment, using The native mechanism operates on the view and generates gesture effects based on the screenshot of the application interface.

[0058] In one implementation, after receiving the first gesture, a screenshot is taken of the interface of the application window, and a gesture effect of the application is generated based on the screenshot image. Figure 1 Taking the illustrated scenario example as an example, when the interface 101 is displayed in the window 10 of the video application, the mobile phone detects the user's first gesture (a gesture of long pressing the top of the window 10). The mobile phone takes a screenshot of the interface 101 and generates a gesture effect of the window 10 according to the screenshot image of the interface 101. In the process of the window 10 moving from the left side of the screen to the right side of the screen, the gesture effect of the window 10 is the screenshot image of the interface 101. That is, in the process of the window 10 moving from the left side of the screen to the right side of the screen, the playback interface of the video application is covered by the screenshot and is not presented to the user, and the user sees a static screenshot image. In this implementation, the gesture effect is static, and the display effect of the gesture effect is not flexible. In addition, the screenshot processing process takes a certain amount of time. After the user makes the first gesture, the electronic device may pause for a while, waiting to obtain the screenshot image and generate the gesture effect according to the screenshot image before moving the application window. The electronic device responds slowly to the user's gesture, and the user experience is poor.

[0059] In another implementation, after receiving the first gesture, the interface of the application window can be screenshoted multiple times, and a dynamic gesture effect can be generated based on the multiple screenshot images obtained by the screenshot processing. In this implementation, if the frequency of the screenshot processing is high, such as taking a screenshot of each frame of the video application interface, the generated gesture effect will be the same as the playback interface of the video application, so that the user can also watch the dynamic playback interface during the movement of the application window of the video application. However, frequent screenshot processing will result in higher power consumption, and executing a large number of screenshots also places higher requirements on the performance of the image processor, which brings a greater burden to the image processor, and the image processor may not be able to handle it. If the frequency of screenshot processing is low, the display effect of the gesture effect will be affected. For example, during the movement of the application window of the video application, the video playback interface viewed by the user loses frames and freezes, the real-time performance is poor, and the user experience is poor.

[0060] The embodiment of the present application provides a method for displaying a dynamic effect. During the process of switching application windows, there is no need to take a screenshot of the interface of the application window. Instead, a gesture dynamic effect of the application window is generated based on the interface layer of the application window. The interface layer is generated by an image synthesizer (Surface Flinger) of an electronic device, and is an interface image displayed in an application window. The method for displaying a dynamic effect provided by the embodiment of the present application generates a gesture dynamic effect based on the interface layer. The gesture dynamic effect can be updated according to the actual content of the interface layer, and the display effect is more flexible. Let's take the scenario where application one is a video application, application two is a calculator application, and application window one and application window two are displayed in split screen as an example. For example, Figure 3 As shown, the mobile phone screen displays a split screen of a video application window 10 and a calculator application window 20, with window 10 displayed on the left side of the screen and window 20 displayed on the right side of the screen. The mobile phone receives a gesture of a user pressing and holding the top Bar 11 of window 10, and picks up window 10; receives an operation of the user pressing and holding the top Bar 11 and dragging it to the right, and window 10 moves along the user's dragging trajectory. During the movement of window 10, the gesture effect of window 10 displays the dynamic interface of the video application instead of a static interface screenshot image. When window 10 moves to the right side of the screen, the user's hand-raising gesture is detected, window 10 is displayed on the right side of the screen, window 20 is displayed on the left side of the screen, the gesture effect is stopped, and window 10 continues to play the interface of the video application. In the process of exchanging the display positions of window 10 and window 20, window 10 displays a dynamic and coherent video application interface, and the display effect of the gesture effect is more flexible. Moreover, when generating dynamic gesture effects, a large amount of screenshot processing is not required, which avoids a large amount of image processor resources.

[0061] In the scenario example given in the embodiment of the present application, after detecting a user's long press gesture on the top of the window, the electronic device picks up the application window. After picking up the application window, a gesture of dragging the application window is detected, and the display position of the application window moves along the dragging track.

[0062] It should be noted that in other implementations, there is no need to long press the top of the window to pick up the application window. When the electronic device detects the gesture of dragging the application window, the display position of the application window moves along the dragging trajectory.

[0063] The motion effect display method provided in the embodiment of the present application displays a gesture motion effect when the display position of the application window moves along the dragging trajectory. The gesture motion effect is generated according to the interface layer of the application window, so that the dynamic playback interface of the application can be displayed.

[0064] The dynamic effect display method provided in the embodiment of the present application can be applied to electronic devices that support multi-window display. The above-mentioned electronic devices may include mobile phones, tablet computers, laptops, personal computers (PCs), ultra-mobile personal computers (UMPCs), handheld computers, netbooks, smart home devices (e.g., smart TVs, smart screens, large screens, smart speakers, smart air conditioners, etc.), personal digital assistants (PDAs), wearable devices (e.g., smart watches, smart bracelets, etc.), vehicle-mounted devices, virtual reality devices, etc., and the embodiments of the present application do not impose any restrictions on this.

[0065] Figure 4 1 is a structural diagram of an electronic device. The electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor, a fingerprint sensor, a temperature sensor, a touch sensor, etc.

[0066] It is to be understood that the structure illustrated in this embodiment does not constitute a specific limitation on the electronic device 100. In other embodiments, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0067] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0068] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0069] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0070] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0071] It is understandable that the interface connection relationship between the modules illustrated in this embodiment is only a schematic illustration and does not constitute a structural limitation of the electronic device. In other embodiments, the electronic device may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0072] The charging management module 140 is used to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from a wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 may receive wireless charging input through a wireless charging coil of an electronic device. While the charging management module 140 is charging the battery 142, it may also power the electronic device through the power management module 141.

[0073] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.

[0074] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0075] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0076] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Mini-LED, Micro-OLED, Micro-OLED, quantum dot light-emitting diodes (QLED), etc.

[0077] The electronic device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.

[0078] ISP is used to process the data fed back by camera 193. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to ISP for processing and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, ISP can be set in camera 193.

[0079] Camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device may include 1 or N cameras 193, where N is a positive integer greater than 1. In the embodiment of the present application, the camera 193 can be used to capture video images.

[0080] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110.

[0081] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, audio, video and other files are stored in the external memory card.

[0082] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device by running the instructions stored in the internal memory 121. For example, in an embodiment of the present application, the processor 110 can execute instructions stored in the internal memory 121, and the internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.). The data storage area may store data (such as video files) created during the use of the electronic device, etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0083] The pressure sensor is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor can be arranged on the display screen 194. There are many types of pressure sensors, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. A capacitive pressure sensor can be a parallel plate including at least two conductive materials. When a force acts on the pressure sensor, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure based on the change in capacitance. When a touch operation acts on the display screen 194, the electronic device 100 detects the intensity of the touch operation based on the pressure sensor. The electronic device 100 can also calculate the position of the touch based on the detection signal of the pressure sensor.

[0084] The touch sensor is also called a "touch panel". The touch sensor can be arranged on the display screen 194, and the touch sensor and the display screen 194 form a touch screen, also called a "touch screen". The touch sensor is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor can also be arranged on the surface of the electronic device 100, which is different from the position of the display screen 194.

[0085] The electronic device 100 can detect a user's pressing operation, dragging operation, etc. on the display screen 194 through a pressure sensor or a touch sensor, so as to detect whether a multi-window switching gesture of the user is received.

[0086] In the embodiment of the present application, the electronic device 100 is an electronic device that can run an operating system and install application programs. Optionally, the operating system running on the electronic device 100 can be system, system, In some embodiments, the software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-core architecture or a cloud architecture. Taking the system as an example, the software structure of the electronic device 100 is exemplarily described.

[0087] Figure 5 A software structure diagram of the electronic device 100 provided in an embodiment of the present application.

[0088] It is understandable that the layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, The system may include an application (App) layer (referred to as the application layer), an application framework (FWK) layer (referred to as the framework layer), an Android runtime (Android runtime) and a system library, as well as a kernel layer.

[0089] The application layer can include a series of application packages, such as camera, gallery, calendar, call, map, navigation, Bluetooth, music, video, short message, etc.

[0090] Among them, the third-party application includes a multi-window gesture entrance, which is used to process the received user gestures and trigger the generation of gesture effects.

[0091] The system user interface (System UI) application includes a gesture management module, a gesture hotspot module, a gesture animation module, etc. The gesture management module is used to manage the relevant processes for generating gesture animations, and the gesture hotspot module is used to generate and manage screen hotspots in different processes. Among them, the screen hotspot is a preset area on the screen, and its specific division and the processing flow corresponding to different screen hotspots will be described in detail in the following embodiments. The gesture animation module is used to provide the function of generating gesture animations.

[0092] like Figure 5 As shown, the application framework layer may include a window manager service (WMS), a content provider, a view system, a phone manager, a resource manager, a notification manager, an activity manager (AMS), a gesture layer management module, a multi-window management module, and the like.

[0093] The window manager WMS is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc. It can manage the information of each application window interface, such as the interface layer information of the application window, etc.

[0094] The activity manager AMS is responsible for managing activities, starting, switching, and scheduling components in the system, and managing and scheduling applications.

[0095] The event distribution module is used to distribute events to various modules.

[0096] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0097] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.

[0098] The phone manager is used to provide communication functions for electronic devices, such as the management of call status (including answering, hanging up, etc.).

[0099] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0100] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.

[0101] The gesture layer management module is used to obtain and manage the interface layer information for generating gesture effects.

[0102] The multi-window management module is used to provide the function of displaying multiple application windows on the screen and manage multiple application windows. For example, it manages the window modes (split screen mode, floating window mode, etc.) of multiple application windows and manages the display size and position of multiple application windows.

[0103] In an embodiment of the present application, by adding a gesture management module (gesture management class), a gesture hot zone module (gesture hot zone class), and a gesture animation module (gesture animation class) in the System UI, and adding a gesture layer management module (gesture layer management class) in the application framework layer, it is possible to obtain the interface layer of the application and generate the gesture animation of the application window according to the interface layer of the application.

[0104] Android runtime includes core libraries and virtual machines. Android runtime is responsible for scheduling and management of the Android system.

[0105] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.

[0106] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0107] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0108] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0109] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0110] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0111] A 2D graphics engine is a drawing engine for 2D drawings.

[0112] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0113] The kernel layer is the layer between hardware and software. The kernel layer can contain display drivers, camera drivers, audio drivers, sensor drivers, etc.

[0114] The following is a detailed description of the motion effect display method provided in the embodiment of the present application in conjunction with the accompanying drawings. It should be noted that the embodiment of the present application takes the scenario in which an electronic device displays two application windows, and in response to a user's gesture in one of the application windows, swaps the display positions of the two application windows as an example for detailed description. The motion effect display method provided in the embodiment of the present application is also applicable to other multi-application window switching scenarios. For example, the scenario in which the application window switches from a floating window mode to a split-screen mode, and from a split-screen mode to a floating window mode, etc. The motion effect display method provided in the embodiment of the present application is also applicable to other scenarios for switching the display mode of application windows. For example, the application window switches from a full-screen mode to a floating window mode, and the application window switches from a full-screen mode to a split-screen mode, etc.

[0115] The electronic device displays application window 1 and application window 2. Optionally, application window 1 and application window 2 may be application windows of two different applications, for example, application window 1 is an application window of application 1, and application window 2 is an application window of application 2. Optionally, application window 1 and application window 2 may be two different application windows of the same application.

[0116] Application window 1 is displayed in the first area of ​​the screen, and application window 2 is displayed in the second area of ​​the screen. In some embodiments, application window 1 and application window 2 are displayed in split screen mode on the screen of the electronic device. In some examples, application window 1 is displayed on the left side of the screen, and application window 2 is displayed on the right side of the screen. In some examples, application window 1 is displayed on the upper side of the screen, and application window 2 is displayed on the lower side of the screen. Figure 3Taking the scene example shown as an example, the mobile phone displays application window one and application window two in split screen, application window one is window 10 of the video application, and application window two is window 20 of the calculator application. Window 10 is displayed on the left side of the screen, and window 20 is displayed on the right side of the screen.

[0117] In some embodiments, the area on the screen of the electronic device used to display multiple application windows can be divided into multiple preset areas. In the embodiment of the present application, a preset area is referred to as a screen hot zone. In different window modes, the screen hot zones can be divided in different ways. For example, in split-screen mode, the screen area for split-screen display of each application window is divided into 6 screen hot zones; for example, in floating window mode, the screen area occupied by the full-screen application window is divided into 4 screen hot zones. When the mobile phone detects the user's gestures in different screen hot zones, it can execute the corresponding process.

[0118] For example, Figure 3 The example scenario shown in FIG. 1 is used as an example to describe the present invention. The mobile phone displays a video application window 10 and a calculator application window 20 in split screen, with window 10 displayed on the left side of the screen and window 20 displayed on the right side of the screen. Figure 6 As shown, the screen area occupied by window 10 and window 20 is recorded as screen area 200. The user can drag window 10 or window 20 to exchange the display position of window 10 and window 20. The application window dragged by the user is called an active window, and the application window that moves with the movement of the active window is called a passive window. Taking window 10 as an active window as an example, screen area 200 is divided into 6 screen hot zones, namely hot zone 1, hot zone 2, hot zone 3, hot zone 4, hot zone 5 and hot zone 6.

[0119] The user performs a first gesture on application window 1 (window 10). For example, the first gesture is a long press gesture on the top of the application window (such as the bar at the top of the window). The mobile phone detects the long press gesture of the user in hot zone 1 and determines that the first gesture of the user is detected. In response to receiving the first gesture on application window 1 (window 10), application window 1 (window 10) is picked up. For example, refer to Figure 3 , the mobile phone receives the user's gesture of long pressing Bar 11 at the top of window 10 and picks up window 10.

[0120] After the application window 1 (window 10) is picked up, the user can drag the application window 1 (window 10) through the second gesture. Exemplarily, the second gesture is a gesture of dragging the application window. In response to receiving the second gesture of the user, the application window 1 (window 10) moves the display position on the screen along the moving track of the second gesture. Exemplarily, refer to Figure 3In response to the user's gesture of pressing and dragging the Bar 11 at the top of the window 10, the window 10 moves along the dragging track. The moving track of the second gesture can pass through any screen hot zone.

[0121] The user can perform a third gesture (such as a hand-raising gesture) at any position on the screen. The mobile phone detects the third gesture in different screen hot zones and can perform corresponding actions respectively. In one example, if the third gesture is detected in hot zone 5, the positions of window 10 and window 20 are swapped, window 10 is displayed on the right side of the screen, and window 20 is displayed on the left side of the screen. In one example, if the third gesture is detected in hot zone 2, the positions of window 10 and window 20 are not swapped, window 10 is still displayed on the left side of the screen, and window 20 is displayed on the right side of the screen. In one example, the third gesture is detected in hot zone 3, window 10 is closed, and the split-screen management application is started. In one example, if the third gesture is detected in hot zone 4, window 10 is displayed as a floating window, and window 20 is displayed in full screen. In one example, if the third gesture is detected in hot zone 6, the positions of window 10 and window 20 are swapped, window 10 is displayed on the right side of the screen, and window 20 is displayed on the left side of the screen.

[0122] In some embodiments, when the application window moves with the user's second gesture, a gesture effect is displayed. The electronic device generates the gesture effect of each application window according to the interface layer of the application window.

[0123] Exemplary, combined Figure 5 The electronic device software architecture shown, Figure 7 A flow chart of a method for displaying dynamic effects provided in an embodiment of the present application is shown.

[0124] like Figure 7 As shown, the dynamic effect display method provided in the embodiment of the present application may include:

[0125] S701: A multi-window gesture entry module of a third-party application receives a gesture event.

[0126] The sensor (such as a touch sensor) of the electronic device detects the user's operation on the display screen (touch screen) at a preset frequency, and generates corresponding gesture events according to the detected operation. For example, if a long press operation on the top bar of the application window is detected, a first event (long press event) is generated, and the first event includes the location where the long press operation is detected. For example, if an operation of pressing and holding the application window (such as the top bar of the application window) and moving it multiple times and the moving distance is greater than a threshold is detected, that is, a drag operation on the application window is detected, then a second event (drag event) is generated, and the second event includes the location where the drag operation is applied; for example, if a hand-raising operation acting on the application window is detected, a third event (hand-raising event) is generated, and the third event includes the location where the hand-raising operation is detected.

[0127] When the multi-window gesture entry module of the third-party application receives a gesture event (long press event, drag event, hand raising event, etc.), it determines that the user gesture has been received.

[0128] For example, Figure 3 The scenario example shown is used as an example for introduction. The third-party application is a video application, and the video application includes a multi-window gesture entry module, and the multi-window gesture entry module receives gesture events. For example, a long press event is received (the location of the long press operation is the screen area corresponding to the Bar at the top of the application window); or a drag event of the application window is received; or a hand-raising event of the application window is received.

[0129] S702: In response to a drag event on an application window, the multi-window gesture entry module of the third-party application sends a first message to a gesture management module of the system UI.

[0130] The electronic device detects the user's gestures on the display screen (touch screen) at a preset frequency. If the electronic device detects the user's dragging operation of the application window multiple times in a row, the application window moves its display position along the moving track of the dragging operation.

[0131] In one implementation, the multi-window gesture entry module determines whether the operation of dragging the application window is detected for the first time according to the gesture event. Figure 3 The scenario example shown is used as an example. The mobile phone screen displays a window 10 of a video application and a window 20 of a calculator application in split screen, with window 10 displayed on the left side of the screen and window 20 displayed on the right side of the screen. For example, window 10 is displayed in the first area and window 20 is displayed in the second area. The user can move the display position of window 10 by dragging. If the starting position of the drag operation is determined to be the first area according to the drag event, it is determined that the gesture of dragging window 10 is detected for the first time.

[0132] In one implementation, after the event of dragging the application window is detected for the first time, the multi-window gesture entry module of the third-party application sends a first message to the gesture management module of the system UI, and the first message is used to trigger the preparation of gesture effects. In one implementation, the first message includes a task identifier (TaskId), gesture information, window mode, mode information, etc.

[0133] The TaskId is used to uniquely identify the application window (such as window 10) that receives the user gesture.

[0134] The gesture information includes the gesture type of the currently received gesture event, the position where the user operation is detected (coordinates on the screen), etc. For example, if the gesture type is a long press operation, the position where the long press operation is detected is coordinate 1 on the screen. For example, if the gesture type is a drag operation, the position where the drag operation is detected is coordinate 2 on the screen.

[0135] The window mode is used to indicate the display mode of the application window that receives the gesture event, including split-screen mode, floating window mode, etc.

[0136] Different window modes may correspond to different mode information. In one example, the mode information corresponding to the split-screen mode includes top-bottom split-screen, left-right split-screen, etc.; the mode information corresponding to the floating window mode is used to indicate the display mode of the background application, such as full-screen display, display desktop, top-bottom split-screen display, left-right split-screen display, etc.

[0137] Exemplarily, the structure of the first message is as follows:

[0138]

[0139] Among them, ev represents gesture information, taskId represents task identifier, windowMode represents window mode, and primaryScreenType represents mode information.

[0140] S703: The gesture management module of the system UI sends a second message to the gesture hotspot module of the system UI.

[0141] In one implementation, the gesture management module sends a second message to the gesture hot zone module, and the second message is used to trigger the creation of the screen hot zone. In one implementation, the second message includes TaskId, gesture information, window mode, mode information, etc. The gesture management module obtains TaskId, gesture information, window mode, mode information, etc. from the first message, and sends it to the gesture hot zone module in the second message.

[0142] S704: The gesture hotspot module of the system UI creates a screen hotspot according to the window mode and mode information.

[0143] In different window modes, the screen hot areas can be divided in different ways.

[0144] In one example, when the window mode is split screen mode and the mode information is left-right split screen, create Figure 6 The screen hot zones shown. The screen hot zones include hot zone 1, hot zone 2, hot zone 3, hot zone 4, hot zone 5 and hot zone 6. It can be understood that in other window modes or mode information, the screen hot zones have corresponding division methods.

[0145] S705. The gesture hotspot module of the system UI sends a third message to the gesture animation module of the system UI.

[0146] In one implementation, the gesture hotspot module sends a third message to the gesture animation module, and the third message is used to trigger the creation of gesture animation. In one implementation, the third message includes TaskId, gesture information, window mode, mode information, etc. The gesture hotspot module obtains TaskId, gesture information, window mode, mode information, etc. from the second message and sends it to the gesture animation module in the third message.

[0147] S706: The gesture animation module of the system UI requests the gesture layer management module of the framework layer to obtain interface layer information.

[0148] For example, the interface layer information is the handle of the interface layer (Surface) corresponding to the task (Task) of the application window. The handle of the interface layer is used to uniquely point to an interface layer. According to the handle of the interface layer (Surface) corresponding to the task (Task) of the application window, the top handle of the interface layer tree of the application window can be obtained, and all the information of the interface layer tree of the application window can be obtained. For example, the interface layer tree includes the interface layer hierarchy, the display range, display size, display position, etc. of each level of the interface layer. The display position, display size, etc. of all the interface layers of the application window can also be adjusted according to the handle of the interface layer (Surface) corresponding to the task (Task) of the application window.

[0149] S707: The gesture layer management module of the framework layer collects interface layer information of each application window.

[0150] In one implementation, the WMS manages the interface layers of each application window on the screen of the electronic device, and the gesture layer management module obtains the interface layer information of each application window from the WMS.

[0151] In one example, the gesture layer management module traverses the interface layer tree of the application window and collects all visible interface layer trees in full-screen mode. The gesture layer management module traverses the interface layer tree of the application window and collects all visible interface layer trees in split-screen mode; for example, if it is a left-right split screen, the interface layer (Surface) corresponding to the task (Task) of the left application window and the interface layer (Surface) corresponding to the task (Task) of the right application window are collected; for example, if it is a top-bottom split screen, the interface layer corresponding to the task (Task) of the upper application window and the interface layer corresponding to the task (Task) of the lower application window are collected. The gesture layer management module also traverses the interface layer tree of the application window and collects all visible interface layer trees in floating window mode.

[0152] Optionally, the gesture layer management module also traverses the interface layer tree of the application window, collects all visible interface layer trees of the picture-in-picture mode, and hides all interface layers of the picture-in-picture mode. In this way, when the gesture animation is played, the picture-in-picture interface will not appear, ensuring the integrity of the gesture animation playback interface.

[0153] Optionally, the gesture layer management module also creates a wallpaper layer for drawing a frame of image. In one example, the image can be used as the background of the application window when the application window is reduced in size. Figure 3 As shown, after the window 10 is reduced in size, the image 30 is displayed on the screen as the background of the window 10. In an example, the image can be blurred to generate a blurred image, which is used to display the blurred image in the gesture animation.

[0154] S708. The gesture layer management module of the framework layer returns the collected interface layer information of each application window to the gesture animation module of the system UI.

[0155] In one implementation, the gesture layer management module sends interface layer information to the gesture animation module. The interface layer information includes one or more of the handles of the full screen mode interface layer, the handles of each interface layer in the split screen mode, the handles of the floating window mode interface layer, the handles of the picture-in-picture mode interface layer, and the handles of the wallpaper layer.

[0156] It is understandable that one or more items in the interface layer information may be empty. For example, when the current window mode is split-screen mode, there is no full-screen mode interface layer, and the handle of the full-screen mode interface layer is empty. Figure 3 Taking the scene example shown as an example, the window mode is split screen mode, window 10 is displayed on the left side of the screen, and window 20 is displayed on the right side of the screen. The gesture layer management module obtains the handle of the interface layer corresponding to window 10 and the handle of the interface layer corresponding to window 20 from WMS. The handle of the interface layer in full screen mode is empty, the handle of the interface layer in floating window mode is empty, and the handle of the interface layer in picture-in-picture mode is empty.

[0157] S709: The gesture effect module of the system UI generates gesture effects according to the interface layer information.

[0158] In one implementation, the gesture animation module obtains the interface layer information of the corresponding application window from the interface layer information of each application window returned by the gesture layer management module based on the window mode and mode information, and generates the gesture animation of the application window according to the interface layer information of the corresponding application window (the handle of the interface layer corresponding to the task of the application window). Exemplarily, the gesture animation module adjusts the display position and display size of the interface layer of the application window through the handle of the interface layer corresponding to the task of the application window, that is, adjusts the display position and display size of the gesture animation of the application window.

[0159] In this method, the handle of the interface layer corresponding to the task of the application window is obtained, that is, the control over the interface layer of the application window is obtained, and gesture effects can be generated according to the interface layer of the application window; the interface layer is updated in real time, and the gesture effects are updated in real time. It is not necessary to perform frequent screenshot processing to play the dynamic interface. The large amount of power consumption caused by frequent screenshot processing is avoided.

[0160] In one implementation, while the application window moves its display position along the moving track of the drag event, the display position and display size of the gesture effect (interface layer) of the application window are adjusted accordingly. During this process, the window mode and mode information of the multiple application windows do not change. In other words, the window mode and mode information are the window mode and mode information when the drag event is first received. After receiving the hand-raising event, the window mode may be switched or the application window position may be swapped, and the window mode and mode information will be updated accordingly.

[0161] In one example, the window mode is split screen mode, and the mode information is left-right split screen. Then, the handle of the interface layer corresponding to the task of the left application window and the handle of the interface layer corresponding to the task of the right application window in the split screen mode interface layer are obtained from the interface layer information of each application window returned by the gesture layer management module. The display position and size of the interface layer corresponding to the task of the left application window are adjusted by the handle of the interface layer corresponding to the task of the left application window; the display position and size of the interface layer corresponding to the right application window are adjusted by the handle of the interface layer corresponding to the task of the right application window.

[0162] In one example, the window mode is split screen mode, and the mode information is split screen up and down. Then, the handle of the interface layer corresponding to the task of the upper application window and the handle of the interface layer corresponding to the task of the lower application window in the split screen mode interface layer are obtained from the interface layer information of each application window returned by the gesture layer management module. The display position and size of the interface layer corresponding to the task of the upper application window are adjusted by the handle of the interface layer corresponding to the task of the upper application window; the display position and size of the interface layer corresponding to the task of the lower application window are adjusted by the handle of the interface layer corresponding to the task of the lower application window.

[0163] In this way, since the gesture effects are generated based on the interface layer corresponding to the application window, the interface layer is updated in real time, and the gesture effects are also updated in real time. For applications with dynamically changing interfaces such as video applications, gesture effects are also dynamically updated during the movement of the application window, and the display effect is more flexible. Compared with the method of taking screenshots of the interface of the application window, the method of generating gesture effects based on the screenshot image can increase the rate of gesture effect generation and improve the response speed to user gestures because it does not require screenshot processing.

[0164] In the method provided in the embodiment of the present application, when it is detected that the application window is pressed and moved multiple times during the drag operation so that the moving distance is greater than the threshold, the handle of the interface layer corresponding to the task of the application window is obtained, so that the interface layer of the application window can be adjusted through the handle, such as adjusting the display position and display size of the interface layer. Even after the interface layer moves or changes the display size, the gesture effect of the application window will be updated in real time as the interface layer is updated.

[0165] During the subsequent movement of the drag operation, the display parameters of the interface layer can be modified through the handle of the interface layer corresponding to the task of the application window according to the position of the drag operation on the screen, so as to adjust the display effect of the gesture effect (interface layer) according to the position of the drag operation on the screen. For example, according to the detected position of the drag operation, the display size of the interface layer of the application window can be adjusted, the display position of the interface layer can be adjusted, the transparency of the interface layer can be adjusted, and the clarity of the interface layer can be adjusted.

[0166] In one implementation, the position of the received gesture operation (drag operation) on the screen can be determined based on the gesture information (gesture type, gesture detection position, etc.). When the user's drag operation acts on different screen hotspots on the screen, the gesture animation (interface layer) can be displayed as a corresponding display effect.

[0167] Still Figure 3Taking the scene example shown as an example, when a user presses and holds Bar 11 at the top of window 10 and drags window 10 , the gesture effect (interface layer) of window 10 moves along the dragging trajectory of the user.

[0168] For example, Figure 8 As shown, if the user's drag operation moves to hot zone 2, the active window (window 10) moves into hot zone 2, the active window (window 10) is proportionally reduced according to the distance the gesture moves downward, and is proportionally enlarged according to the distance the drag operation moves upward; the passive window (window 20) is reduced to a preset value (for example, 95% of the original window size).

[0169] For example, Fig. 9 As shown, if the user's drag operation moves to the hot zone 3, the active window (window 10) moves into the hot zone 3, the active window (window 10) is proportionally reduced according to the distance the drag operation moves downward, and is proportionally enlarged according to the distance the drag operation moves upward; the passive window (window 20) is reduced to a preset value (for example, 95% of the original window size).

[0170] For example, Fig.10 As shown, if the user's drag operation moves into the hot zone 5, the active window (window 10) moves into the hot zone 5, and the active window (window 10) is proportionally reduced according to the distance the drag operation moves downward, and is proportionally enlarged according to the distance the drag operation moves upward; the passive window (window 20) is reduced to a preset value (for example, 95% of the original window size) and moves to the left side of the screen.

[0171] For example, Fig.11As shown, if the user's drag operation moves to hot zone 4, the active window (window 10) moves to hot zone 4, and the active window (window 10) no longer continues to shrink, and is displayed in floating window mode; the passive window (window 20) is displayed in full screen mode. Among them, the gesture animations of the active window and the passive window are generated according to the wallpaper layer, that is to say, the gesture animations of the active window and the passive window are displayed as blurred images. Since the shape of the active window has changed greatly after the active window has been reduced and displayed in floating window mode, the actual dynamic effect picture generated by the split-screen mode interface layer will be severely deformed; after the passive window is enlarged and displayed in full screen mode, the shape of the passive window has changed greatly, and the actual dynamic effect picture generated by the split-screen mode interface layer will also be severely deformed; the viewing experience is poor. The gesture animations of the active window and the passive window are uniformly displayed as blurred images, which can enhance the user's viewing experience. In one implementation, the blurred image is a preset blurred image; in one implementation, the blurred image is an image obtained by blurring the last frame of an image played by the application window before the drag operation enters a preset hot zone (e.g., hot zone 4); in one implementation, the blurred image is an image that uses a preset image with a preset transparency to block the application window display interface.

[0172] For example, Fig.12 As shown, if the user's drag operation moves to the hot zone 6, the active window (window 10) moves to the hot zone 6, and the active window (window 10) no longer continues to shrink, and is displayed in split-screen mode; the passive window (window 20) shrinks to a preset value (such as 95% of the original window size) and moves to the left side of the screen. Among them, the gesture effects of the active window and the passive window are generated according to the wallpaper layer, that is, the gesture effects of the active window and the passive window are displayed as blurred images.

[0173] In some embodiments, during the switching of application windows, the audio of the application continues to play without interruption, and can be synchronized with the dynamic pictures of the gesture effects, so that the user's viewing experience is coherent and better.

[0174] It is understandable that the electronic device provided in the embodiment of the present application includes a hardware structure and / or software module corresponding to each function in order to realize the above functions. Those skilled in the art should easily realize that, in conjunction with the units and algorithm steps of each example described in the embodiment disclosed herein, the embodiment of the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the embodiment of the present application.

[0175] The embodiment of the present application can divide the functional modules of the above-mentioned electronic device according to the above-mentioned method example. For example, each functional module can be divided corresponding to each function, or two or more functions can be integrated into one processing module. The above-mentioned integrated module can be implemented in the form of hardware or in the form of software functional modules. It should be noted that the division of modules in the embodiment of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation.

[0176] In one example, see Fig.13 , which shows a possible structural diagram of the electronic device involved in the above embodiment. The electronic device 1300 includes: a processing unit 1310 , a storage unit 1320 and a display unit 1330 .

[0177] The processing unit 1310 is used to control and manage the actions of the electronic device 1300 .

[0178] The storage unit 1320 is used to store program codes and data of the electronic device 1300 .

[0179] The display unit 1330 is used to display the interface of the electronic device 1300 .

[0180] Of course, the unit modules in the above-mentioned electronic device 1300 include but are not limited to the above-mentioned processing unit 1310, storage unit 1320 and display unit 1330.

[0181] Optionally, the electronic device 1300 may further include an audio unit, a communication unit, etc. The audio unit is used to collect audio, play audio, etc. The communication unit is used to support the electronic device 1300 to communicate with other devices.

[0182] The processing unit 1310 may be a processor or a controller, for example, a central processing unit (CPU), a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof. The storage unit 1320 may be a memory. The display unit 1330 may be a display screen, etc. The audio unit may include a microphone, a speaker, etc. The communication unit may include a mobile communication unit and / or a wireless communication unit.

[0183] For example, the processing unit 1310 is a processor (such as Figure 4 The processor 110 shown in FIG. 1 ), the storage unit 1320 may be a memory (eg, Figure 4 The internal memory 121 shown in FIG. 1 ), the display unit 1330 may be a display screen (such as Figure 4 The audio unit may be an audio module (such as Figure 4 The communication unit may include a mobile communication unit (such as Figure 4 The mobile communication module 150 shown) and the wireless communication unit (such as Figure 4 The electronic device 1300 provided in the embodiment of the present application may be Figure 4 The electronic device 100 shown in FIG. The processor, memory, display screen, etc. mentioned above may be connected together, for example, via a bus.

[0184] The embodiment of the present application also provides a chip system, which includes at least one processor and at least one interface circuit. The processor and the interface circuit can be interconnected by lines. For example, the interface circuit can be used to receive signals from other devices (such as a memory of an electronic device). For another example, the interface circuit can be used to send signals to other devices (such as a processor). Exemplarily, the interface circuit can read instructions stored in the memory and send the instructions to the processor. When the instructions are executed by the processor, the electronic device can perform the various steps in the above embodiments. Of course, the chip system can also include other discrete devices, which are not specifically limited in the embodiment of the present application.

[0185] An embodiment of the present application also provides a computer-readable storage medium, which includes computer instructions. When the computer instructions are executed on the above-mentioned electronic device, the electronic device executes each function or step executed by the mobile phone in the above-mentioned method embodiment.

[0186] The embodiment of the present application also provides a computer program product. When the computer program product is run on a computer, the computer is enabled to execute each function or step executed by the mobile phone in the above method embodiment.

[0187] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0188] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0189] The units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0190] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0191] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium, including several instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code.

[0192] The above contents are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application shall be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A method for displaying dynamic effects, It is characterized in that The method comprises: The electronic device displays a first application window and a second application window in a split screen, wherein the first application window plays video content, the first application window is displayed in a first area on the screen, and the second application window is displayed in a second area on the screen; In response to a drag event on the first application window, the electronic device obtains interface layer information of the first application window, and controls the first application window to move following the drag event; wherein, during the movement of the first application window, the interface layer information of the first application window is used to control the first application window to continuously play the video content; In response to a lift event acting on the first application window falling within a third area on the screen of the electronic device, the first application window is displayed in the second area, and the second application window is displayed in the first area.

2. The method according to claim 1, It is characterized in that The method further comprises: The electronic device controls the first application window to adjust its size according to the position of the drag event through the interface layer information of the first application window.

3. The method according to claim 1, It is characterized in that The interface layer information of the first application window includes a handle of the interface layer corresponding to the task of the first application window.

4. The method according to claim 1, It is characterized in that The second region includes the third region.

5. The method according to any one of claims 1 to 4, It is characterized in that The method further comprises: In response to the drag event acting on the first application window falling within the fourth area of ​​the screen of the electronic device, the aspect ratio of the first application window changes and a blurred image is displayed.

6. The method according to claim 5, It is characterized in that The method further comprises: In response to the drag event acting on the first application window falling within the fourth area of ​​the screen of the electronic device, the aspect ratio of the second application window changes and a blurred image is displayed.

7. The method according to claim 6, It is characterized in that The blurred image is: A preset blurred image; or, The image is obtained by blurring the first image, where the first image is the last frame of video image played by the first application window before the drag event falls on the fourth area.

8. The method according to claim 5, It is characterized in that The method further comprises: In response to a lift event acting on the first application window falling within the fourth area, the first application window is displayed as a floating window and continues to play video content, and the second application window is displayed in full screen.

9. An electronic device, It is characterized in that include: one or more processors; Display screen; Memory; One or more computer programs are stored in the memory, and the one or more computer programs include instructions. When the instructions are executed by the electronic device, the electronic device executes the method as described in any one of claims 1 to 8.

10. A computer-readable storage medium, It is characterized in that The method comprises computer instructions; when the computer instructions are executed on an electronic device, the electronic device executes the method according to any one of claims 1 to 8.