Suspended ball processing method, electronic device and storage medium in multi-tasking scenarios

Abstract

The present application provides a method for processing a floating ball in a multi-tasking scenario. The method can be applied to electronic devices such as mobile phones and tablets. When the preset conditions are met, the electronic device can display a floating ball that matches the above-mentioned preset conditions. The electronic device can display multiple floating balls that meet the preset conditions to avoid the floating balls generated later from squeezing out the floating balls generated earlier, thereby affecting the user experience. At the same time, the electronic device can set personalized floating ball display rules according to the timeliness characteristics of different floating ball services. For multiple floating balls displayed at the same time, the electronic device can also set a combination display rule for the combined display of the floating balls to avoid the blocking of the foreground application by too many floating balls.

Description

Technical Field

[0001] The present application relates to the field of terminals, and in particular to a method and electronic device for processing a suspended ball in a multi-tasking scenario. Background Art

[0002] After exiting a page or application, mobile devices and other terminal electronic devices can display a floating ball, also known as a floating capsule, in the exit window. The floating ball can always be displayed on top of the window and will not be covered. This allows users to quickly and conveniently reopen the previously closed page or application through the floating ball. Summary of the Invention

[0003] The present application provides a method for processing a floating ball in a multi-tasking scenario. The method can be applied to terminal electronic devices such as mobile phones and tablet computers. By implementing this method, the above-mentioned electronic devices can display multiple floating balls. Furthermore, the electronic device can set personalized floating ball display rules based on the timeliness characteristics of different floating ball services. In this way, the electronic device can provide users with multiple types of information through multiple floating balls, while avoiding the obstruction of the foreground application by too many floating balls.

[0004] In a first aspect, the present application provides a multi-task interaction method, which is applied to an electronic device, and the method includes: detecting that the electronic device meets a first preset condition, displaying a first floating ball; wherein the first floating ball displays an identifier of a first application and first information; when the first floating ball is displayed on the interface of the electronic device, detecting that the electronic device meets a second preset condition, displaying a second floating ball on the interface of the electronic device at the same time as displaying the first floating ball; wherein the second floating ball displays an identifier of a second application and second information.

[0005] In implementing the method provided in the first aspect, when the conditions for displaying multiple floating balls are detected, the electronic device can simultaneously display multiple floating balls, wherein the floating balls display the logo and prompt information of the associated application, so that the user can quickly and conveniently obtain the prompt information and the application providing the above information.

[0006] In combination with the method provided in the first aspect, in some embodiments, the second suspended ball is displayed above the first suspended ball.

[0007] In this way, the electronic device can display the newly generated hover ball above the existing hover balls. In a scene where multiple hover balls are displayed, the user can determine the display time of each hover ball based on the display position of each hover ball, and then determine the priority of the prompt information in each hover ball, so as to reasonably arrange time and tasks.

[0008] In combination with the method provided in the first aspect, in some embodiments, the method also includes: determining that no user operation acting on the first floating ball is detected within a first period of time after the first floating ball is displayed, and displaying the first floating ball in a thumbnail state; the first floating ball in the thumbnail state includes the identifier of the first application, but does not include the first information.

[0009] By implementing the method provided in the above embodiment, after the electronic device displays an expanded floating ball (including an application icon and prompt information) for a period of time and no user operation on the floating ball, such as a click operation, is detected, the expanded floating ball can be adjusted to a thumbnail state (including the application icon) to reduce the display area of the floating ball and reduce the obstruction of the foreground application, thereby improving the user experience.

[0010] In combination with the method provided in the first aspect, in some embodiments, the method also includes: determining that no user operation acting on the second floating ball is detected within a second time period after the second floating ball is displayed, and displaying the second floating ball in a thumbnail state; the second floating ball in the thumbnail state includes an identifier of the second application, but does not include the second information.

[0011] By implementing the method provided in the above embodiment, in a scenario where multiple floating balls are displayed, the electronic device can simultaneously adjust multiple expanded floating balls to a thumbnail state, further reducing the display area of the floating balls and reducing the obstruction of the foreground application.

[0012] In combination with the method provided in the first aspect, in some embodiments, the first duration is equal to the second duration.

[0013] By implementing the methods provided in the above embodiments, electronic devices can set the duration of the expanded floating ball display based on the characteristics of the services corresponding to the floating ball, thereby improving the user experience. For example, the electronic device can set the expanded display time of the subway floating ball to 30 seconds and the expanded display time of the flight floating ball to 10 seconds.

[0014] In combination with the method provided in the first aspect, in some embodiments, displaying a second floating ball in a thumbnail state includes: determining that other floating balls in a thumbnail state are displayed on the interface of the electronic device, and aggregating the second floating ball in the thumbnail state and the other floating balls in the thumbnail state into a third floating ball; wherein the third floating ball displays the logo of the second application.

[0015] By implementing the method provided in the above embodiment, in a scenario where multiple floating balls are displayed, when multiple expanded floating balls are adjusted to a thumbnail state, the electronic device can also aggregate multiple thumbnailed floating balls into one, thereby further reducing the display area of the floating balls, reducing the obstruction of the foreground application, and improving the user experience.

[0016] The application icon portion of the aggregated floating ball (the third floating ball) can display the application icon from the most recently generated floating ball. For example, if the electronic device displays the second floating ball after the first floating ball, the second floating ball can be called the most recently generated floating ball. Therefore, the application icon portion of the third floating ball can display the application icon from the second floating ball, i.e., the logo of the second application. In this way, users can determine the application to which the most recently generated floating ball belongs based on the application icons in the aggregated floating ball, and then determine the priority of the prompt information in each floating ball, so as to arrange their time reasonably.

[0017] In combination with the method provided in the first aspect, in some embodiments, the third suspended ball includes indication information, where the indication information is used to indicate that the third suspended ball is an aggregated suspended ball including multiple suspended balls.

[0018] By implementing the method provided in the above embodiment, the user can determine through the application icon of the thumbnail floating ball whether the floating ball is a thumbnail of an expanded floating ball or an aggregation of multiple expanded floating balls, and then determine whether the thumbnail floating ball can correspond to multiple floating balls.

[0019] In combination with the method provided in the first aspect, in some embodiments, the method further includes: detecting a first user operation acting on the third floating ball; and displaying multiple floating balls in response to the first user operation.

[0020] By implementing the method provided in the above embodiment, when an electronic device detects a user operation on a combined floating ball, the electronic device can split the combined floating ball back into multiple floating balls before the aggregation and display these multiple floating balls. This allows the user to conveniently access the currently needed floating ball at any time and use it to obtain more information or complete necessary operations.

[0021] In combination with the method provided in the first aspect, in some embodiments, the first information is a check-in reminder for a flight booked by the user, and the first preset condition includes: a notification of the flight is obtained, and the current time of the electronic device is within the check-in time range of the flight; or, the first information is a boarding reminder for a flight booked by the user, and the first preset condition includes: a notification of the flight is obtained, the current time of the electronic device is within the waiting time range of the flight, and the current location of the electronic device is within the geographical range of the flight's departure airport; or, the first information is a subway boarding reminder, and the first preset condition includes: the current location of the electronic device is within the geographical range of the subway station; or, the first information is a translation reminder, and the first preset condition includes: a copy operation is detected, and the language used in the copied content is not a commonly used language of the system.

[0022] Implement the method provided in the above embodiment: when a flight notification is obtained and the current time of the electronic device is within the check-in time range of the flight, the electronic device can display a flight floating ball. Alternatively, when a flight notification is obtained, the current time of the electronic device is within the waiting time range of the flight, and the current location of the electronic device is within the geographical range of the departure airport of the flight, the electronic device can display a flight floating ball. The flight floating ball can display relevant information about the flight booked by the user, such as check-in prompts, boarding prompts, etc. When the current location of the electronic device is within the geographical range of the subway station, the electronic device can display a subway floating ball. The subway floating ball can display subway boarding prompts, such as subway boarding codes, health codes, etc. When a copy operation is detected and the language used in the copied content is not a commonly used language of the system, the electronic device can display a translation floating ball.

[0023] In combination with the method provided in the first aspect, in some embodiments, the method further includes: determining that no user operation acting on the first floating ball is detected within a third time period after the first floating ball is displayed, and terminating the display of the first floating ball.

[0024] By implementing the method provided in the above embodiment, in a scenario where the floating ball is a transient floating ball, such as a navigation floating ball or a dialing floating ball, after displaying the floating ball for a period of time and no user operation on the floating ball is detected, the electronic device can confirm that the user does not need the shortcut provided by the above floating ball, and then the electronic device can terminate the display of the floating ball to reduce the obstruction of the foreground application and avoid interference with the user.

[0025] In combination with the method provided in the first aspect, in some embodiments, determining that no user operation acting on the first floating ball is detected within a third time period after the first floating ball is displayed, and terminating the display of the first floating ball, includes: determining that no user operation acting on the first floating ball is detected within a fourth time period after the first floating ball is displayed, and displaying the first floating ball in a thumbnail state; the first floating ball in the thumbnail state includes an identifier of the first application but does not include the first information; the first floating ball in the thumbnail state also includes a countdown identifier, which is used to indicate the remaining display time of the first floating ball in the thumbnail state; the third time period is equal to the sum of the fourth time period and the countdown time indicated by the countdown identifier; and when the countdown identifier indicates the end of the timing, terminating the display of the first floating ball.

[0026] When implementing the method provided in the above embodiment, in a scenario where the floating ball is a transient floating ball, such as a navigation floating ball or a dialing floating ball, after displaying the floating ball for a period of time and no user operation is detected on the floating ball, the electronic device may adjust the expanded floating ball to a thumbnail state and display a countdown icon on the thumbnail state to prompt the user that the floating ball is about to disappear. If the electronic device still does not detect the user's operation on the floating ball when the countdown icon indicates the end of the countdown, the electronic device may confirm that the user does not need the shortcut provided by the floating ball, and then the electronic device may stop displaying the floating ball to reduce obstruction of the foreground application and avoid interference with the user.

[0027] In combination with the method provided in the first aspect, in some embodiments, the first information is a navigation prompt, and the first preset condition includes: a copy operation is detected, and the copied content indicates a first location on the map; the first information is a dialing prompt, and the first preset condition includes: a copy operation is detected, and the copied content includes a first telephone number.

[0028] Implementing the method provided in the above embodiment: When a copy operation is detected and the copied content indicates a specific location on a map, the electronic device may display a navigation hover ball. This navigation hover ball can provide users with quick itinerary planning services. When a copy operation is detected and the copied content indicates a phone number, the electronic device may display a dialing hover ball. This dialing hover ball can provide users with quick dialing services, saving user operations and improving the user experience.

[0029] In combination with the method provided in the first aspect, in some embodiments, the method also includes: detecting a second user operation acting on the first floating ball; in response to the second user operation, displaying the first page, the first page displays third information, the third information includes the first information, or the third information is associated with the first information.

[0030] By implementing the method provided in the above embodiment, when a user operation acting on the floating ball is detected, the electronic device can run an application associated with the floating ball, or display a page of more information associated with the floating ball, including the prompt information in the floating ball, so that the user can easily and quickly obtain more relevant information.

[0031] In combination with the method provided in the first aspect, in some embodiments, the first page further includes a second floating ball; or further includes a second floating ball in a thumbnail state, wherein the thumbnail state of the second floating ball includes an identifier of the second application but does not include the second information.

[0032] By implementing the method provided in the above embodiment, after displaying the page associated with the first floating ball, the electronic device may also display the remaining floating balls, such as the second floating ball, on the same page. In this way, the user can directly click on the second floating ball on the basis of the above page to obtain more information provided by the second floating ball.

[0033] In combination with the method provided in the first aspect, in some embodiments, the first page displays a graphic code, and the graphic code and the second floating ball do not overlap; the graphic code includes a QR code and a bar code.

[0034] When implementing the method provided in the above embodiment, if the page displayed by the floating ball includes a graphic code, for example, the page displayed by the subway floating ball includes a subway boarding code, then the electronic device can display the remaining floating balls that need to be displayed outside the area occupied by the subway boarding code, so as to avoid blocking the above subway boarding code and hindering the user from using the subway boarding code, thereby improving the user experience.

[0035] In combination with the method provided in the first aspect, in some embodiments, a fourth floating ball and a fifth floating ball are also displayed on the interface of the electronic device, and the fourth floating ball covers the fifth floating ball. The method also includes: detecting a third user operation acting on the interface of the electronic device; in response to the third user operation, displaying the fourth floating ball and the fifth floating ball, and the fifth floating ball is not covered by the fourth floating ball.

[0036] By implementing the method provided in the above embodiment, when an electronic device displays multiple floating balls, it can collapse the floating balls that exceed the displayed number. Then, the user can control the electronic device to display the collapsed floating balls by swiping up / down, and then access the quick service provided by the floating balls.

[0037] In combination with the method provided in the first aspect, in some embodiments, the method also includes: detecting a fourth user operation acting on the first floating ball or the second floating ball; in response to the fourth user operation, displaying the first floating ball and the second floating ball at a first position on the interface of the electronic device, wherein the first position is the position where the fourth user operation is terminated.

[0038] By implementing the method provided in the above embodiment, the electronic device can recognize the user's operation of moving the floating ball and then move one or more floating balls displayed on the screen to the position specified by the user. In this way, the user can arbitrarily adjust the display position of the floating ball to reduce the negative user experience caused by the floating ball blocking the foreground application.

[0039] In a second aspect, the present application provides an electronic device comprising one or more processors and one or more memories; wherein the one or more memories are coupled to the one or more processors, and the one or more memories are used to store computer program code, and the computer program code comprises computer instructions. When the one or more processors execute the computer instructions, the electronic device executes the method described in the first aspect and any possible implementation of the first aspect.

[0040] In a third aspect, the present application provides a computer-readable storage medium comprising instructions, which, when executed on an electronic device, enables the electronic device to execute the method described in the first aspect and any possible implementation of the first aspect.

[0041] In a fourth aspect, the present application provides a computer program product comprising instructions, which, when executed on an electronic device, enables the electronic device to execute the method described in the first aspect and any possible implementation of the first aspect.

[0042] It is understandable that the electronic device provided in the second aspect, the computer-readable storage medium provided in the third aspect, and the computer program product provided in the fourth aspect are all used to perform the methods provided in this application. Therefore, the beneficial effects that can be achieved can be referenced to the beneficial effects of the corresponding methods and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] Figure 1A-1C A user interface for displaying a floating ball on a set of electronic devices provided in an embodiment of the present application;

[0044] Figure 2A-2B The embodiment of the present application provides a user interface for a set of electronic devices that changes a floating ball in an expanded state to a reduced state;

[0045] Figure 2C-2E The embodiment of the present application provides a user interface for a group of electronic devices that aggregate multiple floating balls into one floating ball;

[0046] Figure 3A Schematic diagram of different types of suspended balls provided in the embodiments of the present application;

[0047] Figure 3B is a schematic diagram of a transient suspended ball provided in an embodiment of the present application;

[0048] Figure 4A-Figure 4N A user interface for displaying a floating ball on a set of electronic devices provided in an embodiment of the present application;

[0049] Figures 5A-5K A user interface for displaying a floating ball on a set of electronic devices provided in an embodiment of the present application;

[0050] Figures 6A-6O A user interface for displaying a floating ball on a set of electronic devices provided in an embodiment of the present application;

[0051] Figure 7 This is a software structure diagram of the method for handling a suspended ball in a multi-tasking scenario provided by an embodiment of the present application;

[0052] Figure 8 This is a software structure diagram of the notification application provided in an embodiment of the present application;

[0053] Figure 9 This is a software structure diagram of another notification application provided in an embodiment of the present application;

[0054] Figure 10 This is a flow chart of a method for handling a suspended ball in a multi-tasking scenario provided by an embodiment of the present application;

[0055] Figure 11 This is a schematic diagram of the hardware structure of the electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0056] The terms used in the following embodiments of the present application are only for the purpose of describing specific embodiments and are not intended to limit the present application.

[0057] In one solution provided by an embodiment of the present application, a mobile phone or other terminal electronic device can display a floating ball, or floating capsule, in the window after exiting. The floating ball can always be displayed at the top layer of the window (the topmost layer of the display layer) and will not be covered. In this way, users can quickly and conveniently open previously closed pages or applications by clicking the floating ball anytime, anywhere.

[0058] first, Figure 1A The user interface of the first electronic device displaying the floating ball is exemplarily shown. The above-mentioned mobile phone can be called the first electronic device.

[0059] like Figure 1A As shown, the user interface may represent the user interface of the first electronic device playing a video. At this time, the user can browse the video. Above the window layer of the video playing, the first electronic device may display a floating ball that prompts the user of the flight information of the flight booked, which is recorded as a flight floating ball, for example Figure 1A The flight information of the user's booked flight may come from an application that provides flight booking services for the user, which is referred to as a flight application. Therefore, the flight floating ball may also be referred to as the floating ball corresponding to the flight application.

[0060] A floating ball may include an application icon and prompt information. The application icon may indicate the application associated with the floating ball. Generally, the information displayed in the floating ball comes from the above-mentioned associated application. At the same time, the floating ball can also provide users with a service to quickly open the above-mentioned associated application. For example, in response to the user clicking the floating ball, the electronic device can directly open the application interface and display the interface associated with the prompt information. The specific content displayed in the prompt information is important information that the user is concerned about. In this way, users can obtain important information more conveniently without entering the above-mentioned associated application.

[0061] For example, in Figure 1A In the example, the application icon may be an application icon for a flight application installed on the first electronic device. The flight hover ball is associated with the flight application. Thus, the user can use the application icon to understand the application that the first electronic device relies on to provide the hover ball notification service. Thus, after seeing the application icon, the user can also open the application installed on the first electronic device to obtain more services provided by the application.

[0062] Specifically, the flight floating ball is associated with the boarding pass page of the booked flight provided by the flight application. This page can display the flight information of the booked flight, such as departure time, arrival time, boarding gate, seat number, etc. Figure 1B The prompt message in the flight suspension ball: "52K boarding gate" can be turned off. Figure 1B In the case of the page shown, the user is reminded of the boarding gate of the booked flight in real time; "View Boarding Pass" can remind the user to click the above floating ball to obtain the boarding pass page, so as to obtain more flight information provided by the boarding pass page.

[0063] In some cases, the prompt information displayed in the floating ball is sufficient to meet the user's needs. In some cases, the prompt information displayed in the floating ball may not meet the user's needs. In this case, the user can click on the floating ball to obtain more information including the prompt information.

[0064] For example, the flight hoverball above shows "Gate 52K" and allows users to find the boarding gate for their booked flight. In some cases, knowing the gate information allows users to confirm their departure gate. In these cases, the prompt displayed in the hoverball is sufficient to meet the user's needs.

[0065] However, in some cases, the user may also need to know information such as seat number. In this case, the prompt information displayed in the above floating ball is not enough to meet the user's needs. In this case, the user can click on the above floating ball to obtain more flight information that is not displayed in the prompt information. Figure 1BAs shown, the first electronic device can detect the user operation on the flight floating ball, and in response to the above user operation, the first electronic device can display Figure 1C The user interface shown shows a boarding pass. In this way, the user can quickly obtain the flight information of the scheduled flight through the flight floating ball.

[0066] However, in a multitasking scenario, after a new floating ball is generated, the previously generated floating ball will be replaced by the new floating ball. For example, after displaying the above-mentioned flight floating ball, the first electronic device may detect a translation scene. In response to detecting the above-mentioned translation scene, the first electronic device may display a translation floating ball to provide users with a quick translation service. At this time, in a scenario where the floating ball does not support multitasking, after the above-mentioned translation floating ball is generated, the above-mentioned flight floating ball will be occupied by the above-mentioned translation floating ball, that is, the above-mentioned flight floating ball will be terminated. As a result, the user will not be able to enter the flight application and obtain flight information through the shortcut provided by the above-mentioned flight floating ball.

[0067] Therefore, an embodiment of the present application provides a method for handling a suspended ball in a multi-tasking scenario.

[0068] By implementing this method, the first electronic device can display multiple floating balls in a multitasking scenario. This allows the user to simultaneously access prompts from multiple floating balls. Furthermore, the first electronic device can adjust the display status of the multiple floating balls based on different scenarios to prevent excessive floating balls from obstructing the screen and impacting the user experience.

[0069] Specifically, the first electronic device may be provided with multiple floating balls, and conditions (display conditions) that must be met for each floating ball to be displayed. The first electronic device may then acquire data indicating the current operating status (status data) in real time and detect whether the status data meets the display conditions for one or more of the multiple floating balls. When the display conditions for one or more floating balls are met, the first electronic device may display the corresponding one or more floating balls.

[0070] For example, when the first electronic device's current status data meets the display conditions for a flight hoverball, the first electronic device may generate and display the flight hoverball. When the first electronic device's current status data meets the display conditions for a translation hoverball, the first electronic device may generate and display the translation hoverball. In other words, in one possible implementation, both a flight hoverball and a translation hoverball are displayed simultaneously on the first electronic device's display interface. The first electronic device may manage these two hoverballs separately to prevent the later-generated translation hoverball from crowding out the earlier-generated flight hoverball.

[0071] Furthermore, the first electronic device can set the floating ball display rules according to the timeliness characteristics of different floating ball services. For multiple floating balls displayed at the same time, the first electronic device can also set the combined display rules of the floating balls to avoid the obstruction of the foreground application interface by too many floating balls. The foreground application refers to the application that is visible and running on the desktop. Figure 1A The first electronic device may be installed with a video player, and the video player is calling the display screen to play a video. The video player may be called a foreground application running on the first electronic device.

[0072] For example, after displaying a floating ball, the first electronic device may detect whether there is any user operation on the floating ball within a preset time. If no user operation on the floating ball is detected within the preset time, the first electronic device may hide the floating ball to reduce the display area of the floating ball and reduce the obstruction of the foreground application by the floating ball. The preset time period may be, for example, 5 seconds. This embodiment of the present application is not limited to this.

[0073] When there are multiple hidden floating balls on the screen, the first electronic device can aggregate the multiple hidden floating balls and display an aggregated floating ball, thereby further reducing the display area of the floating ball and reducing the obstruction of the foreground application interface by the floating ball.

[0074] Specifically, Figure 2A-2B The user interface of the first electronic device in which the floating ball is hidden is exemplarily shown.

[0075] refer to Figure 2A The user interface shown includes window 211 and floating ball 212. Window 211 can display the home page of the first electronic device or a user interface provided by an application. The above-mentioned application refers to an application installed on the first electronic device other than the application associated with floating ball 212. At this time, the content displayed in window 211 may indicate that the first electronic device is executing a video playback application.

[0076] When it is detected that the current status data of the first electronic device meets the display conditions of the flight floating ball, the first electronic device can generate and display the flight floating ball. The floating ball 212 can represent the above-mentioned flight floating ball. The above-mentioned display conditions are, for example: 1. The first electronic device is currently located within the geographical range of the departure airport of the user's booked flight; 2. The current system time of the first electronic device is within the waiting time range of the user's booked flight. The above-mentioned waiting specifically refers to the process of the user completing security check and waiting at the boarding gate for boarding. The above-mentioned display conditions are extracted based on the characteristics of flight services.

[0077] The flight hover ball can be associated with a flight application on the first electronic device. The application icon in the hover ball 212 can indicate the flight application associated with the flight hover ball. The prompt information in the hover ball 212 can help the user quickly obtain important flight information in the current scenario.

[0078] The current scene may be a scene where the user is about to board a plane. In this case, the user can quickly obtain the boarding gate information for the upcoming boarding process through the floating ball 212, that is, they can obtain flight information without having to access the flight application. Accessing the flight application means that the first electronic device runs the flight application and displays the user interface provided by the flight application.

[0079] at this time, Figure 2A The display state of the floating ball 212 displaying the application icon and prompt information can be called the expanded state of the floating ball. In this case, the display area occupied by the floating ball 212 is larger, which may reduce the user experience of using other applications. In particular, when multiple floating balls in the expanded state are displayed, these multiple floating balls in the expanded state occupy a larger display area in the entire display window, and the foreground application interface (the application that is using window 211 to play the video) is more seriously blocked, which greatly affects the user experience.

[0080] Therefore, after displaying the floating ball 212, the first electronic device detects whether there is any user operation on the floating ball 212 within 5 seconds after displaying the floating ball 212. The 5 seconds is an exemplary preset time.

[0081] If the first electronic device does not detect a user operation on the unfolded floating ball 212 within the preset time, the first electronic device may push the floating ball 212 to the right side of the screen and only display the application icon portion of the floating ball 212. Figure 2B At this time, Figure 2B The display area occupied by the middle floating ball 212 is significantly reduced, thereby reducing the obstruction of the application currently running in the foreground and improving the user experience. Figure 2B The display state of the middle floating ball 212 may be referred to as a thumbnail state of the floating ball.

[0082] Figure 2A to Figure 2B The process in which the first electronic device changes the floating ball from the expanded state to the contracted state to reduce the display area of the floating ball can be referred to as the first electronic device hiding the floating ball.

[0083] Figure 2C-2E The user interface of the first electronic device aggregating multiple thumbnail floating balls is exemplarily shown.

[0084] First, in Figure 2CIn the user interface shown, the first electronic device can display multiple expanded floating balls, such as a flight floating ball 212, a subway floating ball 213, and a travel floating ball 214. The flight floating ball 212 can be referred to in the above description and will not be described here. The subway floating ball 213 can be used to display the subway boarding code. The travel floating ball 214 can be used to display information such as the arrival time of the user's scheduled online car-hailing service or the time to arrive at the designated destination. The different types of floating balls will be introduced in detail later.

[0085] For any of the aforementioned floating balls, if the first electronic device detects no user operation on the floating ball within 5 seconds (preset time) after displaying the floating ball, the first electronic device may change the floating ball from its expanded state to its reduced state. If multiple floating balls need to be reduced, the first electronic device may aggregate them into a single, aggregated floating ball during the process.

[0086] refer to Figure 2D After displaying the floating ball for 5 seconds, the flight floating ball 212, the subway floating ball 213, and the travel floating ball 214 can all enter a thumbnail state. At this time, if multiple thumbnail floating balls are detected, the first electronic device can aggregate the flight floating ball 212, the subway floating ball 213, and the travel floating ball 214 that have entered a thumbnail state into one, and then display this one floating ball. Figure 2E Middle suspension ball 215. This suspension ball can be called a polymer suspension ball.

[0087] The first electronic device is not limited to a mobile phone. The first electronic device may also be a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a cellular phone, a personal digital assistant (PDA), an augmented reality (AR) device, a virtual reality (VR) device, an artificial intelligence (AI) device, a wearable device, an in-vehicle device, a smart home device and / or a smart city device. The embodiments of the present application do not impose any special restrictions on the specific type of the electronic device.

[0088] under, Figure 3A The example shows the floating balls corresponding to different business scenarios that may be displayed on the first electronic device.

[0089] like Figure 3A As shown, the suspension ball 301 (the aforementioned Figure 2CThe floating ball 212 in the image may represent a flight floating ball that provides flight service notifications. The flight floating ball may be associated with a flight application installed on the first electronic device that provides services such as flight inquiries and flight reservations. The information displayed in the flight floating ball may be derived from the flight application. When a user action on the floating ball 301 is detected, the first electronic device may display all flight information for the booked flight. This will be described in detail in subsequent embodiments and will not be elaborated on here.

[0090] Suspended ball 302 (i.e. Figure 2C The floating ball 213 in the image may represent a subway floating ball that provides a quick display of the subway boarding code service. The subway floating ball may be associated with a subway application installed on the first electronic device that provides services such as subway query and subway boarding code display. The information displayed in the subway floating ball may be derived from the aforementioned subway application. When a user operation is detected on the floating ball 302, the first electronic device may display the subway boarding code, thereby providing the user with a quick scan-to-board service.

[0091] Floating ball 303 may represent a translation floating ball offering a translation service. The translation floating ball can translate the copied content recorded in the clipboard of the first electronic device into text expressed in the first electronic device's commonly used system language. Upon detecting a user action on floating ball 303, the first electronic device may display a translation page. The translation page may display the copied content and the text of the copied content expressed in the commonly used system language.

[0092] The floating ball 304 may represent a navigation floating ball that provides map navigation services. The first electronic device may identify the location copied in the clipboard and then generate a navigation floating ball. The navigation floating ball may be associated with an application installed on the first electronic device that provides map display and navigation services, and use the above application to determine the route from the current location of the first electronic device to the above copied location. When a user operation acting on the floating ball 304 is detected, the first electronic device may display a navigation page. The above navigation page may display the route from the current location of the first electronic device to the above location. Thus, the user can obtain quick navigation services through the above navigation page.

[0093] Floating ball 305 may represent a call floating ball that provides a quick dialing service. The first electronic device may identify the phone number copied from the clipboard and then generate a call floating ball. The call floating ball may be associated with a call application installed on the first electronic device. When a user action on floating ball 305 is detected, the first electronic device may call the copied phone number, thereby providing the user with a quick dialing service.

[0094] Floating ball 306 may represent a split-screen floating ball providing a split-screen service. This split-screen refers to running two applications simultaneously on a single mobile phone screen and displaying the window views provided by both applications. In some embodiments, the first electronic device also supports adjusting the relative window sizes of the two applications. This is not limited to two applications; it can also include three or even more applications. This embodiment of the present application does not impose any restrictions on this.

[0095] The first electronic device can detect a user operation of frequently switching between two or more applications. For example, an operation of frequently changing the foreground application by switching from application A to application B and then to application A. At this time, the first electronic device can generate a split-screen floating ball, that is, floating ball 306. When a user operation acting on the floating ball 306 is detected, the first electronic device can divide the mobile phone screen into multiple windows. One window displays the view provided by one application. At this time, the split-screen floating ball can prompt the user to display application A and application B in split screen. Application A and application B are both applications that support split-screen display.

[0096] Floating ball 307 may represent a delivery tracking service. The delivery tracking service may be associated with a delivery tracking application installed on the first electronic device. The delivery tracking service may display the user's delivery code. The delivery information displayed in the delivery tracking service may originate from the delivery tracking application. Upon detecting a user action on floating ball 307, the first electronic device may display more information about the delivery order, such as the item type, item image, sender, and shipping address.

[0097] Floating ball 308 may represent a takeout order notification. The takeout floating ball may be associated with a takeout app installed on the first electronic device that provides takeout services. The takeout floating ball may display the remaining delivery time of the user's ordered takeout. The delivery time information displayed in the takeout floating ball may be derived from the takeout app. When a user action on floating ball 308 is detected, the first electronic device may display more information about the takeout order, such as the item list, order number, merchant contact information, delivery address, and so on.

[0098] Suspended ball 309 (i.e. the aforementioned Figure 2C The floating ball 214 in the travel image may represent a travel floating ball that provides notifications of online car-hailing. The travel floating ball may be associated with a travel application installed on the first electronic device that provides a taxi service. The travel floating ball may display information such as the arrival time of the user's scheduled online car-hailing or the time to arrive at the designated destination. The arrival time of the online car-hailing displayed in the travel floating ball may be derived from the above-mentioned travel application. When a user operation acting on the floating ball 309 is detected, the first electronic device may display more information about the above-mentioned travel order, such as the order number, vehicle location, departure place, destination, driver contact information, license plate, etc.

[0099] According to the timeliness characteristics of the services provided by different floating balls, the first electronic device can set different termination mechanisms (disappearance mechanisms) for different floating balls to achieve both the quick service provided by the floating ball and the avoidance of redundant display and the impact on the user's browsing experience.

[0100] In some embodiments, after displaying an expanded floating ball, if no user operation on the expanded floating ball is detected within a preset time, the first electronic device may change the expanded floating ball to a thumbnail state, i.e., hide the expanded floating ball. Then, when the service in the application associated with the floating ball is completed, the first electronic device may stop displaying the floating ball. After termination, the first electronic device no longer displays the floating ball.

[0101] In other embodiments, after displaying the expanded floating ball, when no user operation acting on the expanded floating ball is detected within a preset time, the first electronic device may directly terminate the floating ball.

[0102] by Figure 3A For example, when the first electronic device detects that the user has completed security and entered the terminal, it can display the expanded floating ball 301. After displaying the expanded floating ball 301 for a period of time, for example, 5 seconds, and if the first electronic device does not detect any user operation on the floating ball 301 during this period, the first electronic device can adjust the expanded floating ball 301 to a thumbnail state. When the first electronic device detects that the user has boarded the plane, it can stop displaying the floating ball 301.

[0103] by Figure 3A For example, when the first electronic device detects a user operation to copy a location, it can display the expanded floating ball 304. After the expanded floating ball 304 is displayed for a period of time, and the first electronic device does not detect any user operation on the floating ball 304 during the period, the first electronic device can adjust the expanded floating ball 304 to a thumbnail state. After the thumbnail state of the floating ball 304 is displayed for a period of time, and the first electronic device does not detect any user operation on the floating ball 304 during the period, the first electronic device can stop displaying the floating ball 304.

[0104] The time for different types of suspended balls to enter the contracted state or terminate from the expanded state can be the same or different, and the time from the contracted state to termination can be the same or different, and the embodiment of the present application does not limit this.

[0105] The aforementioned floating ball that terminates due to the absence of a user operation detected on the floating ball (navigation floating ball) may be referred to as a transient floating ball. The first electronic device may use a countdown ring to remind the user which floating balls are transient, thereby prompting the user to promptly access the quick services provided by the transient floating balls, so as to avoid being unable to re-access the transient floating ball after the transient floating ball terminates, thereby preventing the user from being unable to access the quick services provided by the transient floating ball.

[0106] Figure 3B The figure exemplarily shows a transient floating ball that may be displayed on the first electronic device.

[0107] During the process of displaying the expanded floating ball, if no user operation acting on the floating ball is detected, the first electronic device may change the expanded floating ball to a reduced state. Figure 3B As shown, the navigation floating ball can change from the state shown by the floating ball 304 to the state shown by the floating ball 314.

[0108] When displaying the thumbnail navigation floating ball, if no user operation on the navigation floating ball (floating ball 304) is detected within a preset time, the first electronic device will stop displaying the navigation floating ball. In other words, the navigation floating ball is a transient floating ball. When displaying the thumbnail navigation floating ball (floating ball 314), the first electronic device may display a countdown ring on the application icon in the navigation floating ball, such as Figure 3B The ring 31 in the suspended ball 314.

[0109] When the thumbnail state of the floating ball 314 is initially displayed, the countdown ring is a complete ring. As time goes on, the ring can gradually decrease counterclockwise from the 12 o'clock position. Figure 3B When the countdown ring disappears, the countdown ends and the first electronic device can stop displaying the floating ball 314. The duration of the countdown ring is the duration for which the first electronic device displays the thumbnail floating ball 314.

[0110] Similarly, when the dial floating ball is a transient floating ball, the dial floating ball (floating ball 305) that enters the thumbnail state may be as shown in floating ball 315, and then change to as shown in floating ball 325; when the split-screen floating ball is a transient floating ball, the split-screen floating ball (floating ball 306) that enters the thumbnail state may be as shown in floating ball 316, and then change to as shown in floating ball 326. Figure 3B The first electronic device can also Figure 3A Other types of suspension balls are set as transient suspension balls, which are not limited in this embodiment of the present application.

[0111] under, Figures 4A-4H 、 Figures 5A-5I 、 Figures 6A-6I The user interface of a first electronic device implementing the floating ball processing method in a multi-tasking scenario provided by an embodiment of the present application is shown.

[0112] under. Figures 4A-4H The example shows a user interface of a group of first electronic devices displaying multiple floating balls in a multitasking scenario.

[0113] first, Figure 4A The user scenario of a user using a video player application to watch a video is shown. At this time, the application (video player) providing the video playback service can be referred to as the application currently running in the foreground. The view or control displayed in window 411 is provided by the video player.

[0114] The first electronic device can obtain the current location of the first electronic device in real time, which is recorded as the current location. The embodiment of the present application does not limit the specific method for the first electronic device to obtain the current location. For example, the first electronic device can obtain the current location using the global positioning system (GPS), the global navigation satellite system (GLONASS) or the Beidou navigation satellite system (BDS). In addition, the first electronic device can also obtain the current location using a positioning method based on a location fingerprint of a base station signal and / or a high-fidelity wireless communication (wireless fidelity, Wi-Fi) signal.

[0115] After obtaining the current location, the first electronic device may confirm whether the current location is within the geographical range of the subway station and / or the geographical range of the airport. If the current location of the first electronic device is within the geographical range of the subway station, it may indicate that the user is currently in the subway station. Similarly, if the current location of the first electronic device is within the geographical range of the airport, it may indicate that the user is currently in the airport. The geographical range of the subway station and the geographical range of the airport can be determined using the aforementioned positioning service. This embodiment of the present application will not be further described.

[0116] When the current location of the first electronic device is within the geographical range of the subway station, the first electronic device may display a subway floating ball in the window 411, such as Figure 4B The suspended ball 412 is shown.

[0117] At the same time, if the current location is also within the geographical range of the airport, the first electronic device may also display a flight suspension ball in the window 411, such as Figure 4C The suspended ball 413 is shown.

[0118] Optionally, the first electronic device may display the later generated floating ball above the earlier generated floating ball. For example, if the first electronic device first determines that the current location is within the geographical scope of the subway station, the first electronic device may first generate a subway floating ball (floating ball 412). Then, the first electronic device may generate a flight floating ball (floating ball 413) based on the current location being within the geographical scope of the airport. At this time, the above-mentioned subway floating ball is the earlier generated floating ball, and the above-mentioned flight floating ball is the later generated floating ball. In the process of displaying the flight floating ball, the first electronic device may move the subway floating ball downward, and then display the flight floating ball at the position where the subway floating ball was originally displayed.

[0119] refer to Figure 4B and Figure 4C After determining to display the subway floating ball, the first electronic device may display the subway floating ball at the position of 1 / 4 from the top to the bottom of the screen. After determining to display the flight floating ball, the first electronic device may move the subway floating ball to the bottom of the screen and display the flight floating ball at the position where the subway floating ball was originally displayed (the position of 1 / 4 from the top to the bottom of the screen). The above-mentioned initial display position, that is, the position of 1 / 4 from the top to the bottom of the screen, is preset. The first electronic device may also set other initial display positions. The embodiments of the present application are not limited to this.

[0120] At this point, both the subway hoverball (hoverball 412) and the flight hoverball (hoverball 413) are in the expanded state. In the expanded state, the first electronic device can detect user actions on the hoverball, such as a click. In response to these user actions, the first electronic device can display more information related to the content currently displayed by the hoverball.

[0121] like Figure 4D As shown, the first electronic device can detect the user operation of clicking the floating ball 413. In response to the above user operation, the first electronic device can display Figure 4E The user interface shown. Figure 4E The user interface of the first electronic device displaying a boarding pass is exemplarily shown.

[0122] like Figure 4E As shown, the interface can display flight information such as the flight number (SF1314), departure point (Shenzhen Bao'an Airport T3), destination (Beijing Daxing Airport T3), take-off time (9:00), landing time (13:20), check-in counter (G07), boarding gate (52K), seat number (S-18D), etc. In this way, by clicking the flight floating ball, users can quickly and conveniently obtain detailed flight information of the flight they have booked.

[0123] Optional, reference Figure 4FThe first electronic device may also display a subway suspended ball (suspended ball 412) when displaying the boarding pass. In this way, the user can directly obtain the subway boarding QR code through the suspended ball 412.

[0124] Figure 4E (or Figure 4F ) The user interface shown in FIG. 4 further includes a control 421. When a user operation acting on the control 421 is detected, the first electronic device may display Figure 4D Alternatively, the first electronic device may display other interfaces provided by the flight application associated with the flight floating ball, such as a flight ticket query interface.

[0125] like Figure 4G As shown, the first electronic device can detect the user operation of clicking the floating ball 412. In response to the above user operation, the first electronic device can display Figure 4H The user interface shown in Figure 4H As shown, the interface may display a QR code 422. The QR code may be a subway QR code. Figure 4H After the user interface shown, the user can use the QR code 422 to quickly scan the code to enter the station (subway station), thereby providing convenience for the user to travel by subway. The QR code can also be a bus boarding code, etc., which is not limited in this embodiment of the application.

[0126] In some embodiments, the floating ball can also be a floating ball for a payment application. Upon detecting a user click on the floating ball, the first electronic device can display a barcode for payment. This is not limited to QR codes and barcodes; the first electronic device can also display other graphical codes to accommodate other business scenarios.

[0127] Optional, reference Figure 4I , the first electronic device may also display a flight suspension ball (suspension ball 413) when displaying the QR code. In this way, the user can directly obtain the boarding pass through the suspension ball 413. Preferably, when detecting the display of the QR code, the first electronic device may display other suspension balls on the screen, such as the suspension ball 413, and move it outside the area where the QR code is displayed, referring to Figure 4J , to avoid blocking the QR code and hindering QR code recognition.

[0128] Figure 4H (or Figure 4I 、 Figure 4J ) The user interface shown in FIG. 4 also includes a control 423. When a user operation acting on the control 423 is detected, the first electronic device may display Figure 4C Alternatively, the first electronic device may display other user interfaces provided by a subway application associated with the subway hoverball.

[0129] During the process of displaying the expanded floating ball, if no user operation acting on the expanded floating ball is detected within a preset time, the first electronic device can hide the expanded floating ball, that is, adjust the expanded floating ball to a thumbnail floating ball, so as to reduce the display area, avoid blocking the foreground application, and thereby improve the user experience.

[0130] refer to Figure 4C After the floating ball 412 is displayed, the first electronic device can monitor whether there is a user operation of clicking the floating ball 412 within a preset time. Figure 2A and Figure 2B In the introduction of the embodiment, the preset time can be 5 seconds. Optionally, the preset time corresponding to different floating balls can be the same or different. The embodiment of the present application does not limit the specific length of the preset time. For example, in the introduction of the subsequent embodiments, the preset time is 5 seconds.

[0131] When a user operation of clicking on the floating ball 412 is detected, the first electronic device may display the boarding pass interface corresponding to the floating ball 412. Conversely, if no user operation of clicking on the floating ball 412 is detected within a preset time, the first electronic device may push the expanded floating ball 412 to the right side of the screen to hide the floating ball 412, such as Figure 4K As shown, the floating ball 412 is changed to a thumbnail state.

[0132] Similarly, after displaying the floating ball 413, the first electronic device may monitor whether there is a user operation of clicking the floating ball 413 within a preset time. If no user operation of clicking the floating ball 413 is detected, the first electronic device may also change the floating ball 413 to a thumbnail state.

[0133] At this time, when there are multiple floating balls in thumbnail states, the first electronic device may aggregate the multiple floating balls in thumbnail states to display a single aggregated floating ball. Specifically, when adjusting an expanded floating ball to a thumbnail state, the first electronic device may detect whether a thumbnail state floating ball is already displayed on the current screen. When a thumbnail state floating ball is detected to be already displayed, the first electronic device may aggregate the floating ball that is about to be adjusted to a thumbnail state with the existing thumbnail state floating ball, and then display a single aggregated floating ball.

[0134] like Figure 4K As shown, the floating ball 412 and the floating ball 413 can enter the thumbnail state successively. Among them, the first electronic device first displays the floating ball 412, so the floating ball 412 can enter the thumbnail state first. When the floating ball 413 enters the thumbnail state, the first electronic device can detect that the thumbnail state of the floating ball 412 has been displayed on the current screen. At this time, the first electronic device can aggregate the floating ball 412 and the floating ball 413 into one floating ball, referring to Figure 4LThe suspended ball 414 is removed, thereby greatly reducing the obstruction of the screen by the suspended ball.

[0135] Optionally, the aggregated floating ball 414 may display the application icon of the last floating ball to enter the thumbnail state, for example, floating ball 413 is the last floating ball to enter the thumbnail state compared to floating ball 412. Alternatively, the aggregated thumbnail state floating ball 414 may also display an icon specifically indicating the aggregated floating ball. This embodiment of the present application is not limited to this.

[0136] It is understood that although the first electronic device displays only one aggregated floating ball, the first electronic device still maintains multiple floating balls. The user can operate on the aggregated floating ball to instruct the first electronic device to redisplay the multiple floating balls, thereby allowing the user to select the currently required floating ball and obtain the service provided by the floating ball.

[0137] like Figure 4M As shown, the first electronic device can detect a user operation on the floating ball 414, such as a click operation. In response to the above user operation, the first electronic device can display Figure 4N The user interface shown in Figure 4N As shown, at this time, the first electronic device can redisplay the floating ball 412 and the floating ball 413 before the aggregation. In this way, the user can click on the floating ball 412 or the floating ball 413 to obtain the subway boarding code or boarding pass.

[0138] The first electronic device can also monitor whether the user performs a preset specific operation. When the specific operation is detected, the first electronic device can display a floating ball that matches the specific operation. Figures 5A-5I The example shows that the first electronic device displays a user interface of a translation floating ball or a navigation floating ball matching the copy operation according to a preset copy operation.

[0139] first, Figure 5A The following example shows a user interface of a first electronic device displaying an English page. Figure 5A As shown, at this time, the window 411 can display a news report expressed in English. Above the layer showing the news report, the window 411 also displays a collective floating ball 414. At this time, the floating ball 414 can also be displayed. Figure 4G The suspended ball 414 in the image may include a flight suspended ball and a subway suspended ball. Specifically, Figure 5A The suspended ball 414 can be referenced Figure 4G The introduction of the suspended ball 414 will not be repeated here.

[0140] exist Figure 5AIn the scenario shown, the first electronic device can detect a user operation on the English text in the window 411, such as a long press operation, a box selection operation, etc. Figure 5B , the first electronic device may detect a user operation on "Hainan International Convention and Exhibition Center." In response to the operation, the first electronic device may display a menu bar 511. Menu bar 511 may include a "Copy" button. The "Copy" button may be used to copy the text selected by the user ("Hainan International Convention and Exhibition Center").

[0141] When the user operation on the "Copy" button is detected, the first electronic device can identify the language used in the text selected by the user. Then, the first electronic device can determine whether the user is browsing foreign language articles or other content expressed in foreign languages by comparing the language used in the text selected by the user with the common language set by the system. The foreign language refers to other types of languages that are different from the common language of the system. When the common language of the system is set to Chinese, Figure 5A English displayed in the system can be called a foreign language. Other languages such as Japanese, German, French, etc. that are different from the common system language "Chinese" can also be called foreign languages.

[0142] When it is determined that the text selected by the user is inconsistent with the common language of the system, the first electronic device can display a translation floating ball. The translation floating ball can provide translation services for the user.

[0143] For example, reference Figure 5C In the scenario where the system's commonly used language is set to Chinese, after detecting the copy operation, the first electronic device may determine that the language used in the copied text is not the system's commonly used language. In this case, the first electronic device may display a translation floating ball, i.e., floating ball 512.

[0144] The first electronic device can detect the user operation acting on the floating ball 512. In response to the above operation, the first electronic device can display Figure 5D The user interface shown in Figure 5DAs shown, the user interface may include controls 521, 522, text boxes 523, and 524. Control 521 may display the language used by the copied text recognized by the first electronic device. Control 522 may display the common language set in the first electronic device. Text box 523 may display the copied text ("Hainan International Convention and Exhibition Center"). Text box 524 may display the translation result, that is, the expression of the system common language corresponding to the above-mentioned copied text in the non-system common language ("Hainan International Convention and Exhibition Center").

[0145] Optionally, in response to the above user operation on the floating ball 512, the first electronic device may also Figure 5C A window is displayed in the translation result. The window can automatically adjust its window size according to the display area required for the translation result. In this way, the first electronic device can display the translation result quickly and directly through the window, and can also minimize the translation result. Figure 5C Occlusion of the content displayed in .

[0146] In this way, by clicking the translation floating ball, the user can quickly and conveniently obtain the translation result of the copied text into the system's commonly used language through the translation floating ball, thereby providing convenience for the user to browse foreign language web pages.

[0147] After detecting the copied text, the first electronic device can also identify whether the text is an address. If the text is confirmed to be an address, the first electronic device can also display a navigation hover ball. The navigation hover ball can be associated with a map application installed on the first electronic device and access positioning services, route planning services, and navigation services provided by the map application. The user can use the navigation hover ball to quickly and conveniently obtain a route from the current location to the address.

[0148] For example, in Figure 5B In the scenario shown, after recognizing that the copied text is an address ("Hainan International Convention and Exhibition Center"), the first electronic device may also display a navigation floating ball, referring to Figure 5E In the embodiment of the present application, the copied address may be expressed in a language commonly used by the system or in a language not commonly used by the system. When the address is expressed in a language not commonly used by the system, the first electronic device may translate the text in the language not commonly used by the system into the text in the language commonly used by the system.

[0149] Then, if Figure 5F As shown, the first electronic device can detect the user operation acting on the floating ball 513. In response to the above operation, the first electronic device can display Figure 5G The user interface shown in FIG. The user interface can display a route from the user's current location to the above-identified address.

[0150] like Figure 5G As shown, the interface displays: location A and location B. Location A may be the current location of the first electronic device (current location); location B may be a location recognized by the first electronic device from the copied text, such as the aforementioned recognized "Hainan International Convention and Exhibition Center". Figure 5G Also shown are two routes from location A to location B: Route 1 and Route 2.

[0151] In this way, the display Figure 5G After the user interface is shown, the user can understand how to go from location A to location B through the locations and routes displayed in the user interface.

[0152] Optional, Figure 5G The illustrated user interface may also display the aggregated hovering ball 414 , and may not display the transient hovering ball 512 recommending translation services.

[0153] After detecting the copied text, the first electronic device can also identify whether the text is a phone number. If the text is identified as a phone number, the first electronic device can also display a call hover ball. The call hover ball can be associated with a call application installed on the first electronic device. When a user action on the call hover ball is detected, the first electronic device can call the copied phone number, thereby providing a quick dialing service for the user.

[0154] The first electronic device may also detect a user operation of frequently switching between two or more applications. In response to such operation, the first electronic device displays a split-screen floating ball. The split-screen floating ball can provide the user with a quick split-screen service. When a user operation acting on the split-screen floating ball is detected, the first electronic device may divide the phone screen into multiple windows. Each window displays a view provided by one of the two or more applications.

[0155] The first electronic device may also recognize other specific operations and display a floating ball matching the specific operations, which will not be listed here one by one.

[0156] By implementing the above method, after recognizing that the user has performed a preset specific operation, the first electronic device can determine a demand that is strongly related to the specific operation and then display a floating ball that meets the user's demand.

[0157] For example, after recognizing a user operation to copy text in a non-common language, the first electronic device may determine that the user needs to translate the text in the non-common language. The first electronic device may then display a translation balloon, allowing the user to quickly and easily access translation results, making it easier for the user to browse foreign text.

[0158] In the embodiment of the present application, the above-mentioned navigation floating ball can be a transient floating ball.

[0159] After displaying the translation floating ball (floating ball 512) and the navigation floating ball (floating ball 513), the first electronic device may detect whether there is a user operation on the floating ball within a preset time. After the preset time ends, the first electronic device may gradually hide the floating ball. Figure 5H In the user interface shown, the floating ball 512 and the floating ball 513 gradually move to the right and gradually fold or shrink the display area of the prompt information, that is, enter a hidden state.

[0160] When adjusting a non-transient floating ball in an expanded state to a thumbnail state, the first electronic device may detect whether there is a thumbnail floating ball on the current screen. If a thumbnail floating ball is detected, the first electronic device may combine the non-transient floating ball with the thumbnail floating ball to display a single thumbnail floating ball. This thumbnail floating ball includes all the thumbnail floating balls in the thumbnail state.

[0161] Taking the translation floating ball (floating ball 512) as an example, when no user operation acting on the floating ball 512 is detected within a preset time, the first electronic device can adjust the floating ball 512 to a thumbnail state, referring to Figure 5H The floating ball 512 shown. At this time, there is a floating ball in a thumbnail state (suspended ball 414) on the screen. At this time, the first electronic device can aggregate the floating ball 512 with the suspended ball 414 in a thumbnail state to obtain a new thumbnail state floating ball, refer to Figure 5I At this time, the application icon displayed in the floating ball 514 may be the application icon of the last floating ball 512 that entered the thumbnail state.

[0162] In this way, if the user copies the non-system language text without intending to translate the text, the first electronic device can hide the translation floating ball in a timely manner to avoid affecting the user's browsing experience when browsing the page.

[0163] Thereafter, if the user wants to view the translation result, the user can click on the thumbnail floating ball 514 to instruct the first electronic device to redisplay the hidden translation floating ball (floating ball 512), and then view the translation result through the translation floating ball.

[0164] In a scenario where the first electronic device displays a foreign language web page, if no user operation on the translation floating ball is detected within a preset time, the translation floating ball may enter a thumbnail state. When the first electronic device no longer displays the foreign language web page, the first electronic device may stop displaying the translation floating ball. In some embodiments, when the first electronic device is no longer displaying the foreign language web page, the first electronic device may also stop displaying the translation floating ball after a period of time. The above period of time may be, for example, 3 minutes. This is not shown in the embodiments of the present application.

[0165] By implementing the above method, if the first electronic device displays a floating ball in response to a specific user operation and provides a quick service that the user does not currently need, the first electronic device can appropriately retract the floating ball to avoid obstruction, thereby improving the user experience. When the user needs the quick service provided by the floating ball, the first electronic device can redisplay the floating ball and provide the user with the required quick service.

[0166] For example, a first electronic device may display a translation balloon in response to an operation to copy text in a non-common language. When the user does not need translation services, the first electronic device may hide the balloon. When the user needs the balloon, the first electronic device may redisplay it to provide the user with the translation service that the user currently needs.

[0167] When the floating ball of the transient floating ball in the expanded state is adjusted to be displayed in a thumbnail state, the first electronic device may start to terminate the timer and display a countdown ring on the floating ball. When the timer ends, the first electronic device may stop displaying the floating ball.

[0168] like Figure 5H As shown, after displaying the navigation floating ball (floating ball 513), if no user operation acting on the floating ball 513 is detected within a preset time, the first electronic device can adjust the floating ball 513 to a thumbnail state to reduce the display area.

[0169] like Figure 5I As shown, after entering the thumbnail state, the floating ball 513 can display a countdown ring. The countdown ring timing length is, for example, 5 seconds. Figure 5J As shown, the countdown ring can gradually decrease counterclockwise from the 12 o'clock position. The user can use the countdown ring to understand the remaining time for the first electronic device to display the floating ball, so as to remind the user to click on the floating ball and obtain the quick service provided by the floating ball before the floating ball disappears.

[0170] like Figure 5J As shown, at any time before the countdown ring ends, if a user operation of clicking the floating ball 513 is detected, the first electronic device may display Figure 5GAfter the countdown ring ends, if no user operation of clicking the floating ball 513 is detected, the first electronic device can terminate the floating ball 513, that is, no longer display the floating ball 513. Figure 5K In the user interface shown, after the countdown ring ends, the floating ball 513 is no longer displayed on the screen. The first electronic device also does not aggregate the floating ball 513 into the thumbnail floating ball 514.

[0171] Optionally, after detecting a user click on floating ball 513, the map application corresponding to floating ball 513 can plan a route for the user. Thereafter, floating ball 513 can be changed to a non-transient floating ball. The user can access the navigation page and obtain navigation services at any time through the non-transient floating ball.

[0172] When implementing the above method, if the quick service provided by the floating ball displayed by the first electronic device based on the user's specific operation is not currently required by the user, and the first electronic device cannot determine whether the user will need the above quick service within a period of time in the future, the first electronic device can terminate the above floating ball in a timely manner to avoid obstruction, thereby improving the user experience.

[0173] The first electronic device also supports changing the position of the floating ball, refer to Figures 6A-6I The user interface shown.

[0174] refer to Figure 6A , Figure 6A The user interface shown in FIG. 6 shows an aggregated floating ball 601. The first electronic device can detect a user operation on the floating ball 601. In response to the above operation, the first electronic device can display all the floating balls included in the floating ball 601, referring to FIG. Figure 6B , including translation floating ball 611, flight floating ball 612, and subway floating ball 613.

[0175] At this time, the first electronic device can detect the user operation on any one of the plurality of floating balls. In response to the above operation, the first electronic device can provide the user with a quick service corresponding to the floating ball. Figure 4E 、 Figure 4H 、 Figure 5D The user interface shown is not described here in detail.

[0176] like Figure 6C As shown, the first electronic device can detect the user operation of long pressing the translation floating ball 611. The above operation can also be a double-click operation, which is not limited in the embodiment of the present application. In response to the above operation, the first electronic device can shrink the translation floating ball 611, referring to Figure 6DThen, the first electronic device may change the display position of the floating ball according to the user's drag operation. At the same time, the first electronic device may also display a delete control 614.

[0177] like Figure 6E As shown, the first electronic device may detect a user operation of moving the translation floating ball 611 to the delete control 614. In response to this operation, the first electronic device may delete the translation floating ball 611, i.e., stop displaying the translation floating ball 611. The first electronic device may aggregate the remaining flight floating ball 612 and subway floating ball 613 into a new, abbreviated floating ball. This abbreviated floating ball also no longer includes the translation floating ball 611.

[0178] like Figure 6F 、 Figure 6G As shown, the first electronic device may also detect the user operation of dragging the translation floating ball 611 to the lower left of the screen. After the movement is completed, the first electronic device may display Figure 6H At this time, the translation floating ball 611, flight floating ball 612, and subway floating ball 613 originally displayed in the upper right corner of the screen are all moved to the lower left corner of the screen.

[0179] In the display Figure 6H After the user interface shown, if no user operation on any of the above floating balls is detected within a preset time, the first electronic device can aggregate the above three floating balls into a miniature floating ball again, referring to Figure 6I .

[0180] Optional, such as Figure 6J 、 Figure 6K As shown, the first electronic device can also detect the user operation of dragging the floating ball 601. After the movement is completed, the first electronic device can display the aggregated floating ball 601 at the moved position, referring to Figure 6L .

[0181] By implementing the above method, the user can arbitrarily adjust the position of the currently displayed floating ball, thereby minimizing the obstruction of the currently displayed user interface by the floating ball and improving the user experience.

[0182] The first electronic device can support the display of multiple floating balls. The first electronic device does not limit the number of floating balls supported for display. Figure 6M As shown, the first electronic device can display 6 floating balls: in addition to the translation floating ball 611, flight floating ball 612, and subway floating ball 613 introduced above, it also includes a takeaway floating ball 615, a travel floating ball 616, and a courier floating ball 617.

[0183] The above-mentioned takeaway floating ball 615 is a floating ball generated after detecting that a user uses a takeaway application to order food, and is used to prompt the progress of the takeaway order. The user can obtain the ordering progress through the above-mentioned floating ball. For example, the user can know that the takeaway will be delivered in about 4 minutes and 20 seconds through the "4:20 remaining" displayed in the floating ball 615. The travel floating ball 616 is a floating ball generated after detecting that a user uses a travel application to book a taxi, and is used to prompt the progress of the taxi booking. For example, the user can know that the reserved taxi will arrive at the departure place in 6 minutes through the "6:00 remaining" displayed in the floating ball 615. The express floating ball 617 can be used to remind the user of the delivered express.

[0184] like Figure 6M As shown, the first electronic device can display five completely non-overlapping floating balls in the expanded state. The first electronic device can fold the remaining floating balls behind the fifth floating ball. For example, the first electronic device can fold the floating ball 617 behind the fifth floating ball (floating ball 616), that is, display part of the floating ball 617 (the floating ball 617 is partially covered by the floating ball 616). The first electronic device can detect a sliding operation acting on the floating ball area. In response to the above operation, the first electronic device can display the covered floating ball.

[0185] For example, reference Figure 6N , the first electronic device may detect a user operation of sliding upward on the floating ball area. In response to the above user operation, the first electronic device may display a folded express floating ball 617, referring to Figure 6O At the same time, the first electronic device may fold the translation floating balls 611 that exceed the complete display quantity.

[0186] When a user cannot access the desired floating ball, they need to exit the currently displayed interface and open a new application, page, etc. This increases a large number of user operations, increases the complexity of interaction, and reduces the user experience. By implementing the above method, the first electronic device can display multiple floating balls, thereby avoiding the problem of users being unable to access the desired floating ball at any time due to the limited number of floating balls, and thus obtaining the shortcut operations provided by the floating ball.

[0187] In the embodiments of this application,

[0188] exist Figure 4CIn the illustrated user interface, subway hover ball 412 may be referred to as the first hover ball, and flight hover ball 413 may be referred to as the second hover ball. The subway app icon displayed in subway hover ball 412 may be referred to as the first app identifier. The subway station information and subway boarding code displayed in subway hover ball 412 may be referred to as the first information. The flight app icon displayed in flight hover ball 413 may be referred to as the second app identifier. The boarding gate information and electronic boarding pass information displayed in flight hover ball 413 may be referred to as the second information.

[0189] exist Figure 4C 、 Figure 4K In the user interface shown, if no user clicks on subway floating ball 412 are detected for a period of time while it is displayed, subway floating ball 412 may be changed to a thumbnail state. This period of time may be referred to as a first duration. If no user clicks on flight floating ball 413 are detected for a period of time while it is displayed, flight floating ball 413 may be changed to a thumbnail state. This period of time may be referred to as a second duration. The first and second durations may be equal, for example, 5 seconds, or they may be different.

[0190] refer to Figure 4L The floating ball 414 obtained by aggregating the subway floating ball 412 and the flight floating ball 413 can be called a third floating ball. The overlapping icons displayed in the floating ball 414 can indicate that the floating ball is an aggregated floating ball. The overlapping icons can be called the third floating ball and include indication information.

[0191] refer to Figure 4M , the electronic device detects that the user operation acting on the floating ball 414 can be called the first user operation.

[0192] refer to Figure 4G When the electronic device detects a user operation acting on the subway floating ball 412, it can be called a second user operation. Figure 4H The page shown may be referred to as the first page. Figure 4H The information displayed in the shown page can be referred to as third information.

[0193] exist Figure 6M In the user interface shown, subway suspended ball 412 and flight suspended ball 413 are the first suspended ball and the second suspended ball respectively. Suspended ball 616 can be called the fourth suspended ball, and suspended ball 617 can be called the fifth suspended ball. Figure 6N The sliding operation shown may be referred to as a third user operation. After performing the above operation, the floating ball 617 is no longer covered by the floating ball 616.

[0194] exist Figure 5E In the user interface shown, the translation floating ball 513 may also be referred to as the first floating ball. Figure 5E Display translation floating ball 513 to Figure 5K The time between terminating the translation suspension ball 513 can be called the third duration. Figure 5E The expanded state translation suspension ball 513 is displayed Figure 5I The time between the abbreviated translation floating balls 513 with countdown can be called the fourth duration.

[0195] refer to Figure 6C-6D 、 Figure 6F-6H , the floating ball 616 can be called a first floating ball or a second floating ball, and the user's operation of dragging the floating ball 616 can be called a fourth user operation. Figure 6G The position shown where the user stops dragging can be referred to as the first position.

[0196] The software system of the first electronic device may adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. In the embodiment of the present invention, the Android system with a layered architecture is used as an example to illustrate the software structure of the first electronic device. Figure 7 The software structure block diagram of the first electronic device implementing the floating ball processing method in the multi-tasking scenario provided by the embodiment of the present application is exemplified.

[0197] A layered architecture divides software into several layers, each with distinct roles and responsibilities. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer.

[0198] The application layer can include a series of application packages. Figure 7 As shown, the application package may include notification applications, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message and other applications.

[0199] In an embodiment of the present application, the notification application can obtain data reflecting the current status or environment of the first electronic device, and determine whether to display a floating ball that matches the above status or environment based on the above data, so as to provide users with timely and convenient floating ball notification services.

[0200] Combine Figures 4A-4N 、 Figures 5A-5K 、 Figures 6A-6OIn the user interface shown, the notification application can obtain data reflecting the current state or environment of the first electronic device, determine whether the first electronic device is within the geographical range of a subway station or an airport, or identify whether the first electronic device is copying text in a language not commonly used by the system. When it is detected that the geographical range matches or a preset specific operation is being performed, the notification application can call the window manager to display a flight hover ball, subway hover ball, translation hover ball, navigation hover ball, etc. that matches the geographical range matching or the preset specific operation being performed.

[0201] The application framework layer provides an application programming interface (API) and programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0202] like Figure 7 As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

[0203] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc. Figures 4A-4N 、 Figures 5A-5K 、 Figures 6A-6O The user interface shown here relies on the window manager, which manages the foreground application or desktop, as well as the display position and area of the hover ball.

[0204] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0205] The view system includes visual controls, such as controls for displaying text, controls for displaying pictures, etc. The view system can be used to build applications. The display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying pictures. In the embodiment of the present application, the display Figures 4A-4N 、 Figures 5A-5K 、 Figures 6A-6O The user interface shown also relies on the view system. The view system can manage the text controls in the displayed user interface, the controls that display images, etc., such as the floating ball and the prompt information in the floating ball.

[0206] The phone manager is used to provide communication functions for the first electronic device. For example, call status management (including answering, hanging up, etc.) In the embodiment of the present application, after recognizing the operation of copying the phone number, the notification application displays the call hover ball, and the function of dialing using the call hover ball relies on the call status management service provided by the phone manager.

[0207] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, etc. In an embodiment of the present application, the first electronic device can obtain data reflecting the current state or environment of the first electronic device, such as the current location, system time, clipboard data, etc., through the resources provided by the resource manager.

[0208] The Notification Manager allows applications to display notifications in the status bar. These messages can be displayed briefly and then disappear automatically without user interaction. For example, the Notification Manager is used to notify users of completed downloads and message reminders. The Notification Manager can also display notifications in the top status bar of the system as icons or scrolling text, such as notifications from background applications, or as dialog windows on the screen. Examples include text messages in the status bar, beeps, vibrations on electronic devices, and flashing indicator lights.

[0209] In the embodiment of the present application, the floating ball can be a form of displaying notification content by the notification manager. In addition, the form of displaying notification content by the notification manager can also be a card, a banner, and a notification menu when the screen is locked, etc., which will not be listed here one by one.

[0210] Android Runtime includes core libraries and a virtual machine. Android Runtime is responsible for scheduling and management of the Android system.

[0211] The core library consists of two parts: one containing the Java language's callable functions and the other the Android core library. The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files in the application layer and application framework layer as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.

[0212] The system library can include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0213] The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications. The 2D graphics engine is a drawing engine for 2D drawing. The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing. The window manager and view system can realize display through the image drawing and display capabilities provided by the surface manager, 2D graphics engine, and 3D graphics processing library. Figures 4A-4N 、 Figures 5A-5K 、 Figures 6A-6O The functionality of the user interface is shown.

[0214] The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library can support multiple audio and video encoding formats.

[0215] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver. The display driver can control the display screen on the first electronic device to display according to the preset user interface, such as display Figures 4A-4N 、 Figures 5A-5K 、 Figures 6A-6O The user interface shown.

[0216] Further, Figure 8 The specific structure of the notification application is shown as an example. Figure 8 The software modules of the notification application shown and the services provided by the modules in the process of implementing the floating ball processing method in a multi-tasking scenario.

[0217] like Figure 8 As shown, the notification application may include a perception module, a service identification module, a service module, and a floating ball management module.

[0218] The perception module can be used to obtain in real time preset data for determining the current business scenario of the first electronic device. The business identification module can determine whether to trigger the display of the floating ball and the type of floating ball to be displayed based on the data obtained by the perception module. The business module can obtain the corresponding information to be displayed from the application corresponding to the floating ball based on the type of floating ball determined by the business identification module. The floating ball management module can display the corresponding floating ball based on the data determined when the business module executes the floating ball business.

[0219] The perception module can obtain in real time preset data for determining the current business scenario of the first electronic device. The preset data for determining the current business scenario of the first electronic device includes but is not limited to: data indicating the working status of the electronic device, order information, and notification messages.

[0220] Among them, the data indicating the working status of the electronic device includes: positioning data indicating the current location of the first electronic device (current location), the current system time of the first electronic device (current time), the interaction status reflecting whether the first electronic device interacts with the user, and clipboard data indicating whether the user performs a copy operation and the copied content.

[0221] The first electronic device can obtain information about orders completed by the user using the installed application from the application, such as flight orders, ride-hailing orders, food delivery orders, express delivery orders, etc.

[0222] The first electronic device can also obtain the above-mentioned order information by identifying the notification of the above-mentioned application. For example, when the departure time of the flight booked by the user is approaching, the application installed on the first electronic device for the user to book the flight can receive the flight itinerary notification sent by the server. The above-mentioned server refers to a server corresponding to the flight application installed on the first electronic device, which provides services such as flight inquiry and flight booking. Based on the above-mentioned notification, the first electronic device can obtain information about the flight booked by the user, such as flight number, departure place, departure time, etc. Furthermore, the first electronic device can identify whether the user is currently in the airport, checking in, waiting for the flight, and other states or actions.

[0223] The sensing module is not limited to the above-mentioned current location, system time, interaction status, clipboard data, and application notifications. The sensing module can also sense other data reflecting the status of the first electronic device. This embodiment of the application does not limit this.

[0224] The service identification module can determine whether to trigger the floating ball service based on the data obtained by the perception module.

[0225] First, the service identification module may record specific hovering ball types and the display conditions for each hovering ball. Table 1 shows the hovering ball types and the display conditions for each hovering ball recorded in the service identification module. The service identification module may determine whether the current state or environment of the first electronic device triggers a certain type of hovering ball based on Table 1.

[0226] Table 1

[0227]

[0228]

[0229] "Service Type" includes: Flight, Subway, Translation, Navigation, Dial-up, and Split-screen. Flight, Subway, Translation, Navigation, Dial-up, and Split-screen correspond to the flight service, subway service, translation service, navigation service, dial-up service, and split-screen service described in the user interface above.

[0230] Actions include: show, hide, terminate, and expand. Figure 4B The action of displaying the hovering ball 412 may be referred to as a display action. Figure 4K 、 Figure 4L The action of adjusting the floating ball to a thumbnail state (including aggregation) can be called a hiding action. Figure 5K The action of no longer displaying the floating ball 513 may be referred to as a termination action. Figure 4M and Figure 4N The action of unfolding the thumbnail state floating ball 414 shown may be referred to as an unfolding action.

[0231] "Current location" includes: airport geographical range, non-airport geographical range, subway station geographical range, and non-subway station geographical range. The "airport geographical range" mentioned above means that the current location of the first electronic device is within the preset airport geographical range. Conversely, the "non-airport geographical range" means that the current location of the first electronic device is not within the preset airport geographical range. Similarly, the "subway station geographical range" means that the current location of the first electronic device is within the preset subway station geographical range, and the "non-subway station geographical range" means that the current location of the first electronic device is not within the preset subway station geographical range.

[0232] The states of "Current Time" include: Waiting for Flight and Already Taken Off. The current state of "Waiting for Flight" means that the current time is within a period of time before the user's scheduled flight takes off. This period of time may be, for example, 4 hours before takeoff. This embodiment of the present application does not impose any restrictions on this. The current state of "Taken Off" means that the current time of the first electronic device is after (including) the user's scheduled flight takes off.

[0233] "Interaction status" includes: no operation within the timing time, copying, closing the page, switching back and forth, clicking on the floating ball and other actions. No operation within the timing time means that the first electronic device has not detected the user operation acting on the floating ball. Copying refers to the user operation of copying pictures and texts detected by the first electronic device. Closing the page refers to the user operation detected by the first electronic device to close the currently displayed page or the page affected by the copy operation. Switching back and forth refers to the user operation of frequently switching between two or more applications detected by the first electronic device. For example, the operation of frequently changing the foreground application from switching from application A to application B and then to application A. Clicking on the floating ball refers to the click operation on the thumbnail floating ball on the screen detected by the first electronic device.

[0234] "Clipboard Data" includes: non-common languages, addresses, and phone numbers. When the "Interaction State" is Copy, if the language of the data written in the "Clipboard Data" is non-common languages, the user can be instructed to copy foreign text; if the data written in the "Clipboard Data" is an address, the user can be instructed to copy the address; if the data written in the "Clipboard Data" is a phone number, the user can be instructed to copy the phone number.

[0235] The "\" above indicates a type of data that the service identification module does not need to consider when determining whether to trigger a service. The value of the data marked with "\" in a row will not affect the service identification module's determination of whether to trigger the service in that row. For example, when the service identification module determines whether to trigger the display of the flight hover ball, the service identification module does not need to pay attention to the data in "Interaction Status" and "Clipboard Data". The values of "Interaction Status" and "Clipboard Data" will not affect the service identification module's determination of whether to trigger the display of the flight hover ball.

[0236] In the flight service: First, the first electronic device can obtain the user's flight order from the flight application, or obtain the user's flight order by monitoring the notification of the flight application, and then determine the user's flight information (departure time, departure place, etc.). When it is detected that the current location is within the geographical range of the airport and the current time is waiting for the flight, the service identification module can determine to trigger the display of the flight floating ball. The prompts in the flight floating ball can be information such as the check-in counter, boarding gate, seat number, etc. Furthermore, the flight floating ball can play the above information in a carousel.

[0237] Optionally, the service identification module can further distinguish the specific stage of the waiting time, such as the check-in stage, the security check stage, and the waiting stage for boarding. Furthermore, the flight hover ball can display the above information according to the above different stages. If the current location is within the geographical area of the airport, the current time is after the departure time, and a flight delay notification is received (or a delay is detected in the flight order obtained from the flight application), the prompt information displayed in the flight hover ball may also include a delay prompt.

[0238] If the first electronic device displays the expanded flight hoverball for a period of time and detects no user action on the flight hoverball (interaction state: no action within the timer), the service identification module may determine to hide the flight hoverball. If the current location is not within the airport's geographic range and the current time is after the scheduled flight's departure time (the departure time has already arrived and the user is no longer within the airport), the service identification module may determine to terminate the flight hoverball.

[0239] For subway services: When the current location is within the geographic range of a subway station, the service identification module may determine that the subway service has been triggered. At this point, the notification app may determine to display the subway hover ball. When the current location is outside the geographic range of a subway station, the service identification module may determine to terminate the subway hover ball. Similarly, if no user action on the subway hover ball is detected within a timer, the service identification module may determine to hide the subway hover ball, resizing the expanded state of the subway hover ball to a reduced state.

[0240] In the translation service: When the "Interaction Status" is copying and the language of the copied data is not a common system language, the service identification module can determine to display the translation floating ball. After the translation floating ball is displayed, if the "Interaction Status" is closing the page, the service identification module can determine to terminate the translation floating ball. Similarly, if no user operation on the translation floating ball is detected within the timer, the service identification module can determine to adjust the expanded translation floating ball to a thumbnail state.

[0241] In the navigation service: When the "Interaction State" is Copy and the copied data is an address, the service identification module can determine to display the navigation hover ball. If no user operation on the subway hover ball is detected within the timing period, the service identification module can determine to adjust the expanded navigation hover ball to a thumbnail state. After entering the thumbnail state, the navigation hover ball can start a new round of timing. After the new round of timing ends and no user operation on the navigation hover ball is detected, the service identification module can determine to terminate the navigation hover ball.

[0242] In the dial-up service: When the "Interaction State" is copying and the copied data is a phone number, the service identification module can determine to display the dial-up floating ball. If no user operation on the subway floating ball is detected within the timing time, the service identification module can determine to adjust the dial-up floating ball from the expanded state to the thumbnail state. After entering the thumbnail state, the dial-up floating ball can start a new round of timing. After the new round of timing ends and no user operation on the dial-up floating ball is detected, the service identification module can determine to terminate the dial-up floating ball.

[0243] In the split-screen service: When the "interaction state" is switching back and forth, the service identification module can determine to display the split-screen floating ball. If no user operation acting on the split-screen floating ball is detected within the timing time, the service identification module can determine to adjust the split-screen floating ball in the expanded state to the thumbnail state. After entering the thumbnail state, the split-screen floating ball can start a new round of timing. After the new round of timing ends and no user operation acting on the split-screen floating ball is detected, the service identification module can determine to terminate the split-screen floating ball.

[0244] Furthermore, for the flight floating ball, subway floating ball, and translation floating ball, when the floating ball changes to a reduced state, the multiple floating balls in the reduced state may be aggregated into one.

[0245] When a user operation on a thumbnail floating ball is detected, such as a user operation of clicking the floating ball, the service identification module may determine to expand the hidden floating ball. Further, if the thumbnail floating ball is an aggregated floating ball, the service identification module may determine to expand the aggregated floating ball.

[0246] In addition, the above business types also include express delivery, food delivery, and ride-hailing. The first electronic device can obtain the user's order information from the application program that executes the above business, and then display the corresponding floating ball.

[0247] For example, the first electronic device can obtain the user's express order from the express application. When there is an order to be confirmed, the first electronic device can confirm to the user that it meets the express service preset in the notification application. Then, the first electronic device can display the express floating ball, referring to Figure 3A Users can access the express delivery tasks through the express floating ball. When the express delivery task is completed, for example, the express delivery that was signed for on behalf of the user has been signed for, the express floating ball can be terminated.

[0248] For takeaway and ride-hailing services, please refer to the above-mentioned express delivery services and will not be elaborated here.

[0249] Based on service type, the service module can be divided into submodules such as flight module, subway module, translation module, navigation module, dialing module, and split-screen module. Each submodule records the business logic of its specific service. Based on the service instructions issued by the service identification module, the submodule determines the floating ball state (show, hide, terminate, expand) and the information to be displayed in the floating ball.

[0250] Taking the confirmation and display of the flight floating ball as an example, the flight module can receive business indication information for displaying the flight floating ball. In response to the above business indication information, the flight module can first determine the user's flight information. The flight module can obtain the user's order information from the order information module in the perception module. The above order information includes the flight information of the booked flight, such as flight number, date, departure place, take-off time, etc. Based on the above flight information, the flight module can determine the prompt information in the flight floating ball to be displayed, such as flight information such as check-in counter, boarding gate, seat number, etc. At the same time, the flight module can confirm the page link. The above page link is a link to the page in the flight application that displays the user's flight order. The flight module can use the above page link to obtain and display the page in the flight application that displays the user's flight order.

[0251] The hover ball management module can construct a hover ball based on the data sent by the business module. The data sent by the business module (or the call parameters for the business module to call the hover ball management module to construct the hover ball) may include: status, hover ball number (ID), display content, and callback interface.

[0252] The aforementioned states are the states of the floating ball described in Table 1, including display, hiding, termination, and expansion. The floating ball management module can determine whether to display, hide, terminate, or expand the floating ball based on the aforementioned states. Accordingly, the floating ball management module can determine the animation display effect corresponding to the aforementioned display, hiding, termination, or expansion actions.

[0253] The floating ball ID can be used to mark each floating ball. Thereafter, when the state of the floating ball needs to be changed, the floating ball management module can determine the floating ball to be changed based on the floating ball ID. Display content refers to the content directly displayed by the floating ball in the expanded state, including application icons and prompts. Display content can provide users with the most intuitive notification prompts. The application icons and prompts that need to be displayed in the floating balls corresponding to different businesses are different. For details, please refer to Figure 3A The introduction of , will not be repeated here.

[0254] The callback interface can be used to return control commands to the business module. The above control commands can instruct the business module to perform subsequent operations, such as displaying a jump page, etc. Taking the flight floating ball as an example, after detecting the user's operation on the expanded flight floating ball, the floating ball management module can return a control command indicating a click operation to the flight module. In response to the above control command, the flight module can call the window manager to display the flight details page. The above flight details page is obtained by the flight module from the flight application. For example, the above flight details page Figure 4E Alternatively, the above control command can also trigger the launch of a flight application. In this way, the user can obtain flight information for the scheduled flight in the user interface provided by the flight application.

[0255] Window managers and resource managers can refer to Figure 7 The introduction in , will not be repeated here.

[0256] Optionally, in addition to the notification service provided by the floating ball, the first electronic device may also include other types of notification services, such as card notifications and banner notifications. In this case, in addition to the floating ball notification, the services provided by the notification application should also include other types of notification services such as card notifications and banner notifications. In this case, the notification application may also include a notification management module, refer to Figure 9 The software structure diagram shown.

[0257] The notification management module may include a floating ball module, a card module, and a banner module. After receiving the service indication information sent by the service identification module, the notification management module may also determine the form of the notification. For example, when the above service indication information indicates flight services, the notification management module may determine to display the flight floating ball, flight card, and flight banner. In this case, the service indication information sent by the notification management module to the flight service also includes notification form indication information. Based on the above notification form indication information, the flight service can determine which form of notification to generate, namely, a floating ball notification, a card notification, or a banner notification.

[0258] Accordingly, based on the notification form indicated by the notification form indication information, the flight service can send notification content (parameters) to the management modules corresponding to each notification form. For example, the notification form of the flight service indicated by the notification form indication information includes floating ball notification, card notification, and banner notification. In this case, the flight service can send notification content to the floating ball management module, card management module, and banner management module respectively. The floating ball management module, card management module, and banner management module can generate floating balls, cards, and banners displaying the above notification content based on the above notification content.

[0259] Figure 8 and Figure 9 The software structure shown is merely an example and should not be construed as limiting the embodiments of the present application.

[0260] Combine Figures 4A-4N 、 Figures 5A-5K The user interface shown, Figure 10 The flowchart of the method for processing a floating ball in the aforementioned multi-tasking scenario implemented by the first electronic device is shown.

[0261] S101: Acquire status data.

[0262] The first electronic device can obtain preset data for determining the business scenario in which the first electronic device is currently located in real time. Figure 8 , the perception module in the notification application can complete the above data acquisition action. The above data includes but is not limited to order information, current location, system time, interaction status and clipboard data. The above order information, current location, system time, interaction status and clipboard data can be found in Figure 8 The introduction of , will not be repeated here.

[0263] For example, at time T, the state data acquired by the perception module may be as shown in the following table (Table 2):

[0264] Table 2

[0265] Order Information Flight Order A Current Location Position S System time Time T Interaction State copy Clipboard data Hainan International Convention and Exhibition Center

[0266] The flight order A may represent the order information of a flight ticket reserved by the user obtained by the first electronic device from the flight application. Figure 4E The first electronic device may obtain the user's flight information from the flight order.

[0267] The location S may indicate the current geographical location of the first electronic device as location S. The location S may be longitude and latitude data indicating a location. The map application installed on the first electronic device may convert the longitude and latitude data into a location that is easy for the user to understand, such as Figure 5G Alternatively, the position S may be a converted location, such as the location A.

[0268] The time T is the current time of the first electronic device and may also be the time when the first electronic device obtains the current location, interaction state, and clipboard data.

[0269] The first electronic device can detect user interactions with the first electronic device. The "copy" operation described above may indicate that, at time T, the first electronic device detected a copy operation on content displayed on the first electronic device. Additionally, the first electronic device can also detect click operations, long press operations, double-click operations, and application switching operations on controls displayed in the user interface, all of which are omitted here.

[0270] After detecting the "copy" operation, the first electronic device's clipboard may write the copied data selected by the user. The above data includes but is not limited to text. The language used in the above text is not limited to Chinese, English, Japanese, German, French, etc. For example, referring to Figure 5B In the user interface shown, after detecting the copy operation, the copied text "Hainan International Convention and Exhibition Center" can be written into the clipboard of the first electronic device.

[0271] S102: Determine whether the above status data triggers a preset service.

[0272] There are multiple scenarios in which the first electronic device uses a floating ball to provide notification services to users. For example, the aforementioned scenario of displaying a flight floating ball to provide users with quick access to flight information, displaying a subway floating ball to provide users with quick access to subway QR codes, and displaying a translation floating ball to provide users with instant translation services, etc.

[0273] Based on the characteristics of various service scenarios, the first electronic device may be configured with trigger conditions for various services, i.e., the conditions for displaying the corresponding floating ball. During step S101, the first electronic device may obtain status data reflecting its current state and then determine whether the status data satisfies the conditions for displaying a specific type of floating ball. If so, the first electronic device may determine to display the corresponding floating ball.

[0274] Refer to the above Figure 8 As described above, the service identification module can be pre-set with service types and corresponding trigger conditions (Table 1). After receiving the status data sent by the perception module, the service identification module searches for services that match the status data. When a service that matches the status data is found, the service identification module can send service indication information to the service module.

[0275] For example, after receiving the status data shown in Table 2, the first electronic device may query Table 1 for services that match the above status data. Assume that location S is within the geographical scope of airport S1. The above-mentioned airport S1 is the airport where the flight booked by the user departs. Airport S1 also includes the airport subway station. At the same time, location S is also within the geographical scope of the airport subway station. Time T is within the check-in time range of the flight booked by the user. At this time, the service identification module can confirm the display of the flight floating ball. At the same time, the service identification module can also confirm the display of the subway floating ball; according to the interaction status "copy" in Table 2 and the English text in the clipboard data, the service identification module can also confirm the triggering of the display of the translation floating ball.

[0276] S103: Construct a floating ball matching the triggered service.

[0277] After determining the triggered service, the service identification module can send service indication information to the service module. This service indication information may include displaying a flight hover ball, displaying a subway hover ball, and displaying a translation hover ball. The flight module, subway module, and translation module in the service module can receive the display flight hover ball indication information, display subway hover ball indication information, and display translation hover ball indication information, respectively.

[0278] After each service module receives the service indication information, the above-mentioned each service module may display, hide, terminate or expand the floating ball of the corresponding service according to the above-mentioned service indication information and the preset service logic.

[0279] For example, in response to receiving an instruction to display a flight hover ball, the flight module can determine the user's order information. This order information includes flight information for the booked flight, such as the flight number, date, departure point, and takeoff time. Based on this flight information, the flight module can determine the prompt information to be displayed in the flight hover ball, such as flight information such as the check-in counter, boarding gate, and seat number. At the same time, the flight module can determine a page link. This page link is a link to a page in the flight application that displays the user's flight order. The flight module can use this page link to obtain and display the page in the flight application that displays the user's flight order.

[0280] After determining the user's flight information, the flight module can send the floating ball parameters to the floating ball management module. The above floating ball parameters include but are not limited to status, business number (ID), display content, and callback interface. The above floating ball parameters can be referred to Figure 8 The introduction of , will not be repeated here.

[0281] At this time, the flight module can send the floating ball parameters to the floating ball management module as shown in the following table (Table 3):

[0282] Table 3

[0283]

[0284] S104: Displaying the floating ball according to the floating ball parameters.

[0285] After receiving the floating ball parameters sent by the business module, the floating ball management module can display, hide, terminate or expand the floating ball according to the above floating ball parameters.

[0286] For example, after receiving the floating ball parameters shown in Table 3, the floating ball management module can construct a floating ball X, such as Figure 4C The flight floating ball 413 is shown, and the window manager is controlled to display the above-mentioned floating ball X.

[0287] The floating ball number X can be the floating ball ID (0001), or other numbers associated with the floating ball ID. The floating ball management module locates the floating ball X through the floating ball number or the floating ball ID.

[0288] Then, the floating ball management module can determine that the application icon displayed in the floating ball X is the icon of the flight application. At the same time, the prompt information displayed in the floating ball X is "check-in counter, boarding gate or seat number". Figure 4C Alternatively, the prompt information displayed in the floating ball X rotates the check-in counter, boarding gate, and seat number.

[0289] The floating ball X also includes a callback interface A. After detecting a user operation on the floating ball X, the floating ball X can send an indication signal to the corresponding business module through the callback interface A. For example, Figure 4C In the scenario shown, after detecting the user operation on the floating ball 413, the floating ball 413 can send an indication signal to the flight module through the callback interface A. The indication signal can trigger the flight module to display Figure 4E The user interface shown, or instructions to run the flight application, and then display the user's flight orders, etc.

[0290] In this way, the first electronic device detects the current state. When multiple types of services are triggered, the first electronic device can display multiple floating balls. In this way, the user can obtain prompt information of multiple floating balls at the same time.

[0291] Figure 11 A schematic diagram of the hardware structure of a first electronic device is shown.

[0292] The first electronic device may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0293] It should be understood that the structures illustrated in the embodiments of the present invention do not constitute specific limitations on the first electronic device. In other embodiments of the present application, the first electronic device may include more or fewer components than illustrated, or may combine or separate certain components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0294] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0295] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.

[0296] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.

[0297] The charging management module 140 is configured to receive charging input from a charger. The power management module 141 is configured to connect the battery 142 , the charging management module 140 and the processor 110 .

[0298] The wireless communication function of the first electronic device can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0299] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the first electronic device can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.

[0300] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the first electronic device. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0301] The modem processor may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.) or displays an image or video through the display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

[0302] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied on the first electronic device. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0303] In an embodiment of the present application, the first electronic device can obtain flight orders in the flight application, display the subway boarding code, browse foreign web pages, etc. based on the communication services provided by the mobile communication module 150 and / or the wireless communication module 160.

[0304] In some embodiments, antenna 1 of the first electronic device is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, so that the first electronic device can communicate with a network and other devices via wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), Beidou navigation satellite system (BDS), quasi-zenith satellite system (QZSS) and / or satellite based augmentation system (SBAS).

[0305] In an embodiment of the present application, the first electronic device can achieve real-time positioning based on the above-mentioned wireless communication technology, thereby obtaining positioning data indicating the user's current geographical location.

[0306] The first electronic device implements display functionality through a GPU, display screen 194, and an application processor. The GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.

[0307] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD). The display panel can also be made of an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a mini-LED, a micro-LED, a micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device can include one or N display screens 194, where N is a positive integer greater than one.

[0308] In the embodiment of the present application, the first electronic device displays Figures 4A-4N 、 Figures 5A-5K 、 Figures 6A-6O The user interface shown relies on the display capabilities provided by the aforementioned GPU, display screen 194, and application processor, etc.

[0309] The first electronic device can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.

[0310] The internal memory 121 may include one or more random access memories (RAM) and one or more non-volatile memories (NVM).

[0311] Random access memory can include static random-access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM, for example, the fifth generation of DDR SDRAM is generally referred to as DDR5 SDRAM), etc. Non-volatile memory can include disk storage devices and flash memory.

[0312] The random access memory can be directly read and written by the processor 110 and can be used to store executable programs (such as machine instructions) of the operating system or other running programs, and can also be used to store user and application data. Non-volatile memory can also store executable programs and user and application data, and can be pre-loaded into the random access memory for direct reading and writing by the processor 110.

[0313] In an embodiment of the present application, the code of the notification application may be stored in a non-volatile memory. When running the notification application, the first electronic device may load the code of the notification application into a random access memory, and then execute the notification application to implement the floating ball processing method in a multi-tasking scenario provided by the notification application.

[0314] The external memory interface 120 can be used to connect to an external non-volatile memory to expand the storage capacity of the first electronic device. The external non-volatile memory communicates with the processor 110 through the external memory interface 120 to implement data storage function.

[0315] The first electronic device can implement audio functions such as music playback and recording through the audio module 170 , the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0316] The pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. The gyroscope sensor 180B can be used to determine the motion posture of the first electronic device. The air pressure sensor 180C is used to measure air pressure. The magnetic sensor 180D includes a Hall effect sensor. The first electronic device can use the magnetic sensor 180D to implement functions such as magnetic attachment. The acceleration sensor 180E can detect the magnitude of the acceleration of the first electronic device in various directions (generally three axes). When the first electronic device is stationary, it can detect the magnitude and direction of gravity. The acceleration sensor 180E can also be used to identify the posture of the electronic device. The distance sensor 180F is used to measure distance. The proximity light sensor 180G may include, for example, a light-emitting diode (LED) and a light detector, such as a photodiode. The first electronic device can use the proximity light sensor 180G to detect when a user is holding the first electronic device close to their ear to talk, thereby automatically turning off the screen. The proximity light sensor 180G can also be used for automatic unlocking and locking. The ambient light sensor 180L is used to sense ambient light brightness. The fingerprint sensor 180H is used to collect fingerprints. The temperature sensor 180J is used to detect temperature.

[0317] The touch sensor 180K is also referred to as a "touch-sensitive device." The touch sensor 180K can be disposed on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also referred to as a "touch screen." The touch sensor 180K is used to detect touch operations applied thereto or in the vicinity thereof. The touch sensor can transmit the detected touch operations to the application processor to determine the type of touch event. Visual output related to the touch operations can be provided via the display screen 194. In other embodiments, the touch sensor 180K can also be disposed on the surface of the first electronic device, at a location different from that of the display screen 194.

[0318] In the embodiment of the present application, the first electronic device detects whether there is an effect on Figures 4A-4H 、 Figures 5A-5I or Figures 6A-6I User operation of the controls in the illustrated user interface relies on the touch detection capabilities provided by the touch sensor 180K.

[0319] The bone conduction sensor 180M can obtain vibration signals. The button 190 includes a power button, a volume button, etc. The button 190 can be a mechanical button. It can also be a touch button. The first electronic device can receive the key input and generate a key signal input related to the user settings and function control of the first electronic device. The motor 191 can generate a vibration prompt. When the first electronic device displays a floating ball, the first electronic device can also use the motor 191 at the same time to strengthen the prompt. The indicator 192 can be an indicator light, which can be used to indicate the charging status, power changes, and can also be used to indicate messages, missed calls, notifications, etc.

[0320] SIM card interface 195 is used to connect a SIM card. A SIM card can be inserted into or removed from SIM card interface 195 to connect to and disconnect from the first electronic device. The first electronic device may support one or N SIM card interfaces, where N is a positive integer greater than one.

[0321] The term "user interface (UI)" in the specification, claims and drawings of this application refers to the media interface for interaction and information exchange between an application or operating system and a user, which realizes the conversion between the internal form of information and the form acceptable to the user. The user interface of an application is a source code written in a specific computer language such as Java and Extensible Markup Language (XML). The interface source code is parsed and rendered on the terminal device, and finally presented as content that the user can recognize, such as pictures, text, buttons and other controls. Controls, also known as widgets, are the basic elements of the user interface. Typical controls include toolbars, menu bars, text boxes, buttons, scroll bars, pictures and text. The properties and contents of controls in the interface are defined by tags or nodes, such as XML through <textview> 、 <imgview> 、

[0322] <videoview>The controls contained in the interface are specified by nodes such as .a node corresponds to a control or attribute in the interface, and the node is presented as user-visible content after parsing and rendering. In addition, many applications, such as hybrid applications, usually also contain web pages in their interfaces. A web page, also called a page, can be understood as a special control embedded in the application interface. A web page is a source code written in a specific computer language, such as hypertext markup language (GTML), cascading style sheets (CSS), JavaScript (JS), etc. The web page source code can be loaded and displayed as user-recognizable content by a browser or a web page display component with similar functions to a browser. The specific content contained in a web page is also defined by tags or nodes in the web page source code, such as GTML through 、 、 <video> 、 <canvas>To define the elements and attributes of a web page.

[0323] A common form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operations that uses graphics. It can be an icon, window, control, or other interface element displayed on the display of an electronic device. Controls can include icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, and other visual interface elements.

[0324] As used in the specification and appended claims of the present application, the singular expressions "a", "an", "said", "above", "the" and "this" are intended to include plural expressions as well, unless the context clearly indicates otherwise. It should also be understood that the term "and / or" used in the present application refers to and includes any or all possible combinations of one or more listed items. As used in the above embodiments, the term "when..." can be interpreted to mean "if..." or "after..." or "in response to determining..." or "in response to detecting...". Similarly, the phrase "when determining..." or "if (stated condition or event) is detected" can be interpreted to mean "if determining..." or "in response to determining..." or "when (stated condition or event) is detected" or "in response to detecting (stated condition or event)", depending on the context.

[0325] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one website, computer, server or data center to another website, computer, server or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrations. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk).

[0326] Those skilled in the art will appreciate that all or part of the process steps in the above-described method embodiments can be implemented by a computer program instructing the relevant hardware. The program can be stored in a computer-readable storage medium, and when executed, the program can include the process steps in the above-described method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.< / canvas> < / video> < / videoview> < / imgview> < / textview>

Claims

1. A multi-task interaction method, applied to an electronic device, characterized in that: The method comprises: When displaying a first interface, when detecting that the electronic device meets a first preset condition, displaying a first floating ball on the first interface; wherein the first interface is a home page or a user interface of a third application, the first floating ball displays an identifier and first information of the first application, and the first application is different from the third application; When a first floating ball is displayed on the first interface, it is detected that the electronic device meets a second preset condition, and a second floating ball is displayed simultaneously with the first floating ball on the first interface; wherein the second floating ball displays an identifier of a second application and second information, the first preset condition and the second preset condition are different, the first application and the second application are different, and the second application and the third application are different; detecting a second user operation on the first floating ball; In response to the second user operation, the first application interface is displayed, the first floating ball stops being displayed, and the second floating ball continues to be displayed on the first application interface. The first application interface displays third information, and the third information includes the first information, or the third information is associated with the first information.

2. The method according to claim 1, characterized in that The second suspended ball is displayed above the first suspended ball.

3. The method according to claim 1 or 2, characterized in that The method further comprises: Within a first time period after the first floating ball is displayed, no user operation on the first floating ball is detected, and a thumbnail of the first floating ball is displayed; the thumbnail of the first floating ball includes the identifier of the first application but does not include the first information.

4. The method according to claim 3, characterized in that The method further comprises: Within a second time period after the second floating ball is displayed, no user operation on the second floating ball is detected, and a thumbnail of the second floating ball is displayed; the thumbnail of the second floating ball includes the identifier of the second application but does not include the second information.

5. The method according to claim 4, characterized in that The first duration is equal to the second duration.

6. The method according to claim 4 or 5, characterized in that The display of the second floating ball in a thumbnail state includes: when other floating balls in a thumbnail state are also displayed on the first interface, aggregating the second floating ball in the thumbnail state and the other floating balls in the thumbnail state into a third floating ball; wherein the logo of the second application is displayed in the third floating ball.

7. The method according to claim 6, characterized in that The third suspended ball includes indication information, where the indication information is used to indicate that the third suspended ball is an aggregated suspended ball including multiple suspended balls.

8. The method according to claim 7, characterized in that The method further comprises: detecting a first user operation on the third floating ball; In response to the first user operation, the plurality of floating balls are displayed.

9. The method according to claim 1, characterized in that The first information is a check-in reminder for a flight booked by the user, and the first preset condition includes: obtaining a notification of the flight, and the current time of the electronic device is within the check-in time range of the flight; Alternatively, the first information is a boarding reminder for a flight booked by the user, and the first preset condition includes: obtaining a notification of the flight, the current time of the electronic device being within the waiting time range of the flight, and the current location of the electronic device being within the geographical range of the departure airport of the flight; Alternatively, the first information is a subway boarding reminder, and the first preset condition includes: the current location of the electronic device is within the geographical range of the subway station; Alternatively, the first information is a translation prompt, and the first preset condition includes: a copy operation is detected, and the language used in the copied content is not a common language of the system.

10. The method according to claim 1, characterized in that The method further comprises: Within a third time period after the first floating ball is displayed, no user operation on the first floating ball is detected, and the display of the first floating ball is terminated.

11. The method according to claim 10, characterized in that The step of: not detecting a user operation on the first floating ball within a third time period after the first floating ball is displayed, and terminating the display of the first floating ball, includes: Within a fourth time period after the first floating ball is displayed, no user operation on the first floating ball is detected, and the first floating ball is displayed in a thumbnail state; The first floating ball in the abbreviated state includes an identifier of the first application but does not include the first information; the first floating ball in the abbreviated state also includes a countdown identifier, which is used to indicate the remaining display time of the first floating ball in the abbreviated state; the third duration is equal to the sum of the fourth duration and the countdown duration indicated by the countdown identifier; When the countdown mark indicates that the timing is over, the display of the first floating ball is stopped.

12. The method according to claim 10 or 11, characterized in that The first information is a navigation prompt, and the first preset condition includes: a copy operation is detected, and the copied content indicates a first location on a map; The first information is a dialing prompt, and the first preset condition includes: a copy operation is detected, and the copied content includes a first telephone number.

13. The method according to claim 1, wherein The first application interface displays a graphic code, and the graphic code does not overlap with the second floating ball; the graphic code includes a QR code and a bar code.

14. The method according to claim 1, wherein A fourth floating ball and a fifth floating ball are further displayed on the first interface, wherein the fourth floating ball covers the fifth floating ball. The method further includes: detecting a third user operation on the first interface; In response to the third user operation, the fourth floating ball and the fifth floating ball are displayed, and the fifth floating ball is not covered by the fourth floating ball.

15. The method according to claim 1, wherein The method further comprises: detecting a fourth user operation on the first floating ball or the second floating ball; In response to the fourth user operation, the first floating ball and the second floating ball are displayed at a first position of the first interface, wherein the first position is a position where the fourth user operation is terminated.

16. An electronic device, characterized in that: The method comprises one or more processors and one or more memories; wherein the one or more memories are coupled to the one or more processors, and the one or more memories are used to store computer program code, wherein the computer program code comprises computer instructions, and when the one or more processors execute the computer instructions, the method according to any one of claims 1 to 15 is executed.

17. A computer-readable storage medium comprising instructions, characterized in that: When the instructions are executed on an electronic device, the method according to any one of claims 1 to 15 is executed.

Images