Application flow transfer method and electronic device
By detecting the three-finger swipe speed on the application interface, displaying the flow interface and shrinking the application interface, users can directly drag the application to the target device, solving the problem of cumbersome operation in the existing technology and improving the convenience of application flow and user experience.
Patent Information
- Application Number
- CN202211465498.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-11-22
- Publication Date
- 2025-11-21
- Estimated Expiration
- 2042-11-22
AI Technical Summary
Users need to manually download and log in to applications when switching devices, which is cumbersome and time-consuming. Existing technologies cannot easily address this technical challenge, thus affecting the user experience.
When a three-finger swipe gesture is detected on the application interface, and the speed of the gesture is greater than or equal to a speed threshold, a transition interface is displayed. When the application interface is shrunk to a preset size, a second transition interface is displayed, which includes the application icon and the target device icon. Users can drag the application icon to the target device to transition.
It facilitates application workflow, reduces operation time, and improves user experience.
Smart Images

Figure CN118069005B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the terminal field, and in particular to an application flow transfer method and an electronic device. BACKGROUND
[0002] With the development of terminal technology, the application of the terminal is more and more rich, and the use scene is more and more extensive. At present, when a user uses a certain application on a single device, if the user needs to switch the device to continue using the application, the user needs to download and start the application on another terminal. In the starting process, the user also needs to log in to the application and other operations, so that the application can obtain the historical data of the user, so as to continue to use the application on the terminal. However, this method needs to manually restore the previous application use state through the history record, which is tedious and time-consuming, and affects the user experience. SUMMARY
[0003] The present application provides an application flow transfer method, which is convenient to operate and short in time consumption, and improves the user experience.
[0004] In a first aspect, the present application provides an application flow transfer method. The method comprises: an electronic device detects whether the moving speed of a three-finger up sliding operation on a first application interface is greater than or equal to a first threshold value in response to the received three-finger up sliding operation; wherein the first application interface displays first application content of a first application; the electronic device detects that the moving speed of the three-finger up sliding operation is greater than or equal to the first threshold value, displays a first flow transfer interface, moves the first application interface to a first position, and gradually reduces the first application interface in the process of moving the first application interface to the first position; wherein the first flow transfer interface is under the first application interface; when the first application interface moves to the first position and is reduced to a first size, the electronic device displays a second flow transfer interface; wherein the second flow transfer interface comprises a first application icon, an electronic device icon, and an icon of at least one other electronic device; the electronic device moves the first application icon in response to receiving a drag operation on the first application icon; the electronic device detects that the first application icon moves to the icon of a target device, and transfers the first application to the target device, so that the target device displays the first application interface, and the first application interface continues to display the first application content on the target device. In this way, the present application can trigger the application flow transfer function through a specific gesture, realize the animation effect of the application flow transfer function start, and trigger the application flow transfer function through a simple operation, effectively reduce the operation time consumption, and improve the user experience.
[0005] For example, the first flow transfer interface is a flow transfer transition interface in the present application. The second flow transfer interface is a task flow transfer interface in the present application.
[0006] In a possible implementation, the electronic device, in response to the received three-finger upward sliding operation on the first application interface, detects whether the moving speed of the three-finger upward sliding operation is greater than or equal to a first threshold value, including: the electronic device, in response to the received three-finger upward sliding operation on the first application interface, detects whether the moving speed of the three-finger upward sliding operation is greater than or equal to the first threshold value within a preset sliding distance; when the moving speed of the three-finger upward sliding operation is less than the first threshold value, the electronic device moves the first application interface following the three-finger upward sliding operation, and gradually reduces the first application interface as the upward sliding distance of the three-finger upward sliding operation increases, while continuously detecting whether the moving speed of the three-finger upward sliding operation is greater than or equal to the first threshold value within the preset sliding distance. In this way, within the preset sliding distance, the electronic device can realize application interface hand tracking before the user's three-finger sliding reaches the speed threshold.
[0007] In a possible implementation, the electronic device detects that the moving speed of the three-finger upward sliding operation is greater than or equal to the first threshold value, displays the first transition interface, and moves the first application interface to the first position, and gradually reduces the first application interface in the process of moving the first application interface to the first position, including: within the preset sliding distance, the first application interface moves to a second position following the three-finger upward sliding operation, and when the first application interface is reduced to a second size, it is detected that the moving speed of the three-finger upward sliding operation is greater than or equal to the first threshold value, the first transition interface is displayed, and the first application interface is moved from the second position to the first position, and in the process of moving the first application interface from the second position to the first position, the first application interface is gradually reduced from the second size to the first size. In this way, the electronic device can start the automatic playing process of the transition interface by monitoring the three-finger sliding speed in real time within the preset distance, and can start the automatic playing process of the transition interface after detecting that the sliding speed reaches the threshold value.
[0008] In a possible implementation, the electronic device, in response to the received three-finger upward sliding operation on the first application interface, detects whether the moving speed of the three-finger upward sliding operation is greater than or equal to a first threshold value, including: the electronic device, in response to the received three-finger upward sliding operation on the first application interface, determines to trigger the application transition function; the electronic device draws the first transition interface, and the electronic device draws the second transition interface, and the electronic device detects whether the moving speed of the three-finger upward sliding operation is greater than or equal to the first threshold value; wherein the position of the first application icon in the second transition interface corresponds to the first position of the first application interface in the first transition interface. In this way, the electronic device can realize the advance drawing of the task transition interface by synchronously drawing the task transition interface, and avoid interface lag when switching the task transition interface.
[0009] In a possible implementation, when the first application interface moves to the first position and is reduced to the first size, the electronic device displays the second flow interface, including: the electronic device detects that the first application interface moves to the first position and is reduced to the first size, determines that the display condition of the second flow interface is met, and displays the second flow interface that has been drawn. In this way, the electronic device can realize the early drawing of the task flow interface by synchronously drawing the task flow interface, and avoid interface lag when switching the task flow interface.
[0010] In a possible implementation, when the first application interface moves to the first position and is reduced to the first size, the electronic device displays the second flow interface, including: the electronic device displays the second flow interface according to a preset motion effect. In this way, the preset motion effect can be set to enrich the effect when the second flow interface enters, and improve the user experience.
[0011] In a possible implementation, when the first application interface moves to the first position and is reduced to the first size, the electronic device displays the second flow interface, including: the electronic device cancels the display of the first flow interface. Optionally, the electronic device can hide the first flow interface.
[0012] In a possible implementation, before the electronic device receives the three-finger up sliding operation, the first application interface is displayed full screen on the display screen of the electronic device. Optionally, the first application interface can also be displayed in the form of a floating window or a split screen.
[0013] In a possible implementation, in the process of moving the first application interface to the first position, the first application interface is gradually reduced, including: the four edges of the first application interface are reduced in equal ratio. In this way, the first application interface can be reduced in equal ratio following the user gesture, until it is reduced to a preset size, for example, a capsule size. Then, the first application interface is converted into an application icon, to improve the animation display effect and further improve the user experience.
[0014] In a second aspect, the present application provides an electronic device, comprising one or more processors, a memory, and one or more computer programs, wherein the one or more computer programs are stored in the memory and, when the computer programs are executed by the one or more processors, cause the electronic device to perform the following steps: in response to a received three-finger upward sliding operation on a first application interface, detecting whether a moving speed of the three-finger upward sliding operation is greater than or equal to a first threshold; wherein the first application interface displays first application content of a first application; when it is detected that the moving speed of the three-finger upward sliding operation is greater than or equal to the first threshold, displaying a first flow interface, moving the first application interface to a first position, and gradually reducing the first application interface in the process of moving the first application interface to the first position; wherein the first flow interface is under the first application interface; when the first application interface is moved to the first position and reduced to a first size, displaying a second flow interface; wherein the second flow interface comprises a first application icon, an electronic device icon, and an icon of at least one other electronic device; in response to a received dragging operation on the first application icon, moving the first application icon; when it is detected that the first application icon is moved to an icon of a target device, flowing the first application to the target device, so that the target device displays the first application interface and the first application interface continues to display the first application content on the target device.
[0015] In a possible implementation, in response to a received three-finger upward sliding operation on a first application interface, detecting whether a moving speed of the three-finger upward sliding operation is greater than or equal to a first threshold comprises: in response to the received three-finger upward sliding operation on the first application interface, detecting whether the moving speed of the three-finger upward sliding operation is greater than or equal to the first threshold within a preset sliding distance; when the moving speed of the three-finger upward sliding operation is less than the first threshold, moving the first application interface following the three-finger upward sliding operation, gradually reducing the first application interface as a sliding distance of the three-finger upward sliding operation increases, and continuously detecting whether the moving speed of the three-finger upward sliding operation is greater than or equal to the first threshold within the preset sliding distance.
[0016] In a possible implementation, when it is detected that the moving speed of the three-finger upward sliding operation is greater than or equal to the first threshold, displaying a first flow interface and moving the first application interface to a first position, and gradually reducing the first application interface in the process of moving the first application interface to the first position comprises: within the preset sliding distance, when the first application interface is moved to a second position following the three-finger upward sliding operation and reduced to a second size, it is detected that the moving speed of the three-finger upward sliding operation is greater than or equal to the first threshold, the first flow interface is displayed, and the first application interface is moved from the second position to the first position, and the first application interface is gradually reduced from the second size to the first size in the process of moving the first application interface from the second position to the first position.
[0017] In a possible implementation, in response to the received three-finger upward sliding operation on the first application interface, detecting whether the moving speed of the three-finger upward sliding operation is greater than or equal to a first threshold value comprises: in response to the received three-finger upward sliding operation on the first application interface, determining to trigger the application flow switching function; drawing the first flow switching interface and the second flow switching interface, and detecting whether the moving speed of the three-finger upward sliding operation is greater than or equal to the first threshold value; wherein the position of the first application icon in the second flow switching interface corresponds to the first position of the first application interface in the first flow switching interface.
[0018] In a possible implementation, when the first application interface moves to the first position and is reduced to the first size, displaying the second flow switching interface comprises: detecting that the first application interface moves to the first position and is reduced to the first size, determining that a display condition of the second flow switching interface is met, and displaying the second flow switching interface that has been drawn.
[0019] In a possible implementation, when the first application interface moves to the first position and is reduced to the first size, displaying the second flow switching interface comprises: displaying the second flow switching interface according to a preset motion effect.
[0020] In a possible implementation, when the first application interface moves to the first position and is reduced to the first size, displaying the second flow switching interface comprises: canceling display of the first flow switching interface.
[0021] In a possible implementation, before the three-finger upward sliding operation is received, the first application interface is displayed in full screen in the display screen.
[0022] In a possible implementation, in the process of moving the first application interface to the first position, the first application interface is gradually reduced, comprising: the four edges of the first application interface are reduced in equal ratio.
[0023] In a third aspect, an embodiment of the present application provides a computer readable medium for storing a computer program, the computer program comprising instructions for executing the method in the first aspect or any possible implementation manner of the first aspect.
[0024] In a fourth aspect, an embodiment of the present application provides a computer program, the computer program comprising instructions for executing the method in the first aspect or any possible implementation manner of the first aspect.
[0025] In a fifth aspect, an embodiment of the present application provides a chip, comprising a processing circuit, a receiving pin and a sending pin. The receiving pin, the processing circuit and the sending pin communicate with each other through an internal connection path. The processing circuit executes the method in the first aspect or any possible implementation manner of the first aspect to control the receiving pin to receive a signal and control the sending pin to send a signal. BRIEF DESCRIPTION OF DRAWINGS
[0026] Figure 1 An exemplary schematic diagram of an electronic device hardware structure is shown;
[0027] Figure 2 An exemplary schematic diagram of an electronic device software structure is shown;
[0028] Figure 3 An exemplary schematic diagram of an effect is shown;
[0029] Figure 4 An exemplary schematic diagram of an application flow transfer method is shown;
[0030] Figure 5 An exemplary schematic diagram of a task flow transfer function triggering process is shown;
[0031] Figure 6 An exemplary schematic diagram of module interaction is shown;
[0032] Figure 7 An exemplary schematic diagram of a user interface is shown;
[0033] Figure 8 An exemplary schematic diagram of a user interface is shown;
[0034] Figure 9 An exemplary schematic diagram of a user interface is shown;
[0035] Figure 10 An exemplary schematic diagram of a task flow transfer interface display flowchart is shown;
[0036] Figure 11 An exemplary schematic diagram of a process of obtaining control authority of a foreground application interface is shown;
[0037] Figure 12 An exemplary schematic diagram of a process of obtaining control authority of a foreground application interface is shown;
[0038] Figure 13 An exemplary schematic diagram of an application flow transfer method is shown;
[0039] Figure 14 An exemplary schematic diagram of a task flow transfer interface interruption process is shown;
[0040] Figure 15 An exemplary schematic diagram of a user interface is shown;
[0041] Figure 16 An exemplary schematic diagram of a task flow transfer method in this embodiment is shown;
[0042] Figure 17 An exemplary schematic diagram of interface changes in a task flow transfer process on a mobile phone is shown;
[0043] Figure 18 An example diagram illustrating a process of recognizing a first gesture by a mobile phone;
[0044] Figure 19 An example diagram illustrating a structure of an apparatus. DETAILED DESCRIPTION
[0045] The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, but not all of the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the scope of the present application.
[0046] The term "and / or" in the present application is only used to describe an association relationship of associated objects, and means that there can be three relationships, for example, A and / or B can mean that A exists alone, A and B exist together, and B exists alone.
[0047] The terms "first" and "second" and the like in the description and claims of the embodiments of the present application are used to distinguish different objects, and are not used to describe a specific order of the objects. For example, the first target object and the second target object are used to distinguish different target objects, and are not used to describe a specific order of the target objects.
[0048] In the embodiments of the present application, the words "exemplary" or "for example" are used to mean serving as an example, instance, or illustration. Any embodiment or design solution described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or advantageous than other embodiments or design solutions. Rather, the use of the words "exemplary" or "for example" is intended to present the relevant concept in a specific manner.
[0049] In the description of the embodiments of the present application, unless otherwise specified, the meaning of "a plurality of" is two or more. For example, a plurality of processing units means two or more processing units; a plurality of systems means two or more systems.
[0050] Figure 1 An example diagram illustrating a structure of an electronic device 100 is shown. It should be understood that, Figure 1 The electronic device 100 shown is only an example of an electronic device, and the electronic device 100 can have more or fewer components than shown in the figure, can combine two or more components, or can have a different component configuration. Figure 1The various components shown in the middle can be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application-specific integrated circuits. In this embodiment, only the application flow between the mobile phone and the tablet is taken as an example for description, and in other embodiments, the application flow method in this embodiment can also be applied between any devices such as mobile phones, smart wearable devices, smart home devices, vehicle-mounted devices, tablets, computers, and the like, and the application is not limited.
[0051] The electronic device 100 can include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charge management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headset interface 170D, a sensor module 180, a key 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 can include a pressure sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, etc.
[0052] The processor 110 can include one or more processing units, for example: the processor 110 can include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units can be independent devices or integrated into one or more processors.
[0053] The controller can be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to instruction operation codes and timing signals to complete the control of fetching instructions and executing instructions.
[0054] The processor 110 can also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The cache memory can hold instructions or data that the processor 110 has recently used or is likely to use again. If the processor 110 needs to use the instructions or data again, it can be retrieved directly from the cache memory. This avoids repeated accesses to the main memory, reducing the latency of the processor 110 and thus improving the efficiency of the system.
[0055] The charging management module 140 is configured to receive charging input from a charger. The charger can be a wireless charger or a wired charger. In some embodiments of wired charging, the charging management module 140 can receive charging input from a wired charger through the USB interface 130. In some embodiments of wireless charging, the charging management module 140 can receive wireless charging input through a wireless charging coil of the electronic device 100. The charging management module 140 can charge the battery 142 while also providing power to the electronic device through the power management module 141.
[0056] The power management module 141 is configured to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to provide power to the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be configured to monitor parameters such as battery capacity, battery cycle count, battery health status (leakage, impedance), etc. In other embodiments, the power management module 141 can also be disposed in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be disposed in the same device.
[0057] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, and the baseband processor, etc.
[0058] The antenna 1 and the antenna 2 are configured to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 100 can be configured to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example, the antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in combination with a tuning switch.
[0059] The mobile communication module 150 can provide a solution for wireless communication including 2G / 3G / 4G / 5G, etc. applied to the electronic device 100. The mobile communication module 150 can include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive an electromagnetic wave by the antenna 1, and perform filtering, amplification, etc. on the received electromagnetic wave, and transfer the processed electromagnetic wave to the modem processor to be demodulated. The mobile communication module 150 can also amplify a signal modulated by the modem processor, and radiate the amplified signal as an electromagnetic wave through the antenna 1. In some embodiments, at least part of the function modules of the mobile communication module 150 can be disposed in the processor 110. In some embodiments, at least part of the function modules of the mobile communication module 150 can be disposed in the same device as at least part of the modules of the processor 110.
[0060] The wireless communication module 160 can provide a solution for wireless communication including wireless local area networks (WLAN) (e.g., wireless fidelity (Wi-Fi) network), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) technology, etc. applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrated with at least one communication processing module. The wireless communication module 160 receives an electromagnetic wave via the antenna 2, performs frequency modulation and filtering on the electromagnetic wave signal, and transmits the processed signal to the processor 110. The wireless communication module 160 can also receive a signal to be transmitted from the processor 110, perform frequency modulation and amplification on the signal, and radiate the processed signal as an electromagnetic wave through the antenna 2.
[0061] In some embodiments, the antenna 1 of the electronic device 100 is coupled with the mobile communication module 150, and the antenna 2 is coupled with the wireless communication module 160, so that the electronic device 100 can communicate with a network and other devices through wireless communication technology.
[0062] The electronic device 100 implements a display function through a GPU, a display screen 194, an application processor, etc. The GPU is a microprocessor for image processing, which is connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 can include one or more GPUs that execute program instructions to generate or change display information.
[0063] The display 194 is configured to display images, videos, and the like. The display 194 includes a display panel. In some embodiments, the electronic device 100 can include one or N displays 194, where N is a positive integer greater than one.
[0064] The electronic device 100 can implement a photographing function through an ISP, the camera 193, a video codec, a GPU, the display 194, and an application processor, and the like.
[0065] The camera 193 is configured to capture still images or videos. An object generates an optical image through a lens and projects the optical image to a photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to an ISP to convert the electrical signal into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into an image signal in a standard format, such as RGB, YUV, and the like. In some embodiments, the electronic device 100 can include one or N cameras 193, where N is a positive integer greater than one.
[0066] The internal memory 121 can be configured to store computer-executable program codes including instructions. The processor 110 performs various functional applications and data processing of the electronic device 100 by executing the instructions stored in the internal memory 121. The internal memory 121 can include a program storage area and a data storage area. The program storage area can store an operating system, at least one application program required for a function (such as a sound play function, an image play function, and the like), and the like. The data storage area can store data (such as audio data, a phonebook, and the like) created during the use of the electronic device 100, and the like. In addition, the internal memory 121 can include a high-speed random access memory, and can further include a non-volatile memory such as at least one of a magnetic disk storage device, a flash memory device, a universal flash storage (UFS), and the like.
[0067] The electronic device 100 can implement an audio function through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, and an application processor, and the like. For example, music play, recording, and the like.
[0068] The audio module 170 is configured to convert digital audio information into an analog audio signal output, and to convert an analog audio input into a digital audio signal. The audio module 170 can also be configured to encode and decode audio signals. In some embodiments, the audio module 170 can be disposed in the processor 110, or some of the functions of the audio module 170 can be disposed in the processor 110.
[0069] The speaker 170A, also referred to as a "loudspeaker", is configured to convert an audio electrical signal into a sound signal. The electronic device 100 can listen to music or a hands-free call through the speaker 170A.
[0070] The receiver 170B, also referred to as a "earpiece", is configured to convert an audio electrical signal into a sound signal. When the electronic device 100 is engaged in a call or a voice message, a user can listen to the voice through the receiver 170B by placing the receiver 170B close to the ear.
[0071] The microphone 170C, also referred to as a "microphone", "microphone", is configured to convert a sound signal into an electrical signal. When making a call or sending a voice message, a user can speak into the microphone 170C by placing the mouth close to the microphone 170C, and input the sound signal into the microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In other embodiments, the electronic device 100 can be provided with two microphones 170C, in addition to collecting sound signals, it can also achieve noise reduction function. In other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C, in addition to collecting sound signals, noise reduction, it can also identify the source of the sound, and realize the function of directional recording, etc.
[0072] The earphone interface 170D is configured to connect a wired earphone. The earphone interface 170D can be a USB interface 130, or a 3.5mm open mobile terminal platform (OMTP) standard interface, a cellular telecommunications industry association of the USA (CTIA) standard interface.
[0073] The touch sensor, also referred to as a "touch panel". The touch sensor can be disposed on the display screen 194, and the touch sensor and the display screen 194 form a touch screen, also referred to as a "touch screen". The touch sensor is configured to detect a touch operation acting on or near the touch sensor. The touch sensor can transmit the detected touch operation to the application processor to determine the touch event type. The visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor can also be disposed on the surface of the electronic device 100, which is different from the position of the display screen 194.
[0074] The keys 190 include a power key, a volume key, and the like. The keys 190 can be mechanical keys. The keys 190 can also be touch keys. The electronic device 100 can receive a key input, and generate a key signal input related to user settings and function control of the electronic device 100.
[0075] The motor 191 can generate a vibration cue. The motor 191 can be used for a call vibration cue, and can also be used for a touch vibration feedback. The indicator 192 can be an indicator light, and can be used to indicate a charging state, a power change, and can also be used to indicate a message, a missed call, a notification, and the like.
[0076] The SIM card interface 195 is used to connect a SIM card.
[0077] The software system of the electronic device 100 can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. Embodiments of the present application take an Android system with a layered architecture as an example to exemplarily illustrate the software structure of the electronic device 100.
[0078] Figure 2 is a software structure block diagram of the electronic device 100 of an embodiment of the present application.
[0079] The layered architecture of the electronic device 100 divides software into several layers, each layer has a clear role and division of labor. The layers communicate with each other through a software interface. In some embodiments, the Android system has an application layer, an application framework layer, and a kernel layer, and the like from top to bottom.
[0080] Exemplarily, the application layer can include a series of application packages.
[0081] As shown in Figure 2 , the application packages can include video, control center, desktop (Launcher), settings, and the like.
[0082] The application framework layer provides an application programming interface (API) and a programming framework for the applications of the application layer. The application framework layer includes some pre-defined functions.
[0083] As shown in Figure 2 , the application framework layer can include a window manager (Window Manager), a view system, a resource manager, a notification manager, an input manager (Input Manager), an activity manager (Activity Manager), and the like.
[0084] The window manager is used to manage windows programs. The window manager can acquire the display screen size, determine whether there is a status bar, lock the screen, and capture the screen, etc.
[0085] The view system includes visual controls, such as a control for displaying text, a control for displaying pictures, etc. The view system can be used to build an application program. A display interface can be composed of one or more views. For example, a display interface including a short message notification icon can include a view for displaying text and a view for displaying pictures.
[0086] The resource manager provides various resources for an application program, such as localized strings, icons, pictures, layout files, video files, etc.
[0087] The notification manager enables an application program to display notification information in a status bar, which can be used to convey a message of the notification type, which can automatically disappear after a short stay without user interaction. For example, the notification manager is used to notify a download completion, a message reminder, etc. The notification manager can also be a notification in the form of a chart or a scroll bar text appearing in the top status bar of the system, such as a notification of an application program running in the background, and can also be a notification in the form of a dialog window appearing on the screen. For example, a text information is prompted in the status bar, a prompt sound is emitted, the electronic device is vibrated, a light flashes, etc.
[0088] The activity manager provides a system service for managing the running state of an Activity for Android, and is used to manage the running state of other components in Android. In addition, the activity manager can also be used to manage the life cycle of display, which determines how to control the logical display according to the currently connected physical display device and / or virtual display device, and sends notifications to the system and application programs when the state changes, etc.
[0089] The input manager is used to manage the input part of the entire system, including a keyboard, a mouse, a touch screen, etc.
[0090] The kernel layer is the layer between hardware and software. The kernel layer at least includes a display driver, a camera driver, an audio driver, a sensor driver, a Wi-Fi driver, etc.
[0091] It can be understood that, Figure 2 The layers in the software structure shown and the components included in each layer do not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 can include more or fewer layers than shown, and each layer can include more or fewer components, which are not limited in the present application.
[0092] The application embodiment provides an application flow transferring method. In the method, a user can transfer an application running on a first terminal to a second terminal through a simple operation on the first terminal. The user can continue to use the application through the second terminal. No download or manual starting process is needed, thereby providing an application flow transferring method with convenient operation and short time consumption, and improving user experience.
[0093] Figure 3 The effect schematic diagram is shown for example. Please refer to Figure 3 , a user uses a video application on a mobile phone. That is, the video application runs in the foreground of the mobile phone. The user can trigger an application flow transferring (also referred to as application task flow transferring) function in the application embodiment to transfer the video application running on the mobile phone to a tablet computer to continue running. Please refer to Figure 3 , for example, after the application flow transferring is completed, the video application is displayed on the display interface of the tablet computer, and the data of the video application displayed on the tablet computer is synchronized with that on the mobile phone. For example, before the application flow transferring is performed on the mobile phone, the video application is playing the 7th episode of a TV series. After the video application on the mobile phone is transferred to the tablet computer, the video application displayed on the tablet computer also displays the picture of the 7th episode of the TV series. In this way, the tablet computer does not need to perform the operation of manually downloading and starting the video application, and can automatically restore the historical data of the video application on the mobile phone to run the video application. It should be noted that the application flow transferring scenario of the video application is only used for example in the application embodiment. In other embodiments, the application flow transferring method in the application embodiment can also be applied to the flow transferring of other applications, which will not be described one by one.
[0094] Figure 4 The flowchart of the application flow transferring method is shown for example. Please refer to Figure 4 , the application flow transferring method in the application embodiment includes but is not limited to the following steps:
[0095] First stage: triggering a task flow transferring function.
[0096] For example, still taking the scenario in Figure 3 as an example, the video application is running on the mobile phone, for example, playing the 7th episode of a TV series. The user triggers the task flow transferring function through a preset gesture. It should be noted that the task flow transferring in the application embodiment can be replaced by application task flow transferring, application flow transferring, etc., which is not limited in the application.
[0097] In the application embodiment, the preset gesture for triggering the task flow transferring function can be three-finger upward sliding. That is, the user can touch the display screen with three fingers and slide upward from the bottom of the display screen to trigger the task flow transferring function.
[0098] It should be noted that in the embodiments of the present application, the user slides three fingers upward to trigger the task flow function as an example. In other embodiments, the manner of triggering the task flow function can also be other gestures, for example, it can be three-finger winding, or double-clicking the screen with two fingers, or a preset gesture in the air, which is not limited in the present application.
[0099] The second stage: display the task flow interface.
[0100] For example, the mobile phone determines that the user operation is a preset gesture corresponding to the task flow function in response to the received user operation, and then starts the task flow function. Correspondingly, the mobile phone can display the task flow interface. In the embodiments of the present application, the display of the task flow interface can be further divided into two processes: the display of the transition interface and the display of the task flow interface. In the display process of the transition interface, the mobile phone can display the transition interface, and in the transition interface, the window of the video application (which can also be referred to as the video application interface) moves and changes size according to the preset rules. For example, the video application interface can move and change size according to the user operation. For another example, the video application interface can automatically change according to a preset trajectory and size change mode. Specific embodiments will be described in detail in the embodiments below.
[0101] For example, in the display process of the transition interface, if the mobile phone detects that the display condition of the task flow interface is met, the mobile phone can display the task flow interface. Specific embodiments will be described in detail below.
[0102] The third stage: in the task flow interface, select a target device.
[0103] For example, the mobile phone displays the task flow interface, and the task flow interface includes but is not limited to the icon of the video application and at least one terminal icon. For example, the terminal corresponding to the at least one terminal icon can be referred to as a flowable terminal, that is, a terminal that supports application flow, for example, the terminal can be a terminal with the same account as the mobile phone, for example, it can be a tablet, a wearable device, a smart home device, a vehicle-mounted device, etc., which is not limited in the present application.
[0104] For example, the user can select any terminal device in the task flow interface as the target device for application flow.
[0105] The fourth stage: execute the task flow.
[0106] For example, the mobile phone determines the target device (e.g., the tablet) to be transferred in response to the received user operation. The mobile phone can establish a communication connection with the target device to be transferred and transmit the related data of the video application to the tablet. The tablet can display the video application on the interface, and the interface of the video application displayed by the tablet is the interface displayed by the video application before the mobile phone performs the transfer, for example, the 7th episode of a certain TV series.
[0107] The processes in the above embodiments will be described in detail below with reference to the accompanying drawings. Figure 4 The processes in the above embodiments will be described in detail below with reference to the accompanying drawings.
[0108] First stage: triggering the task transfer function.
[0109] Figure 5 The flowchart for triggering the task transfer function is shown for example. Please refer to Figure 5 , which specifically includes but is not limited to the following steps:
[0110] S501, the Launcher sends a registration gesture event listening request to the Input Manager.
[0111] For example, after the mobile phone is started, the Launcher in the mobile phone sends a registration gesture event listening request to the Input Manager. The request is used to register the gesture listening with the Input Manager. It can be understood that the Launcher expects the Input Manager to feed back the acquired gesture event to the Launcher.
[0112] S502, the Input Manager dispatches the gesture event to the Launcher.
[0113] For example, after receiving the registration gesture event listening request sent by the Launcher, the Input Manager acquires all gesture events. The manner in which the Input Manager acquires the gesture events can refer to the prior art embodiments, which are not limited in the present application.
[0114] For example, the Input Manager dispatches the gesture event to the Launcher every time a gesture event is acquired. It can be understood that the gesture event triggering instruction is sent to the Launcher, which is used to indicate that there is currently a gesture event acting on the screen of the mobile phone.
[0115] Figure 6 The module interaction diagram is shown for example. Please refer to Figure 6The Input Manager includes a gesture event dispatching unit (also referred to as a module or component, which is not limited in the present application) as an example. The gesture event dispatching unit can dispatch a gesture event to a gesture recognition component in the Launcher through path 1 for indicating that a gesture event currently exists as soon as the gesture event is obtained.
[0116] In the embodiment of the present application, the trigger gesture of the task flow conversion function is taken as a three-finger upswipe as an example, and other preset gestures or operations can also be used in other embodiments, which are not limited in the present application.
[0117] Figure 7 The user interface schematic diagram is shown as an example. Please refer to Figure 7 (1), the display interface 701 (also referred to as a display window) of the mobile phone displays a video application interface 702a (also referred to as a video application window or a video application display window, which is not limited in the present application) as an example. That is, the application running in the foreground of the mobile phone is a video application, for example, the seventh episode of a TV series is being played. The user expects to convert the video application running on the mobile phone to the tablet side for continuous use, that is, to continue playing the seventh episode of the TV series. The user touches the display interface 701 with three fingers and slides up from the bottom of the display interface 701 to trigger the task flow conversion function as an example. The Input Manager can detect the gesture event and dispatch the gesture event to the Launcher when the user touches the display interface 701 with three fingers.
[0118] It should be noted that the gesture event of the task flow conversion function is only taken as an example in the embodiment of the present application. In fact, in the embodiment of the present application, the Input Manager detects any gesture event and dispatches the gesture event to the Launcher, and the Launcher detects the corresponding function triggered by the gesture event.
[0119] It should be further noted that the video application interface is taken as an example for full-screen display on the display screen in the embodiment of the present application. In other embodiments, the application flow conversion method in the embodiment of the present application can also be applied to the scene in which the video application is displayed in the form of a floating window or a split screen, which will not be illustrated one by one.
[0120] S503, the Launcher recognizes the three-finger upswipe gesture, and obtains the gesture position and distance.
[0121] For example, the Launcher receives the gesture event dispatched by the Input Manager each time, i.e., identifies the gesture event to determine whether the trigger condition of the corresponding function is met. In the embodiment of the present application, the trigger condition of the task flow conversion function is taken as an example of three-finger up sliding, and accordingly, the Launcher detects whether the current user operation is a three-finger up sliding operation based on the gesture event dispatched by the Input Manager.
[0122] For example, as described above, during the process that the user three-finger touches the display screen and slides up, the Input Manager can dispatch a gesture event to the Launcher when the user three-finger touches the display screen. The Launcher detects whether it is a three-finger touch to the display screen based on the received gesture event. If yes, it can continue to acquire the gesture position and sliding distance. That is, when the Launcher detects the gesture event that the user three-finger touches the display screen, it can trigger the task flow conversion function, i.e., start to execute the second stage.
[0123] The second stage: display the task flow conversion interface.
[0124] Figure 10 The task flow conversion interface display flowchart is shown as an example. Please refer to Figure 10 In the embodiment of the present application, after the task flow conversion function is started, the Launcher controls the display of the related interface (which can also be referred to as a window, such as the foreground application interface, the task flow conversion interface and the flow conversion transition interface), such as the display content, size and dynamic effect of the interface. In the prior art, the control right of each interface of the mobile phone is in the Window Manager, i.e., the Window Manager controls the display mode of each interface, such as the size and position.
[0125] As shown in Figure 10 In the embodiment of the present application, the Launcher needs to acquire the control right of the foreground application interface (such as a video application) and acquire the control right of the task flow conversion interface, so as to execute the subsequent flow conversion transition interface display flow and the task flow conversion interface display flow. For example, please refer to Figure 6 The Activity Manager can call the Launcher through path 2 to pull up the Launcher. Moreover, the Activity Manager can call the control center through path 3 to pull up the control center. When the Launcher and the control center are pulled up, the Launcher and the Window Manager acquire the control right of the foreground application interface (such as a video application) and acquire the control right of the task flow conversion interface through path 3.
[0126] It should be noted that in the embodiments of the present application, the process of obtaining the control permission of the foreground application interface (for example, a video application) and the process of obtaining the control permission of the task flow interface are executed in parallel. As shown in Figure 10 , the mobile phone simultaneously executes the process of obtaining the control permission of the foreground application interface (for example, a video application) and the process of obtaining the control permission of the task flow interface. After obtaining the control permission of the foreground application interface, the mobile phone can display the flow transition interface. Wherein, the Launcher can have obtained the control permission of the task flow interface or is still in the process of obtaining the control permission of the task flow interface while the mobile phone displays the flow transition interface, which depends on the execution capability of the mobile phone, and the present application does not make any limitation.
[0127] For example, during the process of displaying the flow transition interface, if the mobile phone detects that the task flow interface display condition is met and the control permission of the task flow interface has been obtained, the Launcher can display the task flow interface. Specific embodiments will be described in detail below.
[0128] Figure 11 The flowchart of obtaining the control permission of the foreground application interface is shown for example. Please refer to Figure 11 , which includes but is not limited to:
[0129] S1101, the Launcher sends a request for starting the flow transition interface to the Activity Manager.
[0130] For example, after the Launcher determines to trigger the task flow function, it sends a request for starting the flow transition interface to the Activity Manager, which is used to indicate the Launcher to display the flow transition interface. In the embodiments of the present application, the Launcher also controls the foreground application interface during the process of displaying the flow transition interface, therefore, the Launcher needs to obtain the control permission of the foreground application interface when displaying the flow transition interface. Correspondingly, the request for starting the flow transition interface can also be understood as a request for the control permission of the foreground application interface (for example, a video application interface) to the Activity Manager.
[0131] For example, the request can include but is not limited to a callback object, wherein the callback object is used to indicate that the callback object of this request is the Launcher. Optionally, the callback object can be understood as an interface or channel corresponding to the Launcher, and the Activity Manager can call back the Launcher based on the interface or channel indicated by the callback object.
[0132] S1102, the Activity Manager schedules the Launcher to the foreground.
[0133] For example, as described above, the foreground of the mobile phone is currently running a video application. The Activity Manager schedules the Launcher to the foreground in response to the received request for starting the transition interface. For example, the Launcher can be adjusted to the top of the stack. The specific implementation can refer to the prior art embodiments, and the present application is not limited. For example, scheduling the Launcher to the foreground can also be understood as pulling up the Launcher. It should be noted that, Figure 5 When the Launcher performs the gesture event recognition action, the Launcher is in the background running state.
[0134] S1103, the Launcher draws the transition interface.
[0135] For example, after the Launcher is scheduled to the foreground, the transition interface can be drawn. In the embodiments of the present application, the content in the transition interface can be a solid color filling or other pattern filling, which can be set according to actual needs, and the present application is not limited.
[0136] In the embodiments of the present application, the step of S1103 can be executed only once. That is, when the mobile phone initializes and performs the task transition process for the first time, the Launcher can draw the transition interface. In the subsequent application transition scenarios, the Launcher can reuse the already drawn transition interface. That is, S1103 does not need to be executed, and S1104 is directly executed.
[0137] S1104, the Launcher notifies the Window Manager of the completion of drawing.
[0138] For example, after the Launcher draws the transition interface, the Launcher can send a drawing completion instruction to the Window Manager to notify the Window Manager that the transition interface has been drawn.
[0139] S1105, the Window Manager generates remote dynamic effect control parameters.
[0140] Please refer to Figure 6The exemplary Window Manager includes a remote animation unit and a switching control unit. The exemplary remote animation unit generates a remote animation control parameter corresponding to the flow transition interface in response to a received drawing completion instruction. In the embodiments of the present application, the remote animation control parameter of the flow transition interface can be understood as encapsulating the flow transition interface of the Launcher into a remote animation parameter after the Launcher is drawn. Specifically, the Window Manager maintains a window tree, and each window corresponds to a node. The Window Manager newly generates a parent node that is no longer in the window tree maintained by the Window Manager. The Window Manager hangs the flow transition interface on the newly generated parent node. The parameter corresponding to the parent node is the remote animation parameter of the flow transition interface.
[0141] S1106, the Window Manager sends the remote animation control parameter to the Launcher.
[0142] The exemplary Launcher includes a remote animation unit and a switching control unit. The exemplary remote animation unit generates a remote animation control parameter corresponding to the flow transition interface in response to a received drawing completion instruction. In the embodiments of the present application, the remote animation control parameter of the flow transition interface can be understood as encapsulating the flow transition interface of the Launcher into a remote animation parameter after the Launcher is drawn. Specifically, the Window Manager maintains a window tree, and each window corresponds to a node. The Window Manager newly generates a parent node that is no longer in the window tree maintained by the Window Manager. The Window Manager hangs the flow transition interface on the newly generated parent node. The parameter corresponding to the parent node is the remote animation parameter of the flow transition interface. Figure 6 After the remote animation unit generates the remote animation control parameter, the switching control unit sends the remote animation control parameter to the Launcher through path 2 based on the registered callback object, so as to transfer the control right of the flow transition interface to the Launcher. The Launcher obtains the remote animation control parameter, that is, the Launcher obtains the control right of the flow transition interface. Optionally, there is a data channel between the Window Manager and the Activity Manager, and the Window Manager can obtain the registered callback object from the Activity Manager. The specific interaction manner can refer to the prior art embodiments, and the present application is not limited.
[0143] Figure 12 The flowchart for obtaining the control right of the foreground application interface is exemplarily shown. Please refer to Figure 11 Specifically, but not limited to:
[0144] S1201, the Launcher sends a request for starting a task flow interface to the Activity Manager.
[0145] The exemplary Launcher can synchronously execute the flow shown in Figure 11 during the execution of the flow shown in Figure 12the task flow interface. Specifically, Launcher sends a request for starting the task flow interface to the Activity Manager. The request for starting the task flow interface can be used to request the control authority of the task flow interface. Optionally, the request includes, but is not limited to, a callback object (the concept can be referred to the description in Figure 11 , which will not be repeated here), identification information of the task flow unit, and identification information of the foreground application (for example, a video application).
[0146] For example, the task flow unit is an execution module (or component) in the control center, as shown in Figure 6 . The task flow unit can be used to perform operations related to the task flow function. For example, the identification information of the task flow unit can be the package name and the Activity name of the task flow unit, which is not limited in the present application. The identification information of the foreground application can be the package name of the foreground application, which is not limited in the present application.
[0147] S1202, the Activity Manager schedules the task flow unit of the control center to the foreground.
[0148] For example, the Activity Manager receives the request for starting the task flow interface. The Activity Manager can schedule the task flow unit in the control center to the foreground based on the identification information of the task flow unit in the request.
[0149] S1203, the control center draws the task flow interface.
[0150] For example, after the task flow unit is scheduled to the foreground, the task flow interface is drawn. The drawing process of the task flow interface includes, but is not limited to, drawing the application icon (for example, the icon of the video application) and other controls (or components) in the task flow interface. The controls will be described in detail below, which will not be repeated here.
[0151] S1204, the control center notifies the Window Manager of the completion of drawing.
[0152] For example, after the control center completes drawing the task flow interface, the control center can send a drawing completion instruction to the Window Manager to notify the Window Manager of the completion of drawing.
[0153] S1205, the Window Manager generates remote dynamic effect control parameters.
[0154] For example, the Window Manager generates remote dynamic effect control parameters corresponding to the task flow interface. The specific description can be referred to the related content of S1105, which will not be repeated here.
[0155] S1206, the Window Manager sends the remote animation control parameter to the Launcher.
[0156] The specific content can refer to the related content of S1106, which will not be repeated here.
[0157] For example, as shown in Figure 10 After the Launcher obtains the foreground application control permission, the Launcher can execute the process of displaying the flow transition interface and scaling the foreground application interface card.
[0158] Figure 13 The flowchart of the application flow method is shown for example. Please refer to Figure 13 , which includes two process parts corresponding to Figure 10 , one of which is to display the flow transition interface and scale the foreground application interface card. The other part is to display the task flow interface. For example, the process of displaying the flow transition interface and scaling the foreground application interface card includes but is not limited to:
[0159] S1301, the Launcher judges whether the finger moving speed reaches the threshold value within the preset distance.
[0160] In the embodiments of the present application, the user can trigger the display of the task flow interface by sliding three fingers quickly from the bottom of the display screen upwards (the hand can be lifted or not lifted) and / or the user slides three fingers from the bottom of the display screen upwards by a distance greater than or equal to a threshold value (which can be referred to as a distance threshold value, which can be set according to actual needs, and the present application does not make any limitation). That is, the gesture of sliding three fingers upwards by a certain distance (i.e., the sliding distance reaches the distance threshold value) at a speed less than a preset speed threshold value or the gesture of sliding three fingers upwards at a speed greater than or equal to the preset speed threshold value both meet the display condition of the task flow interface.
[0161] The Launcher can continuously calculate the three-finger upswipe speed based on the gesture position and the sliding distance obtained within the preset distance of the three-finger swipe. That is, the Launcher continuously detects whether the gesture movement speed reaches the threshold value within the preset distance of the three-finger swipe. In one example, if it is detected that the three-finger upswipe speed is less than the speed threshold value within the preset distance of the three-finger swipe, S1302a is performed. In another example, if it is detected that the three-finger upswipe speed is greater than or equal to the speed threshold value within the preset distance, S1302b is performed. In an example, the Launcher continues to detect the three-finger upswipe speed during the execution of S1302a. If the Launcher detects that the three-finger upswipe speed is greater than or equal to the speed threshold value within the preset distance of the three-finger swipe, S1302b is performed. If the three-finger swipe distance is greater than the preset distance and the speed threshold value is not reached, the three-finger upswipe speed does not need to be monitored, that is, S1302a is continuously performed.
[0162] It should be noted that the preset distance described above in the embodiments of the present application is less than the distance threshold value. The preset distance is usually set to a very short distance.
[0163] In the embodiments of the present application, during the three-finger upswipe of the user, the mobile phone can display a flow transition interface, and the foreground application interface card (such as a video application) can follow the user's finger sliding and change size, or move and change size according to a preset animation to transition the display of the task flow interface, thereby avoiding problems such as screen freezing caused by incomplete drawing of the task flow interface.
[0164] In S1302a, the Launcher controls the foreground application interface card to follow the hand scaling based on the gesture position and the sliding distance, and displays the flow transition interface.
[0165] In an example, as described above, the Launcher has obtained the control authority of the flow transition interface, and the Launcher can control the motion trajectory and size transformation of the foreground application interface card based on the gesture position and the sliding distance obtained.
[0166] Please refer to Figure 7 (2), the three-finger upswipe of the user triggers the task flow function, and after the Launcher obtains the control authority of the flow transition interface, the Launcher can control the video application interface card 702a to follow the user's finger (i.e., the finger position obtained by the Launcher) to move based on the sliding trajectory of the three fingers. At the same time, as the three fingers of the user move upwards, the video application interface card 702a gradually shrinks. In this example, the three fingers of the user do not leave the display screen. The scenario in which the three fingers of the user leave the display screen will be described in detail below.
[0167] Optionally, the reduction amplitude of the video application interface card 702a is proportional to the distance of the upward sliding of the fingers. The specific correspondence between the reduction amplitude and the sliding distance can be set according to actual needs, which is not limited in the present application.
[0168] Optionally, the reduction manner of the video application interface card 702a in the embodiment of the present application can be equal proportion reduction of the four edges of up, down, left and right.
[0169] Optionally, if the user drags the video application interface card 702a with three fingers, and the user slides the three fingers downward, the video application interface card 702a follows the movement of the three fingers of the user, and the video application interface card 702a is enlarged.
[0170] Still referring to Figure 7 (2), the Launcher displays a flow transition interface 703. The flow transition interface 703 is overlaid below the video application interface card 702a, that is, the level of the flow transition interface 703 is lower than that of the video application interface card 702a. As the video application interface card 702a moves and reduces, more and more of the flow transition interface 703 is displayed in the display interface 701.
[0171] In the embodiment of the present application, as described above, when the Launcher performs S1302a, it still detects whether the speed of the upward sliding of the three fingers reaches the threshold value within the preset distance. For example, if the Launcher detects that the sliding distance of the three fingers has exceeded the preset distance and the speed threshold value has not been reached during the execution of S1302a, the monitoring of the speed is cancelled, and the follow-hand process of the application interface card of S1302a is continued. At the same time, the Launcher performs S1303. That is, after detecting that the three fingers have been upwardly slid beyond the preset distance, the Launcher starts to detect whether the upward sliding distance of the three fingers reaches the distance threshold value. As described above, the distance threshold value is greater than the preset distance.
[0172] S1302b, the Launcher controls the foreground application interface card to automatically scale to the capsule size, and displays the flow transition interface.
[0173] Figure 9 The user interface schematic diagram is shown for example. Please refer to Figure 9 (1), for example, the user slides the three fingers upward from the bottom of the display interface 901. Based on the gesture position and the sliding distance, the Launcher determines that the upward sliding speed of the three fingers exceeds (i.e., is greater than or equal to) the preset speed threshold value, the Launcher displays the flow transition interface, and the Launcher controls the video application interface card 902a to demonstrate the dynamic effect of the flow transition interface according to the preset moving track and the size transformation amplitude.
[0174] Please refer to Figure 9 (2) and Figure 9 (3), for example, after the user quickly slides three fingers and then lifts the hand, the Launcher gradually moves the video application interface card 902a upwards, and gradually reduces the video application interface card 902a according to a preset reduction range, until the video application interface card 902a slides to a preset position (which can be set according to actual needs, and the present application does not limit) and is reduced to a preset size (for example, the specific size of the capsule size can be set according to actual needs, and the present application does not limit). And the Launcher displays the flow transition interface 903, and the display manner can refer to the related description in Figure 7 , which will not be repeated here.
[0175] For example, the Launcher continues to perform S1305 to display the task flow interface.
[0176] In one possible implementation, as described above, the Launcher continuously detects the speed of the three fingers sliding upwards within a preset distance. Accordingly, during the execution of S1302a, that is, during the process of moving and reducing the video application interface card following the three fingers sliding, if the Launcher detects that the speed of the three fingers sliding upwards exceeds the speed threshold within the preset distance, the Launcher can continue to demonstrate the preset motion effect from the current position and current size of the video application interface card to move the video application interface card to a preset position and reduce it to a preset size (for example, the size of the capsule).
[0177] In another possible implementation, the above-mentioned preset position is optionally near or coincides with the native icon in the task flow interface. That is, when the mobile phone displays the task flow interface, the video application interface card changes from the capsule size to the application icon in vision, and the position does not change, that is, it is displayed on or near the native icon in the task flow interface. The specific details will be described below.
[0178] S1303, the Launcher determines whether the distance of the fingers sliding upwards reaches a threshold.
[0179] For example, during the process of the Launcher displaying the flow transition interface and the video application interface card changing with the hand, the Launcher acquires the gesture position and sliding distance in real time to detect whether the distance of the three fingers sliding upwards reaches a threshold (which can be set according to actual needs, and the present application does not limit).
[0180] For example, as Figure 7As shown in (3), the user slides three fingers upward on the interface 701, and the video application interface card 702a follows the movement and gradually shrinks in size. That is, the user drags the video application interface card 702a upward by three-finger sliding. When the Launcher detects that the distance of the three-finger sliding (the height difference between the current position and the starting position) reaches a threshold (for example, h), the Launcher determines that the display condition of the task flow transition interface is met. That is, the display condition is that the distance of the upward dragging of the video application interface card is greater than or equal to the threshold. Accordingly, the Launcher performs S1304.
[0181] In another example, if the Launcher detects that the distance of the three-finger upward sliding does not reach the threshold, S1302 is continuously performed, that is, the flow transition interface is still displayed, and the video application interface card 702a changes position and size with the three-finger sliding.
[0182] In a possible implementation, if the Launcher detects that the distance of the user's finger upward sliding does not reach the threshold and the user lifts the hand, the task flow interruption process in S1302b is performed. The specific details will be described below. Figure 14
[0183] S1304, the Launcher establishes a connection with the control center and sends the finger position.
[0184] S1305, the control center realizes the follow-hand of the application icon according to the finger position.
[0185] In the embodiments of the present application, as described above, Figure 11 and Figure 12 The control authority of the foreground application interface and the control authority of the task flow transition interface are synchronously executed. Therefore, during the execution of S1302b and S1303 by the Launcher, that is, before the distance threshold of the three-finger upward sliding is not reached, it can also be understood that the display condition of the task flow transition interface is not met. The control center has drawn the task flow transition interface, and the Launcher has obtained the control authority of the task flow transition interface. Accordingly, after the Launcher obtains the control authority of the task flow transition interface, it can perform S1304, establish a connection with the control center, and send the obtained finger position (for example, the center point of the three-finger coordinates) to the control center.
[0186] For example, after the control center obtains the finger position, it can control the video application icon to slide on the task flow interface based on the finger position. This animation is invisible to the user. It can be understood that when the Launcher changes the video application interface card on the transition interface based on the finger position and swipe distance, following the user's three-finger swipe, the control center also determines the position of the video application icon in the task flow interface based on the obtained finger position and draws it. However, since the Launcher has not yet invoked the task flow interface, the result currently drawn by the control center is not displayed on the phone's screen.
[0187] S1306, Launcher displays the task flow interface and hides the transition interface.
[0188] like Figure 6 As shown, the Launcher's transition interface display unit calls the control center's task flow unit via path 5. The transition interface display unit can be used to execute the steps related to the Launcher's transition interface display described above. The task flow unit is used to execute steps such as drawing the task flow unit. Specific details can be found above and will not be repeated here.
[0189] In this embodiment of the application, the triggering method of the task flow interface is divided into two types: three-finger upward swipe without lifting the hand (swiping speed is less than the speed threshold) and three-finger rapid upward swipe and lifting the hand (or without lifting the hand).
[0190] In one example, for the method of triggering the task flow interface by swiping up with three fingers without lifting the finger, the user can drag the application interface cards using three fingers without lifting the finger, such as... Figure 7 As shown in (3), when the user drags the video application interface upwards with three fingers to a distance threshold, the video application interface card 702a has shrunk to the size of a capsule (it can also be other sizes; this application is only an illustrative example and is not limited thereto). Subsequently, as Figure 7 As shown in (4), the Launcher determines that the conditions for displaying the task flow interface are met, and the Launcher displays the task flow interface 704. In this example, the user has not raised their hand.
[0191] For example, such as Figure 7 As shown in (4), the task flow interface 704 includes, but is not limited to: video application icon 702b, local icon 705a and other device icons, such as X’s TV icon 705b, X’s Pad icon 705c, etc.
[0192] It should be noted that, as described above, before performing S1306, the control center has completed the drawing of the task flow interface, and determines the position of the application icon 702b in the task flow interface according to the finger position. Accordingly, in S1306, it can be understood that the Launcher calls the task flow interface that is currently newly drawn by the control center, and displays the newly drawn task flow interface, for example, the task flow interface 704, in the display interface 701, and the position of the application icon 702b in the newly drawn task flow interface is the same as the position of the three-finger touch of the user. That is, the position of the video application icon 702b in the task flow interface 704 is the same as the position of the video application interface card in Figure 7 (3). That is, when the user drags the video application interface card 702a to the preset distance by three fingers, the video application interface card 702a changes from the capsule size to the video application icon 702b. Wherein, the video application icon 702b is still at the position of the three-finger touch of the user. As shown in Figure 7 (5) and Figure 7 (6), the user can drag the video application icon 702b by three fingers to the icon corresponding to the target device (for example, a tablet). The mobile phone responds to the received user operation to perform application flow transfer, that is, to transfer the video application on the mobile phone to the tablet.
[0193] In another example, for the manner of three-finger upward sliding without lifting the hand to trigger the task flow interface, the user can always drag the application interface card by three fingers without lifting the hand, and after triggering the task flow interface, the user can lift the hand. Specifically, as shown in Figure 8 (3), when the user drags the video application interface card 802a by three fingers to the threshold distance, the video application interface card 802a has been reduced to the capsule size (or other size, which is only illustrative in the present application, and the present application is not limited). The Launcher detects that the display condition of the task flow interface is met, that is, the distance of three-finger upward sliding (or understood as the distance of upward movement of the application interface card) reaches the distance threshold, and the Launcher displays the task flow interface 804. As shown in Figure 8 (4), the Launcher calls the task flow interface 804 that is drawn by the control center, wherein the position of the video application icon 802b in the task flow interface corresponds to the position of the three-finger touch of the user. For specific description, reference can be made to Figure 7 , which will not be described herein again. Illustratively, in the present embodiment, the user can lift the hand after the mobile phone displays the task flow interface. Alternatively, after the user lifts the hand, the application icon can demonstrate the adsorption effect during the display of the task flow interface. As shown in Figure 8 (4) and Figure 8As shown in (5), after the user slides three fingers and raises their hand, the control center moves the video application icon from the position where the user raised their hand to a preset position on the task flow interface according to a preset trajectory (this can be set according to actual needs, and this application does not limit it), for example, it can be near or overlap with the local icon 805a. Figure 7 The difference is that, Figure 7 When the app icon is displayed on the task flow interface, its position moves according to the user's gesture position. Figure 8 Since the user has already raised their hand, the app icon can be displayed with a snapping animation when it appears on the task flow screen.
[0194] For example, such as Figure 8 (5) and Figure 8 As shown in (6), the user can drag the video application icon 802b with any finger (e.g., index finger) to the target device (e.g., tablet) icon. The mobile phone responds to the received user operation by performing an application transfer, that is, transferring the video application from the mobile phone to the tablet. It should be noted that... Figure 8 (1) and Figure 8 The execution process of (2) can be referred to Figure 7 (1) and Figure 7 (2), that is to say, Figure 8 This provides a two-stage task flow triggering method, allowing users to activate the task flow function by swiping with three fingers and dragging video application interface cards. Figure 7 The difference is that, Figure 8 In this method, after the video application card shrinks to the size of a capsule or becomes an application icon, the user can raise their hand and drag the application icon again with the same or different gestures.
[0195] In yet another example, regarding the method of quickly swiping upwards with three fingers to trigger a task flow interface, specifically, as follows: Figure 9 (1) to Figure 9 As shown in (3), when the user quickly swipes three fingers upwards, the phone displays a transition interface, and the video application interface card 902a moves a distance following the user's three fingers (this distance is less than the preset distance mentioned above). When the Launcher detects that the upward swipe speed of the three fingers has reached a threshold, the Launcher can control the video application interface card 902a to move from its current position to a preset position along a predetermined trajectory, and shrink it to a preset size (e.g., capsule size) according to a preset shrinkage range. Figure 9As shown in (4), the Launcher detects that the video application interface card 902a has moved to a preset position and shrunk to a preset size, thus confirming that the task flow interface display conditions are met. Accordingly, the Launcher calls the task flow interface drawn by the control center, that is, displays the task flow interface 904 in the display interface 901. The application icon 902b can be associated with... Figure 7 Similarly, the position of application icon 902b in interface 901 is the same as its last position before it became an icon; that is, in this example, application icon 902b is at the preset position in task flow interface 904. For example, in... Figure 9 In the illustrated method, since the Launcher moves and shrinks the video application interface card according to a predetermined trajectory and size, the Launcher no longer needs to obtain the finger position. Correspondingly, the control center also does not need to determine the position of the video application icon in the task flow interface based on the finger position. In other words, in the task flow interface drawn by the control center, the video application icon is at a preset position on the task flow interface. The phone responds to the received user operation and executes the application flow, that is, it transfers the video application from the phone to the tablet.
[0196] In one possible implementation, after the phone displays the task flow interface, if the user raises their hand before dragging the video application icon to the vicinity of the target device icon, the control center can respond to the received user hand-raising operation and move the video application icon from its current position (i.e., the raised hand position) to a preset position along a predetermined trajectory. For example, the preset position could be near the device icon or overlap with it. Figure 9 The position shown in (4) can be set according to actual needs, and this application does not limit it.
[0197] In another possible implementation, the Launcher invokes the task flow interface drawn by the control center to enter the scene. The Launcher can invoke pre-set entrance animation effects to demonstrate the entrance animation effects when the task flow interface enters. For example, the entrance animation effect can be a gradual display or a blinking display, etc., which is not limited in this application.
[0198] In another possible implementation, the Launcher invokes the task flow interface to enter, while simultaneously controlling the exit of the transition interface. Optionally, the exit method of the transition interface can be hiding, etc., and this application does not limit it.
[0199] In yet another possible implementation, the mobile phone, in response to the received user operation, performs application flow transfer, i.e., after transferring the video application to the tablet, the Launcher determines that the current application flow transfer process is completed, and can notify the Window Manager to withdraw the remote animation parameter, i.e., withdraws the control authority of the application interface and the task flow transfer interface. For details, refer to S1404-S1406 in Figure 14 , which are not described herein.
[0200] In yet another possible implementation, the control center detects that the video application icon moves to the preset range of the tablet icon (which can be set according to actual requirements, and is not limited in the present application) and stays for a preset time length (which can be set according to actual requirements, and is not limited in the present application), and can determine that the tablet is the device to be transferred, i.e., the target device. In another example, the control center detects that the video application icon moves to the preset range of the tablet icon and the user lifts the hand, and can determine that the tablet is the target device.
[0201] Figure 14 An example of the task flow transfer interface interrupt process is shown. For details, refer to Figure 14 , which includes but is not limited to the following steps:
[0202] S1401, the Launcher sends a task flow transfer end instruction to the Activity Manager.
[0203] For example, the Launcher detects that the distance of the three-finger sliding does not reach the threshold value and the speed of the three-finger sliding also does not reach the threshold value, and the user lifts the hand, and the Launcher triggers the task flow transfer interface to display the interrupt process, i.e., the Launcher sends a task flow transfer end instruction to the Activity Manager to indicate that the task flow transfer process is completed.
[0204] For example, in one example, if the user slides three fingers on the interface, and the sliding speed is less than a threshold value. During the sliding process, the Launcher displays the flow transfer transition interface and the application interface card follows the hand. If the user expects to cancel the application flow transfer operation, i.e., does not want to perform the task flow transfer of the video application, the user lifts the hand. The distance (i.e., the height difference) between the user lifting the hand (i.e., the last touch position) and the starting position of the user three-finger sliding is less than a threshold value, and the Launcher detects that the interrupt condition is met. That is, the interrupt condition is that the distance of the three-finger sliding does not reach the threshold value (for example, a distance threshold value) and the speed of the three-finger sliding is less than a threshold value (for example, a speed threshold value). Accordingly, the Launcher performs S1401.
[0205] S1402, the Activity Manager ends the task flow transfer unit of the control center.
[0206] In the example, the Activity Manager determines that the task flow ends in response to the received task flow end instruction, and the Activity Manager ends the task flow unit of the control center, i.e., the task flow unit of the control center is placed in the background.
[0207] S1403, the Launcher plays a return full-screen state animation effect of the foreground application interface card.
[0208] In the example, the Launcher restores the video application interface card to full-screen display based on the position and size of the video application interface card when the user lifts the hand. For example, referring to (1) of FIG. 15A, after the user drags the video application interface card 1502a to the current position by three fingers, the user lifts the hand. The Launcher detects that the user lifts the hand, and detects that the three-finger sliding distance does not reach the threshold and the three-finger sliding speed does not reach the threshold, and determines that the task flow interruption condition is met. Accordingly, the Launcher demonstrates a foreground application interface card recovery animation effect. As shown in (2) of FIG. 15B and (3) of FIG. 15C, the Launcher gradually moves the video application interface card 1502a from the position in (1) of FIG. 15A to the center of the interface 1501, and during the movement, the video application interface card 1502a gradually increases in size, until as shown in (4) of FIG. 15C, i.e., the video application interface card 1502a is restored to full-screen display (i.e., the interface card size is the same as the display interface 1501 size). In the example, in the foreground application interface card recovery animation effect, the motion trajectory of the card and the size transformation amplitude can be set according to actual needs, which is not limited in the present application. Figure 15 Figure 15 Figure 15 Figure 15 Figure 15
[0209] S1404, the Launcher notifies the Window Manager that the remote animation effect ends.
[0210] In the example, after the Launcher restores the video application interface card to full-screen display, the Launcher sends a remote animation end instruction to the Window Manager, indicating that the application flow process ends.
[0211] S1405, the Window Manager clears the remote animation parameters.
[0212] For example, the Window Manager determines that the application flow is ended in response to the received instruction, and the Window Manager recovers the control authority of the application interface or the control authority of the application interface and the control authority of the task flow interface. It should be noted that, as described above, the control authority of the application interface and the control authority of the task flow interface are acquired in parallel, and in some embodiments, the Launcher can not have acquired the control authority of the task flow interface before the user performs the three-finger upswipe and the hand is lifted. Therefore, in this example, the Window Manager does not need to perform the recovery action of the task flow interface because the control authority of the task flow interface is not transferred.
[0213] In the embodiments of the present application, as described above, the transfer of the control authority of the interface can be understood as encapsulating the interface as a remote dynamic effect parameter and sending the remote dynamic effect parameter to the Launcher. Accordingly, in the embodiments of the present application, the recovery of the control authority of the interface by the Window Manager can be understood as emptying the remote control parameter corresponding to the interface to be recovered. For example, the Window Manager can move the video application interface from the newly created parent node to the window tree of the Window Manager and clear the newly created parent node to recover the control authority. The task flow interface is similar and will not be described here.
[0214] S1406, the Activity Manager ends the Launcher.
[0215] For example, the Activity Manager moves the Launcher to the background for execution.
[0216] The embodiments of the present application also provide a gesture recognition method to recognize the three-finger upswipe operation described above. Figure 16 For example, the flowchart of the task flow method in the embodiments of the present application is shown. Please refer to Figure 16 In the embodiments of the present application, the flow of the task flow method can include the following steps:
[0217] S1601, a first interface of a first application is displayed full screen on a screen of an electronic device, the first application is an application supporting task flow, and the task flow refers to switching a task from a current device to another device for continuous execution.
[0218] In the embodiments of the present application, a mobile phone is taken as an example to illustrate the interface change process of the electronic device in the task flow process.
[0219] Figure 17 For example, the interface change diagram of the task flow process on the mobile phone is shown. Please refer to Figure 17 In the embodiments of the present application, the interface change diagram of the task flow process on the mobile phone is shown. Please refer to Figure 17In (a) of FIG. 1, the interface 1 of the application 1 is displayed full screen on the screen of the mobile phone. The application 1 supports task flow.
[0220] S1602, a first gesture is received on the first interface, and a process of the first gesture includes a first stage and a second stage connected in time sequence.
[0221] In this embodiment, the first gesture can be multi-finger touch and finger continuous sliding after multi-finger touch. Here, the multi-finger touch and the finger continuous sliding after multi-finger touch are continuously performed, that is, there is no action of lifting all fingers between the initial touch and the sliding. If the action of lifting all fingers occurs after the multi-finger touch and before the sliding, the first gesture needs to be re-detected.
[0222] For example, the multi-finger touch and the finger continuous sliding after multi-finger touch can be two-finger touch and finger continuous sliding after two-finger touch, three-finger touch and finger continuous sliding after three-finger touch, or four-finger touch and finger continuous sliding after four-finger touch, and the like.
[0223] Here, the three-finger touch is described.
[0224] Please continue to refer to Figure 17 , in Figure 17 In (b) of FIG. 1, the user touches the screen with the finger 1, the finger 2, and the finger 3 on the interface 1. Then at t0, when the interface 1 is displayed full screen on the screen of the mobile phone, the mobile phone detects that the finger 1, the finger 2, and the finger 3 touch the screen. The mobile phone displays a touch point icon of the finger 1 at a touch point position of the finger 1 on the screen, displays a touch point icon of the finger 2 at a touch point position of the finger 2 on the screen, and displays a touch point icon of the finger 3 at a touch point position of the finger 3 on the screen in response to detecting that the finger 1, the finger 2, and the finger 3 touch the screen on the interface 1.
[0225] The touch point icon of the finger 1, the touch point icon of the finger 2, and the touch point icon of the finger 3 are located on an upper layer of the layer where the interface 1 is located.
[0226] It should be noted that Figure 17 The touch point icons shown in (b) of FIG. 1 are only exemplary descriptions, and the shape of the touch point icon is not limited in this embodiment. For example, in other embodiments, the touch point icon can also be a square or a triangle, and the like.
[0227] It should be noted that the t01 moment can not be the initial touch moment of the three fingers, but a moment after the three fingers touch the screen. For example, assuming that the initial touch moment of the finger 1 is the t1 moment, the initial touch moment of the finger 2 is the t2 moment, and the initial touch moment of the finger 3 is the t3 moment, t1 is earlier than t2, and t2 is earlier than t3 (the subsequent examples are based on this assumption), then the t01 moment can be the t3 moment or a moment after the t3 moment, provided that the three fingers do not move before the t01 moment after falling (i.e., touching the screen).
[0228] The phone can also obtain the touch point position coordinates of the finger 1, the finger 2, and the finger 3 in response to detecting that the finger 1, the finger 2, and the finger 3 touch the screen on the interface 1. Assuming that the initial touch point position coordinates of the finger 1 are point P10 (x10, y10), the initial touch point position coordinates of the finger 2 are point P20 (x20, y20), and the initial touch point position coordinates of the finger 3 are point P30 (x30, y30). Wherein, the x direction is parallel to the short side of the phone frame, and the y direction is parallel to the long side of the phone frame.
[0229] The phone can determine the coordinates (x1, y1) of the center point O1 of the finger 1, the finger 2, and the finger 3 at the t01 moment according to the coordinates of the points P10, P20, and P30.
[0230] In one example, x1 can be equal to the average of x10, x20, and x30, and y1 can be equal to the average of y10, y20, and y30.
[0231] It should be noted that, for ease of description, in this embodiment, the whole process of a complete first gesture is divided into a first stage and a second stage, the first stage is earlier than the second stage, and the end moment of the first stage is the same as the start moment of the second stage. Wherein, the first stage refers to the time period between the three fingers starting to touch the screen (the start moment of the first stage) and the capsule being displayed on the screen (the end moment of the first stage), and the second stage refers to the time period between the capsule being displayed on the screen (the start moment of the second stage) and all fingers being lifted (the end moment of the second stage). Finger lifting refers to the finger leaving the screen and no longer contacting the screen.
[0232] S1603, in the first stage, a first animation is displayed on the screen, the first animation is an animation of gradually reducing and transitioning the window of the first interface to the first capsule corresponding to the first application according to the progress of the first gesture.
[0233] After the user touches the screen with finger 1, finger 2, and finger 3, the user starts to slide along the screen. In this embodiment, it is assumed that the sliding direction is upward. In this embodiment, finger 1, finger 2, and finger 3 slide along the screen upward after touching the screen, and all the fingers are lifted at time t02. Time t02 is later than time t01.
[0234] During time period T from time t01 to time t02, the phone detects that the fingers are sliding on the screen, and the touch point icons are displayed in real time at the positions of the respective touch points of finger 1, finger 2, and finger 3 on interface 1, as shown in (c) of FIG. 1. Figure 17
[0235] In this embodiment, time period T includes time period 1 in which the first phase of the first gesture is located, and time period 2 in which the second phase of the first gesture is located.
[0236] During time period T, the phone determines the target finger. The target finger is the finger that has the earliest initial touch time among the fingers that are currently touching the screen.
[0237] Method 1 for determining the target finger and the center point O2 of all the fingers that are touching the screen during the sliding process
[0238] If finger 1, finger 2, and finger 3 have been touching the screen during the sliding process after touching the screen, and none of them has left the screen, then finger 1 is determined to be the target finger.
[0239] Then, during time period T, the offset value 1 (offsetX, offsetY) of finger 1 is determined according to the real-time touch point position of finger 1.
[0240] Suppose the real-time touch point position of finger 1 during the sliding process is P11(x11, y11), then the offset value 1 (offsetX1, offsetY1) of finger 1 can be determined according to the real-time touch point position P11(x11, y11) of finger 1 and the initial touch position P10(x10, y10) of finger 1.
[0241] In one example, offsetX1 is equal to the difference between x11 and x10, and offsetY1 is equal to the difference between y11 and y10.
[0242] After the offset value 1 (offsetX1, offsetY1) of finger 1 is determined, the phone determines the coordinates (x2, y2) of the center point O2 of all the fingers (including finger 1, finger 2, and finger 3 in this example) that are touching the screen during the sliding process according to the coordinates (x1, y1) of the center point O1 and the offset value 1 (offsetX1, offsetY1).
[0243] In one example, x2 is equal to the sum of x1 and offsetX1, and y2 is equal to the sum of y1 and offsetY1.
[0244] If finger 1, finger 2, finger 3 touch the screen and slide, finger 2, finger 3 touch the screen all the time, finger 1 is lifted at t4, then the time period T is divided into two parts by t4: the first part before t4 and the second part after t4.
[0245] In the first part, the center point O2 of the target finger and all the touch fingers in the sliding process is determined according to the above manner one.
[0246] In the second part, the center point O2 of the target finger and all the touch fingers in the sliding process is determined according to the following manner two.
[0247] Manner two of determining the center point O2 of the target finger and all the touch fingers in the sliding process
[0248] In the time period T after t4, only finger 2, finger 3 touch the screen, finger 1 has been lifted, all the touch fingers at this time include finger 2 and finger 3.
[0249] Since the initial touch time t2 of finger 2 is earlier than the initial touch time t3 of finger 3, finger 2 is determined as the target finger.
[0250] Then, the offset value 2 (offsetX2, offsetY2) of finger 2 can be determined according to the real-time touch point position P21 (x21, y21) of finger 2 and the initial touch position P20 (x20, y20) of finger 2.
[0251] In an example, offsetX2 is equal to the difference between x21 and x20, offsetY2 is equal to the difference between y21 and y20.
[0252] Then, the offset value 2 (offsetX2, offsetY2) is corrected according to the offset value 1 (offsetX1(t5), offsetY1(t5)) of finger 1 at the end time t5 of the first part.
[0253] In an example, the correction process includes:
[0254] Let beforeoffsetX2 be equal to offsetX1(t5), beforeoffsetY2 be equal to offsetY1(t5);
[0255] Let adjustX be equal to the difference between beforeoffsetX2 and offsetX2, adjustY be equal to the difference between beforeoffsetY2 and offsetY2;
[0256] Determine a corrected offset value 2' (offsetX2', offsetY2') of the offset value 2 (offsetX2, offsetY2) according to adjustX, offsetX2, adjustY and offsetY2; wherein offsetX2' is equal to the sum of offsetX2 and adjustX, and offsetY2' is equal to the sum of offsetY2 and adjustY.
[0257] After correcting the offset value of finger 2 to obtain offset value 2' (offsetX2', offsetY2'), the mobile phone determines the coordinates (x2', y2') of the center point O2' of all touch fingers (including finger 2 and finger 3 in this example) in the sliding process according to the coordinates (x1, y1) of the center point O1 and the offset value 2' (offsetX2', offsetY2').
[0258] In one example, x2' is equal to the sum of x1 and offsetX2', and y2' is equal to the sum of y1 and offsetY2'.
[0259] In this embodiment, when some of the touch fingers are lifted, the initial touch time of the finger that is still in touch and has the earliest initial touch time is always taken as the target finger, a new offset value is calculated based on the target finger, and the new offset value is corrected. Through the correction, the multi-finger center point position calculated based on the corrected offset value is consistent with the multi-finger center point position calculated before the finger is lifted, so that the shaking of the animation screen caused by the finger lifting is avoided, and the user's use experience is improved.
[0260] In this way, during the operation of the first gesture, this embodiment allows one or more fingers of the user to be lifted, and in the case of finger lifting, the task flow triggered by the first gesture can still be successfully triggered, the operation difficulty is reduced, and the user's use experience is improved.
[0261] It should be noted that the offset value needs to be corrected only once each time a finger is lifted, and after the correction, the real-time multi-finger center point position in the animation can be determined according to the offset value of the new target finger.
[0262] In one example, if the first ratio of the target offset value to the preset total offset value is equal to the preset ratio threshold, it can be determined that the first stage of the first gesture is completed.
[0263] The total offset value and the ratio threshold are both preset.
[0264] Here, the center point O2 of the target finger and all touch fingers during the sliding process is determined in the foregoing manner as an example. The mobile phone detects that the finger 1, the finger 2, and the finger 3 slide on the screen. In the time period 1 in the first stage, the mobile phone displays the animation 1 on the screen. The animation 1 is an animation in which the window of the control interface 1 according to the progress of the first gesture is gradually reduced and transitions to the capsule 1 corresponding to the application 1.
[0265] A frame in the animation 1 is shown in FIG. 8(c)(c). Figure 17 In FIG. 8(c)(c), the window 1 is the window of the interface 1 after the window is reduced. The content displayed in the window 1 is the interface 1. In the animation 1, the size of the window of the interface 1 is reduced from the full-screen window shown in FIG. 8(a)(a) to the size of the window 1 shown in FIG. 8(c)(c). Figure 17 Figure 17 Figure 17
[0266] In an example, the process of displaying the animation 1 on the screen can include:
[0267] In the animation 1, the center position of the window 1 of the interface 1 is determined as the second center point O2 (or O2').
[0268] A first ratio is determined according to the target offset value and a preset total offset value.
[0269] According to the initial size, the final size, and the first ratio of the window 1 of the interface 1, the display size of the window 1 of the interface 1 in the animation 1 is determined. The final size of the window 1 of the interface 1 is equal to the size of the capsule 1.
[0270] According to the initial content of the window 1 of the interface 1 and the first ratio, the content of the window 1 of the interface 1 in the animation 1 is cropped.
[0271] The total offset value is preset.
[0272] The first ratio can be equal to the quotient obtained by dividing the target offset value by the total offset value.
[0273] The display size of the window 1 of the interface 1 in the animation 1 can be equal to the difference between the initial size of the window 1 and a difference size. The difference size can be equal to the product of the difference between the initial size and the final size of the window 1 and the first ratio.
[0274] When the content of the window 1 of the interface 1 in the animation 1 is cropped, the peripheral interface part of the interface 1 can be cropped according to the first ratio.
[0275] In an example, the process of displaying the animation 1 on the screen can further include:
[0276] Based on the initial rounded corner of window 1 in interface 1, the rounded corner of the first capsule, and the first ratio, determine the rounded corner of window 1 in interface 1 in animation 1.
[0277] In animation 1, the rounded corner of window 1 in interface 1 can be equal to the difference between the initial rounded corner of window 1 and the difference rounded corner. The difference rounded corner can be equal to the product of the difference between the initial rounded corner of window 1 and the rounded corner of the first capsule and the first ratio.
[0278] S1604. In response to the completion of the first stage of the first gesture, the first animation ends, the window of the first interface is released, and a second interface is displayed on the screen. The second interface includes the first capsule and the alternative destination device icon for the task flow.
[0279] like Figure 17 As shown in Figure (d), at the moment the first stage of the first gesture is completed, animation 1 ends and is released. Figure 17 In Figure (c), window 1 of interface 1 displays interface 2 on the screen. Interface 2 includes the capsule 1 corresponding to application 1 and the icon of mobile phone B (assuming the current mobile phone is mobile phone A). Among them, mobile phone B is the alternative destination device for task flow.
[0280] It should be noted that interface 2 can display icons of multiple alternative destination devices for task flow, and is not limited to... Figure 17 One of the figures shown in (d).
[0281] like Figure 17 As shown in Figure (d), in this embodiment, interface 2 can be the interface of a smart interconnected application. The layer containing capsule 1 can be located above the layer containing the interface of the smart interconnected application.
[0282] In this embodiment, the activity manager can generate window 2 (the content of window 2 is the interface of the smart interconnection application, excluding capsule 1 before capsule 1 is generated) at any time after the first gesture begins and before capsule 1 is displayed on the screen. The transparency of window 2 is set to 0 so that window 2 is not displayed before capsule 1 is displayed on the screen. When capsule 1 is generated, the phone sets the transparency of window 2 to a first value (the first value is greater than 0), displays window 2 on the phone screen, and displays capsule 1 on top of window 2.
[0283] like Figure 17 As shown in Figure (d), Capsule 1 may include the application icon of application 1 and / or the application name of application 1 (application 1).
[0284] S1605. In the second stage, a second animation is displayed on the screen. The second animation is an animation in which the first capsule moves toward the target device icon according to the progress of the first gesture and disappears when it reaches the target device icon. The target device icon is one of the alternative target device icons.
[0285] like Figure 17 As shown in Figure (d), after the mobile phone screen displays interface 2, the user can continue to slide finger 1, finger 2, and finger 3 on the screen. The mobile phone responds to this continued sliding operation and displays animation 2 on the screen, that is, dragging capsule 1 to move towards the device icon of mobile phone B and disappearing when it reaches the device icon of mobile phone B.
[0286] It should be noted that when there are multiple alternative device icons on interface 2, users can select the target device by dragging capsule 1 to the target device icon.
[0287] In one example, reaching the target device icon could mean that capsule 1 partially overlaps with the target device icon.
[0288] In another example, reaching the target device icon could mean that the distance between the center point of capsule 1 and the center point of the target device icon is less than a preset distance threshold.
[0289] Of course, "reaching the target device icon" can also be defined with other meanings consistent with this embodiment, and this embodiment does not limit it.
[0290] S1606, In response to the completion of the second stage of the first gesture, the second animation ends, and the task flow of the first interface is transferred to the target device corresponding to the target device icon.
[0291] It should be noted that, for the sake of convenience, the interface animation corresponding to the complete first gesture is divided into two animations, Animation 1 and Animation 2. Those skilled in the art will understand that Animation 1 and Animation 2 can also be combined into a complete animation. In this case, Animation 1 and Animation 2 can be regarded as components of the complete animation.
[0292] In this embodiment, the mobile phone invokes the smart interconnection module to complete the flow of display tasks for interface 1. In other embodiments, other applications with task flow functions can also be used to complete the flow of display tasks for interface 1. This embodiment does not limit the specific application used to complete the task flow.
[0293] The following is combined with Figure 2 and Figure 6 The software architecture diagram shown illustrates the process by which the phone recognizes the aforementioned three-finger touch and swipe (i.e., recognizes the first gesture) from an internal implementation perspective.
[0294] The phone recognizes the first gesture through the Launcher, Input Manager, Window Manager, etc. Figure 18 This is an example diagram illustrating the process of a mobile phone recognizing a first gesture. Figure 18 In this example, application 1 is the foreground application. Please refer to [link / reference]. Figure 18The process of the mobile phone identifying the first gesture can include:
[0295] S1801, the desktop registers a gesture event listener with the input manager.
[0296] S1802, the user presses a finger on the screen.
[0297] In the case that the interface 1 of the application 1 is displayed full screen on the screen, the user presses a finger on the screen.
[0298] S1803, the input manager listens to the operation of the finger pressing on the screen, and dispatches a first gesture event to the desktop.
[0299] The input manager dispatches the first gesture event to the gesture recognition module of the desktop.
[0300] The content of the first gesture event can be that the finger 1, the finger 2 and the finger 3 touch the screen.
[0301] S1804, the desktop identifies the first gesture event as a three-finger touch, and applies to the activity manager to start a foreground window animation, and the desktop also calculates the initial center point position of the three fingers touching.
[0302] This step can be performed by the gesture recognition module of the desktop.
[0303] Here, the foreground window animation can be a complete animation composed of the aforementioned animation 1 and animation 2.
[0304] S1805, the activity manager notifies the window manager to prepare the foreground window animation.
[0305] S1806, the window manager returns the foreground task window control right to the interface control module of the desktop.
[0306] The interface control module plays the foreground window animation on the control screen by using the foreground task window control right.
[0307] S1807, the user moves the finger on the interface 1.
[0308] S1808, the input manager listens to the finger movement, and dispatches a second gesture event to the desktop.
[0309] The input manager dispatches the second gesture event to the gesture recognition module of the desktop.
[0310] S1809, the desktop calculates the offset value 1 of the finger 1, and calculates the current center point position according to the offset value 1 and the initial center point position.
[0311] S1810, the user lifts the finger 1.
[0312] S1811, the input manager listens to the finger 1 lifting up, dispatches a third gesture event to the gesture recognition module of the desktop.
[0313] S1812, if the desktop identifies that not all three fingers are lifting up according to the third gesture event, corrects the offset value 2 of the finger 2 to ensure that the current state of the foreground window does not change.
[0314] The current state of the foreground window refers to the current position, size, etc. of the foreground window.
[0315] S1813, the user lifts up the finger 2 and the finger 3.
[0316] S1814, the input manager listens to the finger 1 lifting up, dispatches a fourth gesture event to the gesture recognition module of the desktop.
[0317] S1815, if the desktop identifies that all three fingers are lifting up according to the fourth gesture event, determines to return to the initial state of the foreground or enter the task flow process of the smart interconnection application according to the current offset value.
[0318] That is, if the foreground window animation has not proceeded to the aforementioned animation 2, the user lifts up all the fingers, then the interface control module of the desktop controls the interface 1 to return to the initial state of the foreground application 1. If the foreground window animation has proceeded to the aforementioned animation 2, then the interface control module of the desktop controls to enter the task flow process of the smart interconnection application.
[0319] S1816, the desktop releases the control right of the foreground task window to the resource manager.
[0320] The identification that all three fingers are lifting up indicates that the first gesture has ended, at this time the desktop no longer needs to control the animation of the foreground task window corresponding to the task window, and therefore can release the control right of the foreground task window.
[0321] In the embodiment, the first gesture is the sum of all gestures corresponding to the first gesture event, the second gesture event, the third gesture event and the fourth gesture event.
[0322] The above describes the task flow process of the complete first gesture. It needs to be noted that if the first gesture ends before the first stage of the first gesture is completed, the screen no longer displays the uncompleted part of the animation 1 after the ending time, but starts to display the inverse animation of the played part of the animation 1 from the picture at the ending time of the animation 1, until returning to the initial state of the window 1 of the interface 1 before displaying the animation 1 (the initial state is the full screen state shown in (a) of FIG. 1 in the example). Figure 17
[0323] It can be understood that, in order to realize the above functions, the electronic device comprises hardware and / or software modules corresponding to each function. The algorithm steps of each example described in combination with the embodiments disclosed herein can be realized in the form of hardware or a combination of hardware and computer software. Whether a certain function is realized in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered beyond the scope of the present application.
[0324] In one example, Figure 16 A schematic block diagram of an apparatus 1600 is shown, which can comprise a processor 1601 and a transceiver / transceiver pin 1602, and optionally further comprises a memory 1603.
[0325] The various components of the apparatus 1600 are coupled together by a bus 1604, which can include a data bus, a power bus, a control bus, and a state signal bus. However, for the sake of clarity, the various buses are shown as a bus 1604.
[0326] Optionally, the memory 1603 can be used for instructions in the foregoing method embodiments. The processor 1601 can be used to execute the instructions in the memory 1603, and control the receiving pin to receive signals and the sending pin to send signals.
[0327] The apparatus 1600 can be an electronic device or a chip of an electronic device in the above method embodiments.
[0328] Wherein, all relevant contents of each step involved in the above method embodiments can be cited to the function description of the corresponding function module, which will not be repeated here.
[0329] The embodiment also provides a computer storage medium, which stores computer instructions, when the computer instructions run on an electronic device, make the electronic device execute the above related method steps to realize the method in the above embodiment.
[0330] The embodiment also provides a computer program product, when the computer program product runs on a computer, makes the computer execute the above related steps to realize the method in the above embodiment.
[0331] In addition, the embodiment of the present application further provides a device, which can be a chip, a component or a module, and the device can include a processor and a memory connected to each other; the memory is used to store computer-executed instructions; when the device is running, the processor can execute the computer-executed instructions stored in the memory, so that the chip executes the method in each method embodiment described above.
[0332] The electronic device, the computer storage medium, the computer program product or the chip provided in the embodiment are used to execute the corresponding method provided above, and thus the beneficial effects achieved by the electronic device, the computer storage medium, the computer program product or the chip can refer to the beneficial effects of the corresponding method provided above, which will not be described herein again.
[0333] Through the description of the above embodiments, those skilled in the art can understand that, for the convenience and brevity, only the division of the above functional modules is taken as an example, and in actual application, the above functions can be completed by different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above.
[0334] In several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of the modules or units is only a logical function division, and actual implementation can have another division manner, for example, a plurality of units or components can be combined or integrated into another device, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the units shown or discussed can be indirect coupling or communication connection through some interfaces, devices or units, and can be electrical, mechanical or other forms.
[0335] The units described as separate components can or can not be physically separate, and the components shown as units can be one physical unit or multiple physical units, that is, can be located in one place or distributed to multiple different places. Part or all of the units can be selected according to actual needs to achieve the purpose of the embodiment scheme.
[0336] In addition, each functional unit in each embodiment of the present application can be integrated in one processing unit, or each unit can exist physically, or two or more units can be integrated in one unit. The integrated unit can be realized in the form of hardware or in the form of a software functional unit.
[0337] Any content of each embodiment of the present application, and any content of the same embodiment, can be freely combined. Any combination of the above is within the scope of the present application.
[0338] If the integrated unit is implemented in the form of a software function unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application essentially or say the parts that make contributions to the prior art or the whole or part of the technical solutions can be embodied in the form of a software product, which is stored in a storage medium, includes several instructions to make a device (which can be a single-chip microcomputer, a chip, etc.) or a processor execute all or part of the steps of the various embodiments of the method of the present application. The aforementioned storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and various media that can store program codes.
[0339] The embodiments of the present application are described above in combination with the drawings, but the present application is not limited to the above-described specific embodiments, and the above-described specific embodiments are only illustrative, not restrictive. Those skilled in the art can make many forms under the inspiration of the present application without departing from the scope of the present application and the scope of protection of the claims, and all of them belong to the protection of the present application.
[0340] The steps of the method or algorithm described in combination with the disclosure of the embodiments of the present application can be implemented in hardware or by a processor executing software instructions. The software instructions can be composed of corresponding software modules, which can be stored in a random access memory (RAM), a flash memory, a read-only memory (ROM), an erasable programmable ROM (EPROM), an electrically EPROM (EEPROM), a register, a hard disk, a mobile hard disk, a compact disc (CD-ROM), or any other form of storage medium well known in the art. An exemplary storage medium is coupled to the processor, so that the processor can read information from the storage medium and write information to the storage medium. Of course, the storage medium can also be an integral part of the processor. The processor and the storage medium can be located in an ASIC.
[0341] Those skilled in the art can understand that the functions described in the embodiments of the present application in the one or more examples above can be implemented in hardware, software, firmware or any combination thereof. When implemented in software, the functions can be stored in a computer readable medium or transmitted as one or more instructions or codes on a computer readable medium. The computer readable medium includes computer storage medium and communication medium, wherein the communication medium includes any medium that facilitates the transfer of computer program from one place to another. The storage medium can be any available medium that can be accessed by a general or special purpose computer.
[0342] The embodiments of the present application are described above in combination with the drawings, but the present application is not limited to the specific embodiments described above, which are merely illustrative rather than restrictive, and those of ordinary skill in the art can make many forms under the inspiration of the present application without departing from the purpose of the present application and the scope protected by the claims.
Claims
1. An application circulation method, characterized in that, include: In response to a received three-finger swipe-up operation on a first application interface, the electronic device detects whether the movement speed of the three-finger swipe-up operation is greater than or equal to a first threshold; wherein, the first application interface displays the first application content of the first application; The electronic device detects that the movement speed of the three-finger swipe operation is greater than or equal to the first threshold, displays a first flow interface, and automatically moves the first application interface to a first position. In the process of moving the first application interface to the first position, the first application interface is automatically and gradually shrunk. The first flow interface is placed under the first application interface. When the first application interface moves to the first position and shrinks to the first size, the electronic device displays a second transition interface in full screen; wherein, the second transition interface includes a capsule-shaped first application icon, the electronic device icon, and at least one other electronic device icon; wherein, the first size is the size of a capsule, the first application interface is an application card; the second transition interface does not include the application card; the at least one other electronic device is a terminal that supports application transition; the first position corresponds to the position of the electronic device icon; In response to a raise-hand operation, the first application icon is snapped to the first position on the second flow interface; The electronic device moves the first application icon in response to a received drag operation on the first application icon; The electronic device detects that the first application icon has moved to the icon of the target device, and transfers the first application to the target device so that the target device displays the interface of the first application, and the first application interface continues to display the content of the first application on the target device.
2. The method according to claim 1, characterized in that, The electronic device, in response to a received three-finger swipe up gesture on a first application interface, detects whether the movement speed of the three-finger swipe up gesture is greater than or equal to a first threshold, including: The electronic device responds to a received three-finger swipe up operation on the first application interface and detects whether the movement speed of the three-finger swipe up operation is greater than or equal to a first threshold within a preset swipe distance. When the movement speed of the three-finger swipe operation is less than the first threshold, the electronic device moves the first application interface following the three-finger swipe operation, and gradually shrinks the first application interface as the swipe distance of the three-finger swipe operation increases. At the same time, within the preset swipe distance, it continuously detects whether the movement speed of the three-finger swipe operation is greater than or equal to the first threshold.
3. The method according to claim 2, characterized in that, The electronic device detects that the movement speed of the three-finger swipe operation is greater than or equal to the first threshold, displays a first flow interface, and moves the first application interface to a first position. Furthermore, during the process of moving the first application interface to the first position, the first application interface is gradually shrunk, including: Within the preset sliding distance, when the first application interface moves to the second position following the three-finger swipe operation and shrinks to the second size, it is detected that the moving speed of the three-finger swipe operation is greater than or equal to the first threshold. The first flow interface is then displayed, and the first application interface is moved from the second position to the first position. In the process of moving the first application interface from the second position to the first position, the first application interface is gradually shrunk from the second size to the first size.
4. The method according to claim 1, characterized in that, The electronic device, in response to a received three-finger swipe up gesture on a first application interface, detects whether the movement speed of the three-finger swipe up gesture is greater than or equal to a first threshold, including: The electronic device responds to the received three-finger swipe-up operation on the first application interface and determines that the application flow function is triggered. The electronic device draws the first transition interface, and the electronic device draws the second transition interface, and the electronic device detects whether the movement speed of the three-finger swipe operation is greater than or equal to the first threshold; wherein, the position of the first application icon on the second transition interface corresponds to the first position of the first application interface on the first transition interface.
5. The method according to claim 4, characterized in that, When the first application interface moves to the first position and shrinks to the first size, the electronic device displays a second transition interface, including: The electronic device detects that the first application interface has moved to the first position and shrunk to the first size, determines that the display conditions of the second transition interface are met, and displays the completed second transition interface.
6. The method according to any one of claims 1 to 5, characterized in that, When the first application interface moves to the first position and shrinks to the first size, the electronic device displays a second transition interface, including: The electronic device displays the second flow interface according to preset animation effects.
7. The method according to any one of claims 1 to 6, characterized in that, When the first application interface moves to the first position and shrinks to the first size, the electronic device displays a second transition interface, including: The electronic device cancels the display of the first flow interface.
8. The method according to any one of claims 1 to 7, characterized in that, Before receiving a three-finger swipe up operation, the first application interface is displayed in full screen on the display screen of the electronic device.
9. The method according to any one of claims 1 to 8, characterized in that, The step of gradually shrinking the first application interface during the process of moving the first application interface to the first position includes: The four sides of the first application interface are scaled down proportionally.
10. An electronic device, characterized in that, include: One or more processors or memories; And one or more computer programs, wherein the one or more computer programs are stored on the memory, and when the computer programs are executed by the one or more processors, cause the electronic device to perform the method of any one of claims 1-9.
11. A computer storage medium, characterized in that, Includes computer instructions that, when executed on an electronic device, cause the electronic device to perform the method as described in any one of claims 1-9.
12. A computer program product, characterized in that, When the computer program product is run on a computer, it causes the computer to perform the method as described in any one of claims 1-9.
13. A chip, characterized in that, The device includes one or more interface circuits and one or more processors; the interface circuits are configured to receive signals from the memory of the electronic device and send the signals to the processors, the signals including computer instructions stored in the memory; when the processor executes the computer instructions, the electronic device performs the method according to any one of claims 1-9.
Citation Information
Patent Citations
Control method applied to electronic equipment and electronic equipment
CN113810542A
Cross-device task migration method, device and system and storage medium
CN115268618A