Multi-device task circulation method and related device
Patent Information
- Application Number
- CN202380072898.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-11-22
- Filing Date
- 2023-09-19
- Publication Date
- 2025-05-27
AI Technical Summary
In multi-device collaboration, the existing technology has a single task transfer method, cannot realize intelligent transfer, has a poor user experience, and cannot adapt to the transfer methods of different devices and applications.
By displaying the control center page on the master device, users can drag and drop the application logo near the slave device logo to automatically adjust the transfer method, realize heterogeneous screen projection or continuous transfer, adapt to the task transfer methods of different applications and devices, and reduce user memory cost.
It realizes intelligent circulation, adapts to the circulation methods of different devices and applications, improves the user experience, simplifies the operation process, and reduces the difficulty for users to find the circulation entrance.
Smart Images

Figure CN120051754A_ABST
Abstract
Description
Multi-device task transfer method and related device
[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office of China on November 22, 2022, with application number 202211474246.3 and application name “Multi-device task transfer method and related apparatus”, the entire contents of which are incorporated by reference into this application. Technical Field
[0002] The present application relates to the field of terminal technology, and in particular to a multi-device task transfer method and related apparatus. Background Art
[0003] Multi-device collaboration is a distributed technology applied to multiple electronic devices. It enables cross-system and cross-device collaboration between two or more electronic devices, enabling resource sharing and collaborative operations. Task flow is a technology that enables seamless application continuity across multiple devices.
[0004] With the continuous development of terminal technology, multi-device collaboration has produced a variety of different task flow methods, such as: same-source screen projection, continuation, different-source screen projection, etc.
[0005] Summary of the Invention
[0006] The present invention provides a multi-device task transfer method and related apparatus, which are applied in the field of terminal technology. A first application and a second application are respectively transferred to a first slave device through heterogeneous screen projection and continuous flow. Different applications are adapted to different flow methods to achieve intelligent flow and improve user experience.
[0007] In the first aspect, an embodiment of the present application proposes a multi-device task flow method. The method includes: the master device displays a first interface, the first interface includes a page of a first application; the master device receives a first operation; in response to the first operation, the master device displays a second interface, the second interface includes a device identifier of the first slave device; the master device receives a second operation for the device identifier of the first slave device; in response to the second operation, the master device displays a third interface and sends a page of the first application to the first slave device so that the first slave device displays the page of the first application; the master device receives a third operation, the third operation is a return operation; in response to the third operation, the master device displays a fourth interface, the fourth interface does not include a page of the first application; the master device displays a fifth interface, the fifth interface includes a page of the second application the master device receives the fourth operation; in response to the fourth operation, the master device displays the sixth interface, which includes the device identification of the first slave device; the master device receives the fifth operation for the device identification of the first slave device; in response to the fifth operation, the master device displays the seventh interface, and sends the content displayed on the page of the second application to the first slave device, so that the first slave device starts the third application, the third application corresponds to the second application, and the content displayed on the page of the third application is the same as the content displayed on the page of the second application; the master device receives the sixth operation, which is a return operation; in response to the sixth operation, the master device displays the eighth interface, which includes the page of the second application.
[0008] In an embodiment of the present application, the first interface is an application page, and the first interface may correspond to the interface shown in a in Figure 6A and a in Figure 7A. The page of the first application may correspond to the A application page shown in Figure 6A. The first application may be a video application or other types of applications, which is not limited in this embodiment of the present application. The first operation is used to enter the control center page. The first operation may be a quick gesture operation, a voice operation, or other types of operations, which is not limited in this embodiment of the present application. The quick gesture operation may be a gesture operation such as swiping up with three fingers.
[0009] The second interface is the control center page, which may correspond to the interface shown in b in FIG6A or the interface shown in b in FIG7A. The form of the device identification of the first slave device can refer to the description in the embodiment section and will not be repeated here. In the embodiment of the present application, the second operation is used to select the first slave device. Based on different pages, the selection method may be different, which may be drag and drop selection, or clicking on the device identification of the first slave device to select, etc. The embodiment of the present application does not limit the type of the second operation.
[0010] The third interface is the control center page after the task flow is successful, which can correspond to the interface shown in e in Figure 6A and e in Figure 7A. The third operation is the return operation. The return operation in the embodiment of the present application refers to the operation of calling the back instruction. Or it can also be understood as the operation of exiting the control center page. The third operation can be a click operation, a shortcut operation, or a voice operation. The embodiment of the present application does not limit the specific type of the third operation.
[0011] The fourth interface is the interface displayed after exiting the control center, which may correspond to the interface shown in f in Figure 6A and f in Figure 7A. It is understandable that after the main device streams the first application through heterogeneous screen projection, the main device closes the first application and does not display the page of the first application.
[0012] In an embodiment of the present application, the fifth interface is an application page, and the fifth interface may correspond to the interface shown in a in Figure 6C and a in Figure 7B. The page of the second application may correspond to the application page B shown in Figure 6C. The second application may be a note application or other types of applications, which is not limited in this embodiment of the present application. The fourth operation is used to enter the control center page. The fourth operation may be a quick gesture operation, a voice operation, or other types of operations, which is not limited in this embodiment of the present application. The quick gesture operation may be a gesture operation such as swiping up with three fingers. The sixth interface is the control center page, which may correspond to the interface shown in b in Figure 6C and the interface shown in b in Figure 7B.
[0013] In the embodiment of the present application, the fifth operation is used to select the first slave device. Based on different pages, the selection method may be different, which may be drag selection, or clicking on the device identifier of the first slave device to select, etc. The embodiment of the present application does not limit the type of the fifth operation. The seventh interface is the control center page after the task flow is successful, which may correspond to the interface shown in e in Figure 6C and e in Figure 7B. The third application and the second application can be understood as different versions of the same application, for example, a note application on a mobile phone and a note application on a computer.
[0014] The sixth operation is the return operation. The return operation in the embodiment of the present application refers to the operation of calling the back instruction. Or it can also be understood as the operation of exiting the control center page. The sixth operation can be a click operation, a shortcut operation, or a voice operation. The embodiment of the present application does not limit the specific type of the sixth operation. The eighth interface is the interface displayed after exiting the control center, which can correspond to the interface shown in f in Figure 6C and f in Figure 7B.
[0015] In this way, the first and second applications can be adapted to different methods and can be respectively transferred to the first slave device through heterogeneous screen projection and continuous streaming. The master device can automatically adjust the streaming method according to the application, realizing intelligent streaming, eliminating the need for users to find the corresponding streaming entrance separately, reducing user memory costs and improving user experience.
[0016] Optionally, the second interface also includes the identifier of the first application, and the sixth interface also includes the identifier of the second application; the second operation is to drag the identifier of the first application to the vicinity of the device identifier of the first slave device; the fifth operation is to drag the identifier of the second application to the vicinity of the device identifier of the first slave device.
[0017] In the embodiment of the present application, the identifier of the first application and the identifier of the second application can both correspond to the task identifiers mentioned above, which will not be described in detail here. The identifier of the first application can correspond to the task identifier of application A, and the identifier of the second application can correspond to the task identifier of application B.
[0018] Being near the device identifier of the first slave device may be understood as a situation where the distance from the device identifier of the first slave device is less than a second threshold.
[0019] In this way, the control center page displays the corresponding application logo, which is simple, intuitive, and clear at a glance. By dragging the application logo near the device logo of the slave device, you can select the slave device, which is simple and easy to understand.
[0020] Optionally, the first operation and the fourth operation are the same, and the first operation is any one of the following operations: a three-finger swipe up operation, a double-click operation, a three-finger swipe down operation, and a triple-click operation.
[0021] In this way, entering the control center page through a shortcut makes operation convenient and fast, improving the user experience.
[0022] Optionally, the third operation is a left-swipe operation or a right-swipe operation on the edge of the screen, or a click operation on the first control displayed on the third interface; the sixth operation is a left-swipe operation or a right-swipe operation on the edge of the screen, or a click operation on the first control displayed on the seventh interface.
[0023] The first control may correspond to an exit control. It is understood that the master device may exit the control center page by sliding sideways or by clicking the exit control on the control center page. The third operation and the sixth operation may be the same or different.
[0024] In this way, multiple exit methods are provided, and users can exit the control center page in an appropriate way, thereby improving user experience.
[0025] Optionally, the master device is any one of a mobile phone, a computer, and a tablet, and the first slave device is any one of a mobile phone, a computer, and a tablet.
[0026] In this way, it can be applied to task transfer between multiple devices, with wide coverage, high practicality, and improved user experience.
[0027] Optionally, the fifth interface and the eighth interface are different interfaces, the fifth interface includes the first page of the second application, the eighth interface includes the second page of the second application, and the first page of the second application is different from the second page of the second application.
[0028] It is understandable that the fifth interface may correspond to a page being edited, or other pages being modified. The second page exits the page being edited, or exits the page being modified.
[0029] In this way, when the master device performs task flow through the connection, it will exit the editing, modification and other states, and the content of the interface displayed by the application before and after the task flow will be different.
[0030] Optionally, the second application is a note application; the first page of the second application is an editing page, which includes the content of the first note; and the second page of the second application is a list page, which includes the identifier of the first note.
[0031] The task flow in the embodiment of the present application can be applied to the note application, and the content of the interface displayed by the application is different before and after the note application flow.
[0032] Optionally, the first interface only includes the page of the first application, and the fourth interface is the desktop of the main device.
[0033] In the embodiments of the present application, a page that includes only the first application can refer to a page that displays the first application in full screen, or a page that displays the first application in an area other than the status bar area. Alternatively, a page that includes only the first application can be understood as a page that does not include pages of other applications except the page of the first application. This embodiment of the present application does not specifically limit this.
[0034] It is understandable that after the main device transfers the first application through the heterogeneous screen projection method, the main device closes the first application and does not display the page of the first application. If the main device only runs the first application in the foreground, after the first application is transferred through the heterogeneous screen projection method, the desktop is displayed.
[0035] Optionally, the first interface also includes a page of a fourth application, and the page of the fourth application and the page of the first application are displayed in split screen; the fourth interface includes a page of the fourth application.
[0036] The fourth application may be a note application or other types of applications, which are not limited in this embodiment of the present application. The fourth application may be the same as the second application or different from the second application.
[0037] It is understandable that if the main device runs the first application and the fourth application in the foreground, after the first application is transferred through heterogeneous screen projection, the page of the fourth application is displayed.
[0038] Optionally, the fifth interface also includes a page of the fifth application, and the page of the fifth application and the page of the second application are displayed in split screen; the eighth interface also includes a page of the fifth application, and the page of the second application and the page of the fifth application are displayed in split screen.
[0039] The fifth application may be a video application or other types of applications, which are not limited in this embodiment of the present application. The fifth application may be the same as the first application or different from the first application.
[0040] It is understandable that if the main device runs the second application and the fifth application in the foreground, after the second application is transferred in a continuous manner, the page of the second application and the page of the fifth application are displayed.
[0041] Optionally, the first interface also includes a first floating window, which displays a page of the sixth application; the second interface does not include the logo of the sixth application, and the fourth interface also displays a second control; in response to the user's operation on the second control, the first floating window is displayed on the fourth interface.
[0042] The application displayed by the floating window may correspond to the small window application mentioned above. The sixth application may be a video application or other types of applications, which are not limited in this embodiment of the present application. The second control may correspond to a reduced small window application, which may also be called a floating ball. The fourth interface may correspond to the interface shown in Figure 8A or Figure 8B.
[0043] It is understood that the small window app does not perform task transfer. After the task transfer, the small window app shrinks to the edge of the screen. The display of the small window app can be restored through the shrunken small window app.
[0044] Optionally, the fifth interface also includes a second floating window, which displays a page of the seventh application; the sixth interface does not include the logo of the seventh application, and the eighth interface also displays a third control; in response to the user's operation on the third control, the second floating window is displayed on the eighth interface.
[0045] The application displayed through the floating window may correspond to the small window application mentioned above. The seventh application may be a video application or other types of applications, which is not limited in the embodiments of the present application. The third control may correspond to a reduced small window application, which may also be referred to as a floating ball. The eighth interface may correspond to the interface shown in Figure 8A or Figure 8B. It is understandable that the small window application does not perform task transfer. After the task transfer, the small window application is reduced to the edge of the screen. The display of the small window application can be restored through the reduced small window application.
[0046] Optionally, the master device is any one of a mobile phone, a computer, and a tablet, the first slave device is a large screen, and the fourth interface includes a page of the first application.
[0047] When the secondary device is a large screen, the first application transfers tasks using same-source screen projection. In same-source screen projection, the application's page remains unchanged before and after the task transfer, displaying the same content. The page displayed on the secondary device is the same as the page displayed on the primary device.
[0048] Optionally, the first interface also includes a page of a fourth application. When the page of the fourth application and the page of the first application are displayed in split screen, the fourth interface does not include the page of the fourth application.
[0049] In a split-screen scenario, the application page remains unchanged and the displayed content remains the same before and after the task flow in the same-source screen projection. The page displayed on the slave device is the same as the page displayed on the master device.
[0050] Optionally, the master device is any one of a mobile phone, a computer, and a tablet, the first slave device is a large screen, and the page of the second application included in the fifth interface and the page of the second application included in the eighth interface are the same page.
[0051] When the secondary device is a large screen, the secondary application transfers tasks using same-source screen projection. In same-source screen projection, the application's page remains unchanged before and after the task transfer, displaying the same content. The page displayed on the secondary device is the same as the page displayed on the primary device.
[0052] Optionally, the page of the first application is a page for playing videos.
[0053] Optionally, the method also includes: the master device displays a ninth interface, the ninth interface includes a page of an eighth application; the master device receives a seventh operation; in response to the seventh operation, the master device displays a tenth interface, the tenth interface includes the device identification of the second slave device; the master device receives an eighth operation for the device identification of the second slave device; in response to the eighth operation, the master device displays an eleventh interface, the eleventh interface includes the device identification of the master device and the device identification of the second slave device, wherein the device identification of the master device is connected to the device identification of the second slave device.
[0054] The ninth interface is the application page, which may correspond to the interface shown in a in Figure 6A and a in Figure 6C above, or other pages running foreground applications. The seventh operation is similar to the first operation, and specific reference may be made to the description of the first operation above, which will not be repeated here. The tenth interface may correspond to a control center page that is not in a collaborative state. The eleventh interface may correspond to a control center page in collaboration. The eighth operation is used to select the device identifier of the second slave device, which may be a click operation or a drag operation. The embodiment of the present application does not limit the specific type of the eighth operation.
[0055] In the embodiment of the present application, connected can be connected, or can be close to each other (such as being next to each other), which is not limited here.
[0056] In this way, the control center page can also realize the collaborative connection between the master device and the slave device.
[0057] Optionally, the eighth operation is an operation of dragging the device identifier of the second slave device to a vicinity of the device identifier of the master device.
[0058] In this way, being near the device identifier of the main device can be understood as a situation where the distance from the device identifier of the main device is less than the third threshold.
[0059] In this way, by dragging the device identifier of the slave device to the vicinity of the device identifier of the master device, a slave device that cooperates with the master device is selected. The operation is simple and easy to understand.
[0060] Optionally, the tenth interface also includes the logo of the eighth application, and the eleventh interface does not include the logo of the eighth application.
[0061] It is understandable that the control center page that is not in a collaborative state displays the application logo and can perform task transfer; the control center page in a collaborative state does not display the application logo and cannot perform task transfer.
[0062] Optionally, the eleventh interface further includes a first identifier, and the first identifier indicates a collaboration type between the master device and the second slave device.
[0063] The first identifier can correspond to same-source screen projection, screen extension, screen mirroring, keyboard and mouse sharing, etc.
[0064] This makes it easier for users to confirm the collaboration type between the master device and the slave device, improving user experience.
[0065] Optionally, the eleventh interface also includes a second identifier, and the method further includes: the master device receives a ninth operation for the second identifier; in response to the ninth operation, the master device and the second slave device switch to a collaboration type corresponding to the second identifier.
[0066] The second identifier may correspond to a collaboration type such as same-source screen projection, screen extension, screen mirroring, keyboard and mouse sharing, etc. The ninth operation may be a click operation, a touch operation, etc., and the embodiment of the present application does not limit the ninth operation.
[0067] In this way, the user can adjust the collaboration type between the master device and the slave device through the second identifier, switch the collaboration mode, and improve the user experience.
[0068] Optionally, the eleventh interface also includes a fourth control, and the method also includes: the master device receives a tenth operation for the fourth control; in response to the tenth operation, the master device disconnects from the second slave device; the master device displays a twelfth interface, the twelfth interface includes a device identifier of the master device and a device identifier of the second slave device, and the device identifier of the master device is not connected to the device identifier of the second slave device.
[0069] The control center page after the twelfth interface is not disconnected from the collaborative connection may correspond to the interface shown in Figure 11A. The fourth control may correspond to a disconnect control (button). The tenth operation may be a click operation, a touch operation, or other type of operation, which is not specifically limited in the embodiments of the present application.
[0070] In this way, the connection between the master device and the slave device can be disconnected through the fourth control, and the collaboration can be disconnected, which is easy to operate.
[0071] Optionally, the method also includes: the master device receives an eleventh operation for the device identification of the second slave device on the eleventh interface; in response to the eleventh operation, the master device disconnects from the second slave device; the master device displays a thirteenth interface, the thirteenth interface includes the device identification of the master device and the device identification of the second slave device, and the device identification of the master device is not connected to the device identification of the second slave device.
[0072] The thirteenth interface, the control center page after the collaborative connection is not disconnected, may correspond to the interface shown in Figure 11 B. The eleventh operation may be a drag operation or other types of operations, which are not specifically limited in the embodiment of the present application.
[0073] In this way, the connection between the master device and the slave device can be disconnected by dragging and dropping, and the collaboration is disconnected, which is easy to operate.
[0074] Optionally, the eleventh interface also includes the identification of the third slave device, and the device identification of the master device is not connected to the device identification of the third slave device; the method also includes: the master device receives a twelfth operation for the device identification of the third slave device on the eleventh interface; in response to the twelfth operation, the master device disconnects from the second slave device and establishes a connection with the third slave device; the master device displays the fourteenth interface, the fourteenth interface includes the device identification of the master device, the device identification of the second slave device and the identification of the third slave device, the device identification of the master device is connected to the device identification of the third slave device, and the device identification of the master device is not connected to the device identification of the second slave device.
[0075] The twelfth operation is used to switch the slave device connected to the master device. The twelfth operation can be an operation of dragging the device identifier of the third slave device, or other types of operations, which are not limited in this embodiment of the present application. The fourteenth interface can correspond to the interface shown in Figure 12.
[0076] In this way, the master device can switch to a coordinated slave device to improve the user experience.
[0077] Optionally, the collaboration type includes any one of the following types: same-source screen projection, screen extension, screen mirroring, and keyboard and mouse sharing.
[0078] In a second aspect, an embodiment of the present application provides an electronic device, including a terminal device, which may also be referred to as a terminal, user equipment (UE), mobile station (MS), mobile terminal (MT), etc. The terminal device may be a mobile phone, a smart TV, a wearable device, a tablet computer (Pad), a computer with wireless transceiver functions, a virtual reality (VR) terminal device, an augmented reality (AR) terminal device, a wireless terminal in industrial control, a wireless terminal in self-driving, a wireless terminal in remote medical surgery, a wireless terminal in a smart grid, a wireless terminal in transportation safety, a wireless terminal in a smart city, a wireless terminal in a smart home, etc.
[0079] The electronic device comprises: a processor and a memory; the memory stores computer-executable instructions; the processor executes the computer-executable instructions stored in the memory, so that the electronic device performs the method of the first aspect.
[0080] In a third aspect, an embodiment of the present application provides a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the method of the first aspect.
[0081] In a fourth aspect, an embodiment of the present application provides a computer program product, which includes a computer program. When the computer program is run, it enables the computer to execute the method of the first aspect.
[0082] In a fifth aspect, an embodiment of the present application provides a chip, the chip including a processor, the processor being used to call a computer program in a memory to execute the method described in the first aspect.
[0083] It should be understood that the second to fifth aspects of the present application correspond to the technical solutions of the first aspect of the present application, and the beneficial effects achieved by each aspect and the corresponding feasible implementation methods are similar and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0084] FIG1 is a schematic diagram of the hardware structure of a terminal device provided in an embodiment of the present application;
[0085] FIG2 is a schematic diagram of a software structure of a terminal device provided in an embodiment of the present application;
[0086] FIG3 is a schematic diagram of an interface of a control center page provided in an embodiment of the present application;
[0087] FIG4A is a schematic diagram of an interface for entering a control center page provided in an embodiment of the present application;
[0088] FIG4B is a schematic diagram of an interface for hiding a control center card provided in an embodiment of the present application;
[0089] FIG4C is a schematic diagram of an interface of a control center card provided in an embodiment of the present application;
[0090] FIG5 is a schematic diagram of another interface for entering a control center page provided in an embodiment of the present application;
[0091] FIG6A is a schematic diagram of an interface for task transfer provided in an embodiment of the present application;
[0092] FIG6B is a schematic diagram of an interface of a slave device provided in an embodiment of the present application;
[0093] FIG6C is a schematic diagram of another interface for task transfer provided in an embodiment of the present application;
[0094] FIG6D is a schematic diagram of an interface of a slave device provided in an embodiment of the present application;
[0095] FIG6E is a schematic diagram of another interface for task transfer provided in an embodiment of the present application;
[0096] FIG6F is a schematic diagram of an interface of a slave device provided in an embodiment of the present application;
[0097] FIG7A is a schematic diagram of an interface for task flow during split-screen display provided by an embodiment of the present application;
[0098] FIG7B is a schematic diagram of an interface for task transfer during another split-screen display according to an embodiment of the present application;
[0099] FIG7C is a schematic diagram of an interface for task transfer during another split-screen display according to an embodiment of the present application;
[0100] FIG7D is a schematic diagram of an interface of a slave device provided in an embodiment of the present application;
[0101] FIG8A is a schematic diagram of an interface for task flow in a small window application according to an embodiment of the present application;
[0102] FIG8B is a schematic diagram of an interface for task flow in another small window application provided by an embodiment of the present application;
[0103] FIG8C is a schematic diagram of an interface for task flow in another small window application provided by an embodiment of the present application;
[0104] FIG9 is a schematic diagram of an interface for a task transfer failure provided by an embodiment of the present application;
[0105] FIG10 is a schematic diagram of an interface for device collaboration provided in an embodiment of the present application;
[0106] FIG11A is a schematic diagram of an interface for collaborative device connection provided by an embodiment of the present application;
[0107] FIG11B is a schematic diagram of an interface for collaborative disconnection of devices provided in an embodiment of the present application;
[0108] FIG12 is a schematic diagram of an interface of a handover coordination device provided in an embodiment of the present application;
[0109] FIG13A is a schematic diagram of an interface of a master device provided in an embodiment of the present application;
[0110] FIG13B is a schematic diagram of an interface of a master device provided in an embodiment of the present application;
[0111] FIG14 is a schematic diagram of an interface of a master device provided in an embodiment of the present application;
[0112] FIG15 is a flow chart of a multi-device task transfer method provided in an embodiment of the present application;
[0113] FIG16 is a schematic structural diagram of a multi-device task transfer apparatus provided in an embodiment of the present application. DETAILED DESCRIPTION
[0114] To facilitate a clear description of the technical solutions of the embodiments of the present application, some of the terms and technologies involved in the embodiments of the present application are briefly introduced below:
[0115] 1. Multi-screen collaboration: Projecting the user interface of electronic device A onto the screen of electronic device B for display, allowing the user to operate the user interface of electronic device A on electronic device B, and transferring files from electronic device B to electronic device A by performing specific operations on electronic device B (for example, dragging and dropping files from the user interface of electronic device B to the user interface of electronic device A), thereby enabling cross-device operations and cross-device file transfers between electronic devices A and B. The user interface of electronic device A can be displayed in any area of the screen of electronic device B or in full screen.
[0116] The multi-screen collaboration in the embodiment of the present application includes: same-source screen projection, screen extension, screen mirroring, keyboard and mouse sharing, etc. At the same time, any two devices use a collaborative mode.
[0117] 2. Screen expansion: Use the screen of electronic device B as the secondary screen of electronic device A. Electronic device A can transfer part of the content it needs to display to the secondary screen for display. The screens of electronic device A and electronic device B can display content together, expanding the display capabilities of electronic device A.
[0118] 3. Screen mirroring: Mirror all the content on the screen of electronic device A to the screen of electronic device B. The content displayed on electronic device B is the same as the content displayed on electronic device A, and changes as the content displayed on electronic device A changes.
[0119] 4. Keyboard and Mouse Sharing: Electronic devices A and B can share their existing input devices, such as a mouse and keyboard. For example, if the input device of electronic device A is shared with electronic device B, the shared input device can be used for input on both electronic devices A and B. Furthermore, with keyboard and mouse sharing, files can be transferred between electronic devices A and B.
[0120] 5. Continuation: When a user runs an application on electronic device A, the interface of electronic device B may prompt the user to open the application currently running on electronic device A on electronic device B, thereby transferring the operation to electronic device B. Alternatively, when a user runs an application on electronic device A, when the user opens the application on electronic device B, the progress of the application on electronic device B is the same as the progress on electronic device A, that is, electronic device B synchronizes the progress of the application running on electronic device A. For example, watching a video, editing a document, etc. For example: a document application is running on electronic device A, which may be a memo, word, etc., and the user is editing a document on electronic device A. When electronic device B and electronic device A are close to each other, a prompt message is displayed on electronic device B, and the user clicks the prompt message on electronic device B. In response to the user's click, electronic device B opens the document application and displays the location where the user is editing, thereby transferring the editing to electronic device B.
[0121] 6. Single-window application screen projection (heterogeneous screen projection): Electronic device A uses two-way encoding, one of which sends the default interface to the display (i.e., displayed on the display of electronic device A). The other encoding sends the standard video stream corresponding to the screen projection application interface rendered on the virtual screen to electronic device B.
[0122] It is understandable that, taking heterogeneous screen projection of application A as an example, the user can close the window of application A on electronic device B, switch the page displayed in the window of application A, and perform other controls, but cannot control other applications in electronic device A.
[0123] 7. Same-source screen projection: Project the content (e.g., videos, photos, etc.) on the screen of electronic device A to the screen of electronic device B for display. In the same-source screen projection scenario, both electronic device A and electronic device B display the interface displayed by electronic device A.
[0124] Alternatively, it can be understood as taking the form of extending the screen to project the interfaces of multiple applications launched on electronic device A to electronic device B. In the same-source projection mode, electronic device A uses one-way encoding to send the projection application interface rendered on the virtual screen and the video stream corresponding to the default interface to electronic device B, so that the default interface and the interface of one or more projection applications launched in the form of free floating windows on electronic device A are displayed on the display screen of electronic device B. Among them, the default interface can be understood as the interface sent by electronic device A.
[0125] In some embodiments, electronic device B can reversely control electronic device A. For example, a PC can reversely control a mobile phone.
[0126] It is understandable that the same-source screen projection method can ensure the continuity of the application; while the different-source screen projection method requires restarting the application when switching between different screens.
[0127] Device collaboration: The master device and slave devices are connected in a collaborative manner. Task transfer: The tasks are transferred to the slave devices, but no collaboration between the devices is performed.
[0128] 8. Other terms
[0129] In the embodiments of this application, terms such as "first" and "second" are used to distinguish between identical or similar items with substantially the same functions and effects. For example, the terms "first chip" and "second chip" are used solely to distinguish between different chips and do not define their order. Those skilled in the art will understand that terms such as "first" and "second" do not define the quantity or execution order, and do not necessarily define differences.
[0130] It should be noted that in the embodiments of this application, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described in this application as "exemplary" or "for example" should not be construed as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.
[0131] In the embodiments of the present application, "at least one" refers to one or more, and "more" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: the existence of A alone, the existence of A and B at the same time, and the existence of B alone, where A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. "At least one of the following items" or similar expressions refers to any combination of these items, including any combination of single items or plural items. For example, at least one of a, b, or c can represent: a, b, c, ab, a--c, bc, or abc, where a, b, c can be single or multiple.
[0132] 9. Terminal equipment
[0133] The terminal device of the embodiment of the present application may also be any form of electronic device. For example, the electronic device may include a handheld device with image processing function, a vehicle-mounted device, etc. For example, some electronic devices include: mobile phones, tablet computers, PDAs, laptop computers, mobile internet devices (MIDs), wearable devices, virtual reality (VR) devices, augmented reality (AR) devices, wireless terminals in industrial control, wireless terminals in self-driving cars, wireless terminals in remote medical surgery, wireless terminals in smart grids, wireless terminals in transportation safety, wireless terminals in smart cities, wireless terminals in smart homes, cellular phones, cordless phones, session initiation protocol (SIP) phones, wireless local loop (WLL) stations, personal digital assistants (PDAs), handheld devices with wireless communication capabilities, computing devices or other processing devices connected to wireless modems, in-vehicle devices, wearable devices, terminal devices in 5G networks or future evolved public land mobile communication networks. The terminal equipment in the network (PLMN), etc., is not limited to this in the embodiments of the present application.
[0134] As an example and not a limitation, in the embodiments of the present application, the electronic device may also be a wearable device. Wearable devices may also be referred to as wearable smart devices, which are a general term for wearable devices that are intelligently designed and developed using wearable technology for daily wear, such as glasses, gloves, watches, clothing, and shoes. A wearable device is a portable device that is worn directly on the body or integrated into the user's clothes or accessories. Wearable devices are not only hardware devices, but also achieve powerful functions through software support, data interaction, and cloud interaction. Broadly speaking, wearable smart devices include those that are fully functional, large in size, and can achieve complete or partial functions without relying on smartphones, such as smart watches or smart glasses, as well as those that only focus on a certain type of application function and need to be used in conjunction with other devices such as smartphones, such as various smart bracelets and smart jewelry for vital sign monitoring.
[0135] In addition, in the embodiments of the present application, the electronic device can also be a terminal device in the Internet of Things (IoT) system. IoT is an important part of the future development of information technology. Its main technical feature is to connect objects to the network through communication technology, thereby realizing an intelligent network of human-machine interconnection and object-to-object interconnection.
[0136] The electronic devices in the embodiments of the present application may also be referred to as: terminal equipment, user equipment (UE), mobile station (MS), mobile terminal (MT), access terminal, user unit, user station, mobile station, mobile station, remote station, remote terminal, mobile device, user terminal, terminal, wireless communication equipment, user agent or user device, etc.
[0137] In the embodiments of the present application, the electronic device or each network device includes a hardware layer, an operating system layer running on the hardware layer, and an application layer running on the operating system layer. The hardware layer includes hardware such as a central processing unit (CPU), a memory management unit (MMU), and memory (also known as main memory). The operating system can be any one or more computer operating systems that implement business processing through processes, such as the Linux operating system, the Unix operating system, the Android operating system, the iOS operating system, or the Windows operating system. The application layer includes applications such as browsers, address books, word processing software, and instant messaging software.
[0138] For example, FIG1 shows a schematic structural diagram of a terminal device.
[0139] The terminal device may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
[0140] It should be understood that the structures illustrated in the embodiments of the present invention do not constitute specific limitations on the terminal device. In other embodiments of the present application, the terminal device may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0141] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.
[0142] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.
[0143] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.
[0144] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface.
[0145] It is understood that the interface connection relationship between the modules illustrated in the embodiment of the present invention is only a schematic illustration and does not constitute a structural limitation on the terminal device. In other embodiments of the present application, the terminal device may also adopt a different interface connection method from the above embodiment, or a combination of multiple interface connection methods.
[0146] The terminal device implements display functionality through a GPU, display screen 194, and an application processor. The GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.
[0147] The terminal device can realize the shooting function through the ISP, camera 193, video codec, GPU, display 194 and application processor.
[0148] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the terminal device. The external memory card communicates with the processor 110 via the external memory interface 120 to implement data storage functions. For example, files such as music and videos can be stored on the external memory card.
[0149] The internal memory 121 can be used to store computer executable program code, and the executable program code includes instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the terminal device (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the terminal device by running instructions stored in the internal memory 121, and / or instructions stored in a memory provided in the processor. For example, the multi-device task flow method of an embodiment of the present application may be executed.
[0150] It is understood that the structures illustrated in the embodiments of the present application do not constitute specific limitations on the terminal device. In other embodiments of the present application, the terminal device may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0151] The software system of the terminal device can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes the Android system of the layered architecture as an example to exemplify the software structure of the terminal device.
[0152] Figure 2 is a block diagram of the software structure of a terminal device in an embodiment of the present application. The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system can be divided into four layers: the application layer (applications), the application framework layer (application framework), the Android runtime (Android runtime) and system libraries, and the kernel layer (kernel).
[0153] The application layer includes a series of application packages. The application layer runs applications by calling the application programming interface (API) provided by the application framework layer. As shown in Figure 2, application packages may include applications such as camera, calendar, phone, map, phone, music, settings, email, video, and social networking.
[0154] The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer includes some predefined functions.
[0155] As shown in FIG2 , the application framework layer may include a window manager, a content provider, a resource manager, a view system, a notification manager, and the like.
[0156] The window manager is used to manage window programs. The window manager can obtain the display size, determine whether there is a status bar, lock the screen, touch the screen, drag the screen, take screenshots, etc.
[0157] Content providers are used to store and retrieve data and make it accessible to applications. Data can include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.
[0158] The view system includes visual controls, such as those for displaying text and images. The view system is used to build applications. A display interface can consist of one or more views. For example, a display interface containing a text notification icon might include a view for displaying text and a view for displaying images.
[0159] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.
[0160] The Notification Manager allows applications to display notifications in the status bar. These messages can be displayed briefly and then disappear automatically, without requiring user interaction. For example, the Notification Manager can be used to notify users of completed downloads and message reminders. The Notification Manager can also display notifications in the top status bar of the system as icons or scrolling text, such as notifications from background applications, or as dialog windows on the screen. Examples include displaying text messages in the status bar, emitting alert sounds, vibrating the device, or flashing indicator lights.
[0161] The Android runtime includes the core library and the virtual machine. The Android runtime is responsible for scheduling and management of the Android system.
[0162] The core library consists of two parts: one is the function that needs to be called by the Java language, and the other is the Android core library.
[0163] The application layer and application framework layer run in a virtual machine. The virtual machine executes Java files in the application layer and application framework layer as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.
[0164] The system library may include multiple functional modules, such as a surface manager, media libraries, a 3D graphics processing library (e.g. OpenGL ES), a 2D graphics engine (e.g. SGL), etc.
[0165] The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.
[0166] The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
[0167] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
[0168] A 2D graphics engine is a drawing engine for 2D drawings.
[0169] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, and sensor driver.
[0170] It should be understood that in some embodiments, layers that implement the same function may be referred to by other names, or a layer that can implement the functions of multiple layers may be considered as one layer, or a layer that can implement the functions of multiple layers may be divided into multiple layers. This embodiment of the present application does not limit this.
[0171] Multi-device collaboration is a distributed technology applied to multiple electronic devices. It enables two or more electronic devices to collaborate across systems and devices, enabling resource sharing and collaborative operations.
[0172] Multi-device collaboration can be applied between electronic devices of the same or different types. The types of electronic devices include, but are not limited to, mobile phones, tablet computers, laptops, large-screen devices (e.g., smart TVs, smart screens), personal computers (PCs), handheld computers, netbooks, personal digital assistants (PDAs), wearable electronic devices, in-vehicle devices, virtual reality devices, and other devices. The mobile phone in the embodiments of the present application can be a foldable screen mobile phone or a non-foldable screen mobile phone, which is not limited here.
[0173] Multi-device collaboration needs to be implemented based on communication connections between devices. The communication connection can be a wired communication connection or a wireless communication connection. Among them, the wired communication connection solution can include, for example, USB On-The-Go (OTG) technology; the wireless communication solution can include, for example, wireless fidelity (Wi-Fi), Wi-Fi Direct (Wi-Fi Direct), Bluetooth (BT), near field communication technology (NFC), infrared technology (IR), etc.
[0174] With the continuous development of terminal technology, multi-device collaboration has produced a variety of different collaboration types (also known as collaborative services), such as screen extension, screen projection, screen mirroring, multi-screen collaboration, keyboard and mouse sharing, super keyboard and mouse, etc. Among the multiple collaboration types listed above: some collaboration types are initiated by the master device (generally the initiator of multi-device collaboration) to the slave device (generally the participant of multi-device collaboration) in response to user operations, so they can be called manual collaboration services or manual collaboration services, such as screen extension, screen projection, screen mirroring, multi-screen collaboration, keyboard and mouse sharing, etc.; other collaboration types are automatically triggered when the triggering rules are met when the user turns on the function, so they can be called automatic collaboration services or automatic collaboration services, such as super connection, etc.
[0175] For two electronic devices, the collaboration type they support is generally related to factors such as device type, screen size, device capability, etc. Therefore, two electronic devices may support only one collaboration type or multiple collaboration types.
[0176] In traditional solutions, the applications used for task flow in terminal devices are video applications, and the type of application being flowed is single. In addition, when performing task flow, intelligent flow cannot be achieved for different devices, resulting in a poor user experience.
[0177] In view of this, the embodiment of the present application provides a multi-device task transfer method. Based on the type of slave device and application type, it adapts to different transfer methods, performs intelligent transfer, reduces user memory cost, and improves user experience.
[0178] To facilitate those skilled in the art to understand the technical solutions of the embodiments of the present application, the embodiments of the present application classify the electronic devices that may be involved in various scenarios of multi-device collaboration, including but not limited to master devices and slave devices.
[0179] Master device: This includes the device currently held by the user. The user can perform operations on the master device to initiate multi-device collaboration and task transfer to other devices. Therefore, the master device is generally also the device that initiates multi-device collaboration and task transfer. The multi-device task transfer method provided in the embodiments of the present application can be implemented in the master device.
[0180] Slave devices: These devices are located near the master device and are logged into the same account as the master device. The master and slave devices are typically electronic devices manufactured by the same manufacturer. For example, the master device could be a mobile phone from manufacturer A, and the slave device could be a tablet or large-screen device from manufacturer A. The accounts used to log into the master and slave devices can be accounts that the user has applied for from the device manufacturer.
[0181] The multi-device task transfer method provided in the embodiment of the present application can be implemented in a master device. For example, the master device can execute each step of the multi-device task transfer method in response to one or more operations performed by a user.
[0182] The following describes the multi-device transfer method of the embodiment of the present application in detail through specific embodiments. The following embodiments can be combined with each other or implemented independently, and the same or similar concepts or processes may not be repeated in some embodiments.
[0183] The control center page provided by the embodiment of the present application is described below in conjunction with Figure 3. The example of the control center page shown in Figure 3 is that, during the process of the main device running application A, the main device detects the user's preset gesture and displays the control center page shown in Figure 3, and the page shown in Figure 3 includes the logo of application A. The preset gesture can be a three-finger swipe up on the screen, a swipe up from the bottom of the screen, etc., which is not limited in this application. Alternatively, in another possible implementation, during the process of the main device running application A, the main device detects that the user opens the notification center, such as swiping down from the top to open the drop-down menu of the notification center, and the drop-down menu may include a card for the user to enter the control center. When the main device detects that the user clicks the card, the control center page shown in Figure 3 may be displayed, or another control center page may be displayed, and the other control center page does not include the logo of application A.
[0184] As shown in Figure 3, the control center page includes a master device identifier 301, a slave device identifier 302, and a task identifier 303. The device identifier can be a tablet device identifier, a large-screen device identifier, a PC device identifier, a mobile phone device identifier, etc. Task identifier 303 indicates the identifier of application A currently running on the master device.
[0185] The device identification 301 of the master device and the device identification 302 of the slave device may be graphical identifications, such as icons, or other skeuomorphic elements.
[0186] In some embodiments, on the control center page, the device identifier 301 of the master device and the device identifier 302 of the slave device can be different colors to facilitate user differentiation. For example, the device identifier 301 of the master device can be blue, and the device identifier 302 of the slave device can be white (or transparent). In addition, on the control center page, the device identifier 301 of the master device and the device identifier 302 of the slave device can be different sizes to facilitate user differentiation. For example, the size of the device identifier 301 of the master device can be larger than the size of the device identifier 302 of the slave device.
[0187] In the scenario where the master device and the slave devices have not established multi-device collaboration, the control center page may include the device identification 301 of the master device and the device identification 302 of each slave device. The device identification 301 of the master device may be located in the central area of the control center page, for example, in the center, the lower center area, the upper center area, etc. of the control center page 300, and this application does not limit this. The device identification 302 of the slave device may be distributed around the device identification of the master device. In some embodiments, the device identification 302 of the slave device is located below the device identification 301 of the master device.
[0188] For example, the master device's device identifier 301 is located in the upper center of the control center page. The device identifiers 302 of each slave device, such as a tablet device identifier, a large-screen device identifier, a PC device identifier, and a mobile phone device identifier, can be evenly distributed in a semicircle below the master device identifier 301.
[0189] For scenarios where the master device and the slave device establish multi-device collaboration, please refer to the relevant description in the collaboration section below and will not be repeated here.
[0190] The task identifier 303 may be a graphical identifier, such as an icon, or other skeuomorphic elements, etc. For example, the application icon may be used as the task identifier 303 , or the application name may be used as the task identifier 303 , which is not limited in this embodiment of the present application.
[0191] In some embodiments, the control center page may further include a device name 304 of each slave device. The device name 304 may be displayed in conjunction with its corresponding device identifier 302. For example, the device name may be displayed above, below, or in other locations above its corresponding device identifier 302. In the embodiment of the present application, the device name 304 may be the product name of the slave device, such as Honor TV, Honor Pad, Honor Magic Book, etc. The device name 304 may also be a user-defined name, such as Xiao Li's Honor tablet, Honor Smart Screen in the living room, etc. This embodiment of the present application does not limit this.
[0192] It is understandable that the task identifier 303 is distributed around the device identifier 301 of the main device, for example, it can be distributed above the device identifier 301 of the main device, or distributed below the device identifier 301 of the main device, etc., and this application does not limit this.
[0193] In some embodiments, the control center page also includes one or more function buttons, such as a details button 305 and an exit button 306. A user can learn how to use the control center page by clicking the details button 305. A user can exit the control center page by clicking the exit button 306. The user can also exit the control center page through quick operations such as swiping.
[0194] In an embodiment of the present application, when the user drags the device identifier 302 of any slave device to the vicinity of the device identifier 301 of the master device, the master device establishes a connection with the slave device and performs a collaborative connection, etc.; when the user drags the task identifier 303 to the vicinity of the device identifier 302 of any slave device, the master device transfers the application corresponding to the task identifier to the corresponding slave device based on the type of the slave device, the status of the application installed on the slave device, etc.
[0195] The following describes how to enter the control center page in conjunction with FIG. 4A to FIG. 5 .
[0196] In the embodiment of the present application, the user can enter the control center page through the control center card in the notification center page, or through a quick operation to enter the control center page. The quick operation can be a three-finger upward swipe, or other types of quick operations, which are not limited in the embodiment of the present application.
[0197] For example, taking a mobile phone as the primary device, as shown in FIG4A , when a user slides their finger downward on the desktop shown in FIG4A a, the primary device receives an instruction to enter the notification center page and enters the notification center page shown in FIG4A b. The notification center page includes one or more function switch buttons, such as a WLAN switch button 401, a Bluetooth switch button 402, a flashlight switch button 403, a vibration switch button 404, and a mute switch button 405. When the user clicks a switch button, the primary device can turn the corresponding function on or off.
[0198] The notification center page may further include one or more sliding controls, such as a sliding control 406 for adjusting the brightness of the display screen. When the user drags the slider in the sliding control 406, the host device may adjust the brightness of the display screen.
[0199] The notification center page may also include a control center card 407. The control center card 407 may include a card name 408 and one or more clickable elements, such as a hide icon 409 for the control center card 407 and an entry button 410 for the control center card 407. The specific contents of the control center card 407 will be described in detail below.
[0200] Among them, the name of the above card is only an example of this application. The smart interconnection function can also be named by other names, and this application does not limit this. For example, it can be: "Honor Interconnection", "Hyper Terminal", etc. Therefore, the card name 408 displayed in the control center card 407 can be "Honor Interconnection", "Hyper Terminal", etc. Correspondingly, the multi-device collaboration homepage can also be called the Honor Interconnection homepage or the Hyper Terminal homepage.
[0201] When the user clicks the entry button 410 on the notification center page, the master device receives the operation of opening the control center and enters the control center page shown in Figure 4A c. The control center page includes the device identification 301 of the master device and the device identification 302 of the slave device.
[0202] In some embodiments, the notification center page further includes an edit button 411. The user can also display or hide the control center card 407 through the edit button 411.
[0203] For example, when a user clicks edit button 411 on the page shown in b in FIG. 4A , the master device receives an operation to display the edit menu and enters the page shown in a in FIG. 4B . The edit menu on this page includes a hide button 412. When the user clicks hide button 412, the master device receives an operation to hide the control center card and enters the page shown in b in FIG. 4B . The control center card is not displayed on this page.
[0204] When the user clicks edit button 411 on the page shown in b in FIG. 4B , the master device receives an operation to display the edit menu and enters the page shown in c in FIG. The edit menu on this page includes display button 413. When the user clicks display button 413, the master device receives an operation to display the control center card and enters the page shown in b in FIG. 4A . The control center card is displayed on this page.
[0205] In some embodiments, when the user clicks the hide icon 409 on the page shown in b in FIG. 4A , the main device receives an operation to hide the control center card and enters the page shown in b in FIG. 4B .
[0206] In a possible implementation, the page shown in b in FIG4B further includes a prompt message 414. Prompt message 414 is used to prompt the user to call out the operation method of the control center card. Prompt message 414 can be a text message, for example, clicking "Show Smart Connect" to restore the card.
[0207] The prompt message 414 can be displayed in the form of a bubble or a toast message. The embodiment of the present application does not limit the specific display form of the prompt message 414.
[0208] The prompt message 414 may disappear after being displayed for a period of time, or after receiving any operation. In this way, the obstruction of other buttons on the notification center page by the prompt message 414 can be reduced. The embodiment of the present application does not limit the disappearance method of the displayed prompt message 414.
[0209] It is understood that prompt message 414 may be displayed only when the user hides the control center card for the first time using the hide icon; prompt message 414 may also be displayed the first N times the user hides the control center card using the hide icon. The present embodiment does not limit the specific display conditions of prompt message 414.
[0210] Based on the above embodiment, the control center card 407 also displays the status of the collaborative function.
[0211] If the master device has already searched for one or more slave devices when displaying the notification center page, the master device can directly display the search results in the control center card 407 when displaying the notification center page. For example, the control center card 407 can display the number of slave devices that the master device has searched for (as shown in b in FIG. 4A ), the device identifiers of the one or more slave devices that have been searched for, and the device names of the one or more slave devices that have been searched for. Alternatively, when the user clicks the entry button 410 , the master device displays the control center interface shown in c in FIG. 4A , which includes the device identifiers of the corresponding number of slave devices.
[0212] If the master device does not search for a slave device or does not perform a search when displaying the notification center page, the master device may display an interface element indicating the function of the control center in the control center card 407 when displaying the notification center page. For example, the control center card 407 may display a slogan for the control center, such as "Smart Connectivity, Smart Life" (as shown in a of FIG4C ).
[0213] If the master device is collaborating with a slave device when displaying the notification center page, the master device may display an interface element indicating the control center function in the control center card 407 when displaying the notification center page. For example, the control center card 407 may display a control center slogan, such as "This device is collaborating" (as shown in b in Figure 4C). In some embodiments, when the master device is collaborating, the control center card 407 does not include the hide icon 409.
[0214] It is understood that in the embodiment shown in Figures 4A-4C above, when the user swipes down on the primary device to access the notification center page, since no foreground application is running on the primary device before accessing the notification center page, the control center page accessed through the notification center page does not include the task identifier 303.
[0215] The user can also enter the notification center page by sliding down when the main device displays the application page. Accordingly, since the main device is running a foreground application before entering the notification center page, the control center page entered through the notification center page includes a task identifier 303 (for example, as shown in Figure 3).
[0216] Another way to enter the control center page is described below with reference to FIG. 5 .
[0217] For example, taking the master device as a mobile phone and the shortcut operation as a three-finger swipe up, as shown in FIG5 , the master device is running a video application and playing a video. When the user swipes upward with three fingers on the page shown in FIG5 a, if the master device determines that the distance corresponding to the swipe up operation exceeds a first threshold, the master device receives an operation to enter the control center page, and the master device enters the control center page shown in FIG5 b. The control center page includes a device identifier 301 of the master device, a device identifier 302 of the slave device, and a task identifier 303.
[0218] In some embodiments, if the master device determines that the distance corresponding to the swipe-up operation exceeds a first threshold, the master device receives an operation to enter the control center page. If the master device determines that the distance corresponding to the swipe-up operation does not exceed the first threshold, the master device does not receive an operation to enter the control center page, does not enter the control center page, and returns to the interface of the running application.
[0219] In the embodiment of the present application, the first threshold value may be 20 pixels (px) or any other value, which is not limited here.
[0220] In some embodiments, the master device may display a dynamic effect based on the three-finger swipe-up operation during the process. The dynamic effect may be a zoom effect, for example, zooming the page receiving the three-finger swipe-up operation by a certain ratio until the page displays the form shown by the task identifier 303, and displaying the device identifiers of the master and slave devices. Any other type of dynamic effect may also be used, and this embodiment of the application is not limited to this.
[0221] Exemplarily, after receiving the three-finger swipe-up operation, the main device enters the control center page shown in FIG5 b via the page shown in FIG5 c.
[0222] It is understood that users can access the control center page through pre-set shortcuts on any interface. In the embodiment shown in Figure 5 above, since the primary device was running a foreground application before entering the control center page, the control center page includes a single application identification card. If the primary device was running multiple foreground applications before entering the control center page, the control center page can include identification cards for multiple applications.
[0223] The task transfer function of the control center is described below with reference to FIG. 6A to FIG. 6F .
[0224] In an embodiment of the present application, if a foreground application is running before the main device enters the control center page, the control center page may include an identification card of the application to implement task flow.
[0225] It is understandable that due to differences in the type of slave device, the application corresponding to the task identifier, etc., the master and slave devices implement different task transfer methods. Task transfer methods include: single window screen casting, same-source screen casting, and continuous casting.
[0226] 6A is a schematic diagram of a task flow interface provided by an embodiment of the present application, assuming that the master device is a mobile phone, the slave device is a computer, application A is a video application, and application A is not installed on the slave device.
[0227] When the master device displays the application page corresponding to application A and receives a three-finger upward swipe gesture from the user, the master device switches from the page shown in FIG6A a to the control center page shown in FIG6A b. The control center page includes the master device's device identification 301, application A's identification card 601, and the computer's device identification 602.
[0228] The user can drag the identification card 601 of application A toward the device identification 602 of the computer. When the user drags the identification card 601 of application A to the vicinity of the device identification 602 of the computer, the device identification 602 of the computer automatically attracts the identification card 601 of application A (as shown in c in FIG6A ).
[0229] When the drag operation ends near the computer's device identifier 602, the master device initiates a task transfer to the computer, and the master device enters the interface shown in Figure 6A (d). In this interface, the icon in the computer's device identifier 602 changes to a connection icon, providing the user with visual feedback on the ongoing task transfer.
[0230] For example, when the distance between the user dragging application A's identification card 601 and the computer's device identification 602 is less than a second threshold, the computer's device identification 602 automatically absorbs application A's identification card 601. When the distance between the location at which the dragging operation ends and the computer's device identification 602 is less than the second threshold, the master device initiates a task transfer to the computer.
[0231] In the embodiment of the present application, the second threshold value may be 20 pixels (px) or any other value, which is not limited here.
[0232] Since application A is not installed in the computer, the main device projects the content displayed by application A (for example, videos, photos, etc.) to the computer screen for display, thereby realizing single-window application projection, that is, heterogeneous screen projection.
[0233] When the task flow between the main device and the computer is completed, the main device enters the interface shown in Figure 6A e, which does not display the identification card 601 of application A. Adaptively, the computer displays a screen projection window 603, which displays the content of application A (as shown in Figure 6B).
[0234] When the main device exits the control center after the flow is completed, the page of application A is not displayed. For example, when the main device receives a user click on the exit button 306 on the page shown in Figure 6A e, the main device enters the page shown in Figure 6A f from the page shown in Figure 6A e. The page shown in Figure 6A f is the desktop of the main device. Alternatively, when the main device receives a user side-slide operation on the page shown in Figure 6A e, the main device enters the page shown in Figure 6A f from the page shown in Figure 6A e. The page shown in Figure 6A f is the desktop of the main device. The side-slide operation can be a left-slide operation or a right-slide operation, which is not limited here.
[0235] For example, Figure 6C is a diagram illustrating a task flow interface provided by an embodiment of the present application. For example, a master device is a mobile phone, a slave device is a computer, and the slave device has application B installed. For example, application B is a note-taking application, and both the master and slave devices have the note-taking application installed.
[0236] When the primary device is displaying the application page corresponding to application B, it receives a three-finger upward swipe from the user, and the primary device enters the control center page shown in FIG6C b from the page shown in FIG6C a. The control center page includes the device identifier 301 of the primary device, the identification card 604 of application B, and the device identifier 602 of the computer.
[0237] The user can drag the identification card 604 of application B toward the device logo 602 of the computer. When the user drags the identification card 604 of application B to the vicinity of the device logo 602 of the computer, the device logo 602 of the computer automatically attracts the identification card 604 of application B (as shown in c in FIG6C ).
[0238] When the drag operation ends near the computer's device identifier 602, the master device initiates a task transfer to the computer, and the master device enters the interface shown in Figure 6C (d). In this interface, the icon in the computer's device identifier 602 changes to a connection icon, providing the user with visual feedback on the ongoing task transfer.
[0239] For example, when the distance between the user dragging application B's logo card 604 and the computer's device logo 602 is less than a first threshold, the computer's device logo 602 automatically absorbs application B's logo card 604. When the distance between the location where the dragging operation ends and the computer's device logo 602 is less than the first threshold, the master device initiates a task transfer to the computer.
[0240] Because application B is already installed on the computer, and both the computer's application B and the primary device's application B support continuation, the primary device exits the editing state of application B and controls the computer to open application B and display the corresponding application page. The progress of the tasks in the application interface corresponding to application B displayed on the computer is the same, thus achieving display content continuation. In other words, the primary device synchronizes the progress or location information of application B running on the primary device with the secondary device. When the secondary device opens application B, it can directly display the corresponding progress or location, achieving continuation.
[0241] It is understandable that if the B application is not installed in the computer, or the B application installed in the computer does not support continuation, or the B application installed on the main device does not support continuation, the main device exits the editing state of the B application and projects the content displayed by the B application (for example: videos, photos, etc.) to the computer screen for display, so as to realize single-window application screen projection, that is, heterogeneous screen projection.
[0242] When the task transfer between the host device and the computer is completed, the host device enters the interface shown in Figure 6C (e), which does not display the identification card 604 of application B. Adaptively, the computer opens application B and displays the application page corresponding to application B (as shown in Figure 6D).
[0243] When the master device exits the control center after the transfer, the page of application B is displayed. For example, when the master device exits the control center after the transfer, it enters the page shown in FIG6C f from the page shown in FIG6C e. The page shown in FIG6C f is the application page corresponding to application B, for example, the main interface of application B. Application B on the master device does not exit the foreground, but instead displays the interface according to the logic of the application connection.
[0244] In some embodiments, if the master device is in the editing state while the B application is performing the task transfer, the master device exits the editing state and then performs the task transfer.
[0245] It is understandable that the master device can exit the control center through the exit button 306 or through a side sliding operation. The embodiment of the present application does not limit the specific operation of exiting the control center.
[0246] 6E is a schematic diagram of an interface for task transfer provided by an embodiment of the present application. Taking the master device as a mobile phone, the slave device as a large-screen device, and application A as a video application as an example, an example of a task transfer method according to another embodiment of the present application is introduced.
[0247] When the primary device is displaying the application page corresponding to application A, it receives a three-finger upward swipe from the user, and the primary device enters the control center page shown in FIG6E b from the page shown in FIG6E a. The control center page includes the device identifier 301 of the primary device, the identification card 601 of application A, and the device identifier 605 of the large-screen device.
[0248] The user can drag the identification card 601 of application A toward the device identification 605 of the large-screen device. When the user drags the identification card 601 of application A to the vicinity of the device identification 605 of the large-screen device, the device identification 605 of the large-screen device automatically attracts the identification card 601 of application A (as shown in c in FIG6E ).
[0249] When the drag operation ends near the device identifier 605 of the large-screen device, the master device initiates a task transfer to the large-screen device, and the master device enters the interface shown in Figure 6E (d). In this interface, the identifier in the device identifier 605 of the large-screen device changes to a connection identifier, providing the user with visual feedback on the ongoing task transfer.
[0250] For example, when the distance between the user dragging the identification card 601 of application A and the device identification 605 of the large-screen device is less than a second threshold, the device identification 605 of the large-screen device automatically absorbs the identification card 601 of application A. When the distance between the position at which the dragging operation ends and the device identification 605 of the large-screen device is less than the second threshold, the master device initiates a task transfer to the large-screen device.
[0251] Since the slave device is a large-screen device, the master device projects the content displayed on the master device (for example, videos, photos, etc.) to the screen of the large-screen device for display, thereby achieving same-source screen projection.
[0252] When the task transfer between the main device and the computer is completed, the main device enters the interface shown in Figure 6E (e), which does not display the identification card 601 of application A. Adaptively, the content displayed on the large-screen device is the same as that displayed on the main device (as shown in Figure 6F (a)).
[0253] When the main device exits the control center after the flow is completed, the main device enters the application page of application A shown in Figure 6E f from the page shown in Figure 6E e. Adaptively, the content displayed on the large-screen device is the same as the content displayed on the main device (as shown in Figure 6F b).
[0254] It is understandable that the master device can exit the control center through the exit button 306 or through a side sliding operation. The embodiment of the present application does not limit the specific operation of exiting the control center.
[0255] It is understandable that when the main device and the large-screen device perform task flow, the state of the application performing the task flow remains unchanged. For example, taking the note application as an example, if the note application is in edit mode, the main device will still be in edit mode after exiting the control center page.
[0256] It is understandable that the above Figures 6A-6F are all described with an example of an application running in the foreground during task transfer. The following describes the scenario of task transfer during split screen in conjunction with Figures 7A-7D.
[0257] For example, Figure 7A is a schematic diagram of a task transfer interface provided by an embodiment of the present application. Taking the master device as a mobile phone, the slave device as a computer, application A as a video application, application B as a note-taking application, and the slave device not having application A installed but having application B installed as an example, the task transfer method of the embodiment of the present application is illustrated. For example, the master device has a video application and a note-taking application installed, and the slave device has a note-taking application installed.
[0258] When the primary device displays the application page corresponding to application A and the application page corresponding to application B in a split screen, upon receiving a three-finger upward swipe from the user, the primary device switches from the page shown in FIG7A a to the control center page shown in FIG7A b. The control center page includes the device identifier 301 of the primary device, an identifier card 601 of application A, an identifier card 604 of application B, and a device identifier 602 of the computer.
[0259] The user can drag the identification card 601 of application A toward the device logo 602 of the computer. When the user drags the identification card 601 of application A to the vicinity of the device logo 602 of the computer, the device logo 602 of the computer automatically attracts the identification card 601 of application A (as shown in c in FIG7A ).
[0260] When the drag operation ends near the computer's device identifier 602, the master device initiates a task transfer to the computer, and the master device enters the interface shown in Figure 7A (d). In this interface, the icon in the computer's device identifier 602 changes to a connection icon, providing the user with visual feedback on the ongoing task transfer.
[0261] For example, when the distance between the user dragging application A's identification card 601 and the computer's device identification 602 is less than a second threshold, the computer's device identification 602 automatically absorbs application A's identification card 601. When the distance between the location at which the dragging operation ends and the computer's device identification 602 is less than the second threshold, the master device initiates a task transfer to the computer.
[0262] Since application A is not installed in the computer, the main device projects the content displayed by application A (for example, videos, photos, etc.) to the computer screen for display, thereby realizing single-window application projection.
[0263] When the task transfer between the main device and the computer is completed, the main device enters the interface shown in Figure 7A e, which does not display the identification card 601 of application A. Adaptively, the computer displays a screen projection window 703, which displays the content of application A (as shown in Figure 6B).
[0264] When the master device exits the control center after the transfer is completed, the master device enters the page shown in Figure 7A f from the page shown in Figure 7A e. In the page shown in Figure 7A f, the application page corresponding to application B is displayed in full screen.
[0265] It is understandable that the master device can exit the control center through the exit button 306 or through a side sliding operation. The embodiment of the present application does not limit the specific operation of exiting the control center.
[0266] For example, Figure 7B is a schematic diagram of a task transfer interface provided by an embodiment of the present application. Taking the master device as a mobile phone, the slave device as a computer, application A as a video application, application B as a note-taking application, and application B installed on the slave device as an example, the task transfer method of the embodiment of the present application is illustrated. For example, the master device has a video application and a note-taking application installed, and the slave device has a note-taking application installed.
[0267] When the primary device displays the application page corresponding to application A and the application page corresponding to application B in a split screen, upon receiving a three-finger upward swipe operation from the user, the primary device enters the control center page shown in FIG7B b from the page shown in FIG7B a. The control center page includes the device identifier 301 of the primary device, an identifier card 601 of application A, an identifier card 604 of application B, and a device identifier 602 of the computer.
[0268] The user can drag the identification card 604 of application B toward the device logo 602 of the computer. When the user drags the identification card 604 of application B to the vicinity of the device logo 602 of the computer, the device logo 602 of the computer automatically attracts the identification card 604 of application B (as shown in c in FIG7B ).
[0269] When the drag operation ends near the computer's device identifier 602, the master device initiates a task transfer to the computer, and the master device enters the interface shown in Figure 7B (d). In this interface, the icon in the computer's device identifier 602 changes to a connection icon, providing the user with visual feedback on the ongoing task transfer.
[0270] For example, when the distance between the user dragging application B's logo card 604 and the computer's device logo 602 is less than a first threshold, the computer's device logo 602 automatically absorbs application B's logo card 604. When the distance between the location where the dragging operation ends and the computer's device logo 602 is less than the first threshold, the master device initiates a task transfer to the computer.
[0271] Since application B is installed in the computer, both application B installed in the computer and application B installed on the main device support continuation. The main device exits the editing state of application B, and controls the computer to open application B and display the application page corresponding to application B to achieve display content continuation.
[0272] When the task transfer between the host device and the computer is completed, the host device enters the interface shown in Figure 7B (e), which does not display the identification card 604 of application B. Adaptively, the computer opens application B and displays the application page corresponding to application B (as shown in Figure 6D).
[0273] When the master device exits the control center after the transfer is complete, it enters the page shown in Figure 7B (f) from the page shown in Figure 7B (e). This page displays a split screen display of the application page corresponding to application A and the application page corresponding to application B. Compared to the page shown in Figure 7B (a), in the page shown in Figure 7B (f), application B has exited the editing state.
[0274] In some embodiments, if the master device is in the editing state while the B application is performing task flow, the master device exits the editing state.
[0275] For example, Figure 7C is a schematic diagram of a task flow interface provided by an embodiment of the present application. Taking a mobile phone as the master device, a large-screen device as the slave device, application A as a video application, and application B as a note-taking application as an example, the task flow method of another embodiment of the present application is described. For example, the master device has a video application and a note-taking application installed.
[0276] When the primary device displays the application page corresponding to application A and the application page corresponding to application B in a split screen, upon receiving a three-finger upward swipe from the user, the primary device switches from the page shown in FIG7C (a) to the control center page shown in FIG7C (b). The control center page includes the device identifier 301 of the primary device, the identification card 601 of application A, and the device identifier 605 of the large-screen device.
[0277] The user can drag the identification card 601 of application A toward the device identification 605 of the large-screen device. When the user drags the identification card 601 of application A to the vicinity of the device identification 605 of the large-screen device, the device identification 605 of the large-screen device automatically attracts the identification card 601 of application A (as shown in c in FIG7C ).
[0278] When the drag operation ends near the device identifier 605 of the large-screen device, the master device initiates a task transfer to the large-screen device, and the master device enters the interface shown in Figure 7C (d). In this interface, the identifier in the device identifier 605 of the large-screen device changes to a connection identifier, providing the user with visual feedback on the ongoing task transfer.
[0279] For example, when the distance between the user dragging the identification card 601 of application A and the device identification 605 of the large-screen device is less than a second threshold, the device identification 605 of the large-screen device automatically absorbs the identification card 601 of application A. When the distance between the position at which the dragging operation ends and the device identification 605 of the large-screen device is less than the second threshold, the mobile phone initiates a task flow to the large-screen device.
[0280] Since the slave device is a large-screen device, the master device projects the content displayed by application A (for example, videos, photos, etc.) to the screen of the large-screen device for display, thereby achieving same-source screen projection.
[0281] When the task transfer between the main device and the computer is completed, the main device enters the interface shown in Figure 7C (e), which does not display the identification card 601 of application A. Adaptively, the content displayed on the large-screen device is the same as that displayed on the main device (as shown in Figure 7D (a)).
[0282] When the main device exits the control center after the flow is completed, the main device enters the application page of application A shown in Figure 7C f from the page shown in Figure 7C e. Adaptively, the content displayed on the large-screen device is the same as the content displayed on the main device (as shown in Figure 7D b).
[0283] It is understandable that the master device can exit the control center through the exit button 306 or through a side sliding operation. The embodiment of the present application does not limit the specific operation of exiting the control center.
[0284] It is understood that in the embodiments shown in Figures 7A-7D above, the main device uses a top-bottom split screen method to split the screen. The main device can also use a left-right split screen method to split the screen. The embodiment of the present application does not limit the split screen method.
[0285] In some embodiments, when the primary device uses a top-to-bottom split screen, the identification cards of the applications displayed from left to right on the control center page correspond to the applications displayed from top to bottom in the split screen interface. When the primary device uses a left-to-right split screen, the identification cards of the applications displayed from left to right on the control center page correspond to the applications displayed from top to bottom in the split screen interface.
[0286] The following describes the scenario of task transfer when a small window application is running with reference to FIG. 8A to FIG. 8C .
[0287] 8A is a schematic diagram of a task flow interface provided by an embodiment of the present application. For example, the main device is a mobile phone, application A is a video application, and the small window application is a note application.
[0288] The page shown in Figure 8A includes: the application page corresponding to application A, and the page 801 corresponding to the small window application. When the main device receives a three-finger swipe-up gesture from the user, it enters the control center page shown in Figure 8A (b). This control center page includes the main device's device identifier 301, application A's identifier card 601, the computer's device identifier 602, and the large-screen device's device identifier 605, but does not include the identifier card corresponding to the small window application.
[0289] In the embodiment of the present application, the small window application can be any application such as notes, instant messaging, etc., and the embodiment of the present application does not limit this.
[0290] The user can drag the identification card 601 of application A toward the device identification 302 of the slave device (e.g., the device identification 602 of the computer, the device identification 605 of the large-screen device, etc.) to transfer the task. The specific process of task transfer is similar to the process described in Figures 6A to 7D above and will not be repeated here.
[0291] In an embodiment of the present application, when the main device exits the control center after the task flow is completed, the page corresponding to the small window application is reduced in size and located on the side of the main device.
[0292] For example, if you drag the page corresponding to application A to the vicinity of the computer's device identifier 602, and if application A is not installed on the computer, the task flow is single-window projection. When the main device exits the control center after the task flow is completed, the main device displays the main page and the reduced small window application 802 (as shown in c in Figure 8A). The reduced small window application 802 is located on the side of the main device.
[0293] Taking dragging the page corresponding to application A to the vicinity of the device identifier 602 of the computer as an example, if the computer has application A installed, the task flow mode is to continue; when the main device exits the control center after the task flow is completed, the main device displays the application page of application A and the reduced small window application 802 (as shown in d in Figure 8A).
[0294] In some embodiments, when the master device is performing task flow, application A is in a playing state; after the master device exits the control center page, application A stops playing the video, or exits the video playback page and returns to the playlist interface.
[0295] It is understandable that the master device can exit the control center through the exit button 306 or through a side sliding operation. The embodiment of the present application does not limit the specific operation of exiting the control center.
[0296] For example, if you drag the page corresponding to application A to the device identifier 605 of the large-screen device, the task transfer mode is same-source screen projection. When the main device exits the control center after the task transfer is completed, the main device displays the main page and the reduced small window application 802 (as shown in d in Figure 8A). The reduced small window application 802 is located on the side of the main device.
[0297] For example, Figure 8B is a schematic diagram of a task flow interface provided by an embodiment of the present application. The pages shown in Figure 8B include: an application page corresponding to the split-screen display of Application A, an application page corresponding to the split-screen display of Application C, and a page 801 corresponding to the small window application. Taking the main device as a mobile phone, Application A as a video application, Application C as a news application, and the small window application as a note application as an example, the task flow method of the embodiment of the present application is illustrated.
[0298] When the primary device receives a three-finger swipe-up gesture from the user, it enters the control center page shown in b of Figure 8B . This control center page includes the primary device's device identifier 301, the identification card 601 for application A, the identification card 803 for application C, the computer's device identifier 602, and the large-screen device's device identifier 605. It does not include the identification card for the small window application.
[0299] The user can drag the task identifier 303 (e.g., identification card 601 of application A, identification card 803 of application B) toward the device identifier 302 of the slave device (e.g., device identifier 602 of the computer, device identifier 605 of the large-screen device, etc.) to transfer the task. The specific process of task transfer is similar to the process described in Figures 6A-7D above and will not be repeated here.
[0300] In an embodiment of the present application, when the main device exits the control center after the task flow is completed, the page corresponding to the small window application is reduced in size and located on the side of the main device.
[0301] For example, if you drag the page corresponding to application A near the computer's device identifier 602, and if application A is installed on the computer, the task flow is continuous. When the master device exits the control center after the task flow is completed, the master device displays the page corresponding to application A, the page corresponding to application B, and the reduced widget application 802 (as shown in c in Figure 8B). The reduced widget application 802 is located on the side of the master device.
[0302] For example, if you drag the page corresponding to application A to the vicinity of the computer's device identifier 602, and if the computer does not have application A installed, the task flow is single-window projection. When the main device exits the control center after the task flow is completed, the main device displays the application page of application C and the reduced small window application 802 (as shown in d in Figure 8B). The reduced small window application 802 is located on the side of the main device.
[0303] For example, if you drag the page corresponding to application A to the vicinity of the device identifier 605 of the large-screen device, the task flow mode is same-source screen projection; when the main device exits the control center after the task flow is completed, the main device displays the page corresponding to application A and the reduced small window application 802 (as shown in e in Figure 8B). The reduced small window application 802 is located on the side of the main device.
[0304] It is understandable that the master device can exit the control center through the exit button 306 or through a side sliding operation. The embodiment of the present application does not limit the specific operation of exiting the control center.
[0305] Exemplarily, Figure 8C is a schematic diagram of an interface for task flow provided in an embodiment of the present application. Take the main device as a mobile phone and the small window application as a note application as an example. The page shown in Figure 8C includes: a main page, and a page 801 corresponding to the small window application. When the main device receives a three-finger swipe up operation from the user, it enters the control center page shown in b in Figure 8C. The control center page includes the device identifier 301 of the main device and the device identifier 302 of the slave device, but does not include the task identifier 303.
[0306] It is understood that, based on the embodiments shown in Figures 6A to 8C above, when the main device receives a shortcut operation, the main device also displays dynamic special effects. The dynamic special effects can be referred to the relevant description above and will not be repeated here.
[0307] It can be understood that when the slave device is a large-screen device, the task flow mode between the master device and the slave device is same-source screen projection. When the slave device is any one of a mobile phone, PC, and tablet, the slave device has the corresponding application installed, and the applications installed on the master and slave devices support continuation, the task flow mode between the master device and the slave device is continuation; when the slave device is any one of a mobile phone, PC, and tablet, and the slave device does not have the corresponding application installed, the task flow mode between the master device and the slave device is heterogeneous screen projection; when the slave device is any one of a mobile phone, PC, and tablet, the slave device has the corresponding application installed, and the application installed on any of the master and slave devices does not support continuation, the task flow mode between the master device and the slave device is heterogeneous screen projection.
[0308] For example, the task transfer mode between the master device and the slave device can refer to the following Table 1, which will not be described in detail here.
[0309] Table 1 Task flow mode
[0310] It is understandable that task transfer may fail for a variety of reasons, including but not limited to: the slave device is locked, the slave device is in sleep mode, the slave device does not support transfer, the application does not support transfer, network anomalies, etc.
[0311] For example, Figure 9 is a schematic diagram of a control center page provided by an embodiment of the present application. As shown in Figure 9, the page shown in a in Figure 9 includes: the device identification 301 of the main device, the identification card 601 of application A, and the device identification 602 of the computer.
[0312] The user can drag the identification card 601 of application A toward the device identification 602 of the computer. When the user drags the identification card 601 of application A to the vicinity of the device identification 602 of the computer, the device identification 602 of the computer automatically attracts the identification card 601 of application A (as shown in b in FIG9 ).
[0313] When the drag operation ends near the computer's device identifier 602, the master device initiates a task transfer to the computer, and the master device enters the interface shown in Figure 9(c). In this interface, the identifier in the computer's device identifier 602 changes to a connection identifier, providing the user with visual feedback on the ongoing task transfer.
[0314] For example, when the distance between the user dragging application A's identification card 601 and the computer's device identification 602 is less than a second threshold, the computer's device identification 602 automatically absorbs application A's identification card 601. When the distance between the location at which the dragging operation ends and the computer's device identification 602 is less than the second threshold, the master device initiates a task transfer to the computer.
[0315] If the task transfer fails, the master device enters the interface shown in Figure 9c and enters the interface shown in Figure 9d. This interface includes: the device identification 301 of the master device, the identification card 601 of application A and the device identification 602 of the computer.
[0316] Based on the above embodiment, if the task transfer fails, a prompt message may be displayed on the control center page of the master device to inform the user that the transfer has failed.
[0317] Exemplarily, the control center page shown in d in Fig. 9 further includes a prompt message 901. The prompt message 901 is used to prompt the user that the task transfer fails.
[0318] The prompt message 901 may be a text message, for example, “Connection failed”.
[0319] The prompt message 901 can be displayed in the form of a bubble or a toast message. The embodiment of the present application does not limit the specific display form of the prompt message 901.
[0320] The prompt message 901 can disappear after being displayed for a period of time, or it can disappear after receiving any operation. In this way, the obstruction of the control center page by the prompt message 901 can be reduced. The embodiment of the present application does not limit the disappearance method of the displayed prompt message 901.
[0321] In some embodiments, the prompt message 901 is also used to inform the user of the reason for the transfer failure. In this way, the user can adjust the slave device based on the failure reason to facilitate the task transfer again, thereby improving the user experience.
[0322] For example, the text corresponding to the prompt message 901 may be: "Connection failed, please unlock the other end and try again", "Task transfer to the slave device is not supported yet", "Application transfer to the slave device is not supported yet", "Network connection is unstable, please try again later", etc. The embodiment of the present application does not limit the specific content of the prompt message 901.
[0323] The device coordination function of the control center is described below with reference to FIG10 to FIG14.
[0324] It is understandable that when the master device enters the control center page through the above two methods, the control center may have the following three situations: the first situation is that the master device has searched for one or more slave devices; the second situation is that the master device has not searched for the slave device; the third situation is that the master device is in collaboration.
[0325] The control center pages corresponding to the three situations are described below with reference to FIG10 .
[0326] In the first scenario, if the master device has already searched for one or more slave devices, the control center page appears as shown in Figure 10(a). This page includes the master device identifier 301 and the slave device identifier 302. The positions and shapes of the master device identifier 301 and the slave device identifier 302 can be found in the description of Figure 3 above and are not repeated here.
[0327] Exemplarily, when the user clicks the entry button 410 on the notification center page shown in b in FIG. 4A , the main device receives an operation to open the control center and enters the control center page shown in a in FIG. 10 .
[0328] Based on the above embodiment, the control center page also displays a prompt message 1001. Prompt message 1001 is used to prompt the user to understand how to use the collaborative function. In some embodiments, prompt message 1001 can disappear after receiving the user's operation, or it can disappear after a period of time (for example, 15 seconds).
[0329] The master device may display the prompt message 1001 when entering the control center page for the first N times, or may display the prompt message 1001 only when entering the control center page for the first time. The embodiment of the present application does not specifically limit the display conditions and disappearance conditions of the prompt message 1001.
[0330] The second case: if the master device fails to search for the slave device, the control center page is shown as b in Figure 10. The control center page includes the device identification 301 of the master device, but does not include the device identification 302 of the slave device.
[0331] Exemplarily, when the user clicks the entry button 410 on the notification center page shown in a in FIG. 4C , the main device receives an operation to open the control center and enters the control center page shown in b in FIG. 10 .
[0332] In some embodiments, the control center page also displays a prompt message 1002. Prompt message 1002 is used to inform the user why the slave device was not found. Reasons include but are not limited to: the nearby device is not logged in to the same account and has the smart interconnection service enabled, the nearby device does not have Bluetooth and WLAN enabled, the nearby device does not support collaboration with the local device, etc.
[0333] In a possible implementation, if the master device fails to search for a slave device within a preset time period of displaying the control center page, prompt message 1002 is displayed; when a slave device is searched and the device identification 302 of the slave device is displayed, prompt message 1002 disappears.
[0334] It can be understood that when the master device searches for the slave device, the master device can enter the page shown in a of FIG10 from the page shown in b of FIG10 .
[0335] The third case: if the master device is in collaboration, the control center page is shown as c in FIG10 . The control center page includes a collaboration indicator 1003 .
[0336] The collaborative identifier 1003 may be a graphical identifier, such as an icon, or other skeuomorphic elements, etc. For example, the device identifier of the primary device and the device identifier of the collaborative device may be merged to form the collaborative identifier 1003. The embodiment of the present application does not limit the specific shape of the collaborative identifier.
[0337] In some embodiments, if the master device is in collaboration, the control center page further includes a collaboration type card 1004 , and the collaboration type card 1004 includes multiple buttons, for example: a multi-screen collaboration button 1005 and a disconnect button 1006 .
[0338] It should be noted that the buttons displayed on the collaboration type card are related to the collaboration types supported between the master device and the slave device. For example, when the master device is a mobile phone and the slave device is any device such as a PC, a PAD, or a large-screen device, the collaboration between the master device and the slave device is the same-source screen projection. The collaboration type card 1004 displayed on the control center page may include a multi-screen collaboration button 1005 and a disconnect button 1006 (as shown in c in Figure 10).
[0339] When the master device is a PC and the slave device is a tablet, the collaboration between the master and slave devices can be any of screen extension, screen mirroring, and keyboard and mouse sharing. The collaboration type card 1004 displayed on the control center page may include a screen extension button 1007, a screen mirroring button 1008, a keyboard and mouse sharing button 1009, and a disconnect button 1006 (as shown in d of Figure 10).
[0340] When the user clicks the screen extension button 1007, the collaboration type between the master device and the slave device is switched to screen extension; when the user clicks the screen mirroring button 1008, the collaboration type between the master device and the slave device is switched to screen mirroring; when the user clicks the keyboard and mouse sharing button 1009, the collaboration type between the master device and the slave device is switched to keyboard and mouse sharing.
[0341] For example, the collaboration types supported between the master device and the slave device may be as shown in Table 2.
[0342] Table 2 Collaboration between master and slave devices
[0343] The connection process and disconnection process between the master device and the slave device will be described below with reference to FIG. 11A and FIG. 11B .
[0344] For example, when a user drags the computer's device identifier 602 on the page shown in FIG. 11A (a) near the master device's device identifier 301, the master device's device identifier 301 automatically attracts the computer's device identifier 602 (as shown in FIG. 11A (b)). When the drag operation ends near the master device's device identifier 301, the master device and the computer begin to establish a collaborative connection, and the master device enters the interface shown in FIG. 11A (c). In this interface, the identifier in the computer's device identifier 602 changes to a connection identifier, providing the user with visual feedback on the ongoing collaborative connection.
[0345] For example, when the distance between the computer's device identifier 602 and the master device's device identifier 301 is less than a third threshold, the master device's device identifier 301 automatically attracts the computer's device identifier 602. When the distance between the location where the dragging operation ends and the master device's device identifier 301 is less than the third threshold, the master device and the computer begin to establish a collaborative connection.
[0346] In the embodiment of the present application, the third threshold value may be 20 pixels (px) or any other value, which is not limited here.
[0347] When the collaborative connection between the main device and the computer is established, the main device enters the page shown in d in Figure 11A, which includes a collaborative logo 1003 and a collaborative type card 1004.
[0348] If the master device cooperates with the computer, the computer displays a cooperation window 1101, and the content displayed in the window is the same as that displayed on the master device.
[0349] If the collaborative connection between the master device and the computer fails to be established, the master device enters the page shown in e in FIG. 11A , which includes the device identification 301 of the master device and the device identification 602 of the computer.
[0350] In some embodiments, if the collaborative connection fails to be established, a prompt message may be displayed on the control center page of the master device to prompt the user that the collaborative connection has failed to be established.
[0351] For example, the page shown in e in 11A also includes a prompt message 1101. Prompt message 1101 is used to notify the user that the collaborative connection establishment failed. Prompt message 1101 can be a text message, for example, "Connection failed." Prompt message 1101 can be displayed in the form of a bubble or a toast message. The embodiment of the present application does not limit the specific display form of prompt message 1101.
[0352] The prompt message 1101 may disappear after being displayed for a period of time, or may disappear after receiving any operation. In this way, the obstruction of the control center page by the prompt message 1101 can be reduced. The embodiment of the present application does not limit the disappearance method of the displayed prompt message 1101.
[0353] In some embodiments, the prompt message 1101 is also used to inform the user of the reason for the transfer failure. In this way, the user can adjust the slave device based on the failure reason to facilitate the task transfer again, thereby improving the user experience.
[0354] For example, the text corresponding to the prompt message 1101 may be: "Connection failed, please unlock the other end and try again", "Task transfer to the slave device is not supported yet", "Application transfer to the slave device is not supported yet", "Network connection is unstable, please try again later", etc. The embodiment of the present application does not limit the specific content of the prompt message 1101.
[0355] The disconnection process between the master device and the slave device will be described below with reference to FIG. 11B .
[0356] In some embodiments, when a user drags the computer's device identifier in the collaborative identifier 1003 in the interface shown in a of FIG. 11B away from the vicinity of the master device's device identifier 301, the master device's device identifier 301 cancels the computer's device identifier 602, and the position of the computer's device identifier 602 is correlated with the position of the drag operation (as shown in b of FIG. 11B). When the drag operation ends at a position no longer near the master device's device identifier 301, the master device disconnects from the computer, and the master device enters the interface shown in c of FIG. 11B, with the computer's device identifier 602 at the end of the slave device sequence.
[0357] For example, when the distance between the computer's device identifier 602 and the master device's device identifier 301 is greater than or equal to a third threshold, the master device's device identifier 301 removes the computer's device identifier 602. When the distance between the location where the dragging operation ends and the master device's device identifier 301 is greater than or equal to the third threshold, the master device and the computer disconnect.
[0358] In a possible implementation, when the master device is collaborating, the control center page continuously displays the collaboration type card 1004 until the collaboration is disconnected. If the user clicks the disconnect button 1006 shown in Figure 11A (d), the master device disconnects from the computer and the master device enters the page shown in Figure 11B (c). This page includes the master device's device identifier 301 and the computer's device identifier 602. The computer's device identifier 602 is the last in the slave device sequence.
[0359] Based on the above embodiment, when the user drags the device identifier of the slave device at the bottom to the vicinity of the collaborative identifier 1003, the master device disconnects the collaboration and establishes a collaborative connection with the slave device corresponding to the device identifier of the dragged slave device.
[0360] For example, as shown in Figure 12, taking the establishment of collaboration between the master device and the slave device 2 as an example, when the user drags the device identifier 1201 of the slave device 1 to the vicinity of the collaboration identifier 303, the master device disconnects the collaboration with the slave device 2 and establishes collaboration with the slave device 1. The master device enters the page shown in b in Figure 12 from the page shown in a in Figure 12.
[0361] The following describes the scenario where task transfer and collaboration scenarios conflict with each other in conjunction with FIG. 13A and FIG. 13B .
[0362] In the embodiment of the present application, when the master device is in collaboration and receives an operation from the user to enter the control center page, the control center page displays the collaboration type card 1004 and does not display the task identifier 303 (as shown in b in Figure 13A). When the collaborative connection between the master device and the slave device is disconnected, the control center page displays the task identifier 303, as shown in c in Figure 13A. When the master device is in collaboration and receives an operation from the user to enter the control center page, the control center page displays the task identifier 303, as shown in c in Figure 13A.
[0363] For example, as shown in FIG13A , when the master device receives a three-finger upward swipe gesture on the interface shown in FIG13A a, the master device enters the page shown in FIG16A b. This page includes a collaboration type card 1004 but does not include a task identifier 303. When the user clicks the disconnect button 1006, the master device displays the page shown in FIG13A c. This page includes the task identifier 303.
[0364] In the embodiment of the present application, when the master device is not in collaboration and a foreground application is running, upon receiving a user's operation to enter the control center page, the control center page displays a task identifier 303. The user can drag the device identifier of the slave device to the vicinity of the device identifier of the master device to achieve a collaborative connection between the master and slave devices.
[0365] For example, as shown in FIG13B , when the master device receives a three-finger swipe-up operation on the interface shown in FIG13A a, the master device enters the page shown in FIG13B a, which includes the master device's device identifier 301, the task identifier 303, and the computer's device identifier 602, but does not include the collaboration type card 1004. When the user drags the computer's device identifier 602 near the master device's device identifier 301, the master device's device identifier 301 automatically attracts the computer's device identifier 602.
[0366] When the drag operation ends at a position near the device identifier 301 of the master device, the master device establishes a collaborative connection with the computer, and the master device enters the page shown in c in FIG. 13B .
[0367] In some embodiments, during the user dragging process, the master device does not display the task identifier 303 (as shown in b in Figure 13B), and when the master device determines the collaboration mode with the slave device, it does not consider the currently running business, but instead determines the collaboration mode with reference to Table 2 shown above.
[0368] Based on the above embodiment, before the main device enters the control center page, the main device also displays a guidance page to prompt the user to agree to the privacy agreement, turn on Bluetooth and WLAN, log in to the account, etc.
[0369] For example, Figure 14 is a schematic diagram of a page of a master device provided in an embodiment of the present application, taking the first time the master device enters the control center as an example.
[0370] As shown in Figure 14, if the master device receives a three-finger swipe-up gesture from the user, the master device enters the page shown in Figure 14a. This page includes a guidance pop-up window 1701. When the user clicks the "Agree" button 1702, the master device enters the page shown in Figure 14b, which displays the privacy agreement and the "Agree" control 1703. When the user clicks the "Agree" control 1703, the master device enters the page shown in Figure 14c, which includes a "Login" control.
[0371] When the user clicks the login control 1704, the main device enters the page shown in d of Figure 14. This page includes an open control 1705. When the user clicks the open control 1705, the main device enters the control center page.
[0372] If the master device has turned on Bluetooth and WLAN when the user clicks the login control 1704, the master device enters the control center page and does not display the page shown in d in Figure 14.
[0373] The above embodiments are described using a mobile phone as the master device. The master device can also be a computer, a pad, etc. The task flow, interface display, and collaboration of other devices such as a computer or a pad can be referred to the above description using a mobile phone as the example, and will not be repeated here.
[0374] For example, FIG15 is a flowchart of a multi-device task transfer method provided in an embodiment of the present application. The method includes:
[0375] S1501: The master device displays a first interface, where the first interface includes a page of a first application.
[0376] In the embodiment of the present application, the first interface is an application page, which may correspond to the interface shown in a in Figure 6A or a in Figure 7A. The page of the first application may correspond to the application page A shown in Figure 6A. The first application may be a video application or other type of application, which is not limited in the embodiment of the present application.
[0377] S1502: The master device receives a first operation.
[0378] The first operation is used to enter the control center page. The first operation can be a quick gesture operation, a voice operation, or other types of operations, which are not limited in this embodiment of the present application. The quick gesture operation can be a gesture operation such as a three-finger swipe up.
[0379] S1503: In response to the first operation, the master device displays a second interface, where the second interface includes a device identifier of the first slave device.
[0380] The second interface is the control center page, which may correspond to the interface shown in b of Figure 6A or the interface shown in b of Figure 7A. The form of the device identification of the first slave device may refer to the description of the device identification of the slave device above, which will not be repeated here.
[0381] S1504: The master device receives a second operation for the device identification of the first slave device.
[0382] In the embodiment of the present application, the second operation is used to select the first slave device. Based on different pages, the selection method can be different, such as drag selection, or clicking the device identifier of the first slave device to select, etc. The embodiment of the present application does not limit the type of the second operation.
[0383] S1505. In response to the second operation, the master device displays the third interface and sends the page of the first application to the first slave device, so that the first slave device displays the page of the first application.
[0384] The third interface is the control center page after the task flow is successful, which may correspond to the interface shown in e in FIG. 6A and e in FIG. 7A .
[0385] S1506: The master device receives the third operation.
[0386] The third operation is a return operation. The return operation in the embodiment of the present application refers to the operation of calling the back instruction. Alternatively, it can be understood as the operation of exiting the control center page. The third operation can be a click operation, a shortcut operation, or a voice operation. The embodiment of the present application does not limit the specific type of the third operation.
[0387] S1507. In response to the third operation, the master device displays a fourth interface, which does not include a page of the first application.
[0388] The fourth interface is the interface displayed after exiting the control center, which may correspond to the interface shown in f in Figure 6A and f in Figure 7A. It is understandable that after the main device streams the first application through heterogeneous screen projection, the main device closes the first application and does not display the page of the first application.
[0389] S1508. The master device displays a fifth interface, which includes a page of the second application.
[0390] In the embodiment of the present application, the fifth interface is an application page, which may correspond to the interface shown in a of Figure 6C and a of Figure 7B. The second application page may correspond to the application page B shown in Figure 6C. The second application may be a note-taking application or other type of application, which is not limited in the embodiment of the present application.
[0391] S1509: The master device receives the fourth operation.
[0392] The fourth operation is used to enter the control center page. The fourth operation can be a quick gesture operation, a voice operation, or other types of operations, which are not limited in this embodiment of the present application. The quick gesture operation can be a gesture operation such as a three-finger swipe up.
[0393] S1510: In response to the fourth operation, the master device displays a sixth interface including a device identification of the first slave device.
[0394] The sixth interface is the control center page, which may correspond to the interface shown in b in FIG. 6C or the interface shown in b in FIG. 7B .
[0395] S1511: The master device receives a fifth operation for the device identification of the first slave device.
[0396] In the embodiment of the present application, the fifth operation is used to select the first slave device. Based on different pages, the selection method can be different, such as dragging to select, or clicking the device identifier of the first slave device to select, etc. The embodiment of the present application does not limit the type of the fifth operation.
[0397] S1512. In response to the fifth operation, the master device displays the seventh interface and sends the content displayed on the page of the second application to the first slave device, so that the first slave device starts the third application. The third application corresponds to the second application, and the content displayed on the page of the third application is the same as the content displayed on the page of the second application.
[0398] The seventh interface is the control center page after the task flow is successful, which can correspond to the interface shown in Figure 6C e and Figure 7B e. The third application and the second application can be understood as different versions of the same application, for example, a note application on a mobile phone and a note application on a computer.
[0399] S1513: The master device receives the sixth operation.
[0400] The sixth operation is the return operation. The return operation in the embodiment of the present application refers to the operation of calling the back instruction. Alternatively, it can be understood as the operation of exiting the control center page. The sixth operation can be a click operation, a shortcut operation, or a voice operation. The embodiment of the present application does not limit the specific type of the sixth operation.
[0401] S1514. In response to the sixth operation, the master device displays an eighth interface, which includes a page of the second application.
[0402] The eighth interface is the interface displayed after exiting the control center, which may correspond to the interface shown in f in FIG. 6C and f in FIG. 7B .
[0403] In this way, the first and second applications can be adapted to different methods and can be respectively transferred to the first slave device through heterogeneous screen projection and continuous streaming. The master device can automatically adjust the streaming method according to the application, realizing intelligent streaming, eliminating the need for users to find the corresponding streaming entrance separately, reducing user memory costs and improving user experience.
[0404] Optionally, the second interface also includes the identifier of the first application, and the sixth interface also includes the identifier of the second application; the second operation is to drag the identifier of the first application to the vicinity of the device identifier of the first slave device; the fifth operation is to drag the identifier of the second application to the vicinity of the device identifier of the first slave device.
[0405] In the embodiment of the present application, the identifier of the first application and the identifier of the second application can both correspond to the task identifiers mentioned above, which will not be described in detail here. The identifier of the first application can correspond to the task identifier of application A, and the identifier of the second application can correspond to the task identifier of application B.
[0406] Being near the device identifier of the first slave device may be understood as a situation where the distance from the device identifier of the first slave device is less than a second threshold.
[0407] In this way, the control center page displays the corresponding application logo, which is simple, intuitive, and clear at a glance. By dragging the application logo near the device logo of the slave device, you can select the slave device, which is simple and easy to understand.
[0408] Optionally, the first operation and the fourth operation are the same, and the first operation is any one of the following operations: a three-finger swipe up operation, a double-click operation, a three-finger swipe down operation, and a triple-click operation.
[0409] In this way, entering the control center page through a shortcut makes operation convenient and fast, improving the user experience.
[0410] Optionally, the third operation is a left-swipe operation or a right-swipe operation on the edge of the screen, or a click operation on the first control displayed on the third interface; the sixth operation is a left-swipe operation or a right-swipe operation on the edge of the screen, or a click operation on the first control displayed on the seventh interface.
[0411] The first control may correspond to an exit control. It is understood that the master device may exit the control center page by sliding sideways or by clicking the exit control on the control center page. The third operation and the sixth operation may be the same or different.
[0412] In this way, multiple exit methods are provided, and users can exit the control center page in an appropriate way, thereby improving user experience.
[0413] Optionally, the master device is any one of a mobile phone, a computer, and a tablet, and the first slave device is any one of a mobile phone, a computer, and a tablet.
[0414] In this way, it can be applied to task transfer between multiple devices, with wide coverage, high practicality, and improved user experience.
[0415] Optionally, the fifth interface and the eighth interface are different interfaces, the fifth interface includes the first page of the second application, the eighth interface includes the second page of the second application, and the first page of the second application is different from the second page of the second application.
[0416] It is understandable that the fifth interface may correspond to a page being edited, or other pages being modified. The second page exits the page being edited, or exits the page being modified.
[0417] In this way, when the master device performs task flow through the connection, it will exit the editing, modification and other states, and the content of the interface displayed by the application before and after the task flow will be different.
[0418] Optionally, the second application is a note application; the first page of the second application is an editing page, which includes the content of the first note; and the second page of the second application is a list page, which includes the identifier of the first note.
[0419] The task flow in the embodiment of the present application can be applied to the note application, and the content of the interface displayed by the application is different before and after the note application flow.
[0420] Optionally, the first interface only includes the page of the first application, and the fourth interface is the desktop of the main device.
[0421] In the embodiments of the present application, a page that includes only the first application can refer to a page that displays the first application in full screen, or a page that displays the first application in an area other than the status bar area. Alternatively, a page that includes only the first application can be understood as a page that does not include pages of other applications except the page of the first application. This embodiment of the present application does not specifically limit this.
[0422] It is understandable that after the main device transfers the first application through the heterogeneous screen projection method, the main device closes the first application and does not display the page of the first application. If the main device only runs the first application in the foreground, after the first application is transferred through the heterogeneous screen projection method, the desktop is displayed.
[0423] Optionally, the first interface also includes a page of a fourth application, and the page of the fourth application and the page of the first application are displayed in split screen; the fourth interface includes a page of the fourth application.
[0424] The fourth application may be a note application or other types of applications, which are not limited in this embodiment of the present application. The fourth application may be the same as the second application or different from the second application.
[0425] It is understandable that if the main device runs the first application and the fourth application in the foreground, after the first application is transferred through heterogeneous screen projection, the page of the fourth application is displayed.
[0426] Optionally, the fifth interface also includes a page of the fifth application, and the page of the fifth application and the page of the second application are displayed in split screen; the eighth interface also includes a page of the fifth application, and the page of the second application and the page of the fifth application are displayed in split screen.
[0427] The fifth application may be a video application or other types of applications, which are not limited in this embodiment of the present application. The fifth application may be the same as the first application or different from the first application.
[0428] It is understandable that if the main device runs the second application and the fifth application in the foreground, after the second application is transferred in a continuous manner, the page of the second application and the page of the fifth application are displayed.
[0429] Optionally, the first interface also includes a first floating window, which displays a page of the sixth application; the second interface does not include the logo of the sixth application, and the fourth interface also displays a second control; in response to the user's operation on the second control, the first floating window is displayed on the fourth interface.
[0430] The application displayed by the floating window may correspond to the small window application mentioned above. The sixth application may be a video application or other types of applications, which are not limited in this embodiment of the present application. The second control may correspond to a reduced small window application, which may also be called a floating ball. The fourth interface may correspond to the interface shown in Figure 8A or Figure 8B.
[0431] It is understood that the small window app does not perform task transfer. After the task transfer, the small window app shrinks to the edge of the screen. The display of the small window app can be restored through the shrunken small window app.
[0432] Optionally, the fifth interface further includes a second floating window displaying a page of the seventh application; the sixth interface does not include a logo of the seventh application, and the eighth interface further displays a third control; in response to a user operating the third control, the second floating window is displayed on the eighth interface. The eighth interface may correspond to the interface shown in Figure 8A or Figure 8B.
[0433] The application displayed through the floating window may correspond to the small window application mentioned above. The seventh application may be a video application or other types of applications, which is not limited in this embodiment of the present application. The third control may correspond to a reduced small window application, which may also be referred to as a floating ball. It is understandable that the small window application does not perform task transfer. After the task transfer, the small window application is reduced to the edge of the screen. The display of the small window application can be restored through the reduced small window application.
[0434] Optionally, the master device is any one of a mobile phone, a computer, and a tablet, the first slave device is a large screen, and the fourth interface includes a page of the first application.
[0435] When the secondary device is a large screen, the first application transfers tasks using same-source screen projection. In same-source screen projection, the application's page remains unchanged before and after the task transfer, displaying the same content. The page displayed on the secondary device is the same as the page displayed on the primary device.
[0436] Optionally, the first interface also includes a page of a fourth application. When the page of the fourth application and the page of the first application are displayed in split screen, the fourth interface does not include the page of the fourth application.
[0437] In a split-screen scenario, the application page remains unchanged and the displayed content remains the same before and after the task flow in the same-source screen projection. The page displayed on the slave device is the same as the page displayed on the master device.
[0438] Optionally, the master device is any one of a mobile phone, a computer, and a tablet, the first slave device is a large screen, and the page of the second application included in the fifth interface and the page of the second application included in the eighth interface are the same page.
[0439] When the secondary device is a large screen, the secondary application transfers tasks using same-source screen projection. In same-source screen projection, the application's page remains unchanged before and after the task transfer, displaying the same content. The page displayed on the secondary device is the same as the page displayed on the primary device.
[0440] Optionally, the page of the first application is a page for playing videos.
[0441] Optionally, the method also includes: the master device displays a ninth interface, the ninth interface includes a page of an eighth application; the master device receives a seventh operation; in response to the seventh operation, the master device displays a tenth interface, the tenth interface includes the device identification of the second slave device; the master device receives an eighth operation for the device identification of the second slave device; in response to the eighth operation, the master device displays an eleventh interface, the eleventh interface includes the device identification of the master device and the device identification of the second slave device, wherein the device identification of the master device is connected to the device identification of the second slave device.
[0442] The ninth interface is the application page, which may correspond to the interface shown in a in Figure 6A and a in Figure 6C above, or other pages running foreground applications. The seventh operation is similar to the first operation, and specific reference may be made to the description of the first operation above, which will not be repeated here. The tenth interface may correspond to a control center page that is not in a collaborative state. The eleventh interface may correspond to a control center page in collaboration. The eighth operation is used to select the device identifier of the second slave device, which may be a click operation or a drag operation. The embodiment of the present application does not limit the specific type of the eighth operation.
[0443] In the embodiment of the present application, connected can be connected, or can be close to each other (such as being next to each other), which is not limited here.
[0444] In this way, the control center page can also realize the collaborative connection between the master device and the slave device.
[0445] Optionally, the eighth operation is an operation of dragging the device identifier of the second slave device to a vicinity of the device identifier of the master device.
[0446] Being near the device identifier of the main device may be understood as a situation where the distance from the device identifier of the main device is less than a third threshold.
[0447] In this way, by dragging the device identifier of the slave device to the vicinity of the device identifier of the master device, a slave device that cooperates with the master device is selected. The operation is simple and easy to understand.
[0448] Optionally, the tenth interface also includes the logo of the eighth application, and the eleventh interface does not include the logo of the eighth application.
[0449] It is understandable that the control center page that is not in a collaborative state displays the application logo and can perform task transfer; the control center page in a collaborative state does not display the application logo and cannot perform task transfer.
[0450] Optionally, the eleventh interface further includes a first identifier, and the first identifier indicates a collaboration type between the master device and the second slave device.
[0451] The first identifier can correspond to same-source screen projection, screen extension, screen mirroring, keyboard and mouse sharing, etc.
[0452] This makes it easier for users to confirm the collaboration type between the master device and the slave device, improving user experience.
[0453] Optionally, the eleventh interface also includes a second identifier, and the method further includes: the master device receives a ninth operation for the second identifier; in response to the ninth operation, the master device and the second slave device switch to a collaboration type corresponding to the second identifier.
[0454] The second identifier may correspond to a collaboration type such as same-source screen projection, screen extension, screen mirroring, keyboard and mouse sharing, etc. The ninth operation may be a click operation, a touch operation, etc., and the embodiment of the present application does not limit the ninth operation.
[0455] In this way, the user can adjust the collaboration type between the master device and the slave device through the second identifier, switch the collaboration mode, and improve the user experience.
[0456] Optionally, the eleventh interface also includes a fourth control, and the method also includes: the master device receives a tenth operation for the fourth control; in response to the tenth operation, the master device disconnects from the second slave device; the master device displays a twelfth interface, the twelfth interface includes a device identifier of the master device and a device identifier of the second slave device, and the device identifier of the master device is not connected to the device identifier of the second slave device.
[0457] The control center page after the twelfth interface is not disconnected from the collaborative connection may correspond to the interface shown in Figure 11A. The fourth control may correspond to a disconnect control (button). The tenth operation may be a click operation, a touch operation, or other type of operation, which is not specifically limited in the embodiments of the present application.
[0458] In this way, the connection between the master device and the slave device can be disconnected through the fourth control, and the collaboration can be disconnected, which is easy to operate.
[0459] Optionally, the method also includes: the master device receives an eleventh operation for the device identification of the second slave device on the eleventh interface; in response to the eleventh operation, the master device disconnects from the second slave device; the master device displays a thirteenth interface, the thirteenth interface includes the device identification of the master device and the device identification of the second slave device, and the device identification of the master device is not connected to the device identification of the second slave device.
[0460] The thirteenth interface, the control center page after the collaborative connection is not disconnected, may correspond to the interface shown in Figure 11 B. The eleventh operation may be a drag operation or other types of operations, which are not specifically limited in the embodiment of the present application.
[0461] In this way, the connection between the master device and the slave device can be disconnected by dragging and dropping, and the collaboration is disconnected, which is easy to operate.
[0462] Optionally, the eleventh interface also includes the identification of the third slave device, and the device identification of the master device is not connected to the device identification of the third slave device; the method also includes: the master device receives a twelfth operation for the device identification of the third slave device on the eleventh interface; in response to the twelfth operation, the master device disconnects from the second slave device and establishes a connection with the third slave device; the master device displays the fourteenth interface, the fourteenth interface includes the device identification of the master device, the device identification of the second slave device and the identification of the third slave device, the device identification of the master device is connected to the device identification of the third slave device, and the device identification of the master device is not connected to the device identification of the second slave device.
[0463] The twelfth operation is used to switch the slave device connected to the master device. The twelfth operation can be an operation of dragging the device identifier of the third slave device, or other types of operations, which are not limited in this embodiment of the present application. The fourteenth interface can correspond to the interface shown in Figure 12.
[0464] In this way, the master device can switch to a coordinated slave device to improve the user experience.
[0465] Optionally, the collaboration type includes any one of the following types: same-source screen projection, screen extension, screen mirroring, and keyboard and mouse sharing.
[0466] It should be noted that the "at..." in the embodiments of the present application can be the instant when a certain situation occurs, or it can be a period of time after the situation occurs, and the embodiments of the present application do not specifically limit this. In addition, the display interface provided in the embodiments of the present application is only an example, and the display interface can also include more or less content.
[0467] The multi-device task transfer method according to an embodiment of the present application has been described above. The following describes an apparatus for executing the multi-device task transfer method according to an embodiment of the present application. Those skilled in the art will appreciate that the method and apparatus can be combined and referenced with each other, and that the relevant apparatus provided in the embodiment of the present application can execute the steps in the multi-device task transfer method.
[0468] As shown in Figure 16, Figure 16 is a structural diagram of a multi-device task flow device provided in an embodiment of the present application. The multi-device task flow device can be a terminal device in an embodiment of the present application, or it can be a chip or chip system in the terminal device.
[0469] As shown in FIG16 , a multi-device task transfer apparatus 2100 can be used in a communication device, circuit, hardware component, or chip, and includes a display unit 2101 and a processing unit 2102. The display unit 2101 is used to support the display step performed by the multi-device task transfer apparatus 2100; the processing unit 2102 is used to support the information processing step performed by the multi-device task transfer apparatus 2100.
[0470] In a possible implementation, the multi-device task transfer apparatus 2100 may also include a communication unit 2103. Specifically, the communication unit is used to support the multi-device task transfer apparatus 2100 in executing the steps of sending and receiving data. The communication unit 2103 may be an input or output interface, pin, or circuit.
[0471] In a possible embodiment, the multi-device task transfer apparatus may further include a storage unit 2104. The processing unit 2102 and the storage unit 2104 are connected via a circuit. The storage unit 2104 may include one or more memories, which may be devices in one or more devices or circuits for storing programs or data. The storage unit 2104 may exist independently and be connected to the processing unit 2102 of the multi-device task transfer apparatus via a communication circuit. The storage unit 2104 may also be integrated with the processing unit 2102.
[0472] The storage unit 2104 can store computer-executable instructions for the method in the terminal device, so that the processing unit 2102 executes the method in the above embodiment. The storage unit 2104 can be a register, a cache, or a RAM, etc. The storage unit 2104 can be integrated with the processing unit 2102. The storage unit 2104 can be a read-only memory (ROM) or other type of static storage device that can store static information and instructions. The storage unit 2104 can be independent of the processing unit 2102.
[0473] The multi-device task transfer method provided in the embodiment of the present application can be applied to electronic devices with display functions. The electronic devices include terminal devices. The specific device form of the terminal device can refer to the above related descriptions and will not be repeated here.
[0474] An embodiment of the present application provides an electronic device, which includes: a processor and a memory; the memory stores computer-executable instructions; the processor executes the computer-executable instructions stored in the memory, so that the electronic device performs the above method.
[0475] The present embodiment provides a chip. The chip includes a processor configured to invoke a computer program stored in a memory to execute the technical solution of the above embodiment. The implementation principles and technical effects are similar to those of the above-mentioned related embodiments and will not be further described here.
[0476] The embodiments of the present application also provide a computer-readable storage medium. The computer-readable storage medium stores a computer program. When the computer program is executed by a processor, the above-mentioned method is implemented. The methods described in the above embodiments can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. If implemented in software, the functions can be stored as one or more instructions or codes on a computer-readable medium or transmitted on a computer-readable medium. Computer-readable media can include computer storage media and communication media, and can also include any medium that can transfer a computer program from one place to another. The storage medium can be any target medium that can be accessed by a computer.
[0477] In one possible implementation, computer-readable media may include RAM, ROM, compact disc read-only memory (CD-ROM) or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium designed to carry or store the desired program code in the form of instructions or data structures and accessible by a computer. Moreover, any connection is appropriately referred to as a computer-readable medium. For example, if a coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL) or wireless technologies such as infrared, radio and microwave are used to transmit software from a website, server or other remote source, the coaxial cable, fiber optic cable, twisted pair, DSL or wireless technologies such as infrared, radio and microwave are included in the definition of medium. Disk and optical disk as used herein include optical disk, laser disk, optical disk, digital versatile disk (DVD), floppy disk and Blu-ray disk, where disks generally reproduce data magnetically, while optical disks reproduce data optically using lasers. Combinations of the above should also be included within the scope of computer-readable media.
[0478] An embodiment of the present application provides a computer program product, which includes a computer program. When the computer program is executed, the computer executes the above method.
[0479] The present application embodiment is described with reference to the flow chart and / or block diagram of the method, device (system) and computer program product according to the embodiment of the present application.It should be understood that each flow process and / or box in the flow chart and / or block diagram and the combination of the flow process and / or box in the flow chart and / or block diagram can be realized by computer program instructions.These computer program instructions can be provided to the processing unit of general-purpose computer, special-purpose computer, embedded processing machine or other programmable device to produce a machine, so that the instruction executed by the processing unit of computer or other programmable data processing device produces the device for realizing the function specified in one flow chart flow or multiple flows and / or one block or multiple blocks of block diagram.
[0480] The above specific implementation methods further illustrate the objectives, technical solutions and beneficial effects of the present invention in detail. It should be understood that the above are only specific implementation methods of the present invention and are not intended to limit the scope of protection of the present invention. Any modifications, equivalent replacements, improvements, etc. made on the basis of the technical solutions of the present invention should be included in the scope of protection of the present invention.
Claims
1. A multi-device task transfer method, characterized in that: include: The master device displays a first interface, where the first interface includes a page of a first application; The master device receives a first operation; In response to the first operation, the master device displays a second interface, where the second interface includes a device identification of the first slave device; The master device receives a second operation for the device identification of the first slave device; In response to the second operation, the master device displays a third interface and sends the page of the first application to the first slave device, so that the first slave device displays the page of the first application; The master device receives a third operation, where the third operation is a return operation; In response to the third operation, the master device displays a fourth interface, where the fourth interface does not include a page of the first application; The master device displays a fifth interface, where the fifth interface includes a page of the second application; The master device receives a fourth operation; In response to the fourth operation, the master device displays a sixth interface, where the sixth interface includes a device identification of the first slave device; The master device receives a fifth operation for the device identification of the first slave device; In response to the fifth operation, the master device displays a seventh interface and sends the content displayed on the page of the second application to the first slave device, so that the first slave device starts a third application, the third application corresponds to the second application, and the content displayed on the page of the third application is the same as the content displayed on the page of the second application; The master device receives a sixth operation, where the sixth operation is a return operation; In response to the sixth operation, the master device displays an eighth interface, where the eighth interface includes a page of the second application.
2. The method according to claim 1, characterized in that The second interface further includes an identifier of the first application, and the sixth interface further includes an identifier of the second application; The second operation is an operation of dragging the logo of the first application to a vicinity of the device logo of the first slave device; The fifth operation is an operation of dragging the logo of the second application to the vicinity of the device logo of the first slave device.
3. The method according to claim 1 or 2, characterized in that The first operation is the same as the fourth operation, and the first operation is any one of the following operations: a three-finger swipe up operation, a double-click operation, a three-finger swipe down operation, and a triple-click operation.
4. The method according to any one of claims 1 to 3, characterized in that The third operation is a left swipe operation or a right swipe operation on the edge of the screen, or a click operation on the first control displayed on the third interface; The sixth operation is a left swipe operation or a right swipe operation on the edge of the screen, or a click operation on the first control displayed on the seventh interface.
5. The method according to any one of claims 1 to 4, characterized in that The master device is any one of a mobile phone, a computer, and a tablet, and the first slave device is any one of a mobile phone, a computer, and a tablet.
6. The method according to any one of claims 1 to 5, characterized in that The fifth interface and the eighth interface are different interfaces. The fifth interface includes the first page of the second application, and the eighth interface includes the second page of the second application. The first page of the second application is different from the second page of the second application.
7. The method according to claim 6, characterized in that The second application is a note-taking application; The first page of the second application is an editing page, and the editing page includes the content of the first note; The second page of the second application is a list page, and the list page includes an identifier of the first note.
8. The method according to any one of claims 1 to 7, characterized in that The first interface only includes the page of the first application, and the fourth interface is the desktop of the main device.
9. The method according to any one of claims 1 to 7, characterized in that The first interface further includes a page of a fourth application, and the page of the fourth application and the page of the first application are displayed in a split screen; The fourth interface includes a page of the fourth application.
10. The method according to any one of claims 1 to 7 and 9, characterized in that: The fifth interface also includes a page of a fifth application, and the page of the fifth application and the page of the second application are displayed in a split screen; The eighth interface also includes a page of the fifth application, and the page of the second application and the page of the fifth application are displayed in split screens.
11. The method according to any one of claims 1 to 10, characterized in that The first interface further includes a first floating window, wherein the first floating window displays a page of a sixth application; The second interface does not include the identifier of the sixth application, and the fourth interface further displays a second control; In response to a user operation on the second control, the first floating window is displayed on the fourth interface.
12. The method according to any one of claims 1 to 10, characterized in that The fifth interface further includes a second floating window, wherein the second floating window displays a page of a seventh application; The sixth interface does not include the identifier of the seventh application, and the eighth interface further displays a third control; In response to the user's operation on the third control, the second floating window is displayed on the eighth interface.
13. The method according to any one of claims 1 to 4 and 9, characterized in that: The master device is any one of a mobile phone, a computer, and a tablet, the first slave device is a large screen, and the fourth interface includes a page of the first application.
14. The method according to claim 13, characterized in that The first interface also includes a page of a fourth application. When the page of the fourth application and the page of the first application are displayed in split screen, the fourth interface does not include the page of the fourth application.
15. The method according to any one of claims 1 to 4 and 10, characterized in that: The master device is any one of a mobile phone, a computer, and a tablet, and the first slave device is a large screen. The page of the second application included in the fifth interface and the page of the second application included in the eighth interface are the same page.
16. The method according to any one of claims 1 to 15, characterized in that The page of the first application is a page for playing videos.
17. The method according to any one of claims 1 to 16, characterized in that The method further comprises: The master device displays a ninth interface, wherein the ninth interface includes a page of the eighth application; The master device receives a seventh operation; In response to the seventh operation, the master device displays a tenth interface, where the tenth interface includes a device identification of the second slave device; An eighth operation in which the master device receives a device identification for the second slave device; In response to the eighth operation, the master device displays an eleventh interface, where the eleventh interface includes the device identification of the master device and the device identification of the second slave device, wherein the device identification of the master device is connected to the device identification of the second slave device.
18. The method according to claim 17, characterized in that The eighth operation is to drag the device identification of the second slave device to the vicinity of the device identification of the master device.
19. The method according to claim 17 or 18, characterized in that The tenth interface also includes the identifier of the eighth application, and the eleventh interface does not include the identifier of the eighth application.
20. The method according to any one of claims 17 to 19, characterized in that: The eleventh interface further includes a first identifier, which indicates a collaboration type between the master device and the second slave device.
21. The method according to claim 20, characterized in that The eleventh interface further includes a second identifier, and the method further includes: The master device receives a ninth operation for the second identifier; In response to the ninth operation, the master device and the second slave device switch to the collaboration type corresponding to the second identifier.
22. The method according to any one of claims 17 to 21, characterized in that The eleventh interface further includes a fourth control, and the method further includes: The master device receives a tenth operation for the fourth control; In response to the tenth operation, the master device disconnects from the second slave device; The master device displays a twelfth interface, which includes the device identification of the master device and the device identification of the second slave device. The device identification of the master device is not connected to the device identification of the second slave device.
23. The method according to any one of claims 17 to 21, characterized in that The method further comprises: The master device receives an eleventh operation on the eleventh interface for the device identification of the second slave device; In response to the eleventh operation, the master device disconnects from the second slave device; The master device displays a thirteenth interface, which includes the device identification of the master device and the device identification of the second slave device. The device identification of the master device is not connected to the device identification of the second slave device.
24. The method according to any one of claims 17 to 21, characterized in that The eleventh interface further includes an identifier of a third slave device, and the device identifier of the master device is not connected to the device identifier of the third slave device; The method further comprises: The master device receives a twelfth operation on the eleventh interface for the device identification of the third slave device; In response to the twelfth operation, the master device disconnects from the second slave device and establishes a connection with the third slave device; The main device displays a fourteenth interface, which includes the device identification of the main device, the The device identification of the second slave device and the identification of the third slave device, the device identification of the master device is connected to the device identification of the third slave device, and the device identification of the master device is not connected to the device identification of the second slave device.
25. The method according to any one of claims 17 to 24, characterized in that The collaboration type includes any one of the following types: same-source screen projection, screen extension, screen mirroring, and keyboard and mouse sharing.
26. The method according to any one of claims 16 to 25, characterized in that The second slave device is any one of a mobile phone, a computer, a tablet, and a large screen.
27. An electronic device, characterized in that: include: processor and memory; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory, so that the electronic device performs the method according to any one of claims 1 to 26.
28. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 26 is implemented.
29. A computer program product, characterized in that The method comprises a computer program which, when being executed, causes a computer to execute the method according to any one of claims 1 to 26.