A control method and electronic device

Abstract

This application discloses a control method and an electronic device. The control method includes: in response to receiving a first trigger operation acting on the electronic device, determining a target task and a target terminal device that match the first trigger operation; sending the target task to the target terminal device so that the target terminal device can continue to execute the target task; wherein the target task can be continued to execute from a target node, and the target node is a node used to characterize the current task progress of the target task when responding to the first trigger operation; the target terminal device is configured to run an application for executing the target task to continue to execute the target task.

Description

Technical Field

[0001] This application relates to the technical field of equipment control, and in particular to a control method and electronic device. Background Technology

[0002] Currently, when users are writing documents or watching videos on their computers, if they need files from their mobile phones, they need to open a file transfer function on their phones or install or open file transfer software (Smart Connect) on their computers to obtain the files. If they need to switch to another device to watch videos, they need to actively record the playback progress through the server using the same account to synchronize the user's video playback progress. This is not only cumbersome but also interrupts the current task, resulting in a less smooth workflow. Summary of the Invention

[0003] The purpose of this application is to provide a control method and an electronic device.

[0004] In a first aspect, embodiments of this application provide a control method, including: In response to receiving a first trigger operation acting on an electronic device, a target task and a target terminal device that match the first trigger operation are determined. The target task is sent to the target terminal device so that the target terminal device can continue to execute the target task; The target task can be continued from the target node, which is a node used to represent the current task progress of the target task when responding to the first triggering operation; The target terminal device is configured to run an application for performing the target task in order to continue performing the target task.

[0005] In one possible implementation, determining the target task and target terminal device corresponding to the first triggering operation includes: Obtain the operation parameters of the first triggering operation; If the specific application currently running on the electronic device is unique, that unique specific application is identified as the target task, and a matching target terminal device is determined from the terminal devices owned by the target user based on the operation parameters; or, a matching target terminal device is determined from the terminal devices within the spatial environment where the electronic device is currently located based on the operation parameters; or, When the specific application currently running on the electronic device is not unique, the device configuration information of the terminal device owned by the target user or the terminal device in the current spatial environment of the electronic device is obtained. Based on the operation parameters and the device configuration information, the target task is determined from the non-unique specific application and the target terminal device is determined from the terminal devices.

[0006] In one possible implementation, obtaining the operation parameters of the first triggering operation includes at least one of the following: In response to a first touch operation that acts on a touch area of ​​an electronic device, at least one of the following is used as the operation parameter: operation trajectory, touch force, number of touch points, touch direction, and touch duration of the first touch operation. In response to a first trigger operation that causes a change in the pose of the electronic device, the change data in the pose of the electronic device is used as the operation parameter; or, In response to a first input operation that obtains a detection area acting on an electronic device, the input data generated by the first input operation is used as the operation parameter, wherein the detection area is formed by the sensing range of the target sensor of the electronic device.

[0007] In one possible implementation, determining the matching target terminal device from the terminal devices based on the operating parameters includes at least one of the following: When the operation parameter is the first operation trajectory generated by the first touch operation, the second terminal device in the current spatial environment of the first terminal device or electronic device owned by the target user is determined as the target terminal device; When the operation parameters are the second operation trajectory generated by the first touch operation, the fourth terminal device in the current spatial environment of the third terminal device or electronic device owned by the target user is determined as the target terminal device; When the operating parameters characterize the electronic device switching from a first pose to a second pose, the fifth terminal device owned by the target user or the sixth terminal device in the current spatial environment of the electronic device is determined as the target terminal device. When the operation parameter is the first gesture pattern or the first voice data generated by the first input operation, the eighth terminal device in the current spatial environment of the seventh terminal device or electronic device owned by the target user is determined as the target terminal device; Wherein, at least one trajectory parameter of the second operation trajectory is different from that of the first operation trajectory.

[0008] In one possible implementation, determining the target task from a non-unique specific application and determining the target terminal device from the terminal device based on the operating parameters and the device configuration information includes at least one of the following: When the operation parameter is the third operation trajectory generated by the first touch operation, the task performed by the first application in the specific application is determined as the target task, and the terminal device in the terminal device that matches the first application is determined as the target terminal device based on the device configuration information; When the operation parameter is the fourth operation trajectory generated by the first touch operation, the task performed by the second application in the specific application is determined as the target task, and the terminal device that matches the second application in the terminal device is determined as the target terminal device based on the device configuration information; When the operating parameters characterize the electronic device switching from a first pose to a second pose, the task performed by the third application in the specific application is determined as the target task, and the terminal device matching the third application in the terminal device is determined as the target terminal device based on the device configuration information; When the operation parameter is the second gesture pattern or the second voice data generated by the first input operation, the task performed by the fourth application in the specific application is determined as the target task, and the terminal device in the terminal device that matches the fourth application is determined as the target terminal device based on the device configuration information; Wherein, at least one trajectory parameter of the fourth operation trajectory and the third operation trajectory are different.

[0009] In one possible implementation, sending the target task to the target terminal device so that the target terminal device can continue to execute the target task includes: Obtain task information for the target task, wherein the task information at least characterizes the data volume and / or execution method of the target task; The target task is processed based on the task information and a corresponding processing strategy. The processing result is sent to the target terminal device so that the target terminal device can continue to execute the target task based on the processing result.

[0010] In one possible implementation, the target task is processed based on the task information using a corresponding processing strategy, including at least one of the following: When the task information indicates that the target task is executed through an online application, the access address and current task progress corresponding to the target task are obtained as the processing result. When the task information indicates that the target task is executed by a local application and the data volume of the target task is not greater than a first threshold, the task content and current task progress of the target task are encapsulated to obtain the processing result. If the task information indicates that the target task is executed through a local application and the data volume of the target task is greater than a first threshold, the processing result is the multiple sub-tasks obtained by splitting the target task and the current task progress; or, If the task information indicates that the target task is executed by a local application and the data volume of the target task is greater than a first threshold, the target task is processed into a video stream or access address and sent to the target terminal device.

[0011] In one possible implementation, the control method further includes at least one of the following: After sending the target task to the target terminal device, the operating state of the electronic device is controlled based on the task information of the target task; or, In response to receiving a second trigger operation acting on the target terminal device, the target terminal device is controlled to run an application for executing the target task, so as to continue executing the target task from the target node. The second trigger operation may or may not be related to the first trigger operation. In response to receiving a third triggering operation acting on an electronic device, an application or application process for executing a terminal task sent by the target terminal is run to continue executing the terminal task from the corresponding target node, wherein the third triggering operation is not related to the first triggering operation.

[0012] In one possible implementation, controlling the target terminal device to continue executing the target task from the target node includes at least one of the following: When the target terminal device is in a powered-off state, in response to receiving a second trigger operation that switches the target terminal device to a powered-on state, the target terminal device is controlled to launch an application for executing the target task, so as to continue executing the target task from the target node; When the target terminal device is in a working state, in response to a second trigger operation acting on the interaction area of ​​the target terminal device, the target terminal device is controlled to continue executing the target task based on the processing result of the obtained target task, starting from the target node.

[0013] Secondly, embodiments of this application also provide an electronic device, including: The device body and at least one sensing module and at least one processor disposed on the device body; The sensing module is used to detect trigger operations applied to the electronic device; The processor is capable of performing the following: in response to receiving a first trigger operation acting on an electronic device, determining a target task and a target terminal device that match the first trigger operation; The target task is sent to the target terminal device so that the target terminal device can continue to execute the target task; The target task can be continued from the target node, which is a node used to represent the current task progress of the target task when responding to the first triggering operation; The target terminal device is configured to run an application for performing the target task in order to continue performing the target task. Attached Figure Description

[0014] To more clearly illustrate the technical solutions in this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0015] Figure 1 A flowchart of a control method provided in this application is shown; Figure 2 This application provides a flowchart of a method for determining a target task and a target terminal device that match a first triggering operation. Figure 3 This application provides an example diagram illustrating the correspondence between a triggering operation and a terminal device. Figure 4 This application provides a flowchart of a method for sending a target task to a target terminal device. Figure 5 This application provides a schematic example of a triggering operation that acts on an electronic device. Figure 6 This application provides an example diagram of displaying partial data from a mobile phone on a laptop computer. Figure 7 The illustration shows a screenshot of a laptop computer responding to user actions, as provided in this application. Figure 8 This application provides an example diagram of displaying partial data of a work computer on a laptop computer. Figure 9 This application provides an illustration of another laptop computer responding to user actions. Figure 10This application provides another schematic example of a triggering operation that acts on an electronic device. Figure 11 An example diagram of displaying mobile phone data on a home computer screen is shown, as provided in this application. Figure 12 This application provides another example diagram of displaying mobile phone data on a home computer screen; Figure 13 An example diagram of a task interface for creating a PPT presentation, provided in this application, is shown. Figure 14 An example diagram is shown, illustrating how to display specific text content from a work computer on the screen of a home computer, as provided in this application. Figure 15 An example diagram of another PPT creation task interface provided in this application is shown; Figure 16 An example diagram of a mobile phone display interface provided in this application is shown; Figure 17 A schematic diagram of the structure of a computer device provided in this application is shown. Detailed Implementation

[0016] Various embodiments and features of this application are described herein with reference to the accompanying drawings.

[0017] It should be understood that various modifications can be made to the embodiments described herein. Therefore, the above description should not be considered as limiting, but merely as an example of embodiments. Other modifications within the scope and spirit of this application will be apparent to those skilled in the art.

[0018] The accompanying drawings, which are included in and form part of this specification, illustrate embodiments of the present application and, together with the general description of the present application given above and the detailed description of the embodiments given below, serve to explain the principles of the present application.

[0019] These and other features of this application will become apparent from the following description of preferred forms of embodiments given as non-limiting examples, with reference to the accompanying drawings.

[0020] It should also be understood that although this application has been described with reference to some specific examples, those skilled in the art can certainly implement many other equivalent forms of this application, which have the features described in the claims and are therefore all within the scope of protection defined herein.

[0021] The above and other aspects, features and advantages of this application will become more apparent when taken in conjunction with the accompanying drawings and in view of the following detailed description.

[0022] Specific embodiments of this application are described thereafter with reference to the accompanying drawings; however, it should be understood that the claimed embodiments are merely examples of this application, which can be implemented in various ways. Well-known and / or repeated functions and structures are not described in detail to avoid unnecessary or redundant details that could obscure the application. Therefore, the specific structural and functional details claimed herein are not intended to be limiting, but merely serve as the basis and representative basis for the claims to teach those skilled in the art to use this application in a variety of substantially any suitable detailed structures.

[0023] This specification may use the phrases “in one embodiment,” “in another embodiment,” “in yet another embodiment,” or “in other embodiments,” all of which may refer to one or more of the same or different embodiments according to this application.

[0024] To facilitate understanding of this application, a control method provided in this application will be described in detail below. The execution entity of the control method in this application can be a processor or controller of an electronic device, and this application does not limit this to either.

[0025] As an example, Figure 1 A flowchart of the control method provided in an embodiment of this application is shown, wherein the steps specifically include S101 and S102.

[0026] S101, in response to obtaining a first trigger operation acting on an electronic device, determine the target task and target terminal device that match the first trigger operation.

[0027] The control method of this application embodiment is applied to scenarios where a user performs tasks based on an electronic device. Optionally, the user can perform various operations based on the electronic device to cause the electronic device to respond to the control logic corresponding to the operations.

[0028] For example, when an electronic device receives a first trigger operation from a user, it responds to the first trigger operation to determine the target task and target terminal device that match the first trigger operation.

[0029] The first trigger operation can be set as any operation in the electronic device that does not match other instructions. For example, the first trigger operation may include a four-finger swipe operation on the touch screen or touchpad of the electronic device, a mouse drag operation on the display screen, a device closing operation, a device moving or rotating operation. Of course, considering that electronic devices are usually equipped with audio / video capture devices, the first trigger operation may also include voice operation, gesture operation, etc.

[0030] Typically, when a user wants to switch to another device to perform the current task, to ensure task continuity and smoothness, the electronic device, upon receiving a first trigger operation, determines the target task corresponding to that first trigger operation. The target task can include an Office editing task currently being performed by the electronic device, an e-book reading task, a web browsing task, a video playback task, an audio playback task, a running game task, an AI processing task, etc. In one feasible embodiment, a mapping table between different trigger operations and different tasks can be pre-created, or the relationship between tasks and trigger operations can be created in real time based on the electronic device's operating information. Upon detecting the first trigger operation, the corresponding target task can be matched.

[0031] Simultaneously, it is also necessary to identify the target terminal device that matches the first trigger operation. This target terminal device must have an independent operating system, meaning it possesses the ability to independently process tasks; furthermore, this target terminal device must have a specific association with the electronic device, such as sharing the same user ID or being located on the same local area network.

[0032] S102, the target task is sent to the target terminal device so that the target terminal device can continue to execute the target task.

[0033] After determining the target task and target terminal device that match the first trigger operation, the operation of sending the target task to the target terminal device is directly executed. It should be noted that this sending action is also an action performed in response to the first trigger operation; that is, the actions performed in response to the first trigger operation are determining the target task and target terminal device that match the first trigger operation and sending the target task to the target terminal device. In this embodiment, the purpose of switching the execution terminal of the target task (from the electronic device to the target terminal device) can be achieved without requiring the user to perform any operations other than the first trigger operation, making the operation convenient and providing a better user experience.

[0034] The identified target terminal device is configured to run an application to execute the target task. The target terminal device described above is not an extended screen or a projected screen device; it has an independent operating system and is capable of running applications. Therefore, when the target task requires an application to execute, the target terminal device is triggered to launch and run the corresponding application locally to continue executing the target task. This application is not merely a receiving application for receiving and displaying projected data, but an application that can run independently to continue executing the target task from the target node. This application is either the same as the application on the electronic device that executes the target task or a different program that provides the same functional services.

[0035] Optionally, since the target terminal device itself has the ability to execute tasks, when the target terminal device receives the target task, the target terminal device can determine the way to continue executing the target task based on its current operating state. For example, when the target terminal device is in an idle or hibernation state, it is set to directly continue executing the received target task; when the target terminal device is in an executing task or power-off state, it is set to respond to a second trigger operation to execute the target task.

[0036] In another example, when a target terminal device receives a target task and there is a task being executed on the target terminal device, the target terminal device can determine whether to directly continue executing the received target task based on the priority of its locally running application and the application used to execute the target task. If the priority of the application used to execute the target task is higher than the priority of its locally running application, then the received target task will be executed directly.

[0037] In this embodiment of the application, when continuing to execute the received target task, the target task can be continued from the target node. The target node is a node used to represent the current task progress of the target task when responding to the first trigger operation, such as the current editing page of an Office file, the current playback progress of a video file, the current display progress of a live streaming task, the current game progress, the current processing progress of an AI inference task, etc., thereby ensuring the continuity and smoothness of the task and avoiding the waste of resources caused by re-executing the target task on the target terminal device.

[0038] This application embodiment, by responding to a user operation, namely a first trigger operation, not only determines the target task that the user expects to switch to another device for execution and the desired target terminal device, but also directly sends the target task to the target terminal device so that the target terminal device can continue to execute the target task without requiring the user to perform any other operations besides the first trigger operation, making the operation convenient; moreover, the target terminal device continues to execute the target task from the node of the current task progress when responding to the first trigger operation, which improves the interaction efficiency while ensuring the continuity of task execution and avoids the waste of resources caused by re-executing the target task on the target terminal device.

[0039] As an example, Figure 2 A flowchart of a method for determining a target task and a target terminal device that match a first triggering operation is shown, wherein the steps specifically include S201-S203.

[0040] S201, obtain the operation parameters for the first trigger operation.

[0041] S202, if there is only one specific application currently running on the electronic device, the unique specific application is identified as the target task, and a matching target terminal device is determined from the terminal devices owned by the target user based on the operation parameters, or a matching target terminal device is determined from the terminal devices in the current spatial environment of the electronic device based on the operation parameters.

[0042] S203, when the specific application currently running on the electronic device is not unique, obtain the device configuration information of the terminal device owned by the target user or the terminal device in the spatial environment where the electronic device is currently located, and determine the target task from the non-unique specific application and the target terminal device from the terminal devices based on the operating parameters and device configuration information.

[0043] Optionally, while obtaining the first trigger operation applied to the electronic device, the operation parameters of the first trigger operation are also obtained. These operation parameters include operation type, operation mode, operation trajectory, operation gesture, direction, and the state presented by the electronic device. Based on this, the operation parameters can characterize actions such as four-finger horizontal swipe from left to right on the electronic device's touchscreen or touchpad, three-finger vertical swipe from top to bottom, three-finger swipe a first distance and then switch to four-finger swipe, etc. The operation parameters can also characterize the opening and closing angle between the two bodies of the electronic device, relative pose changes, or the overall movement of the electronic device, or switching from landscape to portrait mode, etc.

[0044] For example, the operation parameters for obtaining the first triggering operation include at least one of the following: 1. In response to obtaining a first touch operation acting on a touch area of ​​an electronic device, at least one of the following: operation trajectory, touch force, number of touch points, touch direction, and touch duration of the first touch operation is used as an operation parameter.

[0045] For example, an electronic device is equipped with a touchscreen and / or touchpad, allowing a user to perform touch operations based on a touch area formed by the touchscreen and / or touchpad. In response to obtaining a first touch operation acting on the touch area of ​​the electronic device, this first touch operation can serve as a first trigger operation.

[0046] While obtaining the first touch operation applied to the touch area of ​​the electronic device, the system also obtains the operation trajectory, touch force, number of touch points, touch direction, and touch duration of the first touch operation. Specifically, the operation trajectory of the first touch operation includes the start and end points of the first touch operation, the trajectory type (e.g., straight line trajectory, arc trajectory, scaling trajectory, etc.), and the trajectory pattern (e.g., straight line, circle, broken line, letter, symbol, etc.); the touch force of the first touch operation includes the pressure value collected by the touch area when the first touch operation is applied; the number of touch points of the first touch operation includes the number of effective contact points with the touch area, which can characterize the number of fingers used by the user when performing the first touch operation; the touch direction of the first touch operation includes left to right, top to bottom, right to left, bottom to top, diagonal direction, etc.; and the touch duration of the first touch operation includes the duration of contact between the operating body and the touch area during the touch process from the start to the end of the first touch operation.

[0047] Furthermore, at least one of the following can be used as the operation parameters: operation trajectory, touch force, number of touch points, touch direction, and touch duration of the first touch operation.

[0048] 2. In response to the first trigger operation that causes a change in the pose of the electronic device, the change data of the pose of the electronic device is used as the operation parameter.

[0049] Considering that some electronic devices have certain special attributes, such as the ability to switch between portrait and landscape modes (e.g., all-in-one computers, laptops) and switch between main and secondary screens (e.g., rollable screen devices, foldable screen devices), their posture and form will change. For example, the position of the electronic device will move, the screen will switch between portrait and landscape modes, the opening and closing angle of the two main bodies of the electronic device will change, and the screen size will change (rollable screen will unfold or roll up).

[0050] Optionally, an operation that changes the position and orientation of the electronic device can be set as the first trigger operation. In this case, the first trigger operation may include operations such as opening and closing the screen, moving the device, rotating the screen, pulling out the screen, or clicking a control button.

[0051] Correspondingly, when the first trigger operation causes a change in the pose of the electronic device, the obtained pose change data is used as an operation parameter. For example, this change data includes one or more of the following: the opening angle of the body / screen (which may include an initial angle and a final angle), the screen rotation angle, and changes in device shape (such as the length of the body / screen).

[0052] 3. In response to a first input operation that obtains a detection area acting on the electronic device, the input data generated by the first input operation is used as an operation parameter, and the detection area is formed by the sensing range of the target sensor of the electronic device.

[0053] As another example, electronic devices typically integrate various types of sensors to assist them in performing tasks. These include cameras, radar detectors, time-of-flight sensors, infrared detectors, and audio acquisition devices (such as microphones). Based on this, the first trigger operation can include voice commands or gestures, and the first input operation applied to the detection area of ​​the electronic device can be acquired in real time. This detection area is formed by the sensing range of the target sensor of the electronic device, such as the overlapping area determined by the image acquisition area and the sensing area corresponding to a camera, radar detector, time-of-flight sensor, or infrared detector, or the sound pickup area corresponding to an audio acquisition device.

[0054] In response to a first input operation that applies to a detection area of ​​the electronic device, the input data generated by the first input operation is used as an operation parameter. Correspondingly, the operation parameter includes voice data, gesture data, or gesture change data, etc.

[0055] The methods for obtaining the first trigger operation in the embodiments of this application do not require additional components; they can be achieved using the components configured in the electronic device itself, which means that no additional cost is added.

[0056] After obtaining the operation parameters of the first trigger operation, or while obtaining the operation parameters of the first trigger operation, the currently running applications of the electronic device are traversed to determine the target task based on the currently running applications.

[0057] If a specific application is currently running on an electronic device, that specific application is identified as the target task. Specifically, if the electronic device currently has only one specific application open, it indicates that the specific application currently running on the electronic device is unique. Examples of such applications include office applications (e.g., Word documents, PowerPoint presentations), multimedia applications, browser applications, AI assistants (e.g., Doubao, Copilot), video editing applications, or image editing applications.

[0058] While determining the target task, a matching target terminal device can be identified from the terminal devices owned by the target user based on operational parameters. The target user is either the user associated with the current electronic device or the user associated with the account logged into the current electronic device. For example, based on the user ID (such as a system account or application account) included in the operational parameters, the target user is determined; based on the target user's user ID, the terminal devices owned by the target user are determined, and a matching target terminal device is identified from the terminal devices owned by the target user. The terminal devices owned by the target user include the current electronic device and at least one other device.

[0059] While determining the target task, the system can also identify matching target terminal devices from among the terminal devices in the current spatial environment of the electronic device based on operational parameters. In smart office or smart home application scenarios, a local area network (LAN) is typically set up, and the devices within this LAN have specific relationships. Based on this, and using the LAN information included in the operational parameters, the current spatial environment of the electronic device (such as a company network environment or a home network environment) is determined, and matching target terminal devices are then identified from the terminal devices within this spatial environment. This spatial environment typically contains multiple devices, and the collaborative operation of these devices meets the needs of that spatial environment.

[0060] Of course, the current electronic devices are on the same local area network as all terminal devices in this space environment.

[0061] It is worth noting that before determining the matching target terminal device from the terminal devices owned by the target user or from the terminal devices in the current spatial environment of the electronic device, the target terminal device can be determined based on operation parameters including operation trajectory, touch pressure, number of touch points, touch direction, touch duration, etc., or based on one or more of the following: operation trajectory, touch pressure, number of touch points, touch direction, touch duration, terminal devices owned by the target user, and terminal devices in the current spatial environment of the electronic device. As an example, the methods for determining the target terminal device include at least one of the following: The first method Given the first operation trajectory generated by the first touch operation as the operation parameter, the second terminal device in the current spatial environment of the first terminal device or electronic device owned by the target user is identified as the target terminal device.

[0062] The process involves identifying and analyzing the obtained operation parameters to determine whether the first touch operation generates a corresponding first operation trajectory. This first operation trajectory can include sliding four or three fingers from the left edge to the right edge, from the top edge to the bottom edge, or from the center or one-third of the way to the left edge. Different operation trajectories correspond to different terminal devices, allowing for precise location of the corresponding terminal device based on the operation trajectory. For example, sliding four or three fingers from the left edge to the right edge corresponds to a laptop, from the top edge to the bottom edge to a tablet, and from the center or one-third of the way to the left edge to a mobile phone.

[0063] Furthermore, if the first touch operation generates a corresponding first operation trajectory, the second terminal device within the current spatial environment of the target user's first terminal device or electronic device is identified as the target terminal device. Combining the first operation trajectory dimension, the target terminal device is determined from the terminal devices within the current spatial environment of the target user's terminal device or electronic device with high accuracy; that is, the determined target terminal device meets the user's expectations.

[0064] The second method Given the second operation trajectory generated by the first touch operation as the operation parameter, the fourth terminal device in the current spatial environment of the third terminal device or electronic device owned by the target user is identified as the target terminal device.

[0065] Here, different terminal devices are pre-matched with corresponding operation trajectories. For example, the terminal device corresponding to the first operation trajectory is different from the terminal device corresponding to the second operation trajectory. Based on this, when the operation parameters are the second operation trajectory generated by the first touch operation, the target terminal device is determined by combining the second operation trajectory with the third terminal device owned by the target user or the fourth terminal device in the current spatial environment of the electronic device. At least one trajectory parameter (such as touch pressure, number of touch points, touch direction, touch duration, etc.) is different between the second and first operation trajectories. For example, the first operation trajectory is four fingers sliding from the left edge to the right edge, while the second operation trajectory is three fingers sliding from the right edge to the left edge; or, for another example, the first operation trajectory is four fingers sliding from the center to the left edge, while the second operation trajectory is four fingers sliding from one-third of the way to the left edge, etc.

[0066] Based on the above descriptions of the first and second methods, it can be seen that the first operation trajectory corresponds to the first and second terminal devices, and the second operation trajectory corresponds to the third and fourth terminal devices. Furthermore, the first and third terminal devices correspond to the same target user as the current electronic device, and the second and fourth terminal devices are in the same spatial environment as the current electronic device. By combining multiple dimensions of the operation parameters, the target terminal device can be located relatively accurately from multiple terminal devices.

[0067] The third method When the operating parameters characterize the electronic device switching from the first pose to the second pose, the fifth terminal device owned by the target user or the sixth terminal device in the current spatial environment of the electronic device is identified as the target terminal device.

[0068] Similarly, for scenarios where the pose of electronic devices can change, a mapping table between pose changes and terminal devices can be pre-configured. That is, this mapping table includes pose changes of electronic devices (such as switching from landscape to portrait, or from portrait to landscape) and their corresponding terminal devices. For example, when configuring a switch from landscape to portrait, the corresponding target terminal device is a mobile phone; when configuring a switch from portrait to landscape, the corresponding target terminal device is a tablet computer; when configuring a 90° clockwise rotation of the screen, the corresponding target terminal device is an all-in-one machine. Of course, configurations can also be made for changes in the angle between the two devices / screens, and changes in the length of the devices / screens.

[0069] Based on this, after identifying and analyzing the obtained operating parameters, if the operating parameters indicate that the electronic device is switching from a first pose to a second pose, then the fifth terminal device possessed by the target user or the sixth terminal device in the current spatial environment of the electronic device is identified as the target terminal device. Here, both the fifth and sixth terminal devices are the terminal devices corresponding to the switch from the first pose to the second pose.

[0070] The fourth method When the operation parameters are the first gesture pattern or the first voice data generated by the first input operation, the eighth terminal device in the current spatial environment of the seventh terminal device or electronic device owned by the target user is identified as the target terminal device.

[0071] Similarly, corresponding terminal devices can be configured for voice or gesture. When the operation parameters, including the gesture pattern or voice data generated by the first input operation, are identified and analyzed, the target terminal device can be determined from among the terminal devices in the current spatial environment of the target user's terminal device or electronic device, by combining the gesture pattern or voice data. For example, a unique identifier for the corresponding terminal device can be configured using gesture patterns or voice data.

[0072] Based on this, when the operation parameter is the first gesture pattern or the first voice data generated by the first input operation, the eighth terminal device within the current spatial environment of the seventh terminal device or electronic device owned by the target user is determined as the target terminal device. Both the seventh and eighth terminal devices correspond to the first gesture pattern or the first voice data. For example, a circular gesture pattern corresponds to a laptop computer; a triangular gesture pattern corresponds to a mobile phone; voice data including "laptop computer" corresponds to a laptop computer; and voice data including "mobile phone" corresponds to a mobile phone, etc.

[0073] Another example is the situation where an electronic device may not be running a single, specific application. That is, the electronic device may have multiple applications running, and these applications and their tasks can be relayed to other devices, meaning they can be switched to other terminal devices for continued execution. Therefore, when an electronic device is not running a single, specific application, the device configuration information of the target user's terminal devices or the terminal devices in the current spatial environment of the electronic device is obtained. Based on the operating parameters and device configuration information, the target task is determined from the non-unique specific applications, and the target terminal device is determined from the terminal devices. The device configuration information of different terminal devices (such as hardware capabilities, software computing power, application compatibility, etc.) differs, leading to different effects achieved by different terminal devices running the same application to perform the task.

[0074] For example, methods for determining a target task from a non-unique specific application and a target terminal device from terminal devices based on operating parameters and device configuration information include at least one of the following: The fifth method When the operation parameters are the third operation trajectory generated by the first touch operation, the task executed by the first application in the specific application is determined as the target task, and the terminal device that matches the first application in the terminal device is determined as the target terminal device based on the device configuration information.

[0075] Similarly, different operation trajectories can be pre-set to correspond to different applications. Here, the third operation trajectory can include sliding four or three fingers from the left edge to the right edge, sliding from the top edge to the bottom edge, sliding from the center or 1 / 3 to the left edge, etc. For example, sliding four or three fingers from the left edge to the right edge corresponds to office applications (such as Word documents, PPT, etc.), sliding from the top edge to the bottom edge corresponds to AI assistants (such as Doubao, Copilot, etc.), and sliding from the center or 1 / 3 to the left edge corresponds to video editing applications or image editing applications, etc.

[0076] For example, when the operation parameter is the third operation trajectory generated by the first touch operation, the task performed by the first application in the specific application is determined as the target task. That is, the third operation trajectory corresponds to the first application of the electronic device. In other words, once it is determined that the first touch operation corresponds to the generation of the third operation trajectory, the task performed by the first application is determined as the target task.

[0077] Considering that different applications have different operational requirements for electronic devices—for example, applications for playing audio require high-performance media players, applications for displaying images or videos require high-resolution screens, and gaming applications require high-performance processors—after identifying the first application, the target terminal device is determined based on the device configuration information of the terminal devices that match the first application.

[0078] The sixth method When the operation parameters are the fourth operation trajectory generated by the first touch operation, the task executed by the second application in the specific application is determined as the target task, and the terminal device that matches the second application in the terminal device is determined as the target terminal device based on the device configuration information.

[0079] As another example, if the operation parameters are identified and analyzed to obtain a fourth operation trajectory representing the first touch operation, then the task performed by the second application within a specific application is determined as the target task. As can be seen above, different operation trajectories correspond to different applications; that is, the second application corresponding to the fourth operation trajectory is different from the first application corresponding to the third operation trajectory. Specifically, at least one trajectory parameter (such as touch pressure, number of touch points, touch direction, touch duration, etc.) differs between the fourth and third operation trajectories. For example, the third operation trajectory involves three fingers sliding from the left edge to the center, while the fourth operation trajectory involves four fingers sliding from the left edge to the center; or, for another example, the third operation trajectory involves four fingers sliding from the center to the left edge with a first pressure, while the fourth operation trajectory involves four fingers sliding from the 1 / 3 mark to the left edge with a second pressure, etc.

[0080] After identifying the second application based on the fourth operation trajectory, the task executed by the second application is determined as the target task, and the terminal device matching the second application is identified as the target terminal device based on the device configuration information. The logic for determining the terminal device matching the first application as the target terminal device is the same, and will not be elaborated further here.

[0081] The seventh method When the operating parameters characterize the electronic device switching from a first pose to a second pose, the task performed by the third application in a specific application is determined as the target task, and the terminal device matching the third application in the terminal device is determined as the target terminal device based on the device configuration information.

[0082] When the operation parameters represent changes in the pose, the target task can be determined based on a pre-defined correspondence between the pose and the application. For example, switching from landscape to portrait mode might correspond to a social media application, switching from portrait to landscape mode to a video playback application, and switching from opening to closing the lid to an audio playback application.

[0083] When determining the operation parameters characterizing the electronic device's transition from a first pose to a second pose, a corresponding third application is identified from specific applications based on a pre-defined correspondence. The task executed by this third application is then designated as the target task. Simultaneously, based on device configuration information, the terminal device matching the third application is identified as the target terminal device. It should be noted that, considering the operation parameters characterizing the electronic device's opening / closing action, methods such as taking snapshots (e.g., capturing a screenshot of the target task's execution interface) and synchronizing to cloud services (e.g., marking the target task and its execution progress nodes and synchronizing them to the cloud server) are used to determine the target task's progress when the lid is closed, thus achieving the purpose of recording task progress.

[0084] The eighth method When the operation parameter is the second gesture pattern or the second voice data generated by the first input operation, the task performed by the fourth application in the specific application is determined as the target task, and the terminal device that matches the fourth application in the terminal device is determined as the target terminal device based on the device configuration information.

[0085] Similarly, a pre-defined mapping between gesture patterns or voice data and applications is established. For example, the gesture pattern might represent a unique identifier for the application, or the voice data might contain a unique identifier for the application. Based on this, when the operation parameter is a first input operation, the second gesture pattern or second voice data generated by the first input operation is identified. A fourth application is determined based on the specific application identified by the second gesture pattern or second voice data, and the task performed by the fourth application is identified as the target task. Simultaneously, based on device configuration information, the terminal device matching the fourth application is identified as the target terminal device. For example, a √ gesture corresponds to a browser application; a zoom gesture corresponds to a video editing or image editing application; the voice data includes "Word," corresponding to a Word document editing application; and the voice data includes "WeChat," corresponding to the WeChat application, etc.

[0086] In this embodiment, the application to which the target task belongs is first determined. Based on the application's attributes and the device configuration information of each terminal device, the terminal device best suited to perform the target task is selected as the target terminal device. "Best suited" here refers to having superior overall display quality, application smoothness, and processing efficiency.

[0087] Of course, for applications with simpler scenarios and personal habits and characteristics, users can customize the mapping between trigger operations and terminal devices, such as... Figure 3The illustrated diagram shows the correspondence between trigger operations and terminal devices. Taking an all-in-one device as an example, the settings are as follows: when the trigger operation slides from the left edge to the right, the corresponding terminal device is a consumer device such as a tablet or mobile phone; when the trigger operation slides from the right edge to the left, the corresponding terminal device is a work device such as a laptop; and when the trigger operation slides down from the top edge, the corresponding terminal device is an entertainment device such as a game console. Of course, users can set these settings according to their own needs, and this application embodiment does not limit this.

[0088] After determining the target task and target terminal device corresponding to the first triggering operation based on any of the above methods, according to Figure 4 The illustrated flowchart describes a method for sending a target task to a target terminal device, enabling the target terminal device to continue executing the target task. Specifically, steps S401-S403 are included.

[0089] S401, Obtain task information for the target task, the task information at least representing the data volume and / or execution method of the target task.

[0090] S402, Process the target task based on the task information and the corresponding processing strategy.

[0091] S403, the obtained processing result is sent to the target terminal device so that the target terminal device can continue to execute the target task based on the processing result.

[0092] Optionally, after determining the target task, task information can also be obtained. This task information includes the task type (e.g., playing video, document editing, web browsing), task progress (e.g., the current playback time of the video, the position of the document in editing mode, the content presented on the webpage), and task content. Correspondingly, this task information at least represents the data volume and / or execution method of the target task. The data volume of the target task can be the size of video files, audio files, documents (e.g., Word files, PPT files, Excel files), and webpage data. The execution method of the target task can be distinguished as a local task or an online task, such as editing a local Office document or an online Office document, or playing local multimedia files or playing online media data.

[0093] Furthermore, after obtaining the task information of the target task, the target task is processed according to the corresponding processing strategy based on the task information. Optionally, different task information corresponds to different processing strategies. For example, if the task information indicates that the data volume of the target task is small, such as a document or a file less than 100M, the corresponding processing strategy can be set to directly encapsulate the file corresponding to the target task and send it. If the task information indicates that the data volume of the target task is large, such as a file greater than 100M, video stream data, or game stream data, the corresponding processing strategy can be set to split the file corresponding to the target task into multiple sub-files, sort the multiple sub-files according to the task progress of the target task, and send them in sequence. The above processing strategy set based on the data volume of the target task can effectively utilize transmission resources and ensure the real-time performance of data transmission.

[0094] Taking a PPT file larger than 100M as an example, the corresponding processing strategy can be set to record the slide number and the current slide number, split the file into sub-files in the order of the slide numbers (for example, splitting 10 consecutive slides into a sub-file), arrange the sub-files in the order of the slide numbers, and use the current slide number to represent the task progress. Then, send multiple sub-files and the task progress to the target terminal device.

[0095] Taking video stream data as an example, the corresponding processing strategy can be set up to process the target task based on streaming transmission technology. That is, the server breaks the video stream data into continuous small data blocks and sends them to the target terminal device in the order of video playback. After receiving a small portion (usually a few seconds of content), the target terminal device immediately begins rendering and presentation, while the background continues to receive subsequent data until the complete video stream data is received. In this processing strategy, the target terminal device will pre-download several seconds to tens of seconds of data as a buffer to offset the stuttering and latency caused by network fluctuations, thereby ensuring the real-time performance and smoothness of the video stream playback on the target terminal device.

[0096] In another example, for a scenario where the target task has a large amount of data and is a local task, if the target terminal device does not have enough memory, the corresponding processing strategy can be set to send the file corresponding to the target task to an intermediate server. This intermediate server is used to store the data and can be accessed by the target terminal device and electronic devices. In this case, the target terminal device can obtain the file corresponding to the target task by accessing the intermediate server.

[0097] In another example, for scenarios where the target task has a large amount of data and is a local task, the corresponding processing strategy can also be set to send the file address of the file corresponding to the target task to the target terminal device, so that the target terminal device can access the file corresponding to the target task in the form of online access based on the file address, and the file address points to the original file in the electronic device that executes the target task.

[0098] In addition, for scenarios where the target task is an online task, the corresponding processing strategy can be set to directly send the access address and task progress of the target task to the terminal device, so that the target terminal device can continue to execute the target task online.

[0099] Correspondingly, when processing the target task based on the task information using the corresponding processing strategy, it may include at least one of the following: When the task information indicates that the target task is executed through an online application, the processing result is obtained by retrieving the access address corresponding to the target task and the current task progress. In other words, if the task information indicates that the target task is to play cloud resources (such as audio and video provided by a cloud server) through an online application, the processing result is based on the access address corresponding to the target task and the current task progress contained in the task information. This allows the target terminal device to continue the target task by accessing the corresponding access address through a browser or by playing the cloud resources through video playback software after receiving the processing result. Of course, when continuing the target task, the target terminal device will resume playback based on the current task progress, i.e., the playback progress, achieving a seamless switching experience for the user.

[0100] If the task information indicates that the target task is executed through a local application and the data size of the target task does not exceed a first threshold, the task content and current task progress of the target task are encapsulated to obtain the processing result. In other words, if the task information indicates that the target task is the current electronic device executing a local file through a local application, such as executing an Office document editing task, and if the data size of the target task does not exceed the first threshold (e.g., 100M), then the target task and current task progress are directly encapsulated according to the communication protocol to obtain the processing result, which is then sent to the target terminal device.

[0101] When editing an Office document, the system can record the cursor position and view position in real time and store them within the document (such as in OOXML internal data or document metadata) or in a system temporary / configuration file. When the target terminal device opens the Office document, this information can be read and the system can automatically redirect (or prompt for redirection) to continue the target task.

[0102] If the task information indicates that the target task is executed through a local application and the data volume of the target task exceeds a first threshold, the processing result will be multiple subtasks obtained by splitting the target task and the current task progress. In other words, if the task information indicates that the target task is executed by the current electronic device through a local application to execute a local file, but the data volume of the target task exceeds the first threshold, then the processing result will be multiple subtasks obtained by splitting the target task.

[0103] For example, the target task is for an electronic device to play a local video through a local video player. The data volume of the video stream is greater than a first threshold (i.e., 100M). The video player can record the last frame of data played or the duration of playback. In this case, the video stream data is split according to the playback order to obtain multiple sub-tasks. Each sub-task corresponds to a sub-video stream data. The multiple sub-tasks and the recorded last frame of data played or the duration of playback are used as the processing result so that the target terminal device plays the sub-video stream data in playback order starting from the last frame of data or the duration of playback.

[0104] If the task information indicates that the target task is executed through a local application and the data volume of the target task exceeds a first threshold, the target task is processed into a video stream or an access address and sent to the target terminal device. In other words, if the task information indicates that the target task is an ongoing game, the game data generated and dependent on by the ongoing game can be processed into a video stream and transmitted to the target terminal device via streaming technology to present the ongoing game on the target terminal device, allowing the user to continue playing the game. Alternatively, the access address corresponding to the game data generated and dependent on by the ongoing game can be transmitted to the target terminal device, effectively opening the electronic device as a file storage address for the target terminal device to access. The target terminal device can then obtain the game data generated and dependent on by the ongoing game based on this access address to continue playing the game.

[0105] As described above, different target tasks are processed according to their corresponding processing strategies to obtain corresponding processing results. These results are then sent to the target terminal device, enabling it to continue executing the target task based on the processing results. Here, the processing results include task progress, allowing the target terminal device to continue executing the target task based on this progress. This ensures high continuity and smoothness in the execution of the target task, while avoiding resource waste caused by re-executing the target task on the target terminal device.

[0106] In another example, after the target task is sent to the target terminal device, the operating state of the electronic device is controlled based on the task information of the target task. For example, if the task information indicates that the data volume of the target task is not greater than a first threshold, the electronic device can be controlled to switch to a sleep or power-off state after completing the transmission of the target task; if the task information indicates that the data volume of the target task is greater than the first threshold and the target task has been split into sub-tasks, the electronic device can be controlled to switch to a sleep or power-off state after completing the transmission of all sub-tasks; if the task information indicates that the data volume of the target task is greater than the first threshold and the target task has been processed into an access address, the electronic device can be controlled to maintain its operating state after completing the transmission of the access address, so as to enable access to the target terminal device.

[0107] As another example, after sending the target task to the target terminal device, in response to receiving a second trigger operation acting on the target terminal device, the target terminal device can be controlled to run an application for executing the target task, so as to continue executing the target task from the target node. This second trigger operation can be associated with the first trigger operation, such as the interaction methods being opposite in direction; the first trigger operation is a four-finger swipe from the left edge to the right edge, and the second trigger operation is a four-finger swipe from the right edge to the left edge. Alternatively, the second trigger operation can be unrelated to the first trigger operation; for example, the second trigger operation is a power-on operation, in which case there is no association between the second trigger operation and the first trigger operation.

[0108] The second triggering operation can trigger the target terminal device to run an application used to perform the target task. That is, the application that triggers the target terminal device to run is determined based on the program on which the target task on the electronic device depends. For example, if the target task is to play video data, then the application running on the target terminal device must at least have video playback functionality. It should be noted that the application running on the target terminal device can be the same as or different from the application running on the electronic device to perform the target task, but it must be a similar application capable of performing the same function.

[0109] As another example, after the target task is sent to the target terminal device, in response to receiving a third triggering operation acting on the electronic device, an application or application process can be run to execute the terminal task sent by the target terminal, so as to continue executing the terminal task from the corresponding target node. The third triggering operation is not related to the first triggering operation. That is to say, while the user is executing the target task based on the target terminal device, the user can also execute a third triggering operation based on the electronic device. This third triggering operation is used to retrieve and execute the task in the target terminal.

[0110] The method by which an electronic device determines the target terminal and terminal task based on the third trigger operation after receiving the third trigger operation is similar to that described above and will not be elaborated further here. The target terminal can be a target terminal device or other devices that also have a specific association with the electronic device, such as having the same user ID or being on the same local area network.

[0111] After receiving the target task, the target terminal device continues execution of the target task from the target node. For example, if the target terminal device is in a powered-off state, in response to receiving a second trigger operation that switches the target terminal device to a powered-on state, the target terminal device is controlled to launch the application used to execute the target task, so as to continue execution of the target task from the target node. That is, the second trigger operation is a power-on operation acting on the target terminal device; once the target terminal device is in a powered-on state, it is controlled to launch the application used to execute the target task and continue execution of the target task from the target node.

[0112] In another example, when the target terminal device is in a working state, in response to a second trigger operation acting on the interaction area of ​​the target terminal device, the target terminal device is controlled to continue executing the target task based on the processing result of the obtained target task, starting from the target node. As can be seen from the above, the interaction area can be the overlapping area defined by the touch area, the image acquisition area, and the perception area, the sound pickup area, etc. Correspondingly, the second trigger operation can be a touch operation, gesture, gaze, voice, etc.

[0113] The control method described above will be illustrated with the following specific examples: Example 1: The user is currently using a laptop computer, and the target task being performed on the laptop is editing a short video. At this moment, the user executes a first trigger operation based on the laptop computer. See the example diagram showing the trigger operation acting on the electronic device. Figure 5 ,Depend on Figure 5 As shown, in the example, the operation parameter of the first trigger operation represents the horizontal sliding of four fingers from left to right.

[0114] After the laptop receives the first trigger operation, it responds to it. Since the specific application currently running on the laptop is unique—namely, the application used for editing short videos—it takes editing the short video as the target task and records the current editing progress, such as the number of video frames being edited or the time point. Simultaneously, based on a pre-matched correspondence, it searches for the device corresponding to the four-finger horizontal swipe from left to right. The search result is a tablet computer, which is the target terminal device. Here, the laptop and tablet computer have the same user ID; for example, they belong to the same user.

[0115] After determining the target task (editing a short video and the number of video frames or time points being edited) and the target terminal device (tablet computer), the laptop computer further evaluates the size of the short video. If it is less than 100M, it sends the edited short video and the number of video frames or time points being edited to the tablet computer. If it is greater than or equal to 100M, it splits the edited short video into multiple video segments in sequence and sends the multiple video segments and the number of video frames or time points being edited to the tablet computer.

[0116] After the tablet receives the short video to be edited and the number of frames or time points of the video being edited, when the short video is opened on the tablet, it can directly jump to the frame being edited based on the number of frames or time points of the video being edited, allowing the user to continue editing the short video using the tablet without much operation.

[0117] When a user performs the first trigger operation on a laptop, the tablet may be in a powered-off state. Therefore, after the user performs the power-on operation on the tablet (corresponding to the second trigger operation mentioned above), the tablet can directly launch the application that can perform short video editing based on the short video and the number of frames or time points of the video being edited. This process also does not require the user to perform too many operations.

[0118] Of course, when the user performs the first trigger operation on the laptop, the tablet may also be in working mode. In this case, after the tablet receives the short video and the number of video frames or time points being edited, the target user performs touch operation, gesture operation or voice operation on the interactive area of ​​the tablet (corresponding to the second trigger operation mentioned above) to instruct the launch of an application that can perform short video editing, and to edit the short video from the number of video frames or time points being edited.

[0119] In Example 1 above, the laptop computer as the task sender corresponds to the aforementioned electronic device, while the tablet computer as the task receiver corresponds to the aforementioned target terminal device. Those skilled in the art will know that the laptop computer can also be the task receiver and the tablet computer can also be the task sender. In the scenario where the laptop computer is both the task receiver and the tablet computer is the task sender, the first triggering operation is applied to the tablet computer, and the second triggering operation is applied to the laptop computer.

[0120] Example 2: Following the scenario in Example 1, when continuing to edit a short video using a tablet, there might be a situation where some of the footage needed to create the video is still stored on the laptop. In this case, following the process in Example 1, the tablet can be used as the primary device to perform a first trigger action, such as swiping three fingers from the bottom left to the top right corner (this three-finger swipe corresponds to the laptop's movement), to identify the target device as the laptop. Afterward, the tablet can send its currently running short video editing task, along with the number of frames or time points being edited, to the laptop. The laptop can then continue editing the short video based on the short video clips sent by the tablet, the number of frames or time points being edited, and the necessary footage.

[0121] Example 3: Following the scenario in Example 1, when continuing to edit a short video using a tablet, there may be a situation where some of the materials needed to create the short video are still stored on the laptop. In this case, a third trigger operation can be performed on the laptop, and the target terminal for this third trigger operation is the tablet.

[0122] At this point, the laptop responds to the third trigger operation by running an application or application process to execute the terminal task sent by the tablet, thus continuing the short video editing task from the target node corresponding to the tablet. In this example, the laptop (i.e., the current electronic device) is the recipient of the task.

[0123] Example 4: Following the scenario in Example 2, when continuing to edit a short video using a laptop, there might be a situation where some of the materials needed to create the short video are stored on other devices. In this case, the user can perform an access operation based on the laptop (such as the third trigger operation mentioned above). Similarly, this access operation can also be performed based on the laptop's interactive area, such as touch operation, gesture operation, or voice operation. The laptop responds to this access operation to access the data on the other device. Furthermore, the user can continue editing the short video based on the laptop and the accessed materials.

[0124] For example, if the access operation is a voice operation, and the operation parameters of the voice operation include "a 30-second clip of hot pot boiling on my phone that I filmed at the store yesterday at noon," the electronic device responds to the access operation, determines that the target terminal is a mobile phone, and the target terminal's task is to transmit specific video. At this time, the laptop's display area can construct a floating layer on top of the display to display the mobile phone's data, thereby achieving the purpose of access and reading. Figure 6This diagram illustrates a sample of data displayed on a laptop screen from a mobile phone, representing a schematic example of how the target terminal device acquires and utilizes task-related information for a target task. This data is determined based on the user's access actions.

[0125] Furthermore, users can continue editing short videos based on partial data from the laptop and the currently displayed mobile phone. For example, they can perform a series of operations on partial data from the displayed mobile phone to execute editing tasks. This includes using a mouse connected to the laptop to click on the target video in the overlay, long-pressing and dragging it to a blank area on the timeline, and releasing the mouse to complete the insertion. See details... Figure 7 The image shown illustrates the effect of a laptop responding to a user's action.

[0126] Of course, a laptop can access multiple terminals. Therefore, a user can also perform another access operation based on the laptop. This second access operation differs from the first one in that the target terminal is different. For example, the second access operation might involve a four-finger swipe from the right side of the screen, accompanied by the voice command "Retrieve the food cover I designed yesterday in Photoshop." Based on this access operation, the target terminal is determined to be the work computer (different from the currently used laptop), and the terminal task is to transfer a specific image. Correspondingly, Figure 8 This is an example diagram showing partial data from a work computer displayed on a laptop.

[0127] Similarly, users can insert a video by clicking on the target video in the overlay, long-pressing and dragging it to a blank area of ​​the timeline, and then releasing the mouse. See details... Figure 9 The illustration shows the effect. It should be noted that the embodiments in this application are illustrated using a user operating a mouse as an example, but those skilled in the art should know that subsequent operations can also be performed by operating a keyboard, laser pointer, touchpad, touchscreen, etc. connected to a laptop computer to complete the task.

[0128] This example not only involves accessing data from different terminals based on different trigger operations, but also combines multiple triggers such as touch operation and voice operation, enriching the access methods. Furthermore, when accessing other terminals, there is no need to frequently operate the access / transfer software, effectively improving the convenience of access.

[0129] Example 5: Taking a home computer as an example, the target task performed by the user on this electronic device is to create a PowerPoint presentation for a new product launch. During the presentation creation process, it's necessary to access real-life photos of the new product from the user's phone and handwritten meeting notes from the work computer. At this point, the user can access the phone by using a four-finger swipe from the left edge of the screen to the right on the home computer, with the swipe area not exceeding one-quarter of the screen. An example image of this operation can be found here. Figure 10 .

[0130] Correspondingly, the home computer responds to the access operation and builds a floating layer in a specific area of ​​the screen (such as the preset area on the left) to display the phone's data. Figure 11 The image shows an example of displaying mobile phone data on a home computer screen. The size of a specific area can be adjusted to not obscure the current task interface, to obscure the current task interface by an area smaller than a preset ratio, or to set the overlay to semi-transparent. Multiple data points can be displayed as thumbnails, and the data can include images, videos, files, etc., for the user to access as needed.

[0131] If the user's desired data is not found in the displayed overlay, the user can directly issue a voice command to control the retrieval of the desired data from the phone, eliminating the need for manual operation—convenient and fast. For example, a user can send the voice message, "Product photos taken yesterday at the Yoga store." The home computer receives, recognizes, and responds to this voice message, extracting keywords (such as "yesterday," "Yoga store," and "product photos") to quickly filter for corresponding images on the phone. Then, the overlay automatically refreshes its display, showing the phone data retrieved via voice. When there are multiple data points, they can be arranged according to the time they were stored on the phone. Figure 12 This is an example image showing the phone's data displayed on a home computer screen after the content of the overlay is refreshed.

[0132] After browsing the content displayed in the overlay, the user can click on the target data, such as a product image, in the overlay, long-press and drag it to a blank area of ​​the PPT page, and release the mouse to complete the material transfer. A sample screenshot of the PPT task interface can be used as a reference at this point. Figure 13 .

[0133] Since the user also needs to access the handwritten meeting notes on their work computer, they can use a four-finger swipe from the right edge of the screen to the left on their home computer, covering no more than a quarter of the screen. This allows them to access the work computer, and they can simultaneously speak, "Retrieve the new product launch meeting notes, highlighting the key selling points," to specifically retrieve the target data. Correspondingly, the home computer responds to the touch and voice commands, retrieving the text content from the handwritten meeting notes on the work computer and displaying the specific text content (the handwritten meeting notes) in a floating layer on another specific area of ​​the screen (such as the preset area on the right). Figure 14 This image shows an example of displaying specific text content from a work computer on a home computer screen.

[0134] For the retrieved text content, you can use touch operations such as swiping to select the desired text paragraphs and dragging them to the corresponding positions in the PPT to complete the text retrieval for later use. A screenshot of the PPT task interface can be found here. Figure 15 .

[0135] In this example, touch operation and voice control were used to conveniently and quickly access materials and text from other terminals. Moreover, this process did not affect the current task interface, that is, it did not affect the PPT editing interface. There was no need to switch interfaces repeatedly, which improved task execution efficiency and user experience to a certain extent.

[0136] Example 6: Taking a mobile phone as an example, when performing a photo editing task on a mobile phone, the user opens the corresponding application and performs a four-finger swipe from the left edge to the right edge of the screen, simultaneously uttering the voice command, "Pet pictures imported from the camera yesterday." The phone responds to this trigger and voice command, filtering and retrieving candidate images from the tablet, and displaying these candidate images as thumbnails in a constructed overlay. This can be referenced here. Figure 16 An example image of a mobile phone display interface is shown.

[0137] Afterwards, users perform touch operations via the touchscreen to select, insert, and refine images. The entire process takes place within the image editing application's interface, and the editing process remains unaffected.

[0138] On the other hand, this application also provides an electronic device. Since the principle of solving the problem in the electronic device is similar to the control method described above, the implementation of the electronic device can refer to the implementation of the control method described above, and the repeated parts will not be described again.

[0139] For example, the electronic device includes: The device body and at least one sensing module and at least one processor disposed on the device body; The sensing module is used to detect trigger operations applied to the electronic device; The processor is capable of performing the following: in response to receiving a first trigger operation acting on an electronic device, determining a target task and a target terminal device that match the first trigger operation; The target task is sent to the target terminal device so that the target terminal device can continue to execute the target task; The target task can be continued from the target node, which is a node used to represent the current task progress of the target task when responding to the first triggering operation; The target terminal device is configured to run an application for performing the target task in order to continue performing the target task.

[0140] The device body includes at least one sensing module, such as a touch device (e.g., a touch screen, touchpad, or its capacitive touch panel), an image acquisition device (e.g., a camera, an infrared detector), a gravity sensor, an acceleration sensor, a time-of-flight sensor / range sensor, a radar device, a microphone, etc. The sensing module can promptly detect operations performed on the electronic device and then the processor can quickly respond to the detected operations.

[0141] In another aspect, embodiments of this application also provide a computer program product, which is a computer-readable medium storing a computer program. When executed by a processor, the computer program implements the method provided in any embodiment of the present invention, including the following steps S11 and S12: S11, in response to obtaining a first trigger operation acting on an electronic device, determine the target task and target terminal device that match the first trigger operation; S12, the target task is sent to the target terminal device so that the target terminal device can continue to execute the target task; The target task can be continued from the target node, which is a node used to represent the current task progress of the target task when responding to the first triggering operation; The target terminal device is configured to run an application for performing the target task in order to continue performing the target task.

[0142] In another aspect, embodiments of this application also provide a computer device, the structural schematic diagram of which can be as follows: Figure 17As shown, the device includes at least a memory 1701 and a processor 1702. The memory 1701 stores a computer program, and the processor 1702 implements the method provided in any embodiment of the present invention when executing the computer program in the memory 1701. Exemplarily, the computer program steps of the computer device are as follows: S21 and S22: S21, in response to obtaining a first trigger operation acting on an electronic device, determine a target task and a target terminal device that match the first trigger operation; S22, the target task is sent to the target terminal device so that the target terminal device can continue to execute the target task; The target task can be continued from the target node, which is a node used to represent the current task progress of the target task when responding to the first triggering operation; The target terminal device is configured to run an application for performing the target task in order to continue performing the target task.

[0143] In another aspect, embodiments of this application also provide a storage medium carrying one or more computer programs, which, when executed by a processor, implement the method provided in any embodiment of the present invention, including the following steps S31 and S32: S31, in response to obtaining a first trigger operation acting on an electronic device, determine the target task and target terminal device that match the first trigger operation; S32, the target task is sent to the target terminal device so that the target terminal device can continue to execute the target task; The target task can be continued from the target node, which is a node used to represent the current task progress of the target task when responding to the first triggering operation; The target terminal device is configured to run an application for performing the target task in order to continue performing the target task.

[0144] Optionally, in this embodiment, the aforementioned computer program product and storage medium may include, but are not limited to, various media capable of storing program code, such as a USB flash drive, read-only memory (ROM), random access memory (RAM), portable hard drive, magnetic disk, or optical disk. Optionally, in this embodiment, the processor executes the method steps described in the above embodiments according to the program code stored in the computer program product. Optionally, specific examples in this embodiment can refer to the examples described in the above embodiments and optional implementations, which will not be repeated here. Obviously, those skilled in the art should understand that the various modules or steps of the present invention described above can be implemented using general-purpose computing devices. They can be centralized on a single computing device or distributed on a network of multiple computing devices. Optionally, they can be implemented using computer-executable program code, thereby storing them in a storage device for execution by a computing device. In some cases, the steps shown or described can be executed in a different order than those described here, or they can be fabricated as separate integrated circuit modules, or multiple modules or steps can be fabricated as a single integrated circuit module. Thus, the present invention is not limited to any specific hardware and software combination.

[0145] Furthermore, although exemplary embodiments have been described herein, their scope includes any and all embodiments based on this application that have equivalent elements, modifications, omissions, combinations (e.g., schemes involving intersections of various embodiments), adaptations, or alterations. Elements in the claims will be interpreted broadly based on the language used in the claims and are not limited to the examples described in this specification or during the implementation of this application, which will be interpreted as non-exclusive. Therefore, this specification and examples are intended to be considered illustrative only, and the true scope and spirit are indicated by the following claims and the full scope of their equivalents.

[0146] The above description is intended to be illustrative and not restrictive. For example, the above examples (or one or more of them) can be used in combination with each other. Other embodiments may be used by those skilled in the art upon reading the above description. Furthermore, in the above detailed description, various features may be grouped together to simplify the application. This should not be construed as an intention that a disclosed feature not claimed is necessary for any claim. Rather, the subject matter of this application may be less than all the features of a particular disclosed embodiment. Thus, the following claims are incorporated herein by reference as examples or embodiments, wherein each claim is an independent, separate embodiment, and these embodiments are contemplated as being possible in various combinations or arrangements. The scope of this application should be determined by reference to the appended claims and the full scope of their equivalents.

[0147] The foregoing has described in detail several embodiments of this application, but this application is not limited to these specific embodiments. Those skilled in the art can make various variations and modifications based on the concept of this application, and all such variations and modifications should fall within the scope of protection claimed in this application.

Claims

1. A control method, comprising: In response to receiving a first trigger operation acting on an electronic device, a target task and a target terminal device that match the first trigger operation are determined. The target task is sent to the target terminal device so that the target terminal device can continue to execute the target task; The target task can be continued from the target node, which is a node used to represent the current task progress of the target task when responding to the first triggering operation; The target terminal device is configured to run an application for performing the target task in order to continue performing the target task.

2. The control method according to claim 1, wherein, Determining the target task and target terminal device that match the first triggering operation includes: Obtain the operation parameters of the first triggering operation; If the specific application currently running on the electronic device is unique, that unique specific application is identified as the target task, and a matching target terminal device is determined from the terminal devices owned by the target user based on the operation parameters; or, a matching target terminal device is determined from the terminal devices within the spatial environment where the electronic device is currently located based on the operation parameters; or, When the specific application currently running on the electronic device is not unique, the device configuration information of the terminal device owned by the target user or the terminal device in the current spatial environment of the electronic device is obtained. Based on the operation parameters and the device configuration information, the target task is determined from the non-unique specific application and the target terminal device is determined from the terminal devices.

3. The control method according to claim 2, wherein obtaining the operation parameters of the first triggering operation includes at least one of the following: In response to a first touch operation that acts on a touch area of ​​an electronic device, at least one of the following is used as the operation parameter: operation trajectory, touch force, number of touch points, touch direction, and touch duration of the first touch operation. In response to obtaining a first trigger operation that causes a change in the pose of the electronic device, the change data of the pose of the electronic device is used as the operation parameter. or, In response to a first input operation that obtains a detection area acting on an electronic device, the input data generated by the first input operation is used as the operation parameter, wherein the detection area is formed by the sensing range of the target sensor of the electronic device.

4. The control method according to claim 3, wherein, Determining a matching target terminal device from the terminal devices based on the aforementioned operating parameters includes at least one of the following: When the operation parameter is the first operation trajectory generated by the first touch operation, the second terminal device in the current spatial environment of the first terminal device or electronic device owned by the target user is determined as the target terminal device; When the operation parameters are the second operation trajectory generated by the first touch operation, the fourth terminal device in the current spatial environment of the third terminal device or electronic device owned by the target user is determined as the target terminal device; When the operating parameters characterize the electronic device switching from a first pose to a second pose, the fifth terminal device owned by the target user or the sixth terminal device in the current spatial environment of the electronic device is determined as the target terminal device. When the operation parameter is the first gesture pattern or the first voice data generated by the first input operation, the eighth terminal device in the current spatial environment of the seventh terminal device or electronic device owned by the target user is determined as the target terminal device; Wherein, at least one trajectory parameter of the second operation trajectory is different from that of the first operation trajectory.

5. The control method according to claim 3, wherein, Determining a target task from a non-unique specific application and a target terminal device from the terminal device based on the operating parameters and the device configuration information includes at least one of the following: When the operation parameter is the third operation trajectory generated by the first touch operation, the task performed by the first application in the specific application is determined as the target task, and the terminal device in the terminal device that matches the first application is determined as the target terminal device based on the device configuration information; When the operation parameter is the fourth operation trajectory generated by the first touch operation, the task performed by the second application in the specific application is determined as the target task, and the terminal device that matches the second application in the terminal device is determined as the target terminal device based on the device configuration information; When the operating parameters characterize the electronic device switching from a first pose to a second pose, the task performed by the third application in the specific application is determined as the target task, and the terminal device matching the third application in the terminal device is determined as the target terminal device based on the device configuration information; When the operation parameter is the second gesture pattern or the second voice data generated by the first input operation, the task performed by the fourth application in the specific application is determined as the target task, and the terminal device in the terminal device that matches the fourth application is determined as the target terminal device based on the device configuration information; Wherein, at least one trajectory parameter of the fourth operation trajectory and the third operation trajectory are different.

6. The control method according to claim 1, wherein sending the target task to the target terminal device so that the target terminal device can continue to execute the target task includes: Obtain task information for the target task, wherein the task information at least characterizes the data volume and / or execution method of the target task; The target task is processed based on the task information and a corresponding processing strategy. The processing result is sent to the target terminal device so that the target terminal device can continue to execute the target task based on the processing result.

7. The control method according to claim 6, wherein, The target task is processed based on the task information using a corresponding processing strategy, including at least one of the following: When the task information indicates that the target task is executed through an online application, the access address and current task progress corresponding to the target task are obtained as the processing result. When the task information indicates that the target task is executed by a local application and the data volume of the target task is not greater than a first threshold, the task content and current task progress of the target task are encapsulated to obtain the processing result. When the task information indicates that the target task is executed by a local application and the data volume of the target task is greater than a first threshold, the processing result is the multiple sub-tasks obtained by splitting the target task and the current task progress. or, If the task information indicates that the target task is executed by a local application and the data volume of the target task is greater than a first threshold, the target task is processed into a video stream or access address and sent to the target terminal device.

8. The control method according to any one of claims 1, 6, or 7, further comprising at least one of the following: After sending the target task to the target terminal device, the operating state of the electronic device is controlled based on the task information of the target task; or, In response to receiving a second trigger operation acting on the target terminal device, the target terminal device is controlled to run an application for executing the target task, so as to continue executing the target task from the target node. The second trigger operation may or may not be related to the first trigger operation. In response to receiving a third triggering operation acting on an electronic device, an application or application process for executing a terminal task sent by the target terminal is run to continue executing the terminal task from the corresponding target node. The third triggering operation is not related to the first triggering operation.

9. The control method according to claim 8, wherein, Controlling the target terminal device to continue executing the target task from the target node includes at least one of the following: When the target terminal device is in a powered-off state, in response to receiving a second trigger operation that switches the target terminal device to a powered-on state, the target terminal device is controlled to launch an application for executing the target task, so as to continue executing the target task from the target node; When the target terminal device is in a working state, in response to a second trigger operation acting on the interaction area of ​​the target terminal device, the target terminal device is controlled to continue executing the target task based on the processing result of the obtained target task, starting from the target node.

10. An electronic device, comprising: The device body and at least one sensing module and at least one processor disposed on the device body; The sensing module is used to detect trigger operations applied to the electronic device; The processor is capable of performing the following: in response to receiving a first trigger operation acting on an electronic device, determining a target task and a target terminal device that match the first trigger operation; The target task is sent to the target terminal device so that the target terminal device can continue to execute the target task; The target task can be continued from the target node, which is a node used to represent the current task progress of the target task when responding to the first triggering operation; The target terminal device is configured to run an application for performing the target task in order to continue performing the target task.

Images