Multi-device collaboration method, device, electronic device, and medium
By displaying the logo on the first electronic device and sending instructions to control the second device interface, the real-time and complexity problems of remote collaboration of multiple devices are solved, and convenient and secure multi-device collaboration is achieved.
Patent Information
- Application Number
- CN202210316394.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-03-28
- Publication Date
- 2025-08-12
- Estimated Expiration
- 2042-03-28
AI Technical Summary
In the prior art, multi-device remote collaboration has poor real-time and high complexity, especially when operating in the elderly and children, there are problems such as complex operation, safety hazards and poor real-time performance.
By receiving user input when the first electronic device displays a first identifier, a target instruction is sent to the second electronic device to control its display of the corresponding interface, simplifying the operation process and avoiding complex software operations and network transmission delays.
It improves the real-time and convenience of remote collaboration between multiple devices, reduces operational complexity, improves security, and saves network traffic.
Smart Images

Figure CN114741146B_ABST
Abstract
Description
Technical Field
[0001] The present application belongs to the field of communication technology, and specifically relates to a multi-device collaboration method, apparatus, electronic device, and medium. Background Art
[0002] With the continuous development of electronic devices, electronic devices have more and more functions. Most users will encounter inconveniences when using electronic devices. For example, when the elderly want to watch opera on smart TV, the elderly need to show their health code to enter the supermarket, or children need to use tablet computers to take an online class, they do not know how to operate electronic devices. At this time, they can only trouble others to provide them with remote help. However, in the prior art, remote collaboration between electronic devices requires various software, the operation process is relatively complicated, and the process of remote collaboration is prone to jamming and delays. As a result, the real-time performance of remote collaboration between multiple devices in the prior art is poor and the complexity is high. Summary of the Invention
[0003] The purpose of the embodiments of the present application is to provide a multi-device collaboration method, apparatus, electronic device and medium, which can solve the problems of poor real-time performance and high complexity in the prior art when multiple devices collaborate remotely.
[0004] In order to solve the above technical problems, this application is implemented as follows:
[0005] In a first aspect, an embodiment of the present application provides a multi-device collaboration method, which is applied to a first electronic device. The multi-device collaboration method includes: when the first electronic device displays a first identifier, receiving a first input from a user for the first identifier, and the first identifier corresponds to a first interface in a second electronic device; in response to the first input, sending a target instruction to the second electronic device, and the target instruction is used to control the second electronic device to display the first interface.
[0006] In the second aspect, an embodiment of the present application provides another multi-device collaboration method, which is applied to a second electronic device. The multi-device collaboration method includes: receiving a target instruction sent by a first electronic device; displaying a first interface according to the target instruction, and the first interface is an interface in the second electronic device corresponding to the first identifier in the first electronic device.
[0007] In a third aspect, an embodiment of the present application provides a multi-device collaboration apparatus, applied to a first electronic device, comprising: a receiving module and a sending module. The receiving module is configured to receive a first input from a user regarding a first identifier when the first electronic device displays a first identifier, the first identifier corresponding to a first interface in a second electronic device; and the sending module is configured to send a target instruction to the second electronic device in response to the first input received by the receiving module, the target instruction being configured to control the second electronic device to display the first interface.
[0008] In a fourth aspect, embodiments of the present application provide another multi-device collaboration apparatus, applied to a second electronic device, comprising: a receiving module and a display module. The receiving module is configured to receive a target instruction sent by a first electronic device; the display module is configured to display a first interface, based on the target instruction received by the receiving module, where the first interface is an interface on the second electronic device corresponding to the first identifier on the first electronic device.
[0009] In a fifth aspect, an embodiment of the present application provides an electronic device comprising a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, the steps of the method described in the first aspect are implemented.
[0010] In a sixth aspect, an embodiment of the present application provides an electronic device comprising a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, the steps of the method described in the second aspect are implemented.
[0011] In a seventh aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the method described in the first aspect or the second aspect are implemented.
[0012] In an eighth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the method described in the first aspect or the second aspect.
[0013] In a ninth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method described in the first aspect or the second aspect.
[0014] In an embodiment of the present application, when the first electronic device displays a first identifier, the user can make a first input to the first identifier to send a target instruction to the second electronic device for controlling the second electronic device to display a first interface corresponding to the first identifier; the second electronic device can receive the target instruction sent by the first electronic device to display the first interface corresponding to the first identifier in the first electronic device according to the target instruction. Since the first electronic device can display the first identifier indicating the first interface in the second electronic device, the user can directly input the first identifier on the first electronic device to realize remote control of the first interface in the second electronic device by the first electronic device, without the user having to spend a long time on the first electronic device to execute multiple steps through various software to trigger the second electronic device to open the required interface. This improves the real-time performance of multi-device remote collaboration and reduces the complexity of the multi-device remote collaboration process. The present application realizes the convenience and flexibility of remote collaboration between electronic devices. BRIEF DESCRIPTION OF THE DRAWINGS
[0015] Figure 1 This is one of the schematic diagrams of a multi-device collaboration method provided in an embodiment of the present application;
[0016] Figure 2 This is a second example schematic diagram of an interface of a mobile phone provided in an embodiment of the present application;
[0017] Figure 3 This is a third example schematic diagram of a mobile phone interface provided in an embodiment of the present application;
[0018] Figure 4 This is a fourth example schematic diagram of an interface of a mobile phone provided in an embodiment of the present application;
[0019] Figure 5 This is a fifth example schematic diagram of an interface of a mobile phone provided in an embodiment of the present application;
[0020] Figure 6 This is a sixth example schematic diagram of an interface of a mobile phone provided in an embodiment of the present application;
[0021] Figure 7 This is the seventh example schematic diagram of an interface of a mobile phone provided in an embodiment of the present application;
[0022] Figure 8 This is an eighth example schematic diagram of an interface of a mobile phone provided in an embodiment of the present application;
[0023] Figure 9 This is a ninth example diagram of an interface of a mobile phone provided in an embodiment of the present application;
[0024] Figure 10 This is a tenth example schematic diagram of an interface of a mobile phone provided in an embodiment of the present application;
[0025] Figure 11 This is an eleventh example diagram of an interface of a mobile phone provided in an embodiment of the present application;
[0026] Figure 12 This is one of the structural diagrams of a multi-device collaboration apparatus provided in an embodiment of the present application;
[0027] Figure 13 This is the second structural diagram of a multi-device collaboration apparatus provided in an embodiment of the present application;
[0028] Figure 14 This is one of the hardware structure diagrams of an electronic device provided in an embodiment of the present application;
[0029] Figure 15 This is the second hardware structure diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0030] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.
[0031] The terms "first," "second," and the like in the specification and claims of this application are used to distinguish similar objects, and are not used to describe a specific order or precedence. It should be understood that the terms used in this manner are interchangeable where appropriate, so that the embodiments of this application can be implemented in an order other than that illustrated or described herein, and that the objects distinguished by "first," "second," and the like are generally of the same type, and do not limit the number of objects; for example, the first object can be one or more. In addition, the term "and / or" in the specification and claims refers to at least one of the connected objects, and the character " / " generally indicates that the objects connected are in an "or" relationship.
[0032] The multi-device collaboration method provided in the embodiment of the present application is described in detail below with reference to the accompanying drawings through specific embodiments and their application scenarios.
[0033] The multi-device collaboration method in the embodiment of the present application can be applied to scenarios of remote collaboration between electronic devices.
[0034] With the continuous development of electronic devices, they have become an integral part of everyone's lives. A single person may own multiple electronic devices, and a family may have even more. A household may have multiple mobile phones, smart watches, smart TVs, tablets, and more. These devices often require interaction. For example, when you're away, your elderly family member may not know how to operate their smart TV, or your child may need to take an online class on a tablet. Or, when elderly family members need to show their health or payment codes to enter or exit a shopping mall or high-speed rail station, they may struggle to navigate. In these situations, they often rely on others to provide remote assistance. However, existing technologies require various software programs for remote collaboration between electronic devices, resulting in a complex operation process and significant latency and lag. Consequently, existing technologies for multi-device remote collaboration suffer from poor real-time performance and high complexity. With the increasing personalization and differentiation of electronic devices, existing remote control technologies have significant flaws. These issues primarily arise from the following aspects: 1. Operational complexity. Elderly people and children are not adept at complex operations and therefore require assistance, making remote control software less suitable. 2. Security risks exist. If elderly people and children know how to use remote control, scammers could exploit this and obtain sensitive information such as passwords and verification codes on their devices. 3. Real-time performance is poor. During remote control, you swipe your phone, launch an app, and so on. The entire process requires transmitting a large amount of operational information and the animation displayed on your phone, consuming network traffic and bandwidth, and resulting in significant latency.
[0035] The implementation case of the present invention provides a simple and fast remote multi-device collaboration solution: 1. Bind the devices in advance to ensure that both the operating device and the operated device are trustworthy. 2. Set in advance a specified icon in an operating device to correspond to a specific interface of the operated device. In this way, the remote collaboration function can be completed without any operation of the operated device. There is no risk of leaking sensitive information. For the operating device, the operation is simpler and faster. Moreover, network transmission eliminates unnecessary operations and animations, saves traffic and improves real-time performance. 3. Some old mobile phones and mobile hard drives at home can be used as part of the expanded memory of commonly used mobile phones. Access their memory anytime, anywhere on commonly used mobile phones.
[0036] In the solution provided in the embodiment of the present application, when the first electronic device displays the first identifier, the user can make a first input to the first identifier to send a target instruction to the second electronic device for controlling the second electronic device to display the first interface corresponding to the first identifier. Since the first electronic device can display the first identifier indicating the first interface in the second electronic device, the user can directly input the first identifier on the first electronic device to realize the remote control of the first interface in the second electronic device by the first electronic device, without the user having to spend a long time on the first electronic device to execute multiple steps through various software to trigger the second electronic device to open the required interface. This improves the real-time performance of multi-device remote collaboration and reduces the complexity of the multi-device remote collaboration process. The present application realizes the convenience and flexibility of remote collaboration between electronic devices.
[0037] The present invention provides a multi-device collaboration method. Figure 1 FIG1 shows a flow chart of a multi-device collaboration method provided by an embodiment of the present application. Figure 1 As shown, the multi-device cooperation method provided in the embodiment of the present application may include the following steps 201 and 202. The following is an exemplary description using the first electronic device executing the method as an example.
[0038] Step 201: When a first electronic device displays a first identifier, the first electronic device receives a first input of the first identifier by a user.
[0039] In the embodiment of the present application, the first identifier corresponds to the first interface in the second electronic device.
[0040] In an embodiment of the present application, a user can input the first interface in the second electronic device to trigger the second electronic device to send an instruction to the first electronic device, so that the first electronic device generates a first identifier corresponding to the first interface and displays the first identifier, so that the user can input the first identifier in the first electronic device so that the first electronic device can control the first interface corresponding to the first identifier in the second electronic device.
[0041] Optionally, in the embodiment of the present application, the first input may be any of the following: a user input of any possible form, such as a click input, a long press input, a hard press input, or a double-click input, on the first identifier, to trigger the first electronic device to control the first interface corresponding to the first identifier in the second electronic device. The specific input may be determined based on actual usage requirements and is not limited in the embodiment of the present invention.
[0042] Optionally, in an embodiment of the present application, the first electronic device may display the first identifier in the notification bar interface of the first electronic device; or, the first electronic device may display the first identifier on the icon of the application of the first electronic device (i.e., the icon of the application corresponding to the first identifier); or, the first electronic device may display the first identifier on the desktop of the first electronic device.
[0043] Optionally, in an embodiment of the present application, the first identifier can be any one of the following: an icon corresponding to the first interface, an identifier on the application corresponding to the first interface (such as a digital identifier or a red dot identifier, etc.), or a name corresponding to the first interface.
[0044] Optionally, in an embodiment of the present application, before the above step 201, the multi-device collaboration method provided in the embodiment of the present application further includes the following steps 301 and 302.
[0045] Step 301: A first electronic device receives a first instruction sent by a second electronic device.
[0046] In the embodiment of the present application, the above-mentioned first instruction is an instruction corresponding to the input of the user triggering the collaboration between the first electronic device and the second electronic device when the second electronic device displays the first interface.
[0047] Optionally, in an embodiment of the present application, when the first electronic device is authorized to control the second electronic device, the first electronic device may receive the first instruction sent by the second electronic device.
[0048] In an embodiment of the present application, after the second electronic device authorizes the first electronic device to control the second electronic device, the user can trigger the second electronic device to open any interface (for example, the first interface) in the second electronic device, and then the user can input the first interface in the second electronic device to trigger the first electronic device to cooperate with the first interface. At this time, the second electronic device can generate a first instruction based on the user's input for the first interface, and send the first instruction to the first electronic device to trigger the first electronic device to cooperate with the first interface, so that after receiving the first instruction, the first electronic device can generate and display a first identifier corresponding to the first interface, so that the user can input the first identifier to trigger the first electronic device to control / cooperate with the first interface.
[0049] Optionally, in an embodiment of the present application, after the user triggers the second electronic device to open the first interface in the second electronic device, the second electronic device can display (for example, floating display on the first interface or display in an area in the first interface) a collaborative control, and the user can input the collaborative control to trigger the first electronic device to collaborate with the first interface.
[0050] Alternatively, after the user triggers the second electronic device to open the first interface on the second electronic device, the user can perform a sliding input, a long press input, or a specific gesture input on the first interface to trigger the first electronic device to cooperate with the first interface. The specific method can be determined based on actual usage needs and is not limited in the embodiments of the present application.
[0051] Alternatively, after the user triggers the second electronic device to open the first interface in the second electronic device, the user can perform voice input or press input on a physical key / physical key combination to trigger the first electronic device to cooperate with the first interface.
[0052] For example, the second electronic device is a mobile phone. Figure 2 As shown, after the mobile phone 10 (the second electronic device) authorizes the first electronic device to control the mobile phone 10, the user can trigger the mobile phone 10 to open the first interface (for example, the payment interface 11) in the mobile phone 10, and the mobile phone 10 can display the collaboration control 12 on the payment interface 11, and then the user can input the collaboration control 12 to trigger the first electronic device to control the first interface.
[0053] Optionally, in an embodiment of the present application, before the above step 301, the multi-device collaboration method provided in the embodiment of the present application further includes the following steps 401 to 403.
[0054] Step 401: When at least one electronic device within a preset network range is found, the first electronic device displays at least one device identification.
[0055] In the embodiment of the present application, each device identifier is used to indicate one electronic device among at least one electronic device.
[0056] In an embodiment of the present application, the first electronic device displays a collaboration setting interface, which includes a search control. The user can input the search control to trigger the first electronic device to search for electronic devices within a preset network range, so that when at least one electronic device within the preset network range is searched, the user is prompted with the device identification of at least one electronic device.
[0057] Optionally, in an embodiment of the present application, the above-mentioned preset network range can be any one of the following: the same cell range, the same area range, the same local area network range, the same network coverage range, etc.
[0058] Optionally, in an embodiment of the present application, the first electronic device may display at least one device identification in an area in the collaboration setting interface; or, the first electronic device may display a window in a floating form on the collaboration setting interface, wherein the window includes at least one device identification.
[0059] Optionally, in an embodiment of the present application, the at least one device identifier may specifically be a device model, a device name, a device serial number, or a device manufacturer identifier.
[0060] For example, the first electronic device is a mobile phone. Figure 3 As shown, the mobile phone 13 (the first electronic device) displays a collaborative setting interface 14, which includes a search control (for example, a "scan device" control 15). The user can input the search control to trigger the mobile phone 13 to search for all electronic devices within the preset network range, and display the device identifier of at least one searched device in the collaborative setting interface 14 (for example, a "TV A" identifier, a "mobile phone B" identifier, a "computer C" identifier, and a "watch D" identifier).
[0061] Step 402: The first electronic device receives a sixth input of a target device identifier among the at least one device identifier by the user.
[0062] In the embodiment of the present application, the target device identifier is used to indicate the second electronic device.
[0063] Optionally, in the embodiment of the present application, the sixth input may be any one of the following: a click input, a long press input, a re-press input, a double-click input, or any other possible form of input by the user on the target device identifier. Specific input may be determined based on actual usage requirements and is not limited in the embodiment of the present invention.
[0064] Step 403: The first electronic device receives a second instruction sent by the second electronic device in response to the sixth input.
[0065] In the embodiment of the present application, the second instruction is an instruction corresponding to the input of the user triggering authorization in the second electronic device to allow the first electronic device to control the second electronic device.
[0066] In an embodiment of the present application, after the user makes the sixth input of the target device identifier in the first electronic device, the first electronic device can send a request message to the second electronic device, where the request message is used to request authorization from the second electronic device to allow the first electronic device to control the second electronic device. After receiving the request message, the second electronic device can prompt the user whether to allow the first electronic device to control the second electronic device. The user can then input the prompt in the second electronic device to trigger the second electronic device to authorize the first electronic device to control the second electronic device, so that the second electronic device can send a second instruction to the first electronic device to instruct the first electronic device to allow the first electronic device to control the second electronic device.
[0067] Optionally, in an embodiment of the present application, after receiving the request message, the second electronic device may display an authorization control to prompt the user whether to allow the first electronic device to control the second electronic device, so that the user can input the authorization control to trigger the second electronic device to authorize the first electronic device to control the second electronic device.
[0068] Optionally, in an embodiment of the present application, when the second electronic device authorizes the first electronic device to control the second electronic device, and the user does not trigger the first interface of the first electronic device to cooperate with the second electronic device, the first electronic device sets the first identifier of the second electronic device to the first identifier corresponding to the desktop of the second electronic device by default. Thus, the user can input the first identifier corresponding to the desktop of the second electronic device to trigger the second electronic device to display the desktop, and trigger the first electronic device to synchronously display the interface with the same content as the desktop of the second electronic device. At this time, the user can further operate the second electronic device in the interface, and after the operation is completed, choose whether to generate the first identifier corresponding to the last operation interface in the first electronic device.
[0069] Optionally, in an embodiment of the present application, when the first electronic device has permission to control the second electronic device, when the first electronic device receives a message from the second electronic device asking for help, the first electronic device can record the message and, when the first electronic device and the second electronic device are in the same local area network again, prompt the user to set a corresponding first identifier based on the content of the message, so that the user can input in the second electronic device to enable the first electronic device to generate and display the corresponding first identifier.
[0070] Exemplarily, the first electronic device and the second electronic device are in the same local area network, and the first electronic device has permission to control the second electronic device; when the first electronic device and / or the second electronic device leave the local area network, that is, the first electronic device and the second electronic device are not in the same local area network, if the first electronic device receives a message from the second electronic device: Help open the boarding code, then the first electronic device can record the message and prompt the user to set the first identifier corresponding to the "boarding code" when the first electronic device and the second electronic device are in the same local area network again, so that the user can input the boarding code interface in the second electronic device to enable the first electronic device to generate and display the first identifier corresponding to the boarding code interface.
[0071] For example, in combination Figure 3 ,like Figure 4 As shown in (A) in FIG, the user can input the target device identifier (eg, "mobile phone B" identifier) in the collaboration setting interface 14, as shown in FIG. Figure 4As shown in (B) in the figure, the mobile phone 10 is triggered to display the authorization control 16, and then the user can input the authorization control 16 in the mobile phone 10, so that the mobile phone 10 sends a second instruction to the mobile phone 13 to indicate to the mobile phone 13 that the mobile phone 13 is allowed to control the mobile phone 10.
[0072] In an embodiment of the present application, a first electronic device can search for at least one electronic device within a preset network range and display the device identifiers of the searched electronic devices to the user, thereby facilitating the user to select an electronic device from the searched electronic devices to authorize the first electronic device. In this way, the two electronic devices establish mutual authorization without displaying other unrelated interfaces, making operation simple, fast, and highly secure.
[0073] Step 302: The first electronic device generates and displays a first identifier according to the first instruction.
[0074] In the embodiment of the present application, after receiving the first instruction, the first electronic device generates a first identifier corresponding to the first interface according to the instruction of the first instruction (ie, instructing the first electronic device to cooperate with the first interface).
[0075] Optionally, in an embodiment of the present application, the above step 302 can be specifically implemented through the following step 302a or step 302b.
[0076] Step 302a: The first electronic device displays a first identifier in a notification bar interface or desktop of the first electronic device.
[0077] In an embodiment of the present application, the first electronic device may add a collaborative operation logo in the notification bar interface to display the first logo corresponding to the first interface in the second electronic device.
[0078] Optionally, in an embodiment of the present application, the first electronic device may display the first logo on the desktop in a component manner.
[0079] For example, in combination Figure 2 ,like Figure 5 As shown, after the user inputs the collaborative control 12 in the mobile phone 10, the mobile phone 10 can send a first instruction to the mobile phone 13. After receiving the first instruction, the mobile phone 13 can generate and display a first identifier (for example, the "XX payment code" identifier) corresponding to the first interface (i.e., the payment interface 11) in the notification bar interface.
[0080] Optionally, in the embodiment of the present application, the first electronic device may further display the first identifier in the collaboration interface of the first electronic device.
[0081] Step 302b: The first electronic device displays a first identifier on the target application icon in the first electronic device.
[0082] In the embodiment of the present application, the above-mentioned target application icon is the icon of the application corresponding to the first interface.
[0083] It should be noted that the application corresponding to the first interface can be understood as: the application to which the first interface belongs, that is, the first interface is the interface of the target application, and the application to which the first interface belongs is the target application.
[0084] Optionally, in an embodiment of the present application, the first identifier displayed on the target application icon may be any one of the following: a digital identifier, a red dot identifier, a preset graphic identifier, etc.
[0085] In an embodiment of the present application, the first electronic device can display the first identifier on a notification bar interface, a desktop, or an application icon in the first electronic device, thereby improving the flexibility of the first electronic device in displaying the first identifier.
[0086] In an embodiment of the present application, when a first electronic device is authorized to control a second electronic device, a user can input any interface (e.g., the first interface) of the second electronic device according to usage requirements to trigger the first electronic device to generate and display a first identifier corresponding to the first interface, thereby enabling subsequent users to directly input the first identifier to realize remote control of the first interface in the second electronic device by the first electronic device, thereby improving the real-time and convenience of remote collaboration of multiple devices.
[0087] Step 202: The first electronic device sends a target instruction to the second electronic device in response to the first input.
[0088] In an embodiment of the present application, the above-mentioned target instruction is used to control the second electronic device to display the first interface.
[0089] In an embodiment of the present application, after receiving the first input, the first electronic device can send an instruction to the second electronic device, where the instruction is used to instruct the second electronic device to display the first interface corresponding to the first identifier, so that after receiving the instruction, the second electronic device displays the first interface according to the instruction of the instruction.
[0090] For example, Figure 6 As shown in (A), the mobile phone 13 displays a first identifier (such as the "XX payment code" identifier) in the notification bar interface. The user can make a first input to the "XX payment code" identifier, so that the mobile phone 13 controls the mobile phone 10 to display the first interface corresponding to the "XX payment code" identifier, that is, Figure 6 The first interface shown in (B) (i.e., the "XX payment code" interface 17).
[0091] Optionally, in an embodiment of the present application, when the first electronic device controls the first interface in the second electronic device a number of times greater than or equal to a preset number, when the first electronic device again receives a message to control the second electronic device to display the first interface, the first electronic device can automatically complete the collaborative operation on the first interface, that is, the user does not need to click on the first identifier corresponding to the first interface in the first electronic device to complete the collaborative operation on the first interface.
[0092] Optionally, in an embodiment of the present application, after the first electronic device controls the second electronic device to display the first interface, the second electronic device can send an indication message to the first electronic device to indicate to the first electronic device that the second electronic device has opened the first interface, so that the first electronic device can display a prompt window (for example, an "Open Successful" prompt message) based on the indication message to prompt the user that the second electronic device has opened the first interface. In this way, the user can know that the second electronic device has opened the first interface, avoiding the user from triggering the second electronic device to open the first interface again when the user does not know whether the second electronic device has opened the first interface.
[0093] An embodiment of the present application provides a multi-device collaboration method, in which, when a first electronic device displays a first identifier, a user can make a first input to the first identifier to send a target instruction to a second electronic device for controlling the second electronic device to display a first interface corresponding to the first identifier. Since the first electronic device can display a first identifier indicating a first interface in the second electronic device, the user can directly input the first identifier on the first electronic device to achieve remote control of the first interface in the second electronic device by the first electronic device, without the user having to spend a long time on the first electronic device to execute multiple steps through various software to trigger the second electronic device to open the required interface. This improves the real-time nature of multi-device remote collaboration and reduces the complexity of the multi-device remote collaboration process. The present application achieves the convenience and flexibility of remote collaboration between electronic devices.
[0094] Optionally, after the above step 201, the multi-device collaboration method provided in the embodiment of the present application may further include the following step 203.
[0095] Step 203: The first electronic device displays a second interface on the first electronic device.
[0096] In an embodiment of the present application, the interface content of the second interface is generated based on the interface content of the first interface.
[0097] In an embodiment of the present application, the first electronic device can obtain interface information of the first interface from the second electronic device, and perform interface rendering according to the interface information to obtain the second interface.
[0098] Optionally, in an embodiment of the present application, the above-mentioned interface information may include at least one of the following: interface elements (such as text, pictures, controls / components, etc.), interface size, interface layout information, etc.
[0099] Optionally, in an embodiment of the present application, the interface content of the above-mentioned second interface is the same as the interface content of the first interface; or, the interface content of the above-mentioned second interface includes part of the interface content of the first interface; or, the interface content of the above-mentioned second interface is the interface content obtained after editing and processing the interface content of the first interface.
[0100] Optionally, in an embodiment of the present application, the first electronic device may display a floating window in the first electronic device, and display the second interface in the floating window.
[0101] For example, in combination Figure 6 (A) in, such as Figure 7 As shown in (A) in FIG, after the user inputs the first identifier (i.e., the "XX payment code" identifier), the mobile phone 13 controls the mobile phone 10 to display the "XX payment code" interface 17 while displaying the second interface (i.e., the "XX payment code" interface 18) on the mobile phone 13; and, as shown in FIG. Figure 7 As shown in (B) in FIG, the mobile phone 13 may display a prompt window 19 to prompt the user that the mobile phone 10 has successfully opened the “XX payment code” interface.
[0102] In an embodiment of the present application, while the second electronic device displays the first interface, the first electronic device can also display a second interface with the same interface content as the first interface. In this way, the user can view the display results of the second electronic device in real time on the first electronic device, thereby improving the flexibility of the electronic device in displaying content.
[0103] It should be noted that the execution order of the above steps 203 and 202 is not limited in this embodiment of the present application.
[0104] In one case, the above step 203 can be executed first, and then the above step 202 can be executed. In this case, the above step 203 is that the first electronic device responds to the first input and displays the second interface in the first electronic device, and the above step 202 is that the first electronic device sends the target instruction to the second electronic device.
[0105] Alternatively, in another case, the above step 202 can be executed first, and then the above step 203 can be executed, that is, the first electronic device first executes: the first electronic device responds to the first input and sends the target instruction to the second electronic device, and then executes: the first electronic device displays the second interface in the first electronic device.
[0106] Alternatively, in another case, the above steps 202 and 203 may be performed simultaneously, that is, the first electronic device may simultaneously perform: the first electronic device sends a target instruction to the second electronic device in response to the first input, and the first electronic device displays the second interface in the first electronic device.
[0107] Optionally, in the embodiment of the present application, after the first electronic device synchronously displays the second interface, the user can perform further operations on the second interface. After the above step 203, the multi-device collaboration method provided in the embodiment of the present application may further include the following steps 501 and 502.
[0108] Step 501: A first electronic device receives a second input from a user on a second interface.
[0109] Optionally, in an embodiment of the present application, the above-mentioned second input can be a user's drag input, zoom in input, zoom out input, crop input or delete input on the second interface, so as to trigger the first electronic device to edit the second interface; or, the above-mentioned second input can be a user's input on the interface content of the second interface, such as a click input, a long press input or a sliding input, so as to trigger the first electronic device to edit the interface content of the second interface.
[0110] Step 502: The first electronic device updates the second interface to a third interface in response to the second input.
[0111] Optionally, in an embodiment of the present application, the first electronic device can adjust the display position of the second interface in the screen area of the first electronic device based on the user's drag input of the second interface to update the second interface to a third interface, that is, the third interface is the interface after the display position of the second interface is adjusted, for example, dragged from the bottom area of the screen of the first electronic device to the middle area of the screen.
[0112] Optionally, in an embodiment of the present application, the first electronic device can change / adjust the display size of the second interface based on the user's zoom-in input, zoom-out input or crop input of the second interface, so as to update the second interface to a third interface, that is, the third interface is the interface after the display size of the second interface is adjusted.
[0113] Optionally, in an embodiment of the present application, the first electronic device may cancel the display of the second interface according to the user's close input on the second interface, that is, the third interface is the interface that appears after the second interface is canceled.
[0114] Optionally, in an embodiment of the present application, the first electronic device may display at least one editing control (e.g., a copy control, a crop control, a delete control, an add control, a play control, a pause control, etc.) based on a user's long press input on the second interface. The user may then input any of the editing controls to trigger the first electronic device to edit the interface content of the second interface using the editing method corresponding to the arbitrary editing control, i.e., the third interface is the interface after the second interface is edited using any of the editing controls. For example, if the second interface is a music playback interface, the user may input a play control in the music playback interface to trigger the first electronic device to play music.
[0115] Optionally, in an embodiment of the present application, while the first electronic device processes the second interface, the second electronic device edits the first interface displayed on the second electronic device using the same processing method as the first electronic device.
[0116] In an embodiment of the present application, the user can input the second interface displayed synchronously in the first electronic device to trigger the first electronic device to edit the second interface, that is, to update the second interface to the third interface, thereby improving the operability of the first electronic device on the second interface.
[0117] Optionally, in the embodiment of the present application, the first interface is an interface corresponding to a storage directory in the second electronic device. The multi-device collaboration method provided in the embodiment of the present application may further include the following steps 601 and 602.
[0118] Step 601: The first electronic device receives a third input from a user.
[0119] In an embodiment of the present application, the third input is used to search for a target file.
[0120] Optionally, in the embodiment of the present application, the target file may be any one of the following: an image file, an audio file, a video file, a document file, etc. The specific one may be determined according to actual use requirements and is not limited in the embodiment of the present application.
[0121] Optionally, in an embodiment of the present application, the third input may be an input for the user to search for a target file in a file management interface of the first electronic device. For example, the name of the target file may be entered in a search box of the file management interface to search for the target file.
[0122] Step 602: In response to the third input, the first electronic device displays a file identifier when the storage directory in the second electronic device includes the target file.
[0123] In the embodiment of the present application, the above-mentioned file identifier is used to indicate the target file.
[0124] It can be understood that after receiving the third input from the user to search for the target file, the first electronic device can detect whether the target file is included in the second electronic device, and if the target file is included in the storage directory in the second electronic device, it displays a file identifier indicating the target file, so that when the user subsequently triggers the display of the target file, the file identifier can be directly input without having to first open the first interface corresponding to the storage directory in the second electronic device through input before the target file can be displayed, which saves the user's operation steps and time and improves the operational convenience of the first electronic device.
[0125] For example, Figure 8 As shown in (A), the first interface is the interface corresponding to the storage directory displayed by the mobile phone 10 (for example, the "123.jpg" storage directory), as shown in FIG. Figure 8 As shown in (B), the mobile phone 13 displays the file management interface 20, and the user can search for the target file (for example, "photo 123.jpg") in the file management interface 20. When the target file is included in the storage directory in the mobile phone 10, the mobile phone 13 displays the file identifier of the target file (for example, the "photo 123" identifier).
[0126] Optionally, the multi-device collaboration method provided in the embodiment of the present application may further include the following steps 701 to 704.
[0127] Step 701: The first electronic device receives a fourth input of a first identifier from a user.
[0128] Optionally, in the embodiment of the present application, the fourth input may be any possible form of input such as a click input, a long press input, a hard press input, or a double-click input of the first identifier by the user, to trigger the first electronic device to edit the first identifier. The specific input may be determined based on actual usage requirements and is not limited in the embodiment of the present invention.
[0129] Step 702: The first electronic device displays an editing control in response to the fourth input.
[0130] Optionally, in an embodiment of the present application, the above-mentioned editing control may include at least one sub-editing control, for example, the at least one sub-editing control includes at least one of the following: adding device name control, associating address book control, associating device control, classification control and deletion control, etc.
[0131] In the embodiment of the present application, each sub-editing control is used to indicate an editing method for the first identifier.
[0132] The add device name control is used to add a corresponding device name for the first identifier. The associate address book control is used to associate the first identifier with a contact or a device. The category control is used to categorize the first identifier. The delete control is used to delete the first identifier.
[0133] For example, in combination Figure 5 ,like Figure 9 As shown, the user can make a fourth input to the first identifier (for example, the "XX payment code" identifier) to trigger the mobile phone 13 to display multiple sub-editing controls (for example, add device name control, associate address book control, category control, delete control), so that the user can input any sub-editing control in the editing control (for example, target editing control) to trigger the mobile phone 13 to use the editing method corresponding to the arbitrary sub-editing control to edit the first identifier.
[0134] Step 703: The first electronic device receives the user's fifth input to the editing control.
[0135] In the embodiment of the present application, the fifth input is input to the target editing control.
[0136] In an embodiment of the present application, the target editing control is used to indicate an association method for the contact or electronic device of the first identifier.
[0137] In an embodiment of the present application, the target editing control may be an associated address book control, which is used to associate the first identifier with a target contact or a target electronic device.
[0138] Optionally, in an embodiment of the present application, the target contact may be a contact preset by the user; or, the target contact may be a contact whose number of contacts / frequency / time is greater than a preset threshold; or, the target contact may be a contact associated with the first identifier; or, the target contact may be a contact selected by the user through the fifth input.
[0139] Optionally, in an embodiment of the present application, the target electronic device may be an electronic device preset by the user; or, the target electronic device may be an electronic device whose number / frequency / time of sending messages is greater than a preset threshold; or, the target electronic device may be an electronic device associated with the first identifier; or, the target electronic device may be an electronic device selected by the user through the fifth input.
[0140] Optionally, in the embodiment of the present application, the fifth input can be any possible form of input such as a click input, a long press input, a hard press input (for example, a press force greater than a preset force), or a double-click input of the target edit control by the user. The specific form can be determined based on actual usage requirements and is not limited in the embodiment of the present invention.
[0141] Optionally, in an embodiment of the present application, the above-mentioned fifth input includes a first sub-input and a second sub-input, and the first sub-input can be a user's click input, long press input, re-press input or double-click input, etc. of the target editing control to trigger the first electronic device to display at least one contact, and the second sub-input can be the user's selection input of the target contact among the at least one contact.
[0142] Optionally, in an embodiment of the present application, the above-mentioned fifth input includes a first sub-input and a second sub-input, and the first sub-input can be a user's click input, long press input, re-press input or double-click input, etc. of the target editing control to trigger the first electronic device to display at least one device identification, and the second sub-input can be the user's selection input of the target device identification among the at least one device identification (the target device identification is used to indicate the target electronic device).
[0143] Step 704: The first electronic device establishes an association relationship between the first identifier and the target object in response to the fifth input.
[0144] In the embodiment of the present application, the target object is a target contact or a target electronic device.
[0145] For example, in combination Figure 9 ,like Figure 10 As shown, after the user makes the fifth input to the target editing control (eg, the associated address book control 21), the mobile phone 13 can establish an association relationship between the first identifier (ie, the "XX payment code" identifier) and the target contact (eg, the contact "mother").
[0146] In an embodiment of the present application, a user can input a first identifier to trigger the first electronic device to perform various editing processes on the first identifier, thereby improving the diversity of editing the first identifier; and, the first electronic device can establish an association relationship between the first identifier and the target contact or target electronic device, so that when the user subsequently receives a message sent by the target contact or target electronic device, the corresponding first identifier can be directly displayed, thereby more quickly triggering the second electronic device to display the first interface corresponding to the first identifier, thereby improving the convenience and efficiency of remote collaboration of multiple devices.
[0147] Optionally, in an embodiment of the present application, after the above step 704, the multi-device collaboration method provided in the embodiment of the present application may further include the following step 801.
[0148] Step 801: Upon receiving a notification from a target contact, the first electronic device displays at least one second identifier.
[0149] In the embodiment of the present application, the at least one second identifier is associated with the target contact or the notification content.
[0150] Optionally, in an embodiment of the present application, the notification of the target contact can be any one of the following: an incoming call message from the target contact, a short message from the target contact, a video / voice call message from the target contact, an instant messaging message from the target contact, etc.
[0151] Optionally, in the embodiment of the present application, the at least one second identifier may be an identifier containing information of the target contact (eg, account information, name, etc.).
[0152] It should be noted that the at least one second identifier associated with the notification content can be understood as: an identifier that matches the notification content, or an identifier extended from the notification content (for example, if the notification content is "family's boarding code", it can be extended to "mother's boarding code", "father's boarding code" and "brothers and sisters' boarding code", etc.).
[0153] Optionally, in an embodiment of the present application, the display mode of displaying the at least one second identifier may be any one of the following: a priority display mode, a preset marking mode.
[0154] The above-mentioned priority display manner can be understood as: adjusting the display order of the at least one second identifier to be displayed before other identifiers (ie, identifiers in all identifiers except the at least one second identifier).
[0155] Optionally, in an embodiment of the present application, the above-mentioned preset marking method can be a flashing mark display, a highlighted mark display, an enlarged mark display, a color mark method or a border mark method, etc.
[0156] For example, Figure 10 As shown, when mobile phone 13 receives an incoming call message from the contact "mother", mobile phone 13 can use a border marking method to display at least one second identifier associated with the contact "mother" (such as "mother's payment code" and "mother's health code", etc.).
[0157] For example, Figure 11 As shown, when the mobile phone 13 receives an instant communication voice sent by the contact "Mother" (for example, a voice message: cooperate with her to dial a phone number), the mobile phone 13 can display at least one second identifier associated with the content of the message sent by the contact "Mother" (for example, "Mother's Address Book" and "Mother's Dial Keypad", etc.).
[0158] In an embodiment of the present application, after establishing an association between at least one second identifier and a target contact or a target electronic device, the first electronic device can display at least one second identifier associated with the target contact or notification content, so that when the first electronic device receives a message from the target contact, it can directly display at least one second identifier associated with the target contact to the user. In this way, on the one hand, the flexibility of the display of the second identifier is improved, and on the other hand, it is convenient for the user to trigger the second electronic device to display the required interface in the first electronic device more quickly without having to search among multiple identifiers, thereby improving the simplicity of remote collaboration of multiple devices.
[0159] The embodiment of the present application provides a multi-device collaboration method, which may further include the following steps 201a and 201b. The following description will be given by taking the second electronic device as an example to illustrate the method.
[0160] Step 201a: The second electronic device receives the target instruction sent by the first electronic device.
[0161] In an embodiment of the present application, the above-mentioned target instruction is used to control the second electronic device to display the first interface.
[0162] In an embodiment of the present application, a user can make a first input of a first identifier in a first electronic device to send a target instruction to a second electronic device, so that the second electronic device can receive the target instruction sent by the first electronic device, so that the second electronic device displays a first interface corresponding to the first identifier.
[0163] Optionally, in an embodiment of the present application, before the above step 201a, the multi-device collaboration method provided in the embodiment of the present application further includes the following steps 201c and 201d.
[0164] Step 201c: When the second electronic device displays the first interface, the second electronic device receives input from the user to trigger collaboration between the first electronic device and the second electronic device.
[0165] Optionally, in an embodiment of the present application, the user input that triggers the collaboration between the first electronic device and the second electronic device can be any one of the following: user input to the collaboration control, voice input, user sliding input on the first interface, and user pressing input on a physical button / physical button combination.
[0166] Optionally, in an embodiment of the present application, when the second electronic device authorizes the first electronic device to control the second electronic device, the second electronic device receives input from the user triggering collaboration between the first electronic device and the second electronic device.
[0167] It should be noted that, for the description of the user's input triggering the collaboration between the first electronic device and the second electronic device, reference can be made to the description in the above embodiments, which will not be repeated here.
[0168] Step 201d: The second electronic device sends a first instruction to the first electronic device in response to the input.
[0169] In an embodiment of the present application, when the second electronic device displays the first interface, after receiving input from the user triggering collaboration between the first electronic device and the second electronic device, it will generate a first instruction and send the first instruction to the first electronic device, instructing the first electronic device to generate and display a first identifier corresponding to the first interface to collaborate with the first interface in the second electronic device.
[0170] Optionally, in an embodiment of the present application, when the second electronic device authorizes the first electronic device to control the second electronic device, the second electronic device sends a first instruction to the first electronic device.
[0171] In an embodiment of the present application, when the second electronic device authorizes the first electronic device to control the second electronic device, the user can input any interface (for example, the first interface) of the second electronic device according to usage requirements to generate a first instruction, and send the first instruction to the second electronic device, instructing the first electronic device to generate and display a first identifier corresponding to the first interface, so that subsequent users can directly input the first identifier to realize remote control of the first interface in the second electronic device by the first electronic device, thereby improving the real-time and convenience of remote collaboration of multiple devices.
[0172] Step 201b: The second electronic device displays the first interface according to the target instruction.
[0173] In the embodiment of the present application, the above-mentioned first interface is an interface in the second electronic device corresponding to the first identifier in the first electronic device.
[0174] In an embodiment of the present application, after the user makes a first input of the first identifier in the first electronic device, a target instruction is sent to the second electronic device, so that after receiving the target instruction, the second electronic device displays the first interface corresponding to the first identifier according to the instruction.
[0175] It should be noted that, for the target instructions, first instructions, first interface and implementation processes in the above steps 201a and 201b, and steps 201c and 201d, please refer to the relevant descriptions in the above embodiments, which will not be repeated here.
[0176] In an embodiment of the present application, since the second electronic device can receive the target instruction sent by the first electronic device, it can display the first interface according to the target instruction to realize remote control of the first interface in the second electronic device by the first electronic device. Users with limited operating skills (for example, the elderly and children) do not need to perform multiple steps in the second electronic device to open the required interface. This reduces the complexity of users using electronic devices and improves the convenience and flexibility of users using electronic devices.
[0177] It should be noted that the multi-device collaboration method provided in the embodiments of the present application can be executed by an electronic device, a multi-device collaboration apparatus, or a control module in a multi-device collaboration apparatus. In the embodiments of the present application, an electronic device executing the multi-device collaboration method is used as an example to illustrate the multi-device collaboration apparatus provided in the embodiments of the present application.
[0178] Figure 12 A possible structural diagram of a multi-device collaboration apparatus involved in an embodiment of the present application is shown. Figure 12 As shown, the multi-device collaboration apparatus 70 may include: a receiving module 71 and a sending module 72 .
[0179] The receiving module 71 is configured to receive a first user input of a first identifier when the first electronic device displays the first identifier, the first identifier corresponding to the first interface in the second electronic device. The sending module 72 is configured to send a target instruction to the second electronic device in response to the first input received by the receiving module 71, the target instruction being used to control the second electronic device to display the first interface.
[0180] An embodiment of the present application provides a multi-device collaboration apparatus. Since the first electronic device can display a first identifier indicating a first interface in a second electronic device, the user can directly input the first identifier on the first electronic device to realize remote control of the first interface in the second electronic device by the first electronic device, without the user having to spend a long time on the first electronic device to execute multiple steps through various software to trigger the second electronic device to open the required interface. This improves the real-time performance of multi-device remote collaboration and reduces the complexity of the multi-device remote collaboration process. The present application realizes the convenience and flexibility of remote collaboration between electronic devices.
[0181] In one possible implementation, the multi-device collaboration apparatus 70 provided in an embodiment of the present application further includes: a generation module and a display module. The above-mentioned receiving module 71 is further configured to receive a first instruction sent by a second electronic device before the first electronic device displays the first identifier, wherein the first instruction is an instruction corresponding to an input by a user triggering collaboration between the first electronic device and the second electronic device when the second electronic device displays the first interface. The generation module is configured to generate a first identifier based on the first instruction received by the receiving module 71. The display module is configured to display the first identifier.
[0182] In one possible implementation, the display module is further configured to display at least one device identifier when searching for at least one electronic device within a preset network range before the receiving module 71 receives the first instruction sent by the second electronic device when the first electronic device is authorized to control the second electronic device. Each device identifier is used to indicate one of the at least one electronic devices. The receiving module 71 is further configured to receive a sixth input from the user for a target device identifier in the at least one device identifier, where the target device identifier is used to indicate the second electronic device. The receiving module 71 is further configured to receive a second instruction sent by the second electronic device in response to the sixth input, where the second instruction corresponds to the input by the user in the second electronic device triggering authorization to allow the first electronic device to control the second electronic device.
[0183] In one possible implementation, the above-mentioned display module is specifically used to display the first identifier in the notification bar interface or desktop in the first electronic device; or, to display the first identifier on the target application icon in the first electronic device, where the target application icon is the icon of the application corresponding to the first interface.
[0184] In one possible implementation, the multi-device collaboration apparatus 70 provided in an embodiment of the present application further includes a display module. The display module is configured to display a second interface on the second electronic device in response to the first input, where the interface content of the second interface is generated based on the interface content of the first interface.
[0185] In one possible implementation, the multi-device collaboration apparatus 70 provided in an embodiment of the present application further includes an updating module. The receiving module 71 is further configured to receive a second user input regarding the second interface after the display module displays the second interface on the first electronic device. The updating module is configured to update the second interface to a third interface in response to the second input received by the receiving module.
[0186] In one possible implementation, the multi-device collaboration apparatus 70 provided in an embodiment of the present application further includes: a display module. The first interface is an interface corresponding to the storage directory in the second electronic device; the receiving module 71 is further configured to receive a third input from the user, the third input being used to search for a target file. The display module is configured to display a file identifier indicating the target file in response to the third input received by the receiving module 71, if the target file is included in the storage directory in the second electronic device.
[0187] In one possible implementation, the multi-device collaboration apparatus 70 provided in an embodiment of the present application further includes: a display module and an establishment module. The receiving module 71 is further configured to receive a fourth user input regarding the first identifier. The display module is configured to display an edit control in response to the fourth input received by the receiving module 71. The receiving module 71 is further configured to receive a fifth user input regarding the edit control. The establishment module is configured to establish an association between the first identifier and a target object, where the target object is a target contact or a target electronic device, in response to the fifth input received by the receiving module 71.
[0188] In one possible implementation, the above-mentioned display module is also used to display at least one second identifier after the establishment module establishes an association relationship between the first identifier and the target object, when a notification from the target contact is received, and the at least one second identifier has an association relationship with the target contact or the notification content.
[0189] Figure 13 A possible structural diagram of a multi-device collaboration apparatus involved in an embodiment of the present application is shown. Figure 13 As shown, the multi-device collaboration apparatus 80 may include: a receiving module 81 and a display module 82 .
[0190] The receiving module 81 is configured to receive a target instruction sent by the first electronic device. The display module 82 is configured to display a first interface corresponding to the first identifier in the first electronic device according to the target instruction received by the receiving module 81.
[0191] An embodiment of the present application provides a multi-device collaboration device. Since the second electronic device can receive the target instruction sent by the first electronic device, it can display the first interface according to the target instruction to realize remote control of the first interface in the second electronic device by the first electronic device. Users with inconvenient operation (for example, the elderly and children) do not need to perform multiple steps in the second electronic device to open the required interface. This reduces the complexity of users using electronic devices and improves the convenience and flexibility of users using electronic devices.
[0192] In one possible implementation, the multi-device collaboration apparatus 80 provided in an embodiment of the present application further includes a sending module. The receiving module 81 is further configured to receive user input triggering collaboration between the first and second electronic devices, before receiving the target instruction sent by the first electronic device, while the second electronic device displays the first interface. The sending module is configured to send the first instruction to the first electronic device in response to the input received by the receiving module 81.
[0193] The multi-device collaboration device in the embodiment of the present application can be a device, or a component, integrated circuit, or chip in the first electronic device or the second electronic device. The device can be a mobile electronic device or a non-mobile electronic device. Exemplarily, the mobile electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, a mobile Internet device (MID), an augmented reality (AR) / virtual reality (VR) device, a robot, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a personal digital assistant (PDA), etc. It can also be a server, a network attached storage (NAS), a personal computer (PC), a television (TV), an ATM or a self-service machine, etc., and the embodiment of the present application does not make specific limitations.
[0194] The multi-device collaboration apparatus in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.
[0195] The multi-device collaboration apparatus provided in the embodiment of the present application can implement each process implemented by the first electronic device or the second electronic device in the above method embodiment. To avoid repetition, they are not described here.
[0196] Alternatively, as Figure 14 As shown, an embodiment of the present application also provides an electronic device 900, including a processor 901 and a memory 902, wherein the memory 902 stores a program or instruction that can be run on the processor 901. When the program or instruction is executed by the processor 901, the various steps of the multi-device collaboration method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
[0197] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.
[0198] Figure 15 A schematic diagram of the hardware structure of an electronic device implementing an embodiment of the present application.
[0199] The electronic device 100 includes but is not limited to components such as a radio frequency unit 101 , a network module 102 , an audio output unit 103 , an input unit 104 , a sensor 105 , a display unit 106 , a user input unit 107 , an interface unit 108 , a memory 109 , and a processor 110 .
[0200] Those skilled in the art will understand that the electronic device 100 may also include a power source (such as a battery) to power each component, and the power source may be logically connected to the processor 110 through a power management system, thereby implementing functions such as charging, discharging, and power consumption management through the power management system. Figure 14 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be repeated here.
[0201] Among them, Figure 15 The electronic device shown may be the first electronic device or the second electronic device in the above embodiments.
[0202] When Figure 15 When the electronic device shown is the first electronic device in the above embodiment:
[0203] The user input unit 107 is configured to receive a first input from a user on the first identifier when the first electronic device displays the first identifier, and the first identifier corresponds to a first interface in the second electronic device.
[0204] The processor 110 is configured to send a target instruction to the second electronic device in response to the first input, where the target instruction is used to control the second electronic device to display the first interface.
[0205] An embodiment of the present application provides an electronic device. Since the first electronic device can display a first identifier indicating a first interface in a second electronic device, the user can directly input the first identifier on the first electronic device to realize remote control of the first interface in the second electronic device by the first electronic device, without the user having to spend a long time on the first electronic device to execute multiple steps through various software to trigger the second electronic device to open the required interface. This improves the real-time performance of remote collaboration of multiple devices and reduces the complexity of the remote collaboration process of multiple devices. The present application realizes the convenience and flexibility of remote collaboration between electronic devices.
[0206] Optionally, the user input unit 107 is also used to receive a first instruction sent by the second electronic device before the first electronic device displays the first identifier. The first instruction is an instruction corresponding to the input triggered by the user to trigger collaboration between the first electronic device and the second electronic device when the second electronic device displays the first interface.
[0207] The processor 110 is further configured to generate a first identifier according to the first instruction.
[0208] The display unit 106 is configured to display a first identifier.
[0209] Optionally, the display unit 106 is also used to display at least one device identification when at least one electronic device within a preset network range is searched, before the user input unit 107 receives a first instruction sent by the second electronic device when the first electronic device is authorized to control the second electronic device, and each device identification is used to indicate one of the at least one electronic devices.
[0210] The user input unit 107 is further configured to receive a sixth user input of a target device identifier among the at least one device identifier, where the target device identifier indicates a second electronic device. In response to the sixth input, the user input unit 107 is configured to receive a second instruction from the second electronic device, where the second instruction corresponds to an input by the user triggering authorization in the second electronic device to allow the first electronic device to control the second electronic device.
[0211] Optionally, the display unit 106 is further configured to display a second interface on the second electronic device in response to the user input unit 107 receiving the first input, where the interface content of the second interface is generated according to the interface content of the first interface.
[0212] Optionally, the user input unit 107 is further configured to receive a second input of the user on the second interface after the display unit 106 displays the second interface in the first electronic device.
[0213] The processor 110 is further configured to update the second interface to a third interface in response to a second input.
[0214] Optionally, the first interface is an interface corresponding to a storage directory in the second electronic device; the user input unit 107 is further configured to receive a third input from the user, where the third input is used to search for a target file.
[0215] The display unit 106 is further configured to, in response to the third input, display a file identifier when the storage directory in the second electronic device includes the target file, where the file identifier is used to indicate the target file.
[0216] Optionally, the user input unit 107 is further configured to receive a fourth input of the user on the first identifier.
[0217] The display unit 106 is further configured to display an edit control in response to a fourth input.
[0218] The user input unit 107 is further configured to receive a fifth input from the user to the editing control.
[0219] The processor 110 is further configured to establish, in response to a fifth input, an association relationship between the first identifier and a target object, where the target object is a target contact or a target electronic device.
[0220] Optionally, the display unit 106 is further configured to display at least one second identifier associated with the target contact or notification content after the processor 110 establishes an association between the first identifier and the target object and upon receiving a notification from the target contact.
[0221] When Figure 15 When the electronic device shown is the second electronic device in the above embodiment:
[0222] The user input unit 107 is used to receive a target instruction sent by the first electronic device.
[0223] The display unit 106 is configured to display a first interface according to the target instruction, where the first interface is an interface in the second electronic device corresponding to the first identifier in the first electronic device.
[0224] An embodiment of the present application provides an electronic device. Since the second electronic device can receive a target instruction sent by the first electronic device, it can display a first interface according to the target instruction to realize remote control of the first interface in the second electronic device by the first electronic device. Users with limited operating skills (for example, the elderly and children) do not need to perform multiple steps in the second electronic device to open the required interface. This reduces the complexity of users using electronic devices and improves the convenience and flexibility of users using electronic devices.
[0225] Optionally, the user input unit 107 is further configured to receive user input for triggering collaboration between the first electronic device and the second electronic device when the second electronic device displays the first interface before receiving the target instruction sent by the first electronic device.
[0226] The processor 110 is configured to send a first instruction to the first electronic device in response to the input.
[0227] The electronic device provided in the embodiment of the present application can implement each process implemented by the first electronic device or the second electronic device in the above method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0228] The beneficial effects of various implementations in this embodiment can be specifically referred to the beneficial effects of the corresponding implementations in the above method embodiment. To avoid repetition, they will not be described here.
[0229] It should be understood that in an embodiment of the present application, the input unit 104 may include a graphics processing unit (GPU) 1041 and a microphone 1042, and the graphics processor 1041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 107 includes a touch panel 1071 and at least one of other input devices 1072. The touch panel 1071 is also called a touch screen. The touch panel 1071 may include two parts: a touch detection device and a touch controller. Other input devices 1072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and an operating stick, which will not be repeated here.
[0230] The memory 109 can be used to store software programs and various data. The memory 109 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, applications or instructions required for at least one function (such as a sound playback function, an image playback function, etc.). In addition, the memory 109 may include a volatile memory or a non-volatile memory, or the memory 109 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM), and a direct memory bus random access memory (DRRAM). The memory 109 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.
[0231] Processor 110 may include one or more processing units. Optionally, processor 110 integrates an application processor and a modem processor. The application processor primarily handles operations related to the operating system, user interface, and application programs, while the modem processor primarily processes wireless communication signals, such as a baseband processor. It is understood that the modem processor may not be integrated into processor 110.
[0232] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
[0233] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.
[0234] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned method embodiment and achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0235] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.
[0236] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned multi-device collaboration method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0237] It should be noted that, in this article, the terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the statement "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or device comprising the element. In addition, it should be noted that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in the opposite order according to the functions involved. For example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.
[0238] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus the necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), including a number of instructions for enabling a terminal (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods described in each embodiment of the present application.
[0239] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of this application, ordinary technicians in this field can also make many forms without departing from the purpose of this application and the scope of protection of the claims, all of which are within the protection of this application.
Claims
1. A multi-device collaboration method, applied to a first electronic device, characterized in that: The method comprises: When the first electronic device displays a first identifier, receiving a first input from a user for the first identifier, where the first identifier corresponds to a first interface in the second electronic device; In response to the first input, sending a target instruction to the second electronic device, wherein the target instruction is used to control the second electronic device to display the first interface; The first identifier is associated with the target contact; and the method further includes: Upon receiving a notification from the target contact, displaying at least one second identifier on the notification interface, the at least one second identifier being associated with the target contact or the notification content, the at least one second identifier including the first identifier, and the notification from the target contact being any one of the following: an incoming call message from the target contact, a short message from the target contact, a video call message from the target contact, a voice call message from the target contact, or an instant messaging message from the target contact; Before the first electronic device displays the first identifier, the method further includes: receiving a first instruction sent by the second electronic device, where the first instruction is an instruction corresponding to an input by a user triggering collaboration between the first electronic device and the second electronic device when the second electronic device displays the first interface; According to the first instruction, the first identifier is generated and displayed.
2. The method according to claim 1, characterized in that The displaying of the first identifier includes: Displaying the first identifier in a notification bar interface or desktop of the first electronic device; or, The first identifier is displayed on a target application icon in the first electronic device, where the target application icon is an icon of an application corresponding to the first interface.
3. The method according to claim 1, characterized in that After responding to the first input, the method further includes: A second interface is displayed on the first electronic device, and interface content of the second interface is generated according to the interface content of the first interface.
4. The method according to claim 3, characterized in that After displaying the second interface on the first electronic device, the method further includes: receiving a second input from the user on the second interface; In response to the second input, the second interface is updated to a third interface.
5. The method according to claim 1, wherein The first interface is an interface corresponding to a storage directory in the second electronic device, and the method further includes: receiving a third input from a user, wherein the third input is used to search for a target file; In response to the third input, if the target file is included in the storage directory of the second electronic device, a file identifier is displayed, where the file identifier is used to indicate the target file.
6. The method according to claim 1, characterized in that The method further comprises: receiving a fourth input of the first identifier from the user; In response to the fourth input, displaying an edit control; receiving a fifth input from the user to the edit control; In response to the fifth input, an association relationship between the first identifier and a target object is established, where the target object is the target contact or the target electronic device.
7. A multi-device collaboration method, applied to a second electronic device, where the second electronic device is an electronic device corresponding to a target contact, characterized in that: The method comprises: receiving a target instruction sent by a first electronic device; Displaying a first interface according to the target instruction, where the first interface is an interface in the second electronic device corresponding to the first identifier in the first electronic device, the target instruction is sent to the second electronic device after the first electronic device receives a first input of the first identifier by the user, the first identifier is displayed on the notification interface of the first electronic device when the first electronic device receives a notification from the target contact, and the notification from the target contact is any one of the following: an incoming call message from the target contact, a short message from the target contact, a video call message from the target contact, a voice call message from the target contact, or an instant messaging message from the target contact; Before receiving the target instruction sent by the first electronic device, the method further includes: When the second electronic device displays the first interface, receiving input from a user triggering collaboration between the first electronic device and the second electronic device; In response to input indicating that the first electronic device cooperates with the second electronic device, a first instruction is sent to the first electronic device, where the first instruction is used for the first electronic device to generate and display the first identifier.
8. A multi-device collaboration apparatus, applied to a first electronic device, characterized in that: The multi-device collaboration apparatus includes: a receiving module and a sending module; The receiving module is configured to receive a first input of the first identifier by a user when the first electronic device displays the first identifier, the first identifier corresponding to the first interface in the second electronic device; The sending module is configured to send a target instruction to the second electronic device in response to the first input received by the receiving module, wherein the target instruction is used to control the second electronic device to display the first interface; The first identifier is associated with the target contact; the multi-device collaboration apparatus further includes: a display module; The display module is configured to display at least one second identifier on the notification interface when receiving a notification from the target contact, the at least one second identifier being associated with the target contact or the notification content, the at least one second identifier including the first identifier, and the notification from the target contact being any one of the following: an incoming call message from the target contact, a short message from the target contact, a video call message from the target contact, a voice call message from the target contact, or an instant messaging message from the target contact; The multi-device collaboration apparatus further includes: a generation module; The receiving module is further configured to receive a first instruction sent by the second electronic device before the first electronic device displays the first identifier, where the first instruction is an instruction corresponding to an input by a user triggering collaboration between the first electronic device and the second electronic device when the second electronic device displays the first interface; The generating module is configured to generate the first identifier according to the first instruction; The display module is further configured to display the first identifier generated by the generation module.
9. A multi-device collaboration apparatus, applied to a second electronic device, wherein the second electronic device is an electronic device corresponding to a target contact, characterized in that: The multi-device collaboration apparatus includes: a receiving module and a display module; The receiving module is configured to receive a target instruction sent by the first electronic device; The display module is configured to display a first interface according to the target instruction received by the receiving module, where the first interface is an interface in the second electronic device corresponding to the first identifier in the first electronic device, the target instruction is sent to the second electronic device after the first electronic device receives a first input of the first identifier by the user, the first identifier is displayed on the notification interface of the first electronic device when the first electronic device receives a notification from the target contact, and the notification from the target contact is any one of the following: an incoming call message from the target contact, a short message from the target contact, a video call message from the target contact, a voice call message from the target contact, or an instant messaging message from the target contact; The multi-device collaboration apparatus further includes: a sending module; The receiving module is further configured to, before receiving the target instruction sent by the first electronic device, receive an input from a user triggering collaboration between the first electronic device and the second electronic device when the second electronic device displays the first interface; The sending module is configured to send a first instruction to the first electronic device in response to the input of the collaboration between the first electronic device and the second electronic device received by the receiving module, where the first instruction is used for the first electronic device to generate and display the first identifier.
10. An electronic device, characterized in that: It includes a processor, a memory, and a program or instruction stored in the memory and executable on the processor, wherein when the program or instruction is executed by the processor, the steps of the multi-device collaboration method as claimed in any one of claims 1 to 6 or claim 7 are implemented.
11. A readable storage medium, characterized in that: The readable storage medium stores a program or instruction, and when the program or instruction is executed by the processor, the steps of the multi-device collaboration method according to any one of claims 1 to 6 or claim 7 are implemented.
Citation Information
Patent Citations
Remote assistance method between mobile terminals, client side, electronic device and system
CN104038560A
Entry creation method and mobile terminal
CN106201495A
Display control method and device, electronic equipment and computer readable storage medium
CN111913675A
Interface display method and device
CN113296647A