Method for interaction between electronic devices and electronic device - Patents.com

Abstract

A method and an electronic device for interaction between electronic devices related to the field of electronic technology are provided, which can solve the problem that entries of interaction functions between electronic devices are scattered and have different interaction methods, which easily confuse users during use. The method specifically includes providing a unified entry for triggering the interaction function between related devices in a control center of the electronic device. In the unified entry, a user may trigger the interaction function between two or more electronic devices by dragging the device icons of the related devices, and the electronic device may intelligently determine the interaction function to be performed between the electronic devices.

Description

[Technical field]

[0001] This application claims priority to Chinese Patent Application No. 202110475805.1, entitled “METHOD FOR INTERACTION BETWEEN ELECTRONIC DEVICES AND ELECTRONIC DEVICE”, filed with the State Intellectual Property Office of the People's Republic of China on April 29, 2021, the entire contents of which are incorporated herein by reference.

[0002] The present application relates to the field of electronic technology, and in particular to a method for interaction between electronic devices and an electronic device. [Background technology]

[0003] There are more and more electronic devices that can adapt to all scenarios, and different electronic devices have different software and hardware features. Generally, two or more electronic devices need to cooperate with each other to perform some tasks, such as projection, application handoff, and file / picture sharing, and these tasks are also called cross-device services. In fact, the same device vendor or the same application vendor may set different entry and different triggering methods for different cross-device services. Different device vendors or different application vendors may set different entry and triggering modes for the same cross-device service.

[0004] For example, a file / picture on electronic device A needs to be shared with electronic device B. A user selects the file / picture to be shared in electronic device A and taps the share control. Electronic device A starts searching for surrounding devices and displays a device list. The user selects electronic device B from the device list, and electronic device A sends the selected file / picture to electronic device B.

[0005] As another example, suppose the screen content of electronic device A needs to be projected to electronic device B. The user needs to first enable the wireless connection function of the two electronic devices. Next, the user performs an operation on electronic device B to make electronic device B display a QR code, and then enables the scanning function of electronic device A to scan the QR code and establish a connection to electronic device B. After electronic device A establishes a connection to electronic device B, the user operates a screen projection control on the interface of a specific application (e.g., a screen projection application or a video application) on electronic device A, and electronic device A sends the projection data to electronic device B, and electronic device B displays a screen mirror image of electronic device A.

[0006] As can be seen from above, the cross-device service entries are scattered and have different interaction modes, which may confuse users. Summary of the Invention

[0007] The present application provides a method and an electronic device for interaction between electronic devices, thereby solving the problem that the entries of interaction functions between electronic devices are scattered and the interaction methods are different, which easily confuses users during use.

[0008] In a first aspect, a method for interaction between electronic devices is provided, the method includes: a first electronic device displays a first interface, where the first interface includes a first control corresponding to the first electronic device (e.g., a device icon corresponding to the first electronic device) and a second control corresponding to a second electronic device (e.g., a device icon corresponding to the second electronic device), the second electronic device is associated with the first electronic device, and a distance between the first control and the second control is a first distance; the first electronic device receives a first operation of a user on the second control; and in response to the first operation, the first electronic device controls the distance between the first control and the second control to change to a second distance (e.g., zero or close to zero, i.e., two device icons may overlap or partially overlap, or edges of the two device icons are touching), and the first electronic device determines to perform a first interaction function with the second electronic device, where the second distance is smaller than the first distance.

[0009] From the above, it can be seen that a user can trigger an interaction function between electronic devices by moving a control corresponding to an electronic device on the first interface. The user's operation method is simple and easy to remember, and the efficiency of the interaction between the user and the electronic device is improved. It can be easily seen that by using the first interface as a unified entry for triggering the interaction function between electronic devices, the problem in the prior art that the entries of the interaction functions between electronic devices are scattered and the interaction methods are different, which makes the user easily confused during use, can be solved.

[0010] In possible implementations, the second electronic device being associated with the first electronic device includes: the second electronic device and the first electronic device being located in the same communication network; or the second electronic device and the first electronic device being logged into the same account; or the login account of the second electronic device and the login account of the first electronic device being in the same group; or the second electronic device being connected to a hotspot shared by the first electronic device; or the first electronic device being connected to a hotspot shared by the second electronic device; or the first electronic device and the second electronic device establishing a Wi-Fi Direct connection.

[0011] In other words, the first interface may be used as a unified entry for triggering interaction functions between the first electronic device and associated devices of the first electronic device.

[0012] In a possible implementation, the first operation includes dragging the second control on the first interface and releasing the second control when the distance between the second control and the first control is less than a first threshold, the first threshold being less than the first distance and the first threshold being greater than or equal to the second distance. The dragging of the second control on the first interface includes dragging the second control towards the first control while touching the second control on the first interface.

[0013] In some examples of this implementation, the position of the second control may change with the movement of the user's finger on the screen. In a particular implementation, when the user drags and moves the second control, if the distance between the second control and the first control is less than a first threshold and the user's finger releases the second control (i.e., the finger leaves the screen of the first electronic device), the distance between the first control and the second control changes to a second distance. In another particular implementation, after the user drags and moves the second control, if the distance between the second control and the first control is less than a first threshold and the user's finger does not release the second control (i.e., the finger does not leave the screen of the first electronic device) and remains at a position for a preset time, the distance between the first control and the second control changes to a second distance.

[0014] In this application, the movement trajectory of the finger when the user drags the second control is not limited. In other words, the movement trajectory when the user drags the second control may be any curve. When the user's finger releases the second control or the time that the user's finger stays at that position reaches a preset time, the distance between the position where the user's finger releases the device icon of the sound box or the position where the user's finger stays and the first control is calculated. If the distance is smaller than a first threshold, the distance between the first control and the second control is changed to a second distance.

[0015] In some other examples of this implementation, when a user touches and drags the second control, the second control may not change with the movement of the user's finger. Specifically, when a user touches and slides the second control on the screen a certain distance and then leaves the screen or remains at a certain position on the screen for a preset time, the first electronic device determines the distance between the position where the user's finger leaves the screen or remains and the first control. If the distance is less than a first threshold, the distance between the first control and the second control changes to a second distance.

[0016] In a possible implementation, the method further includes the first electronic device displaying an interface of the running of the first application. The first electronic device receiving a second operation. In response to the second operation, the first electronic device displays a control center interface, the control center interface including the first widget. The first electronic device receiving a third operation on the first widget. The first electronic device displaying the first interface includes the first electronic device displaying the first interface in response to the third operation.

[0017] In other words, the first interface may be entered through a control center of the first electronic device. In some other examples, the first interface may alternatively be set to the left-most screen or a corresponding interface of another application (e.g., a system settings application or a smart home application).

[0018] In a possible implementation, the first electronic device determining to perform a first interaction function with the second electronic device includes the first electronic device determining the first interaction function based on information about an application currently running on the first electronic device and a device type of the second electronic device.

[0019] In other words, the first electronic device may intelligently determine a first interaction function to perform with the second electronic device based on information about the currently running application and the device type of the second electronic device. In other words, if the applications currently running on the first electronic device are different, the first electronic device performs a different interaction function with the second electronic device. Alternatively, the first electronic device performs a different interaction function with a second electronic device of a different device type.

[0020] In this way, the intelligence of the first electronic device is improved, and interaction scenarios between electronic devices are enriched.

[0021] In a possible implementation, the application currently running on the first electronic device is the first application.

[0022] In other words, the user displays the control center in a pull-up or slide-down manner on the application interface of the first application displayed by the first electronic device, and enters the first interface through a control (or called a widget) of the control center. In this case, the application currently running on the first electronic device is the first application. In some scenarios, if the first application is a non-desktop application, the first electronic device may determine to perform an interaction function, i.e., a first interaction function, based on the execution information of the first application and the device type of the second electronic device. If the first application is a desktop application, the first electronic device may determine to perform a specific interaction function, i.e., the first interaction function is a pre-defined function, based on the device type of the second electronic device.

[0023] In a possible implementation, after the distance between the first control and the second control changes to the second distance, the method further includes the first electronic device receiving a fourth operation on the second control; and in response to the fourth operation, the first electronic device controls the distance between the second control and the first control to change to the first distance and stops performing the first interaction function with the second electronic device.

[0024] Thus, a manner is provided for stopping a first interaction function performed between a first electronic device and a second electronic device.

[0025] In a possible implementation, the fourth operation includes dragging the second control and releasing the second control when the distance between the second control and the first control is greater than a second threshold; or dragging the second control away from the first control while touching the second control and releasing the second control when the distance between the second control and the first control is greater than the second threshold, where the second threshold is less than or equal to the first distance and the second threshold is greater than the second distance.

[0026] In a possible implementation, after the first electronic device controls the distance between the second control and the first control to change to the first distance, the method further includes the first electronic device receiving a fifth operation on the first control; and in response to the fifth operation, the first electronic device controls the distance between the first control and the second control to change to the second distance, and the first electronic device determining to perform a second interaction function with the second electronic device or the first electronic device sending a first message to the second electronic device, where the first message instructs the second electronic device to determine a second interaction function for the second electronic device to perform with the first electronic device.

[0027] In other words, when a user moves a first control, the first electronic device may determine a second interaction function to perform with the second electronic device, and the second electronic device may determine a second interaction function to perform with the first electronic device.

[0028] In a possible implementation, a direction of data transmission between the first electronic device and the second electronic device during execution of the first interaction function by the first electronic device and the second electronic device is different from a direction of data transmission between the first electronic device and the second electronic device during execution of the second interaction function by the first electronic device and the second electronic device.

[0029] In other words, the user dragging the second control closer to the first control and the user dragging the first control closer to the second control may trigger the same interaction function but may indicate different data transmission directions between the two electronic devices. For example, if the interaction function between the two electronic devices is triggered by touching and dragging the device icon of the PC towards the device icon of the mobile phone, when an application handoff is performed between the mobile phone 101 and the PC 104, the state of the application on the PC 104 may be sent to the mobile phone 101, and the mobile phone 101 executes the application through the handoff based on the received state of the application. If the interaction function between the two electronic devices is triggered by touching and dragging the device icon of the mobile phone towards the device icon of the PC, when an application handoff is performed between the mobile phone 101 and the PC 104, the state of the application on the mobile phone 101 may be sent to the PC 104, and the PC 104 executes the application through the handoff based on the received state of the application.

[0030] In a possible implementation, a relative position between the second control and the first control on the first interface is determined based on a relative position between the second electronic device and the first electronic device.

[0031] In other words, the relative positional relationship between the first control and the second control also represents the positional relationship between the first electronic device and the second electronic device in the real space. In other words, the first interface more clearly displays the relative positions of the first electronic device and the second electronic device in the real space. It is easy to see that the relative positions of the electronic devices in the real space can help the user distinguish between these electronic devices. In other words, when the first electronic device finds two or more electronic devices with the same name, the user may distinguish the electronic devices with the same name based on the different relative positions between the first electronic device and these electronic devices, so that the user selects one of these electronic devices to interact with the first electronic device. For example, when the first electronic device finds two smart TVs named HUAWEI Vision, the interface A displayed by the first electronic device further displays two relative positions of the HUAWEI Vision identifier and the first electronic device identifier. In this case, the user may determine the smart TV corresponding to each HUAWEI Vision identifier based on the position of each smart TV relative to the first electronic device in the real space.

[0032] In a possible implementation, the relative position between the second electronic device and the first electronic device comprises a relative distance and / or a relative orientation between the second electronic device and the first electronic device in a horizontal direction.

[0033] In a possible implementation, the method further includes the first electronic device measuring the relative distance between the second electronic device and the first electronic device using a Wi-Fi based positioning technology or a Bluetooth® iBeacon® based positioning technology; or the first electronic device measuring the relative distance and / or the relative direction between the second electronic device and the first electronic device using a Bluetooth 5.1 based AOA positioning technology and a UWB based positioning technology.

[0034] In a possible implementation, the first interface further includes a third control corresponding to a third electronic device, the third electronic device being associated with the first electronic device.

[0035] It can be seen that the first interface includes controls that correspond to another electronic device associated with the first electronic device. In other words, the first interface may be used as a unified entry for triggering interaction functions between the first electronic device and associated devices of the first electronic device.

[0036] In a possible implementation, in the first interface, the third control and the second control are centered around the first control.

[0037] In one example, the first electronic device may not measure the distance between each associated device and the first electronic device. Instead, the distance between the device icon of each associated device and the device icon of the first electronic device is set to a default value, for example, 120 DP. Optionally, a length value, for example, 20 DP, may be randomly added or subtracted to the determined distance between the device icon of another associated device and the device icon of the first electronic device to create a sense of randomness and enhance the beauty of the device icon layout. Note that the distance between the device icon of each associated device and the device icon of the first electronic device may be set to the same value, i.e., there is one default value. Alternatively, the distance between the device icon of each associated device and the device icon of the first electronic device may be set to be different, i.e., there are multiple default values.

[0038] Then, based on the number M of associated devices, an included angle α between the connecting lines of the device icons of any two adjacent associated devices and the device icon of the first electronic device is determined, for example, α=360° / M. Optionally, an angle value, for example, 10°, may be randomly added or subtracted from the determined angle α to create a sense of randomness and enhance the beauty of the device icon layout.

[0039] Finally, the position of the device icon of another associated device is determined based on the included angle α and the default distance between the device icon of each associated device and the device icon of the first electronic device. For example, the first electronic device displays an interface 1201 shown in Fig. 12. It can be seen that the distance between the device icon of the associated device and the device icon of the first electronic device is approximately equal.

[0040] In a second aspect, a method for interaction between electronic devices is provided, the method includes: a first electronic device displays a first interface, where the first interface includes a first control corresponding to the first electronic device, a second control corresponding to a second electronic device, and a third control corresponding to a third electronic device, both the second electronic device and the third electronic device being associated with the first electronic device, a distance between the second control and the third control being a first distance; the first electronic device receives a first operation of a user on the second control; and in response to the first operation, the first electronic device controls the distance between the second control and the third control to change to a second distance, and the first electronic device determines that the second electronic device performs a first interaction function with the third electronic device, where the second distance is less than the first distance.

[0041] In other words, a user may trigger an interaction function between two other electronic devices that are not the first electronic device on the first interface of the first electronic device. In other words, the first interface of the first electronic device may be used as a unified entry for triggering an interaction function between related devices of the first electronic device. In this way, the problem of the prior art that the entries of the interaction functions of multiple different electronic devices are scattered and the interaction methods are different, which easily confuses users during use, is solved.

[0042] In a possible implementation, the first electronic device determining that the second electronic device performs a first interaction function with the third electronic device includes the first electronic device sending a first message to the second electronic device, where the first message instructs the second electronic device to report information about an application currently running on the third electronic device, or the first electronic device sending a second message to the third electronic device, where the second message instructs the second electronic device to report information about an application currently running on the third electronic device; the first electronic device receiving the information about the application currently running on the second electronic device, or the first electronic device receiving the information about the application currently running on the third electronic device; and the first electronic device determining to perform the first interaction function based on the information about the application currently running on the second electronic device and a device type of the third electronic device; or the first electronic device determining to perform the first interaction function based on the information about the application currently running on the third electronic device and a device type of the second electronic device.

[0043] In other words, a method is provided for a first electronic device to determine an interaction function to be performed between a second electronic device and a third electronic device.

[0044] In a possible implementation, before the first electronic device receives a user's first operation on the second control, the method further includes the first electronic device receiving information regarding an application currently running on the second electronic device, or the first electronic device receiving information regarding an application currently running on the third electronic device, and then the first electronic device determining that the second electronic device will perform a first interaction function with the third electronic device includes the first electronic device determining to perform the first interaction function based on the information regarding the application currently running on the second electronic device and a device type of the third electronic device; or the first electronic device determining to perform the first interaction function based on the information regarding the application currently running on the third electronic device and a device type of the second electronic device.

[0045] In other words, it provides another way for the first electronic device to determine the interaction function to be performed between the second electronic device and the third electronic device.

[0046] In a possible implementation, after the first electronic device determines that the second electronic device will perform a first interaction function with the third electronic device, the method further includes the first electronic device sending a third message to the second electronic device or the third electronic device to instruct them to perform the first interaction function.

[0047] In a possible implementation, the method further includes the first electronic device receiving a second operation of the user; in response to the second operation, the first electronic device controlling the second control to move away from the third control; and if the distance between the second control and the third control is greater than or equal to a first threshold, the first electronic device sending a fourth message to the second electronic device or the third electronic device instructing them to stop performing the first interaction function.

[0048] In a possible implementation, the first operation includes dragging the second control on the first interface and releasing the second control when the distance between the second control and the third control is less than a first threshold, the first threshold being less than the first distance and the first threshold being greater than or equal to the second distance. The dragging of the second control on the first interface includes dragging the second control towards the third control while touching the second control on the first interface.

[0049] In a possible implementation, after the distance between the second control and the third control has changed to the second distance, the method further includes the first electronic device receiving a second operation of the user on the second control; and in response to the second operation, the first electronic device controlling the distance between the second control and the third control to change to the first distance, and the first electronic device sending a fourth message to the second electronic device or the third electronic device instructing them to stop performing the first interaction function.

[0050] In a possible implementation, the second operation includes dragging the second control and releasing the second control when the distance between the second control and the third control is greater than a second threshold; or dragging the second control away from the third control while touching the second control and releasing the second control when the distance between the second control and the third control is greater than the second threshold, where the second threshold is less than or equal to the first distance and the second threshold is greater than the second distance.

[0051] In a third aspect, a method for interaction between electronic devices is provided, the method includes: a first electronic device displays a first interface, where the first interface includes a first control corresponding to the first electronic device, a second control corresponding to a second electronic device, and a third control corresponding to a third electronic device, both the second electronic device and the third electronic device being associated with the first electronic device, and a distance between the second control and the third control is a first distance; the first electronic device receives a first operation of a user on the second control; and in response to the first operation, the first electronic device controls the distance between the second control and the third control to change to a second distance, and the first electronic device sends a first message to the second electronic device or the third electronic device to trigger the second electronic device and the third electronic device to perform a first interaction function, where the second distance is less than the first distance.

[0052] In other words, a user may trigger an interaction function between two other electronic devices that are not the first electronic device on the first interface of the first electronic device, or in other words, the first interface of the first electronic device may be used as a unified entry for triggering an interaction function between related devices of the first electronic device.

[0053] Also, the first electronic device does not determine the interaction function performed between the second electronic device and the third electronic device, but the second electronic device or the third electronic device determines the interaction function performed between the two electronic devices.

[0054] In a possible implementation, the first operation includes dragging the second control on the first interface and releasing the second control when the distance between the second control and the third control is less than a first threshold, the first threshold being less than the first distance and the first threshold being greater than or equal to the second distance. The dragging of the second control on the first interface includes dragging the second control towards the third control while touching the second control on the first interface.

[0055] In a possible implementation, the method further includes the first electronic device receiving a second operation on the second control; and, in response to the second operation, the first electronic device controlling the first electronic device to change the distance between the second control and the third control to the first distance, and the first electronic device sending a second message to the second electronic device or the third electronic device instructing them to stop performing the first interaction function.

[0056] In a possible implementation, the second operation includes dragging the second control and releasing the second control when the distance between the second control and the third control is greater than a second threshold; or dragging the second control away from the third control while touching the second control and releasing the second control when the distance between the second control and the third control is greater than the second threshold, where the second threshold is less than or equal to the first distance and the second threshold is greater than the second distance.

[0057] In a fourth aspect, a method for interaction between electronic devices is provided, the method being applied to a first electronic device, the method including the steps of: displaying an interface of a running first application; receiving a first operation of a user; in response to the first operation, displaying an interface of a control center, the interface of the control center including a first widget; receiving a second operation on the first widget; in response to the second operation, displaying a first interface, the first interface including a first control corresponding to the first electronic device and a second control corresponding to a second electronic device, the second electronic device being associated with the first electronic device, a distance between the first control and the second control being a first distance; receiving a third operation on the second control on the first interface; and in response to the third operation, determining to control the second control to be attracted to the first control and to perform a first interaction function with the second electronic device.

[0058] The control center provides a unified entry for triggering interaction functions among related devices, and it is understood that the triggered user interaction manner is unified.

[0059] In a possible implementation, associating the second electronic device with the first electronic device includes: the second electronic device and the first electronic device being located in the same communications network; or the second electronic device and the first electronic device being logged into the same account; or the login account of the second electronic device and the login account of the first electronic device belonging to the same group.

[0060] In a possible implementation, the step of determining to perform a first interaction function with the second electronic device includes determining the first interaction function to perform with the second electronic device based on a type of the second electronic device; or determining the first interaction function to perform with the second electronic device based on the first application and a type of the second electronic device.

[0061] In a possible implementation, the first interaction function is one of an audio projection function, a screen projection function, an application handoff function, or a content sharing function.

[0062] The audio projection function is the first electronic device sending audio data of a first audio to the second electronic device so that the second electronic device plays the first audio; the screen projection function is the first electronic device sending interface data of the first interface to the second electronic device so that the second electronic device displays the first interface, the interface data of the first interface including a screenshot of the first interface or instructions for drawing the first interface, and if the first interface is a video image, the interface data of the first interface further including a playback address of the video image; the application handoff function is the first electronic device sending information about a second application running on the first electronic device to the second electronic device so that the second electronic device continues running the second application; and the content sharing function is the first electronic device sending a first object to the second electronic device, the first object including any one or more of a picture, a video, a file, text, and audio.

[0063] In a possible implementation, the third operation includes dragging the second control on the first interface and releasing the second control when the distance between the second control and the first control is less than a first threshold, the first threshold being less than the first distance.

[0064] In a possible implementation, after the second control is attracted to the first control, the method further includes the first electronic device receiving a fourth operation on the second control; and in response to the fourth operation, the first electronic device controls the first electronic device to change a distance between the second control and the third control to the first distance and stops performing the first interaction function with the second electronic device.

[0065] In a possible implementation, the fourth operation includes dragging the second control and releasing the second control when a distance between the second control and the first control is greater than a second threshold; and dragging the second control away from the first control while touching the second control and releasing the second control when the distance between the second control and the third control is greater than the second threshold, the second threshold being less than or equal to the first distance.

[0066] In a fifth aspect, there is provided an electronic device including a processor, a memory, and a touch screen, the memory and the touch screen being coupled to the processor, the memory being configured to store computer program code, the computer program code including computer instructions, and when the processor reads the computer instructions from the memory, the electronic device performs a method according to any one of the above aspects and possible implementations of the above aspects.

[0067] In a sixth aspect, an apparatus is provided, the apparatus being included in a first electronic device, the apparatus having functionality to implement the behavior of the electronic device in any manner in the above aspects and possible implementations. The functionality may be implemented by hardware or by hardware executing corresponding software. The hardware or software includes at least one module or unit corresponding to the above functionality, such as a receiving module or unit, a display module or unit, and a processing module or unit.

[0068] In a seventh aspect, there is provided a computer-readable storage medium comprising computer instructions which, when executed on a terminal, cause the terminal to perform a method according to any one of the above aspects and possible implementations of the above aspects.

[0069] In an eighth aspect, there is provided a computer program product, which when executed on a computer causes the computer to perform a method according to any one of the above aspects and possible implementations of the above aspects.

[0070] In a ninth aspect, there is provided a chip system including a processor, the processor executing instructions causing the processor to perform a method according to any one of the above aspects and possible implementations of the above aspects.

[0071] It is understood that the beneficial effects that can be achieved by the electronic device, the apparatus, the computer-readable storage medium, the computer program product, and the chip system provided in the fifth to ninth aspects should be referred to the beneficial effects in the first to fourth aspects and any one of the possible implementations of the first to fourth aspects, and will not be described in detail again here. [Brief description of the drawings]

[0072] [Figure 1] FIG. 1 is a schematic diagram of a system structure of an application scenario according to an embodiment of the present application;

[0073] [Figure 2 (1)] 1 is a schematic diagram of some user interfaces of an electronic device according to an embodiment of the present application; [Figure 2 (2)] 1 is a schematic diagram of some user interfaces of an electronic device according to an embodiment of the present application;

[0074] [Diagram 3] FIG. 2 is a schematic diagram of another user interface of an electronic device according to an embodiment of the present application;

[0075] [Figure 4(1)] 1 is a schematic diagram of some further user interfaces of an electronic device according to an embodiment of the present application; [Figure 4 (2)] 1 is a schematic diagram of some further user interfaces of an electronic device according to an embodiment of the present application; [Figure 4 (3)] 1 is a schematic diagram of some further user interfaces of an electronic device according to an embodiment of the present application;

[0076] [Figure 5(1)] 1 is a schematic diagram of some further user interfaces of an electronic device according to an embodiment of the present application; [Figure 5 (2)] 1 is a schematic diagram of some further user interfaces of an electronic device according to an embodiment of the present application;

[0077] [Figure 6(1)] 1 is a schematic diagram of some further user interfaces of an electronic device according to an embodiment of the present application; [Figure 6 (2)] 1 is a schematic diagram of some further user interfaces of an electronic device according to an embodiment of the present application; [Figure 6 (3)] 1 is a schematic diagram of some further user interfaces of an electronic device according to an embodiment of the present application;

[0078] [Figure 7]FIG. 2 is a schematic diagram of another user interface of an electronic device according to an embodiment of the present application;

[0079] [Figure 8(1)] 1 is a schematic diagram of some further user interfaces of an electronic device according to an embodiment of the present application; [Figure 8 (2)] 1 is a schematic diagram of some further user interfaces of an electronic device according to an embodiment of the present application;

[0080] [Figure 9] FIG. 1 is a schematic diagram of a structure of an electronic device according to an embodiment of the present application;

[0081] [Figure 10(1)] 1 is a schematic diagram of some further user interfaces of an electronic device according to an embodiment of the present application; [Figure 10(2)] 1 is a schematic diagram of some further user interfaces of an electronic device according to an embodiment of the present application;

[0082] [Figure 11] 1 is a schematic diagram of some further user interfaces of an electronic device according to an embodiment of the present application;

[0083] [Figure 12] 1 is a schematic diagram of some further user interfaces of an electronic device according to an embodiment of the present application;

[0084] [Figure 13(1)] 1 is a schematic diagram of some further user interfaces of an electronic device according to an embodiment of the present application; [Figure 13(2)] 1 is a schematic diagram of some further user interfaces of an electronic device according to an embodiment of the present application;

[0085] [Figure 14(1)] 1 is a schematic diagram of some further user interfaces of an electronic device according to an embodiment of the present application; [Figure 14(2)] 1 is a schematic diagram of some further user interfaces of an electronic device according to an embodiment of the present application; [Figure 14(3)] 1 is a schematic diagram of some further user interfaces of an electronic device according to an embodiment of the present application;

[0086] [Figure 15(1)] 1 is a schematic diagram of some further user interfaces of an electronic device according to an embodiment of the present application; [Figure 15(2)] 1 is a schematic diagram of some further user interfaces of an electronic device according to an embodiment of the present application;

[0087] [Figure 16(1)] 1 is a schematic diagram of some further user interfaces of an electronic device according to an embodiment of the present application; [Figure 16(2)] 1 is a schematic diagram of some further user interfaces of an electronic device according to an embodiment of the present application;

[0088] [Figure 17] 1 is a schematic diagram of some further user interfaces of an electronic device according to an embodiment of the present application;

[0089] [Figure 18(1)] 1 is a schematic diagram of some further user interfaces of an electronic device according to an embodiment of the present application; [Figure 18(2)] 1 is a schematic diagram of some further user interfaces of an electronic device according to an embodiment of the present application;

[0090] [Figure 19] 1 is a schematic flow chart of some interaction functions triggered between electronic devices according to an embodiment of the present application;

[0091] [Figure 20(1)] 1 is a schematic diagram of some further user interfaces of an electronic device according to an embodiment of the present application; [Figure 20(2)] 1 is a schematic diagram of some further user interfaces of an electronic device according to an embodiment of the present application; [Figure 20(3)] 1 is a schematic diagram of some further user interfaces of an electronic device according to an embodiment of the present application;

[0092] [Figure 21(1)] 1 is a schematic diagram of some further user interfaces of an electronic device according to an embodiment of the present application; [Figure 21(2)] 1 is a schematic diagram of some further user interfaces of an electronic device according to an embodiment of the present application; and

[0093] [Figure 22] FIG. 1 is a schematic diagram of the structure of an apparatus according to an embodiment of the present application. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0094] In the description of the embodiments of the present application, unless otherwise specified, " / " means "or". For example, A / B may represent A or B. In this specification, "and / or" describes only the relationship of association between related objects and represents that three relationships may exist. For example, A and / or B may represent three cases: when only A exists, when both A and B exist, and when only B exists.

[0095] Additionally, words like "by way of example" or "for example" are used to denote giving an example, instance, or illustration. Any embodiment or design scheme described in the embodiments of this application as "an example" or "for example" should not be described as being preferred or having more advantages over another embodiment or design scheme. Indeed, the use of words like "an example" or "for example" is intended to present relative concepts in a concrete manner.

[0096] The method for interaction between electronic devices provided in an embodiment of the present application can be applied to a network system 100 shown in FIG. 1. FIG. 1 is a schematic diagram of the architecture of the network system 100. The network system 100 includes at least two electronic devices, and the at least two electronic devices are associated electronic devices. For example, the at least two electronic devices may be electronic devices located in the same wireless fidelity (Wi-Fi) network, or electronic devices logged into the same account (e.g., Huawei account) or electronic devices logged into accounts belonging to the same group (e.g., belonging to the same home account). Alternatively, the at least two electronic devices may be electronic devices that establish a trust relationship in another manner, for example, electronic devices that connect to a shared hotspot with each other or establish a Wi-Fi Direct connection. Specifically, the electronic device of the present application may be a mobile phone, a tablet computer, a personal computer (PC), a personal digital assistant (PDA), a smart watch, a netbook, a wearable electronic device, an augmented reality (AR) device, a virtual reality (VR) device, an in-vehicle device, a smart television (also called a smart screen or a large screen), a smart audio device, or the like. The present application does not particularly limit the specific form of the electronic device.

[0097] For example, here, an example is used in which a network system 100 includes a mobile phone 101, a smart TV 102, a smart sound box 103, a PC 104, and a smart TV 105 having an association relationship to describe a method for interaction between electronic devices provided in one embodiment of the present application.

[0098] When performing an interaction between electronic devices, a user needs to select an electronic device to interact with on an electronic device (e.g., mobile phone 101). In one technical solution, the mobile phone 101 enables a wireless communication function, searches for other electronic devices in the vicinity, and displays a list of found electronic devices. Then, the user needs to select an electronic device (e.g., smart TV 102, smart sound box 103, PC 104, and smart TV 105) that needs to be interacted with from the list. Note that in the list displayed on the mobile phone 101, the type and / or model of each found electronic device is usually used as the name of the electronic device, for example, HUAWEI Vision, HUAWEI SoundX, or HUAWEI MateBook. If there are two or more electronic devices with the same name among the found electronic devices, the user cannot distinguish between the two or more electronic devices with the same name and cannot determine which electronic device to select. For example, after the mobile phone 101 finds the smart TV 102 and the smart TV 105, two identifiers named HUAWEI Vision are displayed in the list. However, a user cannot distinguish which smart TV corresponds to each HUAWEI Vision identifier, and cannot determine which smart TV to select.

[0099] In consideration of this, an embodiment of the present application provides a technical solution. When the mobile phone 101 searches for another electronic device in the surroundings using a wireless communication function, it measures a relative position between the mobile phone 101 and the found another electronic device in the real space. The relative position between the other electronic device and the mobile phone 101 includes a relative distance and / or a relative direction between the other electronic device and the mobile phone 101. Then, the mobile phone 101 displays an interface of a device layout based on the relative position between the other electronic device and the mobile phone 101 in the real space, and the interface is indicated as interface A. For example, the interface A includes identifiers of the mobile phone 101 and the other electronic device found by the mobile phone 101. In addition, the relative positional relationship between the identifier of the mobile phone 101 and the identifier of the other electronic device also represents the positional relationship between the mobile phone 101 and the other electronic device in the real space. In other words, the interface A more clearly displays the relative position between the mobile phone 101 and the other electronic device in the real space.

[0100] It is easy to see that the relative positions of electronic devices in real space can help the user to distinguish between these electronic devices. In other words, when the mobile phone 101 finds two or more electronic devices with the same name, the user may distinguish between the electronic devices with the same name based on different relative positions between the mobile phone 101 and these electronic devices, so that the user selects one of these electronic devices to interact with the mobile phone 101. For example, when the mobile phone 101 finds two smart TVs named HUAWEI Vision, the interface A displayed on the mobile phone 101 further displays the positions of the two HUAWEI Vision identifiers relative to the identifier of the mobile phone 101. In this case, the user may determine the smart TV corresponding to each HUAWEI Vision identifier based on the position of each smart TV relative to the mobile phone 101 in real space.

[0101] In a particular embodiment, a user may enter interface A using a control center of mobile phone 101. For example, FIG. 2(1) is a schematic diagram of a home screen (or called a home screen interface or desktop) displayed by mobile phone 101. In response to detecting that a user has performed operation 1 on the home screen of mobile phone 101, mobile phone 101 displays the control center interface shown in FIG. 2(2). Operation 1 is an operation of entering the control center of mobile phone 101, and may be, for example, an operation of a user sliding up from the bottom of the screen (i.e., the bottom of the home screen) or an operation of a user sliding down from the top of the screen (i.e., the top of the home screen). Operation 1 may further include a series of operations. For example, operation 1 includes an operation of a user tapping a "Settings" application icon on the home screen and selecting a control corresponding to the control center on the interface of the "Settings" application.

[0102] As shown in FIG. 2(2), the interface of the control center of the mobile phone 101 includes a control 203 used to enter interface A (also called a widget 203 or a module 203). Furthermore, in response to detecting that the user has operated the control 203, the mobile phone 101 starts broadcasting an inquiry message through a wireless communication function to search for surrounding electronic devices associated with the mobile phone 101, i.e., associated devices of the mobile phone 101. The associated devices of the mobile phone 101 may be electronic devices located in the same communication network as the mobile phone 101, for example, electronic devices located in the same wireless fidelity (Wi-Fi) network. Alternatively, the associated devices of the mobile phone 101 may be electronic devices that log in to the same account (for example, a Huawei account) as the mobile phone 101 or electronic devices that log in to an account that belongs to the same group (for example, belongs to the same family account) as the mobile phone 101. The associated devices of the mobile phone 101 may alternatively be electronic devices that establish a trust relationship with the mobile phone 101 in another manner, for example, electronic devices that connect to a hotspot shared by the mobile phone 101. Alternatively, the mobile phone 101 is connected to a hotspot shared by the electronic device, or the mobile phone 101 and the electronic device establish a Wi-Fi Direct connection. In other words, the embodiment of the present application does not limit the specific manner of associating another electronic device with the mobile phone 101. It should be noted that in the accompanying drawings of the present application, a "super device" is used to collectively refer to the mobile phone 101 and the associated devices having the above-mentioned associated relationship with the mobile phone 101. In other words, the TV, sound box, PC, and the like displayed in the control 203 are the associated devices of the mobile phone 101. In other words, the "super device" is used to represent a set of electronic devices having the above-mentioned associated relationship. It is understood that the "super device" may alternatively be expressed as another term, and is not a specific limitation on the electronic device in the embodiment of the present application.

[0103] The wireless communication capabilities include, but are not limited to, wireless communication capabilities implemented using technologies such as wireless local area network (WLAN) (e.g., Wi-Fi), Radio Frequency Identification (RFID), infrared, Bluetooth, ZigBee, and Ultra Wide Band (UWB).

[0104] It can be seen that most wireless communication functions have certain positioning capabilities, such as Wi-Fi-based positioning capabilities, Bluetooth iBeacon-based positioning capabilities, Bluetooth 5.1-based Angle of Arrival (AOA) positioning capabilities, and UWB-based positioning capabilities. Based on the Wi-Fi-based positioning capabilities and Bluetooth iBeacon-based positioning capabilities, the distance between the mobile phone 101 and another electronic device can be measured. Based on the Bluetooth 5.1-based AOA positioning capabilities and UWB-based positioning capabilities, the distance between the mobile phone 101 and another electronic device and the direction of the other electronic device relative to the mobile phone 101 can be measured.

[0105] The mobile phone 101 further finds the associated devices of the mobile phone 101 (e.g., smart TV 102, smart sound box 103, PC 104, and smart TV 105), and then uses the positioning capability of the wireless communication function to measure the relative positions of the associated devices to the mobile phone 101 in the real space. After obtaining the relative positions between the associated devices and the mobile phone 101 in the real space, the mobile phone 101 may display an interface 301 shown in FIG. 3, i.e., interface A. The interface 301 includes device icons (and device names) used to represent each electronic device, for example, specifically including a device icon corresponding to the mobile phone 101 and a device icon of another electronic device associated with the mobile phone 101. Also, the layout of each device icon is consistent with the layout of the electronic device corresponding to each device icon in the real space. In other words, the relative positions between the device icons in the interface 301 are consistent with the relative positional relationship of the electronic device corresponding to the device icon in the horizontal space.

[0106] Please refer to FIG. 3. In the interface 301, if the device type of the device associated with the mobile phone 101 is unique, the electronic device corresponding to the device icon may be distinguished based on the device type indicated by the device icon. For example, the device icon 310 corresponds to the mobile phone 101, the device icon 330 corresponds to the smart speaker 103, and the device icon 340 corresponds to the PC 104. If the device type of the device associated with the mobile phone 101 is not unique, the electronic device corresponding to the device icon needs to be further determined based on the relative position between the device icons. For example, the interface 301 may determine that the device icon 320 and the device icon 350 correspond to two smart TVs, but cannot determine the specific correspondence between the two device icons and the two smart TVs. Furthermore, the interface 301 further indicates the distance between the device icon 320 and the device icon 310 of the mobile phone 101, and the distance is smaller than the distance between the device icon 350 and the device icon 310 of the mobile phone 101. This means that in the horizontal space, the distance between the smart TV and the mobile phone 101 corresponding to the device icon 320 is smaller than the distance between the smart TV and the mobile phone 101 corresponding to the device icon 350. If the distance between the smart TV 102 and the mobile phone 101 is smaller than the distance between the smart TV 105 and the mobile phone 101 in the horizontal space, then the device icon 320 corresponds to the smart TV 102 and the device icon 350 corresponds to the smart TV 105.

[0107] From the above, it can be seen that interface A displayed on mobile phone 101 not only indicates the devices associated with and located by mobile phone 101, but also indicates the relative positions of the electronic devices, so that the user can distinguish between these electronic devices by more visually grasping the position of each electronic device, and the user can more comfortably and accurately select the electronic device that needs to be operated.

[0108] Of course, in addition to entering interface A from the control center interface of the mobile phone 101, interface A may also be entered from another interface of the mobile phone 101. For example, the above-mentioned interface A may be entered from the leftmost screen of the mobile phone 101, a pull-down notification bar, or the like. Alternatively, interface A may be entered from a corresponding interface of an application (e.g., a smart home application) in the mobile phone 101. In other words, the embodiment of the present application does not limit the specific manner of entering interface A.

[0109] Furthermore, interface A may be used as an entry for interactions between electronic devices. In other words, a user may directly perform an operation on interface A to trigger an interaction between any two or more electronic devices on interface A.

[0110] For example, as shown in FIG. 4(1), the mobile phone 101 displays an interface 401. The interface 401 displays device icons corresponding to the mobile phone 101, the smart TV 102, the smart sound box 103, the PC 104, and the smart TV 105. Optionally, the layout of the device icons corresponding to each electronic device may match the layout of each electronic device in the horizontal space. When the user wants to trigger an interaction between the mobile phone 101 and the smart sound box 103, the user may touch the device icon of the sound box (corresponding to the smart sound box 103) and drag the device icon of the sound box to the device icon of the mobile phone (corresponding to the mobile phone 101). In some embodiments, the position of the device icon of the sound box may change with the movement of the user's finger on the screen. In some examples of this embodiment, before the user drags the device icon of the sound box, the distance between the device icon of the sound box and the device icon of the mobile phone is a distance L1; when the user drags the device icon of the sound box to move, and the distance between the two device icons is less than a threshold R1, the user's finger releases the device icon of the sound box (i.e., the finger leaves the screen of the mobile phone 101), and then the distance between the device icon of the sound box and the device icon of the mobile phone is a distance L2. The distance L2 is less than the distance L1, the distance L2 is less than or equal to the threshold R1, and the threshold R1 is less than the distance L1. Optionally, after the user drags the device icon of the sound box close to the device icon of the mobile phone and then releases the device icon, the device icon of the sound box and the device icon of the mobile phone may be automatically stuck together, i.e., the mobile phone 101 displays the interface 402 shown in FIG. 4(2). By two device icons are attached, it is meant that the two device icons may completely or partially overlap, or the two device icons may even touch each other.In some other examples of this embodiment, when a user drags and moves the soundbox device icon, if the distance between the two device icons is less than a threshold R1, the user's finger does not release the soundbox device icon (i.e., the finger does not leave the screen of the mobile phone 101), but remains in a certain position for a preset time, and the distance between the soundbox device icon and the mobile phone device icon may change to a distance L2, for example, the soundbox device icon and the mobile phone device icon may be stuck together, in other words, the mobile phone 101 displays the interface 402 shown in FIG. 4(2).

[0111] In some examples, the distance between two device icons in the present application may be the distance between the centers of the two device icons. For example, the center of the sound box device icon is point O, the center of the mobile phone device icon is point P, and the distance between the sound box device icon and the mobile phone device icon is the distance between point O and point P. For example, the distance between point O and point P shown in FIG. 4(1) is distance L1. As another example, the distance between point O and point P shown in FIG. 4(2) is distance L2. As another example, the distance between point O and point Q shown in FIG. 14(1) is distance L1, and the distance between point O and point Q shown in FIG. 14(3) is distance L2. In some other examples, the distance between two device icons in the present application may alternatively be the shortest distance between the edges of the two device icons. For example, the outer shapes of the mobile phone device icon and the PC device icon are round. The center of the mobile phone device icon is point O, and the center of the PC device icon is point Q. A line segment OQ intersects with an edge of the mobile phone device icon at point M and intersects with an edge of the PC device icon at point N. The distance between points M and N is the distance between the mobile phone device icon and the PC device icon. For example, the distance between points M and N shown in FIG. 14(1) is distance L1. As another example, the distance between points M and N is distance L2 as shown in FIG. 14(3). Optionally, L2 may be zero or close to zero, i.e., the mobile phone device icon and the PC device icon are attracted to each other.

[0112] It should be further noted that in this embodiment, the finger motion trace obtained when the user drags the sound box device icon is not limited, that is, the motion trace of the sound box device icon dragged by the user may be any curve. When the user's finger releases the sound box device icon or the user's finger stays at a certain position for a preset time, the mobile phone 101 calculates the distance between the position where the user's finger releases the sound box device icon or the position where the user's finger stays and the mobile phone device icon. If the distance is smaller than the threshold R1, the distance between the sound box device icon and the mobile phone device icon is controlled to change to a distance L2, for example, the sound box device icon and the mobile phone device icon are attracted to each other.

[0113] In some other embodiments, when a user drags the device icon of the sound box while touching the device icon of the sound box, the device icon of the sound box may not change with the movement of the user's finger. Specifically, when a user slides the device icon of the sound box on the screen for a certain distance while touching the device icon of the sound box and then leaves the screen or stays at a certain position on the screen for a preset time, the mobile phone 101 determines the distance between the position where the user's finger leaves the screen or the position where the user's finger stays and the device icon of the mobile phone. If the distance is smaller than a threshold value R1, the distance between the device icon of the sound box and the device icon of the mobile phone is controlled to change to a distance L2, for example, the device icon of the sound box and the device icon of the mobile phone are attracted to each other. Note that, in the process of the user's finger moving on the screen, the position of the device icon of the sound box does not change with the movement of the finger.

[0114] In the following embodiment, the method of dragging a device icon to approach another device icon may be any one of the above three methods, which will be described here as an integrated method and will not be described below.

[0115] It should be further noted that interface 401 and interface 402 here may be considered as two different interfaces, and interface 402 and interface 401 may alternatively be considered as the same interface, i.e., interface 402 is the interface obtained after the positions of some device icons on interface 401 are changed.

[0116] When the device icon of the sound box and the device icon of the mobile phone are attracted to each other, the mobile phone 101 may further determine an interaction function to be performed between the mobile phone 101 and the smart sound box 103 based on the current scenario of the mobile phone 101 and the device characteristics of the smart sound box 103. For example, the audio being played on the mobile phone 101 may be switched to be played on the smart sound box 103. Optionally, the interface 402 displayed by the mobile phone 101 may display corresponding prompt information 404 to prompt the user to perform the interaction function between the mobile phone 101 and the smart sound box 103.

[0117] Of course, in some other examples, in the interface 403 shown in FIG. 4(3), the user may drag the device icon of the mobile phone toward the device icon of the sound box while touching the device icon of the mobile phone. When the device icon of the sound box and the device icon of the mobile phone are dragged so that the distance between the two device icons is smaller than the threshold R1, the device icon of the sound box and the device icon of the mobile phone are attracted to each other, that is, the mobile phone 101 displays the interface 402 shown in FIG. 4(2). Similarly, the mobile phone 101 may determine an interaction function to be executed between the mobile phone 101 and the smart sound box 103 based on the current scenario of the mobile phone 101 and the device characteristics of the smart sound box 103. For example, the audio being played on the mobile phone 101 may be switched to be played on the smart sound box 103. Alternatively, the mobile phone 101 transmits the user's operation to the smart sound box 103, and the smart sound box 103 determines an interaction function to be executed between the smart sound box 103 and the mobile phone 101 based on the current scenario of the smart sound box 103 and the device characteristics of the mobile phone 101. For example, audio playing on the smart sound box 103 may be switched to play on the mobile phone 101 .

[0118] It should be further noted that the interface 403 and the interface 402 here may be regarded as two different interfaces, and the interface 403 and the interface 402 may alternatively be regarded as the same interface, i.e., the interface 402 is the interface after the position of some device icons on the interface 403 is changed. Similarly, in the following embodiments, when the interface is changed by the user dragging the device icons, the interfaces before and after the interface is changed may be regarded as two different interfaces or as the same interface, which will not be described one by one below.

[0119] After the user triggers the mobile phone 101 and the smart sound box 103 to execute the interaction function in the above manner, the user may further trigger more electronic devices to execute the interaction function with the mobile phone 101. As another example, in the interface 501 shown in FIG. 5(1), the device icon of the mobile phone and the device icon of the sound box are attracted to each other, which indicates that the mobile phone 101 is instructed to execute the interaction function with the smart sound box 103. Then, another electronic device may be further added to the interaction between the mobile phone 101 and the smart sound box 103 in the above-mentioned drag manner. For example, hold down the device icon of the TV (corresponding to the smart TV 102) and drag it to the device icon of the mobile phone. If the distance between the two device icons is smaller than the threshold R1, the device icon of the TV and the device icon of the mobile phone are attracted to each other, that is, the mobile phone 101 displays the interface 502 shown in FIG. 5(2). In this case, the mobile phone 101 may determine an interaction function to be performed among the mobile phone 101, the smart sound box 103, and the smart TV 102 based on the current scenario of the mobile phone 101 and the smart sound box 103 and the device features of the smart TV 102. For example, the content on the screen of the mobile phone 101 may be projected to the smart TV 102 for display, and the smart sound box 103 continues to play audio. Optionally, the interface 502 displayed by the mobile phone 101 may display corresponding prompt information 503 to prompt the user to select an interaction function to be performed among the mobile phone 101, the smart sound box 103, and the smart TV 102.

[0120] In the above example, it is first detected that the user drags the device icon of the sound box. The mobile phone 101 first determines the interaction function to be performed between the smart sound box 102 and the mobile phone 101 based on the current scenario of the mobile phone 101 and the device type of the smart sound box 103. Then, it is detected that the user drags the device icon of the television, and the mobile phone 101 determines the interaction function to be performed between the three electronic devices based on the current scenario of the mobile phone 101 and the smart sound box 103 and the device characteristics of the smart television 102. In some other examples, if it is detected that the user drags the device icon of the sound box and the device icon of the television at the same time, the mobile phone 101 may directly determine the interaction function to be performed by the three electronic devices based on the current scenario of the mobile phone 101 and the device characteristics of the smart sound box 103 and the smart television 102. Alternatively, it is first detected that the user drags the device icon of the sound box, and then detected that the user drags the device icon of the TV, and the time difference between the two drags is less than a time threshold T (e.g., 1 second), but the mobile phone 101 may still directly determine the interaction functions that the three electronic devices should perform based on the current scenario of the mobile phone 101 and the device features of the smart sound box 103 and the smart TV 102.

[0121] Furthermore, the user may further cancel (or disable) the interaction function between the electronic devices. For example, in the interface 601 shown in FIG. 6(1), the device icon of the sound box, the device icon of the mobile phone, and the device icon of the television are attracted to each other, indicating that the mobile phone 101, the smart sound box 103, and the smart television 102 are performing the interaction function. In this case, if the user wants to cancel (or disable) the interaction function between the smart television 102 and the mobile phone 101 (and the smart sound box 103), the user may drag the device icon of the television away from the device icon of the mobile phone while touching the device icon of the television. In some embodiments, the position of the device icon of the television changes with the movement of the user's finger on the screen. In some examples of this embodiment, the user may drag the device icon of the television to move it. If the distance between the two device icons is greater than a threshold R2 (which may be the same as or different from the threshold R1), the user's finger releases the TV device icon (i.e., the finger leaves the screen of the mobile phone 101), and the distance between the two device icons changes to a distance L1. For example, the TV device icon returns to the position before the adsorption, as shown in the interface 602 of FIG. 6(2). In this case, the smart TV 102 terminates the interaction function with the mobile phone 101 (and the smart sound box 103). In some other examples of this embodiment, when the user drags the TV device icon (i.e., the finger leaves the screen of the mobile phone 101) and moves it, if the distance between the two device icons is greater than the threshold R2, the user's finger does not release the TV device icon (i.e., the finger does not leave the screen of the mobile phone 101), but stays at a certain position for a preset time, and the distance between the two device icons changes to a distance L1. For example, the TV device icon returns to the position before the adsorption, as shown in the interface 602 of FIG. 6(2). The threshold R2 is greater than the distance L2, and the threshold R2 is less than or equal to the distance L1.

[0122] In this embodiment, the finger motion tracking acquired when the user drags the TV device icon is not limited, that is, the motion tracking of the TV device icon dragged by the user may be any curve. When the user's finger releases the TV device icon or the user's finger stays at a certain position for a preset time, the mobile phone 101 calculates the distance between the position where the user's finger releases the TV device icon or the position where the user's finger stays and the mobile phone device icon. If the distance is greater than the threshold R2, the distance between the two device icons changes to a distance L1, and for example, the TV device icon returns to the position before adsorption.

[0123] In some other embodiments, when a user drags the TV device icon while touching the TV device icon, the TV device icon may not change with the movement of the user's finger. Specifically, when a user slides the TV device icon on the screen for a certain distance while touching the TV device icon and then leaves the screen or remains at a certain position on the screen for a preset time, the mobile phone 101 determines the distance between the position where the user's finger leaves the screen or the position where the user's finger remains and the mobile phone device icon. If the distance is greater than a threshold R2, the distance between the two device icons changes to a distance L1, and for example, the TV device icon returns to the position before adsorption. Note that the position of the TV device icon does not change with the movement of the finger during the process of the user's finger moving on the screen.

[0124] In the following embodiments, the method of dragging a device icon away from another device icon may be any one of the three methods described above, which will be described collectively here and will not be described below.

[0125] Furthermore, in the interface 602 shown in Fig. 6(2), the user may drag the device icon of the sound box away from the device icon of the mobile phone while touching the device icon of the sound box. When the drag distance is greater than a threshold R1 (or another threshold) and the hand is released, the device icon of the sound box returns to the position before the attachment, for example, as shown in the interface 603 shown in Fig. 6(3). In this case, the smart sound box 103 ends the interaction function with the mobile phone 101.

[0126] It should be noted that when a user triggers an interaction between two or more electronic devices on the interface A, the two or more electronic devices have the ability or state to execute the interaction function, and the immediate execution of the interaction function between the two or more electronic devices is not limited. For example, when a user triggers an audio projection function between the mobile phone 101 and the smart sound box 103 by dragging a device icon, in this case, if the mobile phone 101 does not have an audio playback task or the audio playback task of the mobile phone 101 is paused, the mobile phone 101 does not immediately send audio data to the smart sound box 103. However, if the mobile phone 101 has an audio playback task, the mobile phone 101 sends the audio data to be played to the smart sound box 103, and the smart sound box 103 plays the audio data to be played.

[0127] In some other examples, the user may cancel (or disable) the interaction function between the electronic devices by operating a control. As another example, in the interface 701 shown in FIG. 7, the device icon of the sound box, the device icon of the mobile phone, and the device icon of the television are attracted to each other, indicating that the mobile phone 101, the smart sound box 103, and the smart television 102 are performing the interaction function. The user may operate the control 702 in the operation interface 701 to cancel the previous operation. For example, the previous operation is an operation of dragging the device icon of the television and moving it closer to the device icon of the mobile phone. When the mobile phone 101 detects that the user has operated the control 702, the mobile phone returns the device icon of the television to the position before the attraction, as shown in the interface 602 shown in FIG. 6(2). Of course, the interface 701 may include a control for canceling all operations. In other words, after the mobile phone 101 detects that the user has operated the control to cancel all operations, the mobile phone 101 may display the interface just as when interface A was entered, i.e., no interaction functions between any electronic devices are triggered. In other words, the mobile phone 101 disables the interaction functions between all electronic devices.

[0128] It should be noted that all of the above examples relate to a method of triggering an interaction function between another electronic device and the mobile phone 101 on the interface A displayed on the mobile phone 101. In some other examples, an interaction function between electronic devices other than the mobile phone 101 may be triggered on the display interface A of the mobile phone 101. For example, in the interface 801 shown in FIG. 8(1), the device icon of the PC and the device icon of the TV are attracted to each other (as shown in the interface 802 in FIG. 8(2)) in response to detecting that the user has dragged the device icon of the PC toward the device icon of the TV and that the distance between the device icon of the PC and the device icon of the TV is less than a threshold R3. In this case, the mobile phone 101 transmits an instruction of the interaction function to the PC 104 or the smart TV 102, and the PC 104 and the smart TV 102 execute the corresponding interaction function.

[0129] From the above, it can be seen that the interface A provided by the mobile phone 101 may be used as a unified entry for interaction between multiple electronic devices, and a user may trigger an interaction function between any two or more electronic devices on the interface A. Also, the mobile phone 101 may intelligently determine a specific interaction function between electronic devices based on the application scenario in which the mobile phone 101 is located and the device types of the mobile phone 101 and the electronic devices that perform the interaction function (different device types have different device features, for example, have a large screen and have powerful audio input / output capabilities). The interaction function may be projection, application handoff, audio projection, content sharing, or the like. In this way, the problem of scattered entries of interaction functions between electronic devices and different interaction methods is solved.

[0130] The mobile phone 101 is used as an example of the above-mentioned electronic device. Figure 9 is a schematic diagram of the structure of the mobile phone 101. It is understood that for other electronic devices such as a smart TV 102, a smart sound box 103, a PC 104, and a smart TV 105, the schematic diagram of the structure of the mobile phone 101 should be referred to. Of course, other electronic devices may include more or less components than the mobile phone 101, combine some components, divide some components, or have different component configurations. The embodiment of the present application is not limited thereto.

[0131] Please refer to Figure 9. The mobile phone 101 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headset jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display 194, a subscriber identification module (SIM) card interface 195, and the like. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, an optical proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.

[0132] It will be appreciated that the structure shown in this embodiment of the present application is not a particular limitation on the mobile phone 101. In other embodiments of the present application, the mobile phone 101 may include more or fewer components than those shown in the figures, some components may be combined, some components may be split, or different component configurations may be used. The components shown in the figures may be implemented in hardware, software, or a combination of software and hardware.

[0133] Processor 110 may include one or more processing units. For example, processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, a neural-network processing unit (NPU), and / or the like. Different processing units may be separate components or may be integrated into one or more processors.

[0134] The controller may generate an operation control signal according to the instruction operation code and the time series signal to complete the control of instruction reading and instruction execution.

[0135] A memory may also be disposed in the processor 110 and configured to store instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that have been used by the processor 110 or that are used periodically. When the processor 110 needs to use the instructions or data again, the processor may retrieve the instructions or data directly from the memory, thereby avoiding repeated accesses and reducing the wait time of the processor 110 and improving system efficiency.

[0136] In some embodiments, the processor 110 may include one or more interfaces, which may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, a universal serial bus (USB) interface, and / or the like.

[0137] The charging management module 140 is configured to receive a charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive the charging input of the wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 may receive the wireless charging input using a wireless charging coil of the mobile phone 101. The charging management module 140 provides power to the electronic device through the power management module 141 while charging the battery 142.

[0138] Power management module 141 is configured to connect to battery 142, charging management module 140, and processor 110. Power management module 141 receives input from battery 142 and / or charging management module 140 and provides power to processor 110, internal memory 121, display 194, camera 193, wireless communication module 160, and the like. In some other embodiments, power management module 141 and charging management module 140 may alternatively be located in the same device.

[0139] The wireless communication functionality of the mobile phone 101 may be implemented through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, a modem processor, a baseband processor, and the like.

[0140] Antenna 1 and Antenna 2 are configured to transmit and receive electromagnetic wave signals. Each antenna in the mobile phone 101 may be configured to cover one or more communication frequency bands. Different antennas may be further multiplexed to improve antenna utilization. For example, Antenna 1 may be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas may be used in combination with tuning switches.

[0141] The wireless communication module 160 may provide a wireless communication solution applied to the mobile phone 101, including wireless local area network (WLAN) (e.g., wireless fidelity (Wi-Fi) network), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) technology, or the like. The wireless communication module 160 may be one or more components integrating at least one communication processor module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering processes on the electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 may further receive signals to be transmitted from the processor 110, perform frequency modulation and amplification on the signals, and convert the signals into electromagnetic waves for emission through the antenna 2.

[0142] In some embodiments, antenna 1 and mobile communication module 150 are coupled and antenna 2 and wireless communication module 160 are coupled in mobile phone 101, such that mobile phone 101 can communicate with networks and other devices using wireless communication technologies that may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, IR technologies, and / or the like. The GNSS may include the global positioning system (GPS), the global navigation satellite system (GLONASS), the Beidou navigation satellite system (BDS), the quasi-zenith satellite system (QZSS), and / or satellite based augmentation systems (SBAS).

[0143] The mobile phone 101 implements display functions using a GPU, a display 194, an application processor, and the like. The GPU is a microprocessor for image processing and is connected to the display 194 and the application processor. The GPU is configured to perform mathematical and geometric calculations and render images. The processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.

[0144] The display 194 is configured to display images, videos, and the like. The display 194 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a mini-LED, a micro-LED, a micro-OLED, a quantum dot light-emitting diode (QLED), or the like. In some embodiments, the mobile phone 101 may include one or N displays 194, where N is a positive integer greater than 1.

[0145] The mobile phone 101 may implement photography functionality through a camera 193, an ISP, a video codec, a GPU, a display 194, an application processor, and the like.

[0146] The external memory interface 120 may be configured to connect to an external memory card, for example, a micro SD card, to expand the storage capacity of the mobile phone 101. The external memory card communicates with the processor 110 through the external memory interface 120 to implement data storage functions. For example, files such as music and videos are stored on the external memory card.

[0147] The internal memory 121 may be configured to store computer executable program code. The executable program code includes instructions. The internal memory 121 may include a program storage area and a data storage area. The program storage area may store an operating system, applications required for at least one function (e.g., audio playback function or image playback function), and the like. The data storage area may store data (e.g., audio data or a phone book) created in the course of using the mobile phone 101. The internal memory 121 may also include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory, or universal flash storage (UFS). The processor 110 executes instructions stored in the internal memory 121 and / or instructions stored in a memory located in the processor to perform various functional applications and data processing of the mobile phone 101.

[0148] The mobile phone 101 may implement audio functions, such as music playback and recording, through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headset jack 170D, an application processor, and the like.

[0149] All the technical solutions in the following embodiments may be applied to the network system 100 in Fig. 1. Here again, an example in which the network system 100 includes a mobile phone 101, a smart TV 102, a smart sound box 103, a PC 104, and a smart TV 105 is used to describe the method for interaction between electronic devices provided in the embodiments of the present application. The mobile phone 101 may specifically have the structure shown in Fig. 9. For the structures of the smart TV 102, the smart sound box 103, the PC 104, and the smart TV 105, please refer to the structure shown in Fig. 9.

[0150] When a user wants to trigger an interaction between electronic devices, the user may enter interface A through any electronic device in the network system 100 and perform an operation on interface A. Here, a mobile phone 101 that a user frequently carries is used as an example for explanation.

[0151] For example, as shown in FIG. 2(1), the mobile phone 101 displays the control center interface 202 shown in FIG. 2(2) in response to detecting that the user has performed a sliding operation from the bottom of the screen (or a sliding operation from the top of the screen) on the home screen 201 displayed by the mobile phone 101. Furthermore, the mobile phone 101 enters the interface 301 shown in FIG. 3, i.e., interface A, in response to detecting that the user has operated a control 203 in the control center interface 202. When the mobile phone 101 displays another interface (e.g., an application interface currently running in the foreground), the user will know that he or she may enter the control center interface 202 shown in FIG. 2(2) by performing a sliding operation from the bottom of the screen (or a sliding operation from the top of the screen).

[0152] In a particular embodiment, when it is detected that the user has operated the control 203 in the control center interface 202, the mobile phone 101 enables the wireless communication function of the mobile phone 101 and transmits and broadcasts an inquiry message to inquire about nearby electronic devices. After receiving the inquiry message of the mobile phone 101, the nearby electronic device separately returns a response to the mobile phone 101. The nearby electronic device may add information such as the MAC address and device type of the electronic device to the response. Based on the information such as the MAC address and device type of the electronic device, the mobile phone 101 may determine whether the electronic device is associated with the mobile phone 101, i.e., whether the electronic device is an associated device of the mobile phone 101. For example, the mobile phone 101 may determine whether the login account of the electronic device and the login account of the mobile phone 101 are the same or belong to the same group of accounts by inquiring the account management server about the login account of the electronic device based on the MAC address of the electronic device held in the response. Alternatively, the mobile phone 101 may inquire of the router of the Wi-Fi network in which the mobile phone 101 is located, whether the electronic device and the mobile phone 101 are located in the same Wi-Fi network, etc., based on the MAC address of the electronic device held in the response. Alternatively, the mobile phone 101 determines, based on the history record stored in the mobile phone 101, whether the electronic device has established a trust relationship with the mobile phone 101, etc. Note that the embodiment of the present application does not limit a specific method for determining the associated device of the mobile phone 101.

[0153] It should be noted that in some scenarios, the mobile phone 101 may have established communication connections to some electronic devices before it is detected that the user has operated the control 203 on the control center interface 202. In this case, after it is detected that the user has operated the control 203 on the control center interface 202, in addition to performing the above-mentioned steps, the mobile phone 101 may further determine, for the electronic devices that have established communication connections to the mobile phone 101, whether the electronic devices are associated devices of the mobile phone 101.

[0154] After the mobile phone 101 determines that the electronic device is an associated device of the mobile phone 101, the mobile phone 101 measures the relative position between each associated device and the mobile phone 101 using the positioning function in the wireless communication function. In some examples, the mobile phone 101 may obtain the distance between each associated device and the mobile phone 101 through measurement using Wi-Fi-based positioning performance or Bluetooth iBeacon-based positioning performance. In other examples, the mobile phone 101 may obtain the distance between each associated device and the mobile phone 101 and the direction of the position of each associated device relative to the position of the mobile phone 101 through measurement using Bluetooth 5.1-based AOA positioning performance or UWB-based positioning performance.

[0155] After obtaining the relative positions between the mobile phone 101 and the associated devices of the mobile phone 101, the mobile phone 101 may draw and display an interface 301 shown in Fig. 3, i.e., interface A. The interface 301 includes identifiers of the mobile phone 101 and the associated devices. Also, the layout of the identifiers of the mobile phone 101 and the identifiers of the associated devices is consistent with the layout of the mobile phone 101 and the associated devices in the real space. In other words, the interface 301 more clearly displays the relative positions between the mobile phone 101 and the associated devices in the real space.

[0156] It should be noted that the mobile phone 101 usually has multiple associated devices, and each associated device may have different wireless communication capabilities and different positioning capabilities. Therefore, an embodiment of the present application further provides a layout method of device identifiers in the interface 301 in multiple different cases.

[0157] Case (1): There is an associated device with Bluetooth 5.1-based AOA positioning capability or UWB-based positioning capability. By default, the mobile phone 101 has Bluetooth 5.1-based AOA positioning capability or UWB-based positioning capability.

[0158] 1.1: First, use the device icon of the mobile phone 101 as the center to determine the location of the device icon of the associated device that has Bluetooth 5.1-based AOA positioning capability or UWB-based positioning capability.

[0159] The mobile phone 101 may measure the distance and direction of an associated device having Bluetooth 5.1-based AOA positioning capability or UWB-based positioning capability relative to the mobile phone 101. Based on the distance and direction relative to the mobile phone 101 obtained through the measurement, the position of the device icon of the associated device (including the distance and direction relative to the device icon of the mobile phone 101) may be determined.

[0160] 1.2: Determine the location of the device icon of another related device that does not have Bluetooth 5.1-based AOA positioning capability or UWB-based positioning capability according to a specific layout rule.

[0161] Next, based on the number M of associated devices of the mobile phone 101, an included angle α is determined between the connecting lines of the device icons of any two adjacent associated devices and the device icon of the mobile phone 101. The location of the device icon of another associated device that does not have Bluetooth 5.1-based AOA positioning capability or UWB-based positioning capability is determined based on the distance between the other associated device and the mobile phone 101, the included angle α, and the connecting lines between the device icon of the mobile phone 101 and the device icon whose location is determined in step 1.1.

[0162] For example, PC 104 has Bluetooth 5.1-based AOA positioning capability or UWB-based positioning capability, and other related devices (i.e., smart TV 102, smart sound box 103, and smart TV 105) do not have Bluetooth 5.1-based AOA positioning capability or UWB-based positioning capability. Specifically, the distance and direction of PC 104 relative to mobile phone 101 may be measured. In this case, the position (including direction and distance) of the device icon of PC 104 may be determined using the device icon of mobile phone 101 as the center. As shown in the interface 1001 shown in FIG. 10(1), after the device icons of mobile phone 101 and PC 104 are determined, it is equivalent to the connection line AB being determined as well.

[0163] The mobile phone 101 may only measure the relative distance between another associated device and the mobile phone 101, and then determine the distance between the device icon of the other associated device and the device icon of the mobile phone 101. Optionally, a length value, for example, 20 device independent pixels (DP), may be randomly added or subtracted to the determined distance between the device icon of the other associated device and the device icon of the mobile phone 101 to create a sense of randomness and enhance the aesthetics of the device icon layout.

[0164] Next, based on the number M of associated devices of the mobile phone 101 (e.g., M=4), an included angle α between the connecting lines of the device icons of any two adjacent associated devices and the device icon of the mobile phone 101 is determined. For example, α=360 degrees / M=360 degrees / 4=90 degrees. Optionally, an angle value, for example, 10 degrees, may be randomly added or subtracted from the determined angle α to create a sense of randomness and enhance the beauty of the device icon layout.

[0165] Finally, the position of the device icon of the PC 104 is used as the focus, i.e., the connecting line between the device icon of the mobile phone 101 and the device icon of the PC 104 (i.e., the connecting line AB) is used as the starting position, and the positions of the device icons of the other related devices are determined based on the included angle α and the distances between the other related devices and the mobile phone 101. For example, the mobile phone 101 finally displays an interface 1001 as shown in Fig. 10(1).

[0166] Note that when the position of the PC 104 changes, the mobile phone 101 determines a new position of the device icon of the PC 104 based on the measured new position of the PC 104. Then, new positions of the device icons of the other associated devices are re-determined based on the new position of the device icon of the PC 104, the included angle α, and the distances between the other associated devices and the mobile phone 101. Specifically, the positions of the device icons of the other associated devices are dynamically adjusted in a timely manner.

[0167] Of course, as the positions of other associated devices (e.g., smart sound box 103, smart TV 102, and smart TV 105) change through measurements, the distance between the device icons of the associated devices and the device icon of mobile phone 101 is correspondingly adjusted.

[0168] Furthermore, when the number of associated devices found by the mobile phone 101 changes (e.g., M changes to 3), the included angle α is recalculated, and new positions of the device icons of the other associated devices are redetermined based on the positions of the device icons of the PC 104, the recalculated included angle α (120 degrees), and the distances between the other associated devices and the mobile phone 101. For example, the mobile phone 101 displays an interface 1002 shown in Fig. 10(2).

[0169] Case (2) There are two or more associated devices with Bluetooth 5.1-based AOA positioning capability or UWB-based positioning capability: By default, the mobile phone 101 has Bluetooth 5.1-based AOA positioning capability or UWB-based positioning capability.

[0170] In some embodiments, any associated device may be selected from two or more associated devices having Bluetooth 5.1-based AOA positioning capability or UWB-based positioning capability, and the location of the device icon of the selected associated device is determined first. According to the method for determining the device icon of the associated device that does not have Bluetooth 5.1-based AOA positioning capability or UWB-based positioning capability in case (1), the device icon of the other associated device that has Bluetooth 5.1-based AOA positioning capability or UWB-based positioning capability and the device icon of the associated device that does not have Bluetooth 5.1-based AOA positioning capability or UWB-based positioning capability are determined.

[0171] In some other embodiments, if two or more associated devices have Bluetooth 5.1-based AOA positioning capability or UWB-based positioning capability, alternatively, the positions of the device icons of the associated devices may be determined first, and the device icons of other associated devices that do not have Bluetooth 5.1-based AOA positioning capability or UWB-based positioning capability are randomly arranged based on the vacant positions on the interface.

[0172] Case (3): None of the associated devices have Bluetooth 5.1-based AOA positioning capability or UWB-based positioning capability.

[0173] In one embodiment, the mobile phone 101 may still obtain the distance between each associated device and the mobile phone 101 through measurement. In this case, the distance between the device icon of each associated device and the device icon of the mobile phone 101 may be determined based on the distance between the associated device and the mobile phone 101. Optionally, a length value, for example, 20 DP, may be randomly added or subtracted from the determined distance between the device icon of another associated device and the device icon of the mobile phone 101 to create a sense of randomness and enhance the aesthetics of the device icon layout.

[0174] Then, based on the number M of associated devices, the included angle α between the connecting lines of the device icons of any two adjacent associated devices and the device icon of the mobile phone 101 may still be determined, for example, α=360 degrees / M. Optionally, an angle value, for example, 10 degrees, may be randomly added or subtracted from the determined angle α to create a sense of randomness and enhance the beauty of the device icon layout.

[0175] Finally, the positions of the device icons of the other related devices are determined based on the included angle α and the distances between the other related devices and the mobile phone 101. For example, the mobile phone 101 displays an interface 1101 shown in Fig. 11. It can be seen that the interface 1101 and the interface 1001 have similarities in that the distances between the device icons of all related devices and the device icon of the mobile phone 101 are the same, and the included angles of the connecting lines between the device icons of any two adjacent related devices and the device icon of the mobile phone 101 are the same. The difference is that the device icons of the related devices are located at different positions on the screen. The adjacency relationships between the device icons of the managed devices are different.

[0176] In some examples of this embodiment, when the positions of other associated devices (e.g., smart sound box 103, smart TV 102, and smart TV 105) change through measurements, the distance between the device icons of the associated devices and the device icon of mobile phone 101 is correspondingly adjusted.

[0177] In some other examples of this embodiment, when the number of associated devices discovered by the mobile phone 101 changes, the included angle α is recalculated and the position of the device icon of each associated device is readjusted based on the recalculated included angle α.

[0178] In another embodiment, the mobile phone 101 may alternatively not obtain the distance between each associated device and the mobile phone 101 through measurement. Instead, the distance between the device icon of each associated device and the device icon of the mobile phone 101 is set to a default value, for example, 120 DP. Optionally, to create a sense of randomness and enhance the beauty of the device icon layout, a length value, for example, 20 DP, may be randomly added or subtracted to the determined distance between the device icon of another associated device and the device icon of the mobile phone 101. Note that the distance between the device icon of each associated device and the device icon of the mobile phone 101 may be set to the same value, i.e., there is one default value. Alternatively, the distance between the device icon of each associated device and the device icon of the mobile phone 101 may be set to be different, i.e., there are multiple default values.

[0179] Based on the number M of associated devices, an included angle α between the connecting lines of the device icons of any two adjacent associated devices and the device icon of the mobile phone 101 is determined. For example, α=360 degrees / M. Optionally, an angle value, for example, 10 degrees, may be randomly added or subtracted from the determined angle α to create a sense of randomness and enhance the beauty of the device icon layout.

[0180] Finally, the position of the device icon of another associated device is determined based on the included angle α and the default distance between the device icon of each associated device and the device icon of the mobile phone 101. For example, the mobile phone 101 displays an interface 1201 shown in Fig. 12. It can be seen that the distances between the device icons of the associated devices and the device icon of the mobile phone 101 are approximately equal.

[0181] In some examples of this embodiment, when the number of associated devices discovered by the mobile phone 101 changes, the included angle α is recalculated and the position of the device icon of each associated device is readjusted based on the recalculated included angle α.

[0182] In conclusion, the embodiment of the present application does not particularly limit the layout method of related devices in the interface A.

[0183] It should also be noted that the mobile phone 101 may periodically acquire a relative position between each associated device and the mobile phone 101, and refresh the interface A based on the most recent acquired position between each associated device and the mobile phone 101. Alternatively, the mobile phone 101 may refresh the interface A when the relative position between the associated device and the mobile phone 101 changes. Alternatively, a refresh control may be set in the interface A. The mobile phone 101 refreshes the interface A after detecting that the user has operated the refresh control.

[0184] It should be noted that when the mobile phone 101 measures the distance and direction between each associated device and the mobile phone 101, and during the process of the mobile phone 101 displaying interface A, the mobile phone 101 may be in a state in which no wireless connection is established between the mobile phone 101 and each associated device and among the associated devices, for example, in a standby state. In other words, during this process, the mobile phone 101 and each associated device need to enable wireless communication functions, but no wireless connection needs to be established between the mobile phone 101 and each associated device and among the associated devices.

[0185] It should be further noted that the user may also enter interface A from another interface of the mobile phone 101. For example, the above-mentioned interface A may be entered from the leftmost screen of the mobile phone 101, a pull-down notification bar, or the like. The leftmost screen is an interface displayed by the mobile phone 101 after it is detected that the user has performed a sliding operation from the left edge of the screen to the right on the home screen displayed by the mobile phone 101, and this interface is not another home screen displayed by the mobile phone 101. Alternatively, the above-mentioned interface A may be entered from an application interface of the mobile phone 101 (for example, an interface for searching for a device in a smart home application or an interface for searching for a device in a settings application).

[0186] In some other examples, interface A may alternatively be included in a control center interface, a leftmost screen, or a pull-down notification bar. For example, FIG. 13(1) shows a home screen 1301 displayed by mobile phone 101. In response to detecting that a user has performed an operation of sliding up from the bottom of the screen on home screen 1301 displayed by mobile phone 101, mobile phone 101 displays control center interface 1302 shown in FIG. 13(2). The content of area 1303 in control center interface 1302 is the content of interface A.

[0187] In other words, the embodiment of the present application does not limit the specific manner of entering interface A or the location of interface A, etc.

[0188] The above describes in detail the process of how a user uses the mobile phone 101 to enter interface A and how the mobile phone 101 displays interface A. The following further describes how a user can perform an operation on interface A to trigger an interaction function between any two or more electronic devices.

[0189] For example, as shown in FIG. 14(1), in the display interface 1401 of the mobile phone 101, device icons corresponding to the mobile phone 101, the smart TV 102, the smart sound box 103, the PC 104, and the smart TV 105 are displayed on the interface 1401. In addition, the display interface 1401 may further display prompt information such as "Drag the icon to trigger an interaction between electronic devices" to prompt the user to perform a drag action to trigger a collaboration between multiple electronic devices. Alternatively, the prompt information in the display interface 1401 may alternatively prompt the user to drag another device toward the local device by "Drag the device to the local device to establish collaboration" (not shown). If the user wants to trigger an interaction between the mobile phone 101 and the PC 104, the user may drag the device icon of the PC toward the device icon of the mobile phone while touching the device icon of the PC. When the two device icons are dragged so that the distance between them is smaller than a threshold R1 (e.g., 65DP) and the hand is released, the device icon of the PC and the device icon of the mobile phone may stick to each other, and the mobile phone 101 may display an interface 1402 shown in FIG. 14(2). In this case, the mobile phone 101 may display prompt information to prompt that the mobile phone 101 and the PC 104 are working together. When the mobile phone 101 and the PC 104 start to execute corresponding interaction functions, the mobile phone 101 may display an interface 1403 shown in FIG. 14(3). In the interface 1403, the device icon of the mobile phone 101 and the device icon of the PC 104 stick to each other. Optionally, prompt information to prompt that the mobile phone 101 and the PC 104 are executing interactive functions or to prompt that the mobile phone 101 and the PC 104 are executing cooperative operations may be displayed on the interface 1403.If mobile phone 101 and PC 104 are unable to perform the interaction function, the device icon of PC 104 will return to the position it was in before it was dragged, i.e., the device icon of mobile phone 101 and the device icon of PC 104 will not be attracted to each other, and mobile phone 101 may further prompt the user of the failure of the collaboration between mobile phone 101 and PC 104.

[0190] In some embodiments, the mobile phone 101 may intelligently determine the interaction function to be performed between the mobile phone 101 and the associated device based on the current scenario in which the mobile phone 101 is located, the type of the associated device (e.g., PC 104), and the like.

[0191] Cross-device interaction features of the present application include, but are not limited to, system level interaction features and application level interaction features. System level interaction features include, but are not limited to, audio projection, projection, and the like. Application level interaction features include, but are not limited to, application handoff, content sharing, and the like.

[0192] Audio projection means sending an audio stream played on one electronic device to another electronic device, which then plays the audio stream, for example, audio projection between mobile phone and smart sound box, audio projection between mobile phone and smart screen with screen off, and audio projection between mobile phone and head unit.

[0193] Projection includes stream projection based on digital living network alliance (DLNA) technology (also called multi-source projection), screen mirroring based on Miracast technology (also called single-source projection), and projection based on other technologies (such as AirPlay). For example, projection is performed between a mobile phone and a smart TV, PC, or tablet. If a user wants to project a video or audio played on a mobile phone to another electronic device, the user may perform stream projection. In this case, the mobile phone may send a playback address of the video or audio to an electronic device (e.g., a PC), and the PC plays the corresponding video or audio based on the received playback address. Alternatively, the mobile phone may send video data or audio data played by the mobile phone to a PC, and the PC may directly play the video data or audio data based on the received video data or audio data. In the screen projection process, the interface displayed on the mobile phone may be different from the content displayed on the PC. If a user wants to project an interface displayed on the screen of the mobile phone to another electronic device, screen mirroring may be performed. In this case, the mobile phone transmits mobile phone interface data to another electronic device (such as a PC), and the PC displays the mobile phone interface. In the screen projection process, the interface displayed on the mobile phone and the mobile phone interface displayed on the PC are the same.

[0194] Application handoff means that an electronic device can continue executing an application that was executed by another electronic device.

[0195] Content sharing includes sharing content such as files, photos, videos, audios, and texts between different electronic devices. For example, application handoff is performed between a mobile phone and a smart TV / PC / tablet computer. Handoff applications are, for example, MeeTime application (video calling application), video application, music application, and document application.

[0196] In a particular implementation method, the mobile phone 101 may first determine the scenario in which the mobile phone 101 is currently located based on the currently running application. For example, if the mobile phone 101 is currently running a document editing application such as Word or WPS, the mobile phone 101 is determined to be in the office scenario. Alternatively, if the mobile phone 101 is currently running a PPT application, a gallery application, or the like, the mobile phone 101 is determined to be in the demo sharing scenario. Alternatively, if the mobile phone 101 is currently running a video application, an audio application, or the like, the mobile phone 101 is determined to be in the audio and video playback scenario. Alternatively, if the mobile phone 101 is currently running a calling application, the mobile phone 101 is determined to be in the video calling scenario. Alternatively, if the mobile phone 101 is currently running a sports application, a fitness application, or browsing a sports webpage, the mobile phone 101 is determined to be in the sports and health scenario. Alternatively, if a head unit appears on the associated device of the mobile phone 101, the mobile phone is determined to be in the head unit projection scenario.

[0197] Note that, as explained above, in some examples, a user pulls up or slides down a control center on an application interface of application 1 (application 1 is not a desktop application) displayed on mobile phone 101 and uses a control (also called a widget) in the control center to enter interface A. In this case, in this example, the application currently running on mobile phone 101 is application 1.

[0198] In some other examples, when the mobile phone 101 displays the home screen (which may be considered as the mobile phone 101 displaying an interface for desktop applications), the user pulls up or slides down to display the control center and uses a control or widget in the control center to enter interface A. Alternatively, the user uses the leftmost screen of the mobile phone 101 to enter interface A. In this example, the application currently running on the mobile phone 101 may be understood to be the application that was most recently run in the foreground by the mobile phone before the mobile phone displayed the control center or entered the leftmost screen, which is a non-desktop application.

[0199] For example, when the mobile phone 101 displays the application interface of application 2 (a non-desktop application), it receives a user's operation and returns to the home interface of the mobile phone. Then, the user initiates the control center by pulling up or sliding down, and uses a control (also called a widget) in the control center to enter interface A. In this case, the application currently running on the mobile phone 101 is application 2.

[0200] As another example, when mobile phone 101 displays the application interface of application 3 (a non-desktop application), it receives a user's operation to return to the home interface of the mobile phone. After the user's operation of sliding from the left edge of the screen to the right on the home screen is again received, the mobile phone displays the leftmost screen and uses a control (or widget) in the leftmost screen to enter interface A. In this case, the application currently running on mobile phone 101 is application 3.

[0201] Then, based on the current scenario of the mobile phone and the type of the associated device, the interaction function that the mobile phone 101 executes with the associated device is determined. For example, an example in which the mobile phone 101 is in a document editing scenario is used to describe how to determine the interaction function that the mobile phone 101 executes with the associated device. If the associated device is a smart TV 102, the device characteristics of the smart TV 102 are that the smart TV 102 has a large screen, so that user input is inconvenient. Therefore, the interaction function between the mobile phone 101 and the smart TV 102 may be determined to be screen mirroring. The user may project the document currently executed on the mobile phone 101 to the smart TV 102 for easy viewing. And the user may continue to edit the document using the mobile phone 101. If the associated device is a PC 104, the PC 104 has a large screen and an input device such as a keyboard due to the device characteristics of the PC 104. Therefore, the interaction function of application handoff that the mobile phone 101 executes with the PC 104 may be selected first. In other words, the mobile phone 101 sends the currently edited document to the PC 104, and the user may continue editing the document on the PC 104 based on the document edited by the mobile phone 101. If either the mobile phone 101 or the PC 104 does not support the application handoff interaction function, the screen mirroring interaction function performed by the mobile phone 101 with the PC 104 may be selected.

[0202] The following Table 1 shows an example of the correspondence between the current scenario of the mobile phone 101, the type of the associated device, and the interaction function between the electronic devices. In other words, after the mobile phone 101 determines the current scenario, the mobile phone 101 may search Table 1 to determine the interaction function that the mobile phone 101 will perform with the associated device. [Table 1A] [Table 1B] [Table 1C]

[0203] It should be noted that the correspondence in Table 1 is merely an example and does not limit the correspondence between the scenario in which the mobile phone 101 is positioned, the types of cooperatively associated devices, and the interaction functions between the electronic devices.

[0204] In some other embodiments, the mobile phone 101 may further determine an interaction function between the two electronic devices based on the running status of the associated devices. For example, a user triggers an interaction function between the mobile phone 101 and the smart TV 102. If it is determined that the smart TV 102 is in a screen-on state, the mobile phone 101 and the smart TV 102 may execute an interaction function of screen mirroring. If it is determined that the smart TV 102 is in a screen-off state, the mobile phone 101 and the smart TV 102 may execute an interaction function of audio projection.

[0205] In some other embodiments, the mobile phone 101 may further determine the interaction function between the two electronic devices based on the device type of the linked related device. In other words, the interaction function between the two electronic devices is a fixed interaction function. For example, when a user triggers an interaction function between the mobile phone 101 and the smart sound box 103, the mobile phone 101 determines that an audio projection interaction function is performed between the mobile phone 101 and the smart sound box 103 based on the device type of the smart sound box 103. As another example, when a user triggers an interaction function between the mobile phone 101 and the smart TV 102, the mobile phone 101 determines that a projection interaction function is performed between the mobile phone 101 and the smart TV 102 based on the device type of the smart TV 102.

[0206] It should be noted that the method for the mobile phone 101 to determine the interaction function to be performed between the mobile phone 101 and the associated device is merely an example. In some other embodiments, the above-mentioned methods may be further combined. For example, when the mobile phone 101 displays an interface during the execution of an application (non-desktop application), the user pulls up or down to display a control center and enters interface A. When the interaction function between the mobile phone 101 and some associated device is triggered through interface A, the mobile phone 101 may determine the interaction function to be performed based on the information about the currently running application and the device type of the associated device. When the mobile phone 101 displays a desktop (which may be regarded as an interface during the execution of a desktop application), the user pulls up or down to display a control center and enters interface A. When the interaction function between the mobile phone 101 and some associated device is triggered through interface A, the mobile phone 101 may determine the interaction function to be performed based on the device type of the associated device, or the mobile phone 101 directly determines to perform some interaction function that has been preset.

[0207] After the mobile phone 101 determines the interaction function to be performed between the mobile phone 101 and the associated device, the mobile phone 101 establishes a wireless connection to the associated device to transmit service data required for the interaction function. The established wireless connection may be, for example, a Wi-Fi peer-to-peer (P2P) network connection or a Bluetooth connection. For example, when the mobile phone 101 and the PC 104 perform the interaction function of screen mirroring, and the mobile phone 101 sends the screen interface of the mobile phone 101 to the PC 104 through the established wireless connection, the PC 104 displays the screen interface of the mobile phone 101. As another example, when the mobile phone 101 and the PC 104 perform the interaction function of application handoff, the mobile phone 101 sends the status of the currently running application to the PC 104. The PC 104 starts the corresponding application locally, and based on the received application status, returns the locally running application to the running state of the mobile phone 101 to continue running. As another example, when the mobile phone 101 and the PC 104 execute the interaction function of stream projection, the mobile phone 101 sends a streaming media playback address to the PC 104, and the PC 104 downloads and plays the streaming media from the corresponding server according to the streaming media playback address. Alternatively, the mobile phone 101 sends streaming media data to the PC 104, and the PC 104 plays corresponding video or audio according to the streaming media data.

[0208] It should be noted that in some examples, the interaction function between the mobile phone 101 and the PC 104 is not affected when the user's drag direction is different. In other words, whether the user touches the device icon of the PC and drags the device icon of the PC toward the device icon of the mobile phone to trigger the interaction function between the two electronic devices, or touches the device icon of the mobile phone and drags the device icon of the mobile phone toward the device icon of the PC to trigger the interaction function between the two electronic devices, the interaction function performed between the mobile phone 101 and the PC 104 is the same. In other examples, the interaction function between the mobile phone 101 and the PC 104 may be different when the user's drag direction is different, for example, the data transmission direction is different. For example, when the device icon of the PC is touched and dragged toward the device icon of the mobile phone to trigger the interaction function between the two electronic devices, when an application handoff is performed between the mobile phone 101 and the PC 104, the state of the application on the PC 104 may be sent to the mobile phone 101, and the mobile phone 101 executes the application through the handoff based on the received state of the application. When an application handoff is performed between the mobile phone 101 and the PC 104 by touching and dragging the mobile phone device icon toward the PC device icon to trigger an interaction function between the two electronic devices, the state of the application on the mobile phone 101 may be sent to the PC 104, and the PC 104 executes the application through the handoff based on the received application state.

[0209] The user may further drag more related devices to participate in the interaction function between the mobile phone 101 and the PC 104. For related operations, please refer to the above description of Figure 5(1) and Figure 5(2).

[0210] In some other embodiments, the user may trigger an interaction function between multiple associated devices and the mobile phone 101 at once by selecting device icons of multiple associated devices and dragging the device icons near the mobile phone 101. For example, in the interface 1501 shown in FIG. 15(1), the user may first select device icons of multiple associated devices, for example, select the device icon of the smart TV 102 and the device icon of the smart speaker 103 by, for example, holding down the device icon, and then drag the device icon toward the device icon of the mobile phone 101 while touching any selected device icon. When the distance between any of the selected device icons and the device icon of the mobile phone 101 is smaller than the threshold R1 and the hand is released, the selected multiple device icons are attracted to the device icon of the mobile phone 101, and the mobile phone 101 displays the interface 1502 shown in FIG. 15(2), and the mobile phone 101, the smart TV 102, and the smart sound box 103 cooperate to execute the corresponding interaction function together.

[0211] Furthermore, the user may cancel (or disable) the interaction function between the mobile phone 101 and the PC 104. For example, in the interface 1601 shown in FIG. 16(1), the device icon of the PC and the device icon of the mobile phone are attracted to each other, indicating that the mobile phone 101 and the PC 104 are executing the interaction function. In this case, if the user wants to cancel (or disable) the interaction function, the user may drag the device icon of the PC away from the device icon of the mobile phone while touching the device icon of the PC. When the distance between the two dragged device icons is greater than a threshold R2 (which may be the same as or different from the threshold R1) and the hand is released, the device icon of the PC returns to the position before the attraction, for example, as shown in the interface 1602 shown in FIG. 16(2). In this case, the PC 104 ends the interaction function with the mobile phone 101. Alternatively, the user may drag the device icon of the PC away from the device icon of the mobile phone while touching the device icon of the PC. When the finger drag distance (i.e., the movement distance of the PC device icon or the distance between two device icons) is smaller than threshold R2 (which may be the same as or different from threshold R1) and the hand is released, the PC device icon returns to the adsorbed position, for example, as shown in interface 1601 in Fig. 16(1). In this case, PC 104 ends the interaction function with mobile phone 101.

[0212] 17, the interface 1701 includes a control 1702 for canceling the previous stage. In response to detecting that the user has operated the control 1702, the mobile phone 101 cancels the drag operation performed by the user in the previous stage. Optionally, the interface 1701 may further include a control 1703 for canceling all. In response to detecting that the user has operated the control 1703, the mobile phone 101 cancels all interaction functions between the electronic devices with one click.

[0213] All the above examples relate to a method of triggering an interaction function between another electronic device and the mobile phone 101 on the interface A displayed on the mobile phone 101. In some other examples, an interaction function between electronic devices other than the mobile phone 101 may be triggered on the display interface A of the mobile phone 101. For example, in the interface 1801 shown in FIG. 18(1), when it is detected that the user drags the device icon of the PC toward the device icon of the TV, and the distance between the device icon of the PC and the device icon of the TV is smaller than the threshold R3 and the hand is released, the mobile phone 101 determines whether the PC 104 and the smart TV 105 can perform the interaction function. If it is determined that the two electronic devices can perform the interaction function, the device icon of the PC and the device icon of the TV are attracted to each other on the interface displayed by the mobile phone 101, prompting that the PC 104 and the smart TV 105 are performing the interaction function. If it is determined that the two electronic devices cannot perform the interaction function, on the interface displayed by the mobile phone 101, the device icon of the PC may return to its initial position, and prompt information may be displayed to inform the PC 104 and the smart TV 105 that they cannot perform the interaction function or to prompt the failure of the collaboration.

[0214] Note that the mobile phone 101 may not distinguish the direction in which the user performs the drag operation, that is, when the drag directions are different, the interaction function triggered between the two electronic devices is the same. For example, regardless of whether it is detected that the user has performed the drag operation shown in FIG. 18(1) or the drag operation shown in FIG. 18(2), the interaction function triggered between the PC 104 and the smart TV 105 is the same. Alternatively, the mobile phone 101 may distinguish the direction in which the user performs the drag operation. Specifically, when the drag directions are different, the interaction function triggered between the two electronic devices is different. For example, the data transmission direction in the interaction function is different. For example, when it is detected that the user has performed the drag operation shown in FIG. 18(1), it may be determined to transmit the status of the application on the PC 104 to the smart TV 105, and the smart TV 105 continues to execute the application. When it is detected that the user has performed the drag operation shown in FIG. 18(2), it may be determined to transmit the status of the application on the smart TV 105 to the PC 104, and the PC 104 continues to execute the application.

[0215] In the following, the process of triggering the PC 104 and the smart TV 105 to perform an interaction function on the mobile phone 101 will be described using an example in which the mobile phone 101 distinguishes the direction in which the user performs a drag operation.

[0216] Solution 1: The mobile phone 101 determines the interaction function to be performed between the PC 104 and the smart TV 105.

[0217] In a specific implementation, the procedure shown in FIG. 19(1) includes the following steps.

[0218] 1: The mobile phone 101 detects that the user has dragged the PC device icon towards the TV device icon, and releases the hand when the distance between the PC device icon and the TV device icon is less than a threshold R3.

[0219] 2: The mobile phone 101 sends a user drag command to the PC 104, and prompts the PC 104 to send a command to report the application scenario of the PC 104. The application scenario of the PC 104 may be determined based on the currently running applications of the PC 104. For the determination method, please refer to the above-mentioned method for determining the application scenario of the mobile phone 101. Optionally, the mobile phone 101 may send the user drag command to the smart TV 105.

[0220] 3: The PC 104 reports its current application scenario to the mobile phone 101. Optionally, the smart TV 104 also reports its current application scenario to the mobile phone 101.

[0221] 4: The mobile phone 101 determines the interaction function to be performed between the PC 104 and the smart TV 105 based on the current application scenario of the PC 104 and the device type of the smart TV 105.

[0222] 5: The mobile phone 101 sends the determined interaction function to the PC 104.

[0223] 6: The PC 104 establishes a wireless connection to the smart TV 105 and sends data required for the interaction functions, such as the screen interface of the PC 104 required for the screen mirroring interaction function and the current application status of the PC 104 required for the application handoff interaction function, to the smart TV 105.

[0224] In another specific implementation, the procedure shown in FIG. 19(2) includes the following steps.

[0225] 1: The PC 104 and the smart TV 105 periodically send their current application scenarios to the mobile phone 101; or, when the application scenarios change, they report the changed application scenarios to the mobile phone 101.

[0226] 2: The mobile phone 101 detects that the user has dragged the PC device icon towards the TV device icon, and releases the hand when the distance between the PC device icon and the TV device icon is less than a threshold R3.

[0227] 3: The mobile phone 101 determines the interaction function to be performed between the PC 104 and the smart TV 105 based on the current application scenario of the PC 104 and the device type of the smart TV 105.

[0228] 4: The mobile phone 101 sends the determined interaction function to the PC 104.

[0229] 5: The PC 104 establishes a wireless connection to the smart TV 105 and sends data required for the interaction functions, such as the screen interface of the PC 104 required for the screen mirroring interaction function and the current application status of the PC 104 required for the application handoff interaction function, to the smart TV 105.

[0230] Solution 2: The PC 104 or the smart TV 105 determines the interaction function to be performed between the PC 104 and the smart TV 105.

[0231] In yet another specific implementation, the procedure shown in FIG. 19(3) includes the following steps.

[0232] 1: The mobile phone 101 detects that the user has dragged the PC device icon towards the TV device icon, and releases the hand when the distance between the PC device icon and the TV device icon is less than a threshold R3.

[0233] 2: The mobile phone 101 sends the user's drag command to the PC 104. Optionally, the mobile phone 101 may also send the user's drag command to the smart TV 105.

[0234] 3: The PC 104 determines the interaction function to be performed between the PC 104 and the smart TV 105 based on the current application scenario of the PC 104 and the device type of the smart TV 105.

[0235] 4: The PC 104 establishes a wireless connection to the smart TV 105 and sends data required for the interaction functions, such as the screen interface of the PC 104 required for the screen mirroring interaction function and the current application status of the PC 104 required for the application handoff interaction function, to the smart TV 105.

[0236] When the mobile phone 101 detects that the user has performed an operation on the mobile phone 101 to cancel (or disable) the interaction function performed between the PC 104 and the smart TV 105, the mobile phone 101 knows that it may send a disable command to the PC 104 and / or the smart TV 105 to disable the interaction function performed between the PC 104 and the smart TV 105.

[0237] It should be noted that the above-mentioned solution 1, solution 2, and specific implementations of these solutions are merely examples. In the embodiment of the present application, the specific steps in the process of triggering the PC 104 and the smart TV 105 to execute the interaction function on the mobile phone 101 are not particularly limited.

[0238] In some other embodiments, after an interaction function between two or more electronic devices has been triggered, a user may further reconfigure the providers of capabilities required for the interaction function, i.e., which electronic devices provide which capabilities required for the interaction function.

[0239] For example, as shown in FIG. 20(1), the mobile phone 101 displays an interface 2001. On the interface 2001, the device icon of the mobile phone and the device icon of the television are attracted to each other, indicating that the mobile phone 101 and the smart television 102 are performing an interaction function. When the mobile phone detects a user's operation of sliding up from the bottom of the interface 2001, the mobile phone may display an interface 2002 shown in FIG. 20(2). A setting menu 2003 is displayed on the interface 2002. The setting menu 2003 displays specific capabilities for the currently performed interaction function provided by each electronic device. The specific capabilities include, but are not limited to, audio output capabilities, sound collection capabilities (i.e., microphone), image collection capabilities (i.e., camera), and the like. A user may use the setting menu 2003 to reconfigure which electronic device provides which capabilities required for the interaction function. For example, the menu 2003 in the interface 2002 indicates that the smart television 102 provides audio output capabilities for the interaction function. If the user wants to reconfigure another electronic device to provide audio output capabilities for the interaction function, the user may alternatively tap option 2006 in menu bar 2003 corresponding to the audio output capabilities, and mobile phone 101 expands options corresponding to the audio output capabilities. For example, mobile phone 101 displays interface 2004 shown in FIG. 20(3) in response to the user tapping option 2006 in menu bar 2003. Options 2005 of multiple electronic devices having audio output capabilities are displayed in a settings menu 2007 in interface 2004. The user may select another electronic device (e.g., mobile phone 101) from option 2005 to provide audio output capabilities for the current interaction function.

[0240] The user may also enter the interface 2002 shown in Fig. 20(2) in another manner. For example, alternatively, corresponding controls, e.g., more setting controls, may be set on the interface 2001 shown in Fig. 20(1). In this case, the mobile phone 101 may display the interface 2002 shown in Fig. 20(2) in response to detecting that the user has operated the control.

[0241] In the above-described embodiment, the setting menu displays the capabilities of the electronic devices involved in the current interaction function. In some other embodiments, the setting menu may alternatively display all capabilities of the currently associated electronic devices. Specifically, the setting menu includes the capabilities of the electronic devices involved in the current interaction function and the capabilities of the electronic devices not involved in the current interaction function. In this case, the user may use the setting menu to trigger the electronic devices not involved in the current interaction function to participate in the current interaction function by setting the capabilities that the electronic devices not involved in the current interaction function require to provide the current interaction function.

[0242] For example, as shown in FIG. 21(1), the mobile phone 101 displays an interface 2101. On the interface 2101, the device icon of the mobile phone and the device icon of the television are attached to each other, indicating that the mobile phone 101 and the smart television 102 are performing an interaction function. Also, in the setting menu 2102 in the interface 2101, the options of each capability include all related devices. For example, the audio output capability includes electronic devices involved in the current interaction function, i.e., the device icon of the mobile phone 101 and the device icon of the smart television 102, and also includes electronic devices not involved in the current interaction function, e.g., the device icon of the smart sound box 102. In this case, if the user selects the smart sound box 102 as the audio output device, the mobile phone 101 displays an interface shown in FIG. 21(2), i.e., the device icon of the smart sound box 102 is also attached to the device diagram of the mobile phone 101 (and the smart television 102), i.e., the smart television 102 is also involved in the current interaction function.

[0243] In addition, in the interfaces shown in Figures 14(1) to 18(2) and Figures 20(1) to 21(2) in the embodiment of the present application, "Super Device" is displayed to prompt the user that the current operation is performed on multiple related terminals. The prompt information "Super Device" is merely an example for explanation and may be replaced with other content, for example, "Smart Cooperation" or "Multi-Device Cooperation".

[0244] An embodiment of the present application further provides an apparatus. As shown in FIG. 22, the apparatus includes at least one processor 2201 and at least one interface circuit 2202. The processor 2201 and the interface circuit 2202 may be interconnected through a line. For example, the interface circuit 2202 may be configured to receive a signal from another device (e.g., the memory of the mobile phone 101). As another example, the interface circuit 2202 may be configured to send a signal to another device (e.g., the processor 2201). For example, the interface circuit 2202 may read an instruction stored in the memory and send the instruction to the processor 2201. When the instruction is executed by the processor 2201, the electronic device may perform the steps performed by the mobile phone 101 (e.g., the mobile phone) in the above-mentioned embodiment. Of course, the chip system may further include another discrete device. The embodiment of the present application is not particularly limited thereto.

[0245] An embodiment of the present application further provides an apparatus. The apparatus is included in an electronic device, and the apparatus has a function of implementing the behavior of the electronic device in any manner in the above-mentioned embodiments. The function may be implemented by hardware or by hardware executing corresponding software. The hardware or software includes at least one module or unit corresponding to the above-mentioned function, such as a detection module or unit, a display module or unit, a determination module or unit, and a calculation module or unit.

[0246] An embodiment of the present application further provides a computer storage medium including computer instructions, which when executed on an electronic device, enable the electronic device to perform any of the methods in the above-mentioned embodiments.

[0247] An embodiment of the present application further provides a computer program product, which, when executed on a computer, enables the computer to perform any of the methods in the above-mentioned embodiments.

[0248] An embodiment of the present application further provides a graphical user interface on an electronic device, the electronic device including a display, a camera, a memory, and one or more processors, the one or more processors being configured to execute one or more computer programs stored in the memory; and the graphical user interface includes a graphical user interface that is displayed when the electronic device executes any of the methods in the above-mentioned embodiments.

[0249] It is understood that in order to implement the above-mentioned functions, the terminal or the like includes corresponding hardware structures and / or software modules for performing the functions. Those skilled in the art should easily realize that the units, algorithms, and steps can be implemented by hardware or a combination of hardware and computer software in the embodiments of the present application, in combination with the examples described in the embodiments disclosed herein. Whether the functions are performed by hardware or by hardware driven by computer software depends on the specific application and the design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions for each specific application, but the implementation should not be considered to go beyond the scope of the embodiments of the present invention.

[0250] In the embodiment of the present application, the terminal or the like may be divided into functional modules based on the above-mentioned method examples. For example, each functional module may be obtained through division based on each corresponding function, or two or more functions may be integrated into one processing module. The integrated module may be implemented in the form of hardware or in the form of a software functional module. It should be noted that in the embodiment of the present invention, the module division is an example and is merely a logical function division. In actual implementation, another division method may be used.

[0251] From the above description of implementation, those skilled in the art can clearly understand that for the purpose of convenience and simple description, the above-mentioned division of functional modules is taken as an example for explanation. In practical application, the above-mentioned functions can be allocated to multiple different modules and implemented according to requirements, that is, the internal structure of the device is divided into multiple different functional modules to implement all or some of the above-mentioned functions. For detailed work processes of the above-mentioned system, device and unit, please refer to the corresponding processes in the above-mentioned method embodiment. Here, details will not be described again.

[0252] The functional units in the embodiments of the present application may be integrated into one processing unit, each of these units may exist physically alone, or two or more units may be integrated into one unit. The integrated unit may be implemented in the form of hardware or in the form of a software functional unit.

[0253] When the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, the integrated unit may be stored in a computer-readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application may be essentially implemented in the form of a software product, or the part that contributes to the prior art, or all or some of the technical solutions may be implemented in the form of a software product. The computer software product is stored in a storage medium and includes a plurality of instructions for instructing a computer device (which may be a personal computer, a server, or a network device) or a processor to execute all or some of the steps of the method described in the embodiments of the present application. The above-mentioned storage medium includes any medium that can store program code, such as a flash memory, a removable hard disk, a read-only memory, a random access memory, a magnetic disk, or an optical disk.

[0254] The above description is merely a specific implementation of the present application, and is not intended to limit the protection scope of the present application. Any variation or replacement within the technical scope disclosed in this application shall be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims. [Other possible items] [Item 1] a first electronic device displaying a first interface, where the first interface includes a first control corresponding to the first electronic device and a second control corresponding to a second electronic device, the second electronic device being associated with the first electronic device, and a distance between the first control and the second control being a first distance; receiving a first user operation on the second control by the first electronic device; and determining, in response to the first manipulation, that the first electronic device controls the distance between the first control and the second control to change to a second distance, and that the first electronic device executes a first interaction function with the second electronic device, where the second distance is smaller than the first distance; A method for interaction between electronic devices, comprising: [Item 2] The second electronic device being associated with the first electronic device, the second electronic device and the first electronic device are located in the same communications network; or the second electronic device and the first electronic device are logged into the same account; or the login account of the second electronic device and the login account of the first electronic device belong to the same group; or the second electronic device is connected to a hotspot shared by the first electronic device; or the first electronic device is connected to a hotspot shared by the second electronic device; or The first electronic device and the second electronic device establish a Wi-Fi Direct connection. The method according to item 1, comprising: [Item 3] 3. The method of claim 1 or 2, wherein the first operation includes dragging the second control on the first interface and releasing the second control when the distance between the second control and the first control is less than a first threshold, the first threshold being less than the first distance and the first threshold being greater than or equal to the second distance. [Item 4] 4. The method of claim 3, wherein the dragging of the second control on the first interface includes dragging the second control toward the first control while touching the second control on the first interface. [Item 5] The method further comprises: displaying, by the first electronic device, an interface of the first application while it is running; receiving a second operation by the first electronic device; in response to the second operation, the first electronic device displays an interface of a control center, where the interface of the control center includes a first widget; receiving, by the first electronic device, a third operation for the first widget; and The step of displaying a first interface on the first electronic device further comprises: and in response to the third operation, the first electronic device displays the first interface. having 5. The method according to any one of items 1 to 4. [Item 6] The step of determining that the first electronic device performs a first interaction function with the second electronic device includes: determining, by the first electronic device, the first interaction function based on information about an application currently running on the first electronic device and a device type of the second electronic device; 6. The method according to item 5, comprising the steps of: [Item 7] 7. The method of claim 6, wherein the application currently running on the first electronic device is the first application. [Item 8] After the distance between the first control and the second control is changed to the second distance, the method further comprises: receiving a fourth operation on the second control by the first electronic device; and and in response to the fourth operation, controlling the first electronic device to change the distance between the second control and the first control to the first distance and ceasing to execute the first interaction function with the second electronic device. 8. The method according to any one of items 2 to 7, comprising: [Item 9] The fourth operation is dragging the second control and releasing the second control when a distance between the second control and the first control is greater than a second threshold; or dragging the second control away from the first control while still touching the second control, and releasing the second control when the distance between the second control and the first control is greater than the second threshold. Including, the second threshold is less than or equal to the first distance, and the second threshold is greater than the second distance; The method according to item 8. [Item 10] After the step of controlling the first electronic device to change the distance between the second control and the first control to the first distance, the method further comprises: receiving a fifth operation on the first control by the first electronic device; and in response to the fifth operation, the first electronic device controls the distance between the first control and the second control to change to the second distance, and the first electronic device determines to perform a second interaction function with the second electronic device, or the first electronic device sends a first message to the second electronic device, where the first message instructs the second electronic device to determine a second interaction function to be performed by the second electronic device with the first electronic device. 10. The method according to item 8 or 9, comprising: [Item 11] 11. The method of claim 10, wherein a data transmission direction between the first electronic device and the second electronic device during execution of the first interaction function by the first electronic device and the second electronic device is different from a data transmission direction between the first electronic device and the second electronic device during execution of the second interaction function by the first electronic device and the second electronic device. [Item 12] 12. The method of any one of items 1 to 11, wherein a relative position between the second control and the first control in the first interface is determined based on a relative position between the second electronic device and the first electronic device. [Item 13] Item 13. The method of item 12, wherein the relative position between the second electronic device and the first electronic device includes a relative distance and / or a relative orientation between the second electronic device and the first electronic device in a horizontal direction. [Item 14] The method further comprises: the first electronic device measuring the relative distance between the second electronic device and the first electronic device using a Wi-Fi based positioning technique or a Bluetooth iBeacon based positioning technique; or the first electronic device measuring the relative distance and / or the relative direction between the second electronic device and the first electronic device using a Bluetooth 5.1-based AOA positioning technique and a UWB-based positioning technique; 14. The method according to item 12 or 13, comprising: [Item 15] 15. The method of any one of claims 1 to 14, wherein the first interface further includes a third control corresponding to a third electronic device, the third electronic device being associated with the first electronic device. [Item 16] Item 16. The method of item 15, wherein in the first interface, the third control and the second control are located around the first control. [Item 17] a first electronic device displaying a first interface, where the first interface includes a first control corresponding to the first electronic device, a second control corresponding to a second electronic device, and a third control corresponding to a third electronic device, both the second electronic device and the third electronic device being associated with the first electronic device, and a distance between the second control and the third control is a first distance; receiving a first user operation on the second control by the first electronic device; and In response to the first operation, the first electronic device controls a distance between the second control and the third control to change to a second distance, and the first electronic device determines that the second electronic device performs a first interaction function with the third electronic device, where the second distance is smaller than the first distance. A method for interaction between electronic devices, comprising: [Item 18] The step of the first electronic device determining that the second electronic device performs a first interaction function with the third electronic device includes: sending a first message from the first electronic device to the second electronic device, where the first message instructs the second electronic device to report information about an application currently running on the second electronic device, or sending a second message from the first electronic device to the third electronic device, where the second message instructs the first electronic device to report information about an application currently running on the third electronic device; the first electronic device receiving the information about the application currently running on the second electronic device or the first electronic device receiving the information about the application currently running on the third electronic device; and the first electronic device determining to perform the first interaction function based on the information about the application currently running on the second electronic device and a device type of the third electronic device; or the first electronic device determining to perform the first interaction function based on the information about the application currently running on the third electronic device and a device type of the second electronic device. 18. The method according to item 17, comprising the steps of: [Item 19] The method further comprises, prior to the step of the first electronic device receiving a first user operation on the second control, the method further comprising: the first electronic device receiving information about an application currently running on the second electronic device or the first electronic device receiving information about an application currently running on the third electronic device; Equipped with Next, the step of the first electronic device determining that the second electronic device executes a first interaction function with the third electronic device comprises: the first electronic device determining to perform the first interaction function based on the information about the application currently running on the second electronic device and a device type of the third electronic device; or the first electronic device determining to perform the first interaction function based on the information about the application currently running on the third electronic device and a device type of the second electronic device. having Item 17. The method according to item 17. [Item 20] After the step of the first electronic device determining that the second electronic device performs a first interaction function with the third electronic device, the method further comprises: sending a third message from the first electronic device to the second electronic device or the third electronic device to instruct them to perform the first interaction function; 20. The method of any one of items 17 to 19, further comprising: [Item 21] 21. The method of any one of items 17 to 20, wherein the first operation includes dragging the second control on the first interface and releasing the second control when the distance between the second control and the third control is less than a first threshold, the first threshold being less than the first distance and the first threshold being greater than or equal to the second distance. [Item 22] 22. The method of claim 21, wherein the dragging of the second control on the first interface includes dragging the second control toward the third control while touching the second control on the first interface. [Item 23] After the distance between the second control and the third control is changed to the second distance, the method further comprises: receiving, by the first electronic device, a second operation of the user on the second control; and and in response to the second operation, the first electronic device controls the distance between the second control and the third control to change to the first distance, and the first electronic device sends a fourth message to the second electronic device or the third electronic device to notify them to stop performing the first interaction function. 23. The method according to any one of items 17 to 22, comprising: [Item 24] The second operation is dragging the second control and releasing the second control when the distance between the second control and the third control is greater than a second threshold; or dragging the second control away from the third control while still touching the second control, and releasing the second control when the distance between the second control and the third control is greater than the second threshold. Including, the second threshold is less than or equal to the first distance, and the second threshold is greater than the second distance; Item 24. The method according to item 23. [Item 25] a first electronic device displaying a first interface, where the first interface includes a first control corresponding to the first electronic device, a second control corresponding to a second electronic device, and a third control corresponding to a third electronic device, both the second electronic device and the third electronic device being associated with the first electronic device, and a distance between the second control and the third control is a first distance; receiving a first user operation on the second control by the first electronic device; and In response to the first operation, the first electronic device controls a distance between the second control and the third control to change to a second distance, and the first electronic device sends a first message to the second electronic device or the third electronic device to trigger the second electronic device and the third electronic device to perform a first interaction function, where the second distance is smaller than the first distance. A method for interaction between electronic devices, comprising: [Item 26] 26. The method of claim 25, wherein the first operation includes dragging the second control on the first interface and releasing the second control when the distance between the second control and the third control is less than a first threshold, the first threshold being less than the first distance and the first threshold being greater than or equal to the second distance. [Item 27] 27. The method of claim 26, wherein the dragging of the second control on the first interface includes dragging the second control toward the third control while touching the second control on the first interface. [Item 28] receiving a second operation on the second control by the first electronic device; and and in response to the second operation, the first electronic device controls the distance between the second control and the third control to change to the first distance, and the first electronic device sends a second message to the second electronic device or the third electronic device to instruct them to stop performing the first interaction function. 28. The method of any one of items 25 to 27, further comprising: [Item 29] The second operation is dragging the second control and releasing the second control when the distance between the second control and the third control is greater than a second threshold; or dragging the second control away from the third control while still touching the second control, and releasing the second control when the distance between the second control and the third control is greater than the second threshold. Including, the second threshold is less than or equal to the first distance, and the second threshold is greater than the second distance; Item 29. The method according to item 28. [Item 30] 1. A method for interaction between electronic devices, applied to a first electronic device, comprising: displaying a running interface of the first application; receiving a first operation from a user; displaying an interface of a control center in response to the first operation, where the interface of the control center includes a first widget; receiving a second operation for the first widget; displaying a first interface in response to the second operation, where the first interface includes a first control corresponding to the first electronic device and a second control corresponding to a second electronic device, the second electronic device being associated with the first electronic device, and a distance between the first control and the second control being a first distance; receiving a third operation on the second control on the first interface; and determining, in response to the third operation, to control the second control to be attracted to the first control and to execute a first interaction function with the second electronic device; A method for providing the above. [Item 31] The second electronic device being associated with the first electronic device, the second electronic device and the first electronic device are located in the same communications network; or the second electronic device and the first electronic device are logged into the same account; or The login account of the second electronic device and the login account of the first electronic device belong to the same group. 31. The method according to item 30, comprising: [Item 32] The step of determining to perform a first interaction function with the second electronic device further comprises: determining the first interaction function to perform with the second electronic device based on a type of the second electronic device; or determining the first interaction function to perform with the second electronic device based on the first application and a type of the second electronic device. 32. The method according to item 30 or 31, comprising the steps of: [Item 33] 33. The method according to any one of claims 30 to 32, wherein the first interaction function is one of an audio projection function, a screen projection function, an application handoff function, or a content sharing function. [Item 34] The audio projection function is that the first electronic device transmits audio data of a first audio to the second electronic device so that the second electronic device plays the first audio; The screen projection function is that the first electronic device sends interface data of the first interface to the second electronic device to allow the second electronic device to display the first interface, the interface data of the first interface including a screenshot of the first interface or an instruction for drawing the first interface, and when the first interface is a video image, the interface data of the first interface further includes a playback address of the video image; The application handoff function is for the first electronic device to send information about a second application running on the first electronic device to the second electronic device so that the second electronic device continues to run the second application; and The content sharing function is that the first electronic device transmits a first object to the second electronic device, and the first object includes any one or more of a picture, a video, a file, a text, and an audio; The method according to item 33. [Item 35] 35. The method of any one of items 30 to 34, wherein the third operation includes dragging the second control on the first interface and releasing the second control when the distance between the second control and the first control is less than a first threshold, the first threshold being less than the first distance. [Item 36] After the second control is attracted to the first control, the method further comprises: receiving a fourth operation on the second control by the first electronic device; and and in response to the fourth operation, controlling the first electronic device to change a distance between the second control and the third control to the first distance and ceasing to execute the first interaction function with the second electronic device. 35. The method according to any one of items 30 to 34, comprising: [Item 37] The fourth operation is dragging the second control and releasing the second control when a distance between the second control and the first control is greater than a second threshold; and dragging the second control away from the first control while still touching the second control, and releasing the second control when the distance between the second control and the third control is greater than the second threshold. Including, the second threshold is less than or equal to the first distance; Item 37. The method according to item 36. [Item 38] 38. An electronic device comprising a processor, a memory and a touch screen, the memory and the touch screen being coupled to the processor, the memory being configured to store computer program code, the computer program code comprising computer instructions, and wherein when the processor reads the computer instructions from the memory, the electronic device is enabled to perform the method of any one of items 1 to 37. [Item 39] 38. A computer-readable storage medium comprising computer instructions, which when executed on an electronic device, enable the electronic device to perform the method according to any one of items 1 to 37. [Item 40] 38. A computer program product, which when executed on a computer enables the computer to carry out the method according to any one of items 1 to 37. [Item 41] A chip system comprising one or more processors, the one or more processors executing instructions causing the one or more processors to perform the method according to any one of items 1 to 37.

Claims

1. a first electronic device displaying a first interface, where the first interface includes a first control corresponding to the first electronic device, a second control corresponding to a second electronic device, and a third control corresponding to a third electronic device, the second electronic device being associated with the first electronic device, a distance between the first control and the second control being a first distance, and the third electronic device being associated with the first electronic device, a distance between the first control and the third control being a third distance; and determining, when the first electronic device receives a first user operation on the first control or the second control, that in response to the first operation, the first electronic device controls the first electronic device to change the distance between the first control and the second control to a second distance, and that the first electronic device executes a first interaction function with the second electronic device, where the second distance is smaller than the first distance; or determining, when the first electronic device receives a second operation on the first control or the third control, that in response to the second operation, the first electronic device controls the first electronic device to change the distance between the first control and the third control to a fourth distance, and that the first electronic device executes a second interaction function with the second electronic device, where the fourth distance is smaller than the second distance, and the first interaction function and the second interaction function are different; A method for interaction between electronic devices, comprising:

2. After the step of controlling, in response to the first operation, to change the distance between the first control and the second control to the second distance and determining to execute the first interaction function with the second electronic device, the method further comprises: receiving a third operation on the third control by the first electronic device; and in response to the third operation, the first electronic device controls the first control to change the distance between the first control and the third control to a fifth distance, and the first electronic device determines to perform a third interaction function with the second electronic device and the third electronic device based on a device type of the second electronic device and a device type of the third electronic device, where the fifth distance is smaller than the third distance, and the first interaction function, the second interaction function, and the third interaction function are different. The method of claim 1 , comprising:

3. The second electronic device being associated with the first electronic device the second electronic device and the first electronic device are located in the same communications network; or the second electronic device and the first electronic device are logged into the same account; or The login account of the second electronic device and the login account of the first electronic device belong to the same group; or the second electronic device is connected to a hotspot shared by the first electronic device; or the first electronic device is connected to a hotspot shared by the second electronic device; or The first electronic device and the second electronic device establish a Wi-Fi Direct connection. Including, The third electronic device being associated with the first electronic device, the third electronic device and the first electronic device are located in the same communications network; or the third electronic device and the first electronic device are logged into the same account; or The login account of the third electronic device and the login account of the first electronic device belong to the same group; or the third electronic device is connected to a hotspot shared by the first electronic device; or the first electronic device is connected to a hotspot shared by the third electronic device; or The first electronic device and the third electronic device establish a Wi-Fi Direct connection. Including, The method of claim 1.

4. The first operation is dragging the first control on the first interface and releasing the first control when the distance between the second control and the first control is less than a first threshold, where the first threshold is less than the first distance and the first threshold is greater than or equal to the second distance; or dragging the second control on the first interface and releasing the second control when the distance between the second control and the first control is less than a first threshold, where the first threshold is less than the first distance and the first threshold is greater than or equal to the second distance; The method of claim 1 , comprising:

5. said dragging the first control on the first interface includes dragging the first control towards the second control while touching the first control on the first interface; said dragging the second control on the first interface includes dragging the second control towards the first control while touching the second control on the first interface; The method according to claim 4.

6. The second operation is dragging the first control on the first interface and releasing the first control when the distance between the third control and the first control is less than a second threshold, where the second threshold is less than the third distance and the second threshold is greater than or equal to the fourth distance; or dragging the third control on the first interface and releasing the third control when the distance between the third control and the first control is less than the second threshold, where the second threshold is less than the third distance and the second threshold is greater than or equal to the fourth distance; The method of claim 1 , comprising:

7. said dragging the first control on the first interface includes dragging the first control towards the third control while touching the first control on the first interface; said dragging the third control on the first interface includes dragging the third control towards the first control while touching the third control on the first interface; The method according to claim 6.

8. The step of determining by the first electronic device to perform a first interaction function with the second electronic device further comprises: The first electronic device determines the first interaction function based on information about an application currently running on the first electronic device and a device type of the second electronic device.

2. The method of claim 1, comprising:

9. The method of claim 8 , wherein the application currently running on the first electronic device is a first application.

10. After the distance between the first control and the second control is changed to the second distance, the method further comprises: receiving a fourth operation on the first control or the second control by the first electronic device; and and in response to the fourth operation, controlling the first electronic device to change the distance between the second control and the first control to the first distance and ceasing to execute the first interaction function with the second electronic device. The method of claim 1 , comprising:

11. The fourth operation is dragging the first control or the second control and releasing the second control when the distance between the second control and the first control is greater than a third threshold; or touching and dragging the first control or the second control away from the other of the second control and the first control, and releasing the second control when the distance between the second control and the first control is greater than the third threshold. Including, the third threshold is less than or equal to the first distance, and the third threshold is greater than the second distance; The method of claim 10.

12. a relative position between the second control and the first control in the first interface based on a relative position between the second electronic device and the first electronic device; a relative position between the third control and the first control in the first interface is based on a relative position between the third electronic device and the first electronic device. The method of claim 1.

13. The method of claim 1 , wherein in the first interface, the third control and the second control are located around the first control.

14. 14. An electronic device comprising a processor, a memory and a touch screen, the memory and the touch screen being coupled to the processor, the memory being configured to store computer program code, the computer program code comprising computer instructions, and wherein when the processor reads the computer instructions from the memory, the electronic device is enabled to perform the method of any one of claims 1 to 13.

15. A computer program, which when executed on a computer enables the computer to carry out the method according to any one of claims 1 to 13.

Images