Equipment control method and device, electronic equipment, storage medium, system and computer program product

Abstract

The invention provides a device control method and device, an electronic device, a storage medium, a system and a computer program product, the device control method can be applied to a first device, a communication connection is established between the first device and a second device in advance, and the method can comprise the following steps: responding to a detection result that a preset function is started; at least one selectable device is obtained, and a device selection interface is displayed, and the device selection interface comprises a selection interface of the at least one selectable device; and in response to detecting that a third device in the at least one selectable device is selected, enabling the third device to establish a data transmission connection with the second device so as to transfer a user interaction function of the second device to the third device for implementation. According to the method and the device, interaction and operation control among a plurality of devices can be involved, so that the efficiency and the convenience of operation control on the plurality of devices are improved.

Description

Technical Field

[0001] This disclosure relates to the field of intelligent communication devices, specifically to a device control method, apparatus, electronic device, storage medium, system, and computer program product. Background Technology

[0002] In related technologies, when users leave their phones, they are unable to interact with other devices, including controlling smart home devices or viewing notifications on their phones. In such cases, users need to spend extra time and effort to retrieve their phones to complete these operations, significantly impacting user convenience and efficiency.

[0003] While smartwatches that connect to smartphones have emerged, their limited screen size and functionality prevent them from fully addressing the aforementioned issues. Therefore, existing smart products need to further address this problem to improve user satisfaction and product competitiveness. Summary of the Invention

[0004] The device control method, apparatus, electronic device, storage medium, system, and computer program product provided by the exemplary embodiments of this disclosure can at least solve the above-mentioned technical problems and other technical problems not mentioned above.

[0005] According to one aspect of this disclosure, a device control method is provided, applied to a first device, wherein a communication connection is pre-established between the first device and a second device, the method comprising: in response to detecting that a preset function has been enabled, acquiring at least one optional device and displaying a device selection interface, wherein the device selection interface includes a selection interface for the at least one optional device; and in response to detecting that a third device among the at least one optional device is selected, causing the third device to establish a data transmission connection with the second device to facilitate the transfer of user interaction functions of the second device to the third device for implementation.

[0006] Optionally, the at least one optional device is a device that is simultaneously within the preset range of the first device and the second device and is capable of providing data processing and data transmission functions.

[0007] Optionally, the step of obtaining at least one selectable device and displaying a device selection interface in response to detecting that a preset function has been enabled includes: displaying a notification interface about the preset event when a preset event occurs on the second device, wherein the notification interface of the preset event includes an interface for entering the device selection interface; and obtaining the at least one selectable device and displaying the device selection interface in response to detecting that the interface for entering the device selection interface is selected.

[0008] Optionally, the step of obtaining at least one optional device in response to detecting that a preset function has been enabled includes: receiving a first device information table from the second device in response to detecting that the preset function has been enabled, wherein the first device information table contains information about devices within a preset range of the second device; searching the information of devices within the preset range of the first device to obtain a second device information table; and obtaining the at least one optional device based on the intersection of the first device information table and the second device information table.

[0009] Optionally, the display device selection interface includes: obtaining the current position distribution of the at least one optional device relative to the first device; and drawing the selection interface corresponding to the at least one optional device in the device selection interface based on the position distribution of each of the at least one optional device relative to the first device.

[0010] Optionally, obtaining the current position distribution of the at least one optional device relative to the first device includes: for each device under test among the at least one optional device, calculating the position coordinates of the device under test relative to the first device; saving the position coordinates of each device under test to a pre-set position database; and performing coordinate transformation on the position coordinates of each device under test saved in the position database to obtain the position distribution of the at least one optional device relative to the first device.

[0011] Optionally, the response to detecting that a third device among the at least one selectable device is selected includes: responding to detecting that the third device has been selected among the at least one selectable device by clicking the selection interface of the at least one selectable device; and / or, in the case that the first device is a watch, responding to detecting that the third device has been selected among the at least one selectable device by rotating the dial of the first device.

[0012] Optionally, the method further includes: displaying a control interface, wherein the control interface corresponds to the current usage scenario; and responding to receiving a control command by controlling the user interaction function accordingly.

[0013] Optionally, the step of responding to detecting that a third device among the at least one selectable device is selected, and establishing a data transmission connection between the third device and the second device to transfer the user interaction function of the second device to the third device for implementation, includes: responding to detecting that the third device is selected, sending device information of the third device to the second device to establish a data transmission connection between the second device and the third device based on the device information of the third device; responding to receiving an operation instruction regarding a predetermined function, sending the operation instruction to the second device so that the third device receives the operation instruction from the second device and transfers the user interaction function of the second device to the third device for implementation based on the operation instruction; receiving a response result from the second device regarding the operation instruction; and updating relevant information on device control based on the response result.

[0014] According to another aspect of this disclosure, a device control method is also provided, applied to a second device, wherein a communication connection is pre-established between the second device and a first device, the method comprising: when a third device is selected from at least one optional device displayed by the first device, establishing a data transmission connection with the third device to transfer user interaction functions of the second device to the third device for implementation.

[0015] Optionally, the at least one optional device is a device that is simultaneously within the preset range of the first device and the second device and is capable of providing data processing and data transmission functions.

[0016] Optionally, the method further includes: in response to detecting a preset event, sending a notification to the first device to display the at least one optional device on the first device based on the notification.

[0017] Optionally, the method further includes: when the first device detects that a preset function has been enabled, sending a device information table to the first device, wherein the device information table contains information about devices within a preset range of the second device, and the device information table is used to obtain at least one optional device, so as to display the selection interface corresponding to the at least one optional device on the first device.

[0018] Optionally, establishing a data transmission connection with the third device includes: receiving device information of the third device from the first device; and establishing a data transmission connection with the third device based on the device information of the third device.

[0019] Optionally, the method further includes: monitoring the status of the data transmission connection to obtain status information of the data transmission connection; and sending the status information of the data transmission connection to the first device so that the first device can display the status information of the data transmission connection.

[0020] Optionally, the method further includes: receiving an operation instruction from the first device regarding the flow of user interaction functions; sending the operation instruction to the third device based on the data transmission connection, so that the third device executes the operation instruction; and sending a response result regarding the operation instruction to the first device, so that the first device updates relevant information on device control based on the response result.

[0021] According to another aspect of the present disclosure, a device control apparatus is also provided, applied to a first device, wherein a communication connection is pre-established between the first device and a second device. The apparatus includes: a device selection unit configured to: in response to detecting that a preset function has been enabled, acquire at least one optional device and display a device selection interface, wherein the device selection interface includes a selection interface for the at least one optional device; and a function transfer unit configured to: in response to detecting that a third device among the at least one optional device is selected, cause the third device to establish a data transmission connection with the second device so as to transfer the user interaction function of the second device to the third device for implementation.

[0022] Optionally, the at least one optional device is a device that is simultaneously within the preset range of the first device and the second device and is capable of providing data processing and data transmission functions.

[0023] Optionally, the device selection unit is configured to: display a notification interface about the preset event when a preset event occurs on the second device, wherein the notification interface of the preset event includes an interface for accessing the device selection interface; and, in response to detecting that the interface for accessing the device selection interface is selected, obtain the at least one selectable device and display the device selection interface.

[0024] Optionally, the device selection unit is configured to: in response to detecting that the preset function has been enabled, receive a first device information table from the second device, wherein the first device information table contains information about devices within a preset range of the second device; search the information of devices within the preset range of the first device to obtain a second device information table; and obtain the at least one selectable device based on the intersection of the first device information table and the second device information table.

[0025] Optionally, the device selection unit is configured to: obtain the current position distribution of the at least one optional device relative to the first device; and draw the selection interface corresponding to the at least one optional device in the device selection interface based on the position distribution of each of the at least one optional device relative to the first device.

[0026] Optionally, the device selection unit is configured to: for each device under test among the at least one selectable device, calculate the position coordinates of the device under test relative to the first device; save the position coordinates of each device under test to a pre-set position database; and perform coordinate transformation on the position coordinates of each device under test saved in the position database to obtain the position distribution of the at least one selectable device relative to the first device.

[0027] Optionally, the function flow unit is configured to: in response to detecting that the third device has been selected from the at least one optional device by clicking the selection interface of the at least one optional device; and / or, in the case that the first device is a watch, in response to detecting that the third device has been selected from the at least one optional device by rotating the dial of the first device.

[0028] Optionally, the device further includes a device control unit configured to: display a control interface, wherein the control interface corresponds to the current usage scenario; and, in response to receiving a control command, perform corresponding control on the user interaction function.

[0029] Optionally, the function transfer unit is configured to: in response to detecting that the third device is selected, send device information of the third device to the second device to establish a data transmission connection between the second device and the third device based on the device information of the third device; in response to receiving an operation instruction regarding a predetermined function, send the operation instruction to the second device so that the third device receives the operation instruction from the second device and transfers the user interaction function of the second device to the third device for implementation based on the operation instruction; receive a response result from the second device regarding the operation instruction; and update relevant information on device control based on the response result.

[0030] According to another aspect of the present disclosure, a device control apparatus is also provided, applied to a second device, wherein a communication connection is pre-established between the second device and a first device. The apparatus includes a function transfer unit configured to: when a third device is selected from at least one selectable device displayed by the first device, establish a data transmission connection with the third device to transfer user interaction functions of the second device to the third device for implementation.

[0031] Optionally, the at least one optional device is a device that is simultaneously within the preset range of the first device and the second device and is capable of providing data processing and data transmission functions.

[0032] Optionally, the apparatus further includes a notification sending unit configured to: in response to detecting the occurrence of a preset event, send a notification to the first device to display the at least one optional device on the first device based on the notification.

[0033] Optionally, the device further includes a device information sending unit configured to: when the first device detects that a preset function has been enabled, send a device information table to the first device, wherein the device information table contains information about devices within a preset range of the second device, and the device information table is used to obtain at least one optional device, so as to display the selection interface corresponding to the at least one optional device on the first device.

[0034] Optionally, the functional transfer unit is configured to: receive device information of the third device from the first device; and establish a data transmission connection with the third device based on the device information of the third device.

[0035] Optionally, the device further includes a connection status monitoring unit, configured to: monitor the status of the data transmission connection to obtain status information of the data transmission connection; and send the status information of the data transmission connection to the first device so that the first device can display the status information of the data transmission connection.

[0036] Optionally, the device further includes an operation instruction response unit, configured to: receive an operation instruction from the first device regarding the flow of user interaction functions; send the operation instruction to the third device based on the data transmission connection, so that the third device executes the operation instruction; and send a response result regarding the operation instruction to the first device, so that the first device updates relevant information for device control based on the response result.

[0037] According to another aspect of the present disclosure, an electronic device is also provided, comprising: at least one processor; and at least one memory storing computer-executable instructions, wherein the computer-executable instructions, when executed by the at least one processor, cause the at least one processor to perform the device control method described in any of the preceding claims.

[0038] According to another aspect of the present disclosure, a computer-readable storage medium storing instructions that, when executed by at least one processor, cause the at least one processor to perform the device control method as described in any of the preceding claims.

[0039] According to another aspect of the present disclosure, a system is also provided that includes at least one computing device and at least one storage device for storing instructions, wherein the instructions, when executed by the at least one computing device, cause the at least one computing device to perform the device control method as described in any of the above.

[0040] According to another aspect of the embodiments of this disclosure, a computer program product is also provided, including computer instructions that, when executed by at least one processor, implement the device control method as described in any of the above.

[0041] The technical solutions provided in this disclosure offer at least the following beneficial effects:

[0042] The device control method, apparatus, electronic device, storage medium, system, and computer program product disclosed herein can be used to control the interaction and operation of multiple devices, thereby improving the efficiency and convenience of operating and controlling multiple devices. Specifically, a first device can select a third device to invoke hardware of the selected third device, including but not limited to cameras, screens, microphones, etc. Furthermore, when a second device needs to invoke the corresponding hardware, the third device actually executes the invocation of the corresponding hardware, thereby achieving efficient and convenient device use in conjunction with the application scenario. Attached Figure Description

[0043] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure, and are not intended to unduly limit this disclosure.

[0044] Figure 1 The illustration shows a scenario of multi-camera shooting and remote call answering in related technologies;

[0045] Figure 2 A flowchart illustrating a device control method applied to a first device in an exemplary embodiment of this disclosure is shown;

[0046] Figure 3 This diagram illustrates a first device receiving a video call notification in an exemplary embodiment of this disclosure.

[0047] Figure 4 A schematic diagram illustrating the acquisition of at least one optional device in an exemplary embodiment of this disclosure is shown;

[0048] Figure 5 A schematic diagram illustrating at least one optional device displayed on a watch in an exemplary embodiment of this disclosure;

[0049] Figure 6This diagram illustrates the acquisition of the orientation of the device under test relative to the first device using three antennas of the first device in an exemplary embodiment of this disclosure.

[0050] Figure 7 A schematic diagram showing the orientation of an optional device in an exemplary embodiment of this disclosure;

[0051] Figure 8 This illustration shows a schematic diagram of selecting optional devices by clicking an icon in an exemplary embodiment of this disclosure;

[0052] Figure 9 A schematic diagram illustrating an exemplary embodiment of this disclosure of selecting an optional device by rotating a dial;

[0053] Figure 10 This diagram illustrates the switching of preset hardware in a live streaming scenario, as shown in an exemplary embodiment of this disclosure.

[0054] Figure 11 This diagram illustrates the switching of preset hardware in a video call scenario according to an exemplary embodiment of this disclosure.

[0055] Figure 12 This illustration shows a schematic diagram of switching and calling preset hardware between a second device and a third device in a live streaming scenario in an exemplary embodiment of this disclosure;

[0056] Figure 13 This diagram illustrates how a first device controls a second device and a third device, as well as the connection status between the second device and the third device, in an exemplary embodiment of this disclosure.

[0057] Figure 14 This illustration shows a multi-device interaction system architecture diagram including a first device, a second device, and at least one optional device in an exemplary embodiment of this disclosure;

[0058] Figure 15 A timing diagram is shown for a multi-camera system, including a second device and a third device, controlled by a first device in an exemplary embodiment of this disclosure.

[0059] Figure 16 A timing diagram is shown in an exemplary embodiment of this disclosure, illustrating a call management process controlled by a first device, including a second device and a third device.

[0060] Figure 17 A flowchart illustrating a device control method applied to a second device in an exemplary embodiment of this disclosure is shown;

[0061] Figure 18 A block diagram of a device control apparatus applied to a first device is shown in an exemplary embodiment of this disclosure;

[0062] Figure 19 A block diagram illustrating a device control apparatus applied to a second device in an exemplary embodiment of this disclosure is shown;

[0063] Figure 20 A block diagram illustrating an electronic device according to an exemplary embodiment of the present disclosure. Detailed Implementation

[0064] To enable those skilled in the art to better understand the technical solutions of this disclosure, the technical solutions in the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings.

[0065] It should be noted that the terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this disclosure are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this disclosure described herein can be implemented in orders other than those illustrated or described herein. The embodiments described in the following examples do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.

[0066] It should be noted that the phrase "at least one of several items" in this disclosure refers to three parallel cases: "any one of the several items", "a combination of any number of the several items", and "all of the several items". For example, "including at least one of A and B" includes the following three parallel cases: (1) including A; (2) including B; (3) including A and B. As another example, "performing at least one of step one and step two" indicates the following three parallel cases: (1) performing step one; (2) performing step two; (3) performing both step one and step two.

[0067] Smart products are becoming an indispensable part of people's daily lives; however, there are still some pain points to be addressed in the development of these products. One major issue relevant to this disclosure is that users cannot directly interact with other devices using their phones when they are away from them. This includes the inability to control smart home devices or view notifications on the phone.

[0068] While smartwatches that connect to smartphones already exist, their small screen size and limited functionality prevent them from fully addressing the issues in certain scenarios. Users often need to spend extra time and effort retrieving their phones to complete these operations, significantly impacting the convenience and efficiency of device use. Therefore, existing smart products need to further address this problem to improve user satisfaction and product competitiveness.

[0069] The video call streaming function in related technologies can support streaming video from a mobile phone to surrounding devices and utilize the hardware capabilities of those devices. Currently supported devices include mobile phones, tablets, and drones, with more devices such as watches to be added in the future. However, watches, being the hardware device most commonly found closest to the user, currently do not support directly receiving video call streams due to limitations in their screen size and functionality; watches are more often positioned as smart assistive devices.

[0070] The multi-camera collaboration (MCC) function in related technologies enables the use of nearby cameras for photography. In multi-camera scenarios, since the camera is not near the user, situations often arise where the camera cannot be operated. Therefore, this publication explores the possibility of using nearby devices for operation in such cases.

[0071] It is clear that the problems encountered in the above scenarios require a multi-device interactive operating system to solve.

[0072] This disclosure provides a detailed analysis of the above scenarios:

[0073] When a user leaves their phone, they can no longer use the phone's normal functions. This means that the user needs to go to retrieve the phone in person to complete the relevant operations, which not only wastes the user's time but may also disrupt their current plans and potentially cause security problems.

[0074] Figure 1 The illustration shows a scenario of multi-camera shooting and remote call answering in related technologies.

[0075] For example, examples may include, but are not limited to, the following related scenarios:

[0076] Case 1, refer to Figure 1 In (a) of the live broadcast, users can use the MCC (Multi-Camera Control) function to shoot from multiple cameras, but the cameras are not located near the user. The user needs to move around to operate and switch and adjust the cameras, which is quite troublesome.

[0077] Case 2, refer to Figure 1 In case (b) of a video call, the phone may not be with the user at all times. For example, the user may be watching TV on the sofa while the phone is on the dining table. If the user wants to answer the video call, they need to go to the dining room to get their phone, and they cannot answer the call immediately.

[0078] It's clear that a current pain point for smart products is that users cannot interact with other devices using their phones when the phone isn't readily available. While watches can connect to phones, limitations in functionality and screen size—for example, most watches don't support camera functions—prevent direct video calls. Therefore, current technologies cannot fully resolve the issues present in scenarios including, but not limited to, those mentioned above.

[0079] To address the aforementioned issues, this disclosure provides a device control method, apparatus, electronic device, storage medium, system, and computer program product, which can involve the interaction and operation control between multiple devices, thereby improving the efficiency and convenience of operating and controlling multiple devices. Specifically, a first device can select a third device to invoke hardware of the selected third device, including but not limited to cameras, screens, speakers, microphones, etc. Furthermore, when a second device needs to invoke the corresponding hardware, the third device actually executes the invocation of the corresponding hardware, thus achieving efficient and convenient device use tailored to the application scenario.

[0080] Below, we will refer to Figures 2 to 20 This disclosure specifically describes the device control methods, apparatus, electronic devices, storage media, systems, and computer program products.

[0081] According to exemplary embodiments of this disclosure, the first device can provide data processing and data transmission functions, and may be, but is not limited to, devices such as watches, smart pens, smart remote controls, and smart rings. It may have characteristics such as being frequently carried or used by the user, but these characteristics should not be construed as limiting the first device. The first device may interact with the user through one or more of the following methods: screen display, audio prompts, touch input, button input, and audio input.

[0082] According to an exemplary embodiment of this disclosure, this disclosure provides a device control method that can be applied to a first device.

[0083] Figure 2 A flowchart illustrating a device control method applied to a first device in an exemplary embodiment of this disclosure is shown.

[0084] Reference Figure 2 In step 201, in response to detecting that a preset function has been enabled, at least one optional device can be acquired and a device selection interface can be displayed, wherein the device selection interface includes a selection interface for at least one optional device.

[0085] According to exemplary embodiments of this disclosure, a preset function may be a function implemented by transferring the user interaction function of the device to another device selected by the user, as described in exemplary embodiments of this disclosure. For example, the user can activate the preset function of exemplary embodiments of this disclosure by issuing voice commands, clicking control buttons, or other feasible means. As another example, the preset function may be automatically activated in response to a preset event (e.g., a call event) occurring on a second device.

[0086] According to exemplary embodiments of this disclosure, the second device can provide data processing and data transmission functions, and may be a smartphone, smart tablet, computer, or other device. A communication connection can be pre-established between the first and second devices, and the connection method is not limited to various wireless or wired methods, such as Bluetooth, Bluetooth Low Energy (BLE), data cable, and Wi-Fi.

[0087] According to an exemplary embodiment of this disclosure, when a preset function is enabled, a notification regarding the occurrence of a preset event on the second device can be displayed, including an interface for accessing a device selection interface, if the second device detects that a preset event has occurred. According to an exemplary embodiment of this disclosure, a notification interface regarding the preset event can be displayed when the second device experiences a preset event, wherein the notification interface for the preset event includes an interface for accessing a device selection interface; in response to detecting that the interface for accessing the device selection interface has been selected, at least one selectable device can be obtained and the device selection interface can be displayed.

[0088] According to exemplary embodiments of this disclosure, the preset event may be receiving a voice or video call, or other related events. The solution of this disclosure can be described in detail when the first device is a watch and the second device is a smartphone.

[0089] Figure 3 This diagram illustrates a first device receiving a video call notification in an exemplary embodiment of this disclosure.

[0090] Reference Figure 3 According to an exemplary embodiment of this disclosure, when a preset event is a video call, and a video call occurs on the second device 301, the first device 302 can display a notification interface regarding this video call. This notification interface may include an interface 303 for accessing a device selection interface. After the user clicks on interface 303, in response to detecting that the interface 303 for accessing the device selection interface has been selected, at least one selectable device can be obtained and the device selection interface can be displayed.

[0091] According to an exemplary embodiment of this disclosure, in response to detecting that a preset function has been enabled, obtaining at least one optional device may include, but is not limited to, the following steps: in response to detecting that a preset function has been enabled, receiving a first device information table from a second device, wherein the first device information table may contain information about devices within a preset range of the second device; searching the information of devices within the preset range of the first device to obtain a second device information table; and obtaining at least one optional device based on the intersection of the first device information table and the second device information table.

[0092] Figure 4 A schematic diagram illustrating the acquisition of at least one optional device is shown in an exemplary embodiment of this disclosure.

[0093] Reference Figure 4 According to exemplary embodiments of this disclosure, in response to detecting that a preset function has been enabled, watch 401 and mobile phone 402 respectively search for nearby devices. For example, they can search for nearby devices using BLE technology to obtain at least one selectable device. Figure 4 The text indicates that watch 401 found nearby devices including speaker 1, TV 1, and mobile phone 2, while mobile phone 402 found nearby devices including mobile phone 1, mobile phone 2, and watch 401.

[0094] Mobile phone 402 can send a first device information table to watch 401 via Wi-Fi, Bluetooth, or other transmission methods. This first device information table can include information about devices within a preset range of mobile phone 402, that is, information about devices near mobile phone 402. Before and after receiving the first device information table, watch 401 can search for information about devices within the preset range, that is, watch 401 searches for information about devices in its vicinity to obtain a second device information table. The device-related information in the first and second device information tables can include, but is not limited to, one or more of the following: device location information, model information, and address information. Watch 401 can filter the second device information table based on the first device information table, or watch 401 can take the intersection of the first and second device information tables to retain at least one selectable device that both watch 401 and mobile phone 402 can search from nearby devices and supports hardware transfer. For example... Figure 4 The mobile phone 2 mentioned above is at least one of the optional devices.

[0095] According to an exemplary embodiment of this disclosure, at least one optional device is a device that is simultaneously within a preset range of the first device and the second device and is capable of providing data processing and data transmission functions.

[0096] According to an exemplary embodiment of this disclosure, the intersection of the nearby devices scanned by watch 401 and mobile phone 402 can be obtained by matching MAC (Media Access Control Address, also known as LAN Address) to obtain the nearby devices jointly scanned by watch 401 and mobile phone 402. For example, the MAC address information for the devices scanned by watch 401 can be as follows:

[0097]

[0098]

[0099] For devices detected by a 402 scan on a mobile phone, the MAC address information can be as follows:

[0100] Devices scanned by mobile phone 402 MAC address Mobile Phone 1 1a48ca4198999899 Mobile Phone 2 1a48ca4199976553 Watch 401 1a48ca4199976549

[0101] By matching the MAC address, it can be determined that mobile phone 2 is a device scanned by both watch 401 and mobile phone 402. Therefore, mobile phone 2 can be displayed as an optional device on the device selection interface of watch 402, so that the user's selection command for mobile phone 2 can be received through the selection interface of optional device mobile phone 2 included in the device selection interface.

[0102] Figure 5 A schematic diagram showing at least one optional device on a watch is illustrated in an exemplary embodiment of this disclosure.

[0103] Reference Figure 5 According to an exemplary embodiment of this disclosure, when the watch, acting as the first device, obtains device information for at least one optional device, it can display the at least one optional device. For example, when the at least one optional device includes multiple devices such as device A, device B, and device C, the icons of each device can be displayed sequentially on the watch face 500. Each icon can represent a selection interface for selecting the corresponding device. It is understood that the display format is not limited to device names, icons, name + icon, or other identifiers, and can also be other feasible display formats.

[0104] According to an exemplary embodiment of this disclosure, displaying a device selection interface may include, but is not limited to, the following steps: obtaining the current position distribution of at least one optional device relative to a first device; and drawing selection interfaces corresponding to at least one optional device in the device selection interface based on the position distribution of each of the at least one optional device relative to the first device.

[0105] According to exemplary embodiments of this disclosure, the selection interfaces corresponding to at least one optional device can be displayed separately in the device selection interface based on the current position distribution of at least one optional device relative to the first device, thereby optimizing interaction and improving interaction efficiency.

[0106] According to an exemplary embodiment of this disclosure, obtaining the current position distribution of at least one optional device relative to a first device may include, but is not limited to, the following steps: for each device under test among the at least one optional device, the position coordinates of the device under test relative to the first device may be calculated; the position coordinates of each device under test may be saved to a pre-set position database; and the position coordinates of each device under test saved in the position database may be transformed to obtain the position distribution of at least one optional device relative to the first device in the same coordinate system.

[0107] According to exemplary embodiments of this disclosure, a scheme in which at least one optional device is displayed directionally on a first device can be implemented using a UWB (Ultra Wideband) module. Specifically, for each device under test among the first device and at least one optional device, the following examples are possible:

[0108] Module 1 (the UWB module in the first device) and Module 2 (the UWB module of the device under test) are two UWB modules. Ranging can be initiated by Module 1 first. After Module 2 receives the data, it sends back a response. Module 1, upon receiving this response, can then initiate another transmission to Module 2 to complete one ranging operation. Each time Module 1 sends and receives data, a timestamp is recorded. Therefore, the flight time can be calculated using the following formula.

[0109]

[0110] In the above formula, T round1 T represents the round-trip time of the first round of signal transmission, i.e., the time it takes for module 1 to send a signal to module 2, and then for module 2 to immediately return a signal to module 1; round2 This represents the round-trip time of the second round of signal transmission, which is the opposite of the first round. This time, it is the time it takes for module 2 to send a signal to module 1, and then for module 1 to return a signal to module 2; T reply1 This indicates the time from when module 2 receives the signal from module 1 to when it sends a reply to module 1; T reply2 This indicates the time from when module 1 receives the signal from module 2 until it sends a reply to module 2.

[0111] The above formula is used to calculate the time of flight for data transmission in two-way time-delay ranging, also known as double-sided two-way ranging (DS-TWR). In DS-TWR, two devices can send and receive data packets to each other to measure the distance between them. This formula calculates the time it takes for a signal to travel from one device to another using the measured timestamps.

[0112] The above formula for calculating time of flight takes into account the total response time for both round trips and yields the pure signal time of flight by subtracting the processing time (the time it takes for the sending and receiving devices to process the signal). This provides a more accurate reflection of the time required for the signal to propagate between the two devices because it eliminates the delay caused by the devices processing the signal. This time of flight is typically used to calculate the actual physical distance between the two devices because the speed of signal propagation is known (e.g., close to the speed of light in air).

[0113] Once the flight time is obtained, multiplying the flight time by the speed of light will give the distance between the devices.

[0114] Figure 6 This diagram illustrates how the orientation of the device under test relative to the first device is obtained through three antennas of the first device in an exemplary embodiment of this disclosure.

[0115] Reference Figure 6 According to an exemplary embodiment of this disclosure, the distances (r1, r2, r3) from the three antennas (A, B, C) in the first device to point M of the device under test can be measured, and the coordinates (x, y) of point M of the device under test can be obtained. It is understood that one or more antennas can be used for calculation, and multiple antennas have higher accuracy than one.

[0116] According to an exemplary embodiment of this disclosure, a location database can be pre-established to establish a correspondence between the known measured location and ID encoding of at least one optional device, and the correspondence can be stored in the pre-established location database to facilitate data management and retrieval.

[0117] According to an exemplary embodiment of this disclosure, by performing coordinate transformation on the position coordinates of each device under test stored in the location database, the position distribution of at least one optional device relative to the first device can be obtained in the same coordinate system. Furthermore, based on the position information of each optional device relative to the first device, a distribution map of the corresponding optional device relative to the first device can be drawn within the first device. Since each optional device has corresponding position coordinate information relative to the first device, the relative positions of each device can be drawn within the same coordinate system.

[0118] Figure 7A schematic diagram showing the orientation of an optional device in an exemplary embodiment of this disclosure is illustrated.

[0119] Reference Figure 7 According to an exemplary embodiment of this disclosure, when the first device is a watch, if the optional device is a mobile phone 2, an icon of the mobile phone 2 can be displayed on the watch face to indicate the relative position of the optional device with respect to the watch. For example, when the watch is at position 1 relative to the mobile phone 2, the icon of the optional device mobile phone 2 can be displayed at position 701 on the watch face; when the watch is at position 2 relative to the mobile phone 2, the icon of the optional device mobile phone 2 can be displayed at position 702 on the watch face.

[0120] Return to reference Figure 2 In step 202, in response to detecting that a third device among at least one optional device is selected, the third device establishes a data transmission connection with the second device to facilitate the transfer of user interaction functions of the second device to the third device for implementation.

[0121] According to an exemplary embodiment of this disclosure, in response to detecting that a third device among at least one optional device is selected, preset hardware of the third device can be invoked. This allows the third device to execute the invocation of the preset hardware when the second device needs to invoke it, thereby transferring the user interaction functions of the second device to the third device for implementation. In one example, preset software can also be invoked simultaneously or separately through the third device to transfer the user interaction functions of the second device to the third device for implementation.

[0122] According to an exemplary embodiment of this disclosure, when a selection of any device from the optional devices is detected, the selected device can be represented by a third device. The first device can invoke preset hardware of the third device, wherein the preset hardware may include, but is not limited to, one or more of the following: a camera, a speaker, a microphone, a display screen, etc. So that when the second device needs to invoke any one or more of the above hardware, the invocation of the corresponding hardware in the third device is actually performed by the third device.

[0123] According to exemplary embodiments of this disclosure, in response to detecting that a third device among at least one optional device is selected, the following steps may be included, but are not limited to: in response to detecting that a third device has been selected among at least one optional device by clicking or long-pressing the selection interface of at least one optional device; and / or, in the case that the first device is a watch, in response to detecting that a third device has been selected among at least one optional device by rotating the dial of the first device.

[0124] According to an exemplary embodiment of this disclosure, when the first device includes a display screen, any one or more third devices can be selected by clicking or long-pressing the icon corresponding to the selection interface of at least one optional device.

[0125] Figure 8 This illustration shows a schematic diagram of selecting an optional device by clicking an icon in an exemplary embodiment of this disclosure.

[0126] For example, you can refer to Figure 8 (a) When the first device is a watch, the icon of the optional device phone 2 can be clicked on the device selection interface 800 via touch or other means, or the optional device phone 2 can be selected via other means not limited to clicking. After detecting that any optional device has been selected as a third device by clicking, scene-related confirmation information 801 can be displayed. For example, refer to Figure 8 In scenario (b), where the default hardware is a camera, a prompt message such as "Confirm to switch the camera of the main phone to the camera of phone 2?" can be displayed to further confirm whether the camera of the main phone, which is the second device, is switched to the camera of phone 2, which is the third device; the confirmation command of the prompt message can be received through interface 802.

[0127] Figure 9 This illustration shows a schematic diagram of an exemplary embodiment of the present disclosure, in which an optional device is selected by rotating a dial.

[0128] Reference Figure 9 According to an exemplary embodiment of this disclosure, when the first device is a watch and includes a dial rotation function, the device to which the pointer points can be controlled by rotating the dial to select a third device from at least one selectable device. For example, refer to... Figure 9 (a) allows users to select the optional device, mobile phone 2, from the device selection interface 800 by rotating the dial. After detecting that any optional device has been selected as a third device by rotating the dial, scene-related confirmation information 801 can be displayed. For example, refer to... Figure 9 In scenario (b), where the default hardware is a camera, a prompt message such as "Confirm to switch the camera of the main phone to the camera of phone 2?" can be displayed to further confirm whether the camera of the main phone, which is the second device, is switched to the camera of phone 2, which is the third device; the confirmation command of the prompt message can be received through interface 802.

[0129] According to an exemplary embodiment of this disclosure, once the prompt message is confirmed, a data transmission connection, such as Wi-Fi, is established between the main mobile phone (the second device) and the mobile phone 2 (the third device). It is understood that confirmation via prompt message can also be omitted to shorten the interaction path, allowing for direct selection of the third device from at least one selectable device via clicking, rotating a dial, or similar methods.

[0130] According to an exemplary embodiment of this disclosure, when a third device is selected from at least one optional device, the preset hardware in the second device will be replaced by the corresponding preset hardware in the third device during hardware invocation.

[0131] Figure 10 This diagram illustrates the switching of preset hardware in a live streaming scenario, as shown in an exemplary embodiment of this disclosure.

[0132] Reference Figure 10 According to exemplary embodiments of this disclosure, in scenarios such as live streaming, multiple shooting devices can be placed in multiple locations to provide different shooting perspectives. For example, mobile phone 1000, as a second device, can serve as a shooting position, acting as a host to capture the scene from perspective 1001. Mobile phone 2, as a third device, can serve as another shooting position to capture the scene from perspective 1002. Furthermore, the main mobile phone 1000 can be used to run live streaming software for live streaming. If a third device is selected from at least one optional device, the camera in the main mobile phone 1000 (as the second device) will be replaced by the corresponding camera in the third mobile phone 2. This allows the shooting position of the live stream to be switched from the main mobile phone 1000 to the mobile phone 2 without interrupting or pausing the live stream on the main mobile phone 1000, i.e., switching the scene from perspective 1001 to perspective 1002.

[0133] Figure 11 This diagram illustrates the switching of preset hardware in a video call scenario, as shown in an exemplary embodiment of this disclosure.

[0134] Reference Figure 11According to an exemplary embodiment of this disclosure, in a video call scenario, when the mobile phone 1101, acting as the second device, receives a video call, the watch 1102, acting as the first device, can select the television 1103 as the third device from at least one optional device. At this time, the mobile phone 1101, acting as the second device, can still continue to run the video call application to answer the video call, but one or more hardware components such as the camera, speaker, microphone, and display required by the mobile phone 1101 to run the video call application can be switched to the corresponding hardware of the television 1103, acting as the third device. This allows the user to make video calls using the camera, speaker, microphone, and display of the television 1103, which is more convenient for the user, when the mobile phone is not nearby.

[0135] According to exemplary embodiments of this disclosure, the above method also includes, but is not limited to, the following steps: projecting the audiovisual media presented on the second device onto the third device for presentation.

[0136] Based on exemplary embodiments of this disclosure, reference can be made to Figure 11 The audio-visual media displayed on the mobile phone 1101 (the second device) can be projected onto the television 1103 (the third device) by using the display of the television 1103 (the third device). For example, the video call interface 1105 displayed on the mobile phone 1101 can be projected onto area 1104 of the television 1103. Before and after selecting the television 1103 (the third device) to switch to the preset hardware, the user can view the current application running on the mobile phone 1101 (the second device) and the preset hardware displayed on the television 1103 (the third device) on the television 1103 (the third device).

[0137] According to exemplary embodiments of this disclosure, the above method also includes, but is not limited to, the following steps: displaying a control interface, wherein the control interface corresponds to the current usage scenario; and, in response to receiving a control command, performing corresponding control on the user interaction functions.

[0138] According to exemplary embodiments of this disclosure, a control interface for calling and controlling preset hardware can be displayed in the first device according to the current usage scenario. This interface may include, but is not limited to, receiving instructions to switch between calling the preset hardware between the second device and the third device, receiving instructions to preview the corresponding effects produced by calling the preset hardware in the second device or the third device, and receiving instructions to control the connection status between the second device and the third device. In response to receiving control instructions, the user interaction functions can be controlled accordingly.

[0139] According to exemplary embodiments of this disclosure, a control interface for controlling the invocation of preset hardware is shown, including but not limited to the following steps: demonstrating the function of switching the invocation of preset hardware between a second device and a third device; and / or, when the preset hardware includes a camera, displaying a preview image generated by the second device and / or the third device invoking the camera; and / or, receiving status information of the data transmission connection between the second device and the third device from the second device; displaying the status information of the data transmission connection; and demonstrating the function of controlling the status of the data transmission connection, wherein the data transmission connection is used to transmit instruction messages to invoke the preset hardware of the third device.

[0140] Figure 12 This illustration shows a schematic diagram of switching and calling preset hardware between a second device and a third device in a live streaming scenario in an exemplary embodiment of this disclosure.

[0141] Reference Figure 12 According to an exemplary embodiment of this disclosure, when the first device is a watch, and the second and third devices are mobile phones used to capture images from different perspectives in a live streaming scenario, with a camera as the preset hardware, the watch, which serves as the first device, can display... Figure 12 The control interface 1200 shown in (a) indicates that the current access to the camera hardware can be switched between IDs “My Phone” and “Phone 2” via camera identifier 1201, My Phone option 1202, and Phone 2 option 1203.

[0142] According to an exemplary embodiment of this disclosure, when the preset hardware includes a camera, a preview image generated by selecting a second and / or third device in a first device and correspondingly calling the camera through the second and / or third device can be displayed in the first device. (Refer to...) Figure 12 In (b), after selecting "Mobile Phone 2", you can view the preview screen 1204 of the corresponding camera angle of "Mobile Phone 2".

[0143] If the first device and the second device are connected via Bluetooth, due to bandwidth limitations, the preview screen will be a screenshot of the preview interface transmitted at regular intervals, rather than a video stream.

[0144] Figure 13 This diagram illustrates how a first device controls a second device and a third device, as well as the connection status between the second device and the third device, in an exemplary embodiment of this disclosure.

[0145] According to an exemplary embodiment of this disclosure, a first device can receive status information of the data transmission connection between the second device and the third device from a second device, and can display the status information of the data transmission connection between the second device and the third device in the first device. The first device can display a function to control the status of the data transmission connection between the second device and the third device, in order to receive instructions to control the status of the data transmission connection between the second device and the third device, for example, referring to... Figure 13 The system can display an identifier 1301 and a status control interface 1302 marked "Disconnect" to indicate that the current third device is a television set and that the second and third devices are currently connected. Clicking the status control interface 1302 marked "Disconnect" will disconnect the connection between the second and third devices. The data transmission connection between the second and third devices is established when the third device is selected and can be used to transmit instruction messages from the first device to invoke the preset hardware of the third device.

[0146] Furthermore, the status of the second and third devices can be controlled separately through other control interfaces. For example, refer to... Figure 12 The identifier 1303 indicates that the current second device is a mobile phone. The volume of the second and third devices can be controlled using the volume sliders to the right of identifiers 1303 and 1304, respectively. Indicators related to call status can also be displayed; for example, the call hang-up identifier 1305 indicates that a call is currently in progress, and the call can be ended by clicking the call hang-up identifier 1305.

[0147] Figure 14 This illustration shows a multi-device interaction system architecture diagram including a first device, a second device, and at least one optional device in an exemplary embodiment of this disclosure.

[0148] Reference Figure 14According to exemplary embodiments of this disclosure, the first device in the multi-device interaction system can be a watch, the second device can be a mobile phone, and the role can act as the host of the multi-device interaction system. At least one optional device can be a terminal device that is simultaneously within the preset range of the first and second devices and is capable of providing data transmission and data processing functions, such as, but not limited to, mobile phones, tablets, personal computers (PCs), and televisions (TVs). Multi-device interaction control software can be deployed in the above devices to control the devices respectively through program instructions corresponding to the device control method of this disclosure. A virtual hardware module can be deployed in the second device to ensure the normal operation of the software in the second device when the preset hardware in the second device is replaced with the corresponding preset hardware in the third device. The first device, the second device, and at least one optional device can all include a wireless data transmission module to realize data transmission functions through BT, WIFI, BLE, etc. The first device and at least one optional device can also include a UWB module to realize relative orientation calculation.

[0149] According to an exemplary embodiment of this disclosure, in response to detecting that a third device among at least one selectable device is selected, establishing a data transmission connection between the third device and the second device to transfer the user interaction function of the second device to the third device for implementation may include, but is not limited to, the following steps: in response to detecting that the third device is selected, sending device information of the third device to the second device to establish a data transmission connection between the second device and the third device based on the device information of the third device; in response to receiving an operation instruction regarding a predetermined function, sending an operation instruction to the second device so that the third device receives the operation instruction from the second device and transfers the user interaction function of the second device to the third device for implementation based on the operation instruction; receiving a response result from the second device regarding the operation instruction; and updating relevant information on device control based on the response result.

[0150] In one example, transferring user interaction functions from a second device to a third device can be achieved by calling preset hardware and / or preset software corresponding to the predetermined functions.

[0151] Figure 15 A timing diagram is shown for a multi-camera system, including a second device and a third device, controlled by a first device in an exemplary embodiment of this disclosure.

[0152] Reference Figure 15In one example, the first device can be a watch (Device B), the second device can be a mobile phone (Device A), and at least one optional device can be, but is not limited to, Device C and Device D, which include camera functionality. The user can actively trigger access to the multi-device interactive interface on the watch. Prior to this, a communication connection can be pre-established between the watch and the mobile phone, or the connection can be established simultaneously with or after the user actively triggers access to the multi-device interactive interface on the watch. This connection can be a Bluetooth connection. Next, the mobile phone can send a list of devices in the vicinity to the watch. Before, during, or after receiving the device information list, the watch can search for devices in the vicinity via BLE and / or UWB to filter the device information list, select at least one optional device, and calculate the location information of at least one optional device relative to the watch to display a device selection interface on the watch. When the user selects Device C through the watch, the watch converts the user's command into a message containing Device C information and sends it to the mobile phone. Upon receiving this message, the mobile phone establishes a Wi-Fi IP2P connection (Wifiper-to-peer, also known as Wi-Fi Direct) with Device C for switching camera functions. After the connection between the phone and device C is established, the phone can send connection status information to the watch. Upon receiving this information, the watch displays the connection status on its screen and manages the connection status between the phone and device C, as well as between the phone and device C themselves, through interfaces in the management chart. When a user performs a control operation through the watch, the watch translates the user's action into an operation command and sends it to the phone. Upon receiving the command, the phone decides whether to forward it to device C and / or respond directly to the command, sending feedback to the watch regarding the phone's execution of the command. After receiving this feedback, the watch can update the front-end and / or back-end content displayed on the watch.

[0153] Figure 16 A timing diagram is shown in an exemplary embodiment of this disclosure, illustrating a call management process controlled by a first device, including a second device and a third device.

[0154] Reference Figure 16In one example, the first device can be a watch (Device B), the second device can be a mobile phone (Device A), and at least one optional device can be, but is not limited to, Device C, Device D, etc. When the mobile phone receives a video call notification, it can send a video call notification message to the watch. Prior to this, a communication connection can be established between the watch and the mobile phone, or the connection can be established simultaneously with or after the mobile phone receives the video call notification; this connection can be a Bluetooth connection. After receiving the video call notification message, the watch can display a notification interface indicating the incoming video call. When the user selects to answer the call on the watch, it can trigger the mobile phone to send a list of nearby devices to the watch. Before, during, or after receiving the device information list, the watch can search for nearby devices using BLE and / or UWB to filter the device information list, select at least one optional device, and calculate the location information of at least one optional device relative to the watch to display a device selection interface on the watch. When a user selects device C via the watch, the watch converts the user's command into a message containing device C information and sends it to the phone. Upon receiving this message, the phone establishes a Wi-Fi 2P connection with device C for switching between one or more functions such as camera, audio recording, and video playback. After the connection between the phone and device C is established, the phone can send feedback on the connection status to the watch. The watch, upon receiving this connection status information, can display the connection status on its screen and manage it through a management interface. When the user performs a control operation via the watch, the watch converts the user's action into an operation command and sends it to the phone. Upon receiving the operation command, the phone can decide whether to forward it to device C and / or directly respond to the command, sending feedback to the watch regarding the phone's execution result. After receiving feedback, the watch can update the front-end and / or back-end content displayed on the watch.

[0155] According to exemplary embodiments of this disclosure, when a mobile phone receives a video call or when the user actively triggers the interaction, it can enter the multi-device interaction interface on the watch. The difference between the two scenarios is that when the mobile phone receives a video call, the user is notified, and then enters the watch's interaction interface after clicking on the watch; while when the user actively triggers the interaction, the user actively enters the watch's interaction interface. The watch can display electronic devices that are simultaneously within the search range of the mobile phone (as the host) and the watch, and that support hardware transfer capabilities. Through operations on the watch, the user can quickly establish a wireless connection between the mobile phone and the selected device C, and hardware functions on the mobile phone, such as the camera, will be replaced by hardware on device C. The difference between the two scenarios is that, in addition to hardware replacement, video calls and similar scenarios also support the function of projecting content from the mobile phone to device C. The watch can display a corresponding control interface.

[0156] According to an exemplary embodiment of this disclosure, this disclosure also provides a device control method that can be applied to a second device, wherein a communication connection can be pre-established between the second device and the first device.

[0157] Figure 17 A flowchart illustrating a device control method applied to a second device in an exemplary embodiment of this disclosure is shown.

[0158] Reference Figure 17 In step 1701, if a third device is selected from at least one of the optional devices displayed by the first device, a data transmission connection with the third device can be established to transfer the user interaction functions of the second device to the third device for implementation.

[0159] According to exemplary embodiments of this disclosure, the above method may further include the following steps: for the audiovisual media currently presented by the second device, it may be projected onto the third device for presentation.

[0160] According to exemplary embodiments of this disclosure, the at least one optional device can be a device that is simultaneously within a preset range of the first device and the second device and is capable of providing data processing and data transmission functions.

[0161] According to an exemplary embodiment of this disclosure, the above method may further include the following steps: in response to detecting the occurrence of a preset event, a notification may be sent to a first device to display at least one optional device on the first device based on the notification.

[0162] According to an exemplary embodiment of this disclosure, the above method may further include the following steps: when the first device detects that a preset function has been enabled, a device information table may be sent to the first device, wherein the device information table may contain information about devices within a preset range of the second device, and the device information table is used to obtain at least one optional device so as to display the selection interface corresponding to at least one optional device on the first device.

[0163] According to an exemplary embodiment of this disclosure, establishing a data transmission connection with a third device may include, but is not limited to, the following steps: receiving device information of the third device from the first device; and establishing a data transmission connection with the third device based on the device information of the third device.

[0164] According to an exemplary embodiment of this disclosure, the above method may further include the following steps: monitoring the status of the data transmission connection to obtain the status information of the data transmission connection; and sending the status information of the data transmission connection to a first device so that the first device can display the status information of the data transmission connection.

[0165] According to an exemplary embodiment of this disclosure, the above method may further include the following steps: receiving operation instructions regarding the flow of user interaction functions from a first device; sending operation instructions to a third device based on a data transmission connection so that the third device can execute the operation instructions; and sending a response result regarding the operation instructions to the first device so that the first device can update relevant information on device control based on the response result.

[0166] It is understood that the specific implementation process of the above exemplary embodiment of the device control method applied to the second device is roughly the same as that of the above exemplary embodiment of the device control method applied to the first device, and will not be described in detail here.

[0167] Figure 18 A block diagram of a device control apparatus applied to a first device is shown in an exemplary embodiment of this disclosure.

[0168] Reference Figure 18 The exemplary embodiments of this disclosure also provide a device control apparatus 1800 applied to a first device, which may include a device selection unit 1801 and a function transfer unit 1802. A communication connection may be pre-established between the first device and the second device.

[0169] The device selection unit 1801 can, in response to detecting that a preset function has been enabled, acquire at least one selectable device and display a device selection interface, wherein the device selection interface includes a selection interface for at least one selectable device;

[0170] The function transfer unit 1802 can, in response to detecting that a third device among at least one optional device is selected, establish a data transmission connection between the third device and the second device so as to transfer the user interaction functions of the second device to the third device for implementation.

[0171] According to exemplary embodiments of this disclosure, the above-described apparatus may further include a first projection unit (not shown in the figures), which can project audiovisual media presented on the second device onto the third device for presentation.

[0172] According to an exemplary embodiment of this disclosure, at least one optional device is a device that is simultaneously within a preset range of the first device and the second device and is capable of providing data processing and data transmission functions.

[0173] According to an exemplary embodiment of this disclosure, the device selection unit 1801 can display a notification interface about a preset event when a preset event occurs on the second device, wherein the notification interface of the preset event includes an interface for entering the device selection interface; in response to detecting that the interface for entering the device selection interface is selected, at least one selectable device is obtained and the device selection interface is displayed.

[0174] According to an exemplary embodiment of this disclosure, the device selection unit 1801 may, in response to detecting that a preset function has been enabled, receive a first device information table from a second device, wherein the first device information table contains information about devices within a preset range of the second device; search the information of devices within the preset range of the first device to obtain a second device information table; and obtain at least one selectable device based on the intersection of the first device information table and the second device information table.

[0175] According to an exemplary embodiment of this disclosure, the device selection unit 1801 can obtain the current position distribution of at least one optional device relative to the first device; based on the position distribution of each of the at least one optional device relative to the first device, the selection interface corresponding to the at least one optional device is drawn in the device selection interface.

[0176] According to an exemplary embodiment of this disclosure, the device selection unit 1801 can calculate the position coordinates of each device under test relative to the first device for each of the at least one selectable devices; save the position coordinates of each device under test to a pre-set position database; and perform coordinate transformation on the position coordinates of each device under test saved in the position database to obtain the position distribution of at least one selectable device relative to the first device.

[0177] According to an exemplary embodiment of this disclosure, the function flow unit 1802 may respond to detecting that a third device has been selected from at least one optional device by clicking the selection interface of at least one optional device; and / or, in the case that the first device is a watch, respond to detecting that a third device has been selected from at least one optional device by rotating the dial of the first device.

[0178] According to an exemplary embodiment of this disclosure, the above-described apparatus may further include a device control unit (not shown in the figures), which can display a control interface, wherein the control interface corresponds to the current usage scenario; and in response to receiving a control command, performs corresponding control on the user interaction functions.

[0179] According to exemplary embodiments of this disclosure, a device control unit (not shown in the accompanying drawings) may demonstrate the function of switching and calling preset hardware between a second device and a third device; and / or, if the preset hardware includes a camera, display a preview image generated by calling the camera by the second device and / or the third device; and / or, receive status information of the data transmission connection between the second device and the third device from the second device; display the status information of the data transmission connection; and demonstrate the function of controlling the status of the data transmission connection, wherein the data transmission connection is used to transmit instruction messages to call the preset hardware of the third device.

[0180] According to an exemplary embodiment of this disclosure, the function transfer unit 1802 may, in response to detecting that a third device is selected, send device information of the third device to the second device so as to establish a data transmission connection between the second device and the third device based on the device information of the third device; in response to receiving an operation instruction regarding a predetermined function, send an operation instruction to the second device so that the third device receives the operation instruction from the second device and transfers the user interaction function of the second device to the third device for implementation based on the operation instruction; receive a response result from the second device regarding the operation instruction; and update the relevant information of device control based on the response result.

[0181] It is understood that the specific implementation process of the device control device 1800 applied to the first device described above is largely the same as that of the device control method applied to the first device described above, and will not be repeated here. The device control device 1800 applied to the first device can be configured to perform specific functions as software, hardware, firmware, or any combination of the above. For example, these devices may correspond to dedicated integrated circuits, pure software code, or modules combining software and hardware. Furthermore, one or more functions implemented by these devices may also be uniformly executed by components in a physical entity device (e.g., a processor, client, or server).

[0182] Figure 19 A block diagram of a device control apparatus applied to a second device is shown in an exemplary embodiment of this disclosure.

[0183] Reference Figure 19 The exemplary embodiments of this disclosure also provide a device control apparatus 1900 applied to a second device, which may include a function transfer unit 1901. A communication connection may be pre-established between the first device and the second device.

[0184] The function transfer unit 1901 can establish a data transmission connection with the third device when the third device is selected from at least one of the optional devices displayed by the first device, so as to transfer the user interaction function of the second device to the third device for implementation.

[0185] According to exemplary embodiments of this disclosure, the above-described apparatus may further include a second projection unit (not shown in the figures), which can project the currently presented audiovisual media onto a third device for presentation.

[0186] According to an exemplary embodiment of this disclosure, at least one optional device is a device that is simultaneously within a preset range of the first device and the second device and is capable of providing data processing and data transmission functions.

[0187] According to an exemplary embodiment of this disclosure, the above-described apparatus may further include a notification sending unit (not shown in the figures) that can send a notification to a first device in response to detecting the occurrence of a preset event, so as to display at least one optional device on the first device based on the notification.

[0188] According to an exemplary embodiment of this disclosure, the above-described apparatus may further include a device information sending unit (not shown in the figures), which may send a device information table to the first device when the first device detects that a preset function has been enabled. The device information table contains information about devices within a preset range of the second device. The device information table is used to obtain at least one optional device so as to display the selection interface corresponding to at least one optional device on the first device.

[0189] According to an exemplary embodiment of this disclosure, the functional transfer unit can receive device information of the third device from the first device; it can also establish a data transmission connection with the third device based on the device information of the third device.

[0190] According to an exemplary embodiment of this disclosure, the above-described apparatus may further include a connection status monitoring unit (not shown in the figures), which can monitor the status of the data transmission connection, obtain the status information of the data transmission connection, and send the status information of the data transmission connection to the first device so that the first device can display the status information of the data transmission connection.

[0191] According to exemplary embodiments of this disclosure, the above-described apparatus may further include an operation instruction response unit (not shown in the figures), which can receive operation instructions regarding the flow of user interaction functions from the first device; can also send operation instructions to a third device based on a data transmission connection so that the third device can execute the operation instructions; and can also send a response result regarding the operation instructions to the first device so that the first device can update relevant information on device control based on the response result.

[0192] It is understood that the specific implementation process of the device control device 1900 applied to the second device described above is largely the same as that of the device control method applied to the first device described above, and will not be repeated here. The device control device 1900 applied to the second device can be configured to perform specific functions as software, hardware, firmware, or any combination thereof. For example, these devices may correspond to dedicated integrated circuits, pure software code, or modules combining software and hardware. Furthermore, one or more functions implemented by these devices may also be uniformly executed by components in a physical entity device (e.g., a processor, client, or server).

[0193] Figure 20 A block diagram illustrating an electronic device according to an exemplary embodiment of the present disclosure.

[0194] Reference Figure 20 The electronic device 2000 includes at least one memory 2001 and at least one processor 2002. The at least one memory 2001 stores a set of computer-executable instructions. When the set of computer-executable instructions is executed by the at least one processor 2002, a device control method according to an exemplary embodiment of the present disclosure is performed.

[0195] As an example, electronic device 2000 may be a PC, tablet, personal digital assistant, smartphone, or other device capable of executing the aforementioned set of instructions. Here, electronic device 2000 is not necessarily a single electronic device, but may be any collection of devices or circuits capable of executing the aforementioned instructions (or instruction sets) individually or in combination. Electronic device 2000 may also be part of an integrated control system or system manager, or may be configured to interconnect with a portable electronic device locally or remotely (e.g., via wireless transmission) through an interface.

[0196] In electronic device 2000, processor 2002 may include central processing unit (CPU), graphics processing unit (GPU), programmable logic device, dedicated processor system, microcontroller, or microprocessor. By way of example and not limitation, processor may also include analog processor, digital processor, microprocessor, multi-core processor, processor array, network processor, etc.

[0197] The processor 2002 can execute instructions or code stored in the memory 2001, which can also store data. Instructions and data can also be sent and received via a network through a network interface device, which can employ any known transmission protocol.

[0198] The memory 2001 can be integrated with the processor 2002, for example, by arranging RAM or flash memory within an integrated circuit microprocessor. Alternatively, the memory 2001 can include a separate device, such as an external disk drive, a storage array, or other storage device usable by any database system. The memory 2001 and the processor 2002 can be operatively coupled, or can communicate with each other, for example, via I / O ports, network connections, etc., enabling the processor 2002 to read files stored in the memory.

[0199] In addition, the electronic device 2000 may also include a video display (such as a liquid crystal display) and a user interaction interface (such as a keyboard, mouse, touch input device, etc.). All components of the electronic device 2000 can be interconnected via a bus and / or network.

[0200] According to exemplary embodiments of this disclosure, a computer-readable storage medium storing instructions may also be provided, wherein when the instructions are executed by at least one computing device, they cause at least one computing device to perform the device control method described above.

[0201] Examples of computer-readable storage media herein include: read-only memory (ROM), random access programmable read-only memory (PROM), electrically erasable programmable read-only memory (EEPROM), random access memory (RAM), dynamic random access memory (DRAM), static random access memory (SRAM), flash memory, non-volatile memory, CD-ROM, CD-R, CD+R, CD-RW, CD+RW, DVD-ROM, DVD-R, DVD+R, DVD-RW, DVD+RW, DVD-RAM, BD-ROM, BD-R, BD-R LTH, BD-RE, Blu-ray or optical disc storage, hard disk drive (HDD), solid-state drive (SSD), card storage (such as multimedia cards, secure digital (SD) cards, or ultra-fast digital (XD) cards), magnetic tape, floppy disk, magneto-optical data storage device, optical data storage device, hard disk, solid-state drive, and any other device configured to store a computer program and any associated data, data files, and data structures in a non-transitory manner and to provide the computer program and any associated data, data files, and data structures to a processor or computer so that the processor or computer can execute the computer program. The computer program in the aforementioned computer-readable storage medium can run in an environment deployed in computer devices such as clients, hosts, agent devices, servers, etc. Furthermore, in one example, the computer program and any associated data, data files, and data structures are distributed across a networked computer system, such that the computer program and any associated data, data files, and data structures are stored, accessed, and executed in a distributed manner through one or more processors or computers. It should be noted that the instructions can also be used to perform additional steps in addition to those described above, or to perform more specific processing while performing the above steps. The details of these additional steps and further processing have already been mentioned in the description of the relevant methods, so they will not be repeated here to avoid repetition.

[0202] Another embodiment of this disclosure relates to a system comprising at least one computing device and at least one storage device for storing instructions, wherein the instructions, when executed by at least one computing device, cause at least one computing device to perform the device control method described above.

[0203] Another embodiment of this disclosure relates to a computer program product including computer instructions that can be executed by at least one processor to implement a device control method of an exemplary embodiment of this disclosure.

[0204] It should be noted that the system according to the exemplary embodiments of this disclosure may rely entirely on the operation of computer programs or instructions to achieve the corresponding functions. That is, each unit corresponds to each step in the functional architecture of the computer program, so that the entire system is called through a special software package (e.g., a lib library) to achieve the corresponding functions.

[0205] On the other hand, when the above system is implemented in software, firmware, middleware or microcode, the program code or code segment used to perform the corresponding operation can be stored in a computer-readable medium such as a storage medium, so that at least one processor or at least one computing device can perform the corresponding operation by reading and running the corresponding program code or code segment.

[0206] According to exemplary embodiments of this disclosure, the storage device may be integrated with the computing device, for example, by arranging RAM or flash memory within an integrated circuit microprocessor. Alternatively, the storage device may include a separate device, such as an external disk drive, a storage array, or other storage device usable by any database system. The storage device and the computing device may be operatively coupled, or may communicate with each other, for example, via I / O ports, network connections, etc., enabling the computing device to read instructions stored in the storage device.

[0207] The device control method, apparatus, electronic device, storage medium, system, and computer program products provided in this disclosure can involve the interaction and operation control between multiple devices, thereby improving the efficiency and convenience of operating and controlling multiple devices. Specifically, a first device can select a third device to invoke hardware of the selected third device, including but not limited to cameras, screens, microphones, etc. Furthermore, when a second device needs to invoke the corresponding hardware, the third device actually executes the invocation of the corresponding hardware, thereby achieving efficient and convenient device use in conjunction with the application scenario.

[0208] The foregoing has described various exemplary embodiments of this disclosure. It should be understood that the foregoing description is exemplary only and not exhaustive, and this disclosure is not limited to the disclosed exemplary embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of this disclosure. Therefore, the scope of protection of this disclosure should be determined by the scope of the claims.

Claims

1. A device control method, characterized in that, Applied to a first device, wherein a communication connection is pre-established between the first device and a second device, the method includes: In response to detecting that a preset function has been enabled, at least one optional device is acquired and a device selection interface is displayed, wherein the device selection interface includes a selection interface for the at least one optional device; In response to detecting that a third device among the at least one selectable device is selected, the third device establishes a data transmission connection with the second device to facilitate the transfer of user interaction functions of the second device to the third device for implementation.

2. The equipment control method as described in claim 1, characterized in that, The at least one optional device is a device that is simultaneously within the preset range of the first device and the second device and is capable of providing data processing and data transmission functions.

3. The equipment control method as described in claim 1, characterized in that, The response to detecting that a preset function has been enabled, acquiring at least one selectable device and displaying a device selection interface includes: When a preset event occurs on the second device, a notification interface about the preset event is displayed, wherein the notification interface of the preset event includes an interface for accessing the device selection interface; In response to detecting that the interface for entering the device selection interface has been selected, the at least one selectable device is obtained and the device selection interface is displayed.

4. The equipment control method as described in claim 1, characterized in that, The response to detecting that a preset function has been enabled, acquiring at least one optional device, includes: In response to detecting that the preset function has been enabled, a first device information table is received from the second device, wherein the first device information table contains information about devices within a preset range of the second device; Search for information on devices within a preset range of the first device to obtain a second device information table; The at least one optional device is obtained based on the intersection of the first device information table and the second device information table.

5. The equipment control method as described in claim 1, characterized in that, The display device selection interface includes: Obtain the current position distribution of the at least one optional device relative to the first device; Based on the positional distribution of each of the at least one optional device relative to the first device, the selection interface corresponding to each of the at least one optional device is drawn in the device selection interface.

6. The equipment control method as described in claim 5, characterized in that, The step of obtaining the current position distribution of the at least one optional device relative to the first device includes: For each device under test among the at least one optional device, calculate the position coordinates of the device under test relative to the first device; The location coordinates of each of the devices under test are saved to a pre-set location database; The coordinates of each device under test stored in the location database are transformed to obtain the position distribution of the at least one optional device relative to the first device.

7. The equipment control method as described in claim 1, characterized in that, The response to detecting that a third device among the at least one selectable device is selected includes: In response to detecting that the third device has been selected from the at least one optional device by clicking the selection interface of the at least one optional device; And / or, In the case that the first device is a watch, the third device is selected from the at least one optional device in response to the detection that the dial of the first device has been rotated.

8. The equipment control method as described in claim 1, characterized in that, The method further includes: Display the control interface, wherein the control interface corresponds to the current usage scenario; In response to receiving a control command, the user interaction function is controlled accordingly.

9. The equipment control method as described in claim 1, characterized in that, The step of responding to detecting that a third device among the at least one selectable device is selected, and establishing a data transmission connection between the third device and the second device to facilitate the transfer of user interaction functions from the second device to the third device for implementation, includes: In response to detecting that the third device is selected, the device information of the third device is sent to the second device so as to establish a data transmission connection between the second device and the third device based on the device information of the third device; In response to receiving an operation instruction regarding a predetermined function, the operation instruction is sent to the second device, so that the third device receives the operation instruction from the second device and, based on the operation instruction, transfers the user interaction function of the second device to the third device for implementation. Receive the response result of the operation command sent by the second device; The relevant information for device control is updated based on the response results.

10. A device control method, characterized in that, Applied to a second device, wherein a communication connection has been pre-established between the second device and the first device, the method includes: If a third device is selected from at least one of the optional devices displayed by the first device, a data transmission connection is established with the third device to transfer the user interaction functions of the second device to the third device for implementation.

11. The equipment control method as described in claim 10, characterized in that, The at least one optional device is a device that is simultaneously within the preset range of the first device and the second device and is capable of providing data processing and data transmission functions.

12. The equipment control method as described in claim 10, characterized in that, The method further includes: In response to the detection of a preset event, a notification is sent to the first device to display the at least one optional device on the first device based on the notification.

13. The equipment control method as described in claim 10, characterized in that, The method further includes: When the first device detects that a preset function has been enabled, a device information table is sent to the first device. The device information table contains information about devices within a preset range of the second device. The device information table is used to obtain at least one optional device so as to display the selection interface corresponding to the at least one optional device on the first device.

14. The equipment control method as described in claim 10, characterized in that, The establishment of a data transmission connection with the third device includes: Receive device information of the third device from the first device; Based on the device information of the third device, a data transmission connection is established with the third device.

15. The equipment control method as described in claim 10, characterized in that, The method further includes: The status of the data transmission connection is monitored to obtain the status information of the data transmission connection; The status information of the data transmission connection is sent to the first device so that the first device can display the status information of the data transmission connection.

16. The equipment control method as described in claim 10, characterized in that, The method further includes: Receive operation instructions regarding the flow of user interaction functions from the first device; The operation command is sent to the third device based on the data transmission connection so that the third device can execute the operation command; A response result regarding the operation command is sent to the first device so that the first device can update relevant information about device control based on the response result.

17. A device control apparatus, characterized in that, Applied to a first device, wherein a communication connection is pre-established between the first device and a second device, the device includes: The device selection unit is configured to: in response to detecting that a preset function has been enabled, acquire at least one optional device and display a device selection interface, wherein the device selection interface includes a selection interface for the at least one optional device; The function transfer unit is configured to: in response to detecting that a third device among the at least one selectable device is selected, cause the third device to establish a data transmission connection with the second device so as to transfer the user interaction function of the second device to the third device for implementation.

18. A device control apparatus, characterized in that, Applied to a second device, wherein a communication connection is pre-established between the second device and the first device, the device includes: The function transfer unit is configured to: when a third device is selected from at least one of the optional devices displayed by the first device, establish a data transmission connection with the third device to transfer the user interaction function of the second device to the third device for implementation.

19. An electronic device, characterized in that, include: At least one processor; At least one memory that stores computer-executable instructions. Wherein, when the computer-executable instructions are executed by the at least one processor, they cause the at least one processor to perform the device control method as described in any one of claims 1-16.

20. A computer-readable storage medium for storing instructions, characterized in that, When the instruction is executed by at least one processor, it causes the at least one processor to perform the device control method as described in any one of claims 1-16.

21. A system comprising at least one computing device and at least one storage device for storing instructions, characterized in that, When the instruction is executed by the at least one computing device, it causes the at least one computing device to perform the device control method as described in any one of claims 1-16.

22. A computer program product comprising computer instructions, characterized in that, When the computer instructions are executed by at least one processor, they implement the device control method as described in any one of claims 1-16.

Images