Equipment control method, equipment and computer readable storage medium

Abstract

The invention discloses a device control method, a device and a computer readable storage medium, in the method, a central device can determine a first device having a first pointing relationship with a remote control device from M devices, and determine a second device having a second pointing relationship with the remote control device from the M devices; according to the device capability information of the first device, the device state information of the first device, the device capability information of the second device and the device state information of the second device, determining a transfer device from the first device, and determining a to-be-transferred device from the second device; and finally, controlling the to-be-transferred equipment to start the target capability, and / or controlling the to-be-transferred equipment to output the target content. By adopting the method and the device, the pointing control of the equipment can be realized, and meanwhile, the state circulation among the equipment is realized by combining the equipment capability information and the equipment state information of the pointed equipment, so that a better interaction effect among the equipment is realized, and the intelligence of equipment control is favorably improved.

Description

Technical Field

[0001] The present application relates to the field of Internet of Things control, and in particular to a device control method, device and computer-readable storage medium. Background Art

[0002] With the continuous development and popularization of smart homes, smart devices in homes have gradually diversified, and these smart devices can bring convenience to people's lives. Through remote control devices (such as mobile phones, remote controls, etc.), the status of these smart devices can be controlled throughout the house. For example, the remote control device can control the lighting of lamps, control the speakers to play music, control the TV to play videos, etc. At present, the control of these devices by remote control devices is usually independent. For example, when the position of the object (such as the user) moves from the dining room to the living room, the remote control device can be used to control the lights in the dining room to turn off the lighting first, and then control the lights in the living room to turn on the lighting. However, this device control method lacks intelligence, resulting in poor interaction between devices. Summary of the invention

[0003] The embodiments of the present application provide a device control method, a device, and a computer-readable storage medium, which can realize the pointing control of the device, and at the same time realize the state flow between devices in combination with the device capability information and device status information of the pointed device, so that the devices have a better interaction effect, which is conducive to improving the intelligence of device control.

[0004] In a first aspect, the present application provides a device control method, which is applied to a central device, and the method includes: determining a first device that has a first pointing relationship with a remote control device from M devices; the remote control device is used to remotely control M devices, M is a positive integer; the first pointing relationship is associated with a first posture information of the remote control device; determining a second device that has a second pointing relationship with the remote control device from the M devices; the second pointing relationship is associated with the second posture information of the remote control device; the second posture information is different from the first posture information; determining a transfer device from the first device and a device to be transferred from the second device based on the device capability information of the first device, the device status information of the first device, the device capability information of the second device and the device status information of the second device; the transfer device and the device to be transferred have the same target capability, and the target capability is in an enabled state on the transfer device; controlling the device to be transferred to enable the target capability, and / or controlling the device to be transferred to output target content, the target content being all or part of the content output by the transfer device when the target capability is in an enabled state.

[0005] In this way, the central device can judge the devices that the remote control device points to first and then, based on the posture information of the remote control device and the location information of the devices in the whole house, and then determine the transfer device and the device to be transferred for state transfer based on the device capability information and device status information of the device pointed to by the remote control device, and then control the device capability information and / or device status information of the transfer device pointed to first to flow to the device to be transferred later. In this way, on the one hand, the pointing control of the device can be realized, the control of the function flow between devices can be automatically realized, the operation process can be simplified, and the efficiency of device control can be improved. On the one hand, the intersection of the capabilities of different devices can be used to make the devices have a certain degree of interactivity, which is conducive to improving the intelligence of device control.

[0006] In combination with the first aspect, in a possible implementation method, the above-mentioned determining the first device that has a first pointing relationship with the remote control device from M devices includes: receiving the first posture information of the remote control device; and determining the first device that has a first pointing relationship with the remote control device from the M devices based on the first posture information and the position information of the M devices.

[0007] It can be seen that according to the posture information of the remote control device in space and the position information of the device, the direction of the remote control device can be determined, so as to control the device more conveniently.

[0008] In combination with the first aspect, in a possible implementation, the first posture information includes first position information and first posture information; the above-mentioned determining the first device that has a first pointing relationship with the remote control device from the M devices based on the first posture information and the position information of the M devices includes: determining the pointing posture information of the remote control device pointing to the device m based on the first position information and the position information of the device m; the device m is one of the M devices; in response to the difference between the first posture information and the pointing posture information being less than or equal to a threshold, determining that the device m is the first device that has a first pointing relationship with the remote control device.

[0009] It can be seen that by comparing the attitude information of the remote control device with the pointing attitude information of the device that the remote control device is pointing to, the device that the remote control device is pointing to can be quickly determined.

[0010] In combination with the first aspect, in a possible implementation method, the first position information is position information based on the first coordinate system, and the position information of the device m is position information based on the second coordinate system; the above-mentioned determining the pointing posture information of the remote control device pointing to the device m based on the first position information and the position information of the device m includes: obtaining the position information of the origin of the first coordinate system in the second coordinate system, and the conversion relationship between the first coordinate system and the second coordinate system; converting the first position information to the second coordinate system according to the position information of the origin of the first coordinate system in the second coordinate system, and the conversion relationship between the first coordinate system and the second coordinate system to obtain the second position information of the remote control device; determining the pointing posture information of the remote control device pointing to the device m according to the second position information and the position information of the device m.

[0011] It can be seen that by unifying the coordinate system used by the remote control device with the coordinate system used by the devices in the whole house, the pointing posture information of the remote control device pointing to the device can be calculated more efficiently.

[0012] In combination with the first aspect, in a possible implementation, the first posture information includes the azimuth and pitch angle of the remote control device based on the first coordinate system, and the pointing posture information includes the azimuth and pitch angle of the remote control device pointing to the device m based on the second coordinate system. The above method also includes: according to the conversion relationship between the first coordinate system and the second coordinate system, converting the azimuth and pitch angle of the remote control device based on the first coordinate system to the second coordinate system to obtain the azimuth and pitch angle of the remote control device based on the second coordinate system; in response to the azimuth of the remote control device based on the second coordinate system, the difference between the azimuth of the remote control device and the azimuth of the remote control device pointing to the device m based on the second coordinate system is less than or equal to the first threshold, and the difference between the pitch angle of the remote control device based on the second coordinate system and the pitch angle of the remote control device pointing to the device m based on the second coordinate system is less than or equal to the second threshold, determining that the difference between the first posture information and the pointing posture information is less than or equal to the threshold.

[0013] It can be seen that by comparing the current azimuth angle of the remote control device and the azimuth angle of the remote control device pointing device, as well as the current pitch angle of the remote control device and the pitch angle of the remote control device pointing device in the same coordinate system, the relationship between the current posture information of the remote control device and the pointing posture information of the pointing device can be determined more accurately.

[0014] In combination with the first aspect, in a possible implementation, the above-mentioned determining the first device that has a first pointing relationship with the remote control device from M devices includes: receiving first information from the remote control device, the first information is used to indicate the identification information of the first device that has a first pointing relationship with the remote control device among the M devices; based on the first information, determining the first device from the M devices.

[0015] It can be seen that the central device directly receives the direction judgment result of the remote control device, so as to more quickly determine the device that has a direction relationship with the remote control device, which is beneficial to improving the processing efficiency of the central device.

[0016] In combination with the first aspect, in a possible implementation method, the above-mentioned determining a transfer device from the first device and determining a device to be transferred from the second device based on the device capability information of the first device, the device status information of the first device, the device capability information of the second device and the device status information of the second device includes: determining a candidate transfer device from the first device and determining a candidate device to be transferred from the second device based on the device capability information of the first device, the device status information of the first device, the device capability information of the second device and the device status information of the second device; wherein, one candidate transfer device corresponds to at least one candidate device to be transferred, and there is the same target capability between one candidate transfer device and each candidate transfer device in at least one candidate device to be transferred, and the target capability is in an enabled state on the candidate transfer device; determining a transfer device from the candidate transfer devices and determining a device to be transferred from the candidate devices to be transferred based on the distance between the candidate transfer device and the remote control device, and the distance between the candidate device to be transferred and the remote control device.

[0017] It can be seen that when there are multiple candidate transfer devices and candidate devices to be transferred, the distance between the candidate transfer device and the remote control device, as well as the distance between the candidate device to be transferred and the remote control device, can be combined to determine the transfer device and the device to be transferred that are closer to the remote control device. This is conducive to improving the flexibility of device control.

[0018] In combination with the first aspect, in a possible implementation manner, the method further includes: controlling the transfer device to turn off the target capability, or controlling the transfer device to keep the target capability in an on state.

[0019] It can be seen that after the device capability information and / or device status information of the transferring device is transferred to the device to be transferred, the transferring device can be flexibly controlled to turn on or off the target capability, which is conducive to enriching the device control method.

[0020] In combination with the first aspect, in a possible implementation method, the above-mentioned control of the device to be transferred to enable the target capability, and / or, controlling the device to be transferred to output the target content, includes: sending a first instruction to the transfer device to control the transfer device to turn off the target capability, and / or, stop outputting the target content; sending a second instruction to the device to be transferred to control the device to be transferred to enable the target capability, and / or, control the device to be transferred to output the target content.

[0021] It can be seen that by sending instructions to the transferring device and the device to be transferred, accurate device control can be achieved.

[0022] In a second aspect, the present application provides another device control method, which is applied to a remote control device, the method comprising: receiving a selection operation, and obtaining a first positioning result of the remote control device from at least one positioning device based on the selection operation; determining a first posture information of the remote control device based on the first positioning result; obtaining a second positioning result of the remote control device from at least one positioning device based on the selection operation; the duration of the selection operation is greater than a threshold, or the number of selections of the selection operation meets a preset condition; determining second posture information of the remote control device based on the second positioning result; the second posture information is different from the first posture information.

[0023] In this way, the remote control device can obtain its own positioning results from the positioning device, and then combine the remote control device's own measurement results to determine more accurate posture information. This method is conducive to improving the accuracy and reliability of device control.

[0024] In combination with the second aspect, in a possible implementation method, the first positioning result includes basic position information and basic posture information, and the first posture information includes first position information and first posture information; the above-mentioned determining the first posture information of the remote control device based on the first positioning result includes: obtaining the acceleration measured by the accelerometer, and determining the position change information of the remote control device based on the acceleration; fusing and filtering the position change information with the basic position information to obtain the first position information of the remote control device; obtaining the angular velocity measured by the gyroscope, and determining the posture change information of the remote control device based on the angular velocity; fusing and filtering the posture change information with the basic posture information to obtain the first posture information of the remote control device.

[0025] It can be seen that the remote control device can fuse and filter the position change information measured by itself with the position information obtained from the positioning device to obtain more accurate position information, and fuse and filter the posture change information measured by itself with the posture information obtained from the positioning device to obtain more accurate posture information.

[0026] In combination with the second aspect, in a possible implementation manner, the method further includes: sending the first pose information.

[0027] It can be seen that the remote control device can send its own posture information to the central device so that the central device can determine the direction of the remote control device and further realize the direction control of the device.

[0028] In combination with the second aspect, in a possible implementation, the above method also includes: determining a first device that has a first pointing relationship with the remote control device from the M devices based on the first posture information and the position information of the M devices; the remote control device is used to remotely control the M devices, M is a positive integer; the first pointing relationship is associated with the first posture information of the remote control device; and sending first information, the first information being used to indicate identification information of the first device.

[0029] It can be seen that the remote control device can determine the device it is pointing to based on its own posture information and the device's location information, and inform the central device of the judgment result, so that the central device can determine the transferred device and the device to be transferred, and realize the flexible flow of device capability information and / or device status information between devices.

[0030] In combination with the second aspect, in a possible implementation, the first posture information includes first position information and first posture information; the above-mentioned determining the first device that has a first pointing relationship with the remote control device from the M devices based on the first posture information and the position information of the M devices includes: determining the pointing posture information of the remote control device pointing to the device m based on the first position information and the position information of the device m; the device m is one of the M devices; in response to the difference between the first posture information and the pointing posture information being less than or equal to a threshold, determining that the device m is the first device that has a first pointing relationship with the remote control device.

[0031] It can be seen that the remote control device can quickly determine the device currently pointed to by comparing the current first posture information with the pointing posture information of the pointing device.

[0032] In combination with the second aspect, in a possible implementation method, the first position information is position information based on the first coordinate system, and the position information of the device m is position information based on the second coordinate system; the above-mentioned determining the pointing posture information of the remote control device pointing to the device m based on the first position information and the position information of the device m includes: obtaining the position information of the origin of the first coordinate system in the second coordinate system, and the conversion relationship between the first coordinate system and the second coordinate system; converting the first position information to the second coordinate system according to the position information of the origin of the first coordinate system in the second coordinate system, and the conversion relationship between the first coordinate system and the second coordinate system to obtain the second position information of the remote control device; determining the pointing posture information of the remote control device pointing to the device m according to the second position information and the position information of the device m.

[0033] It can be seen that by unifying the coordinate system used by the remote control device with the coordinate system used by the devices in the whole house, the pointing posture information of the remote control device pointing to the device can be calculated more efficiently.

[0034] In a third aspect, the present application provides another device control method, applied to a first device, the method comprising: outputting target content; the target content is content output when the target capability is in an on state; in response to a received first instruction, stopping outputting the target content; the first instruction is an instruction generated based on a selection operation received by a remote control device, the selection operation is used to instruct the first device to stop outputting the target content, and to instruct the second device to output the target content; the second device has the target capability.

[0035] In this manner, the first device can stop outputting the target content according to the received first instruction, so that the target content can be output on the second device, thereby conveniently realizing the flow of functions between devices.

[0036] In a fourth aspect, the present application provides another device control method, applied to a second device, the method comprising: outputting target content in response to a received second instruction; the second instruction is an instruction generated based on a selection operation received by a remote control device; the selection operation is used to instruct the first device to stop outputting the target content, and to instruct the second device to output the target content; the target content is the content output when the target capability of the first device is in an on state; the second device has the target capability.

[0037] In this manner, the second device can output the target content originally output on the first device according to the received second instruction, so that the second device and the first device are interactive.

[0038] In a fifth aspect, the present application provides a hub device, comprising at least one memory and at least one processor, wherein the at least one memory is coupled to the at least one processor, the at least one memory is used to store a computer program, and the at least one processor is used to call the computer program, and the computer program includes instructions, which, when executed by the at least one processor, cause the hub device to execute: determining a first device from M devices that has a first pointing relationship with the remote control device; the remote control device is used to remotely control M devices, M is a positive integer; the first pointing relationship is associated with the first posture information of the remote control device; determining a second device from the M devices that has a second pointing relationship with the remote control device; the second pointing relationship is associated with the second posture information of the remote control device; the second posture information is different from the first posture information; determining a transfer device from the first device and a device to be transferred from the second device based on the device capability information of the first device, the device status information of the first device, the device capability information of the second device and the device status information of the second device; the transfer device and the device to be transferred have the same target capability, and the target capability is in an enabled state on the transfer device; controlling the device to be transferred to enable the target capability, and / or controlling the device to be transferred to output target content, the target content being all or part of the content output by the transfer device when the target capability is in an enabled state.

[0039] In combination with the fifth aspect, in one possible implementation, the one or more processors call the computer instructions to cause the central device to execute: receiving the first posture information of the remote control device; and determining, from the M devices, the first device that has a first pointing relationship with the remote control device based on the first posture information and the position information of the M devices.

[0040] In combination with the fifth aspect, in a possible implementation, the first posture information includes first position information and first posture information; the one or more processors call the computer instructions to enable the central device to execute: based on the first position information and the position information of device m, calculate the pointing posture information of the remote control device pointing to device m; device m is one of the M devices; in response to the difference between the first posture information and the pointing posture information being less than or equal to a threshold, determine that device m is the first device that has a first pointing relationship with the remote control device.

[0041] In combination with the fifth aspect, in a possible implementation method, the first position information is position information based on the first coordinate system, and the position information of the device m is position information based on the second coordinate system; the one or more processors call the computer instructions to enable the central device to execute: obtain the position information of the origin of the first coordinate system in the second coordinate system, and the conversion relationship between the first coordinate system and the second coordinate system; according to the position information of the origin of the first coordinate system in the second coordinate system, and the conversion relationship between the first coordinate system and the second coordinate system, convert the first position information to the second coordinate system to obtain the second position information of the remote control device; according to the second position information and the position information of the device m, determine the pointing posture information of the remote control device pointing to the device m.

[0042] In combination with the fifth aspect, in a possible implementation, the first posture information includes the azimuth and pitch angle of the remote control device based on the first coordinate system, and the pointing posture information includes the azimuth and pitch angle of the remote control device pointing to the device m based on the second coordinate system. The one or more processors call the computer instructions to enable the central device to execute: according to the conversion relationship between the first coordinate system and the second coordinate system, the azimuth and pitch angle of the remote control device based on the first coordinate system are converted to the second coordinate system to obtain the azimuth and pitch angle of the remote control device based on the second coordinate system; in response to the difference between the azimuth of the remote control device based on the second coordinate system and the azimuth of the remote control device pointing to the device m based on the second coordinate system is less than or equal to the first threshold, and the difference between the pitch angle of the remote control device based on the second coordinate system and the pitch angle of the remote control device pointing to the device m based on the second coordinate system is less than or equal to the second threshold, it is determined that the difference between the first posture information and the pointing posture information is less than or equal to the threshold.

[0043] In combination with the fifth aspect, in one possible implementation, the one or more processors call the computer instructions to cause the central device to execute: receiving first information from a remote control device, the first information being used to indicate identification information of a first device among M devices that has a first pointing relationship with the remote control device; and determining the first device from the M devices based on the first information.

[0044] In combination with the fifth aspect, in a possible implementation, the one or more processors call the computer instructions to enable the central device to execute: determine a candidate transfer device from the first device and a candidate device to be transferred from the second device based on the device capability information of the first device, the device status information of the first device, the device capability information of the second device and the device status information of the second device; wherein, one candidate transfer device corresponds to at least one candidate device to be transferred, and there is the same target capability between one candidate transfer device and each of the at least one candidate transfer devices to be transferred, and the target capability is in an turned-on state on the candidate transfer device; determine a transfer device from the candidate transfer devices and a device to be transferred from the candidate devices to be transferred based on the distance between the candidate transfer device and the remote control device, and the distance between the candidate device to be transferred and the remote control device.

[0045] In combination with the fifth aspect, in one possible implementation, the one or more processors call the computer instruction to cause the central device to execute: controlling the transfer device to turn off the target capability, or controlling the transfer device to keep the target capability in an on state.

[0046] In a sixth aspect, the present application provides a remote control device, comprising at least one memory and at least one processor, wherein the at least one memory is coupled to the at least one processor, the at least one memory is used to store a computer program, and the at least one processor is used to call the computer program. The computer program comprises instructions, which, when executed by the at least one processor, cause the remote control device to execute: receive a selection operation, and in response to the selection operation, obtain a first positioning result of the remote control device from at least one positioning device; based on the first positioning result, determine a first posture information of the remote control device; in response to the duration of the selection operation being greater than a threshold, when it is detected that the selection operation stops, obtain a second positioning result of the remote control device from at least one positioning device; based on the second positioning result, determine the second posture information of the remote control device; the second posture information is different from the first posture information.

[0047] In combination with the sixth aspect, in a possible implementation method, the first positioning result includes basic position information and basic posture information, and the first posture information includes first position information and first posture information; the one or more processors call the computer instructions to enable the remote control device to execute: obtain the acceleration measured by the accelerometer, and determine the position change information of the remote control device based on the acceleration; fuse the position change information with the basic position information to obtain the first position information of the remote control device; obtain the angular velocity measured by the gyroscope, and determine the posture change information of the remote control device based on the angular velocity; fuse the posture change information with the basic posture information to obtain the first posture information of the remote control device.

[0048] In combination with the sixth aspect, in one possible implementation, the one or more processors call the computer instruction to cause the remote control device to execute: sending the first posture information.

[0049] In combination with the sixth aspect, in one possible implementation, the one or more processors call the computer instructions to cause the remote control device to execute: determining, from the M devices, a first device that has a first pointing relationship with the remote control device based on the first posture information and the position information of the M devices; the remote control device is used to remotely control the M devices, where M is a positive integer; the first pointing relationship is associated with the first posture information of the remote control device; and sending first information, where the first information is used to indicate identification information of the first device.

[0050] In the seventh aspect, the present application provides a computer program product. When the computer program product runs on an electronic device, the electronic device executes the device control method in the first aspect, or executes the device control method in the second aspect, or executes the device control method in the third aspect.

[0051] In an eighth aspect, the present application provides a computer storage medium comprising computer instructions, which, when executed on an electronic device, causes the electronic device to execute the device control method in the first aspect, or the device control method in the second aspect, or the device control method in the third aspect, or the device control method in the fourth aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] Figure 1A This is a schematic diagram of a single-room application scenario provided by an embodiment of the present application;

[0053] Figure 1B This is a schematic diagram of a whole-house application scenario provided by an embodiment of the present application;

[0054] Figure 2 It is a structural diagram of a communication system provided in an embodiment of the present application;

[0055] Figure 3A is a schematic diagram of the hardware structure of a remote control device (such as a mobile phone) provided in an embodiment of the present application;

[0056] Figure 3B is a schematic diagram of the hardware structure of another remote control device (such as a remote controller) provided in an embodiment of the present application;

[0057] Figure 3C is a schematic diagram of the hardware structure of a positioning device provided in an embodiment of the present application;

[0058] Figure 3D It is a schematic diagram of the hardware structure of a central device provided in an embodiment of the present application;

[0059] Figure 4 It is a flow chart of a device control method provided in an embodiment of the present application;

[0060] Figure 5A is a schematic diagram of a selection operation provided in an embodiment of the present application;

[0061] Figure 5B is a schematic diagram of another selection operation provided in an embodiment of the present application;

[0062] Figure 5C is a schematic diagram of another selection operation provided in an embodiment of the present application;

[0063] Fig. 6A is a schematic diagram of establishing a first coordinate system provided in an embodiment of the present application;

[0064] Figure 6B is another schematic diagram of establishing a first coordinate system provided in an embodiment of the present application;

[0065] Figure 7 is a schematic diagram of establishing a remote control device coordinate system provided by an embodiment of the present application;

[0066] Figure 8 is a schematic diagram of a positioning device according to an embodiment of the present application determining basic position information of a remote control device;

[0067] Fig. 9 This is a schematic diagram of a process for a remote control device to determine first position information provided by an embodiment of the present application;

[0068] Fig. 10A It is a schematic diagram of a proximity position marking method provided in an embodiment of the present application;

[0069] Fig. 10B It is a schematic diagram of a directional position marking method provided in an embodiment of the present application;

[0070] Fig.11It is a schematic diagram of establishing a whole-house coordinate system provided by an embodiment of the present application;

[0071] Fig.12 is a schematic diagram of first posture information and pointing posture information provided by an embodiment of the present application;

[0072] Fig.13 is a schematic diagram of a remote control device sending a positioning request provided by an embodiment of the present application;

[0073] Fig.14 It is a schematic diagram of a process for a hub device to determine a candidate transfer device and a candidate to-be-transferred device provided in an embodiment of the present application;

[0074] Fig.15 is a schematic diagram of a first device and a second device provided in an embodiment of the present application;

[0075] Fig.16 It is a schematic diagram of a device to be transferred displaying content displayed on a transfer device provided in an embodiment of the present application;

[0076] Fig.17A It is a schematic diagram of a device to be transferred providing an embodiment of the present application, in which a custom capability on the transfer device is enabled;

[0077] Fig. 17B It is a schematic diagram of another device to be transferred provided by the application embodiment for enabling the custom capability on the transfer device;

[0078] Fig.18 It is a flowchart of another device control method provided in an embodiment of the present application;

[0079] Fig.19 It is a flow chart of another device control method provided in an embodiment of the present application. DETAILED DESCRIPTION

[0080] The technical solutions in the embodiments of the present application will be described clearly and in detail below in conjunction with the accompanying drawings. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in the text is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.

[0081] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as suggesting or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features, and in the description of the embodiments of the present application, unless otherwise specified, "plurality" means two or more.

[0082] With the rapid development of smart homes, more and more smart devices are used in homes. When a user moves in a house or changes their activity status, they can actively switch the status of each device, that is, trigger the flow of device status. For example, when a user moves from the dining table to the coffee table in the living room, they can actively trigger the lights in the dining room to flow to the lights in the living room. However, the current state control of these devices is usually independent. When it is necessary to trigger the state flow between devices, the state of one device can only be switched by the remote control device first, and then the state of another device can be switched. For example, when it is necessary to trigger the light flow from the dining room to the living room, it is necessary to control the light state of the dining room from on to off, and then control the light state of the living room from off to on. This device control method has a relatively complicated operation process, poor interaction between devices, and lacks intelligence.

[0083] The embodiment of the present application provides a device control method, which can easily and quickly realize the state transfer between devices, so that the devices have a certain degree of interactivity and improve the intelligence of device control. In the embodiment of the present application, when the user uses the remote control device to control the devices in the house, through the device control method provided by the embodiment of the present application, the position change and posture change of the remote control device in space can be used to determine the device pointed by the remote control device, and then combined with the device state information and device capability information of the device pointed by the remote control device, the device can be dragged and controlled to trigger the flow of device state. For example, after the user points to the lights in the restaurant with the remote control device, presses the confirmation key to select the lights, and keeps the confirmation key in the pressed state until the remote control device is pointed to the lights in the living room, and then releases the confirmation key. Through the device control method provided by the embodiment of the present application, the lighting state of the lights in the restaurant can be controlled to flow to the lights in the living room, so that the lights in the living room are turned on. For another example, when the user points the remote control device to the speaker playing music in the living room, presses the confirmation key to select it, keeps the confirmation key pressed, and points the remote control device to the TV in the living room, and then releases the confirmation key. Through the device control method provided in the embodiment of the present application, the state of the music playing can be controlled to flow to the TV, so that the TV plays music. This device control method is more intelligent and convenient, simplifies the operation of device control, and is conducive to improving the efficiency of device control.

[0084] It should be noted that the flow involved in the embodiments of the present application may be a cut-type flow, for example, after the target content (such as the played music) output by the transfer device is transferred to the device to be transferred, the transfer device may stop outputting the target content, and the device to be transferred may output the target content; or, the flow may also be a copy-type flow, for example, after the target content output by the transfer device is transferred to the device to be transferred, the transfer device may continue to output the target content, and the device to be transferred may also output the target content.

[0085] The present application can be applied to device control in a single room scenario or in a whole house scenario. The application scenarios involved in the embodiments of the present application are introduced below.

[0086] See also Figure 1A , Figure 1A A schematic diagram of a single-room application scenario provided in an embodiment of the present application. Figure 1A As shown, a single room scene (such as a living room) may include at least one household device, for example, a TV 101, a speaker 102, a floor lamp 103, an air purifier 104, an air conditioner 105, etc. In addition, the single room scene may also include a positioning device 106, a remote control device 107, and a hub device 108. Exemplarily, in a single room scene, the user can use the remote control device 107 to point to the speaker 102 that is playing music, press the confirmation button to select the speaker 102, and keep the confirmation button pressed until the remote control device 107 is pointed to the TV 101, and then release the confirmation button, so that the music played in the speaker 102 can be controlled to flow to the TV 101 for playback.

[0087] See also Figure 1B , Figure 1B This is a schematic diagram of a whole-house application scenario provided by an embodiment of the present application. Figure 1BAs shown, the whole house scene may include a living room, a dining room, a study, a bedroom, a gym and other rooms. Each room may include at least one household appliance, for example, the living room may include a TV 101, the dining room may include a soybean milk machine 109 and a refrigerator 110, the study may include a computer 111 and a routing device 112, the bedroom may include an air purifier 104 and a floor lamp 103, and the gym may include a treadmill 113 and a body fat scale 114. In addition, each room may also include a positioning device 106, and the whole house scene may include a remote control device 107 and a hub device 108. Exemplarily, in the whole house scene, the user can use the remote control device 107 to point to the computer 111 in the study that is playing a video, press the confirmation button to select the computer 111, and keep the confirmation button in a pressed state, and then move from the study to the living room, until the remote control device 107 is used to point to the TV 101 in the living room, and then release the confirmation button, the video played by the computer 111 in the study can be controlled to flow to the TV 101 in the living room for playback.

[0088] It should be noted that Figure 1A and Figure 1B The number of devices in the shown scenario does not constitute a specific limitation on the present application. The actual application scenario may include more or fewer devices than the illustrated ones. For example, a single room scenario may include two or more positioning devices, and a whole-house scenario may include two or more remote control devices.

[0089] In the present application embodiment, except Figure 1A and Figure 1B In addition to the devices shown, it may also include door locks, sweeping robots, sockets, washing machines, water heaters, microwave ovens, humidifiers, dehumidifiers, aromatherapy lamps and the like.

[0090] In an embodiment of the present application, the positioning device 106 can be used to locate the remote control device 107 and household appliances. In some embodiments, the positioning device 106 can use ultra wide band (UWB) technology for positioning. UWB technology is a radio communication technology that does not use a sinusoidal carrier, but uses nanosecond non-sinusoidal narrow pulses to transmit data, so the spectrum range it occupies is very wide. UWB has the characteristics of wide spectrum, high precision, low power consumption, strong anti-multipath capability, high security, and low system complexity. It is mostly used for short-distance, high-speed wireless communications, especially in the field of indoor positioning. It has great advantages. In some other embodiments, the positioning device 106 can also use other positioning technologies for positioning, such as ultrasonic positioning technology, which is not limited in the embodiments of the present application.

[0091] The remote control device 107 can be used to remotely control home appliances, including but not limited to controlling the status of home appliances, viewing the operating data of home appliances, etc. The remote control device 107 can be a remote control, for example, a touch remote control, a button remote control, a Bluetooth remote control, an infrared remote control, etc. The remote control device 107 can also be an electronic device such as a mobile phone or a tablet computer.

[0092] The hub device 108 can be used to centrally manage various information related to home appliances. For example, it can manage the device status information, device capability information, location information, etc. of home appliances. In addition, the hub device 108 can also be used to save a whole-house map, establish a whole-house coordinate system, and perform conversion from other coordinate systems (e.g., based on a coordinate system established by the positioning device 106) to a whole-house coordinate system.

[0093] The following is an introduction to the communication system involved in the embodiments of the present application.

[0094] See also Figure 2 , Figure 2 This is a schematic diagram of the structure of a communication system provided in an embodiment of the present application. Figure 2 As shown, the communication system 20 may include a remote control device 201 , household appliances (such as a television 202 , a floor lamp 203 , an air purifier 204 , etc.), a positioning device 205 , and a hub device 206 .

[0095] The remote control device 201 may establish a communication connection with the positioning device 205, and the communication mode may be, for example, UWB communication, wireless fidelity (WiFi), Bluetooth, ZigBee, etc. After the remote control device 201 establishes a communication connection with the positioning device 205, the remote control device 201 may obtain its own positioning result from the positioning device 205, and after obtaining the positioning result, the accelerometer and the gyroscope may be used to correct the positioning result, and then the corrected positioning result may be sent to the positioning device 205. In some embodiments, when the remote control device 201 receives a selection operation (for example, pressing a confirmation key), it may obtain a first positioning result from the positioning device 205, and when it detects that the selection operation stops (for example, releasing the confirmation key), it may obtain a second positioning result from the positioning device 205.

[0096] The remote control device 201 can also establish a communication connection with the home appliance via WiFi or Bluetooth. After the remote control device 201 establishes a communication connection with the home appliance, a control instruction can be sent to the home appliance to control the home appliance. For example, the remote control device 201 can send a turn-on instruction to the TV 202 to control the TV 202 to turn on.

[0097] Optionally, the positioning device 205 can establish a UWB communication or WiFi or Bluetooth communication connection with the home appliance. In some embodiments, the positioning device 205 can directly obtain the location information of the home appliance, or indirectly obtain the location information of the home appliance through the remote control device 201.

[0098] The hub device 206 can establish a communication connection such as WiFi or Bluetooth with the positioning device 205. After the hub device 206 establishes a communication connection with the positioning device 205, the location information of the home appliance, the location information and posture information of the remote control device 201, etc. can be obtained from the positioning device 205. In some embodiments, the hub device 206 can determine the home appliance that has a pointing relationship with the remote control device 201 based on the location information of the home appliance, the location information and posture information of the remote control device 201.

[0099] The hub device 206 can also establish a communication connection with the home appliance via WiFi or Bluetooth. After the hub device 206 establishes a communication connection with the home appliance, it can obtain the device status information and device capability information of the home appliance. After the hub device 206 obtains the device status information and device capability information of the home appliance, it can realize the state flow of controlling the home appliance in combination with the acquired location information and posture information of the remote control device 201.

[0100] The following is an introduction to the hardware structure of the remote control device, positioning device, and central device involved in this application.

[0101] See also Figure 3A , Figure 3AA schematic diagram of the hardware structure of a remote control device (such as a mobile phone) provided in an embodiment of the present application. The remote control device may include a processor 3110, an external memory interface 3120, an internal memory 3121, a universal serial bus (USB) interface 3130, a charging management module 3140, a power management module 3141, a battery 3142, an antenna 1, an antenna 2, a mobile communication module 3150, a wireless communication module 3160, a UWB module 3161, an audio module 3170, a speaker 3170A, a receiver 3170B, a microphone 3170C, an earphone interface 3170D, a sensor module 3180, a button 3190, a motor 3191, an indicator 3192, a camera 3193, a display screen 3194, and a subscriber identification module (SIM) card interface 3195, etc. The sensor module 3180 may include a pressure sensor 3180A, a gyroscope sensor 3180B, an air pressure sensor 3180C, a magnetic sensor 3180D, an acceleration sensor 3180E, a distance sensor 3180F, a proximity light sensor 3180G, a fingerprint sensor 3180H, a temperature sensor 3180J, a touch sensor 3180K, an ambient light sensor 3180L, a bone conduction sensor 3180M, and the like.

[0102] The processor 3110 may include one or more processing units, for example: the processor 3110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a memory, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and / or a neural-network processing unit (neural-network processing unit, NPU), etc. Among them, different processing units can be independent devices or integrated in one or more processors. The controller can be the nerve center and command center of the remote control device. The controller can generate an operation control signal according to the instruction opcode and the timing signal to complete the control of fetching and executing instructions.

[0103] A memory may also be provided in the processor 3110 for storing instructions and data. In some embodiments, the memory in the processor 3110 is a cache memory. The memory may store instructions or data that the processor 3110 has just used or circulated. If the processor 3110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 3110, and thus improves the efficiency of the system.

[0104] The charging management module 3140 is used to receive charging input from a charger. The charger can be a wireless charger or a wired charger. The power management module 3141 is used to connect the battery 3142, the charging management module 3140 and the processor 3110. The power management module 3141 receives input from the battery 3142 and / or the charging management module 3140, and provides power to the processor 3110, the internal memory 3121, the external memory, the display screen 3194, the camera 3193, and the wireless communication module 3160.

[0105] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0106] The mobile communication module 3150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G. The mobile communication module 3150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 3150 can receive electromagnetic waves from the antenna 1, filter, amplify, etc. the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation.

[0107] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 3170A, a receiver 3170B, etc.), or displays an image or video through a display screen 3194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 3110 and be set in the same device as the mobile communication module 3150 or other functional modules.

[0108] The wireless communication module 3160 can provide wireless communication solutions for applications in wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication technology (NFC), infrared technology (IR), etc.

[0109] Optionally, in some embodiments, the wireless communication solution provided by the mobile communication module 3150 can enable the remote control device to communicate with devices in the network (such as hub devices, positioning devices, servers, etc.), and the WLAN wireless communication solution provided by the wireless communication module 3160 can also enable the remote control device to communicate with devices in the network (such as hub devices, positioning devices, servers, etc.), and can communicate with cloud devices through the devices in the network (such as hub devices, positioning devices, servers, etc.). In this way, the remote control device can discover cloud devices and transmit data to cloud devices.

[0110] In the embodiment of the present application, the remote control device (such as a mobile phone) may further include a UWB module 3161, which may provide solutions such as UWB communication and ranging applied to the remote control device. The UWB module 3161 may, for example, integrate a UWB transmitting antenna and multiple UWB receiving antennas to implement attitude measurement of the remote control device based on UWB signals.

[0111] The display screen 3194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light emitting diode (OLED), an active matrix organic light emitting diode or an active matrix organic light emitting diode (AMOLED), a flexible light emitting diode (FLED), Miniled, MicroLed, MicrooLed, a quantum dot light emitting diode (QLED), etc.

[0112] Digital signal processors are used to process digital signals. In addition to processing digital image signals, they can also process other digital signals. For example, when selecting frequency points, digital signal processors are used to perform Fourier transform on frequency point energy.

[0113] NPU is a neural network (NN) computing processor. It can quickly process input information by drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, and can also continuously self-learn.

[0114] The external memory interface 3120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the remote control device. The external memory card communicates with the processor 3110 through the external memory interface 3120 to implement a data storage function. For example, files such as music and videos can be stored in the external memory card.

[0115] The internal memory 3121 can be used to store computer executable program codes, and the executable program codes include instructions. The internal memory 3121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system. The data storage area can store data created during the use of the remote control device. In addition, the internal memory 3121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 3110 executes various functional applications and data processing of the remote control device by running instructions stored in the internal memory 3121 and / or instructions stored in a memory provided in the processor.

[0116] The pressure sensor 3180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 3180A can be disposed on the display screen 3194.

[0117] The gyro sensor 3180B can be used to determine the motion posture of the remote control device. In some embodiments, the angular velocity of the remote control device around three axes (ie, x, y and z axes) can be determined by the gyro sensor 3180B.

[0118] The air pressure sensor 3180C is used to measure air pressure. In some embodiments, the remote control device calculates the altitude through the air pressure value measured by the air pressure sensor 3180C to assist in positioning and navigation.

[0119] The magnetic sensor 3180D includes a Hall sensor. The remote control device can use the magnetic sensor 3180D to detect the opening and closing of the flip leather case. In some embodiments, the remote control device can set features such as automatic unlocking of the flip cover according to the opening and closing state of the leather case or the opening and closing state of the flip cover detected by the magnetic sensor 3180D.

[0120] The accelerometer 3180E can detect the magnitude of the acceleration of the remote control device in all directions (generally three axes). When the remote control device is stationary, it can detect the magnitude and direction of gravity. It can also be used to identify the posture of the remote control device and is applied to applications such as horizontal and vertical screen switching and pedometers.

[0121] Distance sensor 3180F is used to measure distance. The remote control device can measure distance by infrared or laser. In some embodiments, when shooting a scene, the remote control device can use distance sensor 3180F to measure distance to achieve fast focusing.

[0122] The proximity light sensor 3180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. Infrared light may also be emitted outward through the light emitting diode. By using the photodiode, infrared reflected light from a nearby object may be detected. When sufficient reflected light is detected, it may be determined that there is an object nearby. When insufficient reflected light is detected, it may be determined that there is no object nearby.

[0123] The ambient light sensor 3180L is used to sense the ambient light brightness. The remote control device can adaptively adjust the brightness of the display screen 3194 according to the perceived ambient light brightness. The ambient light sensor 3180L can also cooperate with the proximity light sensor 3180G to detect whether the remote control device is in a pocket to prevent accidental touch.

[0124] The fingerprint sensor 3180H is used to collect fingerprints. The remote control device can use the collected fingerprint characteristics to achieve fingerprint unlocking.

[0125] The temperature sensor 3180J is used to detect temperature. In some embodiments, the remote control device can use the temperature detected by the temperature sensor 3180J to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor 3180J exceeds a threshold, the performance of the processor located near the temperature sensor 3180J is reduced to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the remote control device heats the battery 3142 to avoid abnormal shutdown caused by low temperature. In other embodiments, when the temperature is lower than another threshold, the remote control device performs a boost on the output voltage of the battery 3142 to avoid abnormal shutdown caused by low temperature.

[0126] The touch sensor 3180K is also called a “touch panel.” The touch sensor 3180K may be disposed on the display screen 3194 , and the touch sensor 3180K and the display screen 3194 form a touch screen, also called a “touch screen.”

[0127] The bone conduction sensor 3180M can obtain a vibration signal. In some embodiments, the bone conduction sensor 3180M can obtain a vibration signal of a human body's vocal part vibrating bone block. The audio module 3170 can parse a voice signal based on the vibration signal of the vocal part vibrating bone block obtained by the bone conduction sensor 3180M to implement a voice function.

[0128] The key 3190 includes a power key, a confirmation key, a volume key, etc. The key 3190 can be a mechanical key or a touch key. The remote control device can receive key input and generate key signal input related to the object setting and function control of the remote control device.

[0129] The motor 3191 can generate vibration prompts, which can be used for touch vibration feedback. For example, the motor 3191 can also correspond to different vibration feedback effects for touch operations on different areas of the display screen 3194.

[0130] Indicator 3192 can be an indicator light, which can be used to indicate the charging status, power change, etc.

[0131] It can be understood that in other embodiments of the present application, the remote control device may include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange the components differently.

[0132] See also Figure 3B , Figure 3B A schematic diagram of the hardware structure of another remote control device (such as a remote controller) provided in an embodiment of the present application. Figure 3B As shown, the remote control device may include a wireless communication module 301, a UWB module 302, an internal memory 303, a processor 304, a sensor module 305, a power management module 306, and a battery 307. The sensor module 305 may include a gyroscope sensor 305A, an acceleration sensor 305B, a magnetic sensor 305C, and the like.

[0133] The wireless communication module 301 may be one or more devices integrating at least one communication processing module. The wireless communication module 301 may receive electromagnetic waves via an antenna, frequency modulate and filter the electromagnetic wave signals, and send the processed signals to the processor 304. The wireless communication module 301 may also receive signals to be sent from the processor 304, frequency modulate and amplify them, and convert them into electromagnetic waves for radiation via the antenna. Exemplarily, the wireless communication module 301 may include a Bluetooth module, a Wi-Fi module, a ZigBee module, etc.

[0134] The UWB module 302 can provide UWB communication, ranging and other solutions for use in remote control devices. In the embodiment of the present application, the remote control device can integrate a UWB transmitting antenna and multiple UWB receiving antennas to achieve attitude measurement of the remote control device based on UWB signals.

[0135] The internal memory 303 can be used to store one or more computer programs. The processor 304 can run the above instructions stored in the internal memory to enable the remote control device to calculate its own position and execute various applications and data processing. The internal memory may include a code storage area and a data storage area.

[0136] The processor 304 may include one or more processing units, and different processing units may be independent devices or integrated into one or more processors. In the embodiment of the present application, the processor 304 may be used to process the communication information or ranging information output by the UWB module, and the processor may be used to calculate the positioning result of the remote control device.

[0137] The sensor module 305 includes a gyro sensor 305A, an acceleration sensor 305B, and a magnetic sensor 305C. In some embodiments, the sensor module 305 can be used to output azimuth, pitch, and roll angle information of the remote control device.

[0138] The gyro sensor 305A can be used to determine the motion posture of the remote control device. In some embodiments, the angular velocity of the remote control device around three axes (ie, x, y and z axes) can be determined by the gyro sensor 305A.

[0139] The acceleration sensor 305B can detect the magnitude of the acceleration of the remote control device in all directions (generally three axes). When the remote control device is stationary, it can detect the magnitude and direction of gravity. It can also be used to identify the posture of the electronic device.

[0140] The magnetic sensor 305C, that is, a magnetometer, can be used by the remote control device to perform detection to obtain detection data for calculating the posture of the remote control device.

[0141] The power management module 306 is used to connect the battery 307 and the processor 304 . The power management module 306 receives input from the battery 307 and supplies power to the processor 304 , the internal memory 303 , and the wireless communication module 301 .

[0142] See also Figure 3C , Figure 3C A schematic diagram of the hardware structure of a positioning device provided in an embodiment of the present application. Figure 3CAs shown, the positioning device may include a wireless communication module 311 , a UWB module 312 , an internal memory 313 , a processor 314 , a power management module 315 , and a power supply 316 .

[0143] The wireless communication module 311 can provide wireless communication solutions including wireless local area networks (WLAN), Bluetooth, ZigBee, etc. applied to the positioning device. The wireless communication module 311 can be one or more devices integrating at least one communication processing module.

[0144] The UWB module 312 can provide UWB communication, ranging and other solutions for use in positioning devices. It should be noted that the positioning device can be equipped with only one UWB signal receiving antenna, and in this case at least three positioning devices are required to achieve three-dimensional positioning of the remote control device. In another implementation, the positioning device can be equipped with multiple UWB signal receiving antennas, and the arrangement between the antennas needs to meet certain rules. In this implementation, at least two UWB receiving antennas are required to achieve two-dimensional positioning of the remote control device, and at least three UWB receiving antennas are required to achieve three-dimensional positioning of the remote control device. In addition, the positioning device can be equipped with only one UWB transmitting antenna.

[0145] The internal memory 313 can be used to store one or more computer programs, and the processor 314 can execute the instructions stored in the internal memory so that the positioning device can perform the method of position calculation, various applications and data processing, etc. The internal memory can include a code storage area and a data storage area.

[0146] The processor 314 may include one or more processing units, and different processing units may be independent devices or integrated into one or more processors. In the embodiment of the present application, the processor 314 may be used to process the communication or ranging information output by the UWB module, and the processor 314 may also be used to calculate the positioning result of the UWB tag.

[0147] The power management module 315 is used to receive input from a power source 316. The power source 316 can be a battery or a mains supply. The power management module 315 receives power from the battery and / or the mains supply to provide the processor 314, the internal memory 313, and the wireless communication module 311 with power required for normal operation.

[0148] See also Figure 3D , Figure 3D A schematic diagram of the hardware structure of a central device provided in an embodiment of the present application. Figure 3DAs shown, the hub device may include a wireless communication module 321 , an internal memory 322 , a processor 323 , a power management module 324 , and a power supply 325 .

[0149] The wireless communication module 321 can provide wireless communication solutions for application in the central device, including WLAN, Bluetooth, global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared technology (IR), ZigBee, etc.

[0150] The internal memory 322 can be used to store one or more computer programs, which include instructions. The processor 333 can run the above instructions stored in the internal memory, so that the hub device can execute the algorithm flow such as coordinate system conversion. The internal memory may include a code storage area and a data storage area.

[0151] The processor 323 may include one or more processing units, and different processing units may be independent devices or integrated into one or more processors. The processor 323 may be used to process algorithm calculations and business logic, etc.

[0152] The power management module 324 is used to receive input from the power supply 325. The power supply 325 can be a battery or a mains supply. The power management module 324 receives power from the battery and / or the mains supply to provide the processor 323, the internal memory 322, and the wireless communication module 321 with the power required for normal operation.

[0153] It is understandable that Figure 3A , Figure 3B , Figure 3C and Figure 3D The illustrated structure does not constitute a specific limitation on the remote control device, positioning device and hub device. In other embodiments of the present application, the remote control device, positioning device and hub device may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0154] The following describes the steps of a device control method provided by the present application.

[0155] See also Figure 4 , Figure 4 A flow chart of a device control method provided in an embodiment of the present application. The method includes but is not limited to the following steps:

[0156] S401, the remote control device receives a selection operation.

[0157] In an embodiment of the present application, the remote control device may receive a user's selection operation. The selection operation may be an operation whose duration is greater than a threshold, or the selection operation may be an operation whose selection times meet a preset condition. The selection times meeting the preset condition may include the selection times being greater than or equal to the preset times, for example, the preset times may be 2 times, for example, when the remote control device receives 3 (greater than 2 preset times) click selection operations from the user, the state flow between the three devices may be triggered. Optionally, the selection operation may be a long press operation on a key (also referred to as a drag operation), or a click operation on a key, or a combination operation on a key, and the combination operation may be, for example, a click operation first and then a long press operation. Here, the selection operation may be understood as an operation that triggers the flow of the state of the device. By transferring the state of the device, the state of one device may be transferred to another device, for example, the lighting state of lamp A may be transferred to lamp B, so that lamp B may be changed from an off state to a lighting state. Among them, lamp A may be referred to as a transfer device, and lamp B may be referred to as a device to be transferred, that is, the state of the transfer device may be transferred to the device to be transferred.

[0158] Optionally, when the selection operation is a long press operation on a key, the transfer device can be determined from the devices pointed to by the remote control device when the key is pressed, and the device to be transferred can be determined from the devices pointed to by the remote control device when the key is released. Figure 5A As shown, when the button is pressed, the remote control device points to lamp A, and lamp A can be determined as the transfer device. When the button is released, the remote control device points to lamp B, and lamp B can be determined as the device to be transferred. The lighting state of lamp A is then transferred to lamp B, so that lamp B changes from the off state to the lighting state.

[0159] Optionally, when the selection operation is a click operation on a button, the transfer device can be determined from the device pointed to by the remote control device when the button is clicked for the i-th time, and the device to be transferred can be determined from the device pointed to by the remote control device when the button is clicked for the i+1th time, where i is a positive integer. Figure 5B As shown, when the button is clicked for the first time, the remote control device points to lamp A, and lamp A can be determined as the transfer device. When the button is clicked for the second time, the remote control device points to lamp B, and lamp B can be determined as the device to be transferred. Then, the lighting state of lamp A is transferred to lamp B, so that lamp B changes from the off state to the lighting state.

[0160] Optionally, when the selection operation is a combination operation of keys, the combination operation of keys may be, for example, first clicking the key and then long pressing the key. The number of times the key is clicked may be determined as the number of devices to be transferred that are desired to be selected. For example, clicking the key twice in succession may be determined as the number of devices to be transferred being 2, and long pressing the key may determine the transfer device and the device to be transferred. For example, Figure 5C As shown, when the remote control device points to lamp A, click the button twice in succession, then press the button and point to lamps B and lamp C respectively, and finally release the button. Then it can be determined that lamp A is the transfer device, and lamps B and lamps C are the devices to be transferred, and then the lighting state of lamp A is transferred to lamps B and lamps C respectively, so that the states of lamps B and lamps C are changed from the off state to the lighting state.

[0161] S402: The remote control device sends a first positioning request to at least one positioning device. Correspondingly, at least one positioning device receives the first positioning request from the remote control device.

[0162] In an embodiment of the present application, the remote control device may send a first positioning request to at least one positioning device in response to a selection operation. Accordingly, at least one positioning device may receive a positioning request from the remote control device. Here, at least one positioning device may be understood as a positioning device in the whole house, and specifically may be a positioning device in the whole house that is closest to the remote control device when the remote control device receives the selection operation. The positioning device may be, for example, a UWB base station that implements positioning based on UWB technology.

[0163] In some embodiments, the positioning device may establish a first coordinate system to achieve accurate positioning, and perform positioning based on the coordinates in the first coordinate system. Among them, the first coordinate system may also be referred to as a positioning device coordinate system, which is a coordinate system established by the positioning device. The first coordinate system may be established based on the antenna distribution of the positioning device. The positioning device may include a transmitting antenna for transmitting a positioning signal (such as a UWB signal) and a receiving antenna for receiving a positioning signal. It is understood that when the positioning device is used to achieve two-dimensional positioning, it may include at least two receiving antennas and one transmitting antenna, and when the positioning device is used to achieve three-dimensional positioning, it may include at least three receiving antennas and one transmitting antenna. In one possible implementation, the receiving antenna and the transmitting antenna in the positioning device may be integrated into the same antenna, and the positioning device may include only one antenna. In this case, three or more positioning devices may be used to achieve three-dimensional positioning. The embodiment of the present application does not limit the number and distribution of antennas in the positioning device.

[0164] For example, Fig. 6A and Figure 6B The first coordinate system is shown in FIG. 1 based on two antenna distributions. Fig. 6A As shown, the antenna distribution of the positioning device can be three antennas (antenna 0, antenna 1, and antenna 2) presenting an L-shaped antenna structure, and the first coordinate system can be based on the center of antenna 0 in the L-shaped antenna structure as the origin O e Establish. Figure 6B As shown, the antenna distribution of the positioning device may also be three antennas (antenna 0, antenna 1, and antenna 2) presenting a triangular antenna structure, and the first coordinate system may be based on the center of antenna 0 in the triangular antenna structure as the origin O. e Establish. Among them, the X of the first coordinate system e The axis is parallel to the bottom edge of the positioning device and points to the left, Y e The axis points to the front direction of the positioning device, Z e Axis perpendicular to X e O e Y e Flat and upward, with X e Axis and Y e The axis satisfies the right-hand rule.

[0165] Since the first coordinate system is usually established, Z e The positive direction of the axis is the direction opposite to the gravity direction. To ensure that the positioning device can be correctly installed, prompt information can be set on the surface of the positioning device. The prompt information can be used to indicate the correct installation direction of the positioning device. Fig. 6A and Figure 6B As shown, a black arrow may be provided on the surface of the positioning device, perpendicular to the horizontal plane and pointing upward, to prompt the positioning device to be installed according to the direction of the black arrow. Optionally, the positioning device may be installed on a wall of a room, or may be integrated into a home appliance, such as the top of a TV or other large-screen device.

[0166] In some embodiments, in order to determine the posture of the remote control device, the remote control device can establish a remote control device coordinate system. Figure 7 The figure shows the process of establishing the coordinate system of the remote control device. Figure 7 As shown, in the process of establishing the remote control device coordinate system, the center of the remote control device can be used as the origin of the remote control device coordinate system. p , parallel to the horizontal axis of the remote control device, right direction as X p The positive direction of the axis is parallel to the vertical axis of the remote control device and the upward direction is Y p Positive direction of axis, perpendicular to X p O p Y p The plane outward direction is Z p Positive axis direction.

[0167] It should be noted that Figure 7The process of establishing a remote control device coordinate system is described only as an example. In some other embodiments, the remote control device coordinate system may also be established according to other rules. For example, the origin of the remote control coordinate system may also be the center of gravity of the remote control device. p Axis, Y p Axis and Z p The positive direction can also be Figure 7 The direction is opposite to the direction shown, and the embodiments of the present application are not limited to this.

[0168] S403: at least one positioning device sends a first positioning result to the remote control device. Accordingly, the remote control device receives the first positioning result from the at least one positioning device.

[0169] In an embodiment of the present application, at least one positioning device may send a first positioning result to the remote control device. Accordingly, the remote control device may receive the first positioning result from at least one positioning device. Among them, the positioning of the remote control device by at least one positioning device may include determining the position of the remote control device and determining the posture of the remote control device. In other words, the first positioning result may include the position information of the remote control device determined by at least one positioning device (also referred to as the basic position information of the remote control device), and the posture information of the remote control device determined by at least one positioning device (also referred to as the basic posture information of the remote control device).

[0170] In some embodiments, the positioning device determines the basic position information of the remote control device, which specifically includes first determining the distance between the positioning device and the remote control device, then determining the angle of the remote control device relative to the positioning device, and finally calculating the coordinates of the remote control device in the first coordinate system according to the distance between the positioning device and the remote control device, and the angle of the remote control device relative to the positioning device, to obtain the basic position information of the remote control device. Among them, the positioning device and the remote control device can both include a UWB module, and the positioning device and the remote control device can communicate with each other by UWB. Based on the time of UWB communication between the positioning device and the remote control device, the distance between the positioning device and the remote control device can be determined. For example, the distance between the positioning device and the remote control device can be determined by a two-way ranging method; based on the transmission direction of the UWB signal of the remote control device measured by the positioning device, the angle of the remote control device relative to the positioning device can be determined. Furthermore, based on the distance between the positioning device and the remote control device, and the angle of the remote control device relative to the positioning device, the basic position information of the remote control device can be determined.

[0171] For example, Figure 8 The principle of determining the basic position information of the remote control device by the positioning device is shown. Figure 8 As shown, the distance between the positioning device and the remote control device is L, and the signal transmission direction of the remote control device can be represented by angle α and angle β. Among them, angle α is the origin O of the remote control device.p In X e O e Y e Projection of the plane and the origin O of the positioning device e The connection line and X e The angle β is the angle between the positive axis and the origin O of the remote control device. p The origin O of the positioning device e The connection line and Z e Therefore, the basic position information of the remote control device in the first coordinate system can be expressed as the coordinate (x e ,y e , z e ),as follows:

[0172]

[0173] In some embodiments, the positioning device can determine the basic posture information of the remote control device according to the angular rotation relationship between the first coordinate system and the remote control device coordinate system. The basic posture information of the remote control device can be understood as the azimuth angle of the remote control device coordinate system relative to the first coordinate system, and can specifically include the azimuth angle ψ between the remote control device coordinate system and the first coordinate system. p , Pitch angle and roll angle θ p One or more of the three Euler angles. Azimuth ψ p Can be the Y coordinate system of the remote control device p The X axis in the first coordinate system e O e Y e Projection on the plane and Y e The angle between the axes, the azimuth angle can also be called the heading angle or the yaw angle, and the positive direction can be when the remote control device is yawed to the right relative to the positioning device. Can be the Y coordinate system of the remote control device p Axis and the X of the first coordinate system e O e Y e The angle of the plane can be the positive direction when the remote control device is tilted upward relative to the positioning device. p Can be the Z coordinate system of the remote control device p Axis and contains Y p The angle between the vertical planes of the axes can be in the positive direction when the remote control device is tilted to the right relative to the first positioning device.

[0174] In some embodiments, the orientation change of the remote control coordinate system relative to the first coordinate system can be represented by the attitude matrix Describe. Posture matrix The above three Euler angles, namely the azimuth angle ψp , Pitch angle and roll angle θ p The calculation formula is as follows:

[0175]

[0176] S404: The remote control device determines the first position information of the remote control device according to the first positioning result.

[0177] In an embodiment of the present application, after the remote control device receives the first positioning result sent by at least one positioning device, it can determine its own first posture information based on the first positioning result. Among them, the first posture information may include the first position information and the first posture information. Since the remote control device may include an inertial measurement unit (IMU) module, the IMU module may include a gyroscope, an accelerometer, etc. The accelerometer can be used to measure the acceleration of the remote control device, and the gyroscope can measure the angular velocity of the remote control device. After the remote control device receives the first positioning result, that is, after receiving the basic position information and basic posture information of the remote control device, it can combine the acceleration and angular velocity measured by the IMU module to further determine more accurate first position information and first posture information.

[0178] In some embodiments, the remote control device can obtain the acceleration measured by the accelerometer, and determine its own position change information based on the acceleration, for example, the position change information can be obtained by performing a secondary integration process on the acceleration. The position change information is then fused and filtered with the basic position information sent by the positioning device to obtain the first position information of the remote control device. Similarly, the remote control device can obtain the angular velocity measured by the gyroscope, and determine its own attitude change information based on the angular velocity, and then the attitude change information is fused and filtered with the basic attitude information sent by the positioning device to obtain the first attitude information of the remote control device.

[0179] For example, Fig. 9 FIG. 4 shows the process of determining the first position information of the remote control device. Fig. 9 As shown, the remote control device can obtain basic position information and basic attitude information from the positioning device through the UWB module. The acceleration of the remote control device can be obtained through the accelerometer in the IMU module, and the position change information of the remote control device can be obtained by integrating the acceleration. The position change information and the basic position information obtained through the UWB module are fused and filtered to obtain more accurate first position information; the attitude change information of the remote control device can be calculated through the angular velocity of the gyroscope in the IMU module, and the attitude change information and the basic attitude information obtained through the UWB module are fused and filtered to obtain more accurate first attitude information.

[0180] S405, the remote control device sends the first position information to the central device. Correspondingly, the central device receives the first position information from the remote control device.

[0181] In an embodiment of the present application, the remote control device may send the first position information to the central device. Correspondingly, the central device may receive the first position information from the remote control device. The first position information includes the first position information and the first position information.

[0182] Optionally, the remote control device can establish a communication connection with the central device, and the remote control device can directly send the first position information to the central device. The remote control device can also establish a communication connection with the positioning device, and the positioning device establishes a communication connection with the central device, and the remote control device can send the first position information to the positioning device, and then the positioning device forwards the first position information to the central device, so that the remote control device indirectly sends the first position information to the central device.

[0183] S406: The central device determines a first device that has a first pointing relationship with the remote control device from among the M devices according to the first posture information and the position information of the M devices.

[0184] In the embodiment of the present application, after receiving the first position information, the hub device can determine the first device that has a first pointing relationship with the remote control device from the M devices according to the first position information and the position information of the M devices, where M is a positive integer. The first pointing relationship is associated with the first position information of the remote control device.

[0185] Optionally, the M devices may include smart devices, such as a smart TV, a smart speaker, a sweeping robot, etc., and may also include non-smart devices, such as a desk lamp, a window, a fan, etc.

[0186] In some embodiments, each of the M devices may include a UMB module. In this way, the M devices can obtain the position information of the M devices in the coordinate system of the positioning device by performing UWB communication with the positioning device including the UMB module.

[0187] In some embodiments, some of the M devices may include UMB modules, while others may not. For devices that do not include UMB modules, the location marking may be implemented with the assistance of a remote control device, which may include the following two types:

[0188] 1) Close-type position marking method

[0189] The proximity location marking method is to move the remote control device (mobile phone or remote control) containing the UWB module to the device that does not contain the UWB module (hereinafter described as the device to be marked), and then perform UWB communication between the remote control device and the positioning device to obtain the location information of the remote control device in the positioning device coordinate system, and use the location information of the remote control device in the positioning device coordinate system as the location information of the device to be marked in the positioning device coordinate system. This method can be used to mark devices that are close to the user and easy to touch, such as speakers, TVs, floor lamps, etc.

[0190] For example, Fig. 10A The process of close-type position marking is shown in Figure 1. Fig. 10A As shown, the remote control device 1001 moves to the speaker 1002, and through UWB communication between the remote control device 1001 and the positioning device 1003, the position information of the remote control device 1001 in the coordinate system of the positioning device 1003 can be measured, and the position information can be used as the position information of the speaker 1002 in the coordinate system of the positioning device 1003.

[0191] 2) Directional position marking method

[0192] The pointing position marking method is to point the remote control device containing the UWB module at the device to be marked at different positions, and record the position information and posture information of the remote control device at different positions, and use the position information and posture information of the remote control device pointing at the device to be marked at different positions to solve the position information of the device to be marked in the positioning device coordinate system. This method can be used to mark devices that are far away from the user and not easy to touch, such as air conditioners, ceiling lights, etc.

[0193] For example, Fig. 10B The process of directional position marking is shown in FIG. Fig. 10BAs shown, the remote control device 1011 first points to the ceiling light 1012 at position 1, and then moves to position 2 to point to the ceiling light 1012. Through UWB communication between the remote control device 1011 and the positioning device 1013, the position information 1 of the remote control device 1011 in the coordinate system of the positioning device 1013 when it is at position 1, and the position information 2 of the remote control device 1011 in the coordinate system of the positioning device 1013 when it is at position 2 can be measured. In addition, by using the IMU module of the remote control device 1011 and the angle between the coordinate system of the remote control device 1011 and the coordinate system of the positioning device 1013 when the remote control device 1011 is at position 1, the posture information 1 of the remote control device 1011 pointing to the ceiling light 1012 at position 1 can be obtained, and similarly, the posture information 2 of the remote control device 1011 pointing to the ceiling light 1012 at position 2 can be obtained. Finally, based on the position information 1 and posture information 1 of the remote control device 1011 pointing at the ceiling light 1012 at position 1, and the position information 2 and posture information 2 of the remote control device 1011 pointing at the ceiling light 1012 at position 2, the position information of the intersection of the straight line 1014 and the straight line 1015 can be solved, and the position information of the intersection can be used as the position information of the ceiling light 1012 in the coordinate system of the positioning device 1013.

[0194] In some embodiments, the M devices may be devices in a single room, and the single room may include only one positioning device. In this case, the first position information of the remote control device and the position information of the M devices may be obtained based on the same positioning device coordinate system. Determining whether one of the M devices (such as device m) is the first device that has a first pointing relationship with the remote control device may include: calculating the pointing posture information of the remote control device pointing to device m based on the first position information of the remote control device and the position information of device m; in response to the difference between the first posture information of the remote control device and the pointing posture information is less than or equal to a threshold, it can be determined that device m is the first device that has a first pointing relationship with the remote control device.

[0195] In some embodiments, the M devices may be devices in different rooms in a whole house scenario, and each room may include one or more positioning devices. In this case, the first position information of the remote control device and the position information of the M devices may be obtained based on different positioning device coordinate systems. Before determining the first device that has a first pointing relationship with the remote control device from the M devices based on the first position information and the position information of the M devices, the first position information and the position information of the M devices need to be converted to the same coordinate system.

[0196] Optionally, for the whole house scene, a whole house coordinate system (also referred to as a second coordinate system) can be established, and the first position information of the remote control device and the position information of the M devices can be converted to the whole house coordinate system. In this way, the first device in the whole house that has a first pointing relationship with the remote control device can be uniformly determined.

[0197] In some embodiments, the central device can generate a whole house coordinate system based on the whole house floor plan. Fig.11 A method for generating a whole house coordinate system is shown in FIG. Fig.11 As shown, the central device can project the southernmost point of the whole house in the whole house floor plan to the floor plane to obtain a projection point 1101, and then make a straight line 1102 parallel to the east-west direction based on the projection point 1101; then project the westernmost point of the whole house in the whole house floor plan to the floor plane to obtain a projection point 1103, and make a straight line 1104 parallel to the north-south direction based on the projection point 1103; the intersection of the straight line 1102 and the straight line 1104 can be used as the origin of the whole house coordinate system. h , straight line 1102 can be used as the X coordinate system of the whole house h Axis, with due east as X h The positive direction of the axis, line 1104 can be used as the Y axis of the whole house coordinate system. h Axis, with the north direction as Y h Positive axis direction, Z h The axis is perpendicular to the horizontal plane, with the direction pointing to the sky as Z h Positive axis direction.

[0198] In some embodiments, the central device can convert the coordinates in the positioning device coordinate system to the whole-house coordinate system based on the position information of the origin of the positioning device coordinate system in the whole-house coordinate system and the conversion relationship between the positioning device coordinate system and the whole-house coordinate system. Taking the positioning device coordinate system as the above-mentioned first coordinate system as an example, the conversion relationship between the first coordinate system and the whole-house coordinate system can be determined based on the angular rotation relationship between the first coordinate system and the whole-house coordinate system. Among them, the angular rotation relationship between the first coordinate system and the whole-house coordinate system can be described by the attitude angle of the first coordinate system relative to the whole-house coordinate system, which can specifically include the azimuth angle between the first coordinate system and the whole-house coordinate system. Pitch Angle and roll angle Azimuth Can be the Y of the first coordinate system e The X axis in the whole house coordinate system h O h Y h Projection on the plane and Y h The angle between the axes can be e The right yaw of the axis is the positive direction. Can be the Y of the first coordinate system e Axis and the X of the whole house coordinate system h O h Y h The plane angle can be Y e The axial deflection is the positive direction. Can be the Z of the first coordinate system e Axis and contains Y e The angle between the vertical planes of the axes can be such that the first coordinate system is tilted to the right relative to the whole house coordinate system as the positive direction. The transformation relationship between the first coordinate system and the whole house coordinate system can be defined as the attitude transformation matrix between the first coordinate system and the whole house coordinate system. The formula is as follows:

[0199]

[0200] For example, it is assumed that the coordinates of the origin of the first coordinate system in the whole house coordinate system are expressed as The coordinates of point p in the first coordinate system are Then the coordinates of point p in the whole house coordinate system are It can be calculated by the following formula:

[0201]

[0202] Based on this, the central device can convert the first position information of the remote control device and the position information of the M devices into the whole house coordinate system respectively.

[0203] In some embodiments, the first posture information of the remote control device in the first coordinate system can also be converted into posture information in the whole-house coordinate system, and the posture information of the remote control device in the whole-house coordinate system can be understood as the posture angle of the remote control device coordinate system relative to the whole-house coordinate system. Determining whether one of the M devices (such as device m) is the first device that has a first pointing relationship with the remote control device may include: calculating the pointing posture information of the remote control device pointing to device m in the whole-house coordinate system based on the position information of the remote control device in the whole-house coordinate system and the position information of device m in the whole-house coordinate system, and in response to the difference between the posture information of the remote control device in the whole-house coordinate system and the pointing posture information pointing to device m in the whole-house coordinate system is less than or equal to a threshold, it can be determined that device m is the first device that has a first pointing relationship with the remote control device.

[0204] In some embodiments, the attitude information of the remote control device in the whole-house coordinate system may include the azimuth and pitch angle of the remote control device in the whole-house coordinate system, and the pointing attitude information of the remote control device pointing to the device m in the whole-house coordinate system may include the azimuth and pitch angle of the remote control device pointing to the device m in the whole-house coordinate system. If the difference between the azimuth of the remote control device in the whole-house coordinate system and the azimuth of the remote control device pointing to the device m in the whole-house coordinate system is less than or equal to the first threshold, and the difference between the pitch angle of the remote control device in the whole-house coordinate system and the pitch angle of the remote control device pointing to the device m in the whole-house coordinate system is less than or equal to the second threshold, then it can be determined that the attitude information of the remote control device in the whole-house coordinate system and the pointing attitude information of the remote control device pointing to the device m in the whole-house coordinate system are less than or equal to the threshold. Wherein, the first threshold and the second threshold may be the same or different.

[0205] For example, assuming that the position of the remote control device in the whole house coordinate system is [x h ,y h , z h ], the azimuth is ψ h , the pitch angle is The position of device m in the whole house coordinate system is The azimuth of the remote control device pointing to the device m in the whole house coordinate system can be calculated by the following formula:

[0206]

[0207] in,

[0208] The pitch angle of the remote control device pointing to the device m in the whole house coordinate system can be calculated by the following formula:

[0209]

[0210] The azimuth angle ψ of the remote control device in the whole house coordinate system h , and the azimuth of the remote control device pointing to device m in the whole house coordinate system The difference between them is:

[0211]

[0212] The pitch angle of the remote control device in the whole house coordinate system The pitch angle of the remote control device pointing to the device m in the whole house coordinate system The difference between them is:

[0213]

[0214] when is less than or equal to a first threshold, and If the value is less than or equal to the second threshold, it can be determined that the device m is a first device having a first pointing relationship with the remote control device.

[0215] For example, assuming that device m is a ceiling light, Fig.12 The relationship between the first gesture information of the remote control device and the directional gesture information pointing to the ceiling light is shown. Fig.12 As shown, the current first posture information of the remote control device 1201 includes an azimuth angle of ψ h and the pitch angle is When the remote control device 1201 points to the ceiling light 1202, the pointing attitude information includes an azimuth angle of and the pitch angle is At an azimuth of ψ h With azimuth Between

[0216] The difference is less than or equal to the first threshold, and the pitch angle is With the pitch angle When the difference between the values ​​of 1 and 2 is less than or equal to the second threshold, the remote control device 1201 can be directed toward the ceiling light 1202 .

[0217] It can be understood that the first device having the first pointing relationship with the remote control device may include multiple devices, and the multiple devices may be devices located on the same straight line or devices located close to each other.

[0218] S407: The remote control device detects that the selection operation stops.

[0219] In an embodiment of the present application, the duration of the selection operation may be greater than a threshold value, and when the user ends the selection operation, the remote control device may detect that the selection operation has stopped. Alternatively, when the number of selections of the selection operation meets a preset condition, the remote control device may determine that the selection operation has ended. The number of selections meeting the preset condition may include the number of selections being greater than or equal to the preset number.

[0220] Optionally, the selection operation may be a long press operation on a key, the duration of the long press operation is greater than a threshold, and when the long press operation ends, ie, when the key is released, the remote control device may determine that the selection operation stops.

[0221] Optionally, the selection operation may also be a click operation on a button. The remote control device may receive multiple click operations from the user within a specified time period. If, after receiving the nth click operation on the button, the (n+1)th click operation on the button is not received within a first time interval, the remote control device may determine that the selection operation has stopped, where n is a positive integer.

[0222] Optionally, the selection operation may also be a combination operation on the key, and the combination operation on the key may be, for example, first a click operation on the key and then a long press operation on the key. If, after receiving the click operation on the key, a long press operation on the key is received again within the second time interval, the remote control device may determine that the selection operation stops when the long press operation ends.

[0223] S408: The remote control device sends a second positioning request to at least one positioning device. Correspondingly, at least one positioning device receives the second positioning request from the remote control device.

[0224] In an embodiment of the present application, the remote control device may send a second positioning request to at least one positioning device according to the selection operation. Accordingly, at least one positioning device may receive the second positioning request from the remote control device. Among them, at least one positioning device may be the positioning device that is closest to the remote control device in the whole house when the remote control device detects that the selection operation has stopped. The positioning device may be, for example, a UWB base station that implements positioning based on UWB technology. It is understandable that in the present application, the positioning device to which the remote control device sends the first positioning request and the positioning device to which the second positioning request is sent may be the same positioning device, or may be the same group of positioning devices, or may be two different positioning devices, or may be two groups of positioning devices that are partially or completely different.

[0225] For example, Fig.13 As shown, the remote control device 1301 can receive a selection operation when pointing to the smart speaker 1302 at position 1, and the selection operation can be pressing a button. In response to the selection operation, the remote control device 1301 can send a first positioning request to the first positioning device 1303 next to the smart speaker 1302. When the remote control device 1301 moves to position 2 and points to the large-screen device 1304, it detects that the selection operation stops, that is, it detects the operation of releasing the button. At this time, the remote control device 1301 can send a second positioning request to the second positioning device 1305 next to the large-screen device 1304. Here, the first positioning device and the second positioning device can be two different positioning devices.

[0226] S409: at least one positioning device sends a second positioning result to the remote control device. Accordingly, the remote control device receives the second positioning result from the at least one positioning device.

[0227] S410: The remote control device determines second position information of the remote control device according to the second positioning result.

[0228] S411, the remote control device sends second position information to the central device. Correspondingly, the central device receives the second position information from the remote control device.

[0229] S412: The central device determines, from the M devices, a second device that has a second pointing relationship with the remote control device according to the second posture information and the position information of the M devices.

[0230] It should be noted that the specific implementation process and implementation principle of steps S408-S412 in the embodiment of the present application are similar to those of steps S402-S406, and will not be repeated here. Among them, the second pointing relationship is associated with the second posture information of the remote control device. The second posture information of the remote control device is different from the first posture information.

[0231] S413, the central device determines the transfer device from the first device and the device to be transferred from the second device according to the device capability information of the first device, the device status information of the first device, the device capability information of the second device and the device status information of the second device.

[0232] In the embodiment of the present application, after the hub device determines the first device that has a first pointing relationship with the remote control device and the second device that has a second pointing relationship with the remote control device, the hub device can determine the transfer device from the first device and the device to be transferred from the second device based on the device capability information of the first device, the device status information of the first device, the device capability information of the second device, and the device status information of the second device. Among them, the device capability information can be used to indicate the capabilities of the device, and the device status information can be used to indicate the switch status of each capability of the device.

[0233] In some embodiments, the central device can obtain device information of all devices in the house, and the device information includes device status information and device capability information. Exemplarily, the device information can be presented in the form of a table, as shown in Table 1.

[0234] Table 1

[0235]

[0236]

[0237] In some embodiments, after the hub device determines a first device that has a first pointing relationship with the remote control device, and a second device that has a second pointing relationship with the remote control device, it can determine a candidate transfer device from the first device and a candidate device to be transferred from the second device based on the device capability information of the first device, the device status information of the first device, the device capability information of the second device, and the device status information of the second device. Among them, one candidate transfer device can correspond to at least one candidate device to be transferred. The candidate transfer device and the candidate device to be transferred corresponding to the candidate transfer device have the same target capability, and the state of the target capability on the candidate transfer device is turned on.

[0238] The following describes the process by which the central device determines candidate transfer devices and candidate devices to be transferred. Fig.14 , Fig.14 A schematic diagram of a process for a hub device to determine a candidate transfer device and a candidate to-be-transferred device provided in an embodiment of the present application. Fig.14 As shown, the specific steps may include but are not limited to the following steps:

[0239] S1401: Determine, through a user's selection operation, a first device that has a first pointing relationship with the remote control device and a second device that has a second pointing relationship with the remote control device.

[0240] The first device that has a first pointing relationship with the remote control device may be one or more devices, and the second device that has a second pointing relationship with the remote control device may be one or more devices.

[0241] For example, Fig.15 A schematic diagram of a first device and a second device is shown. Fig.15 As shown, when the remote control device 1501 is at position 1, it receives the user's button pressing operation, and it can be determined that the first device in a first pointing relationship with the remote control device 1501 includes the speaker 1502 and the lamp 1503. When the remote control device 1501 moves to position 2, it detects the user's button releasing operation, and it can be determined that the second device in a second pointing relationship with the remote control device 1501 includes the smart screen 1504 and the aromatherapy lamp 1505.

[0242] S1402: Determine a first capability that is currently enabled in device k, where device k is one of the first devices.

[0243] After determining that the first device has a first pointing relationship with the remote control device, the hub device can determine that the first device has a first capability in the device state that is turned on. Here, the first capability can also be referred to as a capability to be transferred. For example, assuming Fig.15 The audio capability of the middle speaker 1502 is on, the lighting capability of the speaker 1502 is off, and the lighting capability of the lamp 1503 is on. Then the hub device can determine that the first capability of the speaker 1502 is the audio capability, and the first capability of the lamp 1503 is the lighting capability.

[0244] S1403: Determine whether device n has a first capability, where device n is one of the second devices.

[0245] Furthermore, the hub device may determine whether there is a device with the first capability among the second devices that have a second pointing relationship with the remote control device. Fig.15The smart screen 1504 has the first capability of the speaker 1502 (i.e., audio capability), and the first capability of the lamp 1503 (i.e., lighting capability), and the aromatherapy lamp 1505 has the first capability of the lamp 1503 (i.e., lighting capability).

[0246] S1404: If the device n has the first capability, determine whether the first capability of the device n is enabled.

[0247] After determining that there is a device with the first capability in the second device, it can be determined whether the state of the first capability in the device is enabled.

[0248] S1405: If the first capability of device n is in a closed state, determine that device k is a candidate transfer device, and device n is a candidate to-be-transferred device corresponding to device k.

[0249] For example, suppose Fig.15 The lighting capability of the smart screen 1504 is off, and the lighting capability of the aromatherapy lamp 1505 is off. Then, it can be determined that the lamp 1503 having a first pointing relationship with the remote control device 1501 is a candidate transfer device, and the smart screen 1504 and the aromatherapy lamp 1505 having a second pointing relationship with the remote control device 1501 are candidate devices to be transferred, and the capability to be transferred is lighting capability.

[0250] S1406, if the first capability of device n is enabled, determine whether the first capability is an audio capability or a video capability; if the first capability is an audio capability or a video capability, determine that device k corresponding to the first capability is a candidate transfer device, and device n is a candidate to-be-transferred device corresponding to device k.

[0251] For example, suppose Fig.15 If the audio capability of the smart screen 1504 is turned on, it can be determined that the speaker 1502 that has a first pointing relationship with the remote control device 1501 is a candidate transfer device, and the smart screen 1504 that has a second pointing relationship with the remote control device 1501 is a candidate device to be transferred, and the capability to be transferred is the audio capability.

[0252] In some embodiments, after the hub device determines the candidate transfer device and the candidate to-be-transferred device, it can store the correspondence between the candidate transfer device and the candidate to-be-transferred device.

[0253] Table 2

[0254]

[0255] In some embodiments, the hub device can determine the transfer device from the candidate transfer devices, and determine the device to be transferred from the candidate devices to be transferred, based on the distance between the candidate transfer device and the remote control device, and the distance between the candidate device to be transferred and the remote control device. Exemplarily, taking Table 2 as an example, assuming that the distance between the lamp in the candidate transfer device and the remote control device is A, and the distance between the speaker in the candidate transfer device and the remote control device is B, if A is greater than B, then it can be determined that the speaker is the transfer device and the smart screen is the device to be transferred; if A is less than B, then it can be determined that the lamp is the transfer device. Optionally, when the lamp is the transfer device, the smart screen and the aromatherapy lamp can be determined as two devices to be transferred, or the one of the smart screen and the aromatherapy lamp that is closer to the remote control device can be determined as the device to be transferred. It can be understood that the number of devices to be transferred can be selected according to demand.

[0256] In some embodiments, when there are multiple candidate transfer devices, the hub device can also select the candidate transfer device with the highest priority as the transfer device according to the priority of the device. Similarly, after determining the transfer device, if there are multiple corresponding candidate transfer devices, the device to be transferred can also be selected from the candidate devices to be transferred according to the priority of the device. It can be understood that the priority of the device can be set according to the needs, and the higher the priority, the higher the importance. Optionally, when the priority of the device is the same, the selection can be made in combination with the distance between the device and the remote control device. For example, a device with the same priority and the closest distance to the remote control device can be selected as a transfer device or a device to be transferred. Exemplarily, taking Table 2 as an example, assuming that the priority of the speaker in the candidate transfer device is higher than that of the lamp, then the speaker can be determined as the transfer device and the smart screen can be determined as the device to be transferred; if the priority of the lamp is higher than that of the speaker, then the lamp can be determined as the transfer device. Optionally, when the lamp is a transfer device, two devices to be transferred, the smart screen and the aromatherapy lamp, can be determined, or the one with a higher priority between the smart screen and the aromatherapy lamp can be determined as the device to be transferred. Optionally, when the smart screen and the aromatherapy lamp have the same priority, the one of the smart screen and the aromatherapy lamp that is closer to the remote control device can be determined as the device to be transferred.

[0257] In some embodiments, the hub device may also determine a third device associated with the movement track of the remote control device from the M devices based on the first posture information, the second posture information, and the position information of the M devices. Figure 5CIn the example, the remote control device moves from the position pointing to lamp A to the position pointing to lamp C, and the third device associated with the movement track of the remote control device is lamp B. Then, according to the device capability information of the first device, the device status information of the first device, the device capability information of the second device, the device status information of the second device, the device capability information of the third device, and the device status information of the third device, the transfer device is determined from the first device, and the devices to be transferred are determined from the second device and the third device, respectively.

[0258] S414, the central device controls the device to be transferred to enable the target capability, and / or controls the device to be transferred to output the target content.

[0259] In the implementation of the present application, after the central device determines the transfer device and the device to be transferred, it can control the device to be transferred to turn on the target capability (i.e., the capability to be transferred), and / or control the device to be transferred to output the target content. Among them, controlling the device to be transferred to output the target content can be understood as controlling the device to be transferred to display and / or play the target content. The target content can be all or part of the content output by the transfer device when the target capability is in the turned-on state. Optionally, the central device controls the device to be transferred to turn on the target capability, and / or controls the device to be transferred to output the target content by first sending a first instruction to the transfer device to control the transfer device to turn off the target capability, and / or control the transfer device to stop outputting the target content; and then sending a second instruction to the device to be transferred to control the device to be transferred to turn on the target capability, and / or control the device to be transferred to output the target content. Optionally, after receiving the first instruction, the transfer device can also keep the target capability turned on, and / or continue to output the target content.

[0260] In some embodiments, the central device can control the device to be transferred to turn on the target capability, and control the transfer device to turn off the target capability. For example, the transfer device is a humidifier, the device to be transferred is an aromatherapy lamp, and the target capability is the air humidification capability. The central device can control the aromatherapy lamp to turn on the air humidification capability, and control the humidifier to turn off the air humidification capability, so that the state of the air humidification capability in the humidifier is transferred to the aromatherapy lamp.

[0261] In some embodiments, the central device can also control the device to be transferred to turn on the target capability, and control the transfer device to keep the target capability in the turned-on state. For example, the transfer device is an aromatherapy lamp, the device to be transferred is a lamp, and the target capability is the lighting capability. The central device can control the lamp to turn on the lighting capability, and control the aromatherapy lamp to keep the lighting capability in the turned-on state, that is, control the aromatherapy lamp to continue lighting, so that the lighting capability in the aromatherapy lamp is transferred to the lamp.

[0262] In some embodiments, when the target capability is audio capability or video capability, the hub device can control the device to be transferred to output all the content output by the transfer device when the target capability is in the on state. When the target capability is audio capability, all the content output by the transfer device when the target capability is in the on state can be the complete song content of the currently playing song, or the complete content of all songs in the current playlist. When the target capability is video capability, all the content output by the transfer device when the target capability is in the on state can be the complete video content of the currently playing video, or the complete content of all videos in the current playlist. For example, the transfer device is a speaker, the device to be transferred is a TV, and the target capability is audio capability. If the speaker is currently playing song A, the hub device can control the TV to play song A from the beginning, or it can control the TV to start playing from the first song in the playlist (for example, song B).

[0263] In some embodiments, when the target capability is audio capability or video capability, the hub device can also control the device to be transferred to output part of the content output by the transfer device when the target capability is in the on state. When the target capability is audio capability, the part of the content output by the transfer device when the target capability is in the on state can be part of the content corresponding to the progress of the currently playing song, that is, the hub device can control the device to be transferred to start playing the song from the progress of the song currently playing by the transfer device. Similarly, when the target capability is video capability, the part of the content output by the transfer device when the target capability is in the on state can be part of the content corresponding to the progress of the currently playing video, that is, the hub device can control the device to be transferred to start playing the video from the progress of the video currently playing by the transfer device. For example, the transfer device is the TV in the living room, the device to be transferred is the TV in the bedroom, and the target capability is video capability. If the TV in the living room is currently playing video A with a progress of 15 minutes, the hub device can control the TV in the bedroom to start playing from the progress of video A with 15 minutes.

[0264] In some embodiments, when both the transferring device and the device to be transferred have display screens, the hub device can also control the device to be transferred to display the content displayed on the transferring device, including but not limited to controlling the device to be transferred to display the files, images, animations, applications, etc. displayed on the transferring device. Fig.16 A schematic diagram showing a device to be transferred displays the content displayed on the transfer device. Fig.16As shown, when the remote control device 1601 is at position 1, it receives the user's button press operation and determines that the large screen device 1602 pointed by the remote control device 1601 is the transfer device. When the remote control device 1601 moves to position 2, it detects the user's button release operation and determines that the TV 1603 pointed by the remote control device 1601 is the device to be transferred. Then the hub device can control the TV 1603 (i.e., the device to be transferred) to display the image displayed by the large screen device 1602 (i.e., the transfer device).

[0265] In some embodiments, the transfer device can be a smart device or a non-smart device. For a non-smart device, the target capability can be a customized capability, for example, a window can have a customized weather capability, and a door can have a customized schedule capability. Fig.17A and Fig. 17B A schematic diagram showing a device to be transferred enabling the custom capability on the transfer device. Fig.17A As shown, when the remote control device 1701 is at position 1, it receives the user's button press operation and determines that the window 1702 pointed by the remote control device 1701 is the transfer device. When the remote control device 1701 moves to position 2, it detects the user's button release operation and determines that the TV 1703 pointed by the remote control device 1701 is the device to be transferred. The window 1702 and the TV 1703 can have the same weather capabilities (customized capabilities). The hub device can control the TV 1703 to display the current weather information and / or air quality information, for example, displaying the current weather information as 30°C, cloudy, and the current air quality information as excellent air. Fig. 17B As shown, when the remote control device 1701 is at position 1, it receives the user's button press operation and determines that the door 1704 pointed by the remote control device 1701 is the transfer device. When the remote control device 1701 moves to position 2, it detects the user's button release operation and determines that the TV 1703 pointed by the remote control device 1701 is the device to be transferred. The door 1704 and the TV 1703 can have the same schedule capability (customized capability). The central device can control the TV 1703 to display the schedule information of the day, for example, showing that the schedule of the day includes attending a seminar at the conference center from 9:00 to 10:30 and attending a parent-teacher meeting at the school from 13:00 to 14:30.

[0266] In the embodiment of the present application, the central device can judge the devices that the remote control device points to first and then second according to the posture information of the remote control device and the location information of the devices in the whole house, and then determine the transfer device and the device to be transferred for state transfer based on the device capability information and device status information of the device pointed to by the remote control device, and then control the device capability information and / or device status information of the transfer device pointed to first to flow to the device to be transferred pointed to later. By implementing the embodiment of the present application, on the one hand, the pointing control of the device can be realized, the control of the function flow between devices can be automatically realized, the operation process can be simplified, and the efficiency of device control can be improved. On the one hand, the intersection of the capabilities of different devices can be used to make the devices have a certain degree of interactivity, which is conducive to improving the intelligence of device control.

[0267] The following introduces the steps of another device control method provided by the present application.

[0268] See also Fig.18 , Fig.18 A flow chart of another device control method provided in an embodiment of the present application. The method includes but is not limited to the following steps:

[0269] S1801, the remote control device receives a selection operation.

[0270] S1802: The remote control device sends a first positioning request to at least one positioning device. Correspondingly, at least one positioning device receives the first positioning request from the remote control device.

[0271] S1803: At least one positioning device sends a first positioning result to the remote control device. Correspondingly, the remote control device receives the first positioning result from the at least one positioning device.

[0272] S1804: The remote control device determines first position information of the remote control device according to the first positioning result.

[0273] The specific implementation process and implementation principle of steps S1801 to S1804 can be found in Figure 4 The corresponding steps S401 to S404 in the embodiment are not described in detail here.

[0274] S1805: The remote control device determines, from the M devices, a first device that has a first pointing relationship with the remote control device according to the first posture information and the position information of the M devices.

[0275] In an embodiment of the present application, the remote control device can determine the first device that has a first pointing relationship with the remote control device from the M devices based on the first posture information and the position information of the M devices. Optionally, the remote control device can pre-store the position information of the M devices, or obtain the position information of the M devices from the cloud server. Optionally, the remote control device can periodically update the stored position information of the M devices to avoid changes in the device position affecting the judgment result of the remote control device.

[0276] It should be noted that the specific implementation of step S1805 is similar to the above step S406, the difference is that step S406 is executed by the central device, and step S1805 is executed by the remote control device. Figure 4 The description of step S406 in the corresponding embodiment will not be repeated here.

[0277] S1806: The remote control device sends the first information to the hub device. Correspondingly, the hub device receives the first information from the remote control device.

[0278] In an embodiment of the present application, after the remote control device determines the first device that has a first pointing relationship with the remote control device from M devices, the first information can be sent to the central device. Correspondingly, the central device can receive the first information from the remote control device. Among them, the first information can be used to indicate the identification information of the first device that has a first pointing relationship with the remote control device among the M devices. The identification information can be used to uniquely identify the device, and different devices can be distinguished by the identification information. For example, the identification information can be the ID of the device, and different devices can be distinguished by different IDs. Alternatively, the identification information can be the name of the device, and different devices have different names. Alternatively, the identification information can be the number of the device, and different devices can also be distinguished by different numbers.

[0279] S1807: The central device determines the first device from the M devices based on the first information.

[0280] In an embodiment of the present application, after the hub device receives the first information from the remote control device, it can determine the first device from the M devices based on the identification information indicated by the first information.

[0281] S1808: The remote control device detects that the selection operation stops.

[0282] S1809: The remote control device sends a second positioning request to at least one positioning device. Correspondingly, at least one positioning device receives the second positioning request from the remote control device.

[0283] S1810: At least one positioning device sends a second positioning result to the remote control device. Correspondingly, the remote control device receives the second positioning result from the at least one positioning device.

[0284] S1811: The remote control device determines second position information of the remote control device according to the second positioning result.

[0285] The specific implementation of steps S1808 to S1811 can be found in Figure 4 The corresponding steps S407 to S410 in the embodiment will not be described in detail here.

[0286] S1812: The remote control device determines, from the M devices, a second device that has a second pointing relationship with the remote control device based on the second posture information and the position information of the M devices.

[0287] S1813, the remote control device sends the second information to the hub device. Correspondingly, the hub device receives the second information from the remote control device.

[0288] S1814: The central device determines a second device from the M devices based on the second information.

[0289] The implementation process and implementation principle of steps S1812 to S1814 are similar to those of steps S1805 to S1807 and will not be repeated here.

[0290] S1815, the central device determines the transfer device from the first device and the device to be transferred from the second device based on the device capability information of the first device, the device status information of the first device, the device capability information of the second device and the device status information of the second device.

[0291] S1816, the central device controls the device to be transferred to enable the target capability, and / or controls the device to be transferred to output the target content.

[0292] The specific implementation of step S1815 and step S1816 can be found in Figure 4 The corresponding steps S413 and S414 in the embodiment are not described in detail here.

[0293] In the embodiment of the present application, the remote control device can determine the devices pointed to first and then second based on its own posture information and the location information of the devices in the whole house, and then the remote control device informs the central device of the pointed device, so that the central device can combine the device capability information and device status information of the device pointed to by the remote control device to determine the transfer device and the device to be transferred for state transfer, and then control the device capability information and / or device status information of the transfer device pointed to first to flow to the device to be transferred pointed to later. By implementing the embodiment of the present application, on the one hand, the pointing control of the device can be realized, the control of the function flow between devices can be automatically realized, the operation process can be simplified, and the efficiency of device control can be improved. On the one hand, the intersection of the capabilities of different devices can be used to make the devices have a certain degree of interactivity, which is conducive to improving the intelligence of device control.

[0294] The following introduces the steps of another device control method provided by the present application.

[0295] See also Fig.19 , Fig.19 A flowchart of another device control method provided in an embodiment of the present application. The method can be executed by a central device, including but not limited to the following steps:

[0296] S1901: Determine, from M devices, a first device that has a first pointing relationship with the remote control device.

[0297] The central device may determine the first device having the first pointing relationship with the remote control device from the M devices in two specific ways:

[0298] In method 1, the central device can receive the first position information from the remote control device, and determine the first pointing relationship between the M devices and the remote control device according to the first position information and the position information of the M devices. Figure 4 This corresponds to the description of step S406 in the embodiment.

[0299] In the second method, the hub device can receive the first information from the remote control device, and then determine the first device from the M devices based on the first information. The first information is used to indicate the identification information of the first device in the M devices that has a first pointing relationship with the remote control device. The specific implementation process of the second method can be referred to Fig.18 The description of step S1806 and step S1807 in the corresponding embodiment.

[0300] S1902: Determine, from the M devices, a second device that has a second pointing relationship with the remote control device.

[0301] The second pointing relationship is associated with second posture information of the remote control device, and the second posture information is different from the first posture information.

[0302] The implementation process of step S1902 is similar to that of step S1901 and will not be repeated here.

[0303] S1903, determining a transfer device from the first device and a device to be transferred from the second device according to device capability information of the first device, device status information of the first device, device capability information of the second device and device status information of the second device.

[0304] S1904: Control the device to be transferred to enable the target capability, and / or control the device to be transferred to output the target content.

[0305] The specific implementation of step S1903 and step S1904 can be found in Figure 4 The corresponding steps S413 and S414 in the embodiment are not described in detail here.

[0306] By implementing the embodiments of the present application, on the one hand, the position information change of the remote control device can be used to realize the pointing control of the device, automatically realize the control of the function flow between devices, simplify the operation process, and help improve the efficiency of device control. On the other hand, the intersection of the capabilities of different devices can be used to make the devices have a certain degree of interactivity, which is conducive to improving the intelligence of device control.

[0307] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) mode. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state disk (SSD)), etc.

[0308] Those skilled in the art can understand that to implement all or part of the processes in the above-mentioned embodiments, the processes can be completed by computer programs to instruct related hardware, and the programs can be stored in computer-readable storage media. When the programs are executed, they can include the processes of the above-mentioned method embodiments. The aforementioned storage media include: ROM or random access memory RAM, magnetic disk or optical disk and other media that can store program codes.

[0309] In short, the above description is only an embodiment of the technical solution of the present invention, and is not intended to limit the protection scope of the present invention. Any modification, equivalent replacement, improvement, etc. made according to the disclosure of the present invention shall be included in the protection scope of the present invention.

Claims

1. A device control method, applied to a central device, characterized in that: The method comprises: Determine a first device having a first pointing relationship with the remote control device from among the M devices; the remote control device is used to remotely control the M devices, where M is a positive integer; and the first pointing relationship is associated with the first position information of the remote control device; Determine, from the M devices, a second device that has a second pointing relationship with the remote control device; the second pointing relationship is associated with second posture information of the remote control device; the second posture information is different from the first posture information; According to the device capability information of the first device, the device status information of the first device, the device capability information of the second device and the device status information of the second device, a transfer device is determined from the first device and a device to be transferred is determined from the second device; the transfer device and the device to be transferred have the same target capability, and the target capability is enabled on the transfer device; The device to be transferred is controlled to enable the target capability, and / or the device to be transferred is controlled to output target content, where the target content is all or part of the content output by the transferring device when the target capability is enabled.

2. The method according to claim 1, characterized in that The step of determining, from the M devices, a first device that has a first pointing relationship with the remote control device comprises: Receive the first position information of the remote control device; According to the first posture information and the position information of the M devices, a first device having a first pointing relationship with the remote control device is determined from the M devices.

3. The method according to claim 2, characterized in that The first position information includes first position information and first posture information; The step of determining, from the M devices, a first device having a first pointing relationship with the remote control device according to the first posture information and the position information of the M devices, includes: Determine, according to the first position information and the position information of the device m, the pointing posture information of the remote control device pointing to the device m; the device m is one of the M devices; In response to a difference between the first posture information and the pointing posture information being less than or equal to a threshold, it is determined that the device m is a first device having a first pointing relationship with the remote control device.

4. The method according to claim 3, characterized in that The first position information is position information based on a first coordinate system, and the position information of the device m is position information based on a second coordinate system; The determining, according to the first position information and the position information of the device m, the pointing posture information of the remote control device pointing to the device m includes: Acquire position information of the origin of the first coordinate system in the second coordinate system, and a conversion relationship between the first coordinate system and the second coordinate system; According to the position information of the origin of the first coordinate system in the second coordinate system and the conversion relationship between the first coordinate system and the second coordinate system, the first position information is converted to the second coordinate system to obtain the second position information of the remote control device; According to the second position information and the position information of the device m, the pointing posture information of the remote control device pointing to the device m is determined.

5. The method according to claim 1, characterized in that The step of determining, from the M devices, a first device that has a first pointing relationship with the remote control device comprises: Receiving first information from a remote control device, where the first information is used to indicate identification information of a first device among the M devices that has a first pointing relationship with the remote control device; Based on the first information, the first device is determined from the M devices.

6. The method according to claim 1, characterized in that The determining a transfer device from the first device and a to-be-transferred device from the second device according to the device capability information of the first device, the device status information of the first device, the device capability information of the second device, and the device status information of the second device includes: According to the device capability information of the first device, the device status information of the first device, the device capability information of the second device and the device status information of the second device, a candidate transfer device is determined from the first device, and a candidate device to be transferred is determined from the second device; wherein one candidate transfer device corresponds to at least one candidate device to be transferred, the one candidate transfer device and each candidate transfer device in the at least one candidate device to be transferred have the same target capability, and the target capability is in an enabled state on the candidate transfer device; According to the distance between the candidate transfer device and the remote control device, and the distance between the candidate to-be-transferred device and the remote control device, a transfer device is determined from the candidate transfer devices, and a to-be-transferred device is determined from the candidate to-be-transferred devices.

7. The method according to any one of claims 1 to 6, characterized in that: The method further comprises: The transfer device is controlled to turn off the target capability, or the transfer device is controlled to keep the target capability in an on state.

8. A device control method, applied to a remote control device, characterized in that: The method comprises: receiving a selection operation, and acquiring a first positioning result of the remote control device from at least one positioning device according to the selection operation; Determining first position information of the remote control device according to the first positioning result; According to the selection operation, obtaining a second positioning result of the remote control device from the at least one positioning device; According to the second positioning result, second posture information of the remote control device is determined; the second posture information is different from the first posture information.

9. The method according to claim 8, characterized in that The method further comprises: The first posture information is sent.

10. The method according to claim 8, characterized in that The method further comprises: According to the first posture information and the position information of M devices, a first device having a first pointing relationship with the remote control device is determined from the M devices; the remote control device is used to remotely control the M devices, M is a positive integer; the first pointing relationship is associated with the first posture information of the remote control device; Sending first information, where the first information is used to indicate identification information of the first device.

11. The method according to claim 10, characterized in that The first position information includes first position information and first posture information; The step of determining, from the M devices, a first device having a first pointing relationship with the remote control device according to the first posture information and the position information of the M devices, includes: Determine, according to the first position information and the position information of the device m, the pointing posture information of the remote control device pointing to the device m; the device m is one of the M devices; In response to a difference between the first posture information and the pointing posture information being less than or equal to a threshold, it is determined that the device m is a first device having a first pointing relationship with the remote control device.

12. The method according to claim 11, characterized in that The first position information is position information based on a first coordinate system, and the position information of the device m is position information based on a second coordinate system; The determining, according to the first position information and the position information of the device m, the pointing posture information of the remote control device pointing to the device m includes: Acquire position information of the origin of the first coordinate system in the second coordinate system, and a conversion relationship between the first coordinate system and the second coordinate system; According to the position information of the origin of the first coordinate system in the second coordinate system and the conversion relationship between the first coordinate system and the second coordinate system, the first position information is converted to the second coordinate system to obtain the second position information of the remote control device; According to the second position information and the position information of the device m, the pointing posture information of the remote control device pointing to the device m is determined.

13. A device control method, applied to a first device, characterized in that: The method comprises: Output target content; the target content is the content output when the target capability is enabled; In response to a received first instruction, stop outputting the target content; the first instruction is an instruction generated according to a selection operation received by the remote control device, the selection operation is used to instruct the first device to stop outputting the target content, and to instruct the second device to output the target content; the second device has the target capability.

14. A device control method, applied to a second device, characterized in that: The method comprises: In response to the received second instruction, outputting the target content; The second instruction is an instruction generated according to a selection operation received by the remote control device; the selection operation is used to instruct the first device to stop outputting the target content, and to instruct the second device to output the target content; the target content is the content output when the target capability of the first device is in an on state; the second device has the target capability.

15. A central device, characterized in that: The central device includes at least one memory and at least one processor, the at least one memory is coupled to the at least one processor, the at least one memory is used to store computer programs, the at least one processor is used to call the computer program, and the computer program includes instructions. When the instructions are executed by the at least one processor, the central device executes the method described in any one of claims 1-7.

16. A remote control device, characterized in that: The remote control device includes at least one memory and at least one processor, wherein the at least one memory is coupled to the at least one processor, the at least one memory is used to store a computer program, the at least one processor is used to call the computer program, and the computer program includes instructions. When the instructions are executed by the at least one processor, the remote control device executes the method according to any one of claims 8 to 12.

17. A computer storage medium, characterized in that: The method comprises computer instructions, which, when executed on an electronic device, cause the electronic device to execute the method as claimed in any one of claims 1 to 7, or execute the method as claimed in any one of claims 8 to 12, or execute the method as claimed in claim 13, or execute the method as claimed in claim 14.

Images