Intelligent equipment control method, central control equipment and device

Abstract

The invention provides an intelligent device control method, a central control device and a device, and the intelligent device control method comprises the steps: determining the position relation between a control gesture and each intelligent device according to a depth image containing the control gesture and the position information of each intelligent device, the control gesture is a gesture made by a user in order to control the intelligent equipment, and when it is determined that the position relation between the target intelligent equipment and the control gesture meets a preset condition, equipment control operation on the target intelligent equipment is started based on the control gesture. According to the intelligent device control method provided by the embodiment of the invention, the control object of the control gesture can be determined based on the position relationship between the control gesture and each intelligent device, so that multiple intelligent devices can be controlled by using the same gesture, and the gesture reuse rate is improved.

Description

Technical Field

[0001] The technical solution disclosed herein relates to the field of artificial intelligence technology, and in particular to an intelligent device control method, central control equipment and device. Background Art

[0002] Smart devices refer to various devices (such as audio and video equipment, lighting equipment, etc.) that can connect to the Internet, exchange and communicate information with the Internet, and provide intelligent services to users.

[0003] In the exemplary technology, the smart device can be controlled by identifying the user's gesture. For example, it can be preset that when a fist gesture is recognized, the smart TV is turned off. When a palm gesture is recognized, the smart fan is turned off. However, in the existing exemplary technology, one gesture can only correspond to one operation of controlling one smart device, and it is impossible to realize that one gesture can control different smart devices separately, and the gesture reuse rate is low. Summary of the invention

[0004] In view of this, the embodiments of the present disclosure provide a smart device control method, a central control device and an apparatus.

[0005] According to a first aspect of the present disclosure, a smart device control method is proposed, the method comprising:

[0006] Determine the positional relationship between the control gesture and each smart device according to the depth image containing the control gesture and the position information of each smart device; wherein the control gesture is a gesture made by the user to control the smart device;

[0007] When it is determined that the positional relationship between the target smart device and the control gesture meets a preset condition, a device control operation on the target smart device is initiated based on the control gesture.

[0008] In combination with any embodiment provided by the present disclosure,

[0009] The control gesture includes: a first device control gesture for controlling device operation;

[0010] The initiating a device control operation on the target smart device based on the control gesture includes:

[0011] Determine a first device control instruction corresponding to the first device control gesture;

[0012] The first device control instruction is sent to the target smart device, so that the target smart device performs an operation corresponding to the first device control instruction.

[0013] In combination with any embodiment provided by the present disclosure,

[0014] The control gesture includes: a device determination gesture for determining the target smart device;

[0015] When it is determined that the positional relationship between the target smart device and the control gesture meets a preset condition, starting a device control operation on the target smart device based on the control gesture includes:

[0016] Determine a smart device whose positional relationship with the device determining the gesture satisfies the preset condition as the target smart device;

[0017] acquiring an image including a second device control gesture for controlling an operation of the device;

[0018] Determine a second device control instruction corresponding to the second device control gesture;

[0019] The second device control instruction is sent to the target smart device, so that the target smart device performs an operation corresponding to the second device control instruction.

[0020] In combination with any embodiment provided in the present disclosure, determining the positional relationship between the control gesture and each smart device according to the depth image containing the control gesture and the position information of each smart device includes:

[0021] Determining a center point of the control gesture according to the depth image including the control gesture;

[0022] Determine the centroid of each smart device according to the location information of each smart device;

[0023] The angles between the spatial connection line between the center point of the control gesture and the center of mass of each smart device and the plane where the control gesture is located are calculated respectively.

[0024] In combination with any implementation manner provided in the present disclosure, the preset conditions include:

[0025] The angle between the spatial connection line between the control gesture and the smart device and the plane where the control gesture is located is greater than a preset angle threshold.

[0026] According to a second aspect of the present disclosure, a smart device control method is proposed, the method comprising:

[0027] Receiving a device control instruction sent by a central control device; wherein the device control instruction is sent by the central control device when it is determined that the positional relationship between the target smart device and the control gesture meets a preset condition;

[0028] Based on the device control instruction, an operation corresponding to the device control instruction is performed.

[0029] In combination with any embodiment provided by the present disclosure,

[0030] The receiving of the device control instruction sent by the central control device includes:

[0031] Receive a first device control instruction sent by the central control device; wherein, the first device control instruction is sent by the central control device when it is determined that the positional relationship between the target smart device and the first device control gesture meets a preset condition, and the first device control gesture is a gesture used to control device operation.

[0032] In combination with any embodiment provided by the present disclosure,

[0033] The receiving of the device control instruction sent by the central control device includes:

[0034] Receive a second device control instruction sent by the central control device; wherein, the second device control instruction is sent by the central control device according to a second device control gesture for controlling device operation when it is determined that the positional relationship between the target smart device and the device determination gesture meets a preset condition, and the device determination gesture is used to determine the target smart device.

[0035] According to a third aspect of the present disclosure, a central control device is provided, the central control device comprising:

[0036] An image acquisition device, used to acquire a depth image including a control gesture;

[0037] A data processing device, configured to determine the positional relationship between the control gesture and each smart device according to the depth image containing the control gesture and the position information of each smart device, and send a notification message to the control device when it is determined that the positional relationship between the target smart device and the control gesture meets a preset condition; wherein the control gesture is a gesture made by the user to control the smart device;

[0038] The control device is used to start a device control operation on the target smart device based on the control gesture after receiving the notification message sent by the data processing device.

[0039] According to a fourth aspect of the present disclosure, a smart device control device is provided, the device comprising:

[0040] A position relationship determination module, used to determine the position relationship between the control gesture and each smart device according to the depth image containing the control gesture and the position information of each smart device; wherein the control gesture is a gesture made by the user to control the smart device;

[0041] The control start module is used to start a device control operation on the target smart device based on the control gesture when it is determined that the position relationship between the target smart device and the control gesture meets a preset condition.

[0042] According to a fifth aspect of the present disclosure, a smart device control device is provided, the device comprising:

[0043] A receiving module, used to receive a device control instruction sent by a central control device; wherein the device control instruction is sent by the central control device when it is determined that the position relationship between the target smart device and the control gesture meets a preset condition;

[0044] The operation execution module is used to execute the operation corresponding to the device control instruction based on the device control instruction.

[0045] According to a sixth aspect of the present disclosure, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores a computer program, and when the program is executed by a processor, the smart device control method of any embodiment of the present disclosure is implemented.

[0046] According to a seventh aspect of the present disclosure, there is provided an electronic device, comprising:

[0047] processor;

[0048] a memory for storing processor-executable instructions;

[0049] The processor is configured to execute the smart device control method of any embodiment of the present disclosure.

[0050] The technical solution provided by the embodiments of the present disclosure may have the following beneficial effects:

[0051] The smart device control method, central control device and apparatus provided by the embodiments of the present disclosure can first determine the target smart device based on the positional relationship between the control gesture and each smart device when there are multiple smart devices, and then start the device control operation on the target smart device based on the control gesture. Since the smart device control method provided by the embodiments of the present disclosure can first determine the control object of the control gesture based on the positional relationship between the control gesture and each smart device, it is possible to control multiple smart devices using the same gesture, thereby improving the gesture reuse rate.

[0052] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0053] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0054] Figure 1 is a flow chart of a smart device control method according to an exemplary embodiment of the present disclosure;

[0055] Figure 2 is a schematic diagram of palm key points according to an exemplary embodiment of the present disclosure;

[0056] Figure 3 is a flow chart of another smart device control method according to an exemplary embodiment of the present disclosure;

[0057] Figure 4 is a flow chart of another smart device control method according to an exemplary embodiment of the present disclosure;

[0058] Figure 5 is a flow chart of another smart device control method according to an exemplary embodiment of the present disclosure;

[0059] Figure 6 is a structural schematic diagram of a central control device according to an exemplary embodiment of the present disclosure;

[0060] Figure 7 is a structural schematic diagram of a smart device control device according to an exemplary embodiment of the present disclosure;

[0061] Figure 8 is a structural schematic diagram of another intelligent device control device according to an exemplary embodiment of the present disclosure;

[0062] Fig. 9 It is a schematic structural diagram of an electronic device according to an exemplary embodiment of the present disclosure. DETAILED DESCRIPTION

[0063] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0064] The terms used in this disclosure are for the purpose of describing specific embodiments only and are not intended to limit the disclosure. The singular forms of "a", "said" and "the" used in this disclosure and the appended claims are also intended to include plural forms unless the context clearly indicates otherwise. It should also be understood that the term "and / or" used herein refers to and includes any or all possible combinations of one or more associated listed items.

[0065] It should be understood that although the terms first, second, third, etc. may be used in the present disclosure to describe various information, such information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of the present disclosure, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein may be interpreted as "at the time of" or "when" or "in response to determining".

[0066] Smart devices refer to various devices that can connect to the Internet, exchange and communicate information with the Internet, and provide intelligent services to users.

[0067] In the exemplary technology, the camera can be used to recognize the user's gesture to control the smart device. However, in the related exemplary technology, when there are multiple smart devices, it is impossible to determine which smart device the user wants to control using the gesture. Therefore, the one-to-one correspondence between gestures and device operations can only be pre-set so that after the gesture is recognized, the device corresponding to the gesture is controlled to perform the corresponding operation. For example, it can be pre-set that when a fist gesture is recognized, the smart TV is controlled to perform the shutdown operation. When a scissors gesture is recognized, the smart electric fan is controlled to perform the shutdown operation.

[0068] In summary, in the relevant exemplary technologies, one gesture can only correspond to one operation of controlling one smart device, and it is impossible to use one gesture to control different smart devices respectively, and the gesture reuse rate is low.

[0069] In view of this, the present disclosure provides a smart device control method, in which the control object of the control gesture can be first determined based on the positional relationship between the control gesture and each smart device. Therefore, it is possible to control multiple smart devices using the same gesture, thereby improving the gesture reuse rate.

[0070] The following is a detailed description of the smart device control method according to the embodiment of the present disclosure in conjunction with the accompanying drawings.

[0071] Figure 1 This is a flowchart of a smart device control method according to an exemplary embodiment of the present disclosure, which can be executed by a central control device. For example, this example takes a smart device in a smart home scenario as an example to introduce the smart device control method in detail. Figure 1 As shown, the exemplary embodiment method may include the following steps:

[0072] In step 101, the positional relationship between the control gesture and each smart device is determined according to the depth image containing the control gesture and the position information of each smart device.

[0073] Among them, the control gesture is a gesture made by the user to control the smart device. In a specific implementation, the central control device can be placed at a certain position in the home scene. Exemplarily, it can be placed in a position with a good field of view, where the depth image containing the control gesture can be obtained as comprehensively as possible. For example, the central control device can use its own structured light depth camera to obtain a depth image containing the control gesture. The central control device can be an electronic device integrating an image acquisition device, a data processing device and a control device. Exemplarily, the image acquisition device can be a structured light depth camera, the data processing device can be a Raspberry Pi host, and the control device can be a voice assistant, such as Xiao Ai.

[0074] The location information of the smart device can be pre-stored in the central control device. Alternatively, the central control device can use its own structured light depth camera to obtain a depth image containing each smart device in real time, and determine the location information of each smart device based on the depth image. The present disclosure does not limit the method of obtaining the location information of each smart device. In the smart home scenario, the smart devices may include: smart TVs, smart electric fans, smart lights, etc.

[0075] After acquiring the depth image including the control gesture and the position information of each smart device, the central control device can further determine the position relationship between the control gesture and each smart device.

[0076] In one embodiment, the central control device may first determine the center point of the control gesture based on the depth image containing the control gesture. Then, the center of mass of each smart device is determined based on the position information of each smart device. Finally, the spatial connection line between the center point of the control gesture and the center of mass of each smart device is respectively calculated, and the angle between the plane where the control gesture is located is the above-mentioned positional relationship.

[0077] For example, when the control gesture is "palm", the central control device can detect the key points of the "palm" based on the depth image using the gesture key point detection algorithm. The detection result can be as follows: Figure 2 Then, the central control device can Figure 2 The key points coded 0, 5, and 17 are connected to form a spatial triangle, and the center point of the spatial triangle is determined to be the center point A of the control gesture "palm". Alternatively, the central control device can Figure 2 The key points coded 0 and 9 are connected to obtain a space line segment, and the midpoint of the space line segment is determined, which is the center point A of the control gesture "palm".

[0078] Similar to the above, the central control device can determine the centroid of each smart device based on the pre-saved location information of each smart device or the depth image containing each smart device acquired in real time by the structured light depth camera. In this example, the centroid of the smart TV, smart fan, smart light, etc. is determined.

[0079] The structured light depth camera can obtain the depth information of each point in the image. Therefore, the central control device can obtain the spatial three-dimensional coordinates of multiple key points on the control gesture "palm" and the spatial three-dimensional coordinates of the center of mass of each smart device. Based on the above three-dimensional spatial coordinates, the central control device can further calculate the angle between the line connecting the center point of the control gesture "palm" and the center of mass of each smart device and the plane where the control gesture "palm" is located. This angle can be used to characterize the positional relationship between the control gesture "palm" and each smart device.

[0080] In step 102, when it is determined that the positional relationship between the target smart device and the control gesture satisfies a preset condition, a device control operation on the target smart device is initiated based on the control gesture.

[0081] In one embodiment, the preset condition may be that the angle between the spatial connection line between the control gesture and the smart device and the plane where the control gesture is located is greater than a preset angle threshold.

[0082] Still taking the control gesture of "palm" as an example, when the user points the "palm" toward a certain smart device, the spatial line connecting the center of mass of the smart device and the center point of the "palm" should be perpendicular to the plane where the "palm" is located. Based on this principle, in this example, when the spatial line connecting the center of mass of a certain smart device and the center point of the "palm" is determined, and the angle with the plane where the "palm" is greater than the preset angle threshold, the smart device can be determined as the target smart device. The preset angle threshold can be 80 degrees or 85 degrees, and can be specifically set by relevant staff based on actual conditions, and this disclosure does not limit this. Then, the central control device can further initiate a device control operation on the determined target smart device based on the "palm".

[0083] For example, in actual applications, when the preset angle threshold is 85 degrees, and it is determined that there are lines connecting the center of mass of multiple smart devices and the center point of the "palm", and the angle between the line and the plane where the "palm" is located is greater than 85 degrees, the smart device corresponding to the angle closest to 90 degrees can be determined as the target smart device.

[0084] It should be noted that the control gesture of "palm" is used as an example in the above examples, but in actual applications, the control gesture can also be a fist gesture, a scissors gesture, etc., and the present disclosure does not limit this.

[0085] The smart device control method provided by the embodiment of the present disclosure can first determine the target smart device based on the positional relationship between the control gesture and each smart device when there are multiple smart devices, and then start the device control operation on the target smart device based on the control gesture. Since the smart device control method provided by the embodiment of the present disclosure can first determine the control object of the control gesture based on the positional relationship between the control gesture and each smart device, it is possible to control multiple smart devices using the same gesture, thereby improving the gesture reuse rate.

[0086] Figure 3 1 is a flow chart of another intelligent device control method according to an exemplary embodiment of the present disclosure. In the description of this embodiment, the same steps as those in any of the above embodiments will be briefly described without further details. For details, please refer to any of the above embodiments. Figure 3 As shown, the exemplary embodiment method may include the following steps:

[0087] In step 301, the positional relationship between the control gesture and each smart device is determined according to the depth image containing the control gesture and the position information of each smart device.

[0088] The control gesture is a gesture made by a user to control a smart device. The control gesture may include: a first device control gesture for controlling device operation. For example, the first device control gesture may be a fist gesture.

[0089] In step 302, when it is determined that the positional relationship between the target smart device and the control gesture meets a preset condition, a first device control instruction corresponding to the first device control gesture is determined;

[0090] When the central control device determines that the target smart device meets the preset conditions, such as a smart TV, it can further determine the first device control instruction corresponding to the first device control gesture. In this example, the first device control instruction corresponding to the above-mentioned fist gesture is determined. Exemplarily, the first device control instruction can be turned off.

[0091] In step 303, the first device control instruction is sent to the target smart device, so that the target smart device performs an operation corresponding to the first device control instruction.

[0092] In this example, after determining that the first device control instruction is "turn off", the central control device can send "turn off" to the above-mentioned smart TV, so that the smart TV performs the "turn off" operation.

[0093] For example, when it is determined that the target smart device is a smart electric fan, the central control device can send "off" to the smart electric fan, so that the smart electric fan performs the "off" operation. In other words, using the method of the embodiment of the present disclosure, it can be achieved that the device to which the user's control gesture points is controlled to perform the corresponding operation, thereby achieving the effect of using the same gesture to control multiple smart devices.

[0094] In the smart device control method provided by the embodiment of the present disclosure, the central control device can complete the determination of the target smart device and the device control instruction based on a gesture, which can simplify the user's operation and improve the user's usage experience.

[0095] Figure 4 FIG. 1 is a flow chart of another smart device control method according to an exemplary embodiment of the present disclosure. Figure 4 As shown, the exemplary embodiment method may include the following steps:

[0096] In step 401, the positional relationship between the control gesture and each smart device is determined according to the depth image containing the control gesture and the position information of each smart device.

[0097] The control gesture is a gesture made by a user to control a smart device. The control gesture may include: a device determination gesture for determining the target smart device. Exemplarily, the device determination gesture may be a "palm".

[0098] In this example, the central control device can determine the positional relationship between the “palm” and each smart device based on the depth image containing the user's palm and the position information of each smart device.

[0099] In step 402, a smart device whose positional relationship with the device determining the gesture meets the preset condition is determined as the target smart device.

[0100] The preset condition may be that the spatial connection line between the control gesture and the smart device has an angle greater than a preset angle threshold with respect to the plane where the control gesture is located. The preset angle threshold may be 80 degrees, or 85 degrees, which is not limited in the present disclosure. For example, the target smart device may be a smart electric fan.

[0101] In step 403, an image including a second device control gesture for controlling device operation is acquired.

[0102] After the central control device determines that the target smart device is a smart electric fan based on the aforementioned "palm", it can continue to obtain an image containing a second device control gesture for controlling the device operation. Exemplarily, the second device control gesture can be a "fist" gesture.

[0103] In step 404, a second device control instruction corresponding to the second device control gesture is determined.

[0104] Based on the image, the central control device can determine the second device control instruction corresponding to the second device control gesture. In this example, the second device control instruction corresponding to the aforementioned "fist" gesture is determined. Exemplarily, the second device control instruction can be "turn on".

[0105] In step 405, the second device control instruction is sent to the target smart device, so that the target smart device performs an operation corresponding to the second device control instruction.

[0106] In this example, the central control device can send "turn on" to the aforementioned smart electric fan, so that the smart electric fan performs the "turn on" operation.

[0107] In the smart device control method provided by the embodiment of the present disclosure, the central control device can determine the target smart device based on a special device determination gesture, and then determine the device control instructions for the target smart device based on the device control gesture, which is more flexible and can also achieve the effect of using the same gesture to control multiple smart devices, thereby improving the gesture reuse rate.

[0108] Figure 5 FIG. 1 is a flow chart of a smart device control method according to an exemplary embodiment of the present disclosure, and the method can be executed by a target smart device. Figure 5 As shown, the exemplary embodiment method may include the following steps:

[0109] In step 501, a device control instruction sent by a central control device is received.

[0110] The device control instruction is sent by the central control device when it is determined that the positional relationship between the target smart device and the control gesture meets a preset condition.

[0111] In step 502, based on the device control instruction, an operation corresponding to the device control instruction is performed.

[0112] In the smart device control method provided by the embodiment of the present disclosure, the target smart device can perform corresponding operations based on the device control instructions received from the central control device. Compared with the existing implementation, which requires the smart device to obtain an image containing a control gesture and then identify the device control instructions corresponding to the control gesture, the amount of calculation on the target smart device side can be reduced.

[0113] In one embodiment, the receiving of the device control instruction sent by the central control device may include:

[0114] Receive a first device control instruction sent by the central control device.

[0115] Among them, the first device control instruction is sent by the central control device when it is determined that the position relationship between the target smart device and the first device control gesture meets a preset condition, and the first device control gesture is a gesture used to control the device operation.

[0116] In the smart device control method provided by the embodiment of the present disclosure, the central control device can complete the determination of the target smart device and the device control instruction based on a gesture, which can simplify the user's operation and improve the user's usage experience.

[0117] In another embodiment, the receiving the device control instruction sent by the central control device may include:

[0118] Receive a second device control instruction sent by the central control device.

[0119] Among them, the second device control instruction is sent by the central control device according to the second device control gesture for controlling the device operation when it is determined that the positional relationship between the target smart device and the device determination gesture meets the preset conditions, and the device determination gesture is used to determine the target smart device.

[0120] In the smart device control method provided by the embodiment of the present disclosure, the central control device can determine the target smart device based on a special device determination gesture, and then determine the device control instructions for the target smart device based on the device control gesture, which is more flexible and can also achieve the effect of using the same gesture to control multiple smart devices, thereby improving the gesture reuse rate.

[0121] Figure 6 1 is a schematic diagram of a central control device according to an exemplary embodiment of the present disclosure. The central control device is used to execute the intelligent device control method of any embodiment of the present disclosure. Figure 6 As shown, the central control device may include:

[0122] The image acquisition device 61 is used to acquire a depth image including a control gesture. In practical applications, the image acquisition device 61 may be, for example, a structured light depth camera.

[0123] The data processing device 62 is used to determine the positional relationship between the control gesture and each smart device based on the depth image containing the control gesture and the position information of each smart device, and send a notification message to the control device when it is determined that the positional relationship between the target smart device and the control gesture meets the preset conditions; wherein the control gesture is a gesture made by the user to control the smart device. Exemplarily, the data processing device 62 can be, for example, a Raspberry Pi host. The Raspberry Pi host is a microcomputer designed for learning computer programming education and is only the size of a credit card.

[0124] The control device 63 is used to start the device control operation on the target smart device based on the control gesture after receiving the notification message sent by the data processing device. In practical applications, the control device 63 can be a voice assistant.

[0125] For the aforementioned method embodiments, for the sake of simplicity of description, they are all expressed as a series of action combinations, but those skilled in the art should know that the present disclosure is not limited by the described order of actions, because according to the present disclosure, certain steps can be performed in other orders or simultaneously.

[0126] Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all optional embodiments, and the actions and modules involved are not necessarily required by the present disclosure.

[0127] Corresponding to the aforementioned application function implementation method embodiment, the present disclosure also provides an application function implementation device and a corresponding terminal embodiment.

[0128] Figure 7 is a structural diagram of a smart device control device according to an exemplary embodiment of the present disclosure. Figure 7 As shown, the intelligent device control device may include:

[0129] The position relationship determination module 71 is used to determine the position relationship between the control gesture and each smart device based on the depth image containing the control gesture and the position information of each smart device; wherein the control gesture is a gesture made by the user to control the smart device.

[0130] The control start module 72 is used to start a device control operation on the target smart device based on the control gesture when it is determined that the position relationship between the target smart device and the control gesture meets a preset condition.

[0131] Optionally, the control gesture includes: a first device control gesture for controlling device operation.

[0132] The control initiation module 72, when used to initiate a device control operation on the target smart device based on the control gesture, includes:

[0133] Determine a first device control instruction corresponding to the first device control gesture.

[0134] The first device control instruction is sent to the target smart device, so that the target smart device performs an operation corresponding to the first device control instruction.

[0135] Optionally, the control gesture includes: a device determination gesture for determining the target smart device.

[0136] The control start module 72, when it is determined that the position relationship between the target smart device and the control gesture meets a preset condition, starts a device control operation on the target smart device based on the control gesture, including:

[0137] A smart device whose positional relationship with the device determining the gesture meets the preset condition is determined as the target smart device.

[0138] An image containing a second device control gesture for controlling an operation of the device is acquired.

[0139] Determine a second device control instruction corresponding to the second device control gesture.

[0140] The second device control instruction is sent to the target smart device, so that the target smart device performs an operation corresponding to the second device control instruction.

[0141] Optionally, the position relationship determining module 71, when used to determine the position relationship between the control gesture and each smart device according to the depth image containing the control gesture and the position information of each smart device, includes:

[0142] A center point of the control gesture is determined according to the depth image including the control gesture.

[0143] According to the location information of each smart device, the center of mass of each smart device is determined.

[0144] The angles between the spatial connection line between the center point of the control gesture and the center of mass of each smart device and the plane where the control gesture is located are calculated respectively.

[0145] Optionally, the preset conditions include:

[0146] The angle between the spatial connection line between the control gesture and the smart device and the plane where the control gesture is located is greater than a preset angle threshold.

[0147] Figure 8is a structural diagram of another intelligent device control device according to an exemplary embodiment of the present disclosure, such as Figure 8 As shown, the intelligent device control device may include:

[0148] The receiving module 81 is used to receive a device control instruction sent by a central control device; wherein the device control instruction is sent by the central control device when it is determined that the positional relationship between the target smart device and the control gesture meets a preset condition.

[0149] The operation execution module 82 is used to execute the operation corresponding to the device control instruction based on the device control instruction.

[0150] Optionally, the receiving module 81, when used to receive the device control instruction sent by the central control device, includes:

[0151] Receive a first device control instruction sent by the central control device; wherein, the first device control instruction is sent by the central control device when it is determined that the positional relationship between the target smart device and the first device control gesture meets a preset condition, and the first device control gesture is a gesture used to control device operation.

[0152] Optionally, the receiving module 81, when used to receive the device control instruction sent by the central control device, includes:

[0153] Receive a second device control instruction sent by the central control device; wherein, the second device control instruction is sent by the central control device according to a second device control gesture for controlling device operation when it is determined that the positional relationship between the target smart device and the device determination gesture meets a preset condition, and the device determination gesture is used to determine the target smart device.

[0154] For the device embodiments, since they basically correspond to the method embodiments, the relevant parts can refer to the partial description of the method embodiments. The device embodiments described above are only schematic, wherein the units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the disclosed solution. A person of ordinary skill in the art may understand and implement it without creative work.

[0155] Accordingly, an embodiment of the present disclosure provides an electronic device, comprising: a processor; and a memory for storing instructions executable by the processor; wherein the processor is configured to execute the smart device control method of any embodiment of the present disclosure.

[0156] Fig. 9 A schematic diagram of the structure of an electronic device 900 is shown according to an exemplary embodiment. For example, the electronic device 900 may be a central control device, and may specifically be a server or the like.

[0157] Reference Fig. 9 , the electronic device 900 may include one or more of the following components: a processing component 902 , a memory 904 , a power component 906 , a multimedia component 908 , an audio component 910 , an input / output (I / O) interface 912 , a sensor component 914 , and a communication component 916 .

[0158] The processing component 902 generally controls the overall operation of the electronic device 900, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 902 may include one or more processors 920 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 902 may include one or more modules to facilitate the interaction between the processing component 902 and other components. For example, the processing component 902 may include a multimedia module to facilitate the interaction between the multimedia component 908 and the processing component 902.

[0159] The memory 904 is configured to store various types of data to support operations on the device 900. Examples of such data include instructions for any application or method operating on the electronic device 900, contact data, phone book data, messages, pictures, videos, etc. The memory 904 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0160] The power supply component 906 provides power to the various components of the electronic device 900. The power supply component 906 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device 900.

[0161] The multimedia component 908 includes a screen that provides an output interface between the electronic device 900 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 908 includes a front camera and / or a rear camera. When the electronic device 900 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0162] The audio component 910 is configured to output and / or input audio signals. For example, the audio component 910 includes a microphone (MIC), and when the electronic device 900 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 904 or sent via the communication component 916. In some embodiments, the audio component 910 also includes a speaker for outputting audio signals.

[0163] I / O interface 912 provides an interface between processing component 902 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0164] The sensor assembly 914 includes one or more sensors for providing various aspects of status assessment for the electronic device 900. For example, the sensor assembly 914 can detect the open / closed state of the electronic device 900, the relative positioning of the components, such as the display and keypad of the electronic device 900, and the sensor assembly 914 can also detect the position change of the electronic device 900 or a component of the electronic device 900, the presence or absence of contact between the user and the electronic device 900, the orientation or acceleration / deceleration of the electronic device 900, and the temperature change of the electronic device 900. The sensor assembly 914 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 914 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 914 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0165] The communication component 916 is configured to facilitate wired or wireless communication between the electronic device 900 and other devices. The electronic device 900 can access a wireless network based on a communication standard, such as WiFi, 4G or 5G, 4G LTE, 5G NR or a combination thereof. In an exemplary embodiment, the communication component 916 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 916 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0166] In an exemplary embodiment, the electronic device 900 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above methods.

[0167] In an exemplary embodiment, a non-temporary computer-readable storage medium is also provided, such as a memory 904 including instructions. When the instructions in the storage medium are executed by a processor 920 of an electronic device 900, the electronic device 900 is enabled to execute the smart device control method of any embodiment of the present disclosure.

[0168] The non-transitory computer-readable storage medium may be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

[0169] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The description and examples are to be considered exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0170] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A method for controlling an intelligent device, characterized in that: The method is executed by a central control device, and the method includes: Determine the positional relationship between the control gesture and each smart device according to the depth image containing the control gesture and the position information of each smart device; wherein the control gesture is a gesture made by the user to control the smart device; When it is determined that the positional relationship between the target smart device and the control gesture meets a preset condition, a device control operation on the target smart device is initiated based on the control gesture.

2. The method according to claim 1, characterized in that The control gesture includes: a first device control gesture for controlling device operation; The initiating a device control operation on the target smart device based on the control gesture includes: Determine a first device control instruction corresponding to the first device control gesture; The first device control instruction is sent to the target smart device, so that the target smart device performs an operation corresponding to the first device control instruction.

3. The method according to claim 1, characterized in that: The control gesture includes: a device determination gesture for determining the target smart device; When it is determined that the positional relationship between the target smart device and the control gesture meets a preset condition, starting a device control operation on the target smart device based on the control gesture includes: Determine a smart device whose positional relationship with the gesture determined by the device satisfies the preset condition as the target smart device; acquiring an image including a second device control gesture for controlling an operation of the device; Determine a second device control instruction corresponding to the second device control gesture; The second device control instruction is sent to the target smart device, so that the target smart device performs an operation corresponding to the second device control instruction.

4. The method according to claim 1, characterized in that: The determining, based on the depth image containing the control gesture and the position information of each smart device, the position relationship between the control gesture and each smart device includes: Determining a center point of the control gesture according to the depth image including the control gesture; Determine the centroid of each smart device according to the location information of each smart device; The angles between the spatial connection line between the center point of the control gesture and the center of mass of each smart device and the plane where the control gesture is located are calculated respectively.

5. The method according to claim 1, characterized in that: The preset conditions include: The angle between the spatial connection line between the control gesture and the smart device and the plane where the control gesture is located is greater than a preset angle threshold.

6. A method for controlling an intelligent device, characterized in that: The method is performed by a target smart device, and includes: Receiving a device control instruction sent by a central control device; wherein the device control instruction is sent by the central control device when it is determined that the positional relationship between the target smart device and the control gesture meets a preset condition; Based on the device control instruction, an operation corresponding to the device control instruction is performed.

7. The method according to claim 6, characterized in that The receiving of the device control instruction sent by the central control device includes: Receive a first device control instruction sent by the central control device; wherein, the first device control instruction is sent by the central control device when it is determined that the positional relationship between the target smart device and the first device control gesture meets a preset condition, and the first device control gesture is a gesture used to control device operation.

8. The method according to claim 6, characterized in that The receiving of the device control instruction sent by the central control device includes: Receive a second device control instruction sent by the central control device; wherein, the second device control instruction is sent by the central control device according to a second device control gesture for controlling device operation when it is determined that the positional relationship between the target smart device and the device determination gesture meets a preset condition, and the device determination gesture is used to determine the target smart device.

9. A central control device, characterized in that: The central control device includes: An image acquisition device, used to acquire a depth image including a control gesture; A data processing device, configured to determine the positional relationship between the control gesture and each smart device according to the depth image containing the control gesture and the position information of each smart device, and send a notification message to the control device when it is determined that the positional relationship between the target smart device and the control gesture meets a preset condition; wherein the control gesture is a gesture made by the user to control the smart device; The control device is used to start a device control operation on the target smart device based on the control gesture after receiving the notification message sent by the data processing device.

10. A smart device control device, characterized in that: The device is applied to a central control device, and the device comprises: A position relationship determination module, used to determine the position relationship between the control gesture and each smart device according to the depth image containing the control gesture and the position information of each smart device; wherein the control gesture is a gesture made by the user to control the smart device; The control start module is used to start a device control operation on the target smart device based on the control gesture when it is determined that the position relationship between the target smart device and the control gesture meets a preset condition.

11. A smart device control device, characterized in that: The device is applied to a target smart device, and the device includes: A receiving module, used to receive a device control instruction sent by a central control device; wherein the device control instruction is sent by the central control device when it is determined that the position relationship between the target smart device and the control gesture meets a preset condition; The operation execution module is used to execute the operation corresponding to the device control instruction based on the device control instruction.

12. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the steps of the method described in any one of claims 1 to 5 or the steps of the method described in any one of claims 6 to 8 are implemented.

13. An electronic device, characterized in that: include: processor; a memory for storing processor-executable instructions; The processor is configured to execute the steps of any one of the methods of claims 1 to 5, or The steps of any one of claims 6 to 8.

Images