Target object sensing method, communication device and program product

Abstract

The invention provides a target object sensing method, a communication device and a program product, relates to the technical field of communication, and can at least solve the problem of low target sensing accuracy in related technologies. The method comprises the following steps: acquiring perception information of a target object perceived by a plurality of perception devices at different positions; and selecting at least two pieces of target perception information from the multiple pieces of perception information, and confirming the behavior or position of the target object according to the at least two pieces of target perception information. The target sensing accuracy can be improved.

Description

Technical Field

[0001] This disclosure relates to the field of communication technology, and in particular to a target object sensing method, communication device, and program product. Background Technology

[0002] Wireless fidelity (Wi-Fi) sensing is a technology that detects the presence, location, and movement of objects, people, and other entities in an environment using Wi-Fi signals. Sensing devices can analyze the reflection and attenuation of Wi-Fi signals using Wi-Fi sensing algorithms to determine the location, presence, and movement of objects. Compared to other sensing technologies, Wi-Fi sensing can penetrate obstacles such as walls, offering better sensing performance in indoor environments. However, related technologies often suffer from poor accuracy when sensing target locations using specific devices. Summary of the Invention

[0003] This disclosure provides a target object perception method, communication device, and program product, which can at least solve the problem of low accuracy in target perception in related technologies.

[0004] On the one hand, a target object perception method is provided, comprising: acquiring perception information of a target object perceived by multiple sensing devices at different locations; selecting at least two target perception information from the multiple perception information; and confirming the behavior or location of the target object based on the at least two target perception information.

[0005] In another aspect, a communication device is provided, comprising: a processing unit and a communication unit; the communication unit is configured to acquire perception information of a target object perceived by multiple sensing devices at different locations; the processing unit is configured to select at least two target perception information from the multiple perception information and confirm the behavior or location of the target object based on the at least two target perception information.

[0006] In another aspect, a communication device is provided, comprising: a memory and a processor; the memory and the processor are coupled; the memory is used to store a computer program; and the processor, when executing the computer program, implements the method described in any of the above embodiments.

[0007] In another aspect, a computer-readable storage medium is provided, on which computer program instructions are stored, which, when executed by a processor, implement the method described in any of the above embodiments.

[0008] In another aspect, a computer program product is provided, the computer program product including computer program instructions that, when executed by a processor, implement the method described in any of the above embodiments.

[0009] In this embodiment, the gateway device can acquire perception information of a target object from multiple sensing devices located at different positions, select at least two target perception information from the multiple perception information, and confirm the behavior or position of the target object based on the at least two target perception information. Since the sensing devices are deployed in different locations in the current environment, the gateway device can acquire relevant perception data of the target object from different angles / positions through multiple sensing devices, and then comprehensively determine information such as the behavior and position of the target object. This multi-angle / positional perception method can reduce interference from irrelevant objects and other noise signals in the environment, thereby improving the accuracy of target perception. Attached Figure Description

[0010] To more clearly illustrate the technical solutions in this disclosure, the accompanying drawings used in some embodiments of this disclosure will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this disclosure. For those skilled in the art, other drawings can be obtained based on these drawings.

[0011] Figure 1 This is a schematic diagram of the architecture of a sensing system provided in some embodiments of this disclosure;

[0012] Figure 2 A coordinate diagram illustrating the location of a sensing device provided for some embodiments of this disclosure;

[0013] Figure 3 A coordinate diagram of a Fresnel model provided for some embodiments of this disclosure;

[0014] Figure 4 A schematic diagram of a target-aware scene provided for some embodiments of this disclosure;

[0015] Figure 5 A schematic diagram of a target perception process provided for some embodiments of this disclosure;

[0016] Figure 6 A flowchart illustrating a target object perception method provided in some embodiments of this disclosure;

[0017] Figure 7 This is a flowchart illustrating yet another target object perception method provided in some embodiments of this disclosure;

[0018] Figure 8 This is a flowchart illustrating yet another target object perception method provided in some embodiments of this disclosure;

[0019] Figure 9 This is a flowchart illustrating yet another target object perception method provided in some embodiments of this disclosure;

[0020] Figure 10 This is a flowchart illustrating yet another target object perception method provided in some embodiments of this disclosure;

[0021] Figure 11 This is a flowchart illustrating yet another target object perception method provided in some embodiments of this disclosure;

[0022] Figure 12 This is a schematic diagram of the structure of a communication device provided in some embodiments of this disclosure;

[0023] Figure 13 This is a schematic diagram of the structure of another communication device provided in some embodiments of this disclosure. Detailed Implementation

[0024] The technical solutions of this disclosure will now be clearly and completely described with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this disclosure, and not all embodiments. Based on the embodiments of this disclosure, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this disclosure.

[0025] It should be noted that, in this disclosure, the terms "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described as "exemplary" or "for example" in this disclosure should not be construed as being more preferred or advantageous than other embodiments or designs. Specifically, the use of terms such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.

[0026] Hereinafter, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature.

[0027] In the description of this disclosure, unless otherwise stated, " / " means "or," for example, A / B can mean A or B. "And / or" in this document is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, and B alone. Furthermore, "at least one" means one or more, and "more than one" means two or more.

[0028] Currently, target perception encompasses various technologies, such as image-based target perception, infrared sensing-based target perception, and sound wave-based target perception. Smart home devices can be equipped with various sensing devices to detect the movement and entry / exit of people in the home, thus enabling home automation. However, these sensing devices typically only detect a specific range, resulting in a small coverage area, and their configuration costs are relatively high.

[0029] Wireless fidelity (WIFI) sensing is a technology that detects the presence, location, and movement of objects, people, and other entities in an environment using WIFI signals. Sensing devices can analyze the reflection and attenuation of WIFI signals using WIFI sensing algorithms to determine the location, presence, and movement of objects. Compared to other sensing technologies, WIFI sensing can penetrate obstacles such as walls, providing better sensing performance in indoor environments.

[0030] Meanwhile, smart homes typically use Wi-Fi to enable communication between devices. Therefore, Wi-Fi sensing technology can use the Wi-Fi signals transmitted and received by indoor devices to sense target objects within the detection area without increasing additional hardware costs. Wi-Fi sensing technology can not only sense human movement, but also sense and recognize human actions, such as sitting posture and the movement of hands and feet.

[0031] Related technologies typically use specific devices to sense the location of a target. However, due to factors such as signal loss, multipath signal interference, and obstructions, the accuracy of target perception is poor when facing enclosed and irregular environments such as indoor spaces, as these technologies rely on a single angle to sense the target's location.

[0032] Therefore, in the technical solution provided in this disclosure, the gateway device can acquire perception information of a target object perceived by multiple sensing devices at different locations, select at least two target perception information from the multiple perception information, and confirm the behavior or location of the target object based on the at least two target perception information. Since the sensing devices are deployed in different locations in the current environment, the gateway device can acquire relevant perception data of the target object from different angles / positions through multiple sensing devices, and then comprehensively determine the behavior, location, and other information of the target object. By using multi-angle / position perception, interference from irrelevant objects and other noise signals in the environment can be reduced, thereby improving the accuracy of target perception.

[0033] The embodiments of this disclosure will now be described in detail with reference to the accompanying drawings.

[0034] Figure 1 This is an architecture diagram of a sensing system provided in an embodiment of this disclosure. Figure 1 As shown, the sensing system may include a gateway device 101 and multiple sensing devices 102.

[0035] The gateway device 101 is connected to multiple sensing devices 102 via a communication link. For example, the gateway device 101 communicates with the multiple sensing devices 102 via a WIFI signal.

[0036] For example, the gateway device 101 and the sensing device 102 can be devices with wireless communication capabilities, such as routers, switches, optical modems, or other wireless devices, or user terminal devices such as mobile phones, tablets, laptops, PDAs, mobile internet devices (MIDs), or wearable devices (such as smartwatches, smart bracelets, pedometers, etc.) and smart home devices (such as refrigerators, televisions, air conditioners, electricity meters, curtains, cameras, door locks, lights, etc.).

[0037] It should be noted that the gateway device 101 is used to connect various devices in the current environment to achieve intelligent control. The gateway device 101 itself can also have the sensing function of the sensing device 102, that is, it can act as a sensing device to perform corresponding sensing operations. Similarly, the sensing device 102, which can establish connections with various devices in the current environment, can also act as a gateway device to perform corresponding intelligent control. As the network center in the current environment, the gateway device 101 can achieve signal coverage of the current environment. By establishing communication connections (such as WIFI connections) with multiple sensing devices 102, data can be transmitted between the gateway device 101 and the sensing devices 102. That is, the gateway device 101 can control the sensing devices 102 to perform corresponding operations, and it can also obtain collected data from the sensing devices 102.

[0038] In some embodiments, the gateway device 101 is used to acquire perception information of a target object perceived by multiple sensing devices 102 at different locations, select at least two target perception information from the multiple perception information, and confirm the behavior or location of the target object based on the at least two target perception information.

[0039] The target object can be set according to the current environment; for example, the target object in an indoor environment can be a person, a pet, a robot vacuum cleaner, etc. For instance, the gateway device 101 can send sensing instructions to multiple sensing devices 102. These sensing instructions are used to instruct the sensing of at least one target object.

[0040] Accordingly, the sensing device 102 receives a sensing instruction from the gateway device 101, senses the target object, and obtains the corresponding sensing information. The sensing device 102 is also used to send the sensing information to the gateway device 101.

[0041] In some embodiments, the perceived information may include at least one of the target object's location information, movement information, and posture information.

[0042] For example, movement information can be the movement distance and direction information of the target object relative to the sensing device 102. The sensing device 102 sends this movement distance and direction information data to the gateway device 101, which performs coordinate transformation based on the coordinates of the sensing device 102 to determine the position coordinates of the target object. Position information can be the coordinates of the target object in a coordinate system. The sensing device 102 can obtain the movement distance and direction information of the target object through sensing, perform coordinate transformation, map the target object to a coordinate system, thereby determining the position coordinates of the target object, and send the position coordinates of the target object to the gateway device 101. Posture information can be the action posture of the target object, such as standing, sitting, lying down, etc. The sensing device 102 can identify the current action posture of the target object by sensing the position coordinates of the target object.

[0043] For example, location information can be represented using a coordinate system with gateway device 101 as the origin. For instance, gateway device 101 establishes a coordinate system based on its own location and the locations of sensing devices 102, with gateway device 101 as the origin. Taking a two-dimensional Cartesian coordinate system as an example, the coordinate position corresponding to gateway device 101 is (0, 0), and this coordinate system also indicates the name and coordinates of each sensing device 102. Gateway device 101 can obtain the location of sensing devices 102 through methods such as Wi-Fi ranging and device positioning, and map it to the coordinate system. Figure 2 As shown, the multiple sensing devices 102 include a smart light in the master bedroom, a smart curtain in the master bedroom, a smart light in the living room, and a smart curtain in the living room. The coordinates of the smart light in the master bedroom are (X0, Y0), the coordinates of the smart curtain in the master bedroom are (X1, Y1), the coordinates of the smart light in the living room are (X3, Y3), and the coordinates of the smart curtain in the living room are (X4, Y4).

[0044] In some embodiments, the sensing device 102 can sense the target object via WIFI sensing.

[0045] For example, such as Figure 3As shown, the sensing device 102 forms an elliptical Fresnel zone between the signal transmitter (Tx) and receiver (Rx) based on the Fresnel model. Within the Fresnel zone, the signal experiences amplitude attenuation and phase shift depending on the path length, causing the signal to coherently or destructively converge at the receiver. Whenever the target object moves a distance that causes a one-wavelength change in the signal, the corresponding signal period fluctuates for one cycle. The sensing device 102 can calculate the target object's position information using the Fresnel model and the signal phase change caused by the target object's movement. For example, if the target object is located between a smart curtain and a smart light, when the target object moves, the smart curtain and smart light can calculate the change in the target object's moving distance from the signal phase change, allowing different sensing devices 102 to estimate the distance and direction of the target object's movement.

[0046] In summary, the technical solution provided in this disclosure can achieve multi-angle perception of the target object. Taking a smart home scenario as an example, for instance... Figure 4 As shown, all smart home devices in a smart home scenario support Wi-Fi signal transmission and reception. A household or each room within a household can be configured with a smart home gateway and multiple smart home devices, establishing a Wi-Fi sensing network through these devices. For example... Figure 5 As shown, the smart gateway 101 can be a smart home gateway, and the sensing device 102 can be a smart home device. The sensing process includes the following steps:

[0047] Step 501: Smart home gateway sensing device.

[0048] A smart home gateway can sense smart home devices in a given scene.

[0049] Step 502: Mark the coordinates of smart home devices.

[0050] Since different smart home devices have corresponding installation locations and device functions, this WIFI sensing network can be a coordinate system with the smart home gateway as the origin, and can also indicate the name and location coordinates of different smart home devices.

[0051] Step 503: Identify the moving target.

[0052] For example, when a device in the scene (including the smart home gateway itself and smart home devices) senses whether the target has moved, it can notify the smart home gateway after sensing the moving target to trigger subsequent operations.

[0053] Step 504: Smart home devices sense moving targets.

[0054] When a target object is detected to move, the smart home gateway can control multiple smart home devices within a preset range or in the current scene to detect the movement of the target object from different angles via Wi-Fi and transmit the detected information to the smart home gateway.

[0055] Step 505: The smart home gateway calculates mobile data.

[0056] Smart home gateways perform data calculations based on sensor information to determine the behavior or location of target objects.

[0057] Step 506: Smart home gateway verifies data.

[0058] Afterwards, the smart home gateway can also perform data verification and detect whether smart home devices are sensing any abnormalities.

[0059] Step 507: The smart home gateway controls smart home devices.

[0060] Once confirmed, the smart home gateway can control the corresponding smart home devices to perform specified functions based on the target object's behavior or location, such as controlling the smart lights to turn on or off.

[0061] It should be noted that the various embodiments of this disclosure can be referenced or learned from each other. For example, the same or similar steps, method embodiments, system embodiments and device embodiments can be referenced from each other without limitation.

[0062] Figure 6 This is a flowchart illustrating a target object perception method provided in an embodiment of this disclosure. Figure 6 As shown, the method includes the following steps:

[0063] Step 601: Obtain the perception information of the target object perceived by multiple sensing devices at different locations.

[0064] Among them, sensing devices include smart home devices, and the target objects include people.

[0065] In some embodiments, the perceived information includes at least one of the target object's location information, movement information, and posture information.

[0066] For example, location information can be the coordinates of the target object. Movement information can be the distance and direction of movement of the target object. Posture information can be the action posture of the target object, such as standing, sitting, lying down, etc.

[0067] In this disclosure, a coordinate system (e.g., Cartesian coordinate system, polar coordinate system, etc.) can be established using the location of the gateway device as the origin, and the coordinates and names of each sensing device can be labeled. The gateway device can perform coordinate transformation based on the target object's movement distance and direction information, as well as the coordinate positions of the corresponding sensing devices, to determine the target object's coordinates. The sensing devices can calculate the target object's movement distance and direction information via Wi-Fi sensing. After determining the target object's movement distance and direction information, the sensing devices can perform coordinate transformation to determine the target object's coordinates in the established coordinate system and directly send these coordinates to the sensing devices.

[0068] This location information can be either two-dimensional or three-dimensional coordinates, meaning that the height dimension of the target object is added to the two-dimensional coordinate system. In this way, the sensing device can identify the target object's location information in three-dimensional coordinates. Based on the location information in three-dimensional coordinates, the device can further identify the target object's posture, such as standing, sitting, or lying down.

[0069] In some embodiments, the distance between multiple sensing devices and the target object is less than a preset distance threshold. In this way, the gateway device can sense the location of the target object by calling sensing devices near the target object. Compared to sensing devices at a distance, nearby sensing devices can reduce the adverse effects of occlusion by objects in the environment, thereby reducing signal attenuation and improving the accuracy of target perception.

[0070] Step 602: Select at least two target perception information from multiple perception information, and confirm the behavior or location of the target object based on the at least two target perception information.

[0071] For example, when the perceived information includes the location information of the target object, the gateway device can select the location information from at least two target perceived information sets, and then determine the attitude information of the target object based on the location information. When the perceived information includes the movement information of the target object, the gateway device can perform coordinate transformation based on the movement information to determine the location information of the target object, and then determine the attitude information of the target object based on the location information. According to the triangulation principle, the gateway device can determine the behavior or location of the target object based on two target perceived information sets. Furthermore, the gateway device can improve the accuracy of perception by determining the behavior or location of the target object based on three or more target perceived information sets.

[0072] In one possible implementation, when the location of the target object is confirmed based on at least two target perception information, the gateway device determines at least two locations of the target object based on the at least two target perception information respectively, and takes the center position of the at least two locations as the location of the target object.

[0073] For example, a gateway device can determine the coordinates of at least two locations and use the average of the coordinates of the at least two locations as the coordinates of the target object's location.

[0074] In other words, the gateway device can determine the center position of at least two locations by calculating the average of the coordinates. Taking a Cartesian coordinate system as an example, the at least two locations are (x1, y1), (x2, y2), (x3, y3)...(x...). n y n The position (x, y) of the target object satisfies the following formula

[0075] Equation 1 and Equation 2:

[0076]

[0077] In some embodiments, the gateway device can determine the behavior of a target object based on positional or orientation information from at least two target perception pieces. For example, the gateway device can pre-determine the correspondence between the target object's position and its behavior, thereby determining the corresponding behavior based on the target object's position. Alternatively, the gateway device can determine the target object's behavior based on the orientation information, which is the most abundant among the at least two target perception pieces.

[0078] Based on the above technical solution, the gateway device can acquire perception information of a target object from multiple sensing devices located at different positions, select at least two target perception information from the multiple perception information, and confirm the behavior or position of the target object based on the at least two target perception information. Since the sensing devices are deployed in different locations in the current environment, the gateway device can acquire relevant perception data of the target object from different angles / positions through multiple sensing devices, and then comprehensively determine the behavior, position, and other information of the target object. By using multi-angle / positional perception, interference from irrelevant objects and other noise signals in the environment can be reduced, thereby improving the accuracy of target perception.

[0079] Furthermore, gateway devices can perform further verification based on the behavior or location of the confirmed target object to ensure accurate perception. The verification process of gateway devices is described below.

[0080] As one possible embodiment of this disclosure, combined with Figure 6 The illustrated embodiments, such as Figure 7 As shown, the method further includes steps 701-702.

[0081] Step 701: Determine whether there is a sensing device with a sensing anomaly among at least two sensing devices.

[0082] It should be noted that in complex sensing scenarios, some sensing devices may be affected by environmental factors, resulting in inaccurate sensing information. This may affect the behavior or location of the target object that the gateway device ultimately confirms. Therefore, after confirming the behavior or location of the target object, the gateway device can detect whether there is a sensing device with abnormal perception among the selected at least two sensing devices based on the behavior or location of the target object. This can avoid the adverse effects of abnormal sensing devices on the final result.

[0083] In some embodiments, the gateway device can determine whether there is a sensing device with a sensing anomaly among the at least two sensing devices based on the attitude information in the sensing information of the at least two sensing devices.

[0084] For example, the gateway device can determine whether the proportion of the most numerous posture information in the perception information of at least two sensing devices is greater than a first ratio. If the proportion is greater than or equal to the first ratio, the sensing device corresponding to the most numerous posture information is determined to be a normal sensing device; or, if the proportion is less than the first ratio, a sensing device with a perception abnormality is determined to exist.

[0085] In some embodiments, the gateway device may acquire the distance between the first sensing device and the target object, and the sensing error of the first sensing device.

[0086] Then, the gateway device can determine whether the distance matches the sensing error of the first sensing device. If the distance does not match the sensing error of the first sensing device, the first sensing device is determined to be a sensing device with a sensing error; or, if the distance does not match the sensing error of the first sensing device, the first sensing device is determined to be a normal sensing device.

[0087] The first sensing device is any one of at least two sensing devices.

[0088] It should be noted that, generally speaking, the sensing error of a sensing device is related to the distance between the sensing device and the target object. That is, the farther the distance between the sensing device and the target object, the greater the sensing error of the sensing device. Therefore, this disclosure can determine whether there is a sensing device with sensing abnormality among at least two sensing devices by judging whether the distance between the sensing device and the target object and the sensing error match.

[0089] For example, the sensing error of a sensing device can be variance, standard deviation, etc.

[0090] In one possible implementation, if the distance is less than a distance threshold and the sensing error of the first sensing device is greater than an error threshold, it is determined that the distance and the sensing error of the first sensing device do not match; if the distance is less than a distance threshold and the sensing error of the first sensing device is less than an error threshold, it is determined that the distance and the sensing error of the first sensing device match.

[0091] The distance threshold is determined based on the distance between the second sensing device (one of at least two sensing devices) and the target object, and the error threshold is determined based on the sensing error of the second sensing device. The second sensing device can be any of the at least two sensing devices other than the first sensing device, and the distance between the second sensing device and the target object is greater than the distance between the first sensing device and the target object.

[0092] For example, the distance threshold can be the distance between the second sensing device and the target object, and the error threshold can be the sensing error of the second sensing device. Taking a smart home scenario as an example, there are at least two sensing devices: a smart curtain, a smart light, and a smart door lock. The target object is located near the smart curtain and smart light, but far from the smart door lock. Therefore, the sensing accuracy of the closer smart curtain and smart light is higher than that of the smart door lock. Under normal circumstances, the sensing error of the smart curtain and smart light should be less than that of the smart door lock. If the sensing error of the smart curtain and smart light calculated by the gateway device is less than that of the smart door lock, it indicates that the sensing device is normal. If the sensing error of the smart curtain and smart light calculated by the gateway device is greater than that of the smart door lock, it indicates that the sensing device is abnormal.

[0093] Step 702: In the event of a sensing device with a sensing anomaly, instruct multiple sensing devices to re-sensitize the target object.

[0094] Subsequently, the gateway device can execute the target object perception method provided in this disclosure based on the perception information re-perceived by multiple perception devices.

[0095] In one possible implementation, the gateway device can instruct the sensing device with the sensing malfunction to re-sensitize the target object, and then execute the target object sensing method provided in this disclosure based on the sensing information re-sensed by the sensing device with the sensing malfunction and the sensing information of other sensing devices.

[0096] In another possible implementation, the gateway device can also instruct a sensing device that detects an anomaly to stop sensing, thereby shutting down the anomaly sensing device.

[0097] Based on the above technical solution, the gateway device in this disclosure can determine whether there is a sensing device with a sensing abnormality among the at least two sensing devices after confirming the behavior or location of the target object. If there is a sensing device with a sensing abnormality, it can instruct multiple sensing devices to re-sensitize the target object. In this way, this disclosure can realize the verification of the confirmed data, thereby avoiding the adverse effects of sensing devices with sensing abnormality on the final result.

[0098] As one possible embodiment of this disclosure, combined with Figure 6 The illustrated embodiments, such as Figure 8 As shown, the method further includes the following step 801.

[0099] Step 801: When the position of the target object changes, send sensing instructions to multiple sensing devices.

[0100] Among them, the perception instruction is used to instruct the perception of the target object.

[0101] For example, the gateway device can also sense the target object through sensing signals and trigger the sensing operation of the sensing device when it determines that the target object has moved. Since the gateway device may be far away from the target object, resulting in low sensing accuracy, the gateway device can determine whether the position of the target object has changed by judging whether the distance between the current position and the previous position of the target object is greater than a preset distance.

[0102] If the distance between the current position and the previous position of the target object is greater than a preset distance, it is determined that the position of the target object has changed.

[0103] If the distance between the current position of the target object and its previous position is less than or equal to a preset distance, it is determined that the position of the target object has not changed.

[0104] Based on the above technical solution, the gateway device in this disclosure can send sensing commands to multiple sensing devices only when the location of the target object changes, thereby triggering the sensing operations of the sensing devices. This reduces the sensing frequency of the sensing devices without affecting the sensing of the target object, thus reducing device power consumption and signal interference.

[0105] As one possible embodiment of this disclosure, combined with Figure 6 The illustrated embodiments, such as Figure 9 As shown, the method further includes the following step 901.

[0106] Step 901: Control the frequency of multiple sensing devices transmitting sensing signals during the sensing period to be adjusted from the first frequency to the second frequency, and / or the frequency of transmitting data signals to be adjusted from the third frequency to the fourth frequency.

[0107] The first frequency is lower than the second frequency, and the third frequency is higher than the fourth frequency. The sensing signal can be a signal carrying channel state information (CSI).

[0108] For example, the gateway device can control the signal frequency of the sensing device through instructions. For instance, the gateway device can instruct the sensing devices to adjust their signal frequency each time it instructs multiple sensing devices to perform sensing. Alternatively, the gateway device can issue instructions in advance so that the sensing devices can automatically adjust their signal frequency each time they perform sensing.

[0109] In some embodiments, the gateway device can also control multiple sensing devices to adjust the frequency of transmitting sensing signals from a second frequency to a first frequency, and / or the frequency of transmitting data signals from a fourth frequency to a third frequency, after the sensing ends. In this way, the sensing devices can resume their original signal transmission after the sensing ends, thereby avoiding interference with the normal operation of the sensing devices.

[0110] Based on the above technical solution, since there is signal interference between the sensing signal and the data signal, and the data transmission volume between the sensing device and the gateway device is not large, the gateway device can control the sensing device to increase the frequency of transmitting sensing signals and decrease the frequency of transmitting data signals during the sensing period, thereby reducing the impact of data signals on sensing and improving the sensing effect.

[0111] As one possible embodiment of this disclosure, combined with Figure 6 The illustrated embodiments, such as Figure 10 As shown, the method further includes the following step 1001.

[0112] Step 1001: In response to the first target operation, store the current position of the target object.

[0113] The first target operation is used to instruct the behavior of the target object, and the current position of the target object corresponds to the behavior specified by the first target operation.

[0114] For example, the first target operation can be a user operation, such as a click, swipe, or knob operation. The user can be the target object itself or not. The user can initiate the first target operation through a terminal device, causing the terminal device to send a corresponding operation command to the gateway device. The gateway device responds to the first target operation by receiving the operation command. Alternatively, the user can initiate the first target operation directly on an input module provided by the gateway device, such as a touch panel or keyboard.

[0115] Based on the above technical solution, the gateway device can pre-store the correspondence between location and behavior by providing human-computer interaction, thereby enabling users to customize the execution behavior. This allows the gateway device to better identify user behavior and thus reasonably control the device functions of smart home devices.

[0116] As one possible embodiment of this disclosure, combined with Figure 6 The illustrated embodiments, such as Figure 11 As shown, the method further includes the following step 1101.

[0117] Step 1101: Based on the behavior or location of the target object and the location of at least one smart home device, send control commands to the target smart home device in at least one smart home device.

[0118] Among them, smart home devices include at least one device function, and control instructions are used to instruct smart home devices to perform specified device functions.

[0119] For example, after determining that the target object is currently lying down, the gateway device can instruct the smart lights in the area where the target object is located to turn off or reduce their brightness. Conversely, if the gateway device determines that the target object is currently standing, it can instruct the smart lights in the area where the target object is located to turn on or increase their brightness.

[0120] For example, the target smart home device can be the sensing device in the above scheme, or it can be other devices. Different smart home devices have different functions; for example, smart curtains can control the degree of curtain opening, and smart lights can control the turning lights on or off. When the target object moves, the gateway device can turn on the smart home devices around the target object and / or turn off the smart home devices around the location where the target object was before moving. For example, if the target object moves from room A to room B, the gateway device can turn off the smart home devices in room A and turn on the smart home devices in room B, thereby improving the user experience for the target object.

[0121] In some embodiments, the method further includes step 1102.

[0122] Step 1102: In response to the second target operation, obtain the evaluation result of the control command.

[0123] The evaluation results are used to characterize user satisfaction with the control commands. This second objective operation can be referenced in the above description of the first objective operation.

[0124] In some embodiments, if the gateway device does not acquire a second target operation within a preset time period, the evaluation result of the control command is determined to be the default result. For example, the default result could be "control is correct".

[0125] Gateway devices can obtain user evaluations of their control over smart home devices through human-computer interaction. This allows the gateway devices to identify correct control data through machine learning, thereby improving the accuracy of subsequent control mode matching.

[0126] It is understood that, in order to achieve the above-mentioned functions, the communication device includes hardware structures and / or software modules corresponding to the execution of each function. Those skilled in the art should readily recognize that, based on the algorithmic steps of the examples described in conjunction with the embodiments of this disclosure, this disclosure can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed in hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this disclosure.

[0127] This disclosure embodiment can divide the communication device into functional modules according to the above method embodiment. For example, each function can be divided into a separate functional module, or two or more functions can be integrated into one functional module. The integrated module can be implemented in hardware or software. It should be noted that the module division in this disclosure embodiment is illustrative and only represents one logical functional division. In actual implementation, there may be other division methods. The following description uses the example of dividing each functional module according to each function.

[0128] For example, taking the communication device as the gateway device in the above method embodiment as an example, Figure 12 This is a schematic diagram of a communication device provided in an embodiment of this disclosure. The communication device can execute the target object perception method provided in the above-described method embodiment. Figure 12 As shown, the communication device 120 includes a processing unit 1201 and a communication unit 1202.

[0129] The communication unit 1202 is used to acquire the perception information of the target object perceived by multiple sensing devices at different locations.

[0130] The processing unit 1201 is used to select at least two target perception information from multiple perception information and to confirm the behavior or location of the target object based on the at least two target perception information.

[0131] In some embodiments, the perceived information includes at least one of the target object's location information, movement information, and posture information.

[0132] In some embodiments, the processing unit 1201 is configured to determine at least two positions of the target object based on at least two target perception information when the position of the target object is confirmed based on at least two target perception information; and to take the center position of the at least two positions as the position of the target object.

[0133] In some embodiments, the processing unit 1201 is used to determine the coordinates of at least two locations; and to use the average of the coordinates of the at least two locations as the coordinates of the target object.

[0134] In some embodiments, the processing unit 1201 is used to determine whether there is a sensing device with a sensing abnormality among at least two sensing devices; the communication unit 1202 is used to instruct multiple sensing devices to re-sensitize the target object if there is a sensing device with a sensing abnormality.

[0135] In some embodiments, the processing unit 1201 is used to acquire the distance between the first sensing device and the target object, and the sensing error of the first sensing device; the first sensing device is any one of at least two sensing devices; the processing unit 1201 is used to determine whether the distance and the sensing error of the first sensing device match; the processing unit 1201 is used to determine that the first sensing device is a sensing device with a sensing abnormality when the distance and the sensing error of the first sensing device do not match; or, when the distance and the sensing error of the first sensing device do not match, determine that the first sensing device is a normal sensing device.

[0136] In some embodiments, the processing unit 1201 is configured to determine that the distance does not match the perception error of the first sensing device when the distance is less than a distance threshold and the perception error of the first sensing device is greater than an error threshold; and to determine that the distance matches the perception error of the first sensing device when the distance is less than a distance threshold and the perception error of the first sensing device is less than an error threshold.

[0137] In some embodiments, the distance threshold is determined based on the distance between the second sensing device and the target object among at least two sensing devices, wherein the distance between the second sensing device and the target object is greater than the distance between the first sensing device and the target object; the error threshold is determined based on the sensing error of the second sensing device.

[0138] In some embodiments, the communication unit 1202 is used to send sensing instructions to multiple sensing devices when the position of the target object changes; the sensing instructions are used to instruct the target object to be sensed.

[0139] In some embodiments, the communication unit 1202 is used to control the frequency of multiple sensing devices transmitting sensing signals during sensing to be adjusted from a first frequency to a second frequency, and / or the frequency of transmitting data signals to be adjusted from a third frequency to a fourth frequency; wherein the first frequency is less than the second frequency, and the third frequency is greater than the fourth frequency.

[0140] In some embodiments, the processing unit 1201 is configured to store the current position of the target object in response to a first target operation; the first target operation is configured to instruct the behavior of the target object; the current position of the target object corresponds to the behavior specified by the first target operation.

[0141] In some embodiments, the communication unit 1202 is used to send control instructions to a target smart home device in at least one smart home device based on the behavior or location of the target object and the location of at least one smart home device; the smart home device includes at least one device function; the control instructions are used to instruct the smart home device to perform the specified device function.

[0142] In some embodiments, the communication unit 1202 is used to obtain the evaluation result of the control command in response to the second target operation; the evaluation result is used to characterize the user's satisfaction with the control command.

[0143] In some embodiments, the sensing device includes smart home devices; the target object includes a person.

[0144] In implementing the functionality of the integrated modules described above using hardware, this disclosure provides another possible structure for the communication device involved in the above embodiments. For example... Figure 13 As shown, the communication device 130 includes a processor 1302 and a bus 1304. Optionally, the communication device 130 may also include a memory 1301; alternatively, the communication device 130 may also include a communication interface 1303.

[0145] Processor 1302 may implement or execute various exemplary logic blocks, modules, and circuits described in conjunction with embodiments of this disclosure. Processor 1302 may be a central processing unit, a general-purpose processor, a digital signal processor, an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It may implement or execute various exemplary logic blocks, modules, and circuits described in conjunction with embodiments of this disclosure. Processor 1302 may also be a combination of computing functions, such as including one or more microprocessor combinations, a combination of a DSP and a microprocessor, etc.

[0146] The communication interface 1303 is used to connect to other devices via a communication network. This communication network can be Ethernet, wireless access network, wireless local area network (WLAN), etc.

[0147] The memory 1301 may be a read-only memory (ROM) or other type of static storage device capable of storing static information and instructions, random access memory (RAM) or other type of dynamic storage device capable of storing information and instructions, or electrically erasable programmable read-only memory (EEPROM), disk storage medium or other magnetic storage device, or any other medium capable of carrying or storing desired program code in the form of instructions or data structures and accessible by a computer, but is not limited thereto.

[0148] As one possible implementation, the memory 1301 can exist independently of the processor 1302. The memory 1301 can be connected to the processor 1302 via a bus 1304 and is used to store instructions or program code. When the processor 1302 calls and executes the instructions or program code stored in the memory 1301, it can implement the method described in any embodiment of this disclosure.

[0149] In another possible implementation, the memory 1301 can also be integrated with the processor 1302.

[0150] The 1304 bus can be an extended industry standard architecture (EISA) bus, etc. The 1304 bus can be divided into address bus, data bus, control bus, etc. For ease of representation, Figure 13 The bus is represented by a single thick line, but this does not mean that there is only one bus or one type of bus.

[0151] Some embodiments of this disclosure provide a computer-readable storage medium (e.g., a non-transitory computer-readable storage medium) storing computer program instructions that, when executed on a computer, cause the computer to perform the methods described in any of the above embodiments.

[0152] For example, the computer-readable storage media described above may include, but are not limited to: magnetic storage devices (e.g., hard disks, floppy disks, or magnetic tapes), optical disks (e.g., compact disks (CDs), digital versatile disks (DVDs), etc.), smart cards, and flash memory devices (e.g., erasable programmable read-only memory (EPROMs), cards, sticks, or key drives, etc.). The various computer-readable storage media described in this disclosure may represent one or more devices for storing information and / or other machine-readable storage media. The term "machine-readable storage media" may include, but is not limited to, wireless channels and various other media capable of storing, containing, and / or carrying instructions and / or data.

[0153] This disclosure provides a computer program product containing instructions that, when run on a computer, cause the computer to perform the methods described in any of the above embodiments.

[0154] The above description is merely a specific embodiment of this disclosure, but the scope of protection of this disclosure is not limited thereto. Any changes or substitutions within the technical scope disclosed in this disclosure should be included within the scope of protection of this disclosure. Therefore, the scope of protection of this disclosure should be determined by the scope of the claims.

Claims

1. A target object perception method, characterized by, The method comprises: obtaining sensing information of a target object sensed by a plurality of sensing devices in different positions; selecting at least two target sensing information from the plurality of sensing information, and confirming a behavior or a position of the target object according to the at least two target sensing information.

2. The method of claim 1, wherein, The sensing information comprises at least one of position information, movement information and posture information of the target object.

3. The method of claim 1, wherein, In a case where the position of the target object is confirmed according to the at least two target sensing information, the confirming the behavior or the position of the target object according to the at least two target sensing information comprises: determining at least two positions of the target object based on the at least two target sensing information respectively. A central position of the at least two positions is taken as the position of the target object.

4. The method of claim 3, wherein, The taking the central position of the at least two positions as the position of the target object comprises: determining coordinates of the at least two positions; and taking an average of the coordinates of the at least two positions as coordinates of the position of the target object.

5. The method of claim 1, wherein, The method further comprises: determining whether there is a sensing device with sensing abnormality in the at least two sensing devices; and in a case where there is a sensing device with sensing abnormality, instructing the plurality of sensing devices to sense the target object again.

6. The method of claim 5, wherein, The determining whether there is a sensing device with sensing abnormality in the at least two sensing devices comprises: obtaining a distance between a first sensing device and the target object, and a sensing error of the first sensing device, the first sensing device being any one of the at least two sensing devices; determining whether the distance matches the sensing error of the first sensing device; and in a case where the distance does not match the sensing error of the first sensing device, determining that the first sensing device is a sensing device with sensing abnormality; or in a case where the distance does not match the sensing error of the first sensing device, determining that the first sensing device is a normal sensing device.

7. The method of claim 6, wherein, The determining whether the distance matches the sensing error of the first sensing device comprises: in a case where the distance is less than a distance threshold value and the sensing error of the first sensing device is greater than an error threshold value, determining that the distance does not match the sensing error of the first sensing device; and in a case where the distance is less than a distance threshold value and the sensing error of the first sensing device is less than an error threshold value, determining that the distance matches the sensing error of the first sensing device.

8. The method of claim 7, wherein, The distance threshold value is determined according to a distance between a second sensing device and the target object in the at least two sensing devices, the distance between the second sensing device and the target object being greater than the distance between the first sensing device and the target object. The error threshold value is determined according to a sensing error of the second sensing device.

9. The method of claim 1, wherein, In a case where the position of the target object is confirmed according to the at least two target sensing information, the method further comprises: in a case where the position of the target object changes, sending a sensing instruction to the plurality of sensing devices, the sensing instruction being used to instruct to sense the target object.

10. The method of claim 1, wherein, The method further comprises: adjust a frequency of transmitting a sensing signal during sensing by the plurality of sensing devices from a first frequency to a second frequency, and / or adjust a frequency of transmitting a data signal from a third frequency to a fourth frequency; wherein the first frequency is less than the second frequency, and the third frequency is greater than the fourth frequency.

11. The method of claim 1, wherein, In the case that the position of the target object is determined according to the at least two pieces of target sensing information, the method further comprises: in response to a first target operation, storing a current position of the target object; the first target operation is used to indicate a behavior of the target object; the current position of the target object corresponds to the behavior specified by the first target operation.

12. The method of claim 1, wherein, The method further comprises: based on the behavior or position of the target object and the position of at least one smart home device, sending a control instruction to a target smart home device in the at least one smart home device; the smart home device comprises at least one device function; the control instruction is used to instruct the smart home device to execute a specified device function.

13. The method of claim 12, wherein, The method further comprises: in response to a second target operation, obtaining an evaluation result of the control instruction; the evaluation result is used to represent the satisfaction of the user to the control instruction.

14. The method of claim 1, wherein the sensing device comprises a smart home device; the target object comprises a person.

15. A communications device, characterized by comprises: a memory and a processor; the memory and the processor are coupled; the memory is used to store instructions executable by the processor; the processor executes the instructions to perform the method of any one of claims 1 to 14.

16. A computer program product, characterised in that, The computer program product comprises computer program instructions, which are executed by the processor to implement the method of any one of claims 1 to 14. The computer program product comprises computer program instructions, which are executed by the processor to implement the method of any one of claims 1 to 14.

Images