Target object perception method and related devices

By utilizing existing wired links of nodes to perceive target objects, the problem of high equipment costs in traditional methods is solved, achieving efficient and accurate target object perception.

CN118804325BActive Publication Date: 2025-11-07HUAWEI TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202310436384.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-04-13
Publication Date
2025-11-07
Estimated Expiration
2043-04-13

AI Technical Summary

Technical Problem

Traditional target object perception methods require the additional deployment of equipment such as cameras and radar, which is costly.

Method used

By utilizing existing wired links between nodes, target objects can be sensed via carrier signals. This reduces equipment deployment costs and allows for the perception of target objects by analyzing the changing characteristics of carrier signals.

Benefits of technology

It achieves efficient and accurate perception of target objects, with a wide coverage, while reducing computational load and equipment costs.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118804325B_ABST
    Figure CN118804325B_ABST
Patent Text Reader

Abstract

The application provides a target object perception method and related equipment, and applies to the field of communication. The target object perception method is executed by a first electronic device, applied to a wired communication system, the system includes at least two nodes in a first environment, and the nodes are connected through a wired link, and the method comprises the following steps: obtaining first information, the first information is information associated with a first carrier signal, the first carrier signal is a carrier signal loaded on the wired link by a first node in the at least two nodes; determining second information matched with the first information in historical information associated with the first environment, the second information is information associated with a second carrier signal obtained historically, and the information of a target object in the first environment is in a known state when the second carrier signal is transmitted in the first environment; determining the information of the target object in the first environment when the first carrier signal is transmitted in the first environment according to the known state corresponding to the second information. The cost of deploying cables and equipment is greatly reduced.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of communication, and particularly relates to a target object perception method and related equipment. BACKGROUND

[0002] With the development of artificial intelligence, artificial intelligence gradually penetrates into people's life and provides services for people. In some scenarios, the premise of the service provided by artificial intelligence is to perceive target objects (such as human bodies) in the environment, which can specifically be to perceive whether there is a person in the environment and the position of the person in the environment and the like. Traditional target object perception methods mainly use cameras, radars and the like to perceive target objects in the environment. However, the above traditional target object perception methods need to additionally deploy cameras, radars and the like, which is high in cost. SUMMARY

[0003] Therefore, it is necessary to provide a target object perception method and related equipment to reduce the cost.

[0004] In a first aspect, an embodiment of the present application provides a target object perception method, executed by a first electronic device, applied to a wired communication system, the wired communication system comprising at least two nodes located in a first environment, the at least two nodes being connected through a wired link, the nodes being used to transmit or receive a carrier signal, the target object perception method comprising: obtaining first information, wherein the first information is information associated with a first carrier signal, the first carrier signal being a carrier signal loaded on the wired link by a first node of the at least two nodes; determining second information matched with the first information in historical information associated with the first environment, wherein the second information is information associated with a second carrier signal obtained historically, and information of a target object in the first environment is in a known state when the second carrier signal is transmitted in the first environment; and determining information of the target object in the first environment when the first carrier signal is transmitted in the first environment according to a known state corresponding to the second information.

[0005] The first electronic device can be any node of the at least two nodes. The nodes other than the first node are used to receive the first carrier signal transmitted by the first node, and the information associated with the first carrier signal includes information of the carrier signal received by the other nodes. In other words, the information associated with the first carrier signal includes the information of the carrier signal received by the other nodes, and the carrier signal received by the other nodes is the first carrier signal transmitted by the first node. The information associated with the first carrier signal can also include information of the first carrier signal transmitted by the first node. The number of the other nodes can be one or more than one. If the number of the other nodes is one, the transceiving state between the first node and the other node is single transmission and single reception. If the number of the other nodes is more than one, the transceiving state between the first node and the other nodes is single transmission and multiple reception.

[0006] The second information in the historical information associated with the first environment that matches the first information is determined, i.e., the first information and the second information are matched, which can be specifically matching the information of the carrier signal received by the node, and can also be matching the information of the carrier signal transmitted by the node.

[0007] In the embodiments of the present application, the target object is perceived by fully utilizing the nodes that have been deployed in the environment and are connected to each other through wired links, without the need to deploy dedicated lines and equipment, thereby greatly reducing the cost of deploying cables and equipment. In the environment, there are more nodes connected to each other through wired links, the number of nodes is large, and the coverage is wide, so it is relatively easy to achieve full coverage of the environment and to accurately and efficiently perceive the target object in the environment. The target object is perceived using the historical information associated with the first environment, which avoids the process of analyzing the carrier signal to perceive the target object each time, reduces the amount of calculation, and improves the efficiency. In the process of perceiving the target object, only the information of the carrier signal needs to be matched, and the historical information associated with the first environment already stores the information of the relevant carrier signal, so only the information of the carrier signal that needs to be perceived at present needs to be extracted. The step of information extraction is reduced, and the efficiency is further improved.

[0008] Preferably, the target object perception method further comprises: obtaining the information of the target object in the first environment and the information of the carrier signal transmitted in the first environment according to a first input, wherein the first input is triggered by the living body; and wherein the obtained information of the target object in the first environment and the information of the carrier signal transmitted in the first environment are used to determine the historical information associated with the first environment. The historical information associated with the first environment can be obtained through the perception trigger or non-perception trigger of the living body, and then the target object can be perceived according to the historical information associated with the first environment.

[0009] Preferably, the first input is used to indicate a third carrier signal, and the third carrier signal is a carrier signal transmitted by a second node in the wired communication system in response to the trigger of the living body; and obtaining the information of the target object in the first environment according to the first input comprises: obtaining the attribute of the second node according to the first input; and determining the information of the target object in the first environment according to the attribute of the second node.

[0010] The attribute of the second node includes one or more of the following information: spatial information of the second node in the first environment (such as the position of the second node in the first environment), device type, and trigger information, wherein the device type can include the following two types: a first type that limits the user to be located near the node to trigger (such as the node only provides a touch screen for interaction), and a second type that does not limit the user to be located near the node to trigger (such as the node allows the user to trigger the node to transmit the carrier signal through remote control), and the trigger information includes the way in which the user interacts with the node, whether it is a key trigger or a remote control trigger, etc.

[0011] When the first electronic device obtains the first input, the node in the wired communication system can be determined to emit the third carrier signal in response to the trigger of the living body. The attribute of the node in the wired communication system is almost fixed, such as the position of the node is almost fixed. When the node emits the third carrier signal in response to the trigger of the living body, the information of the target object in the first environment can be determined according to the attribute of the node, such as the living body in the first environment can be determined to exist, and even the living body can be determined to be located near the node. Thus, the information of the target object in the first environment is continuously obtained through the interaction (perceived interaction or non-perceived interaction) between the living body and the node, so as to continuously enrich or update the historical information associated with the first environment.

[0012] Preferably, the wired communication system further comprises an auxiliary device, and the historical information associated with the first environment comprises the information of the target object in the first environment obtained from the auxiliary device. The historical information associated with the first environment can be obtained by means of the information of the target object in the first environment obtained by other auxiliary devices, and then the target object can be perceived according to the historical information associated with the first environment.

[0013] Preferably, the at least two nodes other than the first node are used to receive the first carrier signal emitted by the first node, and the information associated with the first carrier signal comprises the information of the carrier signal received by the other nodes, wherein the carrier signal received by the other nodes is the first carrier signal emitted by the first node and received by the other nodes.

[0014] Preferably, the transceiving state of the at least two nodes comprises any one of single-transmitting and multiple-receiving, single-transmitting and single-receiving, or multiple-transmitting and multiple-receiving when the first carrier signal or the second carrier signal is transmitted. That is, when the information of the carrier signal (such as the first information or the second information) is obtained in the model obtaining stage (i.e., the stage of obtaining the historical information associated with the first environment) and the perception stage, the transceiving state of the at least two nodes included in the first environment can be controlled to be any one of single-transmitting and multiple-receiving, single-transmitting and single-receiving, or multiple-transmitting and multiple-receiving. The number of the other nodes comprises one or more than one.

[0015] Preferably, the information of the carrier signal comprises one or more of the following: signal power, channel state, amplitude information, phase information, time-frequency feature, signal-to-noise ratio, transmission rate, bit error rate, and feature information, wherein the feature information is information obtained by feature extraction on one or more of the signal power, the channel state, the amplitude information, the phase information, the time-frequency feature, the signal-to-noise ratio, the transmission rate, and the bit error rate. The information of the carrier signal can reflect the influence of the target object in the first environment on the carrier signal.

[0016] Preferably, the known state in the history information associated with the first environment comprises any one or more of the following: absence of the target object in the first environment, presence of the target object in the first environment, location of the target object in the first environment, number of the target objects in the first environment, posture of the target object in the first environment, and moving track of the target object in the first environment. The more information of the target object recorded in the known state, the more the target object in the first environment can be perceived in detail. The information of the known state can be obtained with or without perception of the living body, and the information of the known state can be continuously updated and enriched.

[0017] Preferably, the wired link is a power line, and the at least two nodes connected by the wired link form a power line network. Preferably, the second information in the history information associated with the first environment matching the first information comprises: when the similarity between the second information and the first information reaches a preset threshold, it is determined that the second information matches the first information; or when the second information is identical to the first information, it is determined that the second information matches the first information.

[0018] Preferably, the target object is a living body or a non-living body, such as a person or a vehicle. Preferably, the target object perception method further comprises: updating the history information associated with the first environment according to the newly obtained information of the target object in the first environment and the newly obtained information of the carrier signal transmitted in the first environment. That is, the history information associated with the first environment can be updated in real time according to the newly obtained information, and the target object can be perceived according to the history information associated with the first environment.

[0019] Preferably, the first electronic device is one of the at least two nodes. Alternatively, the first electronic device is the auxiliary device.

[0020] In a second aspect, the embodiments of the present application provide a wired communication system, which comprises a first electronic device and at least two nodes. The at least two nodes are connected by a wired link to form a wired network, and the first electronic device communicates with the at least two nodes. The nodes are configured to transmit or receive a carrier signal, and the first electronic device is configured to execute any one of the target object perception methods.

[0021] Preferably, the wired communication system further comprises at least one auxiliary device, and the auxiliary device communicates with the first electronic device.

[0022] Preferably, the first electronic device accesses the wired network through a wired or wireless connection. When the first electronic device accesses the wired network through a wired connection, the first electronic device is a node in the wired network. For example, the nodes in the wired network are connected by power lines, and the first electronic device accesses the wired network through the power lines, so the first electronic device is a node. When the first electronic device accesses the wired network through a wireless connection, the first electronic device is the auxiliary device.

[0023] Thirdly, embodiments of this application provide an electronic device, which includes a memory and at least one processor, wherein the memory is used to store instructions and the processor is used to execute the instructions to implement any of the target object perception methods described above.

[0024] Fourthly, embodiments of this application provide a computer-readable storage medium storing a program that causes an electronic device to execute any of the target object perception methods described above.

[0025] Fifthly, embodiments of this application provide a computer program product including computer-readable instructions that, when executed by one or more processors, implement any of the target object perception methods described above.

[0026] Understandably, the wired communication system provided in the second aspect, the electronic device provided in the third aspect, the computer-readable storage medium provided in the fourth aspect, and the computer program product provided in the fifth aspect correspond to the methods provided in the first or second aspect. Therefore, the beneficial effects or various implementation methods that they can achieve can be referred to above, and will not be repeated here. Attached Figure Description

[0027] Figure 1 This application provides a schematic diagram of a wired communication system structure.

[0028] Figure 2 This application provides an example of an application scenario.

[0029] Figure 3 This application provides a schematic flowchart of a model acquisition method.

[0030] Figure 4 This application provides a schematic flowchart of a method for perceiving a target object.

[0031] Figure 5 This application provides a schematic diagram of a node structure.

[0032] Figure 6 This application provides a schematic diagram of an auxiliary device structure. Detailed Implementation

[0033] To make the objectives, technical solutions, and advantages of this application clearer, the embodiments of this application will be described in further detail below with reference to the accompanying drawings.

[0034] As mentioned above, traditional target object perception methods all require additional equipment to perceive the target object, which is costly.

[0035] In view of this, this application provides a target object sensing method and related equipment, which utilizes Power Line Communication (PLC) technology to sense target objects. Power Line Communication is a technology that uses power lines for data transmission. Nodes on the power line can load carrier signals onto the wired link. Both the node and the wired link can radiate the energy of the carrier signal into their surrounding environment, thus filling the environment with carrier signals (electromagnetic waves). By analyzing the carrier signals, target objects in the environment can be sensed. This application fully utilizes the existing wired network (such as a power line network) deployed in the environment to sense target objects, eliminating the need to deploy dedicated lines and equipment, greatly reducing the cost of deploying cables and equipment. Furthermore, wired networks include a large number of devices and have a wide coverage area, making it easier to achieve full coverage of the environment and realize accurate and efficient sensing of target objects in the environment.

[0036] Please see Figure 1 The present application provides an exemplary embodiment of a wired communication system 100.

[0037] Wired communication system 100 includes wired network 10. Wired network 10 includes at least two nodes (e.g., Figure 1 Nodes 12, 13, and 14 (shown below) are connected via a wired link. These at least two nodes can communicate via wired and / or wireless links; that is, the communication methods between these at least two nodes include wired and / or wireless. The wired link can be implemented as a power line, coaxial cable, optical fiber, twisted-pair cable, or other suitable wired medium. Wireless link communication can be implemented as the nodes propagating carrier signals through the air, as described below.

[0038] In the embodiments of this application, such as Figure 1 As shown, the wired link in the wired network 10 can be a power line 11. When the wired link in the wired network 10 is a power line 11, the wired network 10 is also called a power line network. When the power line 11 is used as a channel for data transmission, data transmission can be achieved between nodes in the wired network 10 through the power line 11.

[0039] The node can be a node defined in a communication network standard such as the ITU-T G.hn standard or the IEEE HomePlug standard, and the application does not make specific limitations on the type of wired communication technology and the type of protocol. The type of power line communication technology and the type of protocol are not specifically limited. The node can be a central coordinator (CCO), a station (STA), a proxy coordinator (PCO), a domain master (DM), and an end point (EP), and the like. The node can also be other types of nodes, which are not limited in the application.

[0040] The central coordinator is also referred to as a central node, responsible for network control, network maintenance and management, completing network authentication of nodes, data information interaction, and the like. The station and the end point are responsible for accessing the network. The proxy coordinator is also a relay node or a proxy node, responsible for data relay and forwarding, such as data relay and forwarding between the central coordinator and the station, or between the stations, or between the domain master and the end point. The domain master is a master controller in a domain, responsible for managing or coordinating other nodes in the domain. The wired network 10 can be composed of one or more domains, which are a network part obtained by logically dividing the wired network 10.

[0041] For example, in the G.hn standard related to the power line network, the wired network 10 can include a domain master and an end point; in the IEEE 1901.1 standard related to the power line network, the wired network 10 can include a central coordinator and a station, and the application does not make specific limitations on the type of node included in the wired network 10.

[0042] In the embodiments of the application, the physical networking of the wired network 10 includes a star topology, a tree topology, a chain topology, and a ring topology, and the like, which are not specifically limited in the application.

[0043] The nodes in the wired network 10 that transmit or receive data signals through wired links each include a corresponding communication module, and the node implements the transmission and reception of messages based on the communication module. The communication module can be set according to specific circumstances, which are not specifically limited in the application.

[0044] In the embodiments of the application, the node has a power line carrier communication function, and can realize the functions of receiving or transmitting messages in the wired network 10, and the like. For example, Figure 1The nodes in the wired network 10 shown that transmit or receive data signals through the power line 11 include a power line communication module. The power line communication module is connected to the power line 11. The node transmits a packet to other nodes in the wired network 10 through the power line communication module, or receives a packet transmitted by other nodes in the wired network 10.

[0045] The packet can be a null data packet (NDP) or a physical layer protocol data unit (PPDU) for example, which is not limited in the present application.

[0046] The power line communication module can include a PLC media access control (MAC) and physical layer (PHY) communication module, responsible for framing and framing of the PLC carrier signal and modulation and demodulation. The power line communication module can be a chip for implementing the PLC communication protocol, such as a dedicated PLC chip, which can include modules or circuits for implementing PLC MAC and PHY communication, and modules or circuits for framing and framing of the PLC carrier signal and modulation and demodulation. The implementation form of the power line communication module is not limited in the present application.

[0047] In the embodiments of the present application, the node can be used to transmit or receive a carrier signal. The node can transmit the carrier signal by loading the carrier signal onto the wired link. The loading method includes but is not limited to coupling and other ways of modulating the signal onto the wired link. Specifically, the node implements transmission and reception of the carrier signal through the power line communication module. Taking nodes 11 and 12 as an example, the power line communication module of node 11 modulates and encodes the carrier signal of the video signal or the audio signal to obtain the carrier signal, and node 11 transmits the carrier signal to node 12. If the power line communication module of node 11 couples the carrier signal to the power line 11, the carrier signal can be transmitted to node 12 through the power line 11. The carrier signal can also propagate through the air, such as when the carrier signal is transmitted on the power line 11, the power line 11 that injects the carrier signal radiates the energy of the carrier signal to the outside (such as the environment where the power line 11 is located), and then the radiated carrier signal energy propagates through the air to node 12. The carrier signal transmitted by node 11 received by node 12 includes the carrier signal transmitted through the power line 11 and / or the carrier signal propagated through the air. The power line communication module of node 12 decodes the received carrier signal to obtain the video signal or the audio signal transmitted by node 11.

[0048] In the embodiments of the present application, the nodes in the wired network 10 can receive the carrier signals in addition to being powered off, such as in a hibernation state or an active state. For this purpose, the carrier signals received by each node can be directly obtained from the node.

[0049] For example, the frequency unit of the carrier signal can be Mega Hertz (MHz) or Giga Hertz (GHz). In some embodiments, the frequency of the carrier signal can be low frequency, for example, 3-500 kHz. The working frequency band of the carrier signal is not specifically limited in the present application.

[0050] In the embodiments of the present application, the device entity of the node described above can be any communication device capable of supporting communication through the power line 11, such as a router, a gateway, a digital subscriber line (DSL) modem, an optical network terminal (ONT), a wireless access point (AP) for a home use scenario, or various sensors, smart devices, etc. for an enterprise use scenario or an Internet of Things scenario, which are not specifically limited in the present application. The modem can be a power cat or other types of power line communication modems, which are not specifically limited in the present application.

[0051] The power line 11 described above is a transmission medium in the wired network 10, used to realize data transmission or communication. The power line 11 refers to a cable with a transmission power function, including but not limited to the following types of parallel lines, optical fiber composite cables, coaxial cables, twisted pairs, three-strand cables, power cables, control cables, special cables, etc. The cable types are not specifically limited in the present application.

[0052] In some embodiments, the wired communication system 100 can comprise an auxiliary device 20 which can access the wired network 10 through wired or wireless manner. For example, the auxiliary device 20 can be communicatively connected with any node in the wired network 10 through a communication network such as a wired network or a wireless network. The communication network can be a local area network (LAN) or a wide area network (WAN) (e.g., the Internet). Specifically, the communication network can include, but is not limited to, a Wi-Fi hotspot network, a Wi-Fi peer to peer (P2P) network, a Bluetooth network (including classic Bluetooth and Bluetooth Low Energy (BLE)), a ZigBee network, or a near-field communication (NFC) network. The communication connection manner between the auxiliary device 20 and the node in the wired network 10 is determined according to actual conditions, for example, according to the auxiliary device 20 and the connected node, which is not specifically limited in the present application.

[0053] In some embodiments, the auxiliary device 20 is implemented as a terminal device, which can include, but is not limited to, a mobile phone, a tablet, a notebook computer, a desktop computer, an all-in-one computer, a virtual reality (VR) device, an augmented reality (AR) device, a smart watch, a bracelet, etc. The type of the terminal device is not specifically limited in the present application.

[0054] Any of the above nodes can communicate with the terminal device. For example, the above node is implemented as a smart device, which can send the collected image / video or other types of information to the terminal device. The terminal device can make decisions based on the received information of the smart device, and then send control instructions or other information to the smart device. For another example, the user outputs the corresponding control instructions to the smart device through the terminal device. The smart device can change the working state or perform a certain function in response to the received control instructions.

[0055] In some embodiments, the auxiliary device 20 is implemented as a hub device. The hub device can be a separate electronic device dedicated to making intelligent decisions and controlling various devices in the power communication system, such as a smart central control device installed in a user's home. Any of the above nodes can communicate with the hub device. For example, the above nodes are implemented as smart devices, which can send collected images / videos or other types of information to the hub device. The hub device can make decisions based on the received information of the smart devices, and then send control instructions and the like to the smart devices. The smart devices can change the working state or perform certain functions in response to the control instructions received thereby. For another example, the auxiliary device 20 includes the above terminal device and the hub device, and the terminal device can communicate with the hub device. The user outputs corresponding information to the hub device through the terminal device, and the hub device changes the working state or performs certain functions in response to the received information.

[0056] In other implementations, the hub device can be a software program that can be installed in an existing electronic device in a user's home, so that the electronic device further has the functions of making intelligent decisions and controlling smart devices based on the existing functions. For example, the software program of the hub device can be installed in a router, or a smart large screen or a smart television.

[0057] In some embodiments, the auxiliary device 20 is implemented as a cloud server. The auxiliary device 20 can include a hub device and / or a terminal device and / or a cloud server. The hub device and / or the terminal device and / or any of the above nodes can send the information received thereby to the cloud server, which performs calculation and processing, and then the cloud server sends the processing results or control instructions to the hub device and / or the terminal device and / or the nodes, which are forwarded to the smart devices by the hub device and / or the terminal device.

[0058] In some embodiments, the auxiliary device 20 is implemented as a smart device, including but not limited to a robot, a smart home device (such as a smart refrigerator, a smart toilet, a smart toilet, a smart oven, a robot vacuum cleaner), a sensor, and the like. When the smart device is not accessed to the wired communication system 100 through the power line 11, the smart device plays the role of the auxiliary device 20 in the wired communication system 100. When the smart device is accessed to the wired communication system 100 through the power line 11, the smart device plays the role of a node in the wired network 10 in the wired communication system 100.

[0059] In the embodiments of the present application, the number of auxiliary devices 20 in the power communication system can include one or more, and the auxiliary device 20 can include one or more of the above terminal device, sensor or cloud server.

[0060] In the embodiments of the present application, the auxiliary device 20 can communicate with the central coordinator or domain host, such as shown in Figure 1 The node 12 shown in the figure is a domain host, and the auxiliary device 20 communicates with the node 12.

[0061] In some embodiments, the nodes in the wired network 10 can have the hub device function described above, such as the central coordinator or domain host having the hub device function.

[0062] It should be noted that Figure 1 The connection mode and number of each node are only illustrative and do not limit the embodiments of the present application.

[0063] In the embodiments of the present application, the principle of sensing the target object by using the power line communication technology is that when the carrier signal of the wired communication system 100 is transmitted in the environment, the existence of the target object (person or object) in the environment will cause reflection, diffraction, scattering, attenuation, multipath and other phenomena, so that the amplitude, phase, spectrum and other characteristics of the received carrier signal change, and by detecting and analyzing the change characteristics of the carrier signal, whether the target object exists, the position and state of the target object and other information can be inferred, so that the purpose of sensing the target object is achieved. Specifically, the node in the wired network 10 loads the carrier signal on the power line 11. The power line 11 has a certain length, such as the length of the power line 11 being equivalent to the wavelength of the electromagnetic wave below 30 MHz, and the power line 11 does not take any shielding measures, at this time the power line 11 is equivalent to an "antenna", so the power line 11 injected with the carrier signal radiates carrier signal energy to the surrounding space. Alternatively, after the node (such as a modem) modulates the carrier signal, the node can also radiate carrier signal energy to the surrounding space. Thus, the environment (such as air) where the wired communication system 100 is located is filled with carrier signals (electromagnetic waves) radiated by the power line 11 and / or the node, and by analyzing the carrier signals transmitted in the environment (such as the carrier signals transmitted by air), the target object in the environment can be sensed. For example, by analyzing the carrier signals transmitted by the node and the carrier signals received by other nodes (including the carrier signals received through the power line and through the air), the target object in the environment can be sensed.

[0064] In the embodiments of the present application, when the target object is sensed based on the target object sensing method provided in the present application, the transmitted carrier signal is transmitted through the wired link (such as the power line) and the wireless link (such as the air), and when the signal quality of the carrier signal obtained based on the wireless link is poor, the carrier signal with good signal quality can also be stably obtained through the wired link (such as the power line), so as to improve the stability and reliability of sensing the target object, and ensure the timeliness and accuracy of subsequent sensing.

[0065] The target object perception method and related device provided by the embodiments of the present application can be applied to a family application scenario, an office application scenario, a school application scenario, a supermarket application scenario, a warehouse application scenario, a parking lot application scenario, and the like, to perceive target objects in the above application scenarios. It can be understood that the target object perception method and related device provided by the embodiments of the present application are not limited to the above application scenarios, and can be applied to any environment in which target objects need to be perceived.

[0066] The target object perceived by the target object perception method and related device provided by the embodiments of the present application includes a living body and a non-living body, such as a person, a vehicle, and the like, which is not specifically limited by the present application, and can be determined according to actual conditions.

[0067] It should be noted that, Figure 1 The system architecture shown is only an example of the system architecture provided by the target object perception method provided by the present application, and does not limit the embodiments of the present application.

[0068] The following Figure 1 The system architecture shown is used as an example in a family use scenario to exemplarily introduce the target object perception application scenario provided by the embodiments of the present application.

[0069] In the family use scenario, various types of devices are arranged indoors, and each device (for example, a smart refrigerator, a smart screen) can be built-in with a power line communication module to become a node of a power line network. For example, Figure 2 As shown, the user's home, that is, the first environment 200, is arranged with various types of devices, for example, the smart home host 201, the smart television 202, the router 203, and the smart curtain 204 in the area of the living room, the smart sound box 205 in the area of the bedroom A, the smart table lamp 206 in the area of the bedroom B, the smart refrigerator 207 and the smart cooking table 208 in the area of the kitchen, the smart door lock 209 installed on the door, the first smart lamp 211 installed in the dining area, the camera 210 and the second smart lamp 212 installed on the porch wall.

[0070] The wired communication system 21 in the first environment 200 includes a power line network 22 and auxiliary devices (such as a smart door lock 209 and a camera 210), and the power line network 22 includes a full-house smart host 201, a smart TV 202, a router 203, a smart curtain 204, a smart sound box 205, a smart table lamp 206, a smart refrigerator 207, a smart cooking platform 208, a first smart lamp 211, and a second smart lamp 212 connected by power lines 23. Each device in the power line network 22 is internally provided with a power line communication module, and each device in the power line network 22 can communicate with each other through the power lines 23. The full-house smart host 201 in the power line network 22 serves as a central coordinator, and the devices other than the full-house smart host 201 in the power line network 22 serve as stations. The full-house smart host 201 has the function of a hub device, and can communicate with other devices in the wired communication system 21, such as the smart door lock 209 and the camera 210.

[0071] In a home use scenario, the installation or placement positions of the devices can be corresponded to coordinates in a home coordinate system. The home coordinate system can be determined in a full-house pre-installation stage, and is preferably three-dimensional or two-dimensional. The installation or placement positions of walls, doors, windows, lamps, furniture, home appliances, and smart devices in the house can be represented by coordinates in the home coordinate system. In addition, the real-time positions of moving objects (such as family members and pets) in the house can also be obtained in real time by target sensing of devices in the wired communication system 21 (such as devices in the power line network), and the positions of the target objects can also be represented by coordinates in the home coordinate system.

[0072] In some embodiments, the position information of each device in the first environment can be pre-stored, for example, the smart sound box 205 in the bedroom A region. The position information of each device can be uploaded by a user or a technician. It can also be determined by means of signal transmission between nodes in the power line network and the determined node position information, such as Figure 2 The smart TV 202 and the router 203 in the middle receive the carrier signals transmitted by the smart curtain 204, and the received carrier signal strengths are similar, so it can be judged that the smart TV 202 and the router 203 are located in the same area (living room). The position information of the devices in the first environment can also be obtained by means of auxiliary devices, such as the camera 210 identifying the photographed image, identifying the second smart lamp 212, and then the camera 210 uploading the position information of the second smart lamp 212, or the camera 210 uploading the photographed image, and according to the position information of the camera 210, it can be determined that the smart door lock 209 and the camera 210 are in the same area (porch).

[0073] Among them, the content of the wired communication system 21, the power line network 22, the nodes and the power line 23 can refer to the related content of the above Figure 1 , which will not be repeated here.

[0074] It should be understood that Figure 2 is only an example of a home application scenario, not a limitation. According to the actual situation setting, the first environment 200 can be installed with more or less devices than Figure 2 indicated, and / or with devices of different categories. Figure 2

[0075] The following describes the target object perception method provided by the embodiments of the present application, which can be applied to the wired communication system or wired network (such as the power line network shown in Figure 2 ), which can be executed by the first electronic device, which can be any node in the wired network, such as a central coordinator or domain host. The first electronic device can also be an auxiliary device connected to the wired network, such as a hub device.

[0076] The following describes the target object perception method executed by the central coordinator, taking the human body as an example.

[0077] The target object perception method provided by the embodiments of the present application is used to perceive the target object in the first environment, and the target object perception method provided by the embodiments of the present application mainly includes a model acquisition stage and a perception stage. The model acquisition stage mainly collects relevant data in the first environment, and processes the relevant data to obtain a perception model. The perception stage mainly uses the perception model to perceive the target object in the first environment. The model acquisition stage includes an establishment sub-stage and an update sub-stage, wherein the establishment sub-stage is used to establish the perception model. The update sub-stage is used to update the existing perception model, for example, to update the perception model established by the establishment sub-stage, or to update the perception model updated by the previous update sub-stage. The establishment sub-stage is before the perception stage, and the update sub-stage is before the perception stage or the update sub-stage is simultaneous with the perception stage or the update sub-stage is after the perception stage.

[0078] Model acquisition phase

[0079] Please refer to Figure 3 for an exemplary introduction to the model acquisition method provided by the embodiments of the present application.

[0080] Step S31, the central coordinator acquires the first input.

[0081] ​In the embodiments of the present application, the first input is used to indicate obtaining information associated with the first environment, and the information associated with the first environment includes one or more of the following information: information of a target object in the first environment and information of a carrier signal transmitted in the first environment. The first environment is the environment in which the execution subject (central coordinator) is located. As shown in Figure 2 The first environment 200 in which the whole-house intelligent host 201 is located is the first environment, and the first input obtained by the whole-house intelligent host 201 indicates obtaining information associated with the first environment 200.

[0082] The first input includes one or more of the following inputs: input from a living body (such as a user), input from any node in the power line network, and input from an auxiliary device. The auxiliary device is not connected to the power line network through the power line, and the auxiliary device can communicate with the central coordinator through the wired network or the wireless network. The form of the first input can be voice input, touch input, instructions from other devices (such as nodes or auxiliary devices), received signals (such as carrier signals), information that a node receives a carrier signal, etc. The form of the first input is not limited in the present application.

[0083] In the embodiments of the present application, the central coordinator can obtain the first input after starting the perception function, that is, can obtain information associated with the first environment, and then establish a perception model according to the obtained information associated with the first environment, or update the perception model, or perceive a target object in the environment according to the perception model, or update the perception model and perceive the target object in the environment, or establish the perception model and perceive the target object in the environment. For example, when the central coordinator is implemented as the whole-house intelligent host 201, the control interface of the whole-house intelligent host 201 provides a "perception" option, and the whole-house intelligent host 201 starts the perception function in response to the user selecting the "perception" option. After starting the perception function, the whole-house intelligent host 201 obtains the first input to obtain information associated with the first environment 200.

[0084] In some embodiments, the central coordinator can start the perception function by default.

[0085] In step S32, the central coordinator obtains information of a carrier signal transmitted in the first environment and information of a target object in the first environment according to the first input.

[0086] The information of the carrier signal can include one or more of the following: signal power, channel state information (CSI), amplitude information, phase information, time-frequency characteristics, signal-to-noise ratio, transmission rate, bit error rate, and feature information. In other words, the first information can be any one or more of the signal power, channel state information, amplitude information, phase information, time-frequency characteristics, signal-to-noise ratio, transmission rate, bit error rate, and feature information of the first carrier signal.

[0087] The feature information is feature information obtained by feature extraction on any one or more of the signal power, channel state information, amplitude information, phase information, time-frequency characteristics, signal-to-noise ratio, transmission rate, and bit error rate of the carrier signal. For example, the above-mentioned physical information is input into a preset model to perform feature extraction on the above-mentioned physical information through parameters of the preset model to obtain the feature information. The preset model can be a deep learning model, and the preset model can be composed of an encoder and a decoder. The content of feature extraction on the above-mentioned physical information to obtain the feature information can refer to the related art, and the type of the preset model and the feature extraction method are not limited in the present application.

[0088] The carrier signal transmitted in the first environment can be transmitted through a power line and / or transmitted through the air. The carrier signal transmitted in the first environment includes the carrier signal transmitted by the transmitting end and received by the receiving end, and can also include the carrier signal transmitted by the transmitting end. The information of the carrier signal transmitted in the first environment includes the information of the carrier signal transmitted by the transmitting end and received by the receiving end, i.e., the information of the received carrier signal, and can also include the information of the carrier signal transmitted by the transmitting end. In other words, the carrier signal transmitted in the first environment can be the information of the transmitted carrier signal, the information of the received carrier signal, or the information of the transmitted carrier signal and the information of the received carrier signal, and the transmitted carrier signal and the received carrier signal are associated.

[0089] The receiving end can include one or more nodes in the first environment, and the transmitting end can include one or more nodes in the first environment. The information of the carrier signal transmitted in the first environment obtained by the central coordinator according to the first input includes the information of the carrier signal transmitted by any one or more nodes, or the information of the carrier signal received by any one or more nodes, or the information of the carrier signal transmitted by any one or more nodes and the information of the carrier signal received by any one or more nodes.

[0090] Preferably, the information of the carrier signals transmitted in the first environment obtained by the central coordinator is the information of the carrier signals received by any one or more nodes, and in some embodiments, can also include the information of the carrier signals transmitted by any one or more nodes, and then the central coordinator obtains more complete information about the carrier signals transmitted in the first environment according to the information of the transmitted carrier signals. In the embodiments of the present application, the transceiving state of the nodes in the wired communication system or the power line network when the central coordinator obtains the carrier signals transmitted in the first environment includes any one of single-transmitting and multiple-receiving, single-transmitting and single-receiving, or multiple-transmitting and multiple-receiving.

[0091] In some embodiments, for the same node, the node cannot transmit carrier signals while receiving the carrier signals transmitted by the node.

[0092] In the embodiments of the present application, the information of the carrier signals can reflect the influence of the target objects in the first environment on the carrier signals. Specifically, due to the existence of the target objects (people or objects) in the first environment, reflection, diffraction, scattering, attenuation, multipath, and other phenomena occur, so that the amplitude, phase, spectrum, and other characteristics of the received carrier signals change, and then by analyzing the information of the received carrier signals, the target objects in the first environment can be perceived.

[0093] The information of the target objects in the first environment includes the existence of the target objects in the first environment, the non-existence of the target objects in the first environment, the position of the target objects in the first environment, the number of the target objects in the first environment, the moving track of the target objects in the first environment, and the posture of the target objects in the first environment, and other related information of the target objects.

[0094] It can be understood that, under reasonable circumstances, the information of the target objects in the first environment can include two or more of the above information, such as the position of the target objects in the first environment and the number of the target objects in the first environment.

[0095] Step S33, the central coordinator obtains a perception model according to the obtained information of the target objects in the first environment and the information of the carrier signals transmitted in the first environment.

[0096] In the embodiments of the present application, the information of the target objects in the first environment obtained by the central coordinator after performing step S32 is known target object information, that is, the information of the target objects obtained by step S32 can explicitly indicate the existence or non-existence of the target objects in the first environment, the position of the target objects, the number of the target objects, the moving track of the target objects, and the posture of the target objects.

[0097] In the embodiments of the present application, the information of the carrier signal transmitted in the first environment obtained by the central coordinator after performing step S32 is the information of the known or explicit carrier signal, that is, the information of the carrier signal transmitted in the first environment obtained by step S32 can explicitly indicate the carrier signal transmitted in the first environment and explicitly indicate any one or more of the following information in the carrier signal: signal power, channel state (channel state information, CSI), amplitude information, phase information, time-frequency characteristics, signal-to-noise ratio, transmission rate, bit error rate, and characteristic information, etc.

[0098] In the embodiments of the present application, the information of the target object in the first environment obtained by the central coordinator (hereinafter referred to as known state) and the information of the carrier signal transmitted in the first environment (hereinafter referred to as known information) are used to obtain the history information associated with the first environment, which can be used to establish a perception model or update a perception model or perceive the target object in the first environment, or update the perception model and perceive the target object in the first environment, or establish the perception model and perceive the target object in the first environment. For example, in the perception stage, the central coordinator obtains the finally obtained known information and known state according to the history information associated with the first environment, and then obtains new history information associated with the first environment according to the finally obtained known information and known state, which can be used to establish a perception model or update a perception model or the next perception.

[0099] In some embodiments, the central coordinator updates the history information associated with the first environment according to the newly obtained information of the target object in the first environment and the newly obtained information of the carrier signal transmitted in the first environment. That is, the history information associated with the first environment can be updated in real time according to the newly obtained information, and then the target object is perceived according to the history information associated with the first environment, the perception model is updated, etc.

[0100] Exemplarily, at T1 moment, only carrier signal a is transmitting in the first environment, the central coordinator obtains the known information (information associated with carrier signal a) and the known state (information of the target object in the first environment when carrier signal a is transmitting in the first environment) in the first environment, it can be determined that the known information and the known state associated with carrier signal a obtained at the same moment or time period (such as 3 seconds) are associated, and the perception model is established or updated according to the known information and the known state obtained at T1 moment. After a period of time after T1 moment, such as T2 moment, only carrier signal b is transmitting in the first environment, the central coordinator obtains the known information (information associated with carrier signal b) and the known state (information of the target object in the first environment when carrier signal b is transmitting in the first environment) in the first environment, it can be determined that the known information and the known state associated with carrier signal b obtained at the same moment or time period (such as 3 seconds) are associated, and the perception model is established or updated according to the known information and the known state obtained at T2 moment.

[0101] In the embodiment of the present application, the central coordinator establishes the perception model or updates the perception model according to the obtained historical information associated with the first environment. For example, when the central coordinator obtains the first input when there is no perception model, the central coordinator obtains the historical information associated with the first environment according to the first input, and then the central coordinator establishes the perception model according to the obtained historical information associated with the first environment. For another example, when the central coordinator obtains the first input when there is the perception model, the central coordinator obtains the historical information associated with the first environment according to the first input, and then the central coordinator updates the existing perception model according to the obtained historical information associated with the first environment. For another example, when the central coordinator obtains the first input when there is the perception model, the central coordinator uses the perception model to perceive the target object in the first environment, and finally obtains the known information and the known state, and then the central coordinator updates the perception model according to the known information and the known state obtained after the perception. In the embodiment of the present application, the central coordinator obtains the perception model according to the obtained historical information associated with the first environment includes that the central coordinator establishes the perception model according to the known information and the known state associated with each other in the obtained historical information associated with the first environment. Alternatively, the central coordinator updates the perception model according to the known information and the known state associated with each other in the obtained historical information associated with the first environment.

[0102] In the embodiments of the present application, the known state and the known information obtained according to the first input are corresponding, that is, the known information and the known state obtained according to the first input are associated with each other. The known state and the known information are both related to the corresponding first input, for example, the first input a and the first input b, the known state a1 and the known information a2 obtained according to the first input a are related to the first input a, and the known state a1 and the known information a2 are associated with each other. The known state b1 and the known information b2 obtained according to the first input b are related to the first input b, and the known state b1 and the known information b2 are associated with each other. In the embodiments of the present application, the known state and the known information associated with each other are both related to the first environment. For example, the known information a2 is the information of the carrier signal a3 transmitted in the first environment, and the information of the target object in the first environment is the known state a1 when the carrier signal a3 is transmitted in the first environment. In other words, when the information of the target object in the first environment is the known state a1, the obtained information of the carrier signal transmitted in the first environment is the known information a2. Alternatively, when the obtained information of the carrier signal transmitted in the first environment is the known information a2, the information of the target object in the first environment is the known state a1. In some embodiments, the living body and the non-living object have different effects on the carrier signal transmitted in the environment, so that the amplitude, phase, spectrum and other characteristics of the carrier signal affected by the living body and the non-living object are different. For example, the reflection, diffraction, scattering, attenuation, multipath and other phenomena of electromagnetic waves caused by a person and a smart refrigerator in the same environment are different, and accordingly the amplitude, phase, spectrum and other characteristics of the electromagnetic waves affected by the person or the smart refrigerator are different. Therefore, in the embodiments of the present application, the target objects associated with the known information and the known state are of the same type, that is, the known information is the information of the carrier signal affected by the person, and the information of the target object corresponding to the known state is also the information of the person, such as the position and quantity of the person.

[0103] For example, taking the target object as a human body, when the known state a is that there is no person in the first environment, the carrier signal A transmitted in the first environment at this time is obtained, and the corresponding carrier signal information B is obtained, so that the known information corresponding to the known state a is the carrier signal information B. For another example, when the known state b is that there is a person in the first environment, the carrier signal C transmitted in the first environment at this time is obtained, and the corresponding carrier signal information D is obtained, so that the known information corresponding to the known state b is the carrier signal information D. In the embodiments of the present application, the known information and the known state associated with each other are related in time, space and target object. That is, the time, space and target object corresponding to the known information and the known state associated with each other are the same (consistent).

[0104] The perception model can be a model statistically derived from the acquired data (historical information associated with the first environment), which records the associated known information and known states. In some embodiments, the model statistically derived from the acquired data can be implemented as a storage list, or record the associated known information and known states in other forms. In some embodiments, the perception model can also be a deep learning model, such as a convolutional neural network (CNN), deep belief networks (DBN), or a stacked auto-encoder network, etc. This application does not specifically limit the specific type of the perception model.

[0105] For example, with Figure 2 Taking the first environment as an example, the smart TV 202 transmits carrier signal A in the first time period. The router 203 or the whole-house smart host 201 receives the carrier signal A sent by the smart TV 202. The whole-house smart host 201 obtains the corresponding known information based on the carrier signal A it receives (or based on the carrier signal A received by the router 203). For example, the router 203 or the whole-house smart host 201 receives a message sent by the smart TV 202. The whole-house smart host 201 extracts the preamble from the message it receives, or the whole-house smart host 201 extracts the preamble from the message received by the router 203, or the router 203 extracts the preamble from the message. The whole-house smart host 201 obtains the preamble extracted by the router 203. The whole-house smart host 201 divides the obtained preamble by the known sequence stored locally to obtain the known information (channel state a1) corresponding to the received carrier signal A. When carrier signal A propagates in the first environment, the information (known state) of the target object in the first environment is "no target object," and the smart home control unit 201 obtains the known state corresponding to carrier signal A as "no target object exists." Correspondingly, smart curtain 204 transmits carrier signal B. When carrier signal B propagates in the first environment, the information (known state) of the target object in the first environment is "a target object exists," and the smart home control unit 201 obtains the known information (signal power b1, channel state b2) and the corresponding known state of carrier signal B as "a target object exists." Smart TV 202 transmits carrier signal C in the second time period. When carrier signal C propagates in the first environment, the information (known state) of the target object in the first environment is "the target object is located in the living room of the first environment," and the smart home control unit 201 obtains the known information (signal power c1, channel state c2, amplitude information c3) and the corresponding known state of carrier signal C as "the target object is located in the living room of the first environment."

[0106] The carrier signals A-C can be distinguished according to the device transmitting the carrier signals (e.g., carrier signals A and B), or can be distinguished according to the time of transmitting the carrier signals (e.g., carrier signals A and C) if the carrier signals are transmitted by the same device.

[0107] It can be understood that the central coordinator can also extract the payload after the preamble in the message to obtain the information of the carrier signals, and the central coordinator can also obtain the information of the carrier signals in other manners, which are not limited in the present application.

[0108] For example, the central coordinator obtains the sensing model according to the associated known information and known state, and stores the sensing model in a storage list, as shown in Table 1.

[0109] Table 1

[0110]

[0111] The information recorded in Table 1 and Table 2 is the information obtained in the first environment, that is, the sensing model includes the historical information associated with the first environment.

[0112] When the central coordinator has not obtained the sensing model, the central coordinator obtains the associated known information and known state, and adds the associated known information and known state to the storage list to obtain Table 1, thereby realizing the establishment of the sensing model. When the central coordinator has the sensing model, the central coordinator obtains the associated known information and known state, and adds the associated known information and known state to the storage list (e.g., Table 1), thereby realizing the update of the sensing model. For example, Table 1 is the sensing model already obtained by the central coordinator, and the central coordinator further obtains the known information and known state corresponding to the carrier signal D, and records the known information and known state of the first carrier signal D in Table 1, thereby realizing the update of the sensing model.

[0113] In some embodiments, the central coordinator can update the information already recorded in the storage list according to the obtained associated known information and known state, thereby realizing the update of the sensing model. For example, the central coordinator further obtains the signal power b1 and channel state b2 of the carrier signal B, and knows that the corresponding known state is that the target object is located in the living room of the first environment. The central coordinator updates Table 1 according to the newly obtained associated known information and known state as shown in Table 2, thereby realizing the update of the sensing model.

[0114] Table 2

[0115]

[0116] In the embodiments of the present application, when the perception model is implemented as a deep learning model, the central coordinator can train the deep learning model according to the obtained historical information associated with the first environment, in particular, the known information and the known state associated in the historical information associated with the first environment, for example, the deep learning model can be trained using supervised learning, and the model is trained according to the associated known information and known state to obtain the perception model.

[0117] When the central coordinator has not obtained the perception model, the central coordinator inputs the obtained historical information associated with the first environment as training data to the model to be trained to obtain the perception model. When the central coordinator has the perception model, the central coordinator inputs the obtained historical information associated with the first environment as training data to the existing perception model to continue training the existing perception model to obtain an updated perception model.

[0118] In some embodiments, the historical information associated with the first environment, i.e., the perception model, can perceive the target object according to the historical information associated with the first environment, in particular, the known information and the known state associated with each other in the historical information associated with the first environment.

[0119] In some embodiments, step S33 can be implemented as follows: the central coordinator can transmit the obtained historical information associated with the first environment to the cloud server. The cloud server obtains the perception model according to the obtained historical information associated with the first environment, and transmits the perception model to the central coordinator. The cloud server can specifically refer to the above description to process the obtained historical information associated with the first environment to obtain the perception model.

[0120] Implementing the embodiments of the present application has at least the following effects: the central coordinator obtains the associated known information and known state in response to the first input, and establishes the perception model according to the associated known information and known state. In order to quickly perceive the target object according to the perception model in the subsequent, without the need to analyze the obtained carrier signal again. For example, according to the perception model, it is known that when the information of the carrier signal is a, the information of the target object of the first environment is no one, and then when the information of the carrier signal transmitted in the environment is a in the next time, the first environment can be directly obtained according to the perception model. The target object in the first environment is no one. Wherein, the first input is not limited to the input obtained in the model acquisition stage, but also can be the input obtained in the perception stage. Further, in the process of using the perception model to perceive the target object in the first environment, the central coordinator can update the perception model in real time in response to the first input according to the obtained associated known information and known state, to improve the accuracy and efficiency of the perception model, so that the perception model has robustness.

[0121] The following specifically describes how the central coordinator obtains the historical information associated with the first environment according to the first input.

[0122] In the embodiments of the present application, the first input can indicate information related to a carrier signal being transmitted in the first environment, for example, indicating a specific carrier signal being transmitted in the first environment. When the first input indicates information related to a carrier signal being transmitted in the first environment, the central coordinator obtains information (known information) of the carrier signal (i.e. the carrier signal being transmitted in the first environment indicated by the first input), and obtains information (known state) of the target object in the first environment according to the first input, thereby obtaining known information and known state for determining the historical information associated with the first environment according to the first input.

[0123] In the embodiments of the present application, the first input can be an input generated by the organism triggering. For example, the first input is used to indicate a third carrier signal, which is a carrier signal emitted by a second node in the wired communication system (the first environment) in response to the organism triggering. The second node can be any node in the first environment.

[0124] Based on the fact that the position of the node in the wired communication system is fixed in the first environment, when the user operates the node, the node receives the triggering of the user, and the node emits a corresponding carrier signal in response to the operation of the user, it can be determined that there is a person at the position of the node, i.e. the information of the target object in the current first environment can be determined.

[0125] Specifically, taking the example that the first input is used to indicate the third carrier signal. The other nodes in the first environment receive the third carrier signal, and the other nodes report to the central coordinator that they receive the third carrier signal (e.g. report that they receive the third carrier signal emitted by the second node and the third carrier signal), or the central coordinator obtains from the other nodes that the other nodes receive the third carrier signal (or obtains information that the other nodes receive the third carrier signal emitted by the second node and the third carrier signal), then the central coordinator receives the first input. Alternatively, the central coordinator receives the third carrier signal emitted by the second node, and the central coordinator obtains the first input. After the central coordinator obtains the first input, the central coordinator obtains information associated with the third carrier signal, such as the central coordinator obtaining information of the third carrier signal received by the other nodes from the other nodes, or the central coordinator obtaining information associated with the third carrier signal according to the third carrier signal received by the central coordinator, thereby obtaining information (known information) of the carrier signal being transmitted in the first environment according to the information associated with the third carrier signal. The central coordinator obtains the attribute of the second node according to the first input, and then determines the information (known state) of the target object in the first environment according to the attribute of the second node, such as determining that there is a target object in the first environment or determining that the target object is located near the second node.

[0126] The attribute of the second node comprises one or more of the following information: spatial information of the second node in the first environment (e.g., a position of the second node in the first environment), a device type, and trigger information, wherein the device type can comprise the following two types: a first type of limiting a user to be located in a vicinity of the node to trigger (e.g., the node only provides a touch screen to interact), and a second type of not limiting the user to be located in the vicinity of the node to trigger (e.g., the node allows the user to trigger the node to emit the carrier signal through remote control), and the trigger information comprises a manner of the user interacting with the node, key triggering or remote control triggering, and the like.

[0127] Taking the attribute of the second node comprising the spatial information of the second node in the first environment (i.e., the first position information) as an example, the central coordinator obtains the first position information according to the attribute of the second node, wherein the first position information is the position information of the second node in the first environment, and then the central coordinator obtains the information of the target object in the first environment according to the first position information, such as obtaining that there is a person in the first environment and / or there is a person in the vicinity of the position of the second node.

[0128] In the embodiments of the present application, the node in the power line network emits the carrier signal in response to the operation of the living body (e.g., the user), and the carrier signal is the third carrier signal, so the node emitting the third carrier signal is the second node. The operation of the user indicates that the user is in the vicinity of the second node, and the operation of the user is, for example, clicking a physical button, opening a refrigerator door, and the like. When the second node is a smart refrigerator, the operation of the user can be opening the refrigerator door of the smart refrigerator.

[0129] The above Figure 2The first environment is shown as an example, and the second node is taken as the smart TV 202 for illustration. The user clicks the power-on button of the smart TV 202 to turn on the smart TV 202, and the smart TV 202 transmits a third carrier signal in response to the user's operation (clicking the power-on button). When the smart home master 201 receives the third carrier signal, the smart home master 201 obtains the first input. The smart home master 201 obtains information associated with the third carrier signal, such as the signal power, the channel state, the amplitude information, the phase information, the time-frequency characteristics, the signal-to-noise ratio, the transmission rate, the bit error rate, and the characteristic information described above, and further obtains known information corresponding to the third carrier signal. Alternatively, the router 203 receives the third carrier signal, and the smart home master 201 detects that the router 203 obtains the third carrier signal, and then the smart home master 201 obtains the first input. The smart home master 201 obtains known information of the third carrier signal from the router 203. The smart home master 201 obtains the position information of the second node (i.e., the node that transmits the third carrier signal) according to the third carrier signal. The smart home master 201 can obtain the position information of the smart TV 202 according to the home coordinate system or the position relationship between the devices in the first environment stored in advance. The smart home master 201 determines the position information of the smart TV 202 as the position of the current target object in the first environment, and then obtains the information of the target object in the first environment, including that the target object exists in the first environment and / or the target object is located in the area where the smart TV 202 is located in the first environment. Thus, the smart home master 201 obtains the historical information associated with the first environment according to the first input, including information associated with the third carrier signal and that the target object is located in the area where the smart TV 202 is located in the first environment. In some embodiments, when the second node detects that the user operates it and the user is located near it, the second node modulates and encodes specific information to obtain a carrier signal (i.e., the third carrier signal) in response to the user's operation, and transmits the carrier signal. When the central coordinator decodes the carrier signal to obtain the specific information, the central coordinator can determine that the received carrier signal is the third carrier signal.

[0130] In some embodiments, the specific information can be a specific identifier, and can also indicate the user's operation mode, such as a key or a remote control. For example, when the specific information is a specific identifier, the central coordinator determines that the carrier signal is the third carrier signal when the decoded specific information includes the specific identifier. For example, when the specific information indicates the user's operation mode, the central coordinator determines that the carrier signal is the third carrier signal when the decoded specific information includes that the user triggers the second node by pressing a key. Conversely, when the decoded specific information includes that the user triggers the second node by using a remote control, the central coordinator can determine that the carrier signal is not the third carrier signal.

[0131] In some embodiments, the third carrier signal can be a carrier signal obtained after a node encodes specific information (such as an audio signal or a video signal) for adjustment, and the central coordinator can determine the known state according to the node that transmits the third carrier signal. For example, a smart lamp at home only provides a button for user interaction, and the smart lamp transmits a carrier signal after receiving the operation of the user. The central coordinator determines that the received carrier signal is transmitted by the smart lamp, determines that the carrier signal is a third carrier signal based on the device type of the smart lamp, and determines that the known state is that a person is located near the smart lamp.

[0132] In the embodiments of the present application, the first input can be used to indicate the information of the target object in the first environment, that is, the first input carries the information of the target object in the first environment. When the first input indicates the information of the target object in the first environment, the central coordinator obtains the information of the target object in the first environment indicated by the first input, that is, the information of the target object in the first environment obtained when the first input is received (the known state). The central coordinator obtains the information of the carrier signal transmitted in the first environment according to the first input (the known information), thereby obtaining the known information and the known state used to determine the historical information associated with the first environment according to the first input.

[0133] In the embodiments of the present application, the first input is taken as an example of the first instruction of the user input. The central coordinator obtains the information of the target object in the first environment indicated by the first instruction (the known state), and obtains the information of the carrier signal transmitted in the first environment according to the first instruction (the known information), thereby obtaining the known state and the known information associated with each other related to the first instruction.

[0134] The user can operate an auxiliary device (such as a terminal device), and the auxiliary device receives the operation of the user and inputs the first instruction from the user to the central coordinator in response to the operation of the user. Alternatively, the user directly operates the central coordinator, and the central coordinator obtains the first instruction from the user in response to the operation of the user. Alternatively, the user can operate a node other than the central coordinator, and the node receives the operation of the user and inputs the first instruction from the user to the central coordinator in response to the operation of the user.

[0135] In some embodiments, the first input can indicate the position information of the target region and the information of the target object located in the target region, where the target region is a region included in the entire first environment or a partial region in the first environment. That is, the first input carries the position information of the target region and the information of the target object located in the target region. When the first input indicates the position information of the target region and the information of the target object located in the target region, the central coordinator obtains the position information of the target region indicated by the first input and the information of the target object located in the target region, that is, the information of the target object in the first environment (known state) obtained when the first input is received, the central coordinator obtains the information of the carrier signal transmitted in the first environment according to the first input (known information), and then obtains the associated known state and known information.

[0136] In the embodiments of the present application, when the living body inputs the first input, the first input can directly indicate the information about the target object in the first environment. For example, if there are two people in the kitchen region in the current first environment, the first input indicates that there are two people in the kitchen. Exemplarily, the first environment shown in FIG. 1 is taken as an example, and the first input is taken as the first instruction. The first instruction can indicate that there is a target object in the living room, or indicate that there are two people in the kitchen, or indicate that the target object A in the bedroom B is lying on the bed, and the like. The central coordinator obtains the information of the target object in the first environment indicated by the first instruction (known state), and the central coordinator obtains the information of the carrier signal transmitted in the target region according to the position information of the target region in the first instruction (known information). Figure 2

[0137] The following describes a scenario in which the first input is triggered by the living body.

[0138] Scenario one: After the operator (or user) completes the deployment and debugging of the power line and the node in the first environment, the operator performs training in the unmanned state, and records the information of the carrier signal in the first environment when the first environment is in the unmanned state. Specifically, the operator can input the first instruction to the central coordinator in the above manner, where the first instruction indicates that there is no target object in the current first environment, and the carrier signal transmitted in the first environment is obtained. The central coordinator obtains the information of the carrier signal transmitted in the first environment in response to the first instruction. For example, the central coordinator can control the node in the power line network to send or receive the carrier signal, so as to obtain the carrier signal transmitted in the first environment, and obtain the known information according to the obtained information of the carrier signal. The central coordinator stores the known information and the corresponding known state (no target object exists in the first environment). When the central coordinator controls the node in the power line network to send or receive the carrier signal, the control strategy of at least two nodes in the wired communication system or the power line network can be any one of single transmission and multiple reception, single transmission and single reception, or multiple transmission and multiple reception. ​

[0139] Scenario two, after the operator (or user) completes the commissioning of the power line and the nodes in the first environment, the operator conducts a training in the manned state, and records the information of the carrier signals in the first environment when the first environment is in the manned state. Specifically, the operator can input a first instruction to the central coordinator in the above manner, the first instruction indicating that the current first environment has a target object, and obtaining the carrier signals transmitted in the first environment. The central coordinator obtains the information of the carrier signals transmitted in the first environment in response to the first instruction. For example, the central coordinator can control the nodes in the power line network to send or receive the carrier signals, thereby obtaining the information (known information) of the carrier signals transmitted in the first environment. The central coordinator stores the known information and the corresponding known state (the presence of the target object).

[0140] Scenario three, the first instruction can indicate the position of the target object. The operator or user moves in different areas in the first environment, and uploads the position of the area where the operator or user is located to the central coordinator. After the central coordinator obtains the position of the area where the operator or user is located (i.e., the target area position), it obtains the information of the carrier signals transmitted in the position where the operator or user is located. For example, the central coordinator can control the nodes in the power line network to send or receive the carrier signals, thereby obtaining the information of the carrier signals transmitted in the position where the operator or user is located. Figure 2 For example, the operator is located in the dining area and inputs a first instruction to the central coordinator through an auxiliary device (such as a terminal device). The central coordinator obtains the information of the carrier signals transmitted in the dining area in response to the first instruction. For example, the whole-house smart host 201 can control the first smart lamp 211 to send a carrier signal, which can be radiated to the dining area through the power line. Then, the router 203 can obtain the carrier signal emitted by the first smart lamp 211 through air transmission and power line transmission. The whole-house smart host 201 obtains the information (known information) of the carrier signal emitted by the first smart lamp 211 received by the router 203. The central coordinator stores the known information and the corresponding known state (the presence of the target object in the dining area). In this way, after the operator moves to the living room, the operator continues to input a first instruction to the central coordinator through an auxiliary device (such as a terminal device), the first instruction indicating that the current living room has a target object. The central coordinator continues to obtain the information of the carrier signals transmitted in the living room in this way.

[0141] Scenario four, the first instruction can indicate the number of target objects. For example, Figure 2In the first environment shown as an example, the operator can input a first instruction to the central coordinator through an auxiliary device (such as a terminal device), which indicates that there are two target objects in the current dining area. The central coordinator obtains information of the carrier signals transmitted in the dining area in response to the first instruction. For example, the smart home host 201 can control the first smart lamp 211 to send a carrier signal, and the router 203 obtains the carrier signal emitted by the first smart lamp 211. The smart home host 201 obtains information (known information) of the carrier signal emitted by the first smart lamp 211 received by the router 203. The central coordinator stores the known information and the corresponding known state (there are two target objects in the dining area). The relevant information of other areas in the first environment is obtained in the same way.

[0142] In scenario five, the first instruction in scenarios one to four is input by the user in a perceptual manner, and the first instruction in scenario five can be input by the user in a non-perceptual manner. For example, Figure 2 In the first environment shown as an example, the smart home host 201 has a control interface. When the user leaves home and there is no one at home, the user operates on the control interface, such as clicking the “one-key leave home” control, and the smart home host 201 obtains the first instruction from the user. The smart home host 201 can obtain the known state (there is no target object in the current first environment) according to the first instruction. The smart home host 201 can automatically train to obtain information of the carrier signals transmitted in the first environment to record the corresponding information of the carrier signals (known objects) when there is no target object in the first environment, and then update or establish the perception model according to the obtained known information and known state.

[0143] In the embodiments of the present application, the wired communication system further includes an auxiliary device, which communicates with the first electronic device (i.e., the central coordinator), and the first electronic device obtains historical information associated with the first environment, including information of the target object in the first environment obtained from the auxiliary device. The auxiliary device can directly provide the central coordinator with information of the target object in the first environment, such as detecting that there is a target object in the area where the auxiliary device is located, and then outputting that there is a target object in the area where the auxiliary device is located to the central coordinator. The auxiliary device can also provide the data collected by it, and the central coordinator obtains the information of the target object in the first environment according to the data collected by the auxiliary device. For example, the auxiliary device is a human body detector, which outputs corresponding data to the central coordinator after detecting a human body, and the central coordinator obtains the information of the target object in the first environment according to the data output by the human body detector.

[0144] In the embodiments of the present application, the first input can be a trigger of the auxiliary device, and the first input can be used to indicate information about the target object in the first environment provided by the auxiliary device. For example, the first input includes a second instruction, where the second instruction is output by the auxiliary device when the auxiliary device detects that the target object exists in the first environment. The second instruction can indicate information about the target object in the first environment. The central coordinator obtains the information about the target object in the first environment indicated by the second instruction (known state), and obtains information about the carrier signal transmitted in the first environment according to the second instruction (known information), so as to obtain the known state and the known information related to each other and associated with the second instruction.

[0145] For example, as shown in the first environment, Figure 2 For example, as shown in the first environment, the smart door lock 209 detects that a password is input and the password input is successful, and the door lock is opened, and then the smart door lock 209 inputs a second instruction to the whole-house smart host 201, where the second instruction indicates that the target object exists in the first environment. The whole-house smart host 201 obtains the carrier signal transmitted in the first environment, for example, the whole-house smart host 201 controls the router 203 to emit the carrier signal, and the first smart lamp 211, the second smart lamp 212 and the smart television 202 all receive the carrier signal emitted by the router 203. The whole-house smart host 201 obtains information about the carrier signal emitted by the router 203 received by the first smart lamp 211, the second smart lamp 212 and the smart television 202, and obtains the known information according to the information about the carrier signal received by each node. The whole-house smart host 201 records the known information when the target object exists in the first environment.

[0146] In the embodiments of the present application, the second instruction can also include position information of the auxiliary device. The central coordinator determines the position information of the auxiliary device according to the second instruction, obtains information about the carrier signal transmitted in the area where the auxiliary device is located, and obtains the known information.

[0147] For example, as shown in the first environment, Figure 2 For example, as shown in the first environment, the camera 210 located in the porch detects that a person exists at the location of the camera 210, and then the camera 210 inputs a second instruction to the whole-house smart host 201, where the second instruction indicates that the target object exists in the area (porch) where the camera 210 is located. The whole-house smart host 201 obtains information about the carrier signal in the area (porch) where the camera 210 is located, for example, the whole-house smart host 201 controls the router 203 to emit the carrier signal, and the second smart lamp 212 receives the carrier signal emitted by the router 203. The whole-house smart host 201 obtains information about the carrier signal received by the second smart lamp 212, and obtains the known information.

[0148] In some embodiments, the central coordinator can also periodically train the perception model according to a preset period. The central coordinator acquires the carrier signals in the first environment in real time according to the preset period, and further obtains the information of the carrier signals. The central coordinator can also comprehensively consider the attributes of the devices in the wired communication system to determine whether there is a person in the first environment. The attributes of the devices also include the working state or the power-on / off state of the devices. For example, the central coordinator has the function of a hub device. When the central coordinator detects that the commonly used devices or the devices with a quantity reaching a preset threshold in the wired communication system are all in the power-off state, it is determined that there is no person in the first environment.

[0149] In some embodiments, the first input can also be an input triggered by any node in the first environment. For example, when a node in the first environment detects the information of the target object in the first environment, it transmits the detected information to the central coordinator, and the central coordinator obtains the first input. The specific content can be referred to the above-mentioned triggering of the auxiliary device. In some embodiments, the central coordinator can also acquire the carrier signals in the first environment in real time according to a preset period, and determine whether there is a person in the first environment according to the perception model. If the periodic training detects that there is a target object in the first environment, the tracking node near the position of the target object is determined, and the information of the carrier signals received by the tracking node is acquired.

[0150] The embodiments of the present application have at least the following effects: the associated first information and first state can be obtained in the case of user perception or no perception, and the perception model can be established or updated, the perception model is continuously optimized and trained, the robustness of the perception model is improved, and the accuracy and efficiency of the perception model are improved.

[0151] Perception phase

[0152] Please refer to Figure 4 for an exemplary introduction to the method for perceiving a target object provided by the embodiments of the present application.

[0153] In step S41, the central coordinator acquires the first information.

[0154] The first information is the information associated with the first carrier signal, and the first carrier signal is the carrier signal loaded on the wired link by the first node of the wired communication system or the power line network.

[0155] The first node is any one of the at least two nodes of the wired communication system or the power line network. The information associated with the first carrier signal includes the information associated with the first carrier signal received by the other nodes of the at least two nodes except the first node.

[0156] Exemplarily, the first node transmits a first carrier signal a1, the first carrier signal a1 transmitted by the first node and received by other nodes of the at least two nodes except the first node is a second carrier signal a2, and the information associated with the first carrier signal a1 includes information of the second carrier signal a2. The first carrier signal a1 is a carrier signal transmitted by the first node to other nodes in the wired communication system or the power line network, and the second carrier signal a2 is a carrier signal actually received by other nodes in the wired communication system or the power line network and transmitted by the first node. The information of the first carrier signal a1 and the information of the second carrier signal a2 can be different. For example, when the first carrier signal a1 is transmitted in the first environment, the first carrier signal a1 can be reflected, diffracted, scattered, attenuated, multi-paths, etc. due to the presence of target objects (people or objects) in the environment, so that the amplitude, phase, spectrum, etc. of the second carrier signal a2 finally received by other nodes are changed.

[0157] The information of the first carrier signal a2 can include one or more of the following: signal power of the first carrier signal a2, channel state of the first carrier signal a2, amplitude information of the first carrier signal a2, phase information of the first carrier signal a2, time-frequency characteristics of the first carrier signal a2, signal-to-noise ratio of the first carrier signal a2, transmission rate of the first carrier signal a2, bit error rate of the first carrier signal a2, and characteristic information of the first carrier signal a2. In some embodiments, the information associated with the first carrier signal can also include information of the first carrier signal. For example, as described above, the information associated with the first carrier signal a1 also includes information of the first carrier signal a1.

[0158] In the embodiments of the present application, the first information includes any one of the following information: information of the carrier signal transmitted by the first node, or information of the carrier signal transmitted by the first node and received by other nodes except the first node, or information of the carrier signal transmitted by the first node and information of the carrier signal transmitted by the first node and received by other nodes except the first node.

[0159] It can be understood that when the central coordinator obtains the information of the carrier signal transmitted in the first environment, the perception model can be established or updated according to the information of the carrier signal and the corresponding known state, and at the same time, the target object in the first environment can also be perceived according to the information of the carrier signal and the perception model (which can be the established perception model, the perception model before updating, or the perception model after updating).

[0160] The manner in which the central coordinator obtains the information associated with the first carrier signal can refer to the above-mentioned related content of obtaining the information of the carrier signal transmitted in the first environment. For example, the central coordinator can obtain the second information in response to the instruction input by the user. For example, the central coordinator can obtain the second information in response to the instruction input by the user. Figure 2As shown in the first environment, when the user comes home, the user operates the "home mode" on the operation interface of the whole-house smart host 201, and the central coordinator can obtain the instruction in response to the operation of the user, and then obtain the corresponding second information according to the obtained carrier signal. After the central coordinator obtains the second information, the central coordinator can realize the tracking of the target object (such as determining the moving track of the target object) or the confirmation of the number of target objects according to the obtained second information and the perception model.

[0161] Alternatively, the central coordinator can obtain the second information in response to the instruction sent by the auxiliary device. Exemplarily, in the first environment shown, the smart door lock 209 detects that someone inputs a password, and the password input is successful, and the door lock is opened. Then the smart door lock 209 inputs an instruction to the whole-house smart host 201, and the whole-house smart host 201 obtains the carrier signal transmitted in the first environment in response to the instruction of the smart door lock 209. For example, the whole-house smart host 201 controls the router 203 to emit a second carrier signal, and the first smart lamp 211, the second smart lamp 212 and the smart television 202 all receive the second carrier signal emitted by the router 203. The whole-house smart host 201 obtains the second carrier signal received by the first smart lamp 211, the second smart lamp 212 and the smart television 202, and obtains the corresponding second information according to the second carrier signal received by each node. After the central coordinator obtains the second information, the central coordinator can realize the tracking of the target object (such as determining the moving track of the target object) or the confirmation of the number of target objects according to the obtained second information and the perception model. Figure 2

[0162] For another example, the central coordinator can obtain the carrier signal in the first environment in real time according to a preset period, and then perceive the target object in the first environment or establish or update the perception model according to the obtained carrier signal. For example, when the user inputs a perception instruction, a preset period T can be set, and the central coordinator can perceive periodically according to the set preset period T. Specifically, the central coordinator can periodically detect whether there is a target object in the first environment according to the preset period T. If there is a target object, the tracking node near the position of the target object is determined, the second carrier signal received by the tracking node is obtained, and then the corresponding second information is obtained according to the received second carrier signal, so as to determine the information of the target object (such as determining the moving track of the target object) according to the obtained second information and the perception model in the subsequent process.

[0163] In step S42, the central coordinator determines the second information matched with the first information in the historical information associated with the first environment. The second information is the information associated with the second carrier signal obtained historically, and the information of the target object in the first environment is in a known state when the second carrier signal is transmitted in the first environment.

[0164] ​The historical information associated with the first environment includes known information and a known state corresponding to the known information (as shown in Table 1 above). The historical information associated with the first environment can refer to the related content described above, and will not be described here again. The central coordinator determines second information matching the first information in the historical information associated with the first environment, that is, the central coordinator determines the second information matching the first information according to the perception model. The perception model includes the historical information associated with the first environment.

[0165] The perception model (historical information associated with the first environment) can be stored in the first electronic device, or stored in the database corresponding to the first electronic device, or stored in the cloud server. The content of the perception model can refer to the above description, and will not be described here again.

[0166] In the embodiments of the present application, when the similarity between the second information and the first information reaches a preset threshold, it is determined that the second information matches the first information; or, when the second information is the same as the first information, it is determined that the second information matches the first information. The preset threshold can be set according to actual conditions, and the present application does not make specific limitations. The method of obtaining the similarity between the first information and the known information includes but is not limited to cosine similarity, Euclidean distance, Jaccard correlation coefficient, etc.

[0167] Specifically, obtaining the similarity between the first information and the known information includes: for each known information in the perception model, the central coordinator obtains the similarity between the first information and the known information, and when the similarity is greater than or equal to a preset threshold, the central coordinator determines that the known information matching the first information is the second information. As shown in Table 1 above, the perception model includes known information corresponding to three first carrier signals, that is, the known information includes: known information corresponding to carrier signal A (channel state a1), known information corresponding to carrier signal B (signal power b1, channel state b2), and known information corresponding to carrier signal C (signal power c1, channel state c2, amplitude information c3). When it is detected that the similarity between the first information and the known information of the carrier signal A reaches the preset threshold, it is determined that the second information matching the first information is the information of the carrier signal A. Or, when it is detected that the first information is the same as the known information corresponding to the carrier signal A, it is determined that the second information matching the first information is the known information corresponding to the carrier signal A.

[0168] In step S43, the central coordinator determines the information of the target object in the first environment when the first carrier signal is transmitted in the first environment according to the known state corresponding to the second information.

[0169] In the embodiments of the present application, when the first information matches the second information, it is determined that the information of the target object in the first environment when the first carrier signal is transmitted in the first environment is the known state corresponding to the second information. For example, when the first information matches the second information, and the known state corresponding to the second information indicates that there is no target object in the first environment, the central coordinator determines that the information of the target object in the first environment when the first carrier signal is transmitted in the first environment is that there is no target object in the first environment.

[0170] In some embodiments, when it is determined that there is a target object in the first environment, the central coordinator can obtain the information of the target object in the first environment according to the first carrier signal. For example, the central coordinator can determine the position of the target object according to the positions of the nodes that transmit and receive the first carrier signal. Specifically, there is a reflection or transmission attenuation signal conforming to the characteristics of the human body between the receiving node that receives the carrier signal and the transmitting node that transmits the carrier signal. A plurality of transmitting nodes and receiving nodes form a transceiving pair, and the position information of the target object is obtained according to the positions of the nodes in the transceiving pair and the received carrier signal. For example, as shown in the first environment, the target object is located in the living room, the router 203 transmits the carrier signal, the smart TV 202, the smart curtain 204 and the smart host 201 all receive the carrier signal transmitted by the router 203, and the smart host 201 determines that there is a target object in the living room according to the carrier signal transmitted by the router 203 and the smart TV 202 and the smart curtain 204. Figure 2

[0171] In the embodiments of the present application, when the known state corresponding to the second information indicates the position information of the target object, the central coordinator determines that the information of the target object in the first environment when the first carrier signal is transmitted in the first environment is that the target object is located at the position indicated by the known state corresponding to the second information. For example, when the known state corresponding to the second information indicates that the position information of the target object is a, it is determined that there is a target object in the first environment when the first carrier signal is transmitted in the first environment, and the target object is located at the position a. When it is determined that there is a target object in the first environment when the first carrier signal is transmitted in the first environment, the central coordinator can obtain the information of the target object in the first environment according to the first carrier signal. For example, when the known state corresponding to the second information indicates that the position information of the target object is a, the central coordinator determines the tracking node according to the position information a of the target object, and then obtains the carrier signal of the tracking node, so as to realize the continuous tracking of the target object. For example, as described in the above example, the node that receives the first carrier signal is determined, and then the position of the target object is determined according to the position of the node.

[0172] ​In some embodiments, when it is determined that the target object exists in the first environment, the central coordinator obtains a target position of the target object in the first environment, and then the central coordinator obtains a carrier signal transmitted in the target position according to the target position, and the central coordinator updates the perception model or perceives the target object according to the carrier signal transmitted in the target position.

[0173] In some embodiments, when it is determined that the target object exists in the first environment, obtaining the target position of the target object in the first environment includes: when it is detected that the user triggers the node in the wired communication system to emit the carrier signal, it is determined that the target object exists in the first environment; and the position where the node is located is taken as the target position.

[0174] In some embodiments, when the position information of the target object in the first environment is obtained according to the perception model and the second information, the carrier signal in the first environment is obtained according to the position information of the target object; and the target object is perceived according to the obtained carrier signal. Specifically, a tracking node in the first environment is determined according to the position information of the target object, where the position of the tracking node is related to the position of the target object, and the tracking node can include two or more nodes; the tracking node is controlled to emit or receive the carrier signal; and the carrier signal received by the tracking node is obtained.

[0175] In some embodiments, when the first carrier signal or the second carrier signal is transmitted, the transceiving state of at least two nodes included in the wired communication system or the power line network can be controlled to be any one of single emission and multiple reception, single emission and single reception, or multiple emission and multiple reception.

[0176] Implementing the embodiments of the present application has the following technical effects:

[0177] The target object is perceived by using the perception model, which avoids the process of analyzing the carrier signal to perceive the target object each time, reduces the amount of calculation, and improves the efficiency. In the process of perceiving the target object, the perception model can also be updated in real time, and the perception model is continuously optimized and trained, so that the perception model is more robust, and the accuracy and efficiency of the perception model are improved.

[0178] Please refer to Figure 5 for an exemplary introduction to the structure of a node provided by the embodiments. The node is a node in the power line network as shown in Figure 1 or Figure 2 . The node 500 as shown in Figure 5 is capable of performing each step in the method as shown in Figure 3 or Figure 4 . As shown in Figure 5 , the node 500 includes a processor 501, a memory 502, and a transceiving circuit 503.

[0179] The various components in the node 500 are coupled together by a bus system 504, which can include a data bus, a power bus, a control bus, and a state signal bus. For the sake of clarity, the various buses are illustrated as a single bus system 504. However, the various buses and Figure 5 can be implemented as separate busses or a combination of busses.

[0180] The method disclosed in the embodiments of the present application can be applied to the processor 501 or implemented by the processor 501. The processor 501 can be an integrated circuit chip having a signal processing capability. In the implementation process, the steps of the above method can be completed by hardware integrated logic circuit or software form of instructions in the processor 501. The processor 501 described above can be a general processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, a discrete gate or transistor logic device, a discrete hardware component. The disclosed methods, steps and logic block diagrams in the embodiments of the present application can be implemented or executed. The general processor can be a microprocessor or the processor can also be any conventional processor. The steps of the method disclosed in conjunction with the embodiments of the present application can be directly embodied as a hardware code processor for execution, or a combination of hardware and software modules in the code processor for execution. The software module can be located in a random access memory (RAM), a flash memory, a read-only memory (ROM), a programmable read-only memory or an electrically erasable programmable memory, a register, and other mature storage media in the art. The storage medium is located in the memory 502. The program stored in the storage medium includes instructions or stores the perception model for executing the method as shown in Figure 3 or Figure 4 The processor 501 reads the instructions in the memory 502 and completes the steps of the above method in combination with the hardware.

[0181] The transceiver 503 is configured to transmit or receive a carrier signal. The processor 501 is configured to acquire first information, wherein the first information is information associated with a first carrier signal, and the first carrier signal is a carrier signal loaded on a wired link by a first node of the at least two nodes; determine second information matched with the first information in historical information associated with a first environment, wherein the second information is information associated with a second carrier signal obtained historically, and information of a target object in the first environment is in a known state when the second carrier signal is transmitted in the first environment; and determine information of the target object in the first environment when the first carrier signal is transmitted in the first environment according to the known state corresponding to the second information.

[0182] Referring to Figure 6 , an example of a structure of an auxiliary device is described. Figure 6 The auxiliary device 600 shown in Figure 3 or Figure 4 is capable of performing each step of the method shown in Figure 6 . As shown in , the auxiliary device 600 includes a processor 601 and a memory 602.

[0183] Figure 6 Each component in the auxiliary device 600 is coupled together through a bus system 604, wherein the bus system 604 includes not only a data bus, but also a power bus, a control bus and a status signal bus. However, for the purpose of clarity, all kinds of buses are marked as the bus system 604 in

[0184] The method disclosed by the embodiments of the present application can be applied to the processor 601 or implemented by the processor 601. The processor 601 can be an integrated circuit chip having a signal processing capability. In the implementation process, each step of the above method can be completed by an integrated logic circuit or an instruction in the form of software in the processor 601. The processor 601 described above can be a general processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. Each method, step and logic block diagram disclosed in the embodiments of the present application can be implemented or executed. The general processor can be a microprocessor or the processor can also be any conventional processor. The steps of the method disclosed in combination with the embodiments of the present application can be directly embodied as a hardware code processor for execution, or a combination of hardware and software modules in the code processor for execution. The software module can be located in a storage medium in the art, such as a random access memory (RAM), a flash memory, a read-only memory (ROM), a programmable read-only memory or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory 602. The program stored in the storage medium includes instructions or perception models for executing the method as shown in Figure 3 or Figure 4 The processor 601 reads the instructions in the memory 602 and completes the steps of the above method in combination with the hardware thereof.

[0185] Those skilled in the art can realize that the units and algorithm steps of each example described in combination with the embodiments disclosed herein can be realized by electronic hardware or a combination of computer software and electronic hardware. Whether the functions are executed in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0186] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the system, device and unit described above can refer to the corresponding process in the foregoing method embodiments, which will not be described here.

[0187] In several embodiments provided in the present application, it should be understood that the disclosed system, device and method can be implemented in other manners. For example, the division of the units is only a logical function division, and there can be another division manner for the actual implementation, for example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the displayed or discussed mutual couplings or direct couplings or communication connections between different units, or the among different units, can be indirect couplings or communication connections through some interfaces, devices or units, and can be in electrical, mechanical or other forms.

[0188] The units described as separated components can or can not be physically separated, and the components displayed as units can or can not be physical units, i.e., can be located in one place, or can be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purposes of the embodiments of the present application.

[0189] In addition, each functional unit in the various embodiments of the present application can be integrated in one processing unit, or each unit can exist physically as a separate unit, or two or more units can be integrated in one unit.

[0190] If the functions are implemented in the form of software function units and sold or used as independent products, they can be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the present application essentially or the part that contributes to the prior art or part of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a storage medium, and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor to perform all or part of the steps of the methods in the various embodiments of the present application. The foregoing storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or optical disk, and various media that can store program codes.

[0191] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto, any changes or replacements easily thought of by those skilled in the art within the technical scope disclosed by the present application should be covered in the protection scope of the present application, therefore, the protection scope of the present application should be subject to the protection scope of the claims.

[0192] In the present application, A and B corresponding to can be understood as A and B associated, or A and B have an associated relationship. It should be understood that the modes, cases, categories and division of embodiments in the present application are only for the convenience of description, and should not constitute a special limitation. The features in various modes, categories, cases and embodiments can be combined without contradiction. It should also be understood that "first" and "second" in the embodiments of the application are only for distinction and should not constitute any limitation on the present application.

[0193] It should be understood that the term "and / or" herein merely describes the association relationship of the associated objects, which means that there can be three relationships, for example, A and / or B, which can represent the three cases of A alone, A and B together, and B alone. In addition, the character " / " herein generally represents an "or" relationship between the associated objects before and after it.

[0194] Those of ordinary skill in the art can realize that the units and algorithm steps of each example described in combination with the embodiments disclosed herein can be realized in electronic hardware, or a combination of computer software and electronic hardware. Whether the functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. A person skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application. Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the above-described system, device and unit can refer to the corresponding process in the foregoing method embodiments, which will not be described here.

[0195] In several embodiments provided in the present application, it should be understood that the disclosed system, device and method can be implemented in other ways. For example, the device embodiments described above are only schematic, and the division of units is only a logical function division, and actual implementation can have another division manner, for example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the displayed or discussed objects can be indirect coupling or communication connection through some interface, device or unit, which can be electrical, mechanical or other forms.

[0196] The units described as separate components can or can not be physically separated, and the components shown as units can or can not be physical units, that is, they can be located in one place, or they can be distributed on a plurality of network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the present embodiment.

[0197] In addition, each function unit in each embodiment of the present application can be integrated in one processing unit, or each unit can be physically present separately, or two or more units can be integrated in one unit.

[0198] If the functions are implemented in the form of software function units and sold or used as independent products, they can be stored in a computer readable storage medium. Based on this understanding, the technical solutions of the present application or the part of the present application that essentially contributes to the prior art or the part of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes a plurality of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the embodiments of the present application. The aforementioned storage medium includes a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and various media that can store program codes.

[0199] It can be understood that the various numerical numbers involved in the embodiments of the present application are only used for convenient differentiation, and are not used to limit the scope of the embodiments of the present application. The embodiments provided in the present application are not used to limit the present application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principles of the present application shall be included in the protection scope of the present application.

Claims

1. A target object perception method, characterized by, A method performed by a first electronic device, applied to a wired communication system, the wired communication system comprising at least two nodes located in a first environment, the at least two nodes being connected by a wired link, the nodes being configured to transmit or receive carrier signals, the method comprising: obtaining first information, wherein the first information is information associated with a first carrier signal, the first carrier signal being a carrier signal transmitted by a first node of the at least two nodes onto the wired link; determining second information matching the first information in historical information associated with the first environment, wherein the second information is information associated with a second carrier signal obtained historically, information of a target object in the first environment being in a known state when the second carrier signal is transmitted in the first environment; determining information of a target object in the first environment when the first carrier signal is transmitted in the first environment according to the known state corresponding to the second information.

2. The method of claim 1, wherein, The method further comprises: obtaining information of a target object in the first environment and information of a carrier signal transmitted in the first environment according to a first input, wherein the first input is triggered by a living body; wherein the obtained information of a target object in the first environment and information of a carrier signal transmitted in the first environment are used to determine the historical information associated with the first environment.

3. The method of claim 2, wherein, The first input is used to indicate a third carrier signal, the third carrier signal being a carrier signal transmitted by a second node of the wired communication system in response to the living body triggering; then the obtaining information of a target object in the first environment according to the first input comprises: obtaining an attribute of the second node according to the first input; determining information of a target object in the first environment according to the attribute of the second node.

4. The method of any one of claims 1 to 3, wherein, The wired communication system further comprises an auxiliary device, the auxiliary device being in communication with the first electronic device, and the historical information associated with the first environment comprises information of a target object in the first environment obtained from the auxiliary device.

5. The method of any one of claims 1 to 4, wherein, The nodes other than the first node of the at least two nodes are configured to receive the first carrier signal transmitted by the first node, and the information associated with the first carrier signal comprises information of the carrier signal received by the other nodes.

6. The method of claim 5, wherein, The number of the other nodes comprises one or more.

7. The method of any one of claims 1 to 6, wherein, The information of the carrier signal comprises one or more of the following: signal power, channel state, amplitude information, phase information, time-frequency feature, signal-to-noise ratio, transmission rate, bit error rate, and feature information, wherein the feature information is information obtained by feature extraction on one or more of the signal power, the channel state, the amplitude information, the phase information, the time-frequency feature, the signal-to-noise ratio, the transmission rate, and the bit error rate.

8. The method of any one of claims 1 to 7, wherein, The known state in the historical information associated with the first environment comprises one or more of the following: whether the target object exists in the first environment, a position of the target object in the first environment, a number of the target object, a posture of the target object, and a moving track of the target object.

9. The method of any one of claims 1 to 8, wherein, The wired link is a power line.

10. The method of any one of claims 1 to 9, wherein, The determining the second information matching the first information in the historical information associated with the first environment comprises: The second information is determined to match the first information when a similarity between the second information and the first information reaches a preset threshold, or the second information is determined to match the first information when the second information is identical to the first information.

11. The method of any one of claims 1 to 10, wherein, The target object is a living body or a non-living body.

12. The method of any one of claims 1 to 11, wherein, The method further comprises: updating the historical information associated with the first environment according to newly obtained information of the target object in the first environment and newly obtained information of the carrier signal transmitted in the first environment.

13. The method of any one of claims 1 to 12, wherein, The first electronic device is one of the at least two nodes.

14. A wired communication system, characterized by The wired communication system comprises a first electronic device and at least two nodes, the at least two nodes are connected through wired links to form a wired network, the first electronic device communicates with the at least two nodes, the nodes are used to transmit or receive carrier signals, and the first electronic device is used to execute the method in any one of claims 1 to 13.

15. The wired communication system of claim 14, wherein, The wired communication system further comprises at least one auxiliary device, and the auxiliary device communicates with the first electronic device.

16. A wired communication system as claimed in claim 14 or 15, characterized in that, The first electronic device accesses the wired network through a wired or wireless manner.

17. An electronic device, comprising: The electronic device comprises a memory and at least one processor, wherein the memory is used to store instructions, and the processor is used to execute the instructions to realize the method in any one of claims 1 to 13.

18. A computer-readable storage medium, characterized in that, The computer readable storage medium stores a program, and the program causes an electronic device to execute the method in any one of claims 1 to 13.

19. A computer program product, characterised in that, The computer program product comprises computer readable instructions, and when the computer readable instructions are executed by one or more processors, the method in any one of claims 1 to 13 is realized.

Citation Information

Patent Citations

  • Method and system for cross-frequency band power line carrier communication based on frequency recognition technology

    CN103457636A

  • Transformer area identification method and device, terminal equipment and storage medium

    CN113824471A