Sensing system and sensing method

Abstract

The present invention detects a body motion of a person in a building from a radio wave state in the building, and outputs information about the detected body motion in association with the individual.　A sensing system according to the present invention comprises: a transmitter that transmits wireless radio waves to a target space; a receiver that receives the wireless radio waves; an acquisition unit that acquires radio wave state information of the wireless radio waves; an apparatus search device that detects the position and apparatus identification information of a wireless portable apparatus in the target space; a detection processing unit that detects the position and a body motion of at least one target person in the target space on the basis of the radio wave state information; and a correspondence management unit that associates the body motion detected by the detection processing unit with an individual. The correspondence management unit refers to correspondence information in which apparatus identification information of the wireless portable apparatus is associated with individual identification information, and outputs information about the body motion detected by the detection processing unit as information about the individual indicated by the individual identification information associated with the apparatus identification information of the wireless portable device located closest to the target person.

Description

Sensing system and sensing method

[0001] The present invention relates to a sensing system and a sensing method.

[0002] Patent Document 1 discloses a lighting device including a lighting module, a communication device, a controller, and an uninterruptible power supply. When a normal power supply fails, the lighting device uses the communication device to identify the position of a person in a building, and communicates with the person inside the building and a third party outside the building.

[0003] Japanese National Publication of International Patent Application No. 2020-532850

[0004] The present disclosure provides a sensing system and a sensing method capable of detecting the body movement of a person in a building from the radio wave state inside the building, performing personal identification of the person, and outputting information of the detected body movement in association with the person.

[0005] One aspect of the sensing system in this disclosure includes: a transmitter that transmits radio waves into a target space; a receiver that receives the radio waves transmitted to the target space; an acquisition unit that acquires radio wave state information, which is information about the state of the received radio waves; a device search device that searches for at least one wireless portable device in the target space and detects the device identification information and location of the wireless portable device; a detection processing unit that collects the radio wave state information acquired by the acquisition unit, analyzes the radio waves based on the radio wave state information, and detects the location and physical movements of at least one subject in the target space; and a correspondence management unit that associates the physical movements detected by the detection processing unit with an individual. The correspondence management unit refers to correspondence information that associates the device identification information of the wireless portable device with personal identification information that identifies an individual, and outputs the information about the physical movements detected by the detection processing unit as information about the individual indicated by the personal identification information, which is associated with the device identification information of the wireless portable device located closest to the subject. One aspect of the sensing method in this disclosure includes: an acquisition step in which a computer of a sensing system acquires radio wave state information, which is information about the state of radio waves propagating in a target space; a device detection step in which the device identification information and location of at least one wireless portable device present in the target space are detected; a detection processing step in which the radio wave state information acquired in the acquisition step is collected, the radio waves are analyzed based on the radio wave state information, and the location and body movements of at least one subject present in the target space are detected; and a mapping step in which the body movements detected in the detection processing step are associated with an individual. In the mapping step, the mapping information is referenced, which associates the device identification information of the wireless portable device with personal identification information that identifies the individual, and the information of the body movements detected in the detection processing step is output as information about the individual indicated by the personal identification information, which is associated with the device identification information of the wireless portable device closest to the subject. This specification includes all the contents of Japanese Patent Application No. 2025-047376, filed on March 21, 2025.

[0006] The sensing system and sensing method described herein can detect the physical movements of people inside a building based on the radio wave conditions within the building, identify those individuals, and output the detected physical movement information associated with the individuals.

[0007] Figure 1 shows the configuration of the sensing system according to the embodiment. Figure 2 shows the configuration of the electrical equipment materials. Figure 3 shows the configuration of the equipment search device. Figure 4 shows the configuration of the management device. Figure 5 is a flowchart showing the operation procedure of the sensing system.

[0008] (Knowledge and other information forming the basis of this disclosure) At the time the inventors conceived this disclosure, there was a technology that equipped lighting equipment with a lighting module and a communication device, and used the communication device to identify the location of a person inside a building and communicate with the person inside the building and a third party outside the building. There was also a technology that used a Wi-Fi® router placed inside a room to transmit Wi-Fi radio waves, which were received by a Wi-Fi device inside the room, and detected the state of a person inside the room from the amplitude and phase information of the received Wi-Fi radio waves. However, detecting the state of a person using a communication device that transmits and receives Wi-Fi radio waves alone makes it difficult to manage the detected state of a person in association with an individual when there are multiple people in the space being detected or when multiple people are entering and leaving. The inventors discovered the above problem and came to form the subject of this disclosure in order to solve it. Therefore, this disclosure provides a sensing system and sensing method that can detect the physical movements of a person inside a building from the radio wave conditions inside the building, identify that person personally, and output the detected physical movement information in association with the individual.

[0009] The embodiments will be described in detail below with reference to the drawings. However, some descriptions may be omitted to avoid unnecessary detail. For example, detailed explanations of already well-known matters or redundant explanations of substantially identical configurations may be omitted. The accompanying drawings and the following description are provided to enable those skilled in the art to fully understand this disclosure and are not intended to limit the subject matter described in the claims.

[0010] (Embodiment) The embodiment will be described below with reference to Figures 1 to 5. [1. Configuration of the Sensing System] Figure 1 is a diagram showing the configuration of the sensing system 1 according to the embodiment. The sensing system 1 detects the physical movements of a person in the target space S, which is a space within a building H, from the propagation state of radio waves in the target space S, identifies the person personally, and outputs the detected physical movement information associated with the person. The target space S may be a closed space surrounded by walls and a ceiling, or it may be a space with open doors, windows, etc. Furthermore, the use of the target space S is not limited. For example, the target space S may be a living space, a living space, a business space such as an office, or a space used for other purposes.

[0011] Sensing system 1 detects the physical movements of at least one person present in the target space S. Hereinafter, the person whose physical movements are detected by sensing system 1 will be referred to as target person P. Here, physical movements refer to all movements of target person P's body, and may include, for example, the posture of target person P's body, joint movements, chest movements associated with heartbeat and breathing, and eye and mouth movements.

[0012] In the example shown in Figure 1, the target space S is divided into target space S1, which is a passageway extending vertically through the center of the diagram, and five target spaces S2, S3, S4, S5, and S6. Target spaces S2, S3, S4, and S5 are living rooms, and target space S6 is an entrance hall with a door DR. In addition, in the example shown in Figure 1, there are target persons P1, P2, P3, and P4 in target spaces S3, S4, S5, and S6, respectively. Target person P4 is, for example, a person who entered target space S6 through door DR.

[0013] The sensing system 1 comprises at least one electrical equipment 3, an equipment locator 4, and a management device 5.

[0014] The device search device 4 searches for at least one wireless portable device M present in the target space S and detects the device identification information and location of the wireless portable device M. The wireless portable device M can be any portable device that has device identification information and can perform wireless communication, such as a smartphone or a smartwatch. In this embodiment, as an example, the device search device 4 is an access point device that constructs a wireless LAN in the target space S, and the wireless portable device M is a Wi-Fi device. This makes it possible to easily detect the location and device identification information of the wireless portable device M in the target space using the access point device.

[0015] In the example shown in Figure 1, there are no wireless portable devices in target spaces S1 and S2, but there is a wireless portable device M1 in target space S3, a wireless portable device M2 in target space S4, and a wireless portable device M3 in target space S5. In addition, subject P4 is in possession of a wireless portable device M4 in target space S6.

[0016] Electrical equipment 3 may be switches, outlets, and other power wiring components. Alternatively, electrical equipment 3 may be ventilation fans, lighting fixtures, intercoms, and other power-consuming devices. Or, electrical equipment 3 may be distribution boards, building energy management devices, and other power control equipment.

[0017] In this embodiment, the electrical equipment 3 is equipped with a detection unit 32 (described later) that has a Wi-Fi sensing function. The detection unit 32 transmits and receives Wi-Fi radio waves and acquires radio wave state information, which is information about the state of Wi-Fi radio waves propagating within the target space S.

[0018] In the example shown in Figure 1, the sensing system 1 includes electrical equipment 3a, 3b, 3c, 3d, and 3e, which are arranged in the target spaces S2, S3, S4, S5, and S6, respectively. In this embodiment, electrical equipment 3a, 3b, 3c, 3d, and 3e are outlets arranged in the target spaces S2, S3, S4, S5, and S6, respectively. Electrical equipment 3a, 3b, 3c, 3d, and 3e each acquire radio wave state information of radio waves in the target space S using their respective detection units 32.

[0019] Each electrical equipment 3 transmits detected radio wave status information to the management device 5 via Wi-Fi communication through the equipment finder 4, which is an access point device. The electrical equipment 3 may also transmit the detected radio wave status information to the management device 5 via wired communication. The wired communication may be, for example, power line communication (PLC) via a power supply line (not shown) connected to the electrical equipment 3 and the management device 5.

[0020] The management device 5 detects the individual body movements and positions of the subject P from the radio wave condition information acquired by each electrical equipment 3, and outputs the detected body movement information associated with the individual. The output destination is, for example, a management server SS located outside the target space S. The management server SS acquires the body movement information associated with the individual from the sensing system 1 and stores the body movement information for each individual. The management server SS transmits the stored individual body movement information to a predetermined terminal device. The terminal device may be, for example, the individual's wireless portable device, or a terminal device of the administrator who manages the individual's health.

[0021] [2. Configuration of Electrical Equipment] Figure 2 shows an example of the configuration of the electrical equipment 3. The electrical equipment 3 has an equipment function unit 31 and a detection unit 32. The equipment function unit 31 is the element that allows the electrical equipment 3 to perform its original function as electrical equipment, and is configured according to known technology. For example, when the electrical equipment 3 is an outlet, the equipment function unit 31 is the functional part of the outlet, and when the electrical equipment 3 is a switch, the equipment function unit 31 is the functional part of the switch. In this embodiment, as an example, the electrical equipment 3 is an outlet, and the equipment function unit 31 is configured according to known technology, with blade receiving fittings for receiving the blades of a plug of a load device (not shown) arranged inside an insulating case.

[0022] The detection unit 32 includes a first control device 33, a first transmitter 34, a first receiver 35, and a first array antenna 36. The first transmitter 34 transmits radio waves of a predetermined frequency band to the target space S using the first array antenna 36. The first receiver 35 receives the radio waves of the predetermined frequency band transmitted to the target space S via the first array antenna 36. In this embodiment, the radio waves of the predetermined frequency band may be radio waves of the frequency band used in wireless Wi-Fi (hereinafter also referred to as Wi-Fi radio waves).

[0023] The first array antenna 36 may be configured as a single element in which multiple antenna elements are arranged in a line or grid. These antenna elements may be, for example, chip antennas, microstrip antennas, etc. The first array antenna 36 allows the first transmitter 34 to transmit directional radio waves in various directions within the target space S. The first receiver 35 can receive radio waves from each of the antenna elements of the first array antenna 36.

[0024] The first control device 33 is a computer comprising a first processor 330 and a first memory 331. The first memory 331 is composed of, for example, a volatile and / or non-volatile semiconductor memory.

[0025] The first processor 330 is, for example, an arithmetic processing unit such as a CPU. The first processor 330 may have a configuration that includes a ROM on which a program is written, a RAM for temporary data storage, etc. The first processor 330 includes a first communication control unit 333 and an acquisition unit 334 as functional elements or functional units.

[0026] These functional elements of the first processor 330 are realized, for example, by the first processor 330 of the first control device 33, which is a computer, reading and executing the first program 332 stored in the first memory 331. The first program 332 can be stored in any storage medium that is readable by a computer. Alternatively, all or part of the functional elements of the first processor 330 can be configured by hardware, each including one or more electronic circuit components.

[0027] The first communication control unit 333 instructs the first transmitter 34 to transmit radio waves in one or more directions toward the target space S via the first array antenna 36. The first communication control unit 333 also instructs the first receiver 35 to receive radio waves from the first array antenna 36. As described above, in this embodiment, the radio waves are Wi-Fi radio waves. The first communication control unit 333 may perform Wi-Fi communication using the first transmitter 34 and the first receiver 35 in accordance with the Wi-Fi communication standard. This allows the acquisition unit 334, which will be described later, to transmit the acquired radio wave status information to the management device 5.

[0028] The acquisition unit 334 acquires radio wave state information, which is information about the state of radio waves received by the first receiver 35. The radio wave state information may include, for example, amplitude and / or phase information of radio waves received by each antenna element of the first array antenna 36. In this embodiment, the radio wave state information may be channel state information (CSI) acquired based on Wi-Fi radio waves, which are radio waves received by the first receiver 35. The acquisition unit 334 transmits the acquired radio wave state information to the management device 5 and provides it to the detection processing unit 514 (described later).

[0029] Here, the acquisition unit 334 may store each acquired radio wave condition information data in a time series in the first memory 331 or the like. The acquisition unit 334 may calculate a moving average value for each radio wave condition information data from the present to a predetermined time in the past, and transmit the dataset composed of the above moving average values ​​for each data to the management device 5 as the current radio wave condition information. This reduces the noise contained in the radio wave condition information.

[0030] [3. Configuration of the Device Finder] The device finder 4 searches for at least one wireless portable device M present in the target space S and detects the device identification information and location of the wireless portable device M. The device finder 4 is, for example, an access point device that can construct a wireless LAN using wireless Wi-Fi communication and find wireless portable devices M connected to the constructed wireless LAN. However, the access point device is just one example of the device finder 4, and the device finder 4 is not limited to an access point device, but can be any communication device that can search for at least one wireless portable device M present in the target space S and detect the device identification information and location of the wireless portable device M. The device identification information of the wireless portable device M is, for example, the MAC (Media Access Control) address of the wireless portable device M.

[0031] Figure 4 shows the configuration of the device locator 4. The device locator 4 comprises a second control device 41, a second transmitter 42, a second receiver 43, and a second array antenna 44. The second transmitter 42 transmits radio waves of a predetermined frequency band to the target space S via the second array antenna 44. The second receiver 43 receives radio waves of the same predetermined frequency band from surrounding wireless portable devices M via the second array antenna 44. In this embodiment, the radio waves of the predetermined frequency band are Wi-Fi radio waves.

[0032] The second array antenna 44 is composed of multiple antenna elements. Antennas of various sizes can be used for the antenna elements depending on design requirements such as the size of the housing of the equipment search device 4 and the radio wave range. The second array antenna 44 allows the second transmitter 42 to transmit directional radio waves to the target space S in various directions. In addition, the second receiver 43 can receive radio waves arriving from various directions by the second array antenna 44, using beamforming technology in accordance with prior art.

[0033] As a result, the device search device 4, which is an access point device equipped with a second array antenna 44, can accurately detect the location of the wireless portable device M within the target space S.

[0034] The second control device 41 is a computer comprising a second processor 410 and a second memory 411. The second memory 411 is composed of, for example, a volatile and / or non-volatile semiconductor memory.

[0035] The second processor 410 is, for example, an arithmetic processing unit such as a CPU. The second processor 410 may have a configuration that includes a ROM on which a program is written, a RAM for temporary data storage, etc. The second processor 410 includes, as a functional element or functional unit, a second communication control unit 413, a detection unit 414, and a providing unit 415.

[0036] These functional elements of the second processor 410 are realized, for example, by the second processor 410 of the second control unit 41, which is a computer, reading and executing the second program 412 stored in the second memory 411. The second program 412 can be stored in any storage medium that is readable by a computer. Alternatively, all or part of the functional elements of the second processor 410 can be configured by hardware, each including one or more electronic circuit components.

[0037] The second communication control unit 413 controls the second transmitter 42 and the second receiver 43 to realize communication functions specific to the device search device 4. At that time, the second communication control unit 413 instructs the second transmitter 42 to transmit radio waves in one or more directions toward the target space S via the second array antenna 44. The second communication control unit 413 also instructs the second receiver 43 to receive radio waves from the second array antenna 44.

[0038] As described above, since the device search device 4 of the embodiment is an access point device, the second communication control unit 413, in accordance with the prior art, provides, for example, a wireless LAN within the target space S and interconnects the wired LAN outside the target space S with the wireless LAN as its unique communication function.

[0039] The detection unit 414 searches for at least one wireless portable device M present in the target space S and detects the device identification information and location of the wireless portable device M. The detection unit 414, for example, instructs the second communication control unit 413 to have the second transmitter 42 periodically transmit beacon frames into the target space S. Subsequently, the detection unit 414 receives probe requests received by the second receiver 43 from the wireless portable device M in the target space S via the second communication control unit 413. The detection unit 414 obtains the MAC address of the source wireless portable device M included in the received probe request as device identification information.

[0040] Furthermore, the detection unit 414 instructs, for example, the second communication control unit 413 to have the second receiver 43 receive probe requests (i.e., probe requests containing the same MAC address) arriving from multiple directions within the target space S, with emphasis using beamforming technology. The detection unit 414 can then detect the location of the wireless mobile device M using algorithms such as MUSIC (Multiple Signal Classification) or ESPRIT (Estimation of Signal Parameters via Rotational Invariance Techniques), in accordance with prior art.

[0041] In response to receiving an information request from the management device 5 via the second receiver 43 and the second communication control unit 413, the providing unit 415 transmits the device identification information and location of each wireless portable device M detected by the detection unit 414 to the management device 5 via the second communication control unit 413 and the second transmitter 42.

[0042] [4. Configuration of Management Device] The management device 5 outputs the body movements detected by the electrical installation material 3 in association with individuals. FIG. 5 is a diagram showing the configuration of the management device 5. The management device 5 includes a third control device 51 and a communicator 52. The communicator 52 is a transmitter-receiver for performing wireless communication with the device search device 4, which is an access point device. The communicator 52 may include a transmitter-receiver for directly communicating with the electrical installation material 3 via wired communication or wireless communication. As described above, the wired communication may be, for example, power line communication (PLC).

[0043] The third control device 51 is a computer including a third processor 510 and a third memory 511. The third memory 511 is composed of, for example, volatile and / or non-volatile semiconductor memory. Correspondence information 512 that associates device identification information of the wireless portable device M with personal identification information that identifies an individual is stored in advance in the third memory 511. As described above, the device identification information is, for example, a MAC address. The personal identification information is, for example, a personal ID that is an identification code assigned to each individual in advance. The personal ID can be associated with a combination of a specific individual's name and supplementary information (e.g., facial photograph, date of birth, address, etc.).

[0044] The third processor 510 is, for example, an arithmetic processing device such as a CPU. The third processor 510 may be configured to include a ROM in which a program is written, a RAM for temporary storage of data, and the like. The third processor 510 includes, as functional elements or functional units, a detection processing unit 514 and a correspondence management unit 515.

[0045] These functional elements included in the third processor 510 are realized, for example, by the third processor 510 of the third control device 51, which is a computer, reading and executing the third program 513 stored in the third memory 511. The third program 513 can be stored in any computer-readable storage medium. Alternatively, all or part of the functional elements included in the third processor 510 may be configured by hardware including one or more electronic circuit components, respectively.

[0046] The detection processing unit 514 collects radio wave state information from each electrical installation material 3. Based on the collected radio wave state information, the detection processing unit 514 analyzes the radio waves received by each electrical installation material 3, and detects the position and body movement of the subject P existing in the target space S. In the example shown in FIG. 1, the detection processing unit 514 detects the position and body movement of the subject P1 in the target space S3, the subject P2 in the target space S4, the subject P3 in the target space S5, and the subject P4 in the target space S6, respectively, based on the radio wave state information from the electrical installation materials 3a, 3b, 3c, 3d, and 3e.

[0047] Specifically, based on the collected radio wave state information, the detection processing unit 514 analyzes the amplitude and / or phase state of the radio waves received by the first receiver 35 of each electrical installation material 3, and estimates the position and body movement of the subject P existing in the target space S.

[0048] Alternatively, the detection processing unit 514 may detect the position and body movement of the subject P existing in the target space S by using an estimation model obtained by machine-learning the relationship between the radio wave state information provided from each electrical installation material 3 and the position and body movement of the subject P existing in the target space S. The machine learning can be performed using a method such as deep learning, for example. This makes it possible to detect the position and body movement of the subject P with higher accuracy and more easily by using an estimation model obtained by machine-learning the relationship between the radio wave state information with a large amount of information and the detailed position and body movement of the subject P.

[0049] The detection processing unit 514 may store each data of the radio wave state information provided from each electrical installation material 3 in time series for each electrical installation material 3. The detection processing unit 514 may extract a changed area in the target space S from time-series changes in each data of the radio wave state information, and detect the position and body movement of the subject P. This allows processing for detection to be performed focusing only on the changed area in the target space S, so that faster detection can be achieved.

[0050] The detection processing unit 514 may also store in advance reference channel information in the third memory 511 or the like the radio wave state information of each electrical equipment 3 when no subject P is present in the target space S. The detection processing unit 514 can detect the position and physical movements of subject P present in the target space S using the difference between the current radio wave state information collected from each electrical equipment 3 and the reference channel information.

[0051] Alternatively, the arrangement of each electrical equipment 3 in the target space S may be known in advance during construction, and the arrangement information of each electrical equipment 3 in the target space S may be stored in the third memory 511 in advance. The detection processing unit 514 can use the above arrangement information as additional information indicating the location of the radio wave transmission source to detect the position and physical movements of the subject P. This allows the detection processing unit 514 to further improve the accuracy of detecting the position and physical movements of the subject P.

[0052] The response management unit 515 associates the physical movements detected by the detection processing unit 514 with individuals. Specifically, the response management unit 515 obtains the location and device identification information of each wireless portable device M present in the target space S from the device search device 4. The response management unit 515 also identifies the device identification information of the wireless portable device M located closest to the location of each target person P detected by the detection processing unit 514. The response management unit 515 also refers to the correspondence information 512 stored in the third memory 511 and identifies the personal identification information associated with the device identification information of the wireless portable device M located closest to the location of the target person P as the personal identification information of that target person P. The response management unit 515 then outputs the physical information of each target person P detected by the detection processing unit 514 to the management server SS as information about the individual indicated by the personal identification information identified for each target person P.

[0053] This allows for the detection of a person P's physical movements from the radio wave conditions of the target space S, while simultaneously identifying the person P based on a nearby wireless portable device M, and outputting the detected physical movement information associated with the individual.

[0054] The response management unit 515 may identify the wireless portable device M closest to the target person P by using the average value of the distance between the wireless portable device M and the target person P over a predetermined time period. That is, the response management unit 515 acquires the device identification information and location of the wireless portable device M from the device search device 4 at predetermined time intervals over a predetermined period of a predetermined time length. The response management unit 515 then identifies the device identification information of the wireless portable device M whose average distance from the target person P was the shortest over the predetermined period. The response management unit 515 then refers to the response information 512 and identifies the personal identification information associated with the device identification information of the wireless portable device M whose average distance from the target person P was the shortest over the predetermined period. The response management unit 515 may then output the information on the physical movements acquired by the detection processing unit 514 for the target person P to the management server SS as information about the person indicated by the identified personal identification information.

[0055] This allows for the proper correspondence between each subject P and the wireless portable device M, even when the positions of multiple subjects P within the target space S move and temporarily switch places, enabling the output of information on physical movements associated with the appropriate individual.

[0056] [5. Operation of the Sensing System] Next, the operation of the sensing system 1 will be described. Figure 5 is a flowchart showing the processing steps of the sensing method performed by the sensing system 1. The processing shown in Figure 5 is performed by the first control device 33, the second control device 41, and the third control device 51, which are provided in the electrical equipment 3, the equipment locator 4, and the management device 5, which are the computers that make up the sensing system 1. The processing shown in Figure 5 starts when the power to the electrical equipment 3, the equipment locator 4, and the management device 5 is turned on, and is repeatedly performed until the power to any of them is turned off.

[0057] When processing begins, first, the acquisition unit 334 of the first control device 33 of each electrical equipment 3 acquires radio wave state information, which is information about the state of radio waves in the target space S received by the first receiver 35 of each electrical equipment 3 (S100). The acquisition unit 334 of the first control device 33 of each electrical equipment 3 transmits the acquired radio wave state information to the management device 5. In addition, the detection unit 414 of the second control device 41 of the equipment search device 4 detects the equipment identification information and location of at least one wireless portable device M present in the target space S (S102). The provision unit 415 of the second control device 41 of the equipment search device 4 transmits the equipment identification information and location information of the detected wireless portable device M to the management device 5.

[0058] Next, the detection processing unit 514 of the third control device 51 of the management device 5 collects radio wave condition information from the electrical equipment 3, analyzes the radio waves based on the radio wave condition information, and detects the position and physical movements of at least one subject P present in the target space S (S104). The corresponding management unit 515 of the third control device 51 of the management device 5 identifies the device identification information of the wireless portable device M that is closest to the position of the subject P detected by the detection processing unit 514 (S106).

[0059] Furthermore, the correspondence management unit 515 refers to correspondence information 512, which is pre-stored in the third memory 511 and associates the device identification information of the wireless portable device M with personal identification information that identifies an individual, and identifies the personal identification information associated with the device identification information of the wireless portable device M that is closest to the location of the identified target person P as the personal identification information of that target person P (S108). Then, the correspondence management unit 515 outputs the physical information of the target person P detected by the detection processing unit 514 to the management server SS as information about the individual indicated by the personal identification information identified for that target person P (S110), and terminates this process. After the completion of this process, a new process starts from step S100.

[0060] In Figure 5, steps S100, S102, and S104 correspond to the acquisition step, device detection step, and detection processing step in this disclosure, respectively. Steps S106, S108, and S110 correspond to the mapping step in this disclosure.

[0061] (Other Embodiments) In the embodiment described above, as an example, the first transmitter 34, the first receiver 35, and the acquisition unit 334 constituting the sensing system 1 are provided on the electrical equipment 3. Alternatively, at least one of the first transmitter 34 and the first receiver 35 may be provided on the electrical equipment 3. The first communication control unit 333 of the first control device 33 is divided into a functional part related to the first transmitter 34 and a functional part related to the first receiver 35, and the processors constituting each functional part may be provided on the electrical equipment 3 or other equipment equipped with the first transmitter 34, and on the electrical equipment 3 or other equipment equipped with the first receiver 35, respectively. Furthermore, the acquisition unit 334 may be provided on the processor of the electrical equipment 3 equipped with the first receiver 35, or on the processor of other equipment different from the electrical equipment 3 that can communicate with the first receiver 35.

[0062] In the embodiment described above, as an example, the electrical equipment 3 constituting the sensing system 1 is an electrical outlet. In other embodiments, the electrical equipment 3 may have any other function, such as a switch or lighting fixture as exemplified above. Electrical equipment having any of these functions can also become electrical equipment 3 constituting the sensing system 1 by mounting the detection unit 32 described above.

[0063] In the sensing system 1, the arrangement of electrical equipment 3, equipment search device 4, and management device 5 in the target space S is arbitrary as long as radio waves can be transmitted and received. However, from the viewpoint of not creating undetected areas in the target space S, it is preferable that the electrical equipment 3 be distributed within the target space S.

[0064] In the above-described embodiment, the detection processing unit 514 and the corresponding management unit 515 are provided by the management device 5, but they may also be provided by other devices. For example, the equipment search device 4 or any of the electrical equipment materials 3 may be equipped with the detection processing unit 514 and the corresponding management unit 515.

[0065] [6. Effects, etc.] As described above, the sensing system 1 includes a first transmitter 34, a first receiver 35, an acquisition unit 334, a device search device 4, and a management device 5. The first transmitter 34 transmits radio waves to the target space S, and the first receiver 35 receives the radio waves transmitted to the target space S. The acquisition unit 334 acquires radio wave state information, which is information about the state of the radio waves received by the first receiver 35. The device search device 4 searches for at least one wireless portable device M present in the target space S and detects the device identification information and location of the wireless portable device M. The management device 5 includes a detection processing unit 514 and a corresponding management unit 515. The detection processing unit 514 collects radio wave state information from the electrical equipment 3, analyzes the radio waves based on the radio wave state information, and detects the location and physical movements of at least one target person P present in the target space S. The corresponding management unit 515 associates the physical movements detected by the detection processing unit 514 with individuals. The correspondence management unit 515 refers to correspondence information 512, which associates the device identification information of the wireless portable device M with personal identification information that identifies an individual, and outputs the information of the body movement detected by the detection processing unit 514 as information about the individual indicated by the personal identification information, which is associated with the device identification information of the wireless portable device M located closest to the target person P. This makes it possible to detect the body movement of the target person P from the radio wave conditions of the target space S, identify the target person P based on the wireless portable device M near the target person P, and output the detected body movement information associated with the individual.

[0066] At least one of the first transmitter 34 and the first receiver 35 is provided on the electrical equipment 3. This allows the first transmitter 34 and / or the first receiver 35 to be easily arranged within the target space S.

[0067] The device search device 4 may be, for example, an access point device that establishes a wireless LAN within the target space S. This allows for easy detection of the location and device identification information of wireless portable devices M within the target space S using the access point device.

[0068] Furthermore, the access point device, which is the device search device 4, may also be equipped with a second array antenna 44. With this configuration, the location of the wireless portable device M within the target space S can be accurately detected using the access point device equipped with the second array antenna 44.

[0069] Furthermore, the response management unit 515 may acquire the device identification information and location of the wireless portable device M from the device search device 4 at predetermined time intervals over a predetermined period of time. Based on the location of the wireless portable device M acquired at predetermined time intervals, the response management unit 515 can identify the personal identification information associated with the device identification information of the wireless portable device M that had the shortest average distance from the target person P during the predetermined period. The response management unit 515 can then output the information of the body movement detected by the detection processing unit 514 as information about the individual indicated by the identified personal identification information. This allows for the appropriate association between each target person P and the wireless portable device M, and thus the appropriate identification of each target person P, even if the locations of multiple target people P within the target space S temporarily change.

[0070] Furthermore, the sensing system 1 performs a sensing method. The sensing method includes an acquisition step, a detection processing step, a device detection step, and a mapping step. In the acquisition step, radio waves transmitted within the target space S are received, and radio wave state information, which is information about the state of the received radio waves, is acquired (S100). In the device detection step, the device identification information and location of at least one wireless portable device M present in the target space S are detected (S102). In the detection processing step, the radio wave state information acquired in the acquisition step is collected, and the radio waves are analyzed based on the radio wave state information to detect the location and body movements of at least one subject P present in the target space S (S104). In the mapping step, the body movements detected in the detection processing step are mapped to individuals. Specifically, in the mapping step, the device identification information of the wireless portable device M closest to the subject P is identified (S106). Furthermore, in the mapping step, the mapping information 512, which maps the device identification information of the wireless portable device M to personal identification information that identifies an individual, is referenced, and the personal identification information mapped to the device identification information of the wireless portable device M located closest to the target person P is identified (S108). Then, in the mapping step, the information of the body movements detected in the detection processing step is output as information about the individual indicated by the personal identification information mapped to the device identification information of the wireless portable device M located closest to the target person P (S110). This makes it possible to detect the body movements of the target person P from the radio wave conditions of the target space S, identify the target person P based on the wireless portable device M located near the target person P, and output the detected body movement information mapped to the individual.

[0071] Since the embodiments described above are for illustrative purposes of the technology described herein, various modifications, substitutions, additions, omissions, etc., can be made within the scope of the claims or equivalents thereof.

[0072] (Note) The above description of embodiments discloses the following technology.

[0073] (Technology 1) A sensing system comprising: a transmitter that transmits radio waves into a target space; a receiver that receives the radio waves transmitted to the target space; an acquisition unit that acquires radio wave state information, which is information about the state of the received radio waves; a device search device that searches for at least one wireless portable device present in the target space and detects the device identification information and location of the wireless portable device; a detection processing unit that collects the radio wave state information acquired by the acquisition unit, analyzes the radio waves based on the radio wave state information, and detects the location and physical movements of at least one subject present in the target space; and a correspondence management unit that associates the physical movements detected by the detection processing unit with an individual, wherein the correspondence management unit refers to correspondence information that associates the device identification information of the wireless portable device with personal identification information that identifies an individual, and outputs the information of the physical movements detected by the detection processing unit as information about the individual indicated by the personal identification information, which is associated with the device identification information of the wireless portable device located closest to the subject. This configuration allows for the detection of a person's physical movements from the radio wave conditions in the target space, while simultaneously identifying the person based on a wireless portable device near them, and outputting the detected physical movement information associated with the individual.

[0074] (Technology 2) The sensing system according to Technology 1, wherein at least one of the transmitter and the receiver is provided on electrical equipment. With this configuration, at least one of the first transmitter and the first receiver can be easily placed within the target space.

[0075] (Technology 3) The sensing system according to Technology 1 or 2, wherein the device search device is an access point device that establishes a wireless LAN within the target space. With this configuration, the location and device identification information of wireless portable devices within the target space can be easily detected using the access point device.

[0076] (Technical 4) The device search device, which is an access point device, is a sensing system as described in Technical 3, comprising an array antenna. With this configuration, the location of a wireless portable device within a target space can be accurately detected using an access point device equipped with an array antenna.

[0077] (Technology 5) The sensing system according to any one of Techniques 1 to 4, wherein the corresponding management unit acquires the device identification information and location of the wireless portable device from the device search device at predetermined time intervals over a predetermined period of a predetermined time length, identifies the personal identification information associated with the device identification information of the wireless portable device that had the shortest average distance from the target person during the predetermined period based on the location of the wireless portable device acquired at the predetermined time interval, and outputs the information of the body movement detected by the detection processing unit as information about the person indicated by the identified personal identification information. With this configuration, even if the locations of multiple target persons in the target space change temporarily, the correspondence between each target person and the wireless portable device can be appropriately performed, and the personal identification of the target person can be appropriately performed.

[0078] (Technology 6) A sensing method performed by a computer of a sensing system, comprising: an acquisition step of acquiring radio wave state information, which is information about the state of radio waves propagating in a target space; a device detection step of detecting the device identification information and location of at least one wireless portable device present in the target space; a detection processing step of collecting the radio wave state information acquired in the acquisition step, analyzing the radio waves based on the radio wave state information, and detecting the location and body movements of at least one subject present in the target space; and a mapping step of associating the body movements detected in the detection processing step with an individual, wherein the mapping step refers to mapping information that associates the device identification information of the wireless portable device with personal identification information that identifies the individual, and outputs the information of the body movements detected in the detection processing step as information about the individual indicated by the personal identification information, which is associated with the device identification information of the wireless portable device closest to the subject. This configuration produces the same effects as Technology 1.

[0079] As described above, the sensing system and sensing method related to this disclosure can be used for the purpose of outputting human body movements detected from radio wave conditions inside a building, in association with individual individuals.

[0080] 1 Sensing System 3, 3a, 3b, 3c, 3d, 3e Electrical Equipment 4 Equipment Search Device 5 Management Device 31 Equipment Function Unit 32 Detection Unit 33 First Control Device 34 First Transmitter 35 First Receiver 36 First Array Antenna 41 Second Control Device 42 Second Transmitter 43 Second Receiver 44 Second Array Antenna 51 Third Control Device 52 Communication Device 330 First Processor 331 First Memory 332 First Program 333 First Communication Control Unit 334 Acquisition Unit 410 Second Processor 411 Second Memory 412 Second Program 413 Second Communication Control Unit 414 Detection Unit 415 Provision Unit 510 Third Processor 511 Third Memory 512 Corresponding Information 513 Third Program 514 Detection Processing Unit 515 Corresponding Management Unit DR Door H Building M, M1, M2, M3, M4 Wireless mobile device NW Communication network P, P1, P2, P3, P4 Target audience S, S1, S2, S3, S4, S5, S6 Target space SS Management server

Claims

1. A sensing system comprising: a transmitter that transmits radio waves into a target space; a receiver that receives radio waves transmitted to the target space; an acquisition unit that acquires radio wave state information, which is information about the state of the received radio waves; a device search device that searches for at least one wireless portable device in the target space and detects the device identification information and location of the wireless portable device; a detection processing unit that collects the radio wave state information acquired by the acquisition unit, analyzes the radio waves based on the radio wave state information, and detects the location and physical movements of at least one subject in the target space; and a correspondence management unit that associates the physical movements detected by the detection processing unit with an individual, wherein the correspondence management unit refers to correspondence information that associates the device identification information of the wireless portable device with personal identification information that identifies the individual, and outputs the information of the physical movements detected by the detection processing unit as information about the individual indicated by the personal identification information, which is associated with the device identification information of the wireless portable device located closest to the subject.

2. The sensing system according to claim 1, wherein at least one of the transmitter and the receiver is provided on electrical equipment.

3. The sensing system according to claim 1, wherein the device locator is an access point device that establishes a wireless LAN within the target space.

4. The sensing system according to claim 3, wherein the access point device, which is the device locator, comprises an array antenna.

5. The sensing system according to any one of claims 1 to 4, wherein the corresponding management unit acquires the device identification information and location of the wireless portable device from the device search device at predetermined time intervals over a predetermined period of a predetermined time length, identifies the personal identification information associated with the device identification information of the wireless portable device that had the shortest average distance from the target person during the predetermined period, based on the location of the wireless portable device acquired at the predetermined time interval, and outputs the information of the body movement detected by the detection processing unit as information about the person indicated by the identified personal identification information.

6. A sensing method performed by a computer of a sensing system, comprising: an acquisition step of acquiring radio wave state information, which is information about the state of radio waves propagated in a target space; a device detection step of detecting the device identification information and location of at least one wireless portable device present in the target space; a detection processing step of collecting the radio wave state information acquired in the acquisition step, analyzing the radio waves based on the radio wave state information, and detecting the location and body movements of at least one subject present in the target space; and a mapping step of associating the body movements detected in the detection processing step with an individual, wherein the mapping step refers to mapping information that associates the device identification information of the wireless portable device with personal identification information that identifies the individual, and outputs the information of the body movements detected in the detection processing step as information about the individual indicated by the personal identification information, which is associated with the device identification information of the wireless portable device located closest to the subject.

Images