Inference system

Abstract

The present disclosure provides an inference system capable of highly accurately inferring an action of an object to be detected in an indoor space.　This inference system comprises: a first sensor which is arranged in an indoor space and detects a first state of an object to be detected in the indoor space; and a second sensor which detects a second state of the object to be detected which is different from the first state. The inference system infers an action of the object to be detected on the basis of the first state and the second state.

Description

Estimation System

[0001] The present disclosure relates to estimation systems.

[0002] Patent Document 1 discloses a system that uses a human body detection means capable of detecting human movement in an area above a predetermined height from the floor and a human body detection means capable of detecting human movement in an area below to detect human movement and determine that an abnormality has occurred in a bathroom or changing room.

[0003] Japanese Patent Application Laid-Open No. 2021-68363

[0004] The present disclosure provides an estimation system that can estimate the behavior of a detection target in an indoor space with high accuracy.

[0005] One aspect of the present disclosure is an estimation system that includes a first sensor disposed in an indoor space and detecting a first state of a detection target in the indoor space, and a second sensor that detects a second state of the detection target that is different from the first state, and that estimates the behavior of the detection target based on the first state and the second state. This specification includes the entire contents of Japanese Patent Application No. 2024-055738, filed on March 29, 2024.

[0006] According to the estimation system of the present disclosure, by detecting a detection target in an indoor space using a plurality of sensors, the behavior of the detection target can be estimated with high accuracy.

[0007] FIG. 1 is a diagram showing a schematic configuration of an estimation system according to an embodiment. FIG. 2 is a block diagram showing an example of the configuration of each device in the estimation system. FIG. 3 is a plan view showing an example of a sensing area of ​​a sensor. FIG. 4 is a side view showing an example of a sensing area of ​​a sensor. FIG. 5 is a side view showing an example of a sensing area of ​​a sensor. FIG. 6 is a flowchart showing an example of the operation of the estimation system.

[0008] (Knowledge, etc., that formed the basis of the present disclosure) At the time the inventors came up with the present disclosure, there was technology available that detected the movement of a person in a space and detected the occurrence of an abnormality from the detected movement. However, the inventors discovered a problem in that it was necessary to detect or observe the behavior of a detection target, such as a person, in a space based not only on movement but also on more detailed information. In order to solve this problem, the inventors came up with the subject matter of the present disclosure. Therefore, the present disclosure provides an estimation system that can estimate the behavior of a detection target in an indoor space with high accuracy.

[0009] Hereinafter, embodiments will be described in detail with reference to the drawings. However, more detailed description than necessary may be omitted. For example, detailed description of already well-known matters or redundant description of substantially the same configuration may be omitted. Note that the accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.

[0010] (First Embodiment) [1. Configuration of Estimation System] FIG. 1 is a diagram showing the configuration of an estimation system 1. The estimation system 1 uses a plurality of sensors installed in a space to detect the position, size, shape, posture, state, etc. of a detection target present in the space. The space in which the sensors constituting the estimation system 1 are installed is the target space of sensing by the estimation system 1. The shape and purpose of the target space are not limited. For example, the target space may be a closed space surrounded by walls and a ceiling, or may be an open space. Furthermore, for example, the target space may be a residential space, a living space, a business space such as an office, a corridor, a public space, or a space used for other purposes.

[0011] The estimation system 1 detects an object in an indoor space 9. An object detected by the estimation system 1 is called a detection target, and the detection target may be either a living or non-living object. For example, the detection target may be a person, an animal, an autonomously moving robot, or other moving object. The estimation system 1 detects the position, size, shape, and posture of the detection target, or other states of the detection target.

[0012] The indoor space 9 illustrated in Fig. 1 is a space surrounded by a floor 91, a ceiling 92, and four walls 93, 94, 95, and 96. A door is provided in the indoor space 9, and when the door is closed, the indoor space 9 becomes a closed space. Fig. 1 and each of the figures described below show an X-axis, a Y-axis, and a Z-axis. The X-axis, Y-axis, and Z-axis are imaginary axes that are perpendicular to one another, and the Z-axis corresponds to the height direction of the indoor space 9. The X-axis corresponds to the width direction of the indoor space 9, i.e., the left-right direction, and the Y-axis corresponds to the depth direction of the indoor space 9, i.e., the front-to-rear direction.

[0013] A plurality of sensors constituting the estimation system 1 are arranged in the indoor space 9. These sensors can be installed on a floor 91, a ceiling 92, and four walls 93, 94, 95, 96, etc. of the indoor space 9. In this embodiment, each of the plurality of sensors constituting the estimation system 1 is incorporated into electrical equipment installed in the indoor space 9.

[0014] The electrical equipment includes components, equipment, machinery, and devices that are connected to a commercial power source and fixedly installed in the indoor space 9. More specifically, the electrical equipment includes switches, outlets, and other power wiring components. The electrical equipment also includes ventilation fans, lighting fixtures, intercoms, and other devices that consume electricity. The electrical equipment also includes distribution boards, building energy management devices, and other power control devices.

[0015] 1 , a lighting device 10, a switch 20, and outlets 30A and 30B are installed as electrical equipment. The electrical equipment may also include a distribution board 50 installed inside or outside the indoor space 9.

[0016] Power lines 5A, 5B, and 5C are drawn into the indoor space 9 from a distribution board 50. The power lines 5A, 5B, and 5C are, for example, electric wires laid concealed within the walls of the indoor space 9, and are power cables such as VVF cables and CV cables. Hereinafter, when there is no need to distinguish between the power lines 5A, 5B, and 5C, they will be referred to as power lines 5.

[0017] The lighting device 10 is attached to a ceiling 92. The lighting device 10 may be fixed directly to the ceiling 92, or may be attached to a lighting duct rail or the like fixed to the ceiling 92. In this embodiment, a ceiling socket 112 is fixed to the ceiling 92, and the lighting device 10 is attached to the ceiling socket 112. The ceiling socket 112 may be in a form called a lighting rosette. The ceiling socket 112 corresponds to an example of a fixing member. The ceiling socket 112 is connected to a power line 5A, and the lighting device 10 is connected to the power line 5A via the ceiling socket 112.

[0018] The lighting device 10 includes a light source 11 (FIG. 2) described below and a cover 110 that diffuses light emitted from the light source 11. The light source 11 is provided in a circuit body 111 together with a driver 12 (FIG. 2) described below and the like, and is covered by the cover 110.

[0019] The switch 20 has a switch body 21 connected to the power line 5A. The switch 20 connects and disconnects the power line 5A between the lighting device 10 and the distribution board 50, and when the switch 20 is on, power is supplied to the lighting device 10. When the switch 20 is off, the power supply to the lighting device 10 is cut off, and the lighting device 10 is turned off.

[0020] The outlets 30A and 30B are power outlets (also called outlets) to which load devices that operate on commercial power can be connected. For example, the outlets 30A and 30B are single-phase 100V power outlets, with the outlet 30A connected to the distribution board 50 by a power line 5B and the outlet 30B connected to the distribution board 50 by a power line 5C.

[0021] The distribution board 50 branches off a service line 58 connected to a commercial power supply system and connects it to the power line 5. The distribution board 50 is fixed to a wall surface inside the indoor space 9 or outside the indoor space 9.

[0022] A sensor is provided in each electrical equipment installed in the indoor space 9. The lighting device 10 includes a sensor 14. The sensor 14 is arranged so as to be exposed to the indoor space 9 from the cover 110. The sensor 14 is provided on the lighting device 10 facing downward so that the area below the lighting device 10 is the sensing area.

[0023] The sensor 14 is attached to the circuit body 111 and connected to the power line 5A via the circuit body 111. Therefore, when the lighting device 10 is attached to the ceiling 92, power is supplied to the sensor 14 from the power line 5A.

[0024] The switch 20 includes a sensor 24. The sensor 24 is disposed on the switch 20 so as to face the interior space 9 from the wall 94.

[0025] Outlet 30A is equipped with sensor 34A, and outlet 30B is equipped with sensor 34B. Sensor 34A is arranged so as to face from wall 95 toward indoor space 9, and sensor 34B is arranged so as to face from wall 94 toward indoor space 9.

[0026] The sensors 14, 24, 34A, and 34B may be the same type of sensor or different types of sensors, such as a position detection sensor, an image output sensor, or a status detection sensor.

[0027] The position detection sensor outputs a detection result related to the position of the person P in the indoor space 9. Specifically, the position detection sensor may be a PIR (Passive Infrared) sensor, a ranging sensor, or a radar sensor. Furthermore, the ranging sensor may be an ultrasonic ranging sensor or a LiDAR (Light Detection and Ranging). Since the sensors 14, 24A, 24B, 34A, and 34B are fixed to the indoor space 9, if the sensors 14, 24A, 24B, 34A, and 34B include a position detection sensor, information related to the position of the person P can be obtained based on the position of the position detection sensor and the detection result.

[0028] The image output sensor is a sensor that outputs an image as a detection result in the indoor space 9. The image output sensor performs, for example, two-dimensional or three-dimensional detection on the indoor space 9 and outputs an image as a detection result. Specifically, examples of the image output sensor include an infrared array sensor, an image sensor that captures images using light outside the visible range, including infrared light, and a digital camera that captures images using visible light. The infrared array sensor includes multiple infrared sensors arranged in a grid and outputs a thermal image of the detection target range based on the detection values ​​of these multiple infrared sensors. Furthermore, LiDAR can also be used as an image output sensor by generating a depth image including LiDAR measurement values.

[0029] If cameras are used as the sensors 14, 24, 34A, and 34B, the person P in the indoor space 9 may be made aware of the cameras, which may cause psychological oppression. For this reason, if the indoor space 9 is a private space or if the comfort of the person P in the indoor space 9 is important, it is appropriate not to capture images using visible light or high-resolution images. For example, it is preferable to use an infrared array sensor as the sensor 14.

[0030] It is not prohibited to use cameras as the sensors 14, 24, 34A, and 34B. For example, if the estimation system 1 has a function to edit the images captured by the camera so that the individual cannot be identified, it is possible to avoid having a psychological effect on the person P.

[0031] The state detection sensor is a sensor that detects the state of the indoor space 9. The state detection sensor outputs a detection value that detects the state in the indoor space 9. Examples of the state detection sensor include a microphone, a vibration sensor, a temperature sensor, a humidity sensor, a pressure sensor that detects air pressure, and a Doppler sensor.

[0032] The sensors 14, 24, 34A, and 34B are selected from the sensors described above. For example, the types of the sensors 14, 24, 34A, and 34B are selected depending on the positions of the sensors 14, 24, 34A, and 34B in the indoor space 9.

[0033] The sensors 14, 24, 34A, and 34B are installed at different heights in the indoor space 9. Height H1 indicates the height of the installation position of sensor 14, height H2 indicates the height of sensor 24, height H3 indicates the height of sensor 34A, and height H4 indicates the height of sensor 34B. Heights H1 to H4 are all heights relative to the floor 91.

[0034] Since the sensor 14 is installed on the ceiling 92, the height H1 is the height of the entire indoor space 9. The height H2 of the sensor 24 and the heights H3 and H4 of the sensors 34A and 34B are lower than the height H1. The heights H3 and H4 may be the same or different. The sensors 34A and 34B are installed near the floor 91, and the heights H3 and H4 are lower than the height H2.

[0035] The sensor 14 is located at the highest position and detects from the ceiling 92 downward, so it can detect a wide range and detection is rarely obstructed by furniture or fixtures installed in the indoor space 9. For this reason, if an image output sensor or a position detection sensor is used as the sensor 14, a lot of information can be obtained about a wide range of the indoor space 9.

[0036] When an image output sensor or a position detection sensor is used as the sensor 14, it is preferable to use an image output sensor or a position detection sensor for at least one of the sensors 24, 34A, 34B. The sensors 24, 34A, 34B can detect the indoor space 9 from the walls 94, 95. Therefore, for example, if at least one of the sensors 24, 34A, 34B and the sensor 14 are configured as the same type of sensor and are an image output sensor, a three-dimensional detection result of the indoor space 9 can be obtained.

[0037] [2. Configuration of Each Device] Fig. 2 is a block diagram showing an example configuration of each device in the estimation system 1, and shows the configuration of the lighting device 10, the switch 20, the outlets 30A and 30B, and the distribution board 50. Fig. 2 is a diagram that schematically shows the configuration of each device and does not limit the detailed circuit configuration. For example, each device in Fig. 2 may include a circuit that is not shown in Fig. 2.

[0038] The estimation system 1 includes a processing device 40 that processes the detection results of the sensors 14, 24, 34A, and 34B. The lighting device 10 transmits the detection result of the sensor 14 to the processing device 40. Similarly, the switch 20 transmits the detection result of the sensor 24, the outlet 30A transmits the detection result of the sensor 34A, and the outlet 30B transmits the detection result of the sensor 34B to the processing device 40.

[0039] The processing device 40 can be provided in any of the lighting device 10, the switch 20, the outlets 30A and 30B, and the distribution board 50. The processing device 40 may also be mounted in a device separate from these devices. In this embodiment, a configuration in which the lighting device 10 is provided with the processing device 40 will be described as an example.

[0040] A service line 58 is connected to the distribution board 50. The service line 58 is a power line drawn in from outside the building including the indoor space 9 or a main wiring of the building including the indoor space 9, and supplies commercial AC power to the distribution board 50.

[0041] As shown in FIG. 2 , the distribution board 50 includes a main breaker 51, branch wiring 52, and circuit breakers 53A, 53B, and 53C. The main breaker 51 is connected to a service line 58. The branch wiring 52 connects the main breaker 51 to each of the circuit breakers 53A, 53B, and 53C. In the first embodiment, an example is shown in which a single-phase, three-wire, 200V AC power supply is supplied to the distribution board 50 from the service line 58. In this example, the branch wiring 52 includes branch wiring 52R, 52N, and 52T corresponding to the R phase, N phase, and T phase, respectively. The branch wiring 52R, 52N, and 52T are formed of metal members such as stranded wire, single-core wire, or bus bar. The distribution board 50 may also be provided with a ground terminal (not shown).

[0042] When the current flowing from the service line 58 to the branch wiring 52 exceeds a specified capacity, the main breaker 51 cuts off the service line 58 and the branch wiring 52. In addition to the main breaker 51, the distribution board 50 may also include a ground fault circuit interrupter and a neutral phase loss protection circuit (not shown).

[0043] Circuit breaker 53A is connected to branch wiring 52R and branch wiring 52N and supplies single-phase 100V AC current to power line 5A. Circuit breaker 53A disconnects power line 5A from branch wiring 52 when the current flowing through power line 5A exceeds a predetermined capacity. Circuit breaker 53B is connected to branch wiring 52N and branch wiring 52T and supplies single-phase 100V AC current to power line 5B. Circuit breaker 53C is connected to branch wiring 52N and branch wiring 52T and supplies single-phase 100V AC current to power line 5C. Circuit breaker 53B disconnects power line 5B from branch wiring 52 when the current flowing through power line 5B exceeds a predetermined capacity, and circuit breaker 53C disconnects power line 5C from branch wiring 52 when the current flowing through power line 5C exceeds a predetermined capacity.

[0044] The branch wiring 52 can be called secondary wiring relative to the main breaker 51. That is, the main breaker 51 functions as a circuit breaker that separates the commercial power supply from the secondary wiring. Also, the power line 5 can be called secondary wiring relative to the circuit breakers 53A, 53B, and 53C, and the circuit breakers 53A, 53B, and 53C function as circuit breakers that separate the commercial power supply from the secondary wiring.

[0045] In the estimation system 1, the lighting device 10 and the switch 20 are connected to a power line 5A, the outlet 30A is connected to a power line 5B, and the outlet 30B is connected to a power line 5C. The power lines 5A, 5B, and 5C are all connected to a branch wiring 52 of a distribution board 50. In other words, the lighting device 10, the switch 20, and the outlets 30A and 30B are electrically connected to each other via the branch wiring 52 and the power line 5C.

[0046] In the estimation system 1, either wired communication or wireless communication can be used as the communication method for communication between the lighting device 10, the switch 20, and the outlets 30A and 30B. As the wired communication, power line communication (PLC) via the power line 5 can be performed. As the wireless communication method, Wi-Fi (registered trademark), Bluetooth (registered trademark), or other wireless communication methods can be used. In this embodiment, an example will be described in which power line communication via the power line 5 is used in the estimation system 1.

[0047] The lighting device 10 includes a light source 11 and a driver 12 that turns on the light source 11. The light emitted by the light source 11 is diffused by a cover 110 (FIG. 1) to illuminate the interior space 9. The light source 11 is a solid-state light source such as an LED (Light Emitting Diode), or a lamp such as an incandescent lamp or a fluorescent lamp. The driver 12 is connected to the light source 11, and power is supplied from the driver 12 to the light source 11.

[0048] The driver 12 is connected to the power line 5A and receives commercial AC power via the power line 5A. The driver 12 includes a circuit that supplies the power required for the light source 11 to light up. For example, if the light source 11 is an LED, the driver 12 includes an inverter circuit that converts the commercial AC power to output a DC current of a predetermined voltage to the light source 11. The driver 12 may also have a function for adjusting the light intensity of the light source 11. For example, the driver 12 may be configured to be able to adjust the light intensity of the light source 11 by PWM (Pulse Wave Modulation) control.

[0049] The sensor 14 is incorporated into the circuit body 111 ( FIG. 1 ) of the lighting device 10 as the sensor unit 13 together with the control unit 15, the communication unit 16, and the power supply unit 17. The power supply unit 17 is connected to the power line 5A via a ceiling socket 112, converts the AC current supplied from the power line 5A into DC current of a predetermined voltage, and outputs the DC current to the sensor 14, the control unit 15, and the communication unit 16.

[0050] The control unit 15 includes a processor that processes data by executing a program. The processor is configured as an integrated circuit such as a CPU (Central Processing Unit), MPU (Micro Processing Unit), or microcontroller. The control unit 15 may also include a storage device that stores programs and data in a nonvolatile manner using a flash memory, a magnetic recording medium, an optical recording medium, or the like. The control unit 15 may also be configured as an integrated circuit that integrates a processor and a storage device, or may also be configured as a SoC (System on a Chip) that further integrates the sensor 14.

[0051] The sensor unit 13 is equipped with a processing device 40. The processing device 40 includes a processing unit 41 and a storage unit .

[0052] The processing unit 41 includes a processor that processes data by executing a program. The processor is configured with an integrated circuit such as a CPU, MPU, or microcontroller. The processor may also be programmed hardware. The storage unit 42 includes a storage device that stores programs and data in a nonvolatile manner using a flash memory, a magnetic recording medium, an optical recording medium, or the like. The storage unit 42 may also be configured with an integrated circuit integrated with the processing unit 41.

[0053] The processing unit 41 acquires detection data including the detection results of the sensors 14, 24, 34A, and 34B, performs various processes on the detection data, and stores the processed results in the storage unit 42. The processes executed by the processing unit 41 will be described later.

[0054] The control unit 15 operates the sensor 14 to perform detection for the indoor space 9. The control unit 15 acquires the detection result of the sensor 14 and generates detection data including the detection result. The control unit 15 outputs the detection data to the processing device 40.

[0055] The communication unit 16 is a communication device that communicates with other devices that make up the estimation system 1 under the control of the control unit 15, and includes a transmitter, a receiver, an interface circuit, and the like.

[0056] The communication unit 16 is, for example, a communication modem connected to the two cables that make up the power line 5A and performs power line communication via the power line 5A. The communication unit 16 includes, for example, a coding circuit that encodes data, a transmitting circuit that superimposes the coded signal on a carrier wave, a receiving circuit having a filter that extracts the signal superimposed on the carrier wave, and a decoding circuit that decodes the extracted signal to generate received data and outputs the received data to the control unit 15. The communication unit 16 may also be a wireless communication device that performs wireless communication. The communication unit 16 receives detection data transmitted by the switch 20 and the outlets 30A and 30B. The detection data received by the communication unit 16 is output to the processing device 40.

[0057] The switch 20 includes a switch body 21 and a sensor unit 23. Although Fig. 2 shows the switch body 21 as a single-pole switch that disconnects only one of a pair of cables that make up the power line 5A, the switch body 21 may also be a double-pole switch.

[0058] The sensor unit 23 includes a sensor 24, a control unit 25, a communication unit 26, and a power supply unit 27. The power supply unit 27 is connected to the power line 5A at a position closer to the processing device 40 than the switch main body 21. The power supply unit 27 converts the AC current supplied from the power line 5A into DC current of a predetermined voltage and outputs it to the sensor 24, the control unit 25, and the communication unit 26.

[0059] The control unit 25 includes a processor that processes data by executing a program. The processor is configured as an integrated circuit such as a CPU, MPU, or microcontroller. The control unit 25 may also include a storage device that stores programs and data in a nonvolatile manner using a flash memory, a magnetic recording medium, an optical recording medium, or the like. The control unit 25 may be configured as an integrated circuit that integrates a processor and a storage device, or may be configured as an SoC that further integrates the sensor 24.

[0060] The control unit 25 operates the sensor 24 to perform detection of the indoor space 9. The control unit 25 acquires the detection results of the sensor 24 and generates detection data including the detection results. The control unit 25 causes the communication unit 26 to transmit the detection data to the processing device 40.

[0061] The communication unit 26 communicates with the processing device 40 under the control of the control unit 25. For example, the communication unit 26 transmits detection data generated by the control unit 25 to the processing device 40. The communication unit 26 is a communication modem that is connected to two cables that make up the power line 5A and performs power line communication via the power line 5A. The communication unit 26 includes, for example, a coding circuit that encodes data, a transmission circuit that superimposes the coded signal on a carrier wave, a receiving circuit that has a filter that extracts the signal superimposed on the carrier wave, and a decoding circuit that decodes the extracted signal to generate received data and outputs the received data to the control unit 25.

[0062] The outlet 30A includes an outlet body 31A and a sensor unit 33A. The outlet body 31A has a pair of terminals 32A that are connected to the power line 5B. A load device is connected to the terminals 32A. The terminals 32A correspond to an example of a power supply terminal. The load device is, for example, an electrical appliance used in the indoor space 9.

[0063] The sensor unit 33A includes a sensor 34A, a control unit 35A, a communication unit 36A, and a power supply unit 37A. The power supply unit 37A is connected to the power line 5B, converts AC current supplied from the power line 5B into DC current of a predetermined voltage, and outputs the DC current to the sensor 34A, the control unit 35A, and the communication unit 36A.

[0064] The control unit 35A includes a processor that processes data by executing a program. The processor is configured as an integrated circuit such as a CPU, MPU, or microcontroller. The control unit 35A may also include a storage device that stores programs and data in a nonvolatile manner using a flash memory, a magnetic recording medium, an optical recording medium, or the like. The control unit 35A may also be configured as an integrated circuit that integrates a processor and a storage device, or may also be configured as an SoC that further integrates the sensor 34A.

[0065] The control unit 35A operates the sensor 34A to perform detection of the indoor space 9. The control unit 35A acquires the detection results of the sensor 34A and generates detection data including the detection results. The control unit 35A causes the communication unit 36A to transmit the detection data to the processing device 40.

[0066] The communication unit 36A communicates with the processing device 40 under the control of the control unit 35A. For example, the communication unit 36A transmits detection data generated by the control unit 35A to the processing device 40. The communication unit 36A is a communication modem that is connected to two cables that make up the power line 5B and performs power line communication via the power line 5B. The communication unit 36A includes, for example, a coding circuit that encodes data, a transmission circuit that superimposes the coded signal on a carrier wave, a receiving circuit that has a filter that extracts the signal superimposed on the carrier wave, and a decoding circuit that decodes the extracted signal to generate received data and outputs the received data to the control unit 35A.

[0067] The outlet 30B can have the same configuration as the outlet 30A. That is, the outlet 30B includes an outlet body 31B and a sensor unit 33B, and the outlet body 31B has a pair of terminals 32B connected to the power line 5B. The terminals 32B correspond to an example of a power supply terminal. A load device is connected to the terminals 32B.

[0068] The sensor unit 33B includes a sensor 34B, a control unit 35B, a communication unit 36B, and a power supply unit 37B. The power supply unit 37B is connected to the power line 5C, converts AC current supplied from the power line 5C into DC current of a predetermined voltage, and outputs the DC current to the sensor 34B, the control unit 35B, and the communication unit 36B.

[0069] The control unit 35B includes a processor that processes data by executing a program. The processor is configured as an integrated circuit such as a CPU, MPU, or microcontroller. The control unit 35B may also include a storage device that stores programs and data in a nonvolatile manner using a flash memory, a magnetic recording medium, an optical recording medium, or the like. The control unit 35B may also be configured as an integrated circuit that integrates a processor and a storage device, or may also be configured as an SoC that further integrates the sensor 34B.

[0070] The control unit 35B operates the sensor 34B to perform detection of the indoor space 9. The control unit 35B acquires the detection results of the sensor 34B and generates detection data including the detection results. The control unit 35B causes the communication unit 36B to transmit the detection data to the processing device 40.

[0071] The communication unit 36B communicates with the processing device 40 under the control of the control unit 35B. For example, the communication unit 36B transmits detection data generated by the control unit 35B to the processing device 40. The communication unit 36B is a communication modem that is connected to the two cables that make up the power line 5B and performs power line communication via the power line 5B. The communication unit 36B includes, for example, a coding circuit that encodes data, a transmission circuit that superimposes the coded signal on a carrier wave, a receiving circuit that has a filter that extracts the signal superimposed on the carrier wave, and a decoding circuit that decodes the extracted signal to generate received data and outputs the received data to the control unit 35B.

[0072] The processing device 40 provided in the lighting device 10 operates by receiving power from the power supply unit 17. Furthermore, the processing unit 41 directly or indirectly controls the communication unit 16 when communicating with the switch 20 and the outlets 30A and 30B. The processing unit 41 acquires, via the communication unit 16, detection data including the detection results of the sensors 24, 34A, and 34B. Furthermore, the processing unit 41 acquires detection data including the detection results of the sensors 14 from the control unit 15.

[0073] In the estimation system 1, one of the sensors 14, 24, 34A, and 34B is used as a first sensor, and any one or more of the other sensors are used as second sensors. The first sensor is a sensor that detects a first state of the detection target. The second sensor is a sensor that detects a second state of the detection target, the first state being different from the second state. The processing unit 41 identifies the first state of the detection target from the detection result of the first sensor, and identifies the second state of the detection target from the detection result of the second sensor. The processing unit 41 estimates the behavior of the detection target based on the first state and the second state.

[0074] As a first example, the first state is the position of the detection target, and the second state is the movement of the detection target. In this case, the first sensor is a sensor that can detect the position of the detection target in the indoor space 9, and examples thereof include an image output sensor and an ultrasonic distance sensor. The second sensor is a sensor that detects the movement of the detection target, or a sensor that can obtain a detection result that indicates the movement of the detection target, and examples thereof include a distance sensor, an image output sensor, and a PIR sensor.

[0075] In the first example, the processing unit 41 identifies the position of the detection target as a first state. The processing unit 41 identifies the distance from the second sensor to the detection target as a second state. Here, the processing unit 41 identifies the distance from each of multiple parts of the detection target to the second sensor based on the detection data of the second sensor. Then, the processing unit 41 identifies the shape of the detection target based on the position of the detection target identified from the detection data of the first sensor, the position of the second sensor, and the distance from the second sensor to each part of the detection target.

[0076] The processing unit 41 repeatedly acquires the detection data from the first sensor and the detection data from the second sensor at a predetermined cycle. This cycle may be different for the first sensor and the second sensor, but it is preferable that the cycle be the same. The processing unit 41 compares the shape of the detection target identified based on the detection data detected at different times. In this way, the processing unit 41 estimates changes in the shape of the detection target over time. The changes in the shape of the detection target correspond to the movement of the detection target.

[0077] In the first example, the processing unit 41 estimates, for example, whether the detection target is a person or a small animal such as a dog, a cat, etc. Furthermore, the processing unit 41 can estimate whether the behavior of the detection target in the indoor space 9 is dancing, walking, standing, or sleeping.

[0078] As a second example, the first state may be the foot movement of the detection target, and the second state may be the sound emitted by the detection target. In this case, the first sensor is a sensor that detects the foot movement when the detection target is a person, and is a distance measurement sensor or an image output sensor. The sensing area of ​​the first sensor includes the lower part of the indoor space 9. The second sensor is a sensor that detects sound, and specifically, a microphone or a vibration sensor may be used.

[0079] The processing unit 41 identifies the foot movement of the detection target detected by the first sensor. The processing unit 41 repeatedly acquires detection data from the first sensor at a predetermined period and compares the distance from the first sensor to the detection target detected at different times. The processing unit 41 identifies the foot movement of the detection target by identifying changes in the position of the foot of the detection target over time. The processing unit 41 also estimates the content of the sound or voice detected by the second sensor. For example, the processing unit 41 estimates the type of sound or voice detected by the second sensor by performing frequency analysis of the sound or voice detected by the second sensor or pattern matching of the voice data. The content of the sound or voice detected by the second sensor is, for example, a person's laughter, a person's breathing, a person's yelling, etc.

[0080] In the second example, for example, when there is a person as a detection target in the indoor space 9, the processing unit 41 identifies whether the person is standing or moving. From this movement and the estimation result based on sound or voice, the processing unit 41 can estimate whether the behavior of the person in the indoor space 9 is dancing, laughing, or angry.

[0081] As a third example, the first state is the movement of the detection target, and the second state is the facial expression of the detection target. In this case, the first sensor is a sensor that can detect the movement of the detection target in the indoor space 9, and examples of the sensor include an image output sensor and a distance measurement sensor. The second sensor is a sensor that can obtain a detection result including the facial expression of a person when the detection target is a human, and examples of the sensor include a camera.

[0082] The processing unit 41 identifies the movement of the feet of the detection target detected by the first sensor. For example, the processing unit 41 repeatedly acquires detection data from the first sensor at a predetermined period and identifies the movement of the detection target from the detection data detected by the first sensor at different times. The processing unit 41 also estimates the facial expression of the person who is the detection target by analyzing the image generated by the second sensor. Here, the processing unit 41 may estimate an emotion corresponding to the expression of the person who is the detection target. Specifically, the processing unit 41 estimates whether the person who is the detection target is angry, laughing, has a stable emotion, or is in pain. As a result, for example, when the person who is the detection target is holding their abdomen, the processing unit 41 can estimate whether they are holding their abdomen due to poor physical condition such as stomach pain, or whether they are laughing.

[0083] When implementing the first to third examples, it is preferable that the first sensor and the second sensor detect the detection target from different directions. The position of the detection target in the indoor space 9 is not limited, but for example, if the first sensor and the second sensor are arranged at different positions relative to the indoor space 9, it becomes possible to detect the detection target from different directions and obtain more information.

[0084] For example, the first sensor may be provided on the ceiling surface of the indoor space, and the second sensor may be provided on a wall surface that constitutes the indoor space. In this embodiment, this can be realized by defining sensor 14 installed on ceiling 92 as the first sensor, and sensor 24 or sensor 34A installed on wall 94, or sensor 34B installed on wall 95 as the second sensor. There may be one or more second sensors. The same applies to the first sensor.

[0085] Alternatively, for example, the first sensor may be provided on a first wall surface of the indoor space, and the second sensor may be provided on a second wall surface different from the first wall surface. In this case, one or more of sensors 24, 34A, and 34B are defined as the first sensor. Then, one or more of sensors 24, 34A, and 34B that are provided on a wall surface different from the first sensor are defined as the second sensor. For example, if sensor 24 or sensor 34A is defined as the first sensor, sensor 34B is defined as the second sensor. The reverse is also possible.

[0086] When implementing the first example, it is preferable that the first sensor have a wider sensing area than the second sensor. When using the first sensor to identify the position of a detection target in the indoor space 9, a wider sensing area of ​​the first sensor has the advantage of being able to identify the position of the detection target more reliably. In this case, it is also preferable that the first sensor be installed at a higher position in the indoor space 9 than the second sensor. Furthermore, it is more preferable that the first sensor be installed on the ceiling 92, which is the highest position in the indoor space 9.

[0087] The width of the sensing area may be the area of ​​the sensing area in the indoor space 9, or the central angle of the sensing area with the sensor at the center. For example, it is possible to compare sensing areas projected onto the X-Y plane. That is, when comparing the sensing areas when the indoor space 9 is viewed from above, the sensing area of ​​the second sensor is narrower than the sensing area of ​​the first sensor. The width of the sensing area may be the area of ​​the sensing area, or may be the proportion of the sensing area to the floor area of ​​the indoor space 9.

[0088] The processing unit 41 may select a first sensor from among a plurality of sensors provided in the indoor space 9, or may use a predetermined sensor as the first sensor. When the processing unit 41 acquires detection data from the first sensor, it may select a second sensor based on the detection data from the first sensor. For example, when the processing unit 41 identifies the position of a detection target based on the detection data from the first sensor, it may select a sensor whose sensing area includes the identified position of the detection target as the second sensor. The processing unit 41 may also use a predetermined sensor as the first sensor. When the second sensor fails to detect the detection target, the processing unit 41 may newly select a sensor other than the second sensor as the second sensor. In this case, the processing unit 41 may stop the second sensor that is unable to detect the detection target.

[0089] That is, the processing unit 41 may be configured to transmit control data to the sensors 14, 24, 34A, and 34B, thereby controlling the sensors to stop and start. For example, the control unit 15 controls the sensor 14 to be in an operating state and to be in a stopped state in accordance with the control data output by the processing unit 41. In this case, the power consumption of the sensor 14 can be reduced when the operation of the sensor 14 is not required. Similarly, the control unit 25 controls the sensor 24 to be in an operating state and to be in a stopped state in accordance with the control data output by the processing unit 41. The control unit 35A controls the sensor 34A to be in an operating state and to be in a stopped state in accordance with the control data output by the processing unit 41. The control unit 35B controls the sensor 34B to be in an operating state and to be in a stopped state in accordance with the control data output by the processing unit 41. Here, the operating state of a sensor refers to a state in which the sensor is capable of detecting a detection target and is currently detecting the target. Activating a sensor means transitioning the sensor to an operating state, and stopping a sensor means transitioning the sensor from the operating state to a state that consumes less power than the operating state.

[0090] In this case, when starting detection of the detection target, the processing unit 41 activates the sensor to be used as the first sensor. The processing unit 41 also activates the sensor to be used as the second sensor. Note that all sensors may be in an operating state when the processing unit 41 starts processing. If the processing unit 41 determines that the sensor selected as the second sensor cannot detect the detection target, it stops the second sensor. Thereafter, the processing unit 41 may select another sensor as the second sensor and activate it.

[0091] Furthermore, for example, the processing unit 41 may integrate detection data from multiple sensors installed on different surfaces surrounding the indoor space 9. Specifically, the processing unit 41 integrates the detection result of the sensor 14 installed on the ceiling 92 with the detection result of the sensor 24 and / or the sensor 34A installed on the wall 94. Alternatively, the processing unit 41 integrates the detection result of the sensor 14 with the detection result of the sensor 34B. Alternatively, the processing unit 41 integrates the detection result of the sensor 14 with the detection result of the sensor 24 and / or the sensor 34A and the detection result of the sensor 34B. When performing these processes, the processing unit 41 can generate three-dimensional detection data of the person P based on two-dimensional detection results, or obtain two-dimensional or three-dimensional detection data based on one-dimensional detection results. Examples of one-dimensional detection results include detection results from an ultrasonic ranging sensor or a radar sensor. Examples of two-dimensional detection results include detection results from an image output sensor. As a typical example, when the sensors 14 and 24 are configured as infrared array sensors, the processing unit 41 can generate a three-dimensional heat distribution map by overlaying the thermal images detected by the sensors 14 and 24.

[0092] 3. Characteristics of the Sensor Fig. 3 is a plan view showing an example of a sensing area of ​​a sensor provided in the estimation system 1, and is a view of the indoor space 9 from above. Figs. 4 and 5 are side views showing an example of a sensing area of ​​the sensor. Fig. 4 is a view of the indoor space 9 as seen from the +X direction, and Fig. 5 is a view of the indoor space 9 as seen from the -Y direction.

[0093] In Figures 3 to 5, the sensing areas of sensors 14, 24, 34A, and 34B are indicated by the symbols D1, D2, D3, and D4, respectively. As shown in Figure 3, the area obtained by projecting sensing area D1 onto the X-Y plane is a range with a central angle θ11 and a radius R11 centered on sensor 14. The central angle θ11 is 360 degrees or an angle close to it. The X-Y plane is a horizontal plane, which can be rephrased as the floor surface of the indoor space 9. For ease of understanding, the dashed line indicating sensing area D1 in Figure 3 extends outside the indoor space 9, but the actual sensing area D1 is blocked by walls 93, 94, 95, and 96. For this reason, sensing area D1 does not extend outside the indoor space 9.

[0094] The area obtained by projecting sensing area D2 onto the XY plane is a sector with a central angle θ12 and a radius R12 centered on sensor 24. The area obtained by projecting sensing area D3 onto the XY plane is a sector with a central angle θ13 and a radius R13 centered on sensor 34A. The area obtained by projecting sensing area D4 onto the XY plane is a sector with a central angle θ14 and a radius R14 centered on sensor 34B.

[0095] 4, when viewed from the direction along the Y axis, the area obtained by projecting sensing area D1 onto the X-Z plane is a sector with a central angle θ21 centered on sensor 14. The area of ​​sensing area D1 covers the entire area between wall 93 and wall 95. The area obtained by projecting sensing area D4 onto the X-Z plane is a sector with a central angle θ22 centered on sensor 34A and a radius R14.

[0096] 5, the area obtained by projecting sensing area D1 onto the X-Z plane is a sector with a central angle θ21 centered at sensor 14. The area obtained by projecting sensing area D2 onto the X-Z plane is a sector with a central angle θ32 and a radius R12 centered at sensor 24, and the area obtained by projecting sensing area D3 onto the X-Z plane is a sector with a central angle θ33 and a radius R13 centered at sensor 34A.

[0097] The central angles θ11, θ12, θ13, θ14, θ21, θ22, θ31, θ32, θ33 and the radii R11, R12, R13, R14 are determined by the structures and specifications of the sensors 14, 24, 34A, 34B. An example of the operation of the estimation system 1 will now be described.

[0098] 6 is a flowchart showing an example of the operation of the estimation system 1. The operation of FIG. 6 is realized by the processing unit 41 executing a program stored in the storage unit 42.

[0099] In the operation example of Fig. 6, the sensor to be used as the first sensor is determined in advance from sensors 14, 24, 34A, and 34B. The processing device 40 activates the first sensor (step S1) and acquires detection data from the first sensor (step S2). The processing device 40 analyzes the detection result of the first sensor (step S3) and determines whether or not there is a detection target in the indoor space 9 based on the detection result of the first sensor (step S4). If it is determined that there is no detection target in the indoor space 9 (step S4; NO), the processing device 40 returns to step S2.

[0100] If the processing device 40 determines that a detection target is present in the indoor space 9 (step S4; YES), it selects a second sensor (step S5) and activates the selected second sensor (step S6). The processing device 40 acquires detection data including the detection result of the second sensor selected in step S5 (step S7). The processing device 40 determines whether the second sensor selected in step S5 is suitable for detecting the detection target detected by the first sensor (step S8).

[0101] The conditions for a second sensor to be suitable for detecting a detection target include, for example, that the second sensor has a sensing area that includes the detection target detected by the first sensor. This condition also includes, for example, that the second sensor is capable of transmitting detection data. Furthermore, this condition also includes, for example, that the second sensor is capable of performing a detection operation. If the second sensor selected in step S5 does not satisfy any of the above conditions, the processing device 40 determines that the second sensor is not suitable for detection.

[0102] 3, assume that the person P, who is the detection target, is located in a position that is included in sensing area D2, but not in sensing area D3 or sensing area D4. In this case, sensors 34A and 34B cannot detect person P and are therefore not suitable for detecting person P. On the other hand, sensor 24 is suitable for detecting person P. For example, in step S8, processing device 40 can determine whether the second sensor selected in step S5 is suitable for detecting the detection target, based on the positional relationship between the position of person P and the sensing area.

[0103] Furthermore, in step S5, the processing device 40 may select, as the second sensor, a sensor that matches the position of the detection target identified from the detection result of the first sensor.

[0104] If it is determined that the second sensor selected in step S5 is not suitable for detecting the object detected by the first sensor (step S8; NO), the processing device 40 controls to stop the second sensor (step S9). Thereafter, the processing device 40 returns to step S4 and selects another second sensor.

[0105] If it is determined that the second sensor selected in step S5 is suitable for detecting the target detected by the first sensor (step S8; YES), the processing device 40 estimates the behavior of the target (step S10). That is, the processing device 40 estimates the behavior of the target by analyzing the detection results of the first sensor and the second sensor.

[0106] The processing device 40 generates detection data including an estimation result of the behavior of the detection target, and stores the data in the storage unit 42 (step S11).

[0107] (Other Embodiments) As described above, the above-mentioned embodiments have been described as examples disclosed in the present application. However, the technology in the present disclosure is not limited to these, and can be applied to embodiments in which modifications, substitutions, additions, omissions, etc. are made. Furthermore, it is also possible to combine the components described in the above-mentioned embodiments to create new embodiments. Therefore, other embodiments will be described below as examples.

[0108] In the above embodiment, an example configuration has been described in which the estimation system 1 includes multiple sensors installed in one indoor space 9, but the space that the estimation system 1 targets for detection is not limited to one space. For example, the estimation system 1 may include multiple sensors arranged in multiple spaces separated by walls, and these multiple sensors may be connected to the processing device 40 via power lines 5. Furthermore, the estimation system 1 may include multiple processing devices 40, and these multiple processing devices 40 may communicate with each other.

[0109] In the above embodiment, the lighting device 10, the switch 20, and the outlets 30A and 30B are examples of electrical equipment in which sensors can be installed. Examples of electrical equipment in which sensors constituting the estimation system 1 can be installed include an outlet with two or more sockets, an outlet with a ground terminal, a switch with a pilot lamp, a switch with a timer, a switch with lighting, a ventilation fan, etc. Of course, sensors can also be installed in other electrical equipment.

[0110] The configuration of each unit of the estimation system 1 shown in Figure 2 is an example, and the specific implementation form is not particularly limited. In other words, it is not necessarily necessary to implement hardware corresponding to each unit in Figure 2 individually, and it is of course possible, for example, to configure the system so that a single integrated circuit realizes the functions of each unit. Furthermore, in the above-described embodiment, the functions of the control units 15, 25, 35A, and 35B and the processing unit 41 may be realized by software or hardware.

[0111] It should be noted that the above-described embodiments are intended to illustrate the technology of the present disclosure, and various modifications, substitutions, additions, omissions, etc. may be made within the scope of the claims or their equivalents.

[0112] (Additional Notes) The above description of the embodiments discloses the following techniques.

[0113] (Technology 1) An estimation system that includes a first sensor that is arranged in an indoor space and detects a first state of a detection target in the indoor space, and a second sensor that detects a second state of the detection target that is different from the first state, and that estimates the behavior of the detection target based on the first state and the second state. This allows the behavior of the detection target in the indoor space to be estimated with high accuracy by using results of different types of detection performed on the detection target.

[0114] (Technology 2) The estimation system according to Technology 1, wherein the second sensor detects the detection target from a direction different from that of the first sensor. By performing different types of detection on the detection target from different directions, the behavior of the detection target in an indoor space can be estimated with higher accuracy.

[0115] (Technology 3) The estimation system according to Technology 1 or Technology 2, wherein the first sensor is provided on a ceiling surface of the indoor space, and the second sensor is provided on a wall surface that constitutes the indoor space. With this, different types of detection are performed on the detection target from the ceiling surface and the wall surface of the indoor space, thereby making it possible to estimate the behavior of the detection target in the indoor space with higher accuracy.

[0116] (Technology 4) The estimation system according to any one of Technology 1 to Technology 3, wherein the first sensor is provided on a first wall surface of the indoor space, and the second sensor is provided on a second wall surface different from the first wall surface. With this, different types of detection are performed on the detection target from different wall surfaces, thereby making it possible to estimate the behavior of the detection target in the indoor space with higher accuracy.

[0117] (Technology 5) The estimation system according to any one of Technology 1 to Technology 4, wherein the first state is the position of the detection target, and the second state is the movement of the detection target. With this, the position and movement of the detection target in an indoor space are detected, and by using these detection results, the behavior of the detection target in the indoor space can be estimated with higher accuracy.

[0118] (Technology 6) The estimation system according to any one of Technology 1 to Technology 4, wherein the first state is a leg movement of the detection target, and the second state is a sound emitted by the detection target. With this, the leg movement of the detection target in an indoor space and the sound emitted by the detection target are detected, and by using these detection results, the behavior of the detection target in the indoor space can be estimated with higher accuracy.

[0119] (Technology 7) The estimation system according to any one of Technology 1 to Technology 4, wherein the first state is a motion of the detection target, and the second state is a facial expression of the detection target. With this, by using the results of detecting the motion and facial expression of the detection target in the indoor space, the behavior of the detection target in the indoor space can be estimated with higher accuracy.

[0120] (Technology 8) The estimation system according to any one of Technology 7, wherein when the second sensor cannot detect the facial expression of the detection target, control is performed to stop the second sensor. According to this, when estimating the behavior of the detection target in an indoor space, the sensors that are not suitable for detection can be stopped, thereby making it possible to use the sensors more efficiently.

[0121] As described above, the estimation system according to the present disclosure can be used to detect objects such as people and animals in indoor spaces.

[0122] REFERENCE SIGNS LIST 1 Estimation system 5, 5A, 5B, 5C Power line 9 Indoor space 10 Lighting device 11 Light source 12 Driver 13 Sensor unit 14 Sensor 15 Control unit 16 Communication unit 17 Power supply unit 20 Switch 23 Sensor unit 24 Sensor 25 Control unit 26 Communication unit 27 Power supply unit 30A, 30B Outlet 33A, 33B Sensor unit 34A, 34B Sensor 35A, 35B Control unit 36A, 36B Communication unit 37A, 37B Power supply unit 40 Processing device 41 Processing unit 42 Memory unit 50 Distribution board 92 Ceiling (ceiling surface) 93, 94, 95, 96 Wall (wall surface) P Person (detection target)

Claims

1. An estimation system comprising: a first sensor disposed in an indoor space and configured to detect a first state of a detection target in the indoor space; and a second sensor configured to detect a second state of the detection target that is different from the first state; and estimating the behavior of the detection target based on the first state and the second state.

2. The estimation system according to claim 1, wherein the second sensor detects the object from a direction different from that of the first sensor.

3. The estimation system according to claim 1, wherein the first sensor is provided on a ceiling surface of the indoor space, and the second sensor is provided on a wall surface that constitutes the indoor space.

4. The estimation system according to claim 1, wherein the first sensor is provided on a first wall surface of the indoor space, and the second sensor is provided on a second wall surface different from the first wall surface.

5. The estimation system according to claim 1, wherein the first state is the position of the object, and the second state is the movement of the object.

6. The estimation system according to claim 1, wherein the first state is foot movement of the detection target, and the second state is sound emitted by the detection target.

7. The estimation system according to claim 1, wherein the first state is a movement of the detection target, and the second state is a facial expression of the detection target.

8. The estimation system according to claim 7, wherein when the facial expression of the detection target cannot be detected by the second sensor, control is performed to stop the second sensor.

Images