COMPUTER-IMPLEMENTED METHOD, ACTIVITY DETECTION DEVICE, AND SYSTEM FOR PROVIDING INFORMATION TO DETERMINE THE CONDITION OF A CARE RECIPIENT - Patent application

Abstract

To provide a technique for objectively grasping daily living behavior of a cared person.SOLUTION: In a monitoring system, processing executed by a management device includes the steps of: receiving S610 a request of care information based on operation given to an input device; accessing a database of the care information of a cared person stored in a storage device to acquire S620 a cared person's care time; reading S630 predetermined standard time (care need certification standard time) for care need certification from the storage device; comparing care time with the care need certification standard time to estimate S640 a care needs level (for example, Requiring help 1, 2, Long-term care levels 1 to 5); and outputting S650 results of care need certification to be presumed as a result of comparison.SELECTED DRAWING: Figure 6

Description

[Technical field]

[0001] The present disclosure relates to quantifying daily living activities, and more particularly, to a technique for measuring the amount of time a care recipient is receiving care from a caregiver. [Background technology]

[0002] In nursing care facilities, a monitoring system for grasping the daily activities of a care recipient (resident of the facility) may be used. For example, Japanese Patent Application Laid-Open Publication No. 2017-117423 (Patent Document 1) discloses a monitoring system capable of grasping the daily activities of a person being monitored, including the walking speed of the person being monitored. This monitoring system includes a plurality of child units 2 (2A to 2G) and a parent unit 3 installed in a residence H. Each child unit 2 transmits a notification signal to the parent unit 3 when it detects the person being monitored. The parent unit 3 calculates the travel time of the person being monitored from the bedroom PD to the toilet PD based on the time data of the notification signal from the child unit 2D and the time data of the notification signal from the child unit 2E, and calculates the walking speed of the person being monitored based on the travel time (see [Abstract]). In addition, Japanese Patent Application Laid-Open Publication No. 2015-42241 (Patent Document 2) discloses a medical information processing device capable of providing display information that makes it easy to evaluate the walking status. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2017-117423 A [Patent Document 2] JP 2015-42241 A Summary of the Invention [Problem to be solved by the invention]

[0004] Conventionally, the certification of the need for nursing care of a care recipient is based on the visual inspection by an investigator and the diagnosis by the attending physician. When the investigator visually inspects the care recipient, the care recipient may happen to be unable to move, or may behave as if he or she is unable to move. Therefore, the certification of the need for nursing care may not be performed accurately. Therefore, there is a need for a technology that can perform the certification of the need for nursing care of a care recipient accurately.

[0005] The present disclosure has been made in consideration of the above-mentioned background, and according to one embodiment, a technique for providing information for assisting in nursing care certification is disclosed. [Means for solving the problem]

[0006] According to one embodiment, there is provided a computer-implemented method for providing information for determining a condition of a care recipient, the method comprising the steps of receiving an image signal output from an image sensor provided for capturing an image of a room of the care recipient, receiving user identification information and an output of the acceleration sensor from a first communication terminal having an acceleration sensor and worn by the user, and determining the condition of the care recipient based on the image of the room and the output of the acceleration sensor.

[0007] According to another embodiment, there is provided a behavior detection device. The behavior detection device includes an input interface for receiving an input of a video signal, a receiving device for receiving a wireless signal, and a processor for detecting behavior based on the video signal and the wireless signal. The processor receives a video signal output from a video sensor provided for capturing images of the care recipient's room, has an acceleration sensor, receives user identification information and the output of the acceleration sensor from a first communication terminal worn by the user, and determines the state of the care recipient based on the video of the room and the output of the acceleration sensor.

[0008] According to yet another embodiment, a system is provided. The system includes a first communication terminal having an acceleration sensor, and a sensor device for receiving a wireless signal. The sensor device includes a camera, a receiving device for receiving the signal, and a processor for executing arithmetic processing using the signal. The processor receives a video signal output from an image sensor provided in the room of the care recipient to capture an image of the room, receives identification information of a user of the first communication terminal and the output of the acceleration sensor from the first communication terminal, and determines the condition of the care recipient based on the image of the room and the output of the acceleration sensor.

[0009] According to one embodiment, the time spent by a caregiver assisting a care recipient is measured, so that the daily living activities of the care recipient can be objectively grasped.

[0010] The above and other objects, features, aspects and advantages of the present invention will become apparent from the following detailed description of the invention taken in conjunction with the accompanying drawings. [Brief description of the drawings]

[0011] [Figure 1] FIG. 1 is a diagram illustrating an example of measuring daily living activities of a care recipient 800 according to an embodiment. [Diagram 2] FIG. 1 is a block diagram illustrating an example of a configuration of a monitoring system for use in a care facility according to one embodiment. [Diagram 3] 13 is a diagram showing a trajectory of a signal acquired when a care recipient 800 is being cared for by a caregiver 600. FIG. [Figure 4] 1 is a diagram showing an overview of data that can be acquired by a measuring device for each of a care recipient 800 and a caregiver 600. FIG. [Diagram 5] 10 is a flowchart showing a part of the processing executed by the control device 101 of the sensor box 100. [Figure 6] 11 is a flowchart showing a part of a process executed by a control device 201 of a management device 200 according to an embodiment. [Figure 7]13 is a flowchart showing a part of the processing executed by a wearable device 400 having a function of estimating the distance to another wearable device 400. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. In the following description, the same components are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.

[0013] [Outline of understanding daily life activities] An embodiment of grasping the activities of daily living (ADL (Activities of Daily Living)) of a care recipient according to an embodiment will be described with reference to Fig. 1. Fig. 1 is a diagram showing an example of measuring the activities of daily living of a care recipient 800 according to an embodiment. The activities of daily living are observed, for example, at the home of the care recipient 800 or at a care facility if the care recipient 800 is already residing there.

[0014] A sensor box 100 is attached to the ceiling of a room 10 assigned to a care recipient 800 at his / her home or a care facility. A bed 901 is placed in the room 10. The care recipient 800 may spend a long time in the bed 901 depending on the level of care required. The care recipient 800 wears a wearable device 400A.

[0015] The wearable device 400A has a signal transmission function, and transmits the signal 140 at a predetermined timing or based on receiving a signal transmission request. The signal 140 may include acceleration data, a time stamp, and the like.

[0016] In a certain situation, in the room 10, the caregiver 600 assists the care recipient 800. The caregiver 600 wears the wearable device 400B. When the care recipient 800 lives at home, the caregiver 600 is a family member or a visiting helper of the care recipient 800. When the care recipient 800 lives in a facility, the caregiver 600 is a care staff member of the facility.

[0017] The wearable device 400B has a signal transmission function, and transmits the signal 150 at a predetermined timing or based on receiving a signal transmission request. The signal 150 may include acceleration data, a time stamp, and the like.

[0018] Wearable devices 400A and 400B are collectively referred to as wearable device 400. Wearable device 400 may be, for example, a wristwatch type or a bracelet type, but may be in other forms. The communication standard of wearable device 400 is, for example, Bluetooth (registered trademark), but other wireless communication standards may be used. In addition, a housing including a cover of wearable device 400 may be formed with a reflective surface or a reflective object such as a mirror so that it stands out from surrounding objects when photographed by a camera.

[0019] The sensor box 100 receives the signal 140 and the signal 150. The sensor box 100 further includes a storage device, a control device, a communication device, and each sensor (not shown). Each sensor may include a camera, a Doppler sensor, etc. The configuration of the sensor box 100 will be described later.

[0020] In one aspect, the sensor box 100 detects the state of the care recipient 800 in the room 10 by using a video signal output from a camera as an image sensor and an output signal transmitted from the wearable device 400A worn by the care recipient 800. The video signal includes a trajectory of the movement of the care recipient 800. The output signal may include identification information of a user of the wearable device 400A (e.g., the name or resident number of the care recipient 800) and a detected acceleration signal. In another aspect, the identification information of the user may be stored in another device (e.g., a server that manages the user of the wearable device 400, the management device 200, etc.) associated with the wearable device 400A. In this case, the wearable device 400A may acquire the identification information of the user stored in the other device before transmitting the signal 140.

[0021] For example, the sensor box 100 stores in memory layout information prepared in advance as the locations of a bed, a toilet, and other facilities in the living room 10. The sensor box 100 estimates the approximate position of the care recipient 800 using the layout information and the image signal.

[0022] Furthermore, the sensor box 100 detects the movement of the care recipient 800 using the output signal sent from the wearable device 400A. As an example, if the care recipient 800 can walk independently, albeit slowly, a change in acceleration (for example, a periodic change according to the vertical movement of the body) can be detected. On the other hand, if the care recipient 800 is in a state where he / she needs care to the extent that he / she cannot move by himself / herself, the periodic change in acceleration may not be detected. Thus, in a certain aspect, when the movement of the care recipient 800 is detected from the image signal, and further, a change in acceleration is detected, the sensor box 100 can determine that the care recipient 800 is in a state where he / she can walk independently. In another aspect, when the care recipient 800 is detected from the image signal, if the time during which a change in acceleration is not detected from the output signal from the wearable device 400A exceeds a predetermined time, the sensor box 100 can determine that the care recipient 800 is in a state where he / she cannot walk by himself / herself.

[0023] The sensor box 100 calculates the proximity between the care recipient 800 and the caregiver 600 using the signals 140 and 150 and the signals acquired by each sensor. In one aspect, the proximity is calculated as the distance between the care recipient 800 and the caregiver 600. The distance is obtained, for example, by detecting the caregiver 600 and the care recipient 800 in an image captured in the living room 10 and calculating the distance between the caregiver 600 and the care recipient 800. In another aspect, the wearable device 400A worn by the care recipient 800 and the wearable device 400B worn by the caregiver 600 may communicate with each other, and the position of the wearable device 400 that is the source of the signal may be identified using, for example, the AoA technique.

[0024] When the care recipient 800 is in the room 10 and the caregiver 600 is providing care, the sensor box 100 may receive the signal 140 transmitted from the wearable device 400A and the signal 150 transmitted from the wearable device 400B. Furthermore, the sensor box 100 identifies the wearable devices 400A and 400B in the image using image data obtained by photographing the room 10 with a built-in camera (described later) and data acquired from the signal 140 and the signal 150. The wearable devices 400A and 400B are identified, for example, by extracting two areas having specific colors (shown as reflected light, for example) from the image.

[0025] The sensor box 100 further calculates the centers of gravity of the two regions, and calculates the distance between the centers of gravity as the distance between the regions. If this distance is smaller than a predetermined distance, the caregiver 600 is close to the care recipient 800, and the sensor box 100 can determine that the care recipient 800 is receiving care from the caregiver 600. Conversely, if the distance is larger than a predetermined distance, the sensor box 100 can determine that the caregiver 600 is far from the care recipient 800, and can infer that the caregiver 600 is not receiving care from the care recipient 800.

[0026] [System hardware configuration] The configuration of the devices used in a care facility will be described with reference to Fig. 2. Fig. 2 is a block diagram showing an example of the configuration of a monitoring system 20 used in a care facility according to an embodiment. The monitoring system 20 includes a sensor box 100, a management device 200, a mobile terminal 300, a wearable device 400, a care call handset 500, a door sensor 510, a toilet sensor 520, an odor sensor 530, and a vital sensor 540.

[0027] [Sensor Box 100] The sensor box 100 is installed on the ceiling of a room 10 in a facility or the home of a care recipient 800. The sensor box 100 acquires a movement history of the care recipient 800 in the room 900 and images and / or photographs of the room 900, and transmits them to the management device 200.

[0028] The sensor box 100 includes a control device 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, a communication interface 104, a camera 105, a Doppler sensor 106, a wireless communication device 107, a memory device 108, and a beacon receiving device 109.

[0029] The control device 101 controls the operation of the sensor box 100. The control device 101 is configured, for example, by at least one integrated circuit. The integrated circuit is configured, for example, by at least one central processing unit (CPU), at least one application specific integrated circuit (ASIC), at least one field programmable gate array (FPGA), or a combination of these.

[0030] The ROM 102 can store various programs and settings executed by the control device 101. The RAM 103 temporarily stores programs loaded from the ROM 102 or the storage device 108, or data received via the wireless communication device 107 or the beacon receiving device 109. The control device 101 executes the programs loaded into the RAM 103.

[0031] The communication interface 104 may include an interface for wired or wireless communication with the management device 200, and an antenna (not shown). The sensor box 100 transmits and receives data to and from the management device 200 and other communication devices by wired or wireless communication. The other communication devices include, for example, the management device 200, the mobile terminal 300, and other communication terminals. In yet another aspect, the communication interface 104 may include a slot that accepts the insertion of a Subscriber Identity Module (SIM) card. By inserting a SIM card into the slot, the sensor box 100 can communicate data with other information communication devices via a mobile phone line.

[0032] In one implementation, the camera 105 is a near-infrared camera. The near-infrared camera includes an IR (Infrared) projector that projects near-infrared light, and can capture video and / or photos showing the interior of the room 900 even at night. In another implementation, the camera 105 is a surveillance camera that receives only visible light. In still another implementation, a 3D sensor or a thermography camera may be used as the camera 105. The sensor box 100 and the camera 105 may be configured integrally or separately.

[0033] The Doppler sensor 106 is, for example, a microwave Doppler sensor that emits and receives radio waves to detect the behavior (movement) of an object in the room 900. This makes it possible to detect biological information of the care recipient 800 in the room 900. In one example, the Doppler sensor 106 emits microwaves in the 24 GHz band toward the bed 901 in each room 900, and receives the reflected waves reflected by the care recipient 800. The reflected waves are Doppler shifted due to the movement of the care recipient 800. The Doppler sensor 106 can detect the breathing condition and heart rate of the care recipient 800 from the reflected waves.

[0034] The wireless communication device 107 receives each signal emitted from the care call handset 500, the door sensor 510, the toilet sensor 520, the odor sensor 530, and the vital sensor 540, and transmits the received signal to the control device 101. For example, the care call handset 500 includes a care call button 501. When the care call button 501 is operated, the care call handset 500 transmits a signal indicating that the operation has been performed to the wireless communication device 107. The door sensor 510, the toilet sensor 520, the odor sensor 530, and the vital sensor 540 transmit detection signals corresponding to each to the wireless communication device 107.

[0035] The storage device 108 is realized, for example, by an internal hard disk drive (HDD) or solid state drive (SSD). In another aspect, the storage device 108 may be configured to be removable. In this case, the storage device 108 may be realized as a memory card. The storage device 108 may store the video and / or photos captured by the camera 105 and the detection information of the Doppler sensor 106.

[0036] In one aspect, the storage device 108 holds location information of a space (e.g., a room, a living room, a hallway, etc. in a home or facility) in which the sensor box 100 is installed. The location information is used to estimate the position and state of a user of the room (e.g., a resident of the home or a resident of the facility, etc.).

[0037] The beacon receiving device 109 includes an array antenna and receives a beacon signal. The beacon signal is transmitted, for example, by the wearable device 400 or another beacon signal transmitting device. In one aspect, the beacon signal includes an identification number of the wearable device. Furthermore, when the beacon receiving device 109 complies with the Bluetooth 5.1 standard, it can calculate the relative direction of the signal from the signal transmitted from the wearable device 400 by an angle of arrival (AoA) method and detect the position of the wearable device 400 in real time.

[0038] In addition, if the wearable device 400 also complies with the Bluetooth 5.1 standard, the wearable device 400 (for example, the wearable device 400A) includes an array antenna, and can calculate the relative direction of a signal from a signal transmitted from another wearable device 400 (for example, the wearable device 400B) using a reception angle method, thereby detecting the position in real time. The wearable device 400A transmits a signal 140 including the detected position information of the wearable device 400B and the identification data of the wearable device 400B, and the sensor box 100 can receive the signal.

[0039] In another aspect, conversely, the wearable device 400B may detect the position of the wearable device 400B by the AoA technique using a signal received from the wearable device 400A. In this case, the wearable device 400B may transmit the identification data and the position information of the wearable device 400A in addition to the identification data and the time data of the wearable device 400B. The transmitted signal 150 may be received by the sensor box 100.

[0040] In one aspect, the control device 101 may store in the storage device 108 a movement history of the care recipient 800 obtained by analyzing both or either one of the video and / or photo and the detection information of the Doppler sensor 106. The movement history of the care recipient 800 includes at least the position information and timestamp of the care recipient 800. In another aspect, the control device 201 may store in the storage device 108 information on the arrangement of furniture in the room 900 obtained by analyzing the video and / or photo.

[0041] The sensor box 100 periodically acquires images and / or photos and detection information of the Doppler sensor 106 from the received signal. The sensor box 100 may then transmit these images and / or photos and detection information of the Doppler sensor 106 to the management device 200. The sensor box 100 may also transmit to the management device 200 a movement history of the care recipient 800 and arrangement information of the bed and other furniture in the living room 900. When transmitting various information to the management device 200, the sensor box 100 may include an identifier that uniquely identifies the living room 900 or the sensor box 100 in the information to be transmitted. The management device 200 can identify which living room 900 information has been received by referring to the identifier included in the received information.

[0042] Signals 140 and 150 include identification information of the wearable device 400, allowing the sensor box 100 to detect who is present in the room 10.

[0043] Furthermore, when the care recipient 800 is receiving care from the caregiver 600, the care recipient 800 may have difficulty moving, and therefore the fluctuation in the movement or state of the care recipient 800 may be smaller than the fluctuation in the movement or state of the caregiver 600. In that case, the fluctuation in acceleration included in the signal 140 transmitted from the wearable device 400A worn by the care recipient 800 may be smaller than the fluctuation in acceleration of the wearable device 400B worn by the caregiver 600.

[0044] Therefore, for example, when the control device 101 detects an image signal of a person in the living room 10 and further detects reception of the signal 140, it may determine that the care recipient 800 is present in the room. In this case, when the fluctuation of the acceleration included in the signal 140 is smaller than a preset threshold value, or when the acceleration hardly changes, the control device 101 may determine that the care recipient 800 is lying down. In this case, when the time when the signal 140 is received by the sensor box 100 is during a sleeping time (for example, from 9:00 p.m. to 7:00 a.m.), it may be determined that the care recipient 800 may be asleep. On the other hand, when the time when the signal 140 is received by the sensor box 100 is during a time period other than the sleeping time period, such as after a meal, the control device 101 may estimate that the care recipient 800 is unable to move his / her body and requires care.

[0045] In another aspect, the control device 101 may detect a person based on a signal from the camera 105, and further receive the signal 140 and the signal 150. In this case, the control device 101 detects that two people are present in the room 10. Furthermore, when the acceleration included in the signal 140 is smaller than the acceleration included in the signal 150, or when the rate of change of the acceleration included in the signal 140 is smaller than the rate of change of the acceleration included in the signal 150, the control device 101 may determine that the caregiver 600 is moving for the care recipient 800. In this case, when images corresponding to the caregiver 600 and the care recipient 800 are detected as one body (connected), the control device 101 may determine that the caregiver 600 is approaching the care recipient 800 to care for the care recipient 800.

[0046] In another aspect, when the distance between the caregiver 600 and the care recipient 800 continues to be equal to or less than a predetermined threshold (e.g., 0.3 m, 0.5 m, etc.) for a certain period of time, the control device 101 may determine that the care recipient 800 is receiving care from the caregiver 600. In this case, the distance between the care recipient 800 and the caregiver 600 may be calculated as the distance between the wearable device 400B and the wearable device 400A, for example, by the AoA method or the like, and may be included in the signal 140A or the signal 150.

[0047] [Management device 200] The management device 200 includes a control device 201 , a ROM 202 , a RAM 203 , a communication interface 204 , a display interface 205 , an operation interface 207 , and a storage device 220 .

[0048] When the management device 200 is connected to the sensor box 100 arranged in the facility, the management device 200 can aggregate information on each of the care recipients 800 obtained from each of the rooms 900 and constantly monitor the condition of each of the care recipients 800. In another aspect, when the sensor box 100 is provided in the home of the care recipient 800, the management device 200 can communicate with the communication interface 104 of the sensor box 100 via an Internet line or a mobile phone line network.

[0049] The control device 201 controls the operation of the management device 200. The control device 201 is configured, for example, by at least one integrated circuit. The integrated circuit is configured, for example, by at least one CPU, at least one ASIC, at least one FPGA, or a combination of these.

[0050] The ROM 202 can store various programs and settings executed by the control device 201. The RAM 203 temporarily holds programs loaded from the ROM 202 or the storage device 220, data generated by the control device 201, or data transmitted from the sensor box 100. The control device 201 executes the programs loaded into the RAM 203.

[0051] The communication interface 204 may include an interface for communicating with other communication devices by wire or wirelessly, and an antenna (not shown). The management device 200 transmits and receives data to and from external communication devices via the communication interface 204. The external communication devices include, for example, the sensor box 100.

[0052] The display interface 205 is connected to a display 206 , and sends an image signal for displaying an image to the display 206 in accordance with a command output from the control device 201 .

[0053] The operation interface 207 accepts connection of an input device 209. The input device 209 is, for example, a mouse, a keyboard, a touch panel, or other device capable of accepting an input operation from a user. The operation interface 207 includes, for example, a Universal Serial Bus (USB) terminal. The operation interface 207 receives a signal output in response to a user operation from the input device 209, and transmits the signal to the control device 201.

[0054] The storage device 220 can hold various information received from the sensor box 100, profile information of the care recipient 800, and profile information of the room 900. The storage device 220 can be realized by, for example, an HDD or an SSD. In another aspect, the storage device 220 may be configured by a memory card, a DVD, or other removable non-volatile data recording medium.

[0055] In one aspect, the control device 201 accepts an input for selecting the care recipient 800 via the operation interface 207. For the selected care recipient 800, the control device 201 may, for example, count the time during which the care recipient 800 received assistance from the caregiver 600 within a certain period (such as one week or one month) based on the data stored in the storage device 220 or the data received from the sensor box 100. Furthermore, the control device 201 may compare the counted time with a predetermined standard for determining the level of care required, measure the daily living activities of the care recipient 800 at that time, and output the measurement result to the display 206. The measurement result may include, for example, a determination result of care required certification expected depending on the assistance time.

[0056] In another aspect, the management device 200 may execute each process executed by the control device 101 of the sensor box 100 by receiving each signal received by the sensor box 100. In this case, the control device 201 of the management device 200 may estimate whether the care recipient 800 is receiving care or not, using the video signal from the camera 105 and each data included in the signal 140 and the signal 150.

[0057] [Mobile terminal 300] The mobile terminal 300 is used by the caregiver 600 to communicate with the management device 200 or other caregivers 600. The mobile terminal 300 includes a control device 301, a RAM 303, a communication interface 304, a display 305, an input device 306, and an internal memory 320.

[0058] The control device 301 controls the operation of the mobile terminal 300. The control device 301 is configured, for example, by at least one integrated circuit. The integrated circuit is configured, for example, by at least one CPU, at least one ASIC, at least one FPGA, or a combination thereof. The RAM 303 temporarily stores programs and the like loaded from the internal memory 320. The control device 301 executes the programs loaded into the RAM 303.

[0059] The communication interface 304 includes a wireless interface and an antenna (not shown). The mobile terminal 300 exchanges data with an external communication device via the antenna and an access point (not shown). The external communication device includes, for example, the sensor box 100, the management device 200, and the mobile terminal 300 used by another caregiver 600.

[0060] The display 305 is realized by, for example, a liquid crystal monitor or an organic EL (Electro Luminescence) monitor. The input device 306 is realized by, for example, a touch sensor overlaid on the display 305. The touch sensor receives a touch operation that provides a command to the mobile terminal 300, and outputs the content of the operation to the control device 301.

[0061] The internal memory 320 is, for example, a storage medium such as an eMMC (Embedded Multimedia Card). As an example, the internal memory 320 stores a program executed by the control device 301, but the program may be stored in a storage device other than the internal memory 320 as long as the storage device is accessible by the control device 301.

[0062] [Wearable Devices 400] The wearable device 400 includes a beacon transmitting device 410, a beacon receiving device 420, a communication interface 403, a storage device 404, a RAM 405, a control device 406, and an acceleration sensor 407.

[0063] The beacon transmitting device 401 transmits a beacon signal using a short-range wireless technology such as BLE (Bluetooth Low Energy). The beacon signal is transmitted at a predetermined time interval or when a transmission instruction is given to the wearable device 400. The transmitted beacon signal is received by the sensor box 100, another wearable device 400, or another beacon signal receiving device.

[0064] The beacon receiving device 402 can receive beacon signals transmitted from other wearable devices 400 or other beacon signal transmitting devices.

[0065] The communication interface 403 communicates with the sensor box 100 using WiFi (Wireless Fidelity) or Bluetooth or other wireless communication methods.

[0066] The storage device 404 stores data in a non-volatile manner. The storage device 404 is realized by, for example, a flash memory. In another aspect, an SD memory card or other removable data recording medium may be used. In one aspect, the storage device 404 stores, for example, identification data of the wearable device. Furthermore, the storage device 404 may sequentially store position information of the other wearable device 400 detected from a signal received from the other wearable device 400 and the detection time.

[0067] The RAM 405 temporarily stores data, including location information of another wearable device 400 detected from a signal received from the other wearable device 400 and the detection time.

[0068] The control device 406 controls the operation of the wearable device 400. The control device 406 is configured, for example, by at least one integrated circuit. The integrated circuit is configured, for example, by at least one CPU, at least one ASIC, at least one FPGA, or a combination thereof.

[0069] The acceleration sensor 407 detects a change in the speed of the up and down movement of the wearable device 400. The detection result is used to calculate the number of steps taken by the user of the wearable device 400.

[0070] [Detection of nursing care status] Detection of the care recipient 800 being cared for by the caregiver 600 will be described with reference to Fig. 3. Fig. 3 is a diagram showing a trajectory of a signal acquired when the care recipient 800 is being cared for by the caregiver 600. The trajectory can be derived from a signal acquired by the sensor box 100 after the caregiver 600 or the care recipient 800 enters a room through the door 390.

[0071] The care recipient 800 is wearing the wearable device 400A. The caregiver 600 is wearing the wearable device 400B. While the caregiver 600 is in close proximity to the care recipient 800, the wearable devices 400A and 400B may emit signals 140 and 150, respectively. In one aspect, the signals 140 and 150 are emitted at predetermined time intervals.

[0072] The signal 140 emitted by the wearable device 400A may include identification data of the wearable device 400A and identification data and location information of the wearable device 400B. The signal 140 emitted by the wearable device 400A may include identification data of the wearable device 400A and identification data and location information of the wearable device 400B. The signal 150 emitted by the wearable device 400B may include identification data of the wearable device 400B and identification data and location information of the wearable device 400A. The signals 140 and 150 are each received by the sensor box 100.

[0073] In the sensor box 100, the control device 101 executes an analysis process using a signal received by the beacon receiving device 109. For example, the control device 101 develops an area of ​​the room 900 in the RAM 103, and plots the identification data and position information of the wearable device 400A and the identification data and position information of the wearable device 400B in the area. In another aspect, when a marker (not shown) visible to the camera 105 is attached to the wearable device 400, the control device 101 may extract the marker from the image area corresponding to the room 900 as the position of the wearable device 400. In this case, the control device 101 may calculate the distance between the marker of the wearable device 400A and the marker of the wearable device 400B as the distance between the caregiver 600 and the care recipient 800.

[0074] Trajectory 351 represents the trajectory of the caregiver 600. Trajectory 352 represents the trajectory of the care recipient 800. When the control device 101 processes the signals 140, 150 at regular time intervals, the trajectories 351, 352 can be expressed as a set of points. In this case, the interval between the points constituting the trajectory 351 and the interval between the points constituting the trajectory 352 can differ depending on the walking speeds of the caregiver 600 and the care recipient 800.

[0075] The area 361 represents an area corresponding to the bed 901 of the care recipient 800. The area 362 represents an area in which it is estimated that the caregiver 600 was close to the care recipient 800 to provide care to the care recipient 800. The area 362 is an area including a trajectory when the distance between the caregiver 600 and the care recipient 800 was a predetermined distance or less (e.g., 50 cm, 75 cm, 1 m, etc.) at each time when the beacon signal was received. The control device 101 can estimate that the caregiver 600 was close to the care recipient 800 to provide care at this time.

[0076] In another aspect, the signal 140 may be transmitted based on the detection that pairing has been performed by the wearable device 400A approaching the wearable device 400B. Like the signal 140, the signal 150 may be transmitted based on the detection that pairing has been performed by the wearable device 400B approaching the wearable device 400A. As a result, when the caregiver 600 is far enough away to be unable to assist the care recipient 800, the signals 140 and 150 are not transmitted, and the sensor box 100 does not receive the signals 140 and 150. When the sensor box 100 receives the signals 140 and 150, it executes a trajectory analysis process, and therefore, while the caregiver 600 and the care recipient 800 are not in close proximity, the signal 140 and 150 are not subject to the analysis process. As a result, the accuracy of detection of the time during which assistance is being performed may be improved.

[0077] Note that a change in acceleration based on vibration of the wearable device 400 may also be detected outside the room 10. In order to accurately estimate the state of the care recipient 800 in the room 10, the control device 101 or the control device 201 may exclude data detected outside the room 10. As an example, in a case where the time when the door of the room 10 is opened is transmitted wirelessly or wired to the sensor box 100, and the signal 140 or the signal 150 transmits a timestamp as time data together with the acceleration and other data, the control device 101 or the control device 201 may exclude the signal 140 or the signal 150 including a timestamp earlier than the time from the estimation target.

[0078] In another aspect, the care recipient 800 may walk down the corridor to return to the room 10. In this case, the acceleration fluctuations contained in the signals 140 and 150 received outside the room 10 may both be similar. This is because the caregiver 600 adjusts the walking speed to that of the care recipient 800 in order to assist the care recipient 800. In such a case, it can be estimated that the care recipient 800 was receiving care from the caregiver 600, and therefore, when the management device 200 detects such a case, it can be estimated that the care recipient 800 was in a state requiring care.

[0079] On the other hand, when the care recipient 800 can walk normally in a common space such as a hallway or a dining room, the acceleration fluctuation may also be large. Therefore, when the management device 200 receives the signal 140 but does not detect the reception of the signal 150, if the management device 200 detects that the acceleration fluctuation included in the signal 140 is larger than a predetermined threshold, the management device 200 can determine that the care recipient 800 is in a state where care is not required.

[0080] In another aspect, when the caregiver 600 and the care recipient 800 are in the room 10, the control device 101 may delete data related to the caregiver 600 during that time in order to accurately estimate the state of only the care recipient 800. For example, when the control device 101 receives a signal 150 from the wearable device 400B of the caregiver 600, the control device 101 may detect the presence of the caregiver 600 from the identification information included in the signal 150. Therefore, the control device 101 may exclude the time during which the signal 150 is received from the data.

[0081] [Data acquired] Data that can be acquired by the measuring device will be described with reference to Fig. 4. Fig. 4 is a diagram showing an overview of data that can be acquired by the measuring device for each of the care recipient 800 and the caregiver 600.

[0082] 4, data can be acquired from each of the care recipient and the caregiver. As described in the output section, the acquireable data includes the moving speed, activity time, number of steps, video, and location information of the care recipient 800, and the assistance time, location information, and video of the caregiver 600. Each data can be acquired by the sensor box 100 or the wearable device 400.

[0083] [Data on caregivers] The moving speed of the care recipient 800 includes a maximum value, an average value, and a median value. For example, the maximum value is the maximum walking speed among the walking speeds observed in a preset period (one day, one week, one month, etc.). The average value is the average value of the walking speeds observed in the period. The median value is the walking speed that is in the middle when the observed walking speeds are sorted in descending (or ascending) order. When the care recipient 800 is outside of the living room (for example, a living room, a toilet or other place other than the care recipient's room at home, a shared space in a facility, etc.), the moving speed of the care recipient 800 is derived from a trajectory and a time stamp obtained based on a signal acquired from the wearable device 400A.

[0084] Furthermore, inside the room, the moving speed can be derived based on an image captured by the camera 105 of the sensor box 100 or a signal received by the beacon receiving device 109. Furthermore, when the care recipient 800 is wearing the wearable device 400A, the moving speed can be calculated using each signal continuously transmitted from the wearable device 400A and the time of reception of each signal.

[0085] The activity time indicates the time per day that the care recipient 800 is active outside the bed 901. The activity time is calculated using the signal received by the sensor box 100 and the area corresponding to the room 900. For example, if an image corresponding to the care recipient 800 is outside the area, the time that the care recipient 800 is outside the area is accumulated to derive the time that the care recipient 800 is active outside the bed 901.

[0086] The number of steps is derived using acceleration detected by the acceleration sensor 407 included in the wearable device 400A.

[0087] The video is captured by the camera 105 of the sensor box 100. The manager can easily recognize the positional relationship between the care recipient 800 and the caregiver 600 by viewing the video.

[0088] The position information can be detected by the sensor box 100 receiving a beacon signal transmitted from the wearable device 400A. In another aspect, the position information can be detected by the wearable device 400B receiving a signal transmitted from the wearable device 400A worn by the care recipient 800. In another aspect, the sensor box 100 can receive a signal transmitted by the wearable device 400A and detect the position of the wearable device 400A by the AoA technique.

[0089] [Data on caregivers] The assistance time is estimated using the time during which the caregiver 600 and the care recipient 800 continue to be in close proximity to each other. For example, the sensor box 100 detects the time during which the caregiver 600 and the care recipient 800 continue to be in close proximity to each other, using a signal received from the wearable device 400A and a signal received from the wearable device 400B. The close proximity state means that the distance between the caregiver 600 and the care recipient 800 is within a certain range, and this can be estimated as the time during which assistance was provided. Therefore, the sensor box 100 derives the time during which this state continued as the assistance time.

[0090] The position information of the caregiver 600 can be detected by the wearable device 400A that receives a signal emitted from the wearable device 400B worn by the caregiver 600. In another aspect, the sensor box 100 can receive a signal emitted by the wearable device 400B and detect the position of the wearable device 400B by the AoA technique.

[0091] The video is captured by the camera 105 of the sensor box 100. By watching the video, the manager can easily recognize the positional relationship between the care recipient 800 and the caregiver 600. In a certain aspect, the assistance time is defined as the sum of the time during which the caregiver 600 and the care recipient 800 are in close proximity to each other. In this case, by watching the video, the manager can confirm whether the calculated assistance time is appropriate for the time during which the assistance was actually performed.

[0092] [Control Structure] The control structure of the monitoring system 20 according to an embodiment will be described with reference to Fig. 5 to Fig. 7. Fig. 5 is a flowchart showing a part of the process executed by the control device 101 of the sensor box 100.

[0093] In step S510, the control device 101 acquires information from the first device. For example, the sensor box 100 receives the signal 140 transmitted by the wearable device 400A via the beacon receiving device 109. The signal 140 includes identification data of the wearable device 400A. The control device 101 associates the time when the signal 140 is received with the signal 140. Thus, the control device 101 can acquire the identification data of the wearable device 400A and the received time information. In another aspect, the signal 140 may include location information of the wearable device 400B detected based on the signal received from the wearable device 400B.

[0094] In step S520, the control device 101 acquires information from the second device. For example, the sensor box 100 receives the signal 150 emitted by the wearable device 400B via the beacon receiving device 109. The signal 150 includes identification data of the wearable device 400B. The control device 101 associates the time when the signal 150 is received with the signal 150. Thus, the control device 101 can acquire the identification data of the wearable device 400B and the received time information. In another aspect, the signal 150 may include location information of the wearable device 400A detected based on the signal received from the wearable device 400A.

[0095] In step S530, the control device 101 acquires information from each sensor. The sensors include a door sensor 510, a toilet sensor 520, an odor sensor 530, and a vital sensor 540. For example, the vital sensor 540 transmits the detected vital signs of the care recipient 800 at predetermined time intervals. The vital signs may include pulse or heart rate, respiratory rate, blood pressure, and body temperature. The door sensor 510, the toilet sensor 520, and the odor sensor 530 transmit a detection signal to the sensor box 100 when a transmission trigger is detected. The transmission trigger is, for example, when the door 390 is opened or closed, when the toilet door is opened or closed, or when an odor is detected.

[0096] In step S540, the control device 101 estimates the states of the caregiver 600 and the care recipient 800 based on the acquired information. For example, the control device 101 detects a state in which the distance between the wearable device 400A and the wearable device 400B is equal to or less than a predetermined distance, using trajectory data representing a change in the position of the wearable device 400A and trajectory data representing a change in the position of the wearable device 400B, and measures the period during which this state continues. Since this state indicates that the caregiver 600 is close to the care recipient 800, it can be estimated that the caregiver 600 is assisting the care recipient 800.

[0097] In step S550, the control device 101 stores status information of the caregiver 600 and the care recipient 800 in the storage device 108. The status information includes, for example, in chronological order, position data of the caregiver 600, position data of the care recipient 800, an estimated distance, and a flag indicating whether the care recipient 800 is receiving assistance from the caregiver 600.

[0098] In step S560, the control device 101 detects that a predetermined time has elapsed. After that, the control device 101 returns the control to step S510 and acquires the position information of the care recipient 800 and the caregiver 600 again.

[0099] [Output of reference information for nursing care certification] The determination of nursing care certification will be described with reference to Fig. 6. Fig. 6 is a flowchart showing a part of the process executed by control device 201 of management device 200 according to an embodiment.

[0100] In step S610, the control device 201 receives a request for care information based on an operation given to the input device 209. More specifically, an administrator or other staff member inputs the name and other identification information of the care recipient 800 and a request for care information of the care recipient 800 to the management device 200.

[0101] In step S620, the control device 201 accesses a database of care information on the care recipient 800 stored in the storage device 220, and acquires the care time for the care recipient 800.

[0102] In step S630, the control device 201 reads out a reference time predetermined for nursing care certification (hereinafter also referred to as "reference time for nursing care certification, etc.") from the storage device.

[0103] In step S640, the control device 201 compares the assistance time with the reference time for nursing care certification, etc., and estimates a nursing care level (for example, support required 1, 2, nursing care required 1 to 5, etc.) to which the assistance time is appropriate.

[0104] In step S650, the control device 201 outputs the result of the nursing care certification estimated as a result of the comparison. For example, the management device 200 displays on the display 206 the name of the care receiver 800 and the result of the certification.

[0105] [Operation of wearable device 400] A control structure of wearable device 400 according to an embodiment will be described with reference to Fig. 7. Fig. 7 is a flowchart showing a part of a process executed by wearable device 400 having a function of estimating the distance to other wearable devices 400. Below, a case where wearable device 400A estimates the distance to wearable device 400B will be described, but the same applies to the reverse case where wearable device 400B estimates the distance to wearable device 400A.

[0106] In step S710, the control device 406 of the wearable device 400A receives a beacon signal transmitted from another device (eg, the wearable device 400B).

[0107] In step S720, the control device 406 uses the beacon signal to estimate the distance to another device (e.g., the wearable device 400B) by the AoA technique.

[0108] In step S730, the control device 406 stores the estimated distance in the storage device 404.

[0109] In step S740, the control device 406 detects that a distance transmission request has been received from the sensor box 100. For example, the sensor box 100 transmits a distance transmission request at a preset time interval (for example, every 10 seconds, every 30 seconds, every minute, etc.).

[0110] In step S750, in response to receiving the transmission request, the control device 406 transmits the distance to the sensor box 100. More specifically, first, the control device 406 accesses the storage device 404, reads the distance acquired after the previous transmission request, and transmits the read distance via the beacon transmitting device 401. The transmitted signal is received by the beacon receiving device 109 of the sensor box 100. In the sensor box 100, the control device 101 can obtain the distance from the received signal and determine whether the caregiver 600 and the care recipient 800 are in close proximity to each other.

[0111] As described above, according to an embodiment, the control device 101 of the sensor box 100 or the control device 201 of the management device 200 can estimate the time during which the caregiver 600 provided care to the care recipient 800, using the image signal acquired by the camera 105, the signal 140 transmitted by the wearable device 400A worn by the care recipient 800, and the signal 150 transmitted by the wearable device 400B worn by the caregiver 600. This allows the usual movements of the care recipient 800 to be understood, providing information for determining the level of care required by the care recipient 800. As a result, the need for care certification can be made based on objective information, and the accuracy of the need for care certification can be improved.

[0112] In addition, the daily life activities of the care recipient 800 are grasped not only in the facility but also in the care recipient's home, so even when the investigator is absent, information for determining the level of care required of the care recipient 800 can be obtained, making it possible to make an objective determination.

[0113] In addition, since the time during which the caregiver 600 provided care is also collected, the burden of care on the care recipient 800 can be ascertained.

[0114] Some of the technical features disclosed in this specification can be summarized, for example, as follows. [Configuration 1] According to one embodiment, a method is provided for providing information for determining the state of a care recipient (e.g., care recipient 800) executed by a computer (e.g., control device 101, control device 201). The method includes a step in which a processor of the computer receives a video signal output from an image sensor provided for capturing an image of the care recipient's room, a step in which the processor receives user identification information (e.g., name, number) and an output of the acceleration sensor (e.g., acceleration, number of steps) from a first communication terminal (e.g., wearable device 400A) having an acceleration sensor and worn by a user (e.g., care recipient 800), and a step in which the state of the care recipient is determined based on the image of the room and the output of the acceleration sensor. The state includes, for example, a state in which the care recipient 800 is receiving care from the caregiver 600 and a state in which the care recipient 800 is able to act independently.

[0115] [Configuration 2] In a method according to a certain aspect, the determining step includes determining that the care recipient is in a state where he or she can act normally based on the output exceeding a predetermined threshold, and determining that the care recipient is in a state where he or she requires care based on the output falling below the threshold.

[0116] [Configuration 3] In a method according to a certain aspect, the signal transmitted by the first communication terminal further includes location information of the first communication terminal. The method further includes a step of receiving, from a second communication terminal (e.g., wearable device 400B) having an acceleration sensor and worn by the other user, identification information of the other user, an output of the acceleration sensor, and location information of the second communication terminal. The determining step includes determining that the care recipient is in a state requiring care when the distance between the user and the other user is less than a predetermined threshold, and determining that the care recipient is in a state capable of normal behavior when the distance is equal to or greater than the predetermined threshold.

[0117] [Configuration 4] In a method according to an aspect, each of the first communication terminal and the second communication terminal includes an array antenna, and location information of the first communication terminal and location information of the second communication terminal are acquired by communication between the first communication terminal and the second communication terminal.

[0118] [Configuration 5] A method according to a certain aspect further includes a step of outputting a judgment result of the level of care required of the care recipient based on a comparison between the judgment result and a predetermined reference time for determining the level of care required.

[0119] [Configuration 6] According to a certain aspect, the method further includes a step of detecting entry into and exit from the room based on the video signal. The determining step includes determining that the care recipient is in a state requiring care based on a time from entry into and exit from the room exceeding a predetermined time when an output of an acceleration sensor from the first communication terminal is equal to or less than a predetermined threshold.

[0120] [Configuration 7] According to another embodiment, there is provided a behavior detection device (e.g., sensor box 100) that detects daily living behavior and other behaviors of a care recipient 800. This behavior detection device includes an input interface that receives an input of a video signal, a receiving device that receives a wireless signal, and a processor (e.g., control device 101) that detects behavior based on the video signal and the wireless signal. The processor receives a video signal output from an image sensor (e.g., camera 105) that is provided to capture an image of the care recipient's room. The processor has an acceleration sensor, and receives user identification information and the output of the acceleration sensor from a first communication terminal (e.g., wearable device 400A) worn by the user. Furthermore, the processor determines the condition of the care recipient based on the image of the room and the output of the acceleration sensor.

[0121] [Configuration 8] In a behavior detection device according to a certain aspect, the determining step includes determining that the care recipient is in a state where he or she can behave normally based on the output exceeding a predetermined threshold, and determining that the care recipient is in a state where he or she requires care based on the output falling below the threshold.

[0122] [Configuration 9] In a behavior detection device according to a certain aspect, the signal transmitted by the first communication terminal further includes location information of the first communication terminal. The processor further receives, from a second communication terminal having an acceleration sensor and worn by the other user, identification information of the other user, an output of the acceleration sensor, and location information of the second communication terminal. The determining includes determining that the care recipient is in a state requiring care when the distance between the user and the other user is less than a predetermined threshold, and determining that the care recipient is in a state capable of normal behavior when the distance is equal to or greater than the predetermined threshold.

[0123] [Configuration 10] In a behavior detection device according to an aspect, each of a first communication terminal and a second communication terminal includes an array antenna. Position information of the first communication terminal and position information of the second communication terminal are acquired by communication between the first communication terminal and the second communication terminal.

[0124] [Configuration 11] In a behavior detection device according to a certain aspect, a processor outputs a judgment result of the level of care required of the care recipient based on a comparison between the judgment result and a predetermined reference time for determining the level of care required.

[0125] [Configuration 12] In the behavior detection device according to a certain aspect, the processor further detects entry into and exit from the room based on the video signal. The determining step includes determining that the care recipient is in a state requiring care based on the time from entry into and exit from the room exceeding a predetermined time when the output of the acceleration sensor from the first communication terminal is equal to or less than a predetermined threshold.

[0126] [Configuration 13] According to another embodiment, there is provided a system (e.g., monitoring system 20) for detecting daily living activities and other activities of a care recipient. This system includes a first communication terminal (e.g., wearable device 400A) having an acceleration sensor, and a sensor device (e.g., sensor box 100) for receiving wireless signals. The sensor device includes a camera (camera 105), a receiving device for receiving the signal, and a processor (control device 101) for executing arithmetic processing using the signal. The processor receives a video signal output from an image sensor installed in the care recipient's room to capture images of the room, receives identification information of the user of the first communication terminal and the output of the acceleration sensor from the first communication terminal, and determines the condition of the care recipient based on the video of the room and the output of the acceleration sensor.

[0127] [Configuration 14] In a system according to a certain aspect, the determining includes determining that the care recipient is in a state where he or she can act normally based on the output exceeding a predetermined threshold, and determining that the care recipient is in a state where he or she requires care based on the output falling below the threshold.

[0128] [Configuration 15] In a system according to a certain aspect, the signal transmitted by the first communication terminal further includes location information of the first communication terminal. The system further includes a second communication terminal having an acceleration sensor. The processor receives, from the second communication terminal, identification information of a user of the second communication terminal, an output of the acceleration sensor, and location information of the second communication terminal. The determining includes determining that the care recipient is in a state requiring care when an interval between the user of the first communication terminal and the user of the second communication terminal is less than a predetermined threshold, and determining that the care recipient is in a state capable of normal behavior when the interval is equal to or greater than the predetermined threshold.

[0129] [Configuration 16] In a system according to an aspect, each of the first communication terminal and the second communication terminal includes an array antenna. The location information of the first communication terminal and the location information of the second communication terminal are acquired by communication between the first communication terminal and the second communication terminal.

[0130] [Configuration 17] In a system according to a certain aspect, the processor outputs a judgment result of the level of care required of the care recipient based on a comparison between the judgment result and a predetermined reference time for determining the level of care required.

[0131] [Configuration 18] In the system according to an aspect, the processor further detects entry into and exit from the room based on the video signal. The determining step includes determining that the care recipient is in a state requiring care based on the time from entry into and exit from the room exceeding a predetermined time when the output of the acceleration sensor from the first communication terminal is equal to or less than a predetermined threshold.

[0132] The embodiments disclosed herein should be considered to be illustrative and not restrictive in all respects. The scope of the present invention is defined by the claims, not the above description, and is intended to include all modifications within the meaning and scope of the claims. [Industrial Applicability]

[0133] The disclosed technical features can be used in the homes of care recipients, facilities where care recipients reside, and other living spaces. [Explanation of symbols]

[0134] 10,900 Room, 20 Surveillance system, 100 Sensor box, 101,201,301,406 Control device, 102,202 ROM, 103,203,303,405 RAM, 104,204,304,403 Communication interface, 105 Camera, 106 Doppler sensor, 107 Wireless communication device, 108,220,404 Storage device, 109,402,420 Beacon receiving device, 140,150 Signal, 200 Management device, 205 Display interface, 206,305 Display, 207 Operation interface, 209,306 Input device, 300 Mobile terminal, 320 Internal memory, 351,352 Trajectory, 361,362 Area, 390 Door, 400,400A,400B Wearable devices, 401, 410 Beacon transmitter, 407 Acceleration sensor, 500 Care call handset, 501 Care call button, 510 Door sensor, 520 Toilet sensor, 530 Sensor, 540 Vital sensor, 600 Caregiver, 800 Care recipient, 901 Bed.

Claims

1. 1. A computer-implemented method for providing information for determining a condition of a care recipient, comprising: receiving an image signal output from an image sensor provided for capturing an image of the room of the care recipient; receiving, from a first communication terminal having an acceleration sensor and worn by a user, identification information of the user and an output of the acceleration sensor; determining a state of the care recipient based on an image of the room and an output of the acceleration sensor; The signal transmitted by the first communication terminal further includes location information of the first communication terminal; The method comprises: The method further includes a step of receiving, from a second communication terminal having an acceleration sensor and worn by another user, identification information of the other user, an output of the acceleration sensor, and location information of the second communication terminal; The determining step includes: determining that the care recipient is in a state requiring care when a distance between the user and the other user is less than a predetermined threshold; and determining that the person being cared for is in a state where he or she can act normally when the interval is equal to or greater than the predetermined threshold.

2. The determining step includes: determining that the care recipient is in a state where he or she can act normally based on the output exceeding a predetermined threshold; The method of claim 1 , further comprising: determining that the care recipient is in a state requiring care based on the output being below the threshold.

3. each of the first communication terminal and the second communication terminal includes an array antenna; The method according to claim 1 , wherein the location information of the first communication terminal and the location information of the second communication terminal are each obtained by communication between the first communication terminal and the second communication terminal.

4. A method according to any one of claims 1 to 3, further comprising a step of outputting a judgment result of the level of care required of the care recipient based on a comparison between the result of the judgment and a predetermined reference time for judging the level of care required.

5. further comprising a step of detecting entry into and exit from the living room based on the video signal, A method according to any one of claims 1 to 4, wherein the determining step includes determining that the care recipient is in a state requiring care based on the time from entry to exit from the room exceeding a predetermined time when the output of an acceleration sensor from the first communication terminal is below a predetermined threshold.

6. an input interface for receiving an input of a video signal; A receiving device for receiving a radio signal; a processor for detecting an activity based on the video signal and the wireless signal; The processor, Receives a video signal output from an image sensor installed to capture an image of the care recipient's room, receiving, from a first communication terminal having an acceleration sensor and worn by a user, identification information of the user and an output of the acceleration sensor; determining a state of the care recipient based on the image of the room and an output of the acceleration sensor; The signal transmitted by the first communication terminal further includes location information of the first communication terminal; The processor further receives, from a second communication terminal having an acceleration sensor and worn by the other user, identification information of the other user, an output of the acceleration sensor, and location information of the second communication terminal; The determining step comprises: determining that the care recipient is in a state requiring care when a distance between the user and the other user is less than a predetermined threshold; A behavior detection device comprising: determining that the care recipient is in a state in which he or she can behave normally when the interval is equal to or greater than the predetermined threshold value.

7. The determining step comprises: determining that the care recipient is in a state where he or she can act normally based on the output exceeding a predetermined threshold; The behavior detection device according to claim 6 , further comprising: determining that the care recipient is in a state requiring care based on the output being lower than the threshold value.

8. each of the first communication terminal and the second communication terminal includes an array antenna; The behavior detection device according to claim 6 , wherein the location information of the first communication terminal and the location information of the second communication terminal are each acquired through communication between the first communication terminal and the second communication terminal.

9. A behavior detection device as described in any one of claims 6 to 8, wherein the processor outputs a judgment result of the level of care required of the care recipient based on a comparison between the result of the judgment and a predetermined reference time for determining the level of care required.

10. The processor further detects entry and exit into the room based on the video signal; A behavior detection device as described in any of claims 6 to 9, wherein the determining step includes determining that the care recipient is in a state requiring care based on the time from entry to exit from the room exceeding a predetermined time when the output of an acceleration sensor from the first communication terminal is below a predetermined threshold.

11. a first communication terminal having an acceleration sensor; a sensor device for receiving a wireless signal, The sensor device comprises: A camera and A receiving device for receiving a signal; a processor that performs a calculation using the signal; The processor, receiving a video signal output from an image sensor installed in the room of the person being cared for to capture an image of the room; receiving, from the first communication terminal, identification information of a user of the first communication terminal and an output of the acceleration sensor; determining a state of the care recipient based on the image of the room and an output of the acceleration sensor; The signal transmitted by the first communication terminal further includes location information of the first communication terminal; The system further comprises a second communications terminal having an acceleration sensor; The processor receives, from the second communication terminal, identification information of a user of the second communication terminal, an output of the acceleration sensor, and location information of the second communication terminal; The determining step comprises: determining that the care recipient is in a state requiring care when a distance between a user of the first communication terminal and a user of the second communication terminal is less than a predetermined threshold; The system includes determining that the person being cared for is in a state where he or she can act normally when the interval is equal to or greater than the predetermined threshold.

12. The determining step comprises: determining that the care recipient is in a state where he or she can act normally based on the output exceeding a predetermined threshold; The system of claim 11, further comprising determining that the care recipient is in a state requiring care based on the output being below the threshold.

13. each of the first communication terminal and the second communication terminal includes an array antenna; The system according to claim 11 , wherein the location information of the first communication terminal and the location information of the second communication terminal are each acquired through communication between the first communication terminal and the second communication terminal.

14. A system according to any one of claims 11 to 13, wherein the processor outputs a judgment result of the level of care required of the care recipient based on a comparison between the result of the judgment and a predetermined reference time for determining the level of care required.

15. The processor further detects entry and exit into the room based on the video signal; A system according to any one of claims 11 to 14, wherein the determining step includes determining that the care recipient is in a state requiring care based on the time from entry to exit from the room exceeding a predetermined time when the output of an acceleration sensor from the first communication terminal is below a predetermined threshold.

Images