CARE MANAGEMENT METHOD, PROGRAM, CARE MANAGEMENT DEVICE, AND CARE MANAGEMENT SYSTEM
The care management system addresses the challenge of high costs and resource inefficiency by selectively uploading images based on detected behaviors, ensuring timely caregiver access to critical video feeds, thus optimizing resource use and response times.
Patent Information
- Application Number
- JP2021534566
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2019-07-19
- Filing Date
- 2020-05-27
- Publication Date
- 2024-11-26
- Estimated Expiration
- 2040-05-27
AI Technical Summary
Existing care management systems face challenges in efficiently managing image uploads to reduce storage and communication costs while ensuring timely caregiver responses to care recipient conditions, particularly in nursing care settings where constant video streaming is impractical and costly.
A care management system that selectively uploads images based on detected behavioral information, initiating video transfer only when necessary, using sensors to identify relevant actions and transmitting requests to imaging devices for immediate upload to caregiver terminals.
This approach reduces storage and communication costs by limiting unnecessary image uploads, ensuring timely and efficient video access for caregivers, thereby optimizing resource utilization and response times.
Smart Images

Figure 0007589685000001 
Figure 0007589685000002 
Figure 0007589685000003
Abstract
Description
[Technical field]
[0001] The present disclosure relates to a care management system that transmits behavioral information of a care recipient and an image of an area associated with the care recipient to a terminal associated with a caregiver. [Background technology]
[0002] Care management systems for providing care to care recipients are becoming widespread. Care management systems detect actions such as getting up or falling by the care recipient and notify the caregiver of the action. This allows the caregiver to rush to the care recipient's side, prevent the care recipient from falling, and provide immediate medical treatment to the care recipient.
[0003] Concerning technology for detecting the behavior of a care recipient, Japanese Patent Application Laid-Open No. 2001-307246 (Patent Document 1) discloses a human body detection device for "fully dealing with various behavioral patterns of a monitored person." Japanese Patent Application Laid-Open No. 2002-230533 (Patent Document 2) discloses an image processing device that "can accurately determine events of getting into bed and getting out of bed using the boundary side that is the bottom side of the bed outline." Republished Patent No. 2017-188156 (Patent Document 3) discloses technology related to a method of outputting a notification sound when a specified event related to a care recipient is detected. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2001-307246 A [Patent Document 2] JP 2002-230533 A [Patent Document 3] Republished Patent No. 2017-188156 Summary of the Invention [Problem to be solved by the invention]
[0005] With the recent development of information and communication technology, some care management systems provide a video of a care recipient to a caregiver located at a location away from the care recipient. In such a care management system, when deciding how to respond to the care recipient, the caregiver can recognize the condition of the care recipient in more detail by checking the video. In the field of care, the condition of the care recipient may require emergency action by the caregiver, or the care recipient may be expected to respond on his / her own, so that no action by the caregiver is required. For this reason, it is ideal for the care management system to be designed so that the video of the care recipient is always provided to the caregiver so that the caregiver can always recognize the condition of the care recipient in detail.
[0006] On the other hand, constantly uploading videos of the care recipients to the server in the care management system is not realistic because the server's required storage capacity would be enormous. In addition, if the care management system charges for the use of communication lines for uploading videos according to the amount of data, constant uploading of videos would result in a significant increase in the running costs of the care management system. Since nursing care costs are covered by the assets of the care recipients, who are socially vulnerable, and / or the assets of public institutions such as the state, the impact of increased costs on society is greater than in other technology fields.
[0007] For these reasons, care management systems should be designed so that the uploading of footage of care recipients is limited to when necessary, but occurs immediately when needed by caregivers.
[0008] The present disclosure has been made in consideration of the above-mentioned circumstances, and has a purpose to provide a technology that enables uploading of video footage of a care recipient to be started at an appropriate time. [Means for solving the problem]
[0009] According to one aspect of the present disclosure, the method includes the steps of: acquiring behavioral information of the care recipient identified based on a detection signal from a sensor related to the care recipient; transmitting the behavioral information to a terminal associated with the caregiver; in response to acquiring the behavioral information, outputting a request to an imaging device that captures an image of an area associated with the care recipient to upload an image captured by the imaging device; and in response to receiving a request to transfer the image from the terminal, starting transfer of the image to the terminal. a step of instructing the imaging device to stop uploading the video when a video transfer request is not received within a given time from the step of outputting the upload request; A method of care management is provided, comprising:
[0010] The step of outputting the upload request may include outputting the upload request to the imaging device without waiting for a transfer request from the terminal.
[0011] The step of outputting the upload request may include outputting the upload request on the condition that it is determined that uploading of the video is necessary based on an attribute of the behavioral information.
[0012] The attributes of the behavioral information may include the type of the behavioral information. The step of outputting the upload request may include outputting the upload request on the condition that it is determined that uploading of the video is necessary based on an attribute of the caregiver.
[0013] The step of outputting the upload request may include outputting the upload request on the condition that it is determined that uploading of the video is necessary based on an attribute of the care recipient.
[0015] The given time may be set based on the characteristics of the caregiver. The step of acquiring behavioral information of the care recipient may include receiving a detection signal from a sensor, and identifying the behavioral information of the care recipient by analyzing the received detection signal.
[0016] The step of acquiring the behavioral information of the care recipient may include receiving the behavioral information of the care recipient from a sensor.
[0017] The sensor may include an imager. According to another aspect of the present disclosure, there is provided a program that, when executed by a computer, causes the computer to implement the above-described care management method.
[0018] According to yet another aspect of the present disclosure, there is provided a care management device comprising a memory storing the above program and a processor configured to execute the program.
[0019] According to yet another aspect of the present disclosure, there is provided a care management system comprising a sensor box that generates a sensor detection signal related to a care recipient, and the above-mentioned care management device, wherein a processor of the care management device acquires behavioral information of the care recipient identified based on the detection signal generated by the sensor box. Effect of the Invention
[0020] According to the present disclosure, when behavioral information of a care recipient is acquired, uploading of a video of an area associated with the care recipient from the imaging device to the care management device can be started without waiting for a transfer request from a terminal associated with the caregiver to the care management device. This can reduce the time from receiving a transfer request in the care management device to starting the transfer. The upload request is sent to the imaging device along with the transmission of behavioral information to the mobile terminal. This causes the video to be uploaded on the condition that an event occurs that predicts the transfer of the video to the imaging device. [Brief description of the drawings]
[0021] [Figure 1] 1 shows an example of the configuration of a care management system. [Diagram 2] FIG. 13 is a diagram for explaining an example of a detection range of a sensor in a room. [Diagram 3]FIG. 2 is a diagram showing an example of a hardware configuration of equipment in each room 10. [Figure 4] FIG. 2 is a diagram illustrating an example of a hardware configuration of a mobile terminal 300. [Diagram 5] FIG. 2 illustrates an example of a hardware configuration of a management server 400. [Figure 6] 13 is a diagram showing an example of a notification screen that the mobile terminal 300 displays on the display 305 in response to receiving a notification from the management server 400. FIG. [Figure 7] FIG. 13 is a diagram showing another example of the notification screen. [Figure 8] FIG. 1 illustrates a first sequence implemented in a care management system. [Figure 9] FIG. 13 illustrates a second sequence implemented in the care management system. [Figure 10] FIG. 11 is a diagram for explaining a specific example of a difference in timing at which video playback starts on mobile terminal 300 between a first sequence and a second sequence. [Figure 11] FIG. 10 is a diagram showing a modification of the second sequence in FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0022] Hereinafter, an embodiment of the care management system will be described with reference to the drawings. In the following description, the same parts and components are denoted by the same reference numerals. Their names and functions are also the same. Therefore, the description thereof will not be repeated.
[0023] [1. Care Management System Configuration] FIG. 1 shows an example of the configuration of a care management system. The care management system shown in FIG. 1 manages information on two or more patients or residents in a facility such as a hospital or elderly welfare facility. In this specification, the care management system is described as a system for managing information on multiple residents (care recipients) in an elderly welfare facility, as an example. Note that the facility to which the care management system is applied may be another type of facility, such as a hospital. The care recipients may be changed to, for example, patients in the hospital.
[0024] The care management system includes sensor boxes 100A, 100B... installed in the rooms of each resident, mobile terminals 300A, 300B... carried by each of staff members 850A, 850B..., and a management server 400. These can communicate with each other via a network N. The management server 400 receives output from each of the sensor boxes 100A, 100B..., generates a notification as necessary based on the output, and transmits the generated notification to each of the mobile terminals 300A, 300B....
[0025] Upon receiving the notification, each of the mobile terminals 300A, 300B, ... displays the information contained in the notification. Each of the staff members 850A, 850B, ... rushes to the room or the like in accordance with the display on the mobile terminal they carry with them and takes the necessary action.
[0026] Each of the sensor boxes 100A, 100B... includes a respective camera 105A, 105B.... Each of the sensor boxes 100A, 100B... can upload images captured by each of the cameras 105A, 105B... to the management server 400. Each of the sensor boxes 100A, 100B... can download and play the uploaded images.
[0027] In this specification, when referring to common characteristics among the sensor boxes 100A, 100B..., the mobile terminals 300A, 300B..., and the staff members 850A, 850B..., the terms "sensor box 100," "mobile terminal 300," and "staff member 850" may be used.
[0028] Instead of sending the notification to the mobile terminal 300 carried by the staff, the management server 400 may send the notification to the mobile terminal 300 carried by an administrator who manages the staff. In the care management system, the administrator may check the notification and then decide whether to have the staff respond to the notification and, if so, which staff member to have respond to the notification.
[0029] The mobile terminal 300 operated by the staff member 850 may be a smartphone or a tablet terminal. The staff member 850 does not need to bring the mobile terminal 300 with him / her when moving to the room to respond to the notification. In this sense, the mobile terminal 300 may be a stationary computer.
[0030] [2. Acquiring information about the person receiving care] 2 is a diagram for explaining an example of a detection range of a sensor in a living room. In the example of FIG. 2, the sensor box 100 is installed on the ceiling CL of the living room 10.
[0031] 2, a range AR generally represents the detection range of a sensor in the sensor box 100. If the sensor is a Doppler sensor, the Doppler sensor detects activities that occur within the range AR. If the sensor is a camera, the camera takes images within the range AR.
[0032] 2, a bed 30 is installed in a room 10, and a sensor in a sensor box 100 generates an output according to the behavior of a resident 20. The resident 20 may operate a care call handset 500. The operation content of the care call handset 500 in each room 10 may be transmitted to the sensor box 100. The room 10 is an example of an area associated with the resident 20.
[0033] [3. Hardware configuration (equipment in the room)] 3 is a diagram showing an example of a hardware configuration of the equipment in each room 10. In each room, a sensor box 100, a care call handset 500, a door sensor 510, a toilet sensor 520, an odor sensor 530, and a vital sensor 540 are installed.
[0034] The sensor box 100 includes a control device 101 , a ROM (Read Only Memory) 102 , a RAM (Random Access Memory) 103 , a communication interface 104 , a camera 105 , a Doppler sensor 106 , a wireless communication device 107 , and a storage device 120 .
[0035] The control device 101 controls the sensor box 100. The control device 101 is configured, for example, by at least one integrated circuit. The integrated circuit is configured, for example, by at least one central processing unit (CPU), at least one application specific integrated circuit (ASIC), at least one field programmable gate array (FPGA), or a combination of these.
[0036] An antenna (not shown) or the like is connected to the communication interface 104. The sensor box 100 exchanges data with an external communication device via the antenna. An example of the external communication device is the management server 400.
[0037] In one implementation, the camera 105 is a near-infrared camera. The near-infrared camera includes an IR (Infrared) projector that projects near-infrared light. By using the near-infrared camera, an image showing the inside of the room 10 can be captured even at night. In another implementation, the camera 105 is a surveillance camera that receives only visible light. In still another implementation, a 3D sensor or a thermography camera may be used as the camera 105. The camera 105 may be configured integrally with the housing of the sensor box 100 or may be configured separately.
[0038] The Doppler sensor 106 is, for example, a microwave Doppler sensor that emits and receives radio waves to detect the behavior (movement) of objects in the room 10. This makes it possible to detect biological information of the resident 20 in the room 10. In one example, the Doppler sensor 106 emits microwaves in the 24 GHz band toward the bed 30 in each room 10 and receives the waves reflected by the resident 20. The reflected waves are Doppler shifted due to the movements of the resident 20. The Doppler sensor 106 can detect the breathing condition and heart rate of the resident 20 from the reflected waves.
[0039] The wireless communication device 107 receives signals from the care call handset 500, the door sensor 510, the toilet sensor 520, the odor sensor 530, and the vital sensor 540, and transmits the signals to the control device 101. For example, the care call handset 500 includes a care call button 501, and when the care call button 501 is operated, it transmits a signal indicating that the operation has been performed to the wireless communication device 107. The door sensor 510, the toilet sensor 520, the odor sensor 530, and the vital sensor 540 each transmit their detection output to the wireless communication device 107.
[0040] The storage device 120 is, for example, a storage medium such as a hard disk or an external storage device. The storage device 120 stores the programs executed by the control device 101 and various data used to execute the programs. The various data may include behavioral information of the resident 20.
[0041] At least one of the above programs and data may be stored in a storage device other than the storage device 120 (for example, a storage area of the control device 101 (e.g., a cache memory, etc.), ROM 102, RAM 103, an external device (e.g., a management server 400, etc.)) as long as the storage device is accessible by the control device 101.
[0042] [4. Tenant behavior information] The above behavioral information will be explained. The behavioral information is, for example, information that indicates that the resident 20 has performed a predetermined behavior. In one example, the predetermined behavior includes four behaviors: "getting up" that indicates that the resident 20 has woken up, "getting out of bed" that indicates that the resident 20 has left the bed, "falling down" that indicates that the resident 20 has fallen down, and "falling down" that indicates that the resident 20 has collapsed.
[0043] In one embodiment, the control device 101 generates behavioral information of the resident 20 associated with each room 10 based on an image captured by a camera 105 installed in each room 10. For example, the control device 101 detects the head of the resident 20 from the image, and detects the resident 20's "getting up," "getting out of bed," "falling," and "falling off" based on the change over time in the size of the detected head of the resident 20. A specific example of generating behavioral information will be described in more detail below.
[0044] First, the storage device 120 stores the area in the room 10 where the bed 30 is located, a first threshold value Th1, a second threshold value Th2, and a third threshold value Th3. The first threshold value Th1 distinguishes the size of the head of the resident between when the resident is in a recumbent position and when the resident is in a sitting position within the area where the bed 30 is located. The second threshold value Th2 distinguishes whether the resident is in a standing position or not based on the size of the head within the room 10 excluding the area where the bed 30 is located. The third threshold value Th3 distinguishes whether the resident is in a recumbent position or not based on the size of the head within the room RM excluding the area where the bed 30 is located.
[0045] The control device 101 extracts a moving object region as a human region of the resident 20 from the target image, for example, by background subtraction or frame subtraction. The control device 101 further extracts the head region of the resident 20 from the extracted moving object region, for example, by a circular or elliptical Hough transform, by pattern matching using a head model prepared in advance, and by using a threshold value derived by a neural network trained for head detection. The control device 101 detects "getting up," "getting out of bed," "falling over," and "falling down" from the position and size of the extracted head.
[0046] The control device 101 may determine that the action "getting up" has occurred when it detects that the position of the head extracted as described above is within the location area of the bed 30 and that the size of the head extracted as described above has changed from the size of a lying position to the size of a sitting position by using a first threshold value Th1.
[0047] The control device 101 may determine that the action "getting out of bed" has occurred when the position of the head extracted as described above moves from within the area where the bed 30 is located to outside the area where the bed 30 is located, and when it detects that the size of the head extracted as described above has changed from a certain size to the size of an upright position by using the second threshold value Th2.
[0048] The control device 101 may determine that the behavior of "falling" has occurred when the position of the head extracted as described above moves from within the area where the bed 30 is located to outside the area where the bed 30 is located, and when the size of the head extracted as described above changes over time from a certain size to the size of a lying position by using a third threshold value Th3.
[0049] The control device 101 may determine that the action of "falling" has occurred if it detects that the position of the head extracted as described above is located within the room 10 excluding the area where the bed 30 is located, and that the size of the extracted head has changed from a certain size to the size of a lying position by using a third threshold value Th3.
[0050] As described above, in one specific example, the control device 101 of the sensor box 100 generates behavioral information of the resident 20. Note that in the care management system, other elements may generate behavioral information of the resident 20 using images of the inside of the room 10. In the sensor box 100, the camera 105 is an example of an "imaging device." The Doppler sensor 106 in the sensor box 100 is an example of a "sensor," and various sensors such as a vital sensor connected to the sensor box 100 are other examples of "sensors." The sensor box 100 transmits the behavioral information to the management server 400. The management server 400 is an example of a "care management device."
[0051] In another specific example, the sensor box 100 may transmit detection signals from various sensors to the management server 400, and the management server 400 may generate behavior information using the detection signals transmitted from the sensor box 100.
[0052] The management server 400 generates a notification using the behavior information from the sensor box 100 or the behavior information generated based on the detection signal from the sensor box 100, and transmits the generated notification to the mobile terminal 300. As a result, when the sensor box 100 detects a behavior such as getting up of the resident or an action (pressing) on the care call button 501, the behavior is notified to the mobile terminal 300. Some behavior information is generated according to an operation by the resident, such as pressing the care call button 501, and other information is generated without requiring an operation by the resident, such as "getting up" generated based on a detection signal from the camera 105, etc.
[0053] [5. Hardware configuration (mobile terminal)] 4 is a diagram showing an example of a hardware configuration of the mobile terminal 300. The mobile terminal 300 includes a control device 301, a RAM 303, a communication interface 304, a display 305, an input device 306, and an internal memory 320.
[0054] The control device 301 controls the mobile terminal 300. The control device 301 is configured, for example, by at least one integrated circuit. The integrated circuit is configured, for example, by at least one CPU, at least one ASIC, at least one FPGA, or a combination thereof.
[0055] An antenna (not shown) and the like are connected to the communication interface 304. The mobile terminal 300 exchanges data with an external communication device via the antenna and the access point. The external communication device is, for example, the sensor box 100.
[0056] The display 305 is realized by, for example, an organic EL (Electro Luminescence) display. The input device 306 is realized by, for example, a touch sensor overlaid on the display 305. The touch sensor accepts various operations on the mobile terminal 300 by touch operations, and outputs the contents of the operations to the control device 301.
[0057] The built-in memory 320 is a storage medium such as an eMMC (Embedded MultiMediaCard). As an example, the built-in memory 320 stores a program executed by the control device 301, but the program may be stored in a storage device other than the built-in memory 320 as long as the storage device is accessible by the control device 301.
[0058] [6. Hardware configuration (Management Server)] 5 is a diagram showing an example of a hardware configuration of the management server 400. The management server 400 includes a control device 401, a ROM 402, a RAM 403, a communication interface 404, and a storage device 420.
[0059] The control device 401 controls the management server 400. The control device 401 is configured, for example, by at least one integrated circuit. The integrated circuit is configured, for example, by at least one CPU, at least one ASIC, at least one FPGA, or a combination of these.
[0060] An antenna (not shown) or the like is connected to the communication interface 404. The management server 400 exchanges data with an external communication device via the antenna. The external communication device includes, for example, the sensor box 100.
[0061] The storage device 420 is, for example, a storage medium such as a hard disk or an external storage device. In one implementation example, the storage device 420 stores a program executed by the control device 401, but the program may be stored in another storage device accessible by the control device 401. The program may be stored in a recording medium that is detachable from the main body of the management server 400. The storage device 420 includes a resident information area 421, a staff information area 422, and a data area 423.
[0062] Attributes of each resident may be stored in the resident information area 421. In one implementation, the resident attributes include name, age, level of care required, care record, room number (assigned to each room), and sensor box information (assigned to each sensor box).
[0063] Attributes of each staff member may be stored in the staff information area 422. In one implementation example, the attributes of the staff member include name, age, years of experience in nursing care, years of employment at the facility to which the care management system is applied, history of dealing with residents at the facility, and work shifts.
[0064] The data area 423 may store programs executed by the processor of the control device 401 and / or data used in processes performed by the management server 400.
[0065] [7.Notification screen] FIG. 6 is a diagram showing an example of a notification screen that the mobile terminal 300 displays on the display 305 in response to receiving a notification from the management server 400. As shown in FIG.
[0066] The notification screen 600 includes a menu bar area 601, a resident name area 602 that displays the room number and name of the resident corresponding to the notification, an elapsed time area 603 that indicates the time that has elapsed since the notification was sent from management server 400, and an information area 604 that displays information such as the type of notification. In addition to the type of notification ("Fall" and the icon representing a fall in FIG. 6), the information area 604 displays a "Respond" button 605 and a "Watch Video" button 606.
[0067] The notification sent from the management server 400 to the mobile device 300 may include information (sensor box information) indicating which sensor box's detection signal the behavior information on which the notification is based is based. The room number and name displayed in the resident name area 602 may be the room number and name of the resident associated with the sensor box on which the notification is based.
[0068] The mobile terminal 300 may include a timer. The time displayed in the elapsed time area 603 may be the elapsed time measured by the timer from when the notification is received from the management server 400.
[0069] The notification transmitted from the management server 400 to the mobile device 300 may include the type of behavioral information on which the notification is based (such as “getting up,” “getting out of bed,” “falling down,” “stumbling over,” and “operating the care call button”). The type of notification displayed in the information area 604 may be the type of behavioral information included in the notification transmitted from the management server 400.
[0070] When the mobile terminal 300 detects an operation on the "Respond" button 605, the mobile terminal 300 may notify the management server 400 that the staff member 850 carrying the mobile terminal 300 will respond to the notification. When the notification is received, the management server 400 may instruct the mobile terminal 300 to stop displaying a notification screen corresponding to the notification. That is, in the care management system, when a certain notification is transmitted to multiple mobile terminals 300, a notification screen may be displayed on the multiple mobile terminals 300. When the staff member 850 inputs an intention to respond to the notification to at least one mobile terminal 300, the display of the notification screen on the multiple mobile terminals 300 may end.
[0071] When the mobile terminal 300 detects an operation on the "view video" button 606, it may transmit to the management server 400 a request for a video of the room corresponding to the notification.
[0072] Fig. 7 is a diagram showing another example of the notification screen. The notification screen 700 in Fig. 7 displays a video of the living room as a result of operating the "View Video" button 606 on the notification screen 600 in Fig. 6. More specifically, the information area 604 of the notification screen 700 includes a frame 701 that displays a video captured by the camera 105 of the sensor box 100.
[0073] [8. Sequence] In the care management system, one of two types of sequences may be executed depending on the type of notification sent to the mobile terminal 300. An example of the first type of notification is a notification based on the behavioral information "wake up". In one implementation example, for this type of notification, the staff can often determine whether or not a response to the behavioral information is necessary and / or the content of the response without viewing the video of the room. An example of the second type of notification is a notification based on the behavioral information "fall". In one implementation example, for this type of notification, the staff often determines whether or not a response is necessary by determining from the video of the room whether the resident is in a state where he or she can immediately stand up by himself or herself or needs assistance from the staff. The two types of sequences will be described below.
[0074] (1) First sequence Fig. 8 is a diagram showing a first sequence performed in the care management system. In Fig. 8, the left side shows a process executed by the sensor box 100, the center shows a process executed by the management server 400, and the right side shows a process executed by the mobile terminal 300. The processes of the sensor box 100, the management server 400, and the mobile terminal 300 may be realized by a CPU in each control device executing a given program, or may be realized by a dedicated electric circuit in each control device.
[0075] In step S100, the sensor box 100 transmits to the management server 400 detection signals from various sensors (the Doppler sensor 106, the vital sign sensor 540, the camera 105, the care call button 501, etc.).
[0076] In step S200, the management server 400 receives the detection signal, generates behavior information using the detection signal, and generates a notification based on the behavior information.
[0077] In step S210, the management server 400 transmits to the mobile terminal 300 the notification generated in step S200.
[0078] In step S300, mobile terminal 300 acquires a video request in response to the notification transmitted from management server 400. More specifically, mobile terminal 300 displays a notification screen corresponding to the notification transmitted from management server 400, and detects an operation on "Watch Video" button 606 on the notification screen. The detection of an operation on "Watch Video" button 606 is an example of acquiring a video request.
[0079] In step S310, mobile terminal 300 transmits a video request corresponding to the notification transmitted in step S210 to management server 400. In one implementation example, the “video request” transmitted from mobile terminal 300 to management server 400 refers to a request to transfer the video captured by camera 105.
[0080] In response to receiving the video request, in step S220, the management server 400 transmits a request to upload a video of the room to the sensor box 100. The request in step S220 is transmitted to the sensor box of the room corresponding to the notification transmitted in step S220.
[0081] In step S110 , the sensor box 100 starts uploading the video captured by the camera 105 to the management server 400 .
[0082] In step S230, the management server 400 starts transferring the video uploaded from the sensor box 100 to the mobile terminal 300.
[0083] In step S320, the mobile terminal 300 starts playing the video whose transfer began in step S230.
[0084] (2) Second sequence Fig. 9 is a diagram showing a second sequence performed in the care management system. In Fig. 9, the processing of the sensor box 100, the management server 400, and the mobile terminal 300 may be realized by the CPU in each control device executing a given program, or may be realized by a dedicated electric circuit in each control device.
[0085] 9, the management server 400 transmits a notification to the mobile terminal 300 in step S210, and transmits an upload request to the sensor box 100 in step S220. The transmission of the upload request to the sensor box 100 in step S220 is performed in response to the generation of behavioral information. That is, in step S220, the management server 400 transmits an upload request to the sensor box 100 without waiting for a video request from the mobile terminal 300. The transmission of the upload request in step S220 occurs in conjunction with the transmission of the notification in step S210. The transmission of the upload request may be performed prior to the transmission of the notification, as long as it has been decided that the notification should be transmitted.
[0086] The "generation" of the behavioral information is an example of the "acquisition" of the behavioral information. Instead of generating the behavioral information in the management server 400, the management server 400 may "acquire" the behavioral information by receiving the behavioral information from an external device such as the sensor box 100.
[0087] In response to the upload request from the management server 400, the sensor box 100 starts uploading the video in step S110. The uploaded video is stored in the management server 400.
[0088] In response to receiving the video request from the mobile terminal 300 (step S310), the management server 400 starts transferring the uploaded video to the mobile terminal 300 in step S230.
[0089] In step S320, the mobile terminal 300 starts playing the video transferred from the management server 400.
[0090] In Fig. 9, for comparison, the timings of steps S110, S220, and S320 in Fig. 8 are indicated by dashed lines. Compared to the first sequence in Fig. 8, in the second sequence in Fig. 9, the management server 400 transmits an upload request to the sensor box 100 at an earlier timing. As a result, compared to the first sequence, in the second sequence, the sensor box 100 starts uploading video at an earlier timing. As a result, the management server 400 can start transferring video to the mobile terminal 300 in a shorter time after receiving a video request from the mobile terminal 300. Therefore, the mobile terminal 300 can start playing video at an earlier timing.
[0091] Furthermore, in the second sequence, the sensor box 100 starts uploading video at an earlier timing compared to the first sequence, so that video representing a situation at an earlier timing can be provided to the mobile terminal 300.
[0092] As described above with reference to FIG. 9, the management server 400 generates (or receives) behavioral information in step S200, sends a notification including the behavioral information to the mobile terminal 300 in step S210, sends an upload request to the sensor box 100 in step S220, and starts transferring video to the mobile terminal 300 in response to the request from the mobile terminal 300 in step S310 in step S230.
[0093] As further described with reference to Fig. 8, the care management system may execute one of two types of sequences depending on the type of notification. The care management system may execute the sequence of Fig. 9 regardless of the type of notification. That is, the management server 400 may request the sensor box 100 to upload video in response to sending a notification to the mobile terminal 300 regardless of the type of notification, regardless of whether a video request has been acquired from the mobile terminal 300.
[0094] Whether the first or second sequence is executed, i.e., whether the management server 400 waits for a video request from the mobile terminal 300 before sending an upload request or sends an upload request without waiting for a video request from the mobile terminal 300, may be determined based on the attributes of the staff member who owns the mobile terminal 300 to which the management server 400 sent the notification.
[0095] For example, the response history stored in the staff information area 422 may include information indicating whether or not the staff operated the "watch video" button 606 before operating the "respond" button 605. This information is an example of a staff attribute.
[0096] Operating the "Watch Video" button 606 before operating the "Respond" button 605 means that the staff member will decide to respond to the notification after viewing the video of the room. The management server 400 may execute the second sequence if the staff member working at the time of sending the notification includes a staff member who has previously viewed the video of the room and then decided to respond to the notification. The management server 400 may execute the first sequence if the staff member working at the time of sending the notification does not include such a staff member.
[0097] Another example of a staff attribute is the length of service of the staff. The management server 400 may execute the second sequence if the length of service of all staff working at the time of sending the notification is less than a given number of years, and execute the first sequence if the length of service is equal to or greater than the given number of years. In this way, the second sequence may be executed when the length of service of the staff is relatively short and there is a high possibility that the staff will check the video of the room to determine whether or not a response is required, and the first sequence may be executed when such a possibility is low.
[0098] Whether the first sequence or the second sequence is executed may be determined based on the attributes of the resident corresponding to the notification sent from the management server 400 to the mobile terminal 300.
[0099] An example of a resident's attribute is the level of care required. The management server 400 may execute a first sequence when the level of care required of the resident corresponding to the notification is relatively high (e.g., level 4 or higher), and may execute a second sequence when the level of care required is relatively low (e.g., level 3 or lower). This allows the uploading of video to be efficiently started when the staff is likely to decide to respond to a notification from a resident with a high level of care required without checking the video of the room, and when the staff is likely to decide whether or not to respond to a notification from a resident with a low level of care required after checking the video of the room.
[0100] Whether the first sequence or the second sequence is executed may be determined based on an attribute of the behavioral information.
[0101] An example of an attribute of the behavior information is the time when the behavior caused by the behavior information occurred. The data area 423 stores information (hereinafter, also referred to as "congestion information") that specifies a time period when congestion is predicted on the communication lines connecting elements (between the sensor box 100 and the management server 400, between the management server 400 and the mobile terminal 300) in the care management system. The management server 400 may execute a second sequence when the time when the behavior occurred is included in the time period specified by the congestion information, and may execute a first sequence when the time is not included in the time period specified by the congestion information.
[0102] Whether the first sequence or the second sequence is executed may be determined according to conditions derived by machine learning using various data. For example, when a correlation is obtained between the type of behavioral information and information indicating whether the staff viewed the video before deciding on the response by machine learning using past response history, etc., the management server 400 may use the correlation to determine whether the first sequence or the second sequence is executed. More specifically, when an insight (correlation) is obtained by machine learning that "in the case of behavioral information 'falling', the staff will determine whether or not to respond without viewing the video at a probability of 90%", the management server 400 may execute the first sequence if the behavioral information related to the notification is "falling". When an insight is obtained by machine learning that "in the case of behavioral information 'operating the care call button', the staff will determine whether or not to respond after viewing the video at a probability of 85%", the management server 400 may execute the second sequence if the behavioral information related to the notification is "operating the care call button".
[0103] In the examples of Figures 8 and 9, the management server 400 generates behavior information using the detection signal from the sensor box 100, but the sensor box 100 may generate behavior information and transmit the behavior information to the management server 400 instead of or together with the detection signal.
[0104] [9. Specific examples of timing] Fig. 10 is a diagram for explaining a specific example of a difference in timing of starting video playback on the mobile terminal 300 between the first sequence and the second sequence. In the example of Fig. 10, a delay may occur between the start of uploading video and the start of transfer as a result of processing capabilities related to communication between the sensor box 100, the mobile terminal 300, and the management server 400. More specifically, in the example of Fig. 10, a delay of about 5 seconds may occur between the start of uploading by the sensor box 100 and the start of transfer by the management server 400, and a delay of about 5 seconds may occur between the start of transfer by the management server 400 and the start of playback by the sensor box 100.
[0105] 10 will be described starting with the second sequence. In the second sequence, when a notification is generated at 12:00:00 (time "12:00:00" in FIG. 10), the management server 400 transmits the notification to the mobile terminal 300 at that time and also transmits a video upload request to the sensor box 100. The sensor box 100 starts uploading the video to the management server 400 upon receiving the upload request.
[0106] 10, the staff member operates the "view video" button 606 on the mobile terminal 300 10 seconds after receiving the notification. As a result, at 12:00:10, the mobile terminal 300 transmits a video request to the management server 400. Upon receiving the video request, the management server 400 starts transferring the video uploaded from the sensor box 100.
[0107] The mobile terminal 300 can start playing the video 5 seconds after the transfer from the management server 400 starts, that is, at 12:00:15.
[0108] On the other hand, in the first sequence, the management server 400 transmits a notification to the mobile terminal 300 at 12:00:00 and then waits for a video request from the mobile terminal 300.
[0109] When the management server 400 receives the video request from the mobile terminal 300 at 12:00:10, it transmits an upload request to the sensor box 100. In response to receiving the upload request, the sensor box 100 starts uploading the video to the management server 400.
[0110] The management server 400 becomes capable of transferring the video to the mobile terminal 300 5 seconds after the sensor box 100 starts uploading the video, that is, at 12:00:15.
[0111] The mobile terminal 300 is able to play back the video 5 seconds after the management server 400 starts transferring the video, that is, at 12:00:20.
[0112] Compared to the first sequence, in the second sequence, when the management server 400 receives a video request from the mobile terminal 300, it can transfer the video that has already been uploaded from the sensor box 100. In the second sequence, after receiving the video request, playback of the video can be started on the mobile terminal 300 without waiting for the delay time of uploading from the sensor box 100 to the management server 400. In other words, in the second sequence, playback of the video on the mobile terminal 300 can be started earlier by the delay time of uploading from the sensor box 100 to the management server 400.
[0113] Also, in the first sequence, the video provided to mobile terminal 300 is from 12:00:10 onwards, whereas in the second sequence, the video is from 12:00:00 onwards. That is, in the second sequence, the video from the time the notification is transmitted to the time the video request is transmitted, which is not provided to mobile terminal 300 in the first sequence, can be provided to mobile terminal 300.
[0114] [10. Request to cancel upload] Fig. 11 is a diagram showing a modified example of the second sequence of Fig. 9. In the example of Fig. 11, after sending an upload request to the sensor box 100, if the management server 400 does not receive a video request from the mobile terminal 300 for a given period of time or more, the management server 400 instructs the sensor box 100 to stop uploading the video.
[0115] More specifically, if no video request is received from the mobile terminal 300 for a given period of time after sending an upload request to the sensor box 100 in step S220, then in step S222, an upload stop instruction is sent to the sensor box 100. In response to this, in step S112, the sensor box 100 ends the video upload.
[0116] The given time may be fixed or may be set based on the attributes of the staff member currently working. For example, the response history stored in the staff information area 422 may include information indicating whether the staff member operated the "Watch Video" button 606 before operating the "Respond" button 605. Such information is an example of a staff member's attribute. If the staff member currently working at the time of sending the notification in step S200 includes a staff member who has previously viewed a video of the room and then decided to respond to the notification, the management server 400 may set the "predetermined time" to be longer than if the staff member does not include such a staff member.
[0117] Another example of a staff attribute is the length of service of the staff. The management server 400 may set the "predetermined time" to be longer when the length of service of all staff working at the time of sending the notification is less than the given number of years than when the length of service is equal to or greater than the given number of years. This allows the management server 400 to wait for a longer time for a video request from the mobile terminal 300 to promptly start video playback by the second sequence when less experienced staff are working.
[0118] Each embodiment disclosed herein should be considered to be illustrative and not restrictive in all respects. The scope of the present invention is indicated by the claims, not by the above description, and is intended to include all modifications within the meaning and scope of the claims. In addition, the inventions described in the embodiments and each modified example are intended to be implemented, as far as possible, either alone or in combination. [Explanation of symbols]
[0119] 10 Room, 20 Resident, 30 Bed, 100, 100A, 100B Sensor box, 300, 300A, 300B Mobile terminal, 400 Management server, 500 Care call handset, 501 Care call button, 600, 700 Notification screen, 605 "Respond" button, 606 "View video" button, 701 Frame, 850, 850A, 850B Staff.
Claims
1. acquiring behavioral information of the care recipient identified based on a detection signal of a sensor related to the care recipient; transmitting the behavioral information to a terminal associated with a caregiver; outputting, in response to acquisition of the behavioral information, a request to upload an image captured by an imaging device that captures an image of an area associated with the care recipient; in response to receiving a request to transfer the video from the terminal, starting to transfer the video to the terminal; A care management method comprising: if a request to transfer the video is not received within a given time from the step of outputting the upload request, a step of instructing the imaging device to stop uploading the video.
2. The care management method according to claim 1 , wherein the step of outputting the upload request includes outputting the upload request to the imaging device without waiting for the transfer request from the terminal.
3. The care management method according to claim 1 or claim 2, wherein the step of outputting the upload request includes outputting the upload request on the condition that it is determined that uploading the video is necessary based on attributes of the behavioral information.
4. The method of claim 3 , wherein the attributes of the behavioral information include a type of the behavioral information.
5. A care management method as described in any one of claims 1 to 4, wherein the step of outputting the upload request includes outputting the upload request on the condition that it is determined that uploading the video is necessary based on the attributes of the caregiver.
6. A care management method as described in any one of claims 1 to 5, wherein the step of outputting the upload request includes outputting the upload request on the condition that it is determined that uploading the video is necessary based on the attributes of the care recipient.
7. The method of care management according to any one of claims 1 to 6, wherein the given time is set based on a characteristic of the caregiver.
8. The step of acquiring behavioral information of the care recipient includes: receiving the detection signal from the sensor; The care management method according to any one of claims 1 to 7, further comprising: identifying behavioral information of the care recipient by analyzing the received detection signal.
9. The care management method according to any one of claims 1 to 7, wherein the step of acquiring the behavioral information of the care recipient includes receiving the behavioral information of the care recipient from the sensor.
10. The method of care management according to any one of claims 1 to 9, wherein the sensor comprises the imaging device.
11. A program that, when executed by a computer, causes the computer to realize the care management method according to any one of claims 1 to 10.
12. A memory for storing the program according to claim 11; A processor configured to execute the program.
13. A sensor box for generating a detection signal of a sensor relating to a care recipient; A care management system comprising the care management device according to claim 12, A care management system in which a processor of the care management device acquires behavioral information of the care recipient identified based on the detection signal generated by the sensor box.
Citation Information
Patent Citations
Human body sensor
JP2001307246A
Image processing device
JP2002230533A
Nurse call system
JP2015126361A
Central processing unit for observed person monitoring system, central processing method and observed person monitoring system
JP2018025969A
Notification system
WO2015037542A1
