Information processing device, program, computer-readable recording medium, information processing system, and information processing method

Abstract

To provide an information processing apparatus configured to display data for supporting appropriate review of a rehabilitation plan, a program, a computer-readable recording medium, an information processing system, and an information processing method.SOLUTION: An information processing apparatus includes: an acquisition unit which acquires first data obtained by recording daily activity of a cared person, and second data obtained by recording rehabilitation activity of the cared person, for each predetermined rehabilitation item; and a display unit which displays the first data and a designated rehabilitation item of the second data so as to be compared to each other.SELECTED DRAWING: Figure 9

Description

Technical Field

[0001] This technology relates to an information processing apparatus, a program, a computer-readable recording medium, an information processing system, and an information processing method.

Background Art

[0002] In a nursing facility, a rehabilitation plan is formulated for each care recipient, and rehabilitation is carried out. In order to update the rehabilitation plan at any time, the details of the rehabilitation performed for each care recipient are recorded (for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] When recording the details of rehabilitation, even when the same rehabilitation is performed, it may be recorded in different description methods by different recorders. Also, there is not always sufficient means for accurately and simply reviewing the rehabilitation plan while referring to the details of the rehabilitation performed. As a result, the rehabilitation plan may not be appropriately reviewed.

[0005] An object of this technology is to provide an information processing apparatus, a program, a computer-readable recording medium, an information processing system, and an information processing method that enable the display of data for assisting in appropriately reviewing a rehabilitation plan.

Means for Solving the Problems

[0006] According to one aspect of this technology, the information processing device includes an acquisition unit that acquires first data obtained by recording the daily activities of the person receiving care and second data obtained by recording the person receiving care's rehabilitation activities for each predetermined rehabilitation item, and a display unit that displays the first data and the specified rehabilitation item from the second data in a comparative manner.

[0007] Preferably, outputting in a comparative manner includes displaying the first data and the second data overlaid on top of each other.

[0008] Preferably, the first data includes information on changes over time for predetermined indicators. The second data includes information on changes over time for predetermined rehabilitation items.

[0009] Preferably, the first data includes at least one of the following indicators of the person being cared for: sleep duration, sleep state, number of times waking up, number of times getting out of bed, heart rate, and respiratory rate.

[0010] Preferably, recording the daily activities of the person receiving care includes obtaining the person receiving care's biometric information, posture information, or location information.

[0011] Preferably, the second data includes either the number of times or the amount of rehabilitation items performed.

[0012] Preferably, recording the rehabilitation activities of a person receiving care includes inputting the rehabilitation activities of the person receiving care into an information processing device according to predetermined items.

[0013] Preferably, the information processing device is a terminal device, and the acquisition unit acquires first data and second data from a server device that is communicatively connected to the terminal device.

[0014] In accordance with other aspects of this disclosure, the program causes the processor of the information processing device to perform the steps of: acquiring first data obtained by recording the daily activities of the person being cared for and second data obtained by recording the person being cared for for each predetermined rehabilitation item; and displaying the first data and the specified rehabilitation items from the second data in a comparative manner.

[0015] In accordance with yet another aspect of this disclosure, the recording medium is computer-readable and stores the aforementioned program.

[0016] In accordance with further aspects of this disclosure, the information processing system comprises a recording device for recording the activities of a person receiving care, a server device for acquiring the recording results from the recording device, and a terminal device capable of communicating with the server device. The terminal device acquires from the server device first data obtained by recording the daily activities of the person receiving care and second data obtained by recording the rehabilitation activities of the person receiving care for each predetermined rehabilitation item, and displays the first data and the specified rehabilitation item from the second data in a comparative manner.

[0017] In accordance with yet another aspect of this disclosure, the information processing method comprises the steps of acquiring first data obtained by recording the daily activities of a person receiving care and second data obtained by recording the rehabilitation activities of a person receiving care for each predetermined rehabilitation item, and displaying the first data and the specified rehabilitation items from the second data in a comparative manner. [Effects of the Invention]

[0018] According to this technology, by displaying the first data obtained by recording the daily activities of the care recipient and the second data obtained by recording the rehabilitation activities of the care recipient in a comparable manner, it is possible to support an appropriate review of the rehabilitation plan. Here, by recording rehabilitation activities for each predetermined item, it is possible to suppress variations in the entry formats for each recorder and obtain highly reliable second data.

Brief Description of the Drawings

[0019] [Figure 1] It is a diagram showing an example of the configuration of a rehabilitation support system. [Figure 2] It is a diagram showing an example of an overview of the action record or activity record of the user 800 in the living room 900. [Figure 3] It is a diagram showing an example of the hardware configuration of the sensor box 100 and the mobile terminal 300A. [Figure 4] It is a diagram showing an example of the hardware configuration of the server device 200. [Figure 5] It is a diagram showing an example of the action record of the user 800 in the living room 900. [Figure 6] It is a diagram showing an example of the action record of the user 800 in the rehabilitation room 950. [Figure 7] It is a diagram showing an example of a method for estimating the posture (estimating the type of action) of the user 800 in the rehabilitation support system. [Figure 8] It is a functional block diagram for explaining the functional configurations of the sensor box 100, the server device 200, and the terminal device 300 that constitute the rehabilitation support system. [Figure 9] It is a diagram for explaining the operation of the terminal device 300 during the implementation of rehabilitation in a certain aspect. [Figure 10] It is a diagram (part 1) showing the screen displayed on the display 305 of the terminal device 300 in a certain aspect. [Figure 11]This is a diagram (part 2) showing the screen displayed on the display 305 of the terminal device 300 in a particular situation. [Figure 12] This is a sequence diagram showing the processing flow executed in the rehabilitation support system. [Modes for carrying out the invention]

[0020] Embodiments of this technology are described below. Note that the same or corresponding parts may be denoted by the same reference numerals, and their descriptions may not be repeated.

[0021] In the embodiments described below, when numbers or other similar elements are mentioned, the scope of this technology is not necessarily limited to those numbers or similar elements unless otherwise specified. Furthermore, in the embodiments described below, each component is not necessarily essential to this technology unless otherwise specified.

[0022] <System Configuration> Referring to Figures 1 and 2, the overall structure of the rehabilitation support system (information processing system) will be explained. The rehabilitation support system according to this embodiment is intended to be used mainly in residences for the elderly, special nursing homes, and care facilities (hereinafter collectively referred to as "facilities"). In the following explanation, those receiving care within a facility will be referred to as "users," and those performing caregiving tasks within a facility will be referred to as "staff."

[0023] Figure 1 shows an example of the configuration of a rehabilitation support system according to this embodiment. Referring to Figure 1, the rehabilitation support system includes a sensor box 100, a server device 200, and a terminal device 300.

[0024] Facility 10 comprises at least a living room 900 and a rehabilitation room 950. The living room 900 is a room where users 800 spend their daily lives. The rehabilitation room 950 is a room where users 800 undergo rehabilitation (including physical fitness testing) aimed at improving their motor skills. In the example shown in Figure 1, user 800A spends their daily life in the living room 900, and user 800B receives rehabilitation in the rehabilitation room 950.

[0025] The sensor box 100 can acquire records of the user 800's movements (referred to as "daily movements" in this specification) or activities (referred to as "daily activities" in this specification) within the living room 900 using the camera and sensors built into the sensor box 100, as well as various other sensors. The sensor box 100 transmits the acquired records of the user 800's daily movements to the server device 200 via the internal network. The sensor box 100 may also be installed in the rehabilitation room 950. The sensor box 100 in the rehabilitation room 950 can acquire records of the user 800's movements (referred to as "rehabilitation movements" in this specification) or activities (referred to as "rehabilitation activities" in this specification) within the rehabilitation room 950.

[0026] In this specification, "actions" of user 800 refer to actions involving physical movement of user 800. "Activities" of user 800 refer to all actions of user 800, regardless of whether physical movement is involved. For example, "sleeping" and "reading" are included in "activities," even if they do not necessarily involve physical movement of user 800. In this specification, "daily activities" and "rehabilitation activities" are collectively referred to as "actions," and "daily activities" and "rehabilitation activities" are collectively referred to as "activities." Furthermore, records of actions or activities acquired by cameras, sensors, etc., are referred to as "action records" or "activity records."

[0027] The user 800's motion record includes, for example, video data captured by a camera. The user 800's activity record includes, for example, information such as the user 800's sleep time and heart rate acquired by sensors.

[0028] The actions of user 800 include, as an example, "walking," in which user 800's position changes while standing; "getting up," in which user 800's posture changes from lying down to sitting; and "standing up," in which user 800's posture changes from sitting to standing. The action record of user 800 may also include any other actions besides those described above.

[0029] The rehabilitation support system may further include a gateway server 11, a switching device 12, and an access point 13.

[0030] The gateway server 11 interconnects the internal network of facility 10 with the external network of facility 10. The internal network may be a local network consisting of wired and wireless connections. The external network may be, for example, the Internet or a public telephone network. Devices connected to the internal or external network send and receive data using communication protocols such as TCP (Transmission Control Protocol) / IP (Internet Protocol), UDP (User Datagram Protocol), and ICMP (Internet Control Message Protocol).

[0031] The gateway server 11 may have security features. For example, the gateway server 11 may use a firewall or filtering function to prevent devices connected to the external network from accessing devices on the internal network. Conversely, the gateway server 11 may impose restrictions on devices connected to the internal network, such as preventing them from accessing specific web pages on the external network.

[0032] The switching device 12 interconnects each device on the internal network of the facility 10. In some cases, a router or switch may be used as the switching device 12. The switching device 12 may have multiple Ethernet® communication ports and may be connected to each device via Ethernet cables. Furthermore, the switching device 12 may have a wireless antenna compatible with Wi-Fi® (Wireless Fidelity), etc. In that case, the switching device 12 can communicate with each device by both wired and wireless means. In the example shown in Figure 1, there is one switching device 12, but the number of switching devices 12 is not limited to this. The internal network of the facility 10 may be composed of a combination of multiple switching devices 12.

[0033] The access point 13 is equipped with a wireless antenna and connects each device to the internal network via wireless communication. In some cases, a Wi-Fi router may be used as the access point 13. In some cases, the switching device 12 and the access point 13 may be integrated into a single unit.

[0034] The sensor box 100 transmits the acquired user 800 operation records or activity records to the server device 200 via the internal network.

[0035] The server device 200 manages the rehabilitation support system's programs and various data. The server device 200 also stores the user's (800) movement or activity records in their room 900 and the user's (800) movement or activity records in their rehabilitation room 950.

[0036] The server device 200 may be a cloud server on an external network. In that case, the server device 200 will communicate with each device on the internal network via the gateway server 11.

[0037] The terminal device 300 may include mobile terminals 300A used by individual staff members and an administrator terminal 300B used by the administrator of facility 10. The administrator terminal 300B may be used as a terminal for the administrator of facility 10 to log in to the server device 200. In the example shown in Figure 1, two mobile terminals 300A1, 300A2 and one administrator terminal 300B are illustrated, but the number of mobile terminals 300A and administrator terminals 300B is not particularly limited.

[0038] The sensor box 100 can analyze the motion or activity records of the user 800 in the living room 900 or rehabilitation room 950 and transmit the analysis results to the server device 200. The analysis results may include, for example, the estimated type of motion for each motion included in the user 800's motion record, and information such as the duration or speed of each motion. Furthermore, the sensor box 100 can estimate whether the user 800 is in a sleeping state or an awake state.

[0039] The sensor box 100 may further transmit location information to the server device 200. This location information may include information about the living room 900, the rehabilitation room 950, the dining room, and other shared spaces. In other aspects, the sensor box 100 may transmit all or part of the acquired information to the mobile terminal 300A. In that case, the mobile terminal 300A may transmit various information acquired from the sensor box 100 to the server device 200.

[0040] The sensor box 100 incorporates sensors for detecting the movements of the user 800 within the living room 900. An example of a sensor is a Doppler sensor for detecting the movement of an object.

[0041] The mobile terminal 300A is used by staff engaged in caregiving at facility 10. Staff can use the mobile terminal 300A to transmit records of user 800's rehabilitation activities to the server device 200. Staff use the mobile terminal 300A to perform rehabilitation for user 800. For example, staff can use the mobile terminal 300A as a stopwatch to measure the time taken for activities such as walking, getting up, and standing up. In this case, the mobile terminal 300A can transmit timestamps (start time and end time) for each activity to the server device 200.

[0042] In the example shown in Figure 1, the facility 10 contains one resident room 900 and one rehabilitation room 950. However, the rehabilitation support system according to this embodiment can be used in a facility 10 with any number of resident rooms 900 and any number of rehabilitation rooms 950. Similarly, the number of other devices, such as the mobile terminal 300A, access point 13, and switching device 12, is not limited to the example shown in Figure 1.

[0043] The living room 900 includes, for example, a bed 901 as part of its facilities. The user 800 is wearing a vital sensor 400 that detects the user's vital information. One example of vital information to be detected is the user's body temperature. Another example is the user's respiration. Yet another example is the user's heart rate. Yet another example is two or more types of information from these.

[0044] Figure 2 shows an example of an overview of the movement or activity record of user 800 in room 900. The sensor box 100, the server device 200, and the mobile terminal 300A can be connected to each other via a wired or wireless network. Although the example shown in Figure 2 is for room 900, the rehabilitation support system can acquire movement or activity records of user 800 in the rehabilitation room 950 using a similar procedure.

[0045] The sensor box 100 includes a camera 105 (imaging device) and an optional sensor 110 (such as a microphone, infrared sensor, Doppler sensor, or a combination thereof). For example, the sensor box 100 may only capture the user 800's movements with the camera 105 when the sensor 110 detects the user 800's movements, and transmit the motion data to the server device 200 as a record of those movements. As another example, the sensor box 100 may continuously capture the user 800's movements and transmit the motion data to the server device 200 with detection values ​​acquired from the sensor 110 at regular intervals added.

[0046] The server device 200 can analyze the received operation records and store the analysis results along with the user 800's identification information. The terminal device 300 can display the information obtained from the server device 200 on its display.

[0047] Camera 105 photographs the interior of the living room 900. Camera 105 may be a movable camera with two or more movable axes. Camera 105 may be an infrared camera. Furthermore, camera 105 may be a movable infrared camera. In that case, the sensor box 100 can photograph the interior of the living room 900 even during the lights-out period at night without disturbing the sleep of the user 800. Furthermore, in other aspects, camera 105 may include both a normal camera and an external camera. In that case, the sensor box 100 can photograph the interior of the living room 900 during the day with the normal camera and the interior of the living room 900 at night with the infrared camera.

[0048] Sensor 110 can acquire data for detecting or analyzing the user 800's movements. Sensor 110 can acquire, for example, the start time of the user 800's movements, the end time of the movements, and location information. Sensor box 100 or server device 200 can analyze the user 800's movements with high accuracy based on the motion image data and the information acquired from sensor 110.

[0049] Motion data of the user's (rehabilitation) movements in the rehabilitation room 950 can be acquired by the mobile terminal 300A. Motion data of rehabilitation movements may also be acquired by the camera 105 of the sensor box 100, similar to movements (daily activities) in the living room 900.

[0050] <Hardware Configuration> Next, the hardware configuration of the sensor box 100, server device 200, and mobile terminal 300A will be described with reference to Figures 3 and 4. Figure 3 is a diagram showing an example of the hardware configuration of the sensor box 100 and mobile terminal 300A.

[0051] Referring to Figure 3, the sensor box 100 records the movements or activities of the user 800 in the living room 900 or rehabilitation room 950, and transmits the acquired information as a movement record or activity record to the server device 200. The sensor box 100 comprises a control device 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, a communication interface 104, a camera 105, a Doppler sensor 106, a wireless communication device 107, and a storage device 108.

[0052] The control device 101 controls the sensor box 100. The control device 101 is comprised of, for example, at least one integrated circuit. The integrated circuit is comprised of, for example, at least one CPU (Central Processing Unit), at least one ASIC (Application Specific Integrated Circuit), at least one FPGA (Field Programmable Gate Array), or a combination thereof.

[0053] ROM 102 can store various programs and settings executed by the control device 101. RAM 103 temporarily stores programs loaded from ROM 102 or storage device 108. The control device 101 executes the programs loaded into RAM 103.

[0054] The communication interface 104 is connected to an antenna (not shown) or the like. The sensor box 100 exchanges data with other communication devices via this antenna. Other communication devices include, for example, a server device 200, a mobile terminal 300A, an access point 13, and other communication terminals. In some cases, the communication interface 104 may be connected to other communication devices by a wired connection.

[0055] In one implementation, camera 105 is a near-infrared camera. The near-infrared camera includes an IR (Infrared) illuminator that emits near-infrared light and can capture images and / or photographs of the interior of the living room 900 even at night. In another implementation, camera 105 is a surveillance camera that receives only visible light. In yet another implementation, a 3D sensor or a thermographic camera may be used as camera 105. The sensor box 100 and camera 105 may be configured as an integrated unit or as separate units.

[0056] The Doppler sensor 106 is, for example, a microwave Doppler sensor that emits and receives radio waves to detect the behavior (movement) of objects in the living room 900. This allows for the detection of biometric information of the user 800 in the living room 900. In one example, the Doppler sensor 106 emits 24GHz microwaves toward the beds 901 in each living room 900 and receives the microwaves reflected by the user 800 (hereinafter referred to as "reflected waves"). The reflected waves undergo a Doppler shift due to the user 800's movements. From these reflected waves, the Doppler sensor 106 can detect the user 800's respiratory state and heart rate. The Doppler sensor 106 corresponds to the sensor 110 that detects the user 800's movements shown in Figure 2. In some cases, the sensor box 100 may also include any other sensors that detect the user 800's movements besides the Doppler sensor 106.

[0057] The wireless communication device 107 receives each signal from the vital sensor 400 and transmits the signal to the control device 101. The vital sensor 400 transmits its respective detection output to the wireless communication device 107.

[0058] The storage device 108 is, for example, a storage medium such as a hard disk or an external storage device. The storage device 108 can store the motion image data acquired by the camera 105 and the detection information from the Doppler sensor 106. In some cases, an HDD (Hard Disk Drive) or an SSD (Solid State Drive) may be used as the storage device 108.

[0059] The mobile terminal 300A displays the user 800's movement records or activity records. The mobile terminal 300A also receives input of the user 800's rehabilitation movement records and transmits the received rehabilitation movement records to the server device 200. The mobile terminal 300A includes a control device 301, RAM 303, communication interface 304, display 305, input device 306, camera 307, and internal memory 308.

[0060] The control device 301 controls the mobile terminal 300A. The control device 301 is composed of, for example, at least one integrated circuit. The integrated circuit is composed of, for example, at least one CPU, at least one ASIC, at least one FPGA, or a combination thereof. The RAM 303 temporarily stores programs loaded from the internal memory 308. The control device 301 executes the programs loaded into the RAM 303.

[0061] The communication interface 304 is connected to an antenna (not shown) or the like. The mobile terminal 300A exchanges data with external communication equipment via the antenna and access point 13. External communication equipment includes, for example, a sensor box 100 and a server device 200.

[0062] The display 305 is implemented, for example, by a liquid crystal display or an organic EL (Electro-Luminescence) display. The input device 306 is implemented, for example, by a touch sensor superimposed on the display 305. The touch sensor accepts various operations on the mobile terminal 300A via touch operation and outputs the content of the operation to the control device 301. The display 305 may also display a screen for inputting care records and accept input of care records from staff. The camera 307 (imaging device) can acquire moving image data as information on the user 800's movements.

[0063] The internal memory 308 is, for example, a storage medium such as an eMMC (Embedded Multimedia Card). As an example, the internal memory 308 stores a program executed by the control device 301, but this program may be stored in a storage device other than the internal memory 308, as long as it is a storage device accessible by the control device 301. For example, the program may be stored in a recording medium readable by the terminal device 300 (computer).

[0064] Figure 4 shows an example of the hardware configuration of server device 200. Referring to Figure 4, the hardware configuration of server device 200 and the function of each component will be explained. Server device 200 may, for example, be a PC (Personal Computer) or a workstation.

[0065] The server device 200 includes a control unit 201, a ROM 202, a RAM 203, a communication interface 204, a display interface 205, an operation interface 206, and a storage device 207.

[0066] The control device 201 controls the server device 200. The control device 201 is comprised of, for example, at least one integrated circuit. The integrated circuit is comprised of, for example, at least one CPU, at least one ASIC, at least one FPGA, or a combination thereof.

[0067] ROM 202 can store various programs and settings executed by the control unit 201. RAM 203 temporarily stores programs loaded from ROM 202 or storage device 207. The control unit 201 executes the programs loaded into RAM 203.

[0068] An antenna (not shown) and the like are connected to the communication interface 204. The server device 200 exchanges data with external communication equipment via this antenna. External communication equipment includes, for example, a sensor box 100 and a mobile terminal 300A.

[0069] The display interface 205 is connected to the display 208 and sends image signals to the display 208 for displaying images according to commands from the control device 201 or the like. In certain situations, the display 208 may display the expected improvement in each of the user 800's movements, a rehabilitation plan, and rehabilitation records.

[0070] The operating interface 206 is, for example, a USB (Universal Serial Bus) terminal and is connected to the input device 209. The operating interface 206 receives signals indicating user operation from the input device 209. The input device 209 is, for example, a mouse, keyboard, touch panel, or other device capable of accepting user input.

[0071] The storage device 207 is, for example, a storage medium such as a hard disk or an external storage device. The storage device 207 stores, as an example, records of daily activities, records of rehabilitation activities, results of analysis of activity records, expected values ​​of improvement in each activity for each user 800, and records of rehabilitation for each user 800. In some cases, an HDD or SSD may be used as the storage device 207.

[0072] <Acquisition of motion or activity records> Next, with reference to Figures 5 and 6, the process for acquiring user 800's movement records or activity records in the rehabilitation support system will be explained.

[0073] Figure 5 shows an example of a record of daily activities. The example shown in Figure 5 is a view of the living room 900 from a camera 105 in a sensor box 100 installed on the ceiling of the living room 900. The movement path 500 represents the trajectory of the user 800's movements.

[0074] The sensor box 100 uses the camera 105 to capture images of the living room 900. The sensor box 100 adds a timestamp and detection data from the sensor 110 to the video data to generate a record of daily movements or activities. The sensor box 100 periodically transmits the record of daily movements or activities to the server device 200.

[0075] The server device 200 analyzes the motion image data and detection data from the sensor 110 included in the record of daily movements or activities to extract the movement path 500. Next, the server device 200 calculates the walking speed of the user 800 in daily life based on the amount of change in the user 800's position based on the movement path 500 and the timestamp when the user 800's position changes. In a certain situation, the sensor box 100 may calculate the walking speed of the user 800 in daily life and transmit the result of this calculation to the server device 200.

[0076] Figure 6 shows an example of a record of rehabilitation activities. In the example shown in Figure 6, user 800 is receiving walking rehabilitation under the guidance of staff. The sensor box 100 is installed on the ceiling of the rehabilitation room 950, similar to the living room 900.

[0077] User 800 walks from the starting point 601 to the finish point 602, following the instructions of the staff. In one example, user 800's rehabilitation movements are captured by the camera 307 of the mobile terminal 300A. In another example, user 800's rehabilitation movements are captured by the camera 105 of the sensor box 100. A timestamp and detection data from the sensor 110 are added to these video images to generate a record of the rehabilitation movements. The generated record of the rehabilitation movements is stored in the server device 200.

[0078] <Estimation of operation type> Figure 7 shows an example of a method for estimating the posture (estimated type of movement) of user 800 in a rehabilitation support system according to this embodiment. The server device 200 can estimate the type of movement of user 800 by estimating the posture of user 800 based on the movement record and detecting changes in the posture of user 800. The method for estimating the posture of user 800 includes the following four steps.

[0079] In step 810, the server device 200 extracts multiple images in a continuous time series from the operation record. In some cases, the server device 200 may extract video footage from a certain period of time.

[0080] In step 820, the server device 200 identifies the user 800 included in each image extracted in step 810. In some cases, the server device 200 may use existing image recognition technology to identify the user 800 included in the image. In step 830, the server device 200 identifies the size of the user 800's head and the positions of the joints of the head and body included in each image extracted in step 810.

[0081] In step 840, the server device 200 compares adjacent images in chronological order and estimates the user's movements based on changes in the size of the user's head and changes in the positional relationship of the joints of the head and the entire body. Each image is associated with a timestamp, and the server device 200 can also calculate the speed of the user's movements based on the timestamp.

[0082] In a given scenario, the server device 200 may store in the storage device 207 first related information that associates the change in the size of the user 800's head with pattern information relating the positional relationship between the head and the joints of the entire body, and the user 800's posture. In this case, the server device 200 can estimate the user 800's posture in each image based on the first related information. Furthermore, the server device 200 can estimate the type of action performed by the user 800 based on the change in the user 800's posture in each image. For example, if the user 800's posture changes from sitting to standing, the server device 200 estimates that the user 800 performed the action "standing up".

[0083] <Functional configuration> Figure 8 is a functional block diagram illustrating the functional configuration of the sensor box 100, server device 200, and terminal device 300 that constitute the rehabilitation support system 1. As shown in Figure 8, the server device 200 includes an acquisition unit 210 and an output unit 220. The terminal device 300 (information processing device) includes an acquisition unit 310, a display unit 320, and an input unit 330.

[0084] The acquisition unit 210 of the server device 200 acquires "activity data" from the sensor box 100 and "rehabilitation data" from the terminal device 300. In this specification, "activity data" is data obtained by recording the daily activities of the user 800 in their room 900 using the sensor box 100. "Rehabilitation data" is data obtained by recording the rehabilitation activities of the user 800 in the rehabilitation room 950 for each predetermined rehabilitation item using the terminal device 300. Although not shown in Figure 8, "activity data" can also be acquired by the vital sensor 400. In addition, "rehabilitation data" can also be acquired from the sensor box 100 installed in the rehabilitation room 950.

[0085] The output unit 220 of the server device 200 outputs the activity data and rehabilitation data acquired by the acquisition unit 210 to the terminal device 300 in response to a request from the terminal device 300. The acquisition unit 210 and output unit 220 of the server device 200 are included in the control device 201.

[0086] The activity data (first data) and rehabilitation data (second data) acquired by the acquisition unit 210 of the server device 200 are stored in the storage device 207.

[0087] The acquisition unit 310 of the terminal device 300 acquires activity data (first data) and rehabilitation data (second data) output by the output unit 220 of the server device 200. The activity data and rehabilitation data acquired by the acquisition unit 310 are sent to the display unit 320.

[0088] The display unit 320 includes a display control unit 320A and a display 305. The display control unit 320A controls the content displayed on the display 305. The display 305 displays activity data and rehabilitation data in a comparative manner. The meaning of "comparable" here will be explained later.

[0089] The input unit 330 includes an input receiving unit 330A and an input device 306. The input receiving unit 330A receives information input via the input device 306. Based on the information input to the input device 306, the input receiving unit 330A sends a request signal to the acquisition unit 210 of the server device 200. As a response signal to this request signal, the output unit 220 of the server device 200 transmits activity data and rehabilitation data to the acquisition unit 310 of the terminal device 300. Based on the information input to the input device 306, the input receiving unit 330A sends a display selection signal to the display control unit 320A. Based on the activity data (first data) and rehabilitation data (second data) received from the output unit 220 of the server device 200 and the display selection signal received from the input receiving unit 330A, the display control unit 320A controls the display content of the display 305.

[0090] The acquisition unit 310, display control unit 320A, and input reception unit 330A of the terminal device 300 are included in the control device 301.

[0091] <User Interface (during rehabilitation)> Figure 9 is a diagram illustrating the operation of a terminal device during rehabilitation in a particular scenario. In the example shown in Figure 9, the first rehabilitation item is the measurement of "walking speed" (walking training), followed by the second rehabilitation item, "power rehabilitation." Here, "power rehabilitation" refers to rehabilitation using dumbbells.

[0092] As shown in Figure 9, when measuring "walking speed" (the first rehabilitation item), select the main category "walking speed" on the menu screen of the mobile terminal 300A shown in "1.(1)". Next, when the user 800 passes the starting point 601 (Figure 6), select "START" as shown in "1.(2)" to start the "time measurement" in "1.(3)". When the user 800 reaches the goal point 602 (Figure 6), select "STOP" as shown in "1.(4)" to complete the "time measurement". When sending this record from the mobile terminal 300A to the server device 200, select "Register", and if you want to repeat the "time measurement", select "Restart".

[0093] When performing "power rehabilitation" (the second rehabilitation item) following the measurement of "walking speed," select the main category "Power Rehab" on the menu screen of the mobile terminal 300A shown in "2.(1)." After the screen shown in "2.(2)" is displayed, enter the number of repetitions (1 set, 2 sets) of the dumbbell lifting exercise as shown in "1.(3)." Then, by selecting "Register" as shown in "2.(4)," the record of the number of dumbbell lifting repetitions can be sent from the mobile terminal 300A to the server device 200.

[0094] By recording rehabilitation data for predetermined items, such as the "walking speed" measurement and "power rehabilitation" mentioned above, variations in recording formats among different recorders can be suppressed. As a result, highly reliable rehabilitation data can be obtained.

[0095] <User Interface (displayed under "Comparable")> Figures 10 and 11 show examples of screens displayed on the display 305. As shown in Figures 10 and 11, the display 305 overlays activity data 1000 (first data) obtained by recording the daily activities of user 800 in their room 900, and rehabilitation data 2000 (second data) obtained by recording rehabilitation activities of user 800 in their rehabilitation room 950 for each predetermined rehabilitation item ("walking speed," "power rehabilitation," etc.). This allows for a visual comparison between the activity data 1000 and the rehabilitation data 2000.

[0096] However, "display in a comparative manner" is not limited to this; for example, multiple activity data 1000 and multiple rehabilitation data 2000 may be overlaid and displayed on the display 305.

[0097] In the example in Figure 10, activity data 1000 is displayed as "indicators of daily activities," showing the "activity level" (distance of movement path 500 over one month) of user 800 in room 900, and rehabilitation data 2000 is displayed as "rehabilitation items," showing the number of units of range of motion exercises (over one month). Activity data 1000 and rehabilitation data 2000 are displayed overlaid on each other.

[0098] As shown in Figure 10, it can be confirmed that the "activity level" of 800 residents in 900 rooms increased 1 to 2 months after months in which a relatively large amount of "range of motion exercises" were performed as rehabilitation activities (January, May-July, and November).

[0099] In the example shown in Figure 11, the "Indicators of Daily Activities" section displays activity data 1000, which shows the sleep status of user 800 in room 900 (times of nighttime sleep, nighttime awakenings, daytime sleep, and daytime awakenings over a week), recorded by the sensor box 100. The "Rehabilitation Items" section displays rehabilitation data 2000, which shows the selected item from the menu items (number of rehabilitation sessions, walking training, muscle strengthening, etc.) (in the example of Figure 11, it is the number of rehabilitation sessions). The activity data 1000 and rehabilitation data 2000 are displayed overlaid on each other.

[0100] As shown in Figure 11, the weeks in which rehabilitation sessions were performed relatively frequently (week 1 of April and week 4 of April) were characterized by relatively longer nighttime sleep durations and relatively shorter daytime sleep durations.

[0101] The above findings may show different trends for each of the 800 users. Based on the results shown in Figures 10 and 11, the rehabilitation plan for each of the 800 users can be appropriately reviewed.

[0102] <Processing flow> Figure 12 is a sequence diagram showing the flow of information processing methods performed in the rehabilitation support system. As shown in Figure 12, activity data and rehabilitation data are transmitted from the sensor box 100 and terminal device 300 to the server device 200. In sequence SQ1, the terminal device 300 receives input to identify the display target (user ID, date and time, indicators of daily activities, rehabilitation items, etc.).

[0103] In sequence SQ2, terminal device 300 sends a request signal to server device 200 based on an input that identifies the display target. In sequence SQ3, server device 200 extracts the activity data and rehabilitation data to be displayed based on the request signal. In sequence SQ4, server device 200 sends a response signal (a signal containing the activity data and rehabilitation data) to terminal device 300. In sequence SQ5, terminal device 300 displays the activity data and rehabilitation data corresponding to the input.

[0104] <Program> The internal memory 308 of the terminal device 300 stores a program for executing the above-mentioned information processing in the control device 301. The program stored in the internal memory 308 causes the control device 301 (processor) of the terminal device 300 to execute the following steps: acquiring activity data 1000 obtained by recording the daily activities of the user 800 and rehabilitation data 2000 obtained by recording the rehabilitation activities of the user 800 for each predetermined rehabilitation item; and displaying the activity data 1000 and the specified rehabilitation items from the rehabilitation data 2000 in a comparative manner.

[0105] <Summary> To summarize the above example, it is as follows: The rehabilitation support system 1 (information processing system) includes a sensor box 100 and a vital sensor (recording device) for recording the daily activities of the user 800 (care recipient), a server device 200 for acquiring the recording results from the sensor box 100, and a terminal device 300 (information processing device) that can communicate with the server device 200. The terminal device 300 also functions as a device (recording device) for recording the rehabilitation activities of the user 800.

[0106] The terminal device 300 includes an acquisition unit 310 that acquires activity data 1000 (first data) obtained by recording the daily activities of the user 800 in the room 900, and rehabilitation data 2000 (second data) obtained by recording the rehabilitation activities of the user 800 in the rehabilitation room 950 for each predetermined rehabilitation item, and a display unit 320 that displays the activity data 1000 and the specified rehabilitation items from the rehabilitation data 2000 in a comparative manner.

[0107] In the examples in Figures 10 and 11, the activity data 1000 and rehabilitation data 2000 are displayed overlaid, allowing for comparison between the two.

[0108] In one example, activity data 1000 includes information on changes over time for a predetermined indicator (e.g., activity level, sleep duration, etc.). More specifically, activity data 1000 may include at least one of the following indicators for user 800: sleep duration, sleep state, number of times awake, number of times out of bed, heart rate, and respiratory rate.

[0109] Rehabilitation data 2000 may include information on changes over time for predetermined rehabilitation items (for example, changes over time in the number of rehabilitation sessions performed). Rehabilitation data 2000 may include either the number of times or the amount of rehabilitation performed for each item.

[0110] In one example, recording the daily activities of user 800 includes obtaining user 800's biometric information, body position information, or location information.

[0111] In one example, the rehabilitation activities of user 800 are recorded by inputting the user's rehabilitation activities into the terminal device 300 according to predetermined items.

[0112] According to this embodiment, by visually comparing activity data 1000 obtained by recording the daily activities of user 800 in their room 900 with rehabilitation data 2000 obtained by recording the rehabilitation activities of user 800 in their rehabilitation room 950, it becomes easier to compare and confirm the trends in user 800's activities in their room 900 with the trends in user 800's rehabilitation records in the rehabilitation room 950, thereby facilitating appropriate revisions to the rehabilitation plan. Furthermore, by recording rehabilitation activities according to predetermined rehabilitation items, variations in the recording format among different recorders can be suppressed, thus enabling the acquisition of highly reliable rehabilitation data 2000.

[0113] While embodiments of the present technology have been described above, the embodiments disclosed herein should be considered in all respects to be illustrative and not restrictive. The scope of the present technology is defined by the claims, and all modifications within the meaning and scope equivalent to the claims are intended to be included. [Explanation of Symbols]

[0114] 1 Rehabilitation support system, 10 Facilities, 11 Gateway server, 12 Switching device, 13 Access point, 100 Sensor box, 101 Control device, 102 ROM, 103 RAM, 104 Communication interface, 105 Camera, 106 Doppler sensor, 107 Wireless communication device, 108 Storage device, 110 Sensor, 200 Server device, 201 Control device, 202 ROM, 203 RAM, 204 Communication interface, 205 Display interface, 206 Operation interface, 207 Storage device, 208 Display, 209 Input device, 210 Acquisition unit, 220 Output unit, 300 Terminal device, 300A, 300A1, 300A2 Mobile terminal, 300B Administrator terminal, 301 Control device, 303 RAM, 304 Communication interface, 305 Display, 305A First display area, 305B Second display area, 306 Input device, 307 Camera, 308 Internal memory, 310 Acquisition unit, 320 Display unit, 320A Display control unit, 330 Input unit, 330A Input reception unit, 400 Vital sensor, 500 Movement route, 601 Start point, 602 Goal point, 800, 800A, 800B User, 900 Living room, 901 Bed, 950 Rehabilitation room, 1000 Activity data, 2000 Rehabilitation data.

Claims

1. An information processing device that receives input to identify a display target from among first data, which includes information on the temporal change of at least one of the following indicators of the care recipient: sleep duration, sleep state, number of times waking up, number of times getting out of bed, heart rate, and respiratory rate, obtained by recording the care recipient's daily activities, and second data, which includes information on the temporal change of either the number of times and the amount of rehabilitation activities performed, obtained by recording the care recipient's rehabilitation activities for each predetermined rehabilitation item, An acquisition unit that acquires the first data and the second data extracted by the server device based on the input, An information processing device comprising a display unit that outputs the first data and the rehabilitation items identified as the display target from the second data in a comparative manner by overlaying them.

2. The information processing apparatus according to claim 1, wherein recording the daily activities of the person receiving care includes acquiring the person receiving care's biological information, posture information, or location information.

3. The information processing device according to claim 1 or claim 2, wherein recording the rehabilitation activities of the person receiving care includes inputting the rehabilitation activities of the person receiving care into the information processing device for each predetermined item.

4. The aforementioned information processing device is a terminal device, The information processing apparatus according to claim 1 or 2, wherein the acquisition unit acquires the first data and the second data from a server device that is communicably connected to the terminal device.

5. A program for performing information processing in an information processing system comprising a server device and a terminal device capable of communicating with the server device, The terminal device receives an input to identify a display target from among first data, which includes information on the temporal change of at least one of the following indicators obtained by recording the daily activities of the person being cared for: sleep duration, sleep state, number of times waking up, number of times getting out of bed, heart rate, and respiratory rate; and second data, which includes information on the temporal change of either the number of times and the amount of rehabilitation performed, obtained by recording the rehabilitation activities of the person being cared for for each predetermined rehabilitation item; and the terminal device acquires the first data and the second data extracted by the server device based on the input. A program for causing the processor of the terminal device to perform the step of outputting the first data and the rehabilitation items identified as the display targets from the second data in a comparative manner by overlaying them.

6. A computer-readable recording medium storing the program described in Claim 5.

7. A recording device for recording the activities of the person receiving care, A server device that acquires the recording results of the aforementioned recording device, The server device is equipped with a terminal device capable of communicating with it, The aforementioned terminal device is The system receives input to identify a display target from among first data, which includes information on the temporal change of at least one of the following indicators obtained by recording the care recipient's daily activities: sleep duration, sleep state, number of times waking up, number of times getting out of bed, heart rate, and respiratory rate; and second data, which includes information on the temporal change of either the number of times or the amount of rehabilitation performed, obtained by recording the care recipient's rehabilitation activities for each predetermined rehabilitation item. Based on the input, the system retrieves the first data and the second data extracted from the server device. An information processing system that outputs data in a comparative manner by overlaying the first data and the rehabilitation items identified as the display targets from the second data.

8. The information processing device receives an input to identify a display target from among first data, which includes information on the temporal change of at least one of the following indicators obtained by recording the daily activities of the person being cared for: sleep duration, sleep state, number of times waking up, number of times getting out of bed, heart rate, and respiratory rate; and second data, which includes information on the temporal change of either the number of times or the amount of rehabilitation performed, obtained by recording the rehabilitation activities of the person being cared for for each predetermined rehabilitation item; and the information processing device acquires the first data and the second data extracted by the server device based on the input. An information processing method comprising the step of outputting the first data and the rehabilitation items identified as the display targets from the second data by superimposing them on the information processing device so that they can be compared.

Images