Information processing device and information processing method

Abstract

To provide an information processing apparatus and an information processing method and the like to execute control for a situation more broadly.SOLUTION: An information processing device operates in operation modes including at least a user mode and a care mode, the information processing device including: a communication unit configured to transmit a control signal for executing control on a peripheral device; a storage unit configured to store a control content in association with the user mode and the care mode, respectively, the control content being performed by the peripheral device; and a control unit configured to control the communication unit to transmit a control signal to the peripheral device to perform a control content associated with the user mode when only a cared person is detected in a room by using a detection device for detecting the presence of a person in the room, and to control the communication unit to transmit a control signal to the peripheral device to perform a control content associated with the care mode when a care person entering the room is further detected by using the detection device.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, an information processing method, and the like.

Background Art

[0002] Various techniques for controlling the surrounding environment in accordance with a user's sleep are known. For example, Patent Document 1 discloses a system that controls the surrounding environment when detecting an intention of a user on a bed or a mattress to sleep.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the system of Patent Document 1, only the intention of a user on a bed or a mattress to sleep is considered in controlling the surrounding environment. Therefore, appropriate control of the surrounding environment may not always be performed.

[0005] According to some aspects of the present disclosure, it is possible to provide an information processing apparatus, an information processing method, and the like that can execute control considering a wider range of situations.

Means for Solving the Problems

[0006] One aspect of the present disclosure relates to an information processing device that operates in at least two operating modes, user mode and care mode, comprising: a communication unit that transmits control signals to cause peripheral devices to perform control; a storage unit that stores control content to be performed by the peripheral devices in association with the user mode and the care mode, respectively; and a control unit that, using a detection device for detecting the presence of a person in a room, if it is detected that only a person to be cared for is in the room, transmits a control signal from the communication unit to the peripheral devices to perform the control content associated with the user mode, and if it is detected that an additional caregiver has entered the room, transmits a control signal from the communication unit to the peripheral devices to perform the control content associated with the care mode.

[0007] Other aspects of the present disclosure relate to an information processing method performed by an information processing device that operates in at least two operating modes, user mode and care mode, and which includes a storage unit that stores control content to be executed by peripheral devices in association with the user mode and the care mode, respectively, the method comprising: detecting a user present in a room using a detection device that detects the presence of a person in the room; if it is detected that only a person being cared for is present in the room, transmitting a control signal from the communication unit to the peripheral device to execute the control content associated with the user mode; and if it is detected that an additional caregiver has entered the room, transmitting a control signal from the communication unit to the peripheral device to execute the control content associated with the care mode. [Brief explanation of the drawing]

[0008] [Figure 1] This is a schematic diagram showing an example configuration of the control system according to the first embodiment. [Figure 2] Figure 1 is a functional block diagram of the control system. [Figure 3] This figure shows an example of a control content table stored in the memory unit of the information processing device shown in Figure 1. [Figure 4]This figure shows an example of a table of terminal devices and peripheral equipment stored in the memory unit of the information processing device shown in Figure 1. [Figure 5] This is a flowchart illustrating an example of a process performed by an information processing device. [Figure 6] This is a timing chart showing the control flow executed by the information processing device in each mode. [Figure 7] This flowchart shows an example of the process that an information processing device performs during excretion assistance in care mode. [Figure 8] This flowchart shows an example of the process that an information processing device performs during meal assistance in care mode. [Figure 9] This is a diagram illustrating a swallowing choking detection device. [Figure 10] This is a schematic diagram showing the external appearance of the automatic feeding device. [Figure 11] This flowchart shows an example of the process that an information processing device performs during transfer assistance in care mode. [Figure 12] This figure shows an example screen for use by the first user. [Figure 13] This figure shows an example screen for use by a second user. [Figure 14] This figure shows an example configuration of the control system according to the second embodiment. [Figure 15] Figure 14 is a sequence diagram showing an example of processing by the control system. [Figure 16] This figure shows an example of a QR code reading screen on a terminal device. [Figure 17] This figure shows an example of the status display for the first user. [Figure 18] This figure shows another example of the status display for the first user. [Figure 19] This figure shows an example of a status display regarding the risks of multiple first users. [Modes for carrying out the invention]

[0009] Hereinafter, this embodiment will be described with reference to the drawings. For the drawings, the same or equivalent elements are denoted by the same reference numerals, and redundant descriptions are omitted. Note that the embodiment described below does not unduly limit the content described in the claims. Also, not all of the configurations described in this embodiment are essential constituent elements of the present disclosure.

[0010] 1. First Embodiment 1.1 System Configuration Example FIG. 1 is a schematic diagram showing a configuration example of a control system 1 according to the first embodiment. The control system 1 is a system that supports a user. In this embodiment, the user includes a first user and a second user. In this embodiment, the first user is a person who needs support in life, for example, a care recipient. The control system 1 is a system designed on the premise of the existence of a second user in addition to the first user.

[0011] Here, the second user is, for example, a person who assists the life of the first user. Specifically, the second user is, for example, a caregiver or an assistant. In this specification, caregivers or assistants are collectively referred to as "assistants". For example, when the first user is an elderly person or a person with a disability who needs nursing care, or a patient or an injured person who needs support in life, the second user supports the first user. In this specification, hereinafter, it will be described assuming that the second user is an assistant. Note that the assistant is not necessarily limited to a qualified person such as a nurse or a care worker, and includes, for example, any person who supports the life of the first user, such as the family, relatives, or friends of the first user.

[0012] As shown in FIG. 1, in the first embodiment, the control system 1 includes a terminal device 20 and a peripheral device 40. In FIG. 1, eight peripheral devices, namely, a first peripheral device 40a, a second peripheral device 40b, a third peripheral device 40c, a fourth peripheral device 40d, a fifth peripheral device 40e, a sixth peripheral device 40f, a seventh peripheral device 40g, and an eighth peripheral device 40h, are illustrated as the peripheral device 40. The first peripheral device 40a is an air conditioner. The second peripheral device 40b is an aroma diffuser. The third peripheral device 40c is a lighting fixture. The fourth peripheral device 40d is an electric opening / closing curtain. The fifth peripheral device 40e is an audio device. The sixth peripheral device 40f is a blower. The seventh peripheral device 40g is a camera or a human sensor. The eighth peripheral device 40h is an electric bed. However, the number of peripheral devices 40 included in the control system 1 is not limited to eight. The control system 1 may include one or more peripheral devices 40. Also, the peripheral devices 40 included in the control system 1 are not limited to the examples shown here. Other devices may be used as the peripheral device 40. In this specification, when distinguishing one or more peripheral devices is not necessary, it is simply described as "peripheral device 40". For example, when not distinguishing the first peripheral device 40a, the second peripheral device 40b, the third peripheral device 40c, the fourth peripheral device 40d, the fifth peripheral device 40e, the sixth peripheral device 40f, the seventh peripheral device 40g, and the eighth peripheral device 40h shown in FIG. 1, it is described as "peripheral device 40".

[0013] Some of the peripheral devices 40 function as a detection device for detecting the presence of a person in the room. For example, in the example shown in FIG. 1, the seventh peripheral device 40g constituted by a camera or a human sensor functions as the detection device. However, the peripheral device 40 functioning as the detection device is not limited to a camera or a human sensor, and other devices may function as the detection device.

[0014] In this embodiment, the electric bed, which is the eighth peripheral device 40h, is placed in the bedroom used by the first user when sleeping, or in a private room where the first user lives. As shown in Figure 1, the terminal device 20 and other peripheral devices 40 other than the eighth peripheral device 40h may also be placed in the same room as the eighth peripheral device 40h. In this embodiment, the room in which the electric bed, which is the eighth peripheral device 40h, is placed is referred to as the "first user's room".

[0015] Note that the control system 1 is not limited to the example in Figure 1, and modifications such as omitting some components or adding other components can be implemented as appropriate. The same applies to other drawings such as Figure 14, where components can be omitted or added.

[0016] Figure 2 is a functional block diagram of the control system 1 shown in Figure 1. However, in Figure 2, for the sake of brevity, the first peripheral device 40a to the eighth peripheral device 40h shown in Figure 1 are collectively shown as a single functional unit, "peripheral device 40". As shown in Figure 2, the control system 1 further includes an information processing device 10. The information processing device 10 can be configured as, for example, a computer device or a server device. As shown in Figure 2, the information processing device 10 may be configured as an independent device separate from the terminal device 20 and the peripheral devices 40. Alternatively, the information processing device 10 may be configured as an integral part of either the terminal device 20 or the peripheral devices 40 by incorporating its functions into those devices. Furthermore, the information processing device 10 may be implemented by a cloud server or the like that executes the functions of the information processing device 10 described herein.

[0017] The information processing device 10 is connected to the terminal device 20 and the peripheral device 40 in a manner that allows for information communication. For example, the information processing device 10 can be connected in a manner that allows for information communication via Bluetooth®, infrared, NFC (Near Field Communication), wireless LAN (Local Area Network), wired LAN, WAN (Wide Area Network), the Internet, etc. The communication methods used for the terminal device 20 and the peripheral device 40 may be the same or different.

[0018] The information processing device 10 receives various types of information from the terminal device 20 and peripheral devices 40. Based on the received information, the information processing device 10 performs predetermined information processing and transmits control signals to the terminal device 20 or peripheral devices 40, thereby causing the terminal device 20 or peripheral devices 40 to perform predetermined controls.

[0019] As shown in Figure 2, the information processing device 10 comprises a control unit 11, a storage unit 12, and a communication unit 13 as functional units.

[0020] The control unit 11 controls and manages the entire information processing device 10, including each functional unit of the information processing device 10. In this embodiment, in particular, the information processing device 10 can assist the user by executing a computer program stored in the storage unit 12.

[0021] The control unit 11 may include, as hardware, at least one of a circuit that processes digital signals and a circuit that processes analog signals. For example, the control unit 11 can be composed of hardware such as one or more circuit devices or one or more circuit elements mounted on a circuit board. One or more circuit devices are, for example, ICs (Integrated Circuits) or FPGAs (Field-Programmable Gate Arrays). One or more circuit elements are, for example, resistors or capacitors.

[0022] Furthermore, the control unit 11 may be implemented by a processor. The information processing device 10 of this embodiment includes a memory for storing information and a processor that operates based on the information stored in the memory. The information is, for example, a computer program and various types of data. The processor includes hardware. Various types of processors can be used, such as a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), or a DSP (Digital Signal Processor). The memory may be a semiconductor memory such as SRAM (Static Random Access Memory), DRAM (Dynamic Random Access Memory), or flash memory, or it may be a register, or it may be a magnetic storage device such as a hard disk drive (HDD), or it may be an optical storage device such as an optical disk drive. For example, the memory stores instructions that can be read by a computer, and the functions of the control unit 11 are realized as processing when the processor executes these instructions. The instructions here may be instructions from an instruction set that constitutes a computer program, or they may be instructions that instruct the hardware circuit of the processor to operate.

[0023] In this embodiment, the control unit 11 performs predetermined information processing based on information received from the terminal device 20 and peripheral device 40, and transmits control signals to the terminal device 20 or peripheral device 40, thereby causing the terminal device 20 or peripheral device 40 to perform predetermined control. Specific examples of processing by the control unit 11 will be described later.

[0024] The storage unit 12 is the work area of ​​the control unit 11 and is implemented by various types of memory such as SRAM, DRAM, and ROM (Read Only Memory). The storage unit 12 may store computer programs for executing the processes described herein.

[0025] In this embodiment, the storage unit 12 stores control content to be executed by the terminal device 20 or peripheral device 40. In this embodiment, as will be described in detail later, the information processing device 10 operates in four operating modes: off mode, standby mode, user mode, and care mode. The storage unit 12 stores control content to be executed by the terminal device 20 or peripheral device 40 for each mode. For example, the control unit 12 stores control content to be executed by the peripheral device, corresponding to each of the off mode, standby mode, user mode, and care mode. If there are multiple peripheral devices 40 as in this embodiment, the storage unit 12 may store control content to support care for each peripheral device 40. In this embodiment, the storage unit 12 may also store control content for each type of care that the caregiver intends to perform, corresponding to the care mode. In this embodiment, the types of care are assistance with excretion, assistance with eating, and assistance with transfers. In addition, the storage unit 12 may store control content in each type of care, corresponding to the stage (progress) of care.

[0026] Figure 3 shows an example of a control content table stored in the memory unit 12. Specifically, Figure 3 is an example of a table showing the control content to be executed by the peripheral device 40 when the information processing device 10 is operating in care mode. In other words, Figure 3 is an example of a table showing control content associated with care modes. For care modes, the memory unit 12 stores the control content of the peripheral device 40 to support the caregiver's care of the person being cared for. For example, as shown in the table in Figure 3, the memory unit 12 stores control content for each type of care (excretion assistance, meal assistance, and transfer assistance). The memory unit 12 also stores control content associated with the stages of care. In the example shown in Figure 3, three stages of care are shown: before care begins, during care, and after care is completed, but in practice, they may be classified into more detailed stages. For example, each control content may be associated with a trigger to execute that control content. The trigger can be, for example, a predetermined signal received from the terminal device 20 or the peripheral device 40. The control unit 10 determines the care stage based on signals received from the terminal device 20 or peripheral device 40, and for each determined stage, transmits a control signal to the peripheral device 40 to execute the control content shown in the table in Figure 3. In practice, each of the control contents shown in Figure 3 may be stored in association with the peripheral device 40 that will execute the control content.

[0027] Figure 3 illustrates a table showing the control content associated with the care mode. Similarly, the storage unit 12 stores tables showing the control content for the off mode, standby mode, and user mode. However, in the case of off mode, standby mode, and user mode, it is not necessary to store the control content for each type of care.

[0028] The communication unit 13 is an interface for communication over a network and includes, for example, an antenna, an RF (radio frequency) circuit, and a baseband circuit. The communication unit 13 may operate according to the control of the control unit 11, or it may include a communication control processor different from the control unit 11. In this embodiment, the communication unit 13 transmits control signals to the peripheral device 40 to cause it to perform specific control operations.

[0029] The terminal device 20 is, for example, a smartphone or a tablet device. The terminal device 20 may also be another device such as a PC (Personal Computer). The terminal device 20 is, for example, a device owned by the user or caregiver. As shown in Figure 2, the terminal device 20 includes, as functional units, a control unit 21, a storage unit 22, a communication unit 23, a display unit 24, and an input unit 25.

[0030] The control unit 21 controls and manages the entire terminal device 20, including each functional part of the terminal device 20. The control unit 21 may include at least one of a circuit that processes digital signals and a circuit that processes analog signals as hardware. For example, the control unit 21 can be composed of hardware such as one or more circuit devices or one or more circuit elements mounted on a circuit board. The control unit 21 may also be implemented by a processor. Various types of processors can be used, such as a CPU, GPU, or DSP.

[0031] The memory unit 22 is the work area of ​​the control unit 21 and is implemented by various types of memory such as SRAM, DRAM, and ROM.

[0032] The communication unit 23 is an interface for communication over a network and includes, for example, an antenna, an RF circuit, and a baseband circuit. The communication unit 23 may operate according to the control of the control unit 21, or it may include a separate communication control processor from the control unit 21.

[0033] The display unit 24 is an interface for displaying various information, and may be a liquid crystal display, an organic EL display, or another type of display.

[0034] The input unit 25 processes the input of operations by a user using the terminal device 20. The input unit 25 is composed of, for example, operation buttons. Alternatively, a touch sensor may be provided on the display unit 24, and the touch sensor provided on the display unit 24 may function as the input unit 25. In this embodiment, it will be explained that a touch sensor is provided on the display unit 24, and that the touch sensor functions as the input unit 25.

[0035] Peripheral devices 40 are any devices used in the first user's room. Peripheral devices 40 consist of, for example, a television (television receiver), a camera, a motion sensor, lighting fixtures, an air conditioner, an aroma diffuser, audio equipment, an electric bed, etc. However, peripheral devices 40 are not limited to the examples described herein. Devices that may constitute peripheral devices 40 will be described below in this specification with the notation "as peripheral devices 40".

[0036] As shown in Figure 2, the peripheral device 40 includes, as functional units, a control unit 41, a storage unit 42, a communication unit 43, a controlled unit 44, and a detection unit 45. However, not all peripheral devices 40 necessarily include all the functional units described herein. Depending on the function of the peripheral device 40, it may omit some of these functional units. For example, the peripheral device 40 may omit either the controlled unit 44 or the detection unit 45.

[0037] The control unit 41 controls and manages the entire peripheral device 40, including each functional part of the peripheral device 40. The control unit 41 may include at least one of a circuit that processes digital signals and a circuit that processes analog signals as hardware. For example, the control unit 41 can be composed of hardware such as one or more circuit devices or one or more circuit elements mounted on a circuit board. The control unit 21 may be implemented by a processor. Various types of processors can be used, such as a CPU, GPU, or DSP.

[0038] The memory unit 42 is the work area of ​​the control unit 41 and is implemented by various types of memory such as SRAM, DRAM, and ROM.

[0039] The communication unit 43 is an interface for communication over a network and includes, for example, an antenna, an RF circuit, and a baseband circuit. The communication unit 43 may operate according to the control of the control unit 41, or it may include a separate communication control processor from the control unit 41.

[0040] The controlled unit 44 is a mechanism for executing the functions of the peripheral device 40. The peripheral device 40 is equipped with an appropriate controlled unit 44 according to the function of the peripheral device 40. For example, an air conditioning unit as the first peripheral device 40a is equipped with a heat exchanger and compressor, etc., as the controlled unit 44 for performing heating and cooling functions. For example, an aroma diffuser as the second peripheral device 40b is equipped with a mechanism for diffusing aroma oil as the controlled unit 44. For example, a lighting fixture as the third peripheral device 40c is equipped with a light-emitting part, such as a fluorescent lamp or light bulb, as the controlled unit 44. For example, a curtain as the fourth peripheral device 40d is equipped with a motor for opening and closing the curtain as the controlled unit 44. For example, an audio device as the fifth peripheral device 40e is equipped with a speaker that outputs sound as the controlled unit 44. For example, a blower as the sixth peripheral device 40f is equipped with a motor for rotating the blades as the controlled unit 44. For example, the electric bed as the eighth peripheral device 40h includes multiple bottoms as the controlled unit 44. As the electric bed controlled by the controlled unit 44, for example, the method described in PCT / JP2018 / 044703 (Title of Invention: Electric Furniture, International Filing Date: December 5, 2018) can be used. This patent application is incorporated in its entirety by referencing it.

[0041] Even if the peripheral device 40 is composed of devices other than those listed herein, the control unit 44 can be an appropriate mechanism. For example, if the peripheral device 40 is a television receiver, the control unit 44 may be a display unit that displays images and a speaker that outputs sound.

[0042] The detection unit 45 detects the presence of a person. The detection unit 45 can be configured with an appropriate detection mechanism. For example, if the seventh peripheral device 40g is a camera, the detection unit 45 is configured with an imaging unit that captures an image. For example, if the seventh peripheral device 40g is a human presence sensor, the detection unit 45 is configured with a proximity sensor that can detect whether or not a person is near the sensor. The seventh peripheral device 40g can also be configured with RFID (Radio Frequency Identifier). If the seventh peripheral device 40g is an RFID reader, the detection unit 45 is configured with a reading unit that can read information from an RFID tag.

[0043] Information regarding the terminal device 20 and peripheral devices 40 is stored in the storage unit 12 of the information processing device 10 in advance, for example. Figure 4 shows an example of a table of the terminal device 20 and peripheral devices 40 stored in the storage unit 12. As shown in Figure 4, the storage unit 12 stores, for example, the device name of the terminal device 20 or peripheral device 40, device identification information to uniquely identify the terminal device 20 or peripheral device 40, and room identification information to uniquely identify the room of the first user who uses the terminal device 20 or peripheral device 40, in association with each other. As a result, the terminal device 20 and peripheral devices 40 are stored in the storage unit 12 in association with the first user's room. Information regarding the terminal device 20 and peripheral devices 40, i.e., a table like the one shown in Figure 4, may be created based on input from, for example, a user, an assistant, or an administrator of the control system 1, and stored in the storage unit 12.

[0044] 1.2 Mode Transitions Next, the mode transitions performed by the information processing device 10 will be described. In this embodiment, the information processing device 10 operates in one of four modes. The four modes are off mode, standby mode, user mode, and care mode. Details of each mode will be described later.

[0045] Figure 5 is a flowchart illustrating an example of processing performed by the information processing device 10. Specifically, Figure 5 is a flowchart illustrating an example of mode transition processing by the information processing device 10. Mode transitions are performed, for example, by the control unit 11 of the information processing device 10.

[0046] First, the information processing device 10 determines whether or not a person is present in the first user's room (step S11). The information processing device 10 can determine whether or not a person is present using information received from, for example, a camera or motion sensor as the seventh peripheral device 40g.

[0047] If the information processing device 10 determines that no one is present in the first user's room (No. in step S11), it transitions to off mode (step S12). In this case, the information processing device 10 performs operations in off mode. Details of the operations performed in off mode will be described later. The information processing device 10 continues to perform step S11 while performing operations in off mode.

[0048] If the information processing device 10 determines that a person is present in the first user's room (Yes in step S11), it transitions to standby mode (step S13). In this case, the information processing device 10 performs operations in standby mode. Details of the operations performed in standby mode will be described later. While the information processing device 10 is performing operations in standby mode, it executes step S14, which will be described next.

[0049] When the information processing device 10 is operating in standby mode, it determines whether the first user is in bed or not (step S14). The information processing device 10 can determine whether the first user is in bed or not in a variety of ways.

[0050] If the information processing device 10 determines that the first user is not in bed (No in step S14), it continues to operate in standby mode. During this time, the information processing device 10 continues to execute step S14.

[0051] Furthermore, the information processing device 10 may perform step S11 while operating in standby mode. That is, while operating in standby mode, the information processing device 10 may determine whether or not there is a person in the first user's room. If the information processing device 10 determines that there is no person in the first user's room, that is, if the person who was in the first user's room has left the first user's room, it may transition to off mode.

[0052] If the information processing device 10 determines that the first user is in bed (Yes in step S14), it transitions to user mode (step S15). In this case, the information processing device 10 performs operations in user mode. Details of the operations performed in user mode will be described later. While the information processing device 10 is performing operations in user mode, it performs step S16, which will be described next.

[0053] When the information processing device 10 is operating in user mode, it determines whether or not another person has entered the first user's room. For example, the information processing device 10 determines whether or not another person is present in the first user's room (step S16). If the information processing device 10 detects that another person is present in the first user's room, it can determine that another person has entered. The information processing device 10 can use the seventh peripheral device 40g to determine whether or not another person is present.

[0054] If the information processing device 10 determines that no other person is present in the first user's room (No in step S16), it continues to operate in user mode. During this time, the information processing device 10 continues to execute step S16.

[0055] Furthermore, the information processing device 10 may perform step S11 while it is operating in user mode. That is, while it is operating in user mode, the information processing device 10 may determine whether or not there is a person in the first user's room. If the information processing device 10 determines that there is no person in the first user's room, that is, if the person who was in the first user's room has left the first user's room, it may transition to off mode.

[0056] If the information processing device 10 determines that another person is in the first user's room (Yes in step S16), that is, if another person enters the first user's room, it transitions to care mode (step S17). In this case, the information processing device 10 performs operations in care mode. Details of the operations performed in care mode will be described later.

[0057] The information processing device 10 continues to execute step S16 while it is operating in care mode. The information processing device 10 continues to operate in care mode as long as it determines that another person is in the first user's room (step S17). On the other hand, if the information processing device 10 determines that no other person is in the first user's room, that is, if another person has left the first user's room, it switches to user mode (step S15).

[0058] Thus, in this embodiment, the system enters off mode when no other users are present in the first user's room, standby mode or user mode when only the first user is present, and care mode when both the first user and the second user are present. Note that the operating modes do not necessarily have to be divided into four categories. For example, the operating mode when only the first user is present is not divided into standby mode and user mode, and these can be grouped together as user mode.

[0059] Here, we will explain step S11 of the flow in Figure 5 in detail. For example, if the seventh peripheral device 40g is a camera, the information processing device 10 acquires information about the image captured by the camera from the camera via the communication unit 13. By analyzing the acquired image information, the information processing device 10 can determine whether or not a person is present in the first user's room. For example, if the information processing device 10 determines, as a result of analyzing the acquired image, that a person is visible, it can determine that a person is present in the first user's room. However, the method for determining whether or not a person is present is not limited to this. For example, the camera as the seventh peripheral device 40g may determine whether or not a person is present in the first user's room by performing image analysis. In this case, the information processing device 10 can recognize whether or not a person is present in the first user's room by acquiring the determination result information from the camera.

[0060] Furthermore, if the seventh peripheral device 40g is composed of a human presence sensor, the information processing device 10 can determine whether or not a person is present in the room based on the detection status by the human presence sensor.

[0061] In this embodiment, the information processing device 10 can recognize a person as the first user if it detects that one person is present in the first user's room. In other words, the information processing device 10 recognizes a person as the first user if only one person is present in the first user's room. However, the information processing device 10 does not necessarily have to recognize the person present in the first user's room as the first user if it can identify the person present in the room by other means. For example, the information processing device 10 can determine whether the person present is the first user by performing image analysis (face recognition) on an image captured by a camera as the seventh peripheral device 40g. Even if one person is present in the first user's room, that person may not be the first user, such as a cleaning staff member, and such image analysis can accurately determine whether the person present is the first user.

[0062] Even when the seventh peripheral device 40g is comprised of an RFID reader, the information processing device 10 does not necessarily have to recognize one person in the first user's room as the first user. That is, the RFID reader reads the RFID tag carried by the person who enters the first user's room. The RFID tag stores information that can uniquely identify the user, and the storage unit 12 of the information processing device 10 stores information that associates the information stored in the RFID tag with the user. When the RFID reader reads the RFID tag, the information processing device 10 refers to the information stored in the storage unit 12 and identifies the user who entered the first user's room from the information read by the RFID reader. This makes it possible to determine whether the entering user is the first user, the second user, or someone else.

[0063] Next, we will describe in detail the method for determining whether the first user is in bed, which is performed in step S14. For example, the information processing device 10 can determine whether the user is in bed based on the information from the image captured by the camera, which is the seventh peripheral device 40g.

[0064] The information processing device 10 is not limited to the information of images captured by the camera, but can determine whether or not a user is in the bed based on information detected by a user state detection device provided on the electric bed as the eighth peripheral device 40h, or information such as a load sensor provided on the electric bed or a pressure measurement value provided on the mattress.

[0065] Here, the user state detection device is a device that detects the biological information of the first user and is placed, for example, on the bottom of an electric bed. By detecting the user's biological information, the user state detection device can detect the first user's status, such as leaving the bed, being in the bed, position, and posture. As a method for detecting leaving the bed, being in the bed, position, and posture, for example, the methods for detecting entry and exit described in Japanese Patent Application No. 2002-327624 (Title of Invention: Device for detecting entry and exit to and from a bed, Filing date: November 11, 2002), the detection method described in Japanese Patent Application No. 2002-327632 (Title of Invention: Device for detecting positional displacement on a bed, Filing date: November 11, 2002), and the detection method described in Japanese Patent Application No. 2002-327633 (Title of Invention: Device for detecting position on a bed, Filing date: November 11, 2002) can be used. These patent applications are incorporated in their entirety by referencing them.

[0066] The information processing device 10 may determine that the first user is in the bed when the sleep button on the electric bed is pressed or when sleep is detected by the user state detection device. As the electric bed, for example, the electric bed described in Japanese Patent Application No. 2018-227422 (Title of Invention: Electric Furniture, Filing Date: December 4, 2018) can be used. This patent application is incorporated in its entirety by referencing it.

[0067] Next, the method for determining whether another person is present in the room, which is performed in step S16, will be described. The information processing device 10 determines whether multiple people are present in the first user's room by analyzing the image information acquired from, for example, the camera, which is the seventh peripheral device 40g. If, as a result of the analysis of the acquired image, the information processing device 10 determines that multiple people are present, it can determine that another person is present in the first user's room. Note that, as in step S11, the determination of whether multiple people are present may also be made by the camera, which is the seventh peripheral device 40g.

[0068] In this embodiment, if the information processing device 10 detects that another person has entered the room while it is aware that the first user is present in the first user's room, it can recognize that the other person as the second user. In other words, if the information processing device 10 recognizes that only one person is present in the first user's room and identifies that person as the first user, and then detects that another person has entered, it will recognize that other person as the second user. However, the information processing device 10 may determine whether or not the person who entered the first user's room is the second user by other means. For example, the information processing device 10 can determine whether or not the person who entered is the second user by performing image analysis on an image captured by a camera acting as a detection device. Alternatively, the information processing device 10 can determine whether or not the person who entered is the second user by reading the information on an RFID tag.

[0069] In this embodiment, mode transitions were explained with reference to Figure 5. However, mode transitions are merely one possible function of the information processing device 10, and the information processing device 10 does not necessarily have to perform mode transitions. The information processing device 10 only needs to be able to perform the control in the care mode described later when it detects that a caregiver has entered the room of the first user while the person being cared for (second user) is present, as in step S16, "Yes". Therefore, each mode in the mode transitions described here should be understood as merely an example for convenience.

[0070] The information processing device 10 performs specific processing in each of the following modes: standby mode, off mode, user mode, and care mode. In each mode, the information processing device 10 causes the peripheral device 40 to perform different processing. For example, the information processing device 10 stores a table in the storage unit 12 that associates each of the four modes with the processing content to be performed by the peripheral device 40. The information processing device 10 can refer to this table and execute processing for the peripheral device 40 corresponding to the currently running mode.

[0071] 1.3 Details of control associated with mode transitions Here, we will describe the details of the control performed by the information processing device 10 in each of the off mode, standby mode, user mode, and care mode. Figure 6 is a timing chart showing the control flow performed by the information processing device 10 in each mode.

[0072] Figure 6 shows the changes over time in the state of the first user, the operating mode of the information processing device 10, and the operating state of the peripheral devices 40. In Figure 6, the peripheral devices 40 include a camera, first lighting, second lighting, television, audio equipment, electric bed, mattress, aroma diffuser, air conditioner, air purifier, curtains, coffee maker, oven, and door. Here, the first lighting is a light installed on the ceiling, and the second lighting is a light installed at floor level. The mattress is an air mattress placed on an electric bed, and its internal pressure can be changed, for example, by adjusting the amount of air inside. The door is an electric door installed at the entrance to the first user's room.

[0073] As shown in Figure 6, when the first user is out, the first user is not in their room. In this case, the operating mode of the information processing device 10 is the off mode. The off mode is the mode used when the functions of the control system 1 are turned off. In off mode, the information processing device 10 causes the peripheral devices 40 to execute the control contents stored in the memory unit 12 in association with the off mode. For example, in off mode, based on the control signals of the information processing device 10, the camera that acquires information to determine the presence of the first user in the room is turned on, and all other peripheral devices 40 are turned off. A motion sensor may be used instead of a camera.

[0074] Next, let's assume that the first user enters the first user's room. In other words, let's assume that the first user is in the room. In this case, the operating mode of the information processing device 10 becomes standby mode. Standby mode is the mode used when one person is in the first user's room. In this embodiment, standby mode is the mode used when one person is in the first user's room and is not in bed. In standby mode, the information processing device 10 causes the peripheral device 40 to execute the control content stored in the storage unit 12 in association with the standby mode. Specifically, when the information processing device 10 transitions to standby mode, it transmits a control signal to a specific peripheral device 40 to execute an operation. The peripheral device 40 that receives the control signal executes a predetermined operation.

[0075] For example, as shown in Figure 6, the first and second lights are turned on. Also, the television, audio equipment, aroma diffuser, air conditioner, and air purifier are turned on. At this time, the information processing device 10 may transmit a control signal to operate the air conditioner at a comfortable temperature and airflow setting for the first user, based on information such as temperature and humidity obtained from the outside. The comfortable temperature and airflow setting for the first user may be set in advance, learned based on past operating conditions of the air conditioner, or calculated appropriately by the information processing device 10 using a predetermined algorithm. This creates an environment in which the user can easily live in the first user's room.

[0076] Furthermore, when the system enters standby mode, the curtains are turned on and operated to open or close. The operation of the curtains may be determined and controlled depending on the time of day, for example. For example, during the nighttime period from evening to early morning, the curtains are closed, and during the daytime period from early morning to evening, the curtains are open. The door is also turned on and closed. The electric bed and mattress are also turned on. This allows the electric bed and mattress to detect whether or not the first user has entered the bed.

[0077] Next, let's assume that the first user has gone to bed (comes to sleep). In this case, the operating mode of the information processing device 10 is user mode. User mode is the mode when there is one person in the first user's room. In this embodiment, user mode is the mode when there is one person in the first user's room AND the first user is in bed. In user mode, the information processing device 10 can perform different controls depending on whether or not the first user's intention to sleep has been detected. The intention to sleep can be determined, for example, using time information. Specifically, the information processing device 10 obtains the current time based on time information obtained using an internal real-time clock or time information obtained from an external device. The information processing device 10 can determine that the first user's intention to sleep has been detected if the current time is within a predetermined time range in which the first user is expected to go to bed AND the first user is determined to be in bed. The predetermined time range in which the first user is expected to go to bed may be set as appropriate by the first user, the second user, or the administrator of the control system 1. The predetermined time range in which the first user is expected to go to bed is set, for example, between 9 PM and 1 AM. If the current time is outside the predetermined time range, the information processing device 10 can determine that no intention to sleep has been detected. However, the information processing device 10 may also determine that the first user has an intention to sleep if the sleep button on the electric bed is pressed or if sleep is detected by the user state detection device.

[0078] In the example shown in Figure 6, it is assumed that the intention of the first user to sleep has been detected. For example, suppose the first user has fallen asleep. When the operating mode shifts to user mode, the information processing device 10 causes the peripheral devices 40 to execute the control contents stored in the memory unit 12 in association with the user mode. For example, the environment inside the first user's room is controlled to create an environment that is conducive to improving the quality of sleep for the first user. For example, as shown in Figure 6, the illuminance of the first and second lights gradually dims. The television and audio equipment are turned off. The temperature setting of the air conditioner is gradually lowered. The electric bed is also gradually lowered.

[0079] Suppose the first user then enters REM sleep. Whether the first user is in REM sleep or non-REM sleep can be determined based on biometric information. Even in REM sleep, the operating mode of the information processing device 10 remains in user mode. In this case, the illuminance of the first and second lights is turned off. The aroma diffuser is also turned off. The electric bed is set to a fully flat position. The mattress remains on, but its internal pressure is controlled to improve the quality of the first user's sleep. The quality of the first user's sleep may be calculated as a sleep score indicating the quality of sleep, for example, based on the first user's past sleep states. For the sleep score, for example, the sleep score described in Japanese Patent Application No. 2020-175602 (Title of Invention: Electric Bedding System and Application Software, Filing Date: October 19, 2020) can be used. This patent application is incorporated in its entirety by referencing it. The mattress controls its internal pressure to match the internal pressure when the sleep score is high. The temperature setting of the air conditioning system will continue to be gradually lowered.

[0080] Furthermore, suppose the first user enters a non-REM sleep state. Even in the non-REM sleep state, the operating mode of the information processing device 10 remains in user mode. In this case, the electric bed raises the backrest within a range of 10 degrees or less. The temperature setting of the air conditioning system continues to be gradually lowered.

[0081] Next, let's assume that the second user enters the first user's room. In this case, the operating mode of the information processing device 10 becomes care mode. In care mode, the information processing device 10 causes the peripheral devices 40 to execute the control contents stored in the storage unit 12 in association with the care mode. Here, in care mode, the information processing device 10 identifies the type of care. For example, the information processing device 10 determines whether the type of care is assistance with excretion, assistance with eating, or assistance with transfer. Details of how to identify the type of care will be described later. Here, the information processing device 10 identifies the type of care as assistance with excretion. When the information processing device 10 identifies the type of care as assistance with excretion, it controls the peripheral devices 40 according to the stage of care, for example, by referring to the table shown in Figure 3.

[0082] In the example shown in Figure 6, when assisting with toileting in care mode, the first light is kept off while the second light is turned on. In other words, the ceiling light remains off while the footlight is turned on. This ensures sufficient brightness for the second user to perform the necessary actions while minimizing disruption to the first user's sleep. The electric bed is also adjusted to a fully flat position and its height is adjusted. Specifically, the electric bed is adjusted to a height that makes it easier for the second user to change the first user's diaper. The mattress is also adjusted to an internal pressure that makes it easier to position the first user on their side. Furthermore, the air conditioning system's temperature setting is increased. This makes it less likely for the first user to feel cold during diaper changes. The air purifier's operating intensity is also increased. This makes it easier to quickly eliminate any odors that may occur during diaper changes.

[0083] Once the toileting assistance is complete, the second user leaves the first user's room. This causes the information processing device 10 to switch back to user mode. In the example shown in Figure 6, it is assumed that the first user is in a non-REM sleep state at this time. In this case, the second light is turned off again. The electric bed is raised to a backrest angle of 10 degrees or less. The temperature setting of the air conditioner is returned to the temperature setting from the previous user mode, or gradually increased in stages, and then gradually raised towards the wake-up time. The mattress's internal pressure is controlled to improve the first user's sleep quality. The air purifier's operating intensity is returned to normal. These controls may also be performed immediately after the diaper change is completed, before switching to user mode (while still in care mode).

[0084] Suppose the first user then enters REM sleep. Even in REM sleep, the operating mode of the information processing device 10 remains in user mode. In this case, the electric bed becomes fully flat. The temperature setting of the air conditioning system continues to be gradually increased.

[0085] Eventually, morning arrives, and the first user wakes up. The fact that the first user has woken up can be determined based on biometric information. Even if the first user wakes up, if the user remains in bed, the operating mode of the information processing device 10 remains in user mode. However, since the user's intention to sleep is not detected when the user wakes up, different control is performed compared to when the user's intention to sleep is detected.

[0086] For example, as shown in Figure 6, the first and second lights are turned on. The television, audio equipment, and aroma diffuser are also turned on. The curtains are opened. Furthermore, the coffee maker and oven are turned on. This allows for a smooth breakfast preparation. The electric bed is raised, and the mattress is vented to release air from inside. This allows the user to transition from a supine to a seated position. As shown in Figure 6, the coffee maker and oven are turned off after use.

[0087] Next, let's assume that the second user enters the first user's room. In this case, the operating mode of the information processing device 10 becomes care mode. Here, let's assume that the information processing device 10 has identified the type of care as transfer assistance. When the information processing device 10 has identified the type of care as transfer assistance, it refers to a table, for example, shown in Figure 3, and controls the peripheral devices 40 according to the stage of care.

[0088] For example, the door is opened. This makes it easier for the first user to leave. Also, the television and audio equipment are turned off. This is because, when assisting with transfers, the first user is about to leave their room, so there is no need to use the television and audio equipment. Furthermore, at a specific time, the air conditioning system is turned off. This is also because there is no need to use it.

[0089] When the first and second users leave the first user's room, the information processing device 10 switches to off mode. In this case, the first and second lights turn off. The electric bed and mattress also turn off. The aroma diffuser and air purifier also turn off. The curtains remain open and turn off. The door closes and turns off.

[0090] In this way, the operating mode of the information processing device 10 transitions, and in each operating mode, the control of the necessary peripheral devices 40 is performed.

[0091] As explained with reference to Figure 6, some peripheral devices 40 continue the same control even when transitioning from user mode to care mode. For example, the first light remains off even when transitioning from user mode to care mode (the toileting assistance care mode in the example of Figure 6). This makes it less likely to disturb the first user's sleep.

[0092] Furthermore, as explained with reference to Figure 6, the control settings of some peripheral devices 40 are changed when the user switches from user mode to care mode (in the example of Figure 6, the care mode for excretion assistance). For example, when the user switches to the care mode for excretion assistance, the mattress is adjusted to an internal pressure that makes it easier to place the first user in a lateral position, as this improves the quality of sleep for the first user. This makes it easier for the second user to perform care.

[0093] Furthermore, as explained with reference to Figure 6, some peripheral devices 40 switch from a stopped state to an activated state when the user mode transitions from user mode to care mode (in the example of Figure 6, the care mode for assistance with excretion). For example, the second light, which is off in user mode, is turned on in care mode. This makes it easier for the second user to perform care.

[0094] However, the timing chart in Figure 6 is merely an example. Therefore, peripheral devices 40 other than those shown in Figure 6 may perform control as appropriate. Furthermore, the control of peripheral devices 40 is not limited to that shown in Figure 6. Moreover, peripheral devices 40 may perform control as appropriate in care modes other than excretion assistance.

[0095] In each operating mode, the first user may directly control the peripheral device 40 by operating the terminal device 20. In other words, the first user may use the terminal device 20 to perform operations that cause the peripheral device 40 to execute predetermined controls. In this case, the control based on the operation input to the terminal device 20 takes precedence over the control described using Figure 6.

[0096] Furthermore, the first user may perform an operation input to the input interface provided by the peripheral device 40. For example, the first user may directly perform an on / off operation input to the peripheral device 40. In this case as well, control based on the operation input to the peripheral device 40 takes precedence over the control described using Figure 6.

[0097] 1.4 Identifying the type of care Next, an example of a method for identifying the type of care will be described. As mentioned above, in this embodiment, the types of care include assistance with excretion, assistance with eating, and assistance with transfers. The information processing device 10 identifies the type of care when the operating mode transitions to the care mode.

[0098] The type of care can be identified in various ways. For example, the information processing device 10 can identify the type of care that the second user intends to perform based on the tools used for care that the second user brought with them when entering the first user's room (hereinafter also simply referred to as "care tools"). Specifically, for example, an RFID tag may be attached to the care tool, and the information stored in the RFID tag may be read by an RFID reader in the first user's room, and the type of care may be identified based on the read information. In this case, for example, the storage unit 12 stores the information stored in each RFID tag in association with the type of care, and the information processing device 10 may identify the type of care by referring to the information in the storage unit 12. Alternatively, for example, the information processing device 10 may transmit a request signal to the surrounding tools via a gateway, requesting information to identify the type of care. The information to identify the type of care may include, for example, the tool's status information, ID information, and tool type information, and may be stored in a communication device that has been attached to the tool in advance. When each communication device attached to the tool receives a request signal from the information processing device 10, it transmits a response signal containing information for identifying the type of care as a response signal to the request signal. The information processing device 10 can identify the type of care based on the information contained in the response signal. At this time, for example, the storage unit 12 stores the information for identifying the type of care stored in each communication device in association with the type of care, and the information processing device 10 may identify the type of care by referring to the information in the storage unit 12.

[0099] Specifically, for example, RFID tags are attached to diapers used when changing the first user's diaper during toileting assistance, diaper carts, trays or tableware used during meal assistance, and wheelchairs used during transfer assistance. Each RFID tag stores identification information that uniquely identifies that RFID tag. Each RFID tag may also store information about the tool to which the RFID tag is attached, and information about the type of care in which the tool to which the RFID tag is attached is used.

[0100] An RFID reader capable of reading RFID tag information non-contactually is placed in the first user's room. The RFID reader may be placed in any location that allows it to read the RFID tag information when a tool to which the RFID tag is attached enters the first user's room. For example, the RFID reader may be attached to the bedding system 30, or it may be placed near the entrance to the first user's room.

[0101] When providing care, the second user enters the first user's room with the necessary equipment, depending on the type of care being provided. For example, when assisting with toileting (e.g., changing diapers), the second user enters with diapers and a diaper cart. For example, when assisting with meals, the second user enters with dishes and trays containing the food. For example, when assisting with transfers, the second user enters with a wheelchair.

[0102] The control unit 11 of the information processing device 10 can identify the type of care by referring to the information stored in the storage unit 12 based on the identification information of the RFID tag acquired from the RFID reader. For example, if the acquired RFID tag identification information is that of an RFID tag attached to a diaper or diaper cart, the control unit 11 identifies the type of care as excretion assistance. For example, if the acquired RFID tag identification information is that of an RFID tag attached to tableware or a tray, the control unit 11 identifies the type of care as meal assistance. For example, if the acquired RFID tag identification information is that of an RFID tag attached to a wheelchair, the control unit 11 identifies the type of care as transfer assistance.

[0103] In the above example, it was explained that the storage unit 12 stores the identification information of each RFID tag in association with the type of care. However, the storage unit 12 may also store, for example, the identification information of each RFID tag in association with the information of the tool to which the RFID tag is attached. In this case, the control unit 11 can use the identification information obtained from the RFID reader to refer to the storage unit 12 and obtain the tool information corresponding to the identification information. The control unit 11 may then identify the type of care based on the tool information. For example, the storage unit 12 stores the tool information and the type of care in association, and the control unit 11 can identify the type of care by referring to the information in the storage unit 12.

[0104] RFID tags are not limited to the tools mentioned above and may be attached to any other tools used in care. For example, RFID tags may be attached to meal carts used for meals. For example, RFID tags may be attached to lifts used for transfers.

[0105] Furthermore, the type of care does not necessarily have to be identified using RFID tags. For example, a sensor capable of reading a predetermined signal may be placed in the first user's room, and each of the tools used in the care may be fitted with a signal output circuit that emits a signal readable by the sensor. In this case, the sensor transmits information about the received signal to the information processing device 10, and the information processing device 10 can identify the type of care based on the signal received from the sensor. Alternatively, for example, the information processing device 10 may acquire images taken by a camera as a peripheral device 40, perform image analysis to identify the tools held by the second user, and then identify the type of care based on the identified tools.

[0106] The type of care may be determined by other means. For example, if the user state detection device 200 or a camera detects that the first user performed a sitting position upon waking up, the control unit 11 may determine that the type of care is transfer assistance.

[0107] 1.5 Control details for each type of care The control unit 11 of the information processing device 10, upon identifying the type of care, executes control corresponding to the identified type of care. Here, the specific control details will be explained for each type of care.

[0108] 1.5.1 Controls in assistance with excretion Figure 7 is a flowchart showing an example of the process that the information processing device 10 performs during excretion assistance in care mode. The flow in Figure 7 is executed, for example, based on the table shown in Figure 3, when the operating mode of the information processing device 10 switches to care mode and the type of care is identified as excretion assistance.

[0109] If the type of care is identified as assistance with excretion, the control unit 11 of the information processing device 10 causes the peripheral device 40 to perform pre-care control. For example, the control unit 11 turns on a specific light (a light placed at the feet) (step S21). The control unit 11 also causes the diaper cart, which is a peripheral device 40, to be automatically transported to a predetermined location (step S22). The predetermined location is a position that is easy for the second user to work in when changing the first user's diaper, for example, next to an electric bed. The diaper cart may be one that the second user brought with them when entering the first user's room, or it may be one that was already in the first user's room. The diaper cart is a motor-driven self-propelled cart, and its position in the room can be determined using sensors provided on the diaper cart. The movement of the diaper cart to the predetermined location increases convenience for the second user. The control unit 11 also raises the set temperature of the air conditioning unit (step S23).

[0110] Next, the control unit 11 determines whether or not it has detected that application software (hereinafter simply referred to as "app") that supports specific assistance has been launched (step S24). The app is installed on a terminal device used by a second user (hereinafter simply referred to as "second user terminal device"), such as a smartphone or tablet, and is launched by the second user on the second user terminal device. The second user terminal device may be used together with, for example, MR (Mixed Reality) glasses. In this case, the second user can perform assistance while wearing the MR glasses, for example, on their head, and referring to the information displayed on the MR glasses by the app. In this embodiment, the second user terminal device can be treated as a peripheral device 40.

[0111] An assistance support application, for example, digitizes the "intuition" or "tacit knowledge" of the caregiver for tasks that are performed based on that "intuition" or "tacit knowledge," thereby providing instructions to the second user so that appropriate assistance can be provided regardless of the second user's skill level. The application can, for example, build a trained model by performing machine learning based on training data, and then provide instructions to the second user by displaying instructions according to the content of the assistance on the display screen of the second user terminal device or MR glasses based on the trained model. As a system using an assistance support application, for example, the system described in Japanese Patent Application No. 2021-032143 (Title of Invention: Information Processing Device and Information Processing Method, Filing Date: March 1, 2021) can be referenced. This patent application is incorporated in its entirety by reference.

[0112] The control unit 11 can determine that the application has been launched by receiving a notification from the second user terminal device that the application has been launched. If the control unit 11 determines that the application has been launched (Yes in step S24), it causes the peripheral device 40 to perform the care operations. For example, the control unit 11 makes the electric bed fully flat and adjusts the height to a height that is easy for the second user to use for care (step S25). The control unit 11 also adjusts the internal pressure of the mattress to make it easier to place the patient in a lateral position (step S26).

[0113] When the application is launched, instructions for a specific assistance task are displayed on the display screen of the second user terminal device or MR glasses. For example, the second user terminal device displays instructions for diaper changing on its display screen. For example, the second user terminal device displays on its display screen the predetermined location on the first user's body where the diaper should be placed. The second user terminal device detects whether or not the diaper has been placed in the predetermined location. The second user terminal device can, for example, take a picture of the first user's body with a camera installed in the second user terminal device and determine from the captured image whether or not the diaper has been placed in the predetermined location on the first user's body. Alternatively, the second user terminal device may detect that the diaper has been placed in the predetermined location on the first user's body based on input from the second user.

[0114] When the control unit 11 of the information processing device 10 receives information from the second user terminal indicating that a diaper has been placed in a predetermined position on the first user's body, it adjusts the mattress to a predetermined internal pressure that makes it easier to position the first user in a supine position (step S27). As a result, when the second user changes the diaper, it becomes easier to position the first user in a supine position when the diaper is placed in the predetermined position on the first user's body, and as a result, subsequent tasks after diaper changing become easier.

[0115] Once the second user has finished changing the diaper, they operate the second user terminal to close the application. The control unit 11 determines whether or not it has detected the application closing (step S28). For example, when the second user terminal closes the application, it sends a notification to the information processing device 10 indicating that it is closing the application, and the control unit 11 can determine that it has detected the application closing based on the notification received from the second user terminal.

[0116] If the control unit 11 determines that the application has ended (Yes in step S28), it causes the peripheral device 40 to perform post-care completion processing. For example, the control unit 11 increases the operating intensity of the air purifier, which is a peripheral device 40 (step S29). The control unit 11 also causes the diaper cart, which is a peripheral device 40, to be automatically transported to a predetermined location (step S30). The predetermined location may be, for example, the location where the cart was placed before the second user performed the diaper change as part of toileting assistance. If the first user's room is, for example, a room where multiple people live, and the second user changes the diapers of multiple people, the predetermined location may be a location that makes it easy for the second user to work when changing the diaper of the next first user, for example, next to the next first user's bed. This increases convenience for the second user because the diaper cart moves automatically. The control unit 11 also turns off the lights (step S31). Furthermore, the control unit 11 may transition from care mode to user mode when the second user leaves the first user's room.

[0117] 1.5.2 Controls in meal assistance Figure 8 is a flowchart showing an example of the process performed by the information processing device 10 during meal assistance in care mode. The flow in Figure 8 is executed, for example, based on the table shown in Figure 3, when the operating mode of the information processing device 10 transitions to care mode and the type of care is identified as meal assistance. Note that steps S41 to S43 in Figure 8 do not necessarily have to be performed in care mode, but may also be performed in user mode.

[0118] If the type of care is identified as meal assistance, the control unit 11 of the information processing device 10 causes the peripheral device 40 to perform pre-care control. For example, the control unit 11 of the information processing device 10 controls the electrically operated curtains to open (step S41). This allows outside light to enter the room and wake the sleeping first user. The control unit 11 also turns on the coffee maker (step S42). The control unit 11 also turns on the television (step S43). This allows the first user to eat while watching television without having to operate the television with a remote controller or the like. The control unit 11 also adjusts the backrest height of the electric bed to a height that is easy to eat at (step S44). This allows the first user lying in bed to be in a position that is easy to eat at. The control unit 11 also moves the table, which is a peripheral device 40, to a predetermined position (step S45). The table is used by the first user for meals and may be placed near the electric bed or attached to the electric bed. The control unit 11 moves the table to a position that is convenient for the first user to eat in, such as in front of the first user.

[0119] Next, the control unit 11 determines whether or not the first user has started eating (step S46). For example, in meal assistance, an application to support meal assistance is used, similar to the application described in the section on excretion assistance. The control unit 11 may determine that a meal has started if it has detected the launch of the application. At this time, a device specifically for meal assistance may be used. A device specifically for meal assistance is, for example, a swallowing and choking detection device that detects the first user's swallowing and choking.

[0120] Figure 9 illustrates a swallowing choking detection device 460. As shown in Figure 9, the swallowing choking detection device 460 includes a throat microphone 461 worn around the neck of a first user and a terminal device 462 having a camera. The throat microphone 461 outputs audio data from the first user's swallowing, coughing, etc. The camera of the terminal device 462 outputs captured images of the first user eating. The terminal device 462 is, for example, a smartphone or tablet PC placed on the table where the first user eats. The throat microphone 461 is connected to the terminal device 462 using Bluetooth or the like, and the terminal device 462 is connected to the information processing device 10 via a network. However, both the throat microphone 461 and the terminal device 462 may be directly connectable to the server system 100, and various variations of the specific connection configuration are possible.

[0121] For example, the swallowing choking detection device 460 determines whether the first user has choked or swallowed based on the audio data from the throat microphone 461. A device that detects swallowing using a microphone worn around the neck is described, for example, in U.S. Patent Application No. 16 / 276768, filed on February 15, 2019, entitled "Swallowing action measurement device and swallowing action support system." This patent application is incorporated by reference in its entirety in this specification. The processor of the swallowing choking detection device 460 can detect the number of choking episodes, the duration of the choking (time of occurrence, duration, etc.), and whether or not swallowing occurred, based on the audio data. The processor of the swallowing choking detection device 460 provides information to support the second user's decision-making, such as the timing of verbal guidance, whether to stop providing food, and whether the timing and amount of a spoonful provided are appropriate.

[0122] If the control unit 11 determines that the first user has started eating (Yes in step S46), it causes the peripheral device 40 to perform the care control. For example, the control unit 11 causes the automatic feeding device, which is a peripheral device 40, to feed the first user (step S47). The automatic feeding device is an assistance device used when the first user is eating, and specifically, it is a device for automatically bringing food to the first user's mouth. Figure 10 is a schematic diagram showing the appearance of the automatic feeding device. As shown in Figure 10, the automatic feeding device 470 includes a container 472 containing multiple plates into which food can be placed, and an arm 471 that scoops a predetermined amount of food from the container 472 and brings it to the first user's mouth. The arm 471 includes, for example, multiple frames connected by joints and an end effector provided at its tip. The end effector here may be, for example, a hand that grips a spoon, or the spoon itself. The container 472 is provided with a tab 473. Tab 473 is a member whose one end is connected to the periphery of the plate portion in which food is placed, and whose other end is inclined toward the center of the plate portion. By providing Tab 473, it is possible to prevent food from spilling from the plate when scooping food with a spoon. For example, a device that automatically feeds a patient is described in U.S. Patent Application 15 / 094800, filed on April 8, 2016, titled "APPARATUS AND METHOD FOR FOOD CAPTURE". This patent application is incorporated by reference in its entirety in this specification. The automatic feeding device 470 in this embodiment may be, for example, the feeding device disclosed in U.S. Patent Application 15 / 094800, or a device having a similar mechanism. The automatic feeding device performs the operation of delivering food to the mouth of the first user based on a control signal received from the information processing device 10.

[0123] Furthermore, as a control during care provision, the control unit 11 turns on the audio equipment (step S48). The control unit 11 also turns on the aroma diffuser (step S49). The control unit 11 may also set the air conditioning unit's temperature to the temperature for meals. The temperature for meals may be set to a different temperature than the temperature set in user mode.

[0124] The control unit 11 then determines whether the first user has finished eating (step S50). For example, if an operation is performed to stop a running application, the control unit 11 can determine that the first user has finished eating by receiving a notification from the second user terminal device that the application has been stopped. Alternatively, the control unit 11 may weigh an item placed on the table, which is a peripheral device 40, and determine that the meal is finished if the weight does not change for a predetermined time. Alternatively, the control unit 11 may determine whether the first user has finished eating based on an image captured by the camera, which is a peripheral device 40.

[0125] If the control unit 11 determines that the first user has finished eating (Yes in step S50), it performs post-care control. For example, the control unit 11 moves the table, which is a peripheral device 40, to a predetermined position (for example, the position before the meal) (step S51). The control unit 11 also confirms with the first user whether or not to turn off the television, audio equipment, and aroma diffuser (step S52). For example, the control unit 11 can confirm this via voice or screen display. Based on the first user's response, the control unit 11 either turns off the television, audio equipment, and aroma diffuser, or keeps them on.

[0126] 1.5.3 Control Content in Transfer Assistance Figure 11 is a flowchart showing an example of the process performed by the information processing device 10 during transfer assistance in care mode. The flow in Figure 11 is executed, for example, based on the table shown in Figure 3, when the operating mode of the information processing device 10 transitions to care mode and the type of care is identified as transfer assistance.

[0127] If the type of care is identified as transfer assistance, the control unit 11 of the information processing device 10 causes the peripheral devices 40 to perform pre-care control. For example, the control unit 11 of the information processing device 10 turns off the television and audio equipment (step S61). The control unit 11 also adjusts the backrest height of the electric bed to a height that facilitates transfer (step S62). This allows the first user lying on the bed to be in a position that facilitates transfer. The control unit 11 also causes the lift and wheelchair, which are peripheral devices 40, to be automatically transported to a predetermined location (step S63). The predetermined location is a position that makes it easy for the first user to transfer to the wheelchair, for example, next to the electric bed. In this case, the lift and wheelchair are motor-driven self-propelled lift and wheelchair. The control unit 11 locks the casters of the automatically transported wheelchair (step S64). This fixes the wheelchair in place at the transfer location.

[0128] Next, the control unit 11 determines whether or not it has detected that an application to support transfer assistance has been launched (step S65). The application to support transfer assistance, like the application described for toileting assistance, is a digital representation of the caregiver's "intuition" or "tacit knowledge," and is used on a second user terminal.

[0129] The control unit 11 can determine that the application has been launched by receiving a notification from the second user terminal device that the application has been launched. If the control unit 11 determines that the application has been launched (Yes in step S65), it executes the control during care. For example, the control unit 11 raises or lowers the height of the electric bed (step S66). This makes it possible to assist the first user in standing up when transferring from the bed to a wheelchair.

[0130] During care, the second user performs transfer assistance using an app. The transfer assistance app may, for example, provide instructions on how the second user should move their body, or display a photograph or skeletal diagram showing the correct position (center of gravity) and posture for placing the first user in the wheelchair, overlaid on the current image or skeletal diagram acquired by the camera, and instruct the second user to align them. The transfer assistance app may also provide instructions regarding the assistance task based on the second user's physique and skill level. The second user's physique and skill level can, for example, be entered by the second user themselves into the second user terminal device.

[0131] Once the transfer assistance is complete, the second user operates the second user terminal to close the application. The control unit 11 determines whether or not it has detected the application closing (step S67). For example, when the second user terminal closes the application, it sends a notification to the information processing device 10 indicating that it is closing the application, and the control unit 11 can determine that it has detected the application closing based on the notification received from the second user terminal.

[0132] If the control unit 11 determines that the application has ended (Yes in step S67), it instructs the peripheral device 40 to perform post-care completion processing. For example, the control unit 11 turns off the aroma diffuser and air conditioner (step S68). The control unit 11 also turns off the lights (step S69).

[0133] 1.6 Interface Switching In this embodiment, a single terminal device 20 may be used by both a first user and a second user. In this case, the interface of the terminal device 20 may differ depending on the user. If the interface differs depending on the user, the terminal device 20 may automatically switch the interface according to the user. The same applies to peripheral devices 40. For example, the operation input unit for inputting operations to an electric bed, which is a peripheral device 40, can switch its interface according to the user.

[0134] Figure 12 shows an example of a screen used by a first user. Figure 12 is an example of a screen used for inputting information to operate a peripheral device 40, which is displayed on the display unit 24 of the terminal device 20, which is equipped with a touch sensor. When the information processing device 10 determines, for example, from an image captured by a camera, that the first user is operating the terminal device 20, it displays the input screen shown in Figure 12.

[0135] As shown in Figure 12, the input screen displays a list of peripheral devices 40 connected via the information processing device 10. The first user can operate each peripheral device 40 displayed on the input screen by performing operation inputs. For example, when the user turns on the power of an air conditioner, a control signal based on the operation is sent from the terminal device 20 to the information processing device 10, and then the information processing device 10 sends a signal to the air conditioner to turn on its power. When the air conditioner receives this signal, it turns on its power. In this way, the first user can operate the peripheral devices 40 using the terminal device 20.

[0136] Furthermore, the input screen shown in Figure 12 displays an input button labeled "Tacit Knowledge" for displaying a list of apps related to the aforementioned "tacit knowledge." If a second user is using the terminal device 20 and the input screen shown in Figure 12 is displayed, the second user can tap the input button to display a screen on the terminal device 20 showing a list of apps related to "tacit knowledge" (for example, the display screen shown in Figure 13).

[0137] Figure 13 shows an example of a screen used by a second user. When the information processing device 10 determines, for example, from an image captured by a camera, that a second user is operating the terminal device 20, it displays the input screen shown in Figure 13.

[0138] As shown in Figure 13, the input screen displays a list of apps that the second user will use for assistance. These apps are the ones used for the aforementioned assistance with toileting, eating, or transferring. The second user touches an icon representing one of the apps, depending on the type of assistance they intend to perform, and the app corresponding to the touched icon is launched.

[0139] The input screen shown in Figure 13 displays an input button labeled "Operation" for displaying a screen for inputting operations for each of the peripheral devices 40 described above. If the input screen shown in Figure 13 is displayed when the first user is using the terminal device 20, the first user can tap the input button to display a screen for inputting operations for the peripheral devices 40 (for example, the display screen shown in Figure 12) on the terminal device 20.

[0140] The above example describes how the initial screen displayed when the application is launched can be automatically changed depending on whether the user operating the terminal device 20 is the first user or the second user. However, the example is not limited to this, and even when the second user is operating the application, if it is in user mode (for example, when the first user is not in the first user's room), Figure 12 may be displayed as the initial input screen when the application is launched, and if it is in care mode, Figure 13 may be displayed as the initial input screen when the application is launched. Furthermore, even in care mode, if the type of care cannot be identified when the application is launched, Figure 12 may be displayed as the initial input screen, and if the type of care can be identified, Figure 13 may be displayed as the initial input screen.

[0141] In this way, when only the first user (the person being cared for) is in the first user's room, the information processing device 10 causes the peripheral device 40 to execute the control content associated with user mode. When it detects that another person (caregiver) has entered the room, it switches to care mode and causes the peripheral device 40 to execute the control content associated with care mode. The peripheral device 40 executes the control based on the control signals received from the information processing device 10, and therefore executes the control according to the operating mode of the information processing device 10. This makes it possible to execute control that takes into account the characteristics of both the first user and the second user. As a result, it becomes possible to execute control that takes into account a wider range of situations.

[0142] In this embodiment, the information processing device 10 is described as performing transitions between four operating modes. However, the transitions between operating modes do not necessarily have to be performed by the information processing device 10. The transitions between operating modes may be performed, for example, by the terminal device 20, or by an external device (not shown).

[0143] Furthermore, in this embodiment, it was explained that the information processing device 10 operates in four operating modes. However, the information processing device 10 only needs to operate in at least two operating modes: user mode and care mode. By operating in at least these two operating modes, it is possible to switch control according to the occupancy status of the first user and the second user.

[0144] 2. Second Embodiment 2.1 Example System Configuration Figure 14 shows an example of the configuration of the control system 2 according to the second embodiment. The control system 2 is a system that supports the daily life of the first user. The control system 2 according to the second embodiment differs from the control system 1 according to the first embodiment in that it is not used in the room of the first user, but in a public space used by other people receiving care besides the first user. Public spaces include, for example, dining rooms used by multiple users in hospitals or elderly care facilities. However, public spaces are not limited to dining rooms and may include other facilities.

[0145] In the second embodiment, the control system 2 includes an information processing device 10, peripheral devices 40, and a user device 50. The second embodiment will be described below, focusing on the differences, while omitting explanations of aspects similar to the first embodiment as appropriate.

[0146] In this embodiment, the information processing device 10 is configured as, for example, a server device. The information processing device 10 may also be implemented as, for example, a cloud server. The information processing device 10 is connected to the peripheral device 40 and the user device 50 in a manner that enables information communication. The connection method may be the same as the method described in the first embodiment. The information processing device 10 receives various types of information from the peripheral device 40 and the user device 50. Based on the received information, the information processing device 10 performs predetermined information processing and transmits control signals to the peripheral device 40, thereby causing the peripheral device 40 to perform predetermined control.

[0147] As shown in Figure 10, the information processing device 10 comprises a control unit 11, a storage unit 12, and a communication unit 13 as functional units. The functions and configurations of the control unit 11, storage unit 12, and communication unit 13 may be the same as in the first embodiment, so a detailed explanation is omitted here.

[0148] Peripheral devices 40 are any devices placed in a public space where the control system 2 is used, for example, in a cafeteria. Peripheral devices 40 consist of, for example, a television, lighting fixtures, air conditioning equipment, an aroma diffuser, audio equipment, etc. As shown in Figure 14, peripheral devices 40 include, as functional units, a control unit 41, a storage unit 42, a communication unit 43, a controlled unit 44, and a detection unit 45. The functions and configurations of the control unit 41, storage unit 42, communication unit 43, controlled unit 44, and detection unit 45 may be the same as in the first embodiment, so a detailed explanation is omitted here.

[0149] The user device 50 is a device used by the first user. The user device 50 is, for example, a device that moves with the first user. Specifically, the user device 50 may be, for example, a terminal device such as a smartphone or tablet used by the first user. Alternatively, the user device 50 may be attached to a wheelchair used by the first user. In this case, the wheelchair may encompass the functions of the user device 50. The user device 50 comprises, as a functional unit, a control unit 51, a storage unit 52, a communication unit 53, a display unit 54, and an input unit 55.

[0150] The control unit 51 controls and manages the entire user device 50, including each functional part of the user device 50. The control unit 51 may include at least one of a circuit that processes digital signals and a circuit that processes analog signals as hardware. For example, the control unit 51 can be composed of hardware such as one or more circuit devices or one or more circuit elements mounted on a circuit board. The control unit 51 may also be implemented by a processor. Various types of processors can be used, such as a CPU, GPU, or DSP.

[0151] The memory unit 52 is the work area of ​​the control unit 51 and is implemented by various types of memory such as SRAM, DRAM, and ROM.

[0152] The communication unit 53 is an interface for communication over a network and includes, for example, an antenna, an RF circuit, and a baseband circuit. The communication unit 53 may operate according to the control of the control unit 51, or it may include a communication control processor separate from the control unit 51.

[0153] 2.2 Example of processing by a control system In the second embodiment, when the first user enters the public space where the control system 2 is used, the information processing device 10 controls the peripheral device 40 by transmitting a control signal to the peripheral device 40. An example of processing by the control system 2 will be explained with reference to Figure 15.

[0154] Figure 15 is a sequence diagram showing an example of processing by the control system 2 according to the second embodiment. In Figure 15, peripheral device A is a camera, peripheral device B is a lighting fixture, and peripheral device C is an audio device. At the start of the sequence, the lighting fixture is off and the audio device is powered off.

[0155] Peripheral device A, which is a camera, takes images of the inside of the cafeteria. The camera determines whether or not a first user has entered the cafeteria by, for example, analyzing the captured images. When the camera detects that a first user has entered the cafeteria (step S71), it transmits a detection signal to the information processing device 10 indicating that the entry of a first user has been detected (step S72).

[0156] When the information processing device 10 receives a detection signal, it transmits a control signal to the peripheral device 40 to perform a specific process. For example, the information processing device 10 transmits a control signal to the peripheral device B, which is a lighting fixture, to turn it on (step S73).

[0157] When the lighting fixture receives a control signal, it turns on the lights (step S74). In this way, when the first user enters the dining room, the lights in the dining room automatically turn on.

[0158] Furthermore, the information processing device 10 transmits a control signal to a peripheral device 40C, for example, an audio device, to turn on its power (step S75).

[0159] When the audio equipment receives a control signal, it turns on (step S76). In this way, when the first user enters the cafeteria, the audio equipment installed in the cafeteria automatically turns on.

[0160] In this way, the control system 2 according to the second embodiment can perform control in a public space. Note that the process described in Figure 15 is merely an example. Therefore, the information processing device 10 may transmit control signals to other peripheral devices 40 and may perform control different from that described above.

[0161] In the control system 2, for example, it may determine whether a person entering the dining room is a first user (a person receiving assistance) or a second user, and execute different controls based on the determination result. For example, when analyzing images captured by a camera, the information processing device 10 or the camera may determine that a person in a wheelchair is a first user and a person not in a wheelchair is a second user. The information processing device 10 may send different control signals to the peripheral devices 40 depending on whether the person entering the room is a first user or a second user. Alternatively, the information processing device 10 may send a control signal to the peripheral devices 40 only if it determines that the person entering the room is a first user.

[0162] The determination of whether a person entering the room is the first user may be performed by a method other than using a camera. For example, the determination of whether a person entering the room is the first user may be performed using RFID. Specifically, the first and second users using the cafeteria carry terminal devices or cards to which RFID tags are attached. When a first or second user enters the cafeteria, the RFID reader reads the information on the RFID tag and, based on the read information, can refer to the user attribute information stored in the storage unit 12 to determine whether the person entering the room is the first or second user. The information processing device 10 can send different control signals to the peripheral devices 40 depending on whether the person entering the room is the first or second user. As a result, the control system 2 according to the second embodiment can perform control that takes into account the characteristics of both the first and second users in a public space. In other words, it is possible to perform control that takes into account a wider range of situations.

[0163] In the second embodiment, the information processing device 10 may identify the type of care that the second user is about to receive when the second user enters the dining room. The method for identifying the type of care may be the same as the method described in the first embodiment, for example, so a detailed explanation is omitted here. In the second embodiment as well, the information processing device 10 may perform control according to the identified type of care. For example, if the type of care is meal assistance, the information processing device 10 may move a self-propelled meal cart to a predetermined position. In this way, control according to the type of care is realized in the second embodiment as well.

[0164] The control system 2 according to the second embodiment is used in public spaces, and therefore may perform processing according to the characteristics of each first user. For example, suppose the temperature setting of the air conditioning system in a public space such as a cafeteria is 26 degrees. In contrast, suppose 28 degrees is the appropriate temperature for a particular first user. The appropriate temperature is stored in the storage unit 12 of the information processing device 10, associated with the first user, for example, through an input from a second user or administrator. In this case, the particular first user may feel cold when entering a public space where the temperature is set to 26 degrees. Therefore, when the particular first user enters the public space, the information processing device 10 turns on a heater, for example, as a peripheral device 40 (user device 50). The heater is installed, for example, on a wheelchair used by the first user. This makes it possible to create a more comfortable environment for the particular first user while maintaining the environment of the public space.

[0165] 2.3 Pairing Peripherals In the control system 2 according to the second embodiment, when performing control according to the type of care, each first user and the tools used as peripheral devices 40 for care for that first user are paired in advance. In other words, since the control system 2 according to the second embodiment is used in a public space, there may be multiple tools used for care placed in the dining room for each first user. In this case, the pairing of which tool is used by which first user is done in advance.

[0166] Pairing can be performed in various ways. For example, RFID tags containing uniquely identifiable information can be attached to multiple tools, and a second user or administrator of the control system 2 can verify the tools used by each first user and perform predetermined operation inputs to the information processing device 10 to associate the first user with the tool's identification information, thereby storing the information in the storage unit 12 of the information processing device 10.

[0167] Pairing can be performed by other, simpler methods. For example, pairing can be performed using QR codes (registered trademark). Specifically, each device is equipped with a QR code. A second user or administrator of the control system 2 uses the QR code reader function of a terminal device capable of communicating with the information processing device 10 to read the QR code attached to the device associated with a specific first user.

[0168] Figure 16 shows an example of a QR code reading screen on a terminal device. The second user or administrator operates the terminal device to open the QR code reading screen. On the reading screen, the second user or administrator selects a username. The username is the name of the first user managed by the control system 2, for example, the name of the first user who uses the cafeteria. Selectable usernames are stored in the terminal device's memory beforehand, for example. In the example shown in Figure 16, "User A" is selected as the username.

[0169] The second user or administrator selects a username and then uses a terminal device to read the QR code attached to the tool associated with the first user of that username. Reading the QR code can be done using a known method. When reading QR codes, the terminal device can display the information of the read QR codes on the display screen each time it reads multiple QR codes. For example, as shown in Figure 16, the terminal device may display the read QR code 60 at the bottom of the screen as the information of the read QR code. Note that the information of the read QR code does not necessarily have to be displayed as the read QR code 60. For example, the information of the read QR code may be information about the tool to which the read QR code is attached, such as the name of the tool to which the read QR code is attached. The terminal device displays the information of the read QR code on the display screen each time it reads a QR code. In other words, the number of QR code information displayed on the display screen increases each time a QR code is read. In the example shown in Figure 16, four QR codes 60 are illustrated as the QR code information displayed on the display screen. If the first user accidentally scans a QR code for a tool other than the one they intend to use, the second user or administrator can delete the information from the incorrectly scanned QR code (QR code 60) by performing an operation to delete the QR code information displayed on the screen.

[0170] The second user or administrator reads all the QR codes attached to the tools associated with the first user, and then performs a predetermined operation input to perform the process of associating the first user with the tools. The predetermined operation input is, for example, an operation input to a predetermined button, such as tapping the "Register" button 61 shown in Figure 16. When the predetermined operation input is performed, the terminal device sends a command signal to the information processing device 10 to store the association between the first user and the tools used by the first user. Based on the command signal, the information processing device 10 stores the association between the first user and the tools in the storage unit 12. For example, the storage unit 12 stores a table associating the first user with the tools as peripheral devices 40. This performs pairing. When pairing is performed, in the control system 2 according to the second embodiment, if the information processing device 10 identifies the first user who has entered the public space, it may send a control signal only to the peripheral device 40 (user device 50) which is the tool associated with the first user. This makes it possible to control only the tools used by the first user.

[0171] While this example describes pairing performed by scanning a QR code, pairing does not necessarily have to be done using a QR code. Instead of a QR code, another code, such as a barcode, or an NFC tag may be used. In these cases as well, pairing can be performed by scanning the barcode or other code or the NFC tag.

[0172] Although this example illustrates the pairing of a first user with a tool, this example may also be applied to the pairing of a type of care with a tool (a peripheral device 40) used in that care.

[0173] 3. Application Examples 3.1 Automatic Configuration Change While the first user is sleeping, the first user may wake up in the middle of the night, for example, if the second user is providing care. In this case, the information processing device 10 can perform different controls on the peripheral devices 40 before and after the awakening.

[0174] For example, the information processing device 10 determines whether the first user has woken up in the middle of the night based on the body vibrations of the first user detected by a user state detection device installed on the electric bed. If the information processing device 10 determines that the first user has woken up in the middle of the night, it may send a control signal to the peripheral device 40 to execute a different control than the one performed before the determination that the first user had woken up. In this case, the information processing device 10 controls the peripheral device 40 so that the environment surrounding the first user becomes an environment that makes it easier for the first user to fall back asleep after waking up. For example, the information processing device 10 may send a control signal to a lighting fixture to change the illuminance, send a control signal to an air conditioning unit to change the set temperature, or send a control signal to the electric bed to perform "back elevation," "knee elevation," "height adjustment," or "tilting." The environment that makes it easier for the first user to fall back asleep after waking up in the middle of the night may be learned by the information processing device 10 in advance. Specifically, the information processing device 10 can learn an environment that makes it easier for the first user to fall back asleep after waking up in the middle of the night, based on the control content for the peripheral devices 40 and the body vibrations of the first user detected by the user state detection device 200.

[0175] 3.2 Care Evaluation During the sleep of the first user, the quality of the first user's sleep may change before and after care provided by, for example, the second user. In this case, if the second user is providing care using, for example, an app that assists with caregiving, the care method displayed in the app may be more or less likely to decrease the quality of the first user's sleep. Therefore, the information processing device 10 may evaluate the care method displayed in the app based on the quality of the first user's sleep before and after the care.

[0176] For example, the information processing device 10 can evaluate the quality of sleep based on a sleep score calculated based on the body vibrations of the first user detected by the user state detection device. In other words, the information processing device 10 can evaluate that the higher the sleep score, the higher the quality of sleep of the first user. The information processing device 10 associates the method displayed on the terminal device by, for example, an app, with the changes in the quality of sleep of the first user and stores this information in the memory unit 12. The information processing device 10 then compares the changes in the quality of sleep of the first user (e.g., rate of change or amount of change) for each different method. This allows the information processing device 10 to perform an evaluation of care for each method.

[0177] When the information processing device 10 tells the second user that the evaluation of the app used for the care of the first user is low (i.e., the evaluation of such app is below a threshold), it recommends an app of the same type that is applied to users with the same or similar attributes as the first user, and that has a high evaluation for care.

[0178] The information processing device 10 may evaluate the care provided to each individual user. This is because even with the same method, changes in sleep quality can differ for each individual user. After evaluating the care, the information processing device 10 may display the highly-rated care in the app. This makes it less likely for the care to negatively impact the individual user's sleep quality.

[0179] 3.3 Data Sharing The above embodiment describes an example where the control system is used in a room or public space belonging to one first user. However, the control system can also be used in common across multiple facilities. In this case, for example, one information processing device 10 described in the above embodiment may be provided for each facility. When one first user uses these multiple facilities, information about the first user can be shared among the information processing devices 10 provided in each of the multiple facilities.

[0180] Multiple facilities include, for example, the first user's home, a hospital, and a senior care facility. However, multiple facilities are not limited to these and may include any other facilities used by the first user.

[0181] The first user's home is a facility where the first user conducts their daily life. The first user uses the control system described above at home. If the first user is healthy, no assistance is required, so the information processing device 10 may be configured to operate in only three modes: off mode, standby mode, and user mode. In other words, in this case, if the first user is in their room, the information processing device 10 is in standby mode, and if the first user's intention to sleep is detected, the information processing device 10 is in user mode. When the first user is using the control system at home, the information processing device 10 stores the first user's settings information. The first user's settings information is settings information that has been learned by the information processing device 10 or set by the first user and is stored in the storage unit 12 of the information processing device 10. As the first user's settings information, for example, a comfortable environment for the first user is stored. For example, the storage unit 12 of the information processing device 10 stores the set temperature of the air conditioning system and the illuminance of the lighting fixtures.

[0182] Suppose the first user is hospitalized due to injury or illness. The control system described in the above embodiment is also used in the hospital. In this case, the first user's settings information, which was stored in the information processing device 10 of the control system used by the first user at home, is transferred to the information processing device 10 of the control system used in the hospital. The first user's settings information is transferred by being transmitted from the home control system to the hospital control system, for example, via a network such as the internet. By transferring the first user's settings information, the same surrounding environment as the first user's home can be realized in the hospital. For example, the same settings such as the air conditioning temperature and lighting intensity can be realized in the hospital as in the home. In addition, processing can be performed in public spaces within the hospital that are tailored to the first user's settings information. For example, suppose the air conditioning temperature setting in a public space such as the cafeteria is 26 degrees. In contrast, suppose the settings information of the hospitalized first user specifies that the air conditioning temperature should be set to 28 degrees. In this case, the information processing device 10 of the hospital control system may, for example, turn on the heater, which is a peripheral device 40 (user device 50) installed on the wheelchair used by the first user. This makes it possible to create a more comfortable environment for the first user while maintaining the environment of the public space.

[0183] Furthermore, while the first user is hospitalized, new settings may be added to the first user's settings information. For example, if an app is used to assist with the care of the first user in the hospital, the method of care used for the first user by the app may be added as user settings information.

[0184] When the first user is discharged from the hospital and returns home, the first user will use the home control system again. In this case, the first user's settings information added at the hospital will be transferred to the home control system. This allows the first user to create the same environment at home as they did at the hospital. Furthermore, if, for example, the method of care for the first user is added as user information at the hospital, the information processing device 10 of the home control system may automatically install the assistance support application used at the hospital on the terminal device 20, or display information recommending its installation. This allows the first user or a family member acting as the second user to use the application that was used at the hospital, even at home.

[0185] Furthermore, suppose the first user becomes elderly and moves into a nursing home. The nursing home also uses the control system described in the above embodiment. In this case, the first user's settings information, which was stored in the information processing device 10 of the control system used by the first user at home, is transferred to the information processing device 10 of the control system used in the nursing home. The first user's settings information is transferred by being transmitted from the home control system to the nursing home control system via a network such as the internet. By transferring the first user's settings information, the same surrounding environment as the first user's home can be realized in the nursing home. Also, in this case, since the information processing device 10 of the home control system also contains the first user's settings information transferred from the hospital, the nursing home also receives the first user's settings information transferred from the hospital. In this way, the first user's settings information can be transferred between multiple facilities, making it easier for the first user to create a comfortable environment for themselves in any facility.

[0186] Furthermore, the first user may change their settings as appropriate. For example, the first user may change the set temperature of the air conditioning system stored in the memory unit 12 of the information processing device 10 by performing a predetermined operation input to the terminal device 20. This allows them to set the temperature to what they find comfortable at that time. When the first user's settings are transferred between facilities, for example, the most recent settings of the first user are transferred. Alternatively, when the first user's settings are transferred between facilities, the settings may be transferred with appropriate weighting depending on when the settings were changed.

[0187] 3.4 Displaying User Status Hospitals and elderly care facilities need to manage the status of first-users. However, it is not easy for hospital or elderly care facility staff to keep track of the status of first-users. In particular, it is difficult to keep track of the status of each first-user when there are many items indicating the first-user's status or when there are many first-users using the facility. Therefore, the information processing device 10 of the control system used in hospitals and elderly care facilities can display the status of multiple first-users in an easy-to-understand manner, for example, on the terminal device of a second-user.

[0188] For example, the information processing device 10 can display the status of the first user's ADL (Activity of Daily Living) on ​​the terminal device as the first user's status. ADL is an indicator of the minimum actions necessary to carry out daily life. ADL is calculated based on actions such as transferring, moving, climbing stairs, dressing, grooming, defecation, urination, toilet use, bathing, and eating. ADL may be calculated by a known method. This ADL may also be calculated based on data acquired from a peripheral device 40. The user's ADL is stored, for example, in the storage unit 12 of the information processing device 10.

[0189] For example, the status of the first user is shown using a pie chart, as shown in Figure 17 as an example. In the status display for ADL, the risk of each item representing an ADL action is shown by a pie chart. In the example shown in Figure 17, the items representing ADL actions include transfer, mobility, stairs, dressing, grooming, defecation, urination, toilet, bathing, and eating. The information processing device 10 can display the status of the first user regarding ADL based on the ADL stored in the storage unit 12. In the status display, for example as shown in Figure 17, the radius of the pie chart for each item increases as the risk increases. A high risk means that if the first user performs the action alone, there is a high possibility that the first user will suffer injury, such as aspiration or falling. In the example shown in Figure 17, it can be seen that the items of transfer, mobility, and stairs have the highest risk. Note that the status display for the first user is not limited to differences in the radius of the pie chart, but may also be expressed by differences in color, for example.

[0190] The information processing device 10 may display the status of the first user regarding risks on the terminal device as the status of the first user. Specifically, the status of the first user is shown using a pie chart, as shown as an example in Figure 18. In the status display regarding risks, the level of risk for each risk item is shown by a pie chart. In the example shown in Figure 18, the risk items include fall risk, slip risk, aspiration pneumonia risk, and pressure ulcer risk. The information processing device 10 can calculate the level of risk for each risk item using an algorithm for calculating the level of each risk item from the ADL stored in the memory unit 12, and display the status regarding risks based on the calculation results. In the status display, for example as shown in Figure 18, the radius of the pie chart increases as the risk increases for each item. In the example shown in Figure 18, it can be seen that the risk of falling is the highest. By looking at the status display of the first user, the second user can quickly grasp which items pose a high risk to the first user.

[0191] The status display may be configured to be switchable by a predetermined operation input by a second user. For example, suppose the information processing device 10 displays the ADL status as shown in Figure 17 on the terminal device. In this case, if the second user performs an operation input to switch the status display, the information processing device 10 may switch the status display shown on the terminal device from the ADL status display shown in Figure 17 to the risk status display shown in Figure 18. In this way, the second user can easily display the status they want to check.

[0192] The information processing device 10 may display the status of multiple first users on the terminal device. For example, the information processing device 10 stores the status (e.g., ADL) of multiple first users who use the facility. The information processing device 10 may display the ADL status for multiple first users on the terminal device. Alternatively, the information processing device 10 may display the risk status for multiple first users on the terminal device. Figure 19 is a diagram showing an example of displaying the risk status of multiple first users. By displaying the status information of multiple first users in this way, it becomes easier to grasp the overall trends of the multiple first users who use the facility. Pressing the "ADL Operation Details" button in Figure 19 displays the ADL status information of multiple first users. This makes it easier to understand what kind of care needs attention and what tools are needed when providing care.

[0193] The information processing device 10 may also recommend times and locations where the risk of falling is high, as well as the appropriate number of personnel to be deployed. The information processing device 10 may also compare the predicted number of tools with the tools currently possessed and recommend the types and quantities of tools that are lacking. For example, as shown in Figure 19, a recommendation such as "You will need 5 more walkers by XX" is displayed around the status information.

[0194] Although this embodiment has been described in detail above, it will be readily apparent to those skilled in the art that many modifications are possible without substantially departing from the novel aspects and effects of this embodiment. Therefore, all such modifications are included within the scope of this disclosure. For example, any term that appears at least once in the specification or drawings together with a broader or synonymous term may be replaced with that different term anywhere in the specification or drawings. Furthermore, all combinations of this embodiment and its modifications are also included within the scope of this disclosure. In addition, the configuration and operation of the information processing device and information processing method are not limited to those described in this embodiment, and various modifications are possible. [Explanation of symbols]

[0195] 1,2...Control system, 10...Information processing device, 11,21,41,51...Control unit, 12,22,42,52...Storage unit, 13,23,43,53...Communication unit, 20,462...Terminal device, 24,54...Display unit, 25,55...Input unit, 40...Peripheral device, 40a...First peripheral device, 40b...Second peripheral device, 40c...Third peripheral device, 40d...Fourth peripheral device, 40e...Fifth peripheral device, 40f...Sixth peripheral device, 40g...Seventh peripheral device, 40h...Eighth peripheral device, 44...Controlled unit, 45...Detection unit, 50...User device, 60...QR code, 61..."Register" button, 460...Swallowing / choking detection device, 461...Throat microphone, 470...Automatic supply device, 471...Arm, 472...Container, 473...Tab

Claims

1. An information processing device that operates in at least two operating modes: user mode and care mode, A communication unit that acquires information about surrounding tools and transmits control signals to peripheral devices to perform control operations, A storage unit that stores control content to be executed by the peripheral device, corresponding to the user mode and the care mode, Based on information about the surrounding tools, the control unit identifies whether the type of care the caregiver intends to perform is a first care or a second care different from the first care, and using a detection device that detects the presence of a person in the room, if it is detected that only the person being cared for is in the room, it causes the communication unit to transmit a control signal to the peripheral device to execute the control content associated with the user mode, and if it is detected that the caregiver has entered the room, it causes the communication unit to transmit a control signal to the peripheral device to execute the control content associated with the care mode of the identified type of care, Equipped with, An information processing device wherein the control content associated with the care mode when the caregiver performs the first care is different from the control content associated with the care mode when the caregiver performs the second care.

2. The storage unit stores the control content for each type of care, corresponding to the care mode. The control unit further identifies the type of care that the caregiver intends to perform based on the care tools brought by the caregiver, and, according to the identified type of care, transmits a control signal from the communication unit to the peripheral device to execute the control content stored in the storage unit. The information processing apparatus according to claim 1.

3. The aforementioned care tools are fitted with RFID (Radio Frequency Identification) tags. The control unit identifies the type of care based on the information of the RFID tag read by the RFID reader. The information processing apparatus according to claim 2.

4. The information processing apparatus according to claim 2, wherein the types of care include excretion assistance to support the excretion of the person being cared for, meal assistance to support the person being cared for eating, and transfer assistance to support the person being cared for moving.

5. The information processing apparatus according to claim 1, wherein the control unit, using the detection device, recognizes the person being cared for as the person being cared for when it is detected that one person is in the room, and recognizes the other person as the caregiver when it is detected that another person has entered the room while the person being cared for is recognized.

6. An information processing device that operates in at least two operating modes, user mode and care mode, and which includes a storage unit that stores control content to be executed by peripheral devices in correspondence with the user mode and the care mode, is an information processing method executed by such an information processing device, Steps to obtain information about the surrounding tools, Based on information about the surrounding tools, the step of identifying whether the type of care the caregiver intends to perform is a first care or a second care that is different from the first care, A step of detecting a user present in a room using a detection device that detects the presence of people in the room, If it is detected that only the person to be cared for is in the room, the communication unit sends a control signal to the peripheral device to execute the control content associated with the user mode, If it is detected that the caregiver has entered the room, the communication unit transmits a control signal to the peripheral device that causes it to execute the control content associated with the care mode of the identified type of care. Includes, An information processing method wherein the control content associated with the care mode when the caregiver performs the first care is different from the control content associated with the care mode when the caregiver performs the second care.

Images