Support device, method, and program

Abstract

To appropriately support an object person.SOLUTION: A support device includes a first acquisition section, a second acquisition section, a determination section, and a presentation section. The first acquisition section acquires information on an action of an object person to be supported. The second acquisition section acquires information on a psychological state of the object person. The determination section determines whether or not the information on the psychological state of the object person deviates from information on a psychological state in ordinary times. The presentation section presents an action suggestion according to the information on the action of the object person when the information on the psychological state of the object person deviates from the information on the psychological state in ordinary times.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The embodiments disclosed in the present specification and drawings relate to an assistance device, a method, and a program. [Background technology]

[0002] Currently, various technologies have been proposed to support users' daily lives. For example, in the medical field, a support system has been proposed to safely and appropriately support dementia patients going out alone. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-060772 Summary of the Invention [Problem to be solved by the invention]

[0004] One of the problems to be solved by the embodiments disclosed in this specification and the drawings is to enable appropriate support to be provided to a subject. However, the problems to be solved by the embodiments disclosed in this specification and the drawings are not limited to the above problem. Problems corresponding to the effects of each configuration shown in the embodiments described below can also be positioned as other problems. [Means for solving the problem]

[0005] An assistance device according to an embodiment includes a first acquisition unit, a second acquisition unit, a determination unit, and a presentation unit. The first acquisition unit acquires information about the behavior of a person receiving assistance. The second acquisition unit acquires information about the psychological state of the person receiving assistance. The determination unit determines whether the information about the psychological state of the person receiving assistance deviates from information about the psychological state of the person receiving assistance in normal times. If the information about the psychological state of the person receiving assistance deviates from information about the psychological state of the person receiving assistance in normal times, the presentation unit presents a behavioral suggestion according to the information about the behavior of the person receiving assistance. [Brief explanation of the drawings]

[0006] [Figure 1] FIG. 1 is a block diagram showing an example of the configuration of the support device according to the first embodiment. [Figure 2] FIG. 2 is a flowchart illustrating an example of a processing procedure of the support device according to the first embodiment. [Figure 3] FIG. 3 is a diagram illustrating an example of vital data according to the first embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of an action plan according to the first embodiment. [Figure 5A] FIG. 5A is a diagram illustrating an example of the analysis process according to the first embodiment. [Figure 5B] FIG. 5B is a diagram illustrating an example of the analysis process according to the first embodiment. [Figure 5C] FIG. 5C is a diagram illustrating an example of the analysis process according to the first embodiment. [Figure 6] FIG. 6 is a diagram illustrating an example of the presentation process according to the first embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0007] Hereinafter, embodiments of the support device, method, and program will be described in detail with reference to the drawings. Note that the support device, method, and program according to the present application are not limited to the following embodiments.

[0008] (First embodiment) As mentioned above, various technologies have been proposed to support daily life, and support systems for dementia patients are known, for example. When dementia develops, four core symptoms are observed: memory impairment, which causes loss of memory for past events; impaired comprehension and judgment, which causes the inability to make decisions even about trivial matters in daily life; impaired executive function, which causes the inability to plan and carry out tasks in an orderly manner toward a goal; and disorientation, which causes the inability to correctly recognize time, place, people, and the surrounding situation. In addition, behavioral and psychological symptoms such as delusions, hallucinations, delirium, wandering, depression, personality changes, and violent behavior may also be observed.

[0009] As dementia reduces memory, judgment, and calculation skills, it can lead to more mistakes and an inability to correctly recognize time, place, people, and the surrounding situation. Dementia also reduces stress tolerance, leading to constant tension and anxiety, and even minor panic attacks.

[0010] In addition, some dementia patients have difficulty speaking and are unable to ask others about their doubts or unclear points, making it difficult for third parties to notice their difficulties or changes in their psychological state. Alternatively, dementia patients may not be aware of changes in their own psychological state.

[0011] One known support system for dementia patients is one that observes their behavior and provides support when they behave unplanned. However, it is difficult to distinguish whether the cause of the unplanned behavior is a change in the psychological state specific to dementia, or whether it is due to some other sudden factor (such as being stopped by someone), and provide support accordingly.

[0012] Therefore, the support device of this embodiment targets dementia patients as support recipients, acquires information about the behavior and psychological state of the recipient, and provides support according to each piece of acquired information, thereby making it possible to provide appropriate support to the recipient.

[0013] Fig. 1 is a block diagram showing an example of the configuration of a support device 100 according to the first embodiment. Here, Fig. 1 shows an example of a support system 1 including the support device 100. For example, as shown in Fig. 1, the support system 1 includes the support device 100, a subject device 200, and a verifying device 300, and each device is connected to each other via a network 400 so as to be able to communicate with each other.

[0014] 1 shows a single subject device 200 and a single confirmer device 300, but a plurality of subject devices 200 and a plurality of confirmer devices 300 may be connected to the network 400. Also, in the support system 1 shown in FIG. 1, only the support device 100, the subject device 200, and the confirmer device 300 are shown, but various other devices and systems may be connected to the network 400. For example, the support system 1 may be a case in which a data storage device that stores various data on the subject is connected to the network 400.

[0015] The subject device 200 has a behavioral data acquisition device 21, a vital data acquisition device 22, and a terminal device 23, and is operated by the subject of support (a dementia patient). The behavioral data acquisition device 21 and the terminal device 23, and the vital data acquisition device 22 and the terminal device 23 are connected to each other so that they can communicate with each other via short-range wireless communication or the like.

[0016] The behavioral data acquisition device 21 acquires behavioral data of the subject and transmits it to the terminal device 23. For example, the behavioral data acquisition device 21 acquires camera images of the subject's behavior, input information input by the subject, location information of the subject, and the like, and transmits them to the terminal device 23. The behavioral data acquisition device 21 is realized by, for example, a camera, a personal computer (PC), a tablet PC, or a mobile phone (such as a smartphone). Note that while FIG. 1 shows an example in which the subject device 200 includes the behavioral data acquisition device 21, the terminal device 23 may also function as the behavioral data acquisition device. In this case, the subject device 200 includes only the vital data acquisition device 22 and the terminal device 23.

[0017] The vital data acquisition device 22 has various sensors, acquires vital data of the subject, and transmits it to the terminal device 23. For example, the vital data acquisition device 22 acquires vital data such as heart rate, pulse, blood pressure, electrocardiogram, respiratory condition, exercise status (number of steps, time, etc.), body temperature, blood oxygen saturation, and the subject's line of sight, and transmits it to the terminal device 23. The vital data acquisition device 22 is realized by, for example, a wearable device, a biosensor, a non-contact sensor, etc. Note that wearable devices include, for example, wristwatch-type, eyeglass-type, ring-type, shoe-type, pocket-type, pendant-type, diaper-type, electroencephalograph-type, etc. Furthermore, biosensors include, for example, simple blood glucose meters, antigen-antibody test devices (simple urine test devices), etc. Furthermore, non-contact sensors include, for example, millimeter-wave radar, etc.

[0018] The terminal device 23 is a device operated by the subject. The terminal device 23 transmits the behavioral data of the subject received from the behavioral data acquisition device 21 to the support device 100. The terminal device 23 also transmits the vital data of the subject received from the vital data acquisition device 22 to the support device 100. The terminal device 23 also displays various information received from the support device 100 on its own display or outputs it as audio information. The terminal device 23 also accepts various operations via its own input interface. For example, the terminal device 23 can also accept input operations from the subject, such as information on their own behavior or information on their psychological state, and transmit the information to the support device 100. The terminal device 23 is realized by, for example, a PC, a tablet PC, a PDA, a mobile phone (such as a smartphone), or the like.

[0019] In this embodiment, a case will be described in which the terminal device 23 transmits vital data acquired by the vital data acquisition device 22 to the support device 100, but the embodiment is not limited to this. For example, the vital data acquisition device 22 may have a communication function with the support device 100, and the vital data acquisition device 22 may communicate with the support device 100.

[0020] The checker device 300 is composed of a terminal device 31 and is operated by a checker who checks the condition of the subject. Here, the checker includes, for example, a caregiver who cares for the subject, a relative of the subject, a colleague at the workplace of the subject, etc.

[0021] The terminal device 31 is a device operated by a checker. The terminal device 31 receives various information indicating the condition of the subject from the support device 100, and displays the various information received from the support device 100 on its own display or outputs it as audio information. The terminal device 31 is realized by, for example, a PC, a tablet PC, a PDA, a mobile phone (such as a smartphone), or the like.

[0022] The support device 100 is a device operated by an administrator of the support system 1, and executes various processes to support the subject. Specifically, the support device 100 estimates the subject's psychological state based on the behavioral data acquired by the behavioral data acquisition device 21 and the vital data acquired by the vital data acquisition device 22, and when the psychological state is different from normal, presents behavioral suggestions according to the behavior.

[0023] 1, the assistance device 100 includes a communication interface 11, an input interface 12, a display 13, a memory circuit 14, and a processing circuit 15. For example, the assistance device 100 is realized by a computer device such as a PC, a workstation, or a server.

[0024] The communication interface 11 controls the transmission and communication of various data sent and received between the assistance device 100 and each device connected via the network 400. Specifically, the communication interface 11 is connected to the processing circuit 15, and transmits data received from each device on the network 400 to the processing circuit 15, or transmits data received from the processing circuit 15 to each device on the network 400. For example, the communication interface 11 is realized by a network card, a network adapter, a NIC (Network Interface Controller), or the like.

[0025] The input interface 12 accepts input operations of various instructions and information from an operator. Specifically, the input interface 12 is connected to the processing circuit 15, converts the input operations received from the operator into electrical signals, and transmits the electrical signals to the processing circuit 15. For example, the input interface 12 may be realized by a trackball, a switch button, a mouse, a keyboard, a touchpad that performs input operations by touching the operation surface, a touchscreen that integrates a display screen and a touchpad, a non-contact input interface using an optical sensor, a voice input interface, etc. Note that in this specification, the input interface 12 is not limited to those that have physical operation components such as a mouse and a keyboard. For example, an electrical signal processing circuit that receives an electrical signal corresponding to an input operation from an external input device provided separately from the device and transmits the electrical signal to a control circuit is also included as an example of the input interface 12.

[0026] The display 13 displays various types of information and data. Specifically, the display 13 is connected to the processing circuit 15 and displays various types of information and data received from the processing circuit 15. For example, the display 13 is realized by a liquid crystal display, a CRT (Cathode Ray Tube) display, a touch panel, or the like.

[0027] The memory circuitry 14 stores various data and programs. Specifically, the memory circuitry 14 is connected to the processing circuitry 15 and stores data received from the processing circuitry 15, or reads out stored data and transmits it to the processing circuitry 15. For example, the memory circuitry 14 is realized by a semiconductor memory element such as a read-only memory (ROM), a random access memory (RAM), or a flash memory, or a hard disk, an optical disk, or the like. Note that the memory circuitry 14 may also be realized by a cloud computer connected to the assistance device 100 via a network 400.

[0028] The processing circuitry 15 controls the entire assistance device 100. Specifically, the processing circuitry 15 executes various processes for assisting the subject. For example, the processing circuitry 15 controls data exchange with devices on the network 400, data storage in the memory circuitry 14, and various processes using data.

[0029] For example, as shown in FIG. 1, in this embodiment, the processing circuitry 15 executes a first acquisition function 151, a second acquisition function 152, a determination function 153, an estimation function 154, and a presentation function 155. Here, the first acquisition function 151 is an example of a first acquisition unit. The second acquisition function 152 is an example of a second acquisition unit. The determination function 153 is an example of a determination unit. The estimation function 154 is an example of an estimation unit. The presentation function 155 is an example of a presentation unit.

[0030] The first acquisition function 151 acquires information about the behavior of the support target. Specifically, the first acquisition function 151 acquires behavior data that is routinely acquired by the behavior data acquisition device 21 from the terminal device 23. For example, the first acquisition function 151 acquires camera images of the target acquired by the behavior data acquisition device 21, input information input by the target, location information of the target, etc.

[0031] The second acquisition function 152 acquires information related to the psychological state of the subject. Specifically, the second acquisition function 152 acquires vital data of the subject. For example, the second acquisition function 152 acquires vital data that is acquired on a daily basis by the vital data acquisition device 22 from the terminal device 23. Furthermore, for example, the second acquisition function 152 can also acquire input information that the subject inputs to the terminal device 23 as information related to the psychological state of the subject.

[0032] The determination function 153 determines whether or not information regarding the psychological state of the subject deviates from information regarding the psychological state in normal times. Specifically, the determination function 153 determines whether or not the vital data of the subject deviates from the vital data in normal times. Furthermore, the determination function 153 determines whether or not the behavior performed by the subject is a predetermined behavior in the information regarding the behavior of the subject. The processing by the determination function 153 will be described in detail later.

[0033] The estimation function 154 estimates the subject's condition based on the determination result by the determination function 153. Specifically, the estimation function 154 estimates the subject's condition based on whether the vital data is different from normal and whether the behavioral data is a predetermined behavior. For example, when information about the subject's psychological state deviates from information about the subject's normal psychological state and the behavior performed by the subject is different from the predetermined behavior, the estimation function 154 estimates that the subject is suspected of having dementia based on behavioral and psychological symptoms of dementia (BPSD) associated with dementia. The processing by the estimation function 154 will be described in detail later.

[0034] The presentation function 155 presents behavioral suggestions corresponding to information regarding the behavior of the subject when information regarding the subject's psychological state deviates from information regarding the subject's psychological state in normal times. Specifically, the presentation function 155 presents behavioral suggestions corresponding to information regarding the subject's behavior when the subject's vital data deviates from information regarding the subject's vital data in normal times. For example, when information regarding the subject's psychological state deviates from information regarding the subject's psychological state in normal times, the presentation function 155 presents different behavioral suggestions when the subject's behavior differs from a predetermined behavior and when the subject's behavior is a predetermined behavior. The presentation function 155, for example, transmits the behavioral suggestions to the terminal device 23, thereby presenting the behavioral suggestions on the display of the terminal device 23. The presentation function 155 can also transmit a warning or behavioral suggestions for the subject to the terminal device 31 and present them on the display of the terminal device 31. The processing by the presentation function 155 will be described in detail later.

[0035] The processing circuitry 15 described above is realized by, for example, a processor. In this case, each of the processing functions described above is stored in the storage circuitry 14 in the form of a program executable by a computer. The processing circuitry 15 then reads and executes each program stored in the storage circuitry 14 to realize the function corresponding to each program. In other words, the processing circuitry 15 has each of the processing functions shown in FIG. 1 when each program is read.

[0036] The processing circuitry 15 may be configured by combining multiple independent processors, and each processor may execute a program to realize each processing function. Furthermore, each processing function of the processing circuitry 15 may be appropriately distributed or integrated and realized in a single or multiple processing circuits. Furthermore, each processing function of the processing circuitry 15 may be realized by a combination of hardware and software, such as circuits. While the example described here is one in which programs corresponding to each processing function are stored in a single storage circuitry 14, the embodiment is not limited to this. For example, programs corresponding to each processing function may be distributed and stored in multiple storage circuits, and the processing circuitry 15 may read and execute each program from each storage circuit. Furthermore, some of the processing functions of the processing circuitry 15 may be realized by a cloud computer connected to the assistance device 100 via the network 400.

[0037] Next, the processing procedure by the support device 100 will be described with reference to Fig. 2, and then each processing will be described in detail. Fig. 2 is a flowchart showing an example of the processing procedure of the support device 100 according to the first embodiment. Note that Fig. 2 shows processing after support for the subject has started.

[0038] For example, as shown in FIG. 2, in this embodiment, the first acquisition function 151 and the second acquisition function 152 start acquiring behavioral data and vital data (step S101). Specifically, the first acquisition function 151 starts a process of sequentially acquiring the behavioral data of the subject at a predetermined acquisition frequency. Furthermore, the second acquisition function 152 starts a process of sequentially acquiring the vital data of the subject at a predetermined acquisition frequency. That is, after support for the subject is started, the first acquisition function 151 and the second acquisition function 152 continue to acquire each piece of data until the support is ended. This process is realized, for example, by the processing circuitry 15 calling up and executing programs corresponding to the first acquisition function 151 and the second acquisition function 152 from the storage circuitry 14.

[0039] Next, the determination function 153 compares the behavior plan with the behavior data (step S102) and determines whether or not there is an abnormality (step S103). That is, the determination function 153 determines whether or not the behavior indicated by the behavior data is a predetermined behavior. Furthermore, the determination function 153 determines whether or not there is an abnormality in the vital data (steps S104, S109) when there is an abnormality in the behavior data (step S103: Yes) and when there is no abnormality in the behavior data (step S103: No). That is, the determination function 153 determines whether or not the acquired vital data deviates from normal data. These processes are realized, for example, by the processing circuitry 15 calling up and executing a program corresponding to the determination function 153 from the storage circuitry 14.

[0040] Here, if there is an abnormality in the behavioral data and an abnormality in the vital data (step S103: Yes, step S104: Yes), the estimation function 154 performs an analysis related to dementia (step S105). Then, the presentation function 155 presents an action suggestion related to the next action (step S106). Furthermore, the second acquisition function 152 increases the frequency of acquiring vital data (step S107). These processes are realized, for example, by the processing circuitry 15 calling up and executing programs corresponding to the estimation function 154, the presentation function 155, and the second acquisition function 152 from the storage circuitry 14.

[0041] If the behavioral data contains an abnormality and the vital data does not contain an abnormality (step S103: Yes, step S104: No), the estimation function 154 executes behavioral analysis (step S108). This process is realized, for example, by the processing circuitry 15 calling up a program corresponding to the estimation function 154 from the storage circuitry 14 and executing it.

[0042] If there is no abnormality in the behavioral data and there is an abnormality in the vital data (step S103: No, step S109: Yes), the estimation function 154 performs an analysis of the psychological state (step S110). Then, the presentation function 155 presents a behavioral suggestion for restoring the vital data to normal data (step S111). These processes are realized, for example, by the processing circuitry 15 calling up and executing programs corresponding to the estimation function 154 and the presentation function 155 from the storage circuitry 14.

[0043] Furthermore, if there is no abnormality in the behavioral data and no abnormality in the vital data (step S103: No, step S109: No), the determination function 153 determines whether or not to end the support (step S112). Here, if the support is not to be ended (step S112: No), the determination function 153 returns to step S102 and continues the processing. On the other hand, if the support is to be ended, the support device 100 ends the processing. This processing is realized, for example, by the processing circuitry 15 calling up a program corresponding to the determination function 153 from the storage circuitry 14 and executing it.

[0044] In the support device 100, even after steps S107, S108, and S111, the determination function 153 determines whether or not to end the support (step S112). If the support is not to be ended (step S112: No), the determination function 153 returns to step S102 and continues the process. On the other hand, if the support is to be ended, the support device 100 ends the process.

[0045] Each process executed by the assistance device 100 will be described in detail below.

[0046] (Data acquisition process) 2, the first acquisition function 151 and the second acquisition function 152 acquire behavioral data and vital data of the subject. The acquisition of behavioral data by the first acquisition function 151 and the acquisition of vital data by the second acquisition function 152 will be described below in order.

[0047] The first acquisition function 151 acquires the behavioral data of the subject acquired by the behavioral data acquisition device 21 via the terminal device 23. As described above, the behavioral data acquisition device 21 is a camera, a PC, or the like, and acquires behavioral data of the subject in daily life. For example, the subject wears a camera (e.g., a work camera) serving as the behavioral data acquisition device 21 and performs work in the workplace. The behavioral data acquisition device 21 transmits camera images (e.g., video images) of the subject working to the terminal device 23. The first acquisition function 151 acquires the camera images (behavioral data) sequentially acquired by the behavioral data acquisition device 21 from the terminal device 23. That is, the first acquisition function 151 acquires camera images capturing the subject's behavior while working.

[0048] The camera serving as behavioral data acquisition device 21 is not limited to being worn by the subject, but may be fixed indoors or the like. That is, it may be placed and fixed so as to be able to capture the space in which the subject performs his or her work. Furthermore, the camera images captured by the camera are not limited to moving images, but may also be still images captured at regular time intervals.

[0049] The behavioral data acquisition device 21 can also acquire input information by the subject and location information of the subject as the subject's behavioral data. In such cases, for example, a PC, tablet PC, smartphone, or the like is used as the behavioral data acquisition device 21. For example, the subject inputs the tasks he or she has performed into the PC, tablet PC, or smartphone. In this way, the behavioral data acquisition device 21 acquires the subject's behavioral data. Furthermore, when the subject carries a tablet PC or smartphone while working, the subject's location information is acquired by the GPS (Global Positioning System) provided therein. The behavioral data acquisition device 21 pre-stores correspondence information in which location information and task content are associated, and acquires the task content (behavioral data) performed by the subject by comparing the correspondence information with the acquired location information of the subject. The first acquisition function 151 acquires behavioral data based on the input information by the subject and the location information of the subject.

[0050] The second acquisition function 152 acquires vital data acquired by the vital data acquisition device 22 as information related to the psychological state of the subject. Here, the second acquisition function 152 according to this embodiment acquires vital data related to behavioral and psychological symptoms of dementia (BPSD). BPSD is defined as symptoms caused by disorders of perception, thought content, mood, or behavior that are frequently seen in dementia patients, and includes a variety of items.

[0051] The second acquisition function 152 according to this embodiment acquires vital data related to seven items considered to be related to panic symptoms in such BPSD: "excitement," "anxiety," "emotional instability," "fear," "confusion," "avoiding eye contact," and "talking to oneself." Fig. 3 is a diagram for explaining an example of vital data according to the first embodiment. Here, Fig. 3 shows physical parameters (vital data) related to each psychological state (BPSD item) and a detection means (vital data acquisition device 22) for detecting the physical parameters.

[0052] For example, as shown in FIG. 3, "heart rate," "sweating," "hyperventilation," and "changes in behavior (wandering around)" are acquired as physical parameters related to the psychological states of "excitement," "anxiety," "emotional instability," "fear," and "confusion." Here, "heart rate" is detected based on, for example, "heart rate" and "heart rate variability" that can be acquired by a smartwatch (a wristwatch-type wearable device). "sweating" is detected based on, for example, "body temperature" that can be acquired by a smartwatch. "hyperventilation" is detected based on "respiratory rate" and "blood oxygen saturation" that can be acquired by a smartwatch. "Changes in behavior (wandering around)" is detected based on location information acquired by the "GPS" and "camera" provided in the smartphone or smartwatch.

[0053] Furthermore, for example, as shown in Fig. 3, "gaze" is acquired as a physical parameter related to the psychological state of "no eye contact." Here, "gaze" is detected by, for example, a "gaze camera" provided in smart glasses (glasses-type wearable device).

[0054] Furthermore, for example, as shown in Fig. 3, "voice" is acquired as a physical parameter related to the psychological state "talking to oneself." Here, "voice" is detected by, for example, a "microphone" provided in a smartphone or a smartwatch.

[0055] Note that the physical parameters and detection means shown in Figure 3 are merely examples and are not limited to these. Also, the "mental state" items shown in Figure 3 are merely examples, and if the subject is a dementia patient, other items in BPSD may be used.

[0056] The first acquisition function 151 associates the behavioral data acquired as described above with information about the subject (for example, information for identifying the subject) and stores the data in the memory circuitry 14. The second acquisition function 152 associates the vital data (physical parameters) acquired as described above with information about the subject and stores the data in the memory circuitry 14. Here, the vital data may be further associated with a determination result by the determination function 153 and stored. Specifically, each vital data may be associated with information indicating whether it is a value in a normal state or an abnormal state (a state deviating from the normal state).

[0057] (Determination process of behavioral data) 2, the determination function 153 compares the behavioral data acquired by the first acquisition function 151 with the behavioral plan to determine whether or not there is an abnormality. Specifically, the determination function 153 acquires the behavioral plan of the subject and determines whether or not the behavioral data is in accordance with the behavioral plan. Here, the behavioral plan of the subject is, for example, registered in advance in the terminal device 23 and acquired by the determination function 153.

[0058] The determination function 153 acquires the details of the behavior of the subject from the behavior data acquired by the first acquisition function 151, and compares the acquired details of the behavior with the behavior plan to determine whether the behavior is in accordance with the behavior plan. For example, when a camera image is acquired as the behavior data, the determination function 153 acquires the time when the behavior was performed from the time the camera image was taken, and acquires the details of the behavior of the subject from image analysis of the camera image. As an example, the determination function 153 acquires the details of the behavior of the subject by inputting the camera image into a trained model for AI (Artificial Intelligence) analysis.

[0059] The trained model described above is trained in advance using, for example, camera images of various behaviors and the behavioral details in the camera images as training data, and is stored in the memory circuitry 14. The determination function 153 acquires the behavioral details (e.g., work details) of the subject by inputting the camera images acquired by the first acquisition function 151 into the trained model stored in the memory circuitry 14. Then, the determination function 153 compares the acquired behavioral details with the behavior plan and determines whether the acquired behavioral details differ from the behavior plan.

[0060] In addition, when the behavioral data obtained is, for example, behavioral content (e.g., work content) based on information input by the subject or behavioral content (e.g., work content) based on location information, the judgment function 153 compares the obtained behavioral content with the behavior plan corresponding to the time the information was input (or the time the location information was obtained) to determine whether the subject's behavior is in accordance with the behavior plan.

[0061] (Vital data determination processing) 2, the determination function 153 determines whether or not there is an abnormality in the vital data acquired by the second acquisition function 152. Here, the determination function 153 can perform the determination process of the vital data using various methods.

[0062] For example, the determination function 153 compares information about the subject's psychological state with information about the subject's normal psychological state previously acquired from the subject to determine whether the information about the subject's current psychological state deviates from the information about the subject's normal psychological state. That is, the determination function 153 compares the subject's current vital data acquired by the second acquisition function 152 with the past vital data stored in the memory circuitry 14 to determine whether the subject's current vital data differs from that of the normal state.

[0063] As an example, the determination function 153 reads out vital data in a normal state from the past vital data of the subject stored in the memory circuitry 14, and compares it with the vital data acquired by the second acquisition function 152 to determine whether the current psychological state of the subject is different from the normal psychological state. That is, the determination function 153 determines that the current psychological state of the subject is different from the normal psychological state when the vital data acquired by the second acquisition function 152 is significantly different from the vital data in the normal state (for example, when the difference is equal to or greater than a preset threshold).

[0064] In the above example, a case has been described in which the vital data acquired by the second acquisition function 152 is compared with values ​​in a past normal state, but the embodiment is not limited to this, and the vital data acquired by the second acquisition function 152 may be compared with values ​​in a past abnormal state. In such a case, if there is no difference between the vital data acquired by the second acquisition function 152 and the vital data in the abnormal state (for example, if the difference is less than a preset threshold), the determination function 153 determines that the subject's current psychological state is different from normal.

[0065] Furthermore, for example, the determination function 153 compares the information on the psychological state of the subject with a predetermined threshold to determine whether the information on the current psychological state of the subject deviates from the information on the psychological state in normal times. That is, the determination function 153 compares the vital data of the current subject acquired by the second acquisition function 152 with a preset threshold to determine whether the vital data of the current subject differs from the vital data in normal times.

[0066] The threshold value to be compared with the vital data may be a single value or a numerical range having a certain width. That is, the determination function 153 determines that the subject's current vital data acquired by the second acquisition function 152 is in a normal state when the vital data is within a certain numerical range. On the other hand, if the subject's current vital data acquired by the second acquisition function 152 exceeds the certain numerical range, the determination function 153 determines that the subject's psychological state is different from normal.

[0067] As described above, the determination function 153 uses thresholds when performing the determination process of vital data, and these thresholds may be set to uniform values ​​or may be set for each subject. For example, for a subject for whom past data has been accumulated, thresholds may be set based on the past data.

[0068] (Analysis process based on the judgment result) 2, the estimation function 154 performs each analysis process according to the determination result by the determination function 153. Specifically, the estimation function 154 performs analysis processes for each of the first case (behavioral data is abnormal and vital data is abnormal), the second case (behavioral data is abnormal and vital data is normal), and the third case (behavioral data is normal and vital data is abnormal).

[0069] Below, examples of analysis processing in each case will be described using the subject's behavior plan shown in Fig. 4. Fig. 4 is a diagram showing an example of a behavior plan according to the first embodiment. For example, the subject works as an automobile production line worker and performs various tasks according to the time schedule shown in Fig. 4. During work, behavioral data and vital data are sequentially acquired from the subject, the determination function 153 performs determination processing, and the estimation function 154 performs analysis processing according to the determination results.

[0070] First, in the first case (behavioral data is abnormal and vital data is abnormal), as shown in step S105, the estimation function 154 performs an analysis related to dementia. FIG. 5A is a diagram for explaining an example of the analysis process according to the first embodiment. For example, as shown in FIG. 5A, in an automobile production line operation, the subject stopped and interrupted the work at the 15th item of the water leak test starting at 1:00 PM, and the scheduled time passed, so the determination function 153 determines that there is an abnormality in the behavioral data. Furthermore, the determination function 153 confirms an increase in the heart rate, body temperature, and respiratory rate in the vital data, so it determines that there is an abnormality in the vital data.

[0071] In this first case, the estimation function 154 analyzes whether the subject is suspected of having behavioral and psychological symptoms associated with dementia. For example, the estimation function 154 derives an analysis result that the current case is suspected of having behavioral and psychological symptoms associated with dementia, based on the fact that similar situations have repeatedly occurred in the subject's past data. In other words, the estimation function 154 performs an analysis of dementia using the subject's tendencies (changes in physical parameters that are likely to appear with dementia).

[0072] In addition to the analysis based on the past data described above, the estimation function 154 can also perform analysis based on the degree of agreement with BPSD items in the analysis of dementia. For example, when the estimation function 154 determines that a predetermined number of physical parameters shown in FIG. 3 are not normal, it determines that there is a suspicion of behavioral and psychological symptoms associated with dementia. The predetermined number of items may be set uniformly for multiple dementia patients, or may be set for each dementia patient. For example, the number of items may be set according to the number of parameters that are likely to change with dementia.

[0073] Next, in the second case (behavioral data is abnormal and vital data is normal), as shown in step S108, the estimation function 154 performs behavioral analysis. FIG. 5B is a diagram for explaining an example of the analysis process according to the first embodiment. For example, as shown in FIG. 5B, in the behavior plan for automobile line work, an exhaust gas inspection was scheduled to be conducted in the gas inspection room from 2 p.m., but the subject did not conduct the exhaust gas inspection and instead performed the next electronic component inspection, so the determination function 153 determines that there is an abnormality in the behavioral data. On the other hand, the determination function 153 determines that the vital data is normal.

[0074] In this second case, the estimation function 154 analyzes the change in the behavior of the subject. For example, the estimation function 154 derives an analysis result that although the behavior is not as planned, the change in behavior is due to an on-site judgment caused by a malfunction of the exhaust gas inspection device or the like, and is not due to the subject's dementia, because there is no abnormality in the vital data.

[0075] Next, in the third case (behavioral data is normal and vital data is abnormal), as shown in step S110, the estimation function 154 performs an analysis of the psychological state. FIG. 5C is a diagram for explaining an example of the analysis process according to the first embodiment. For example, as shown in FIG. 5C, in an automobile production line operation, an increase in heart rate is confirmed during a visual inspection starting at 9:00, and therefore the determination function 153 determines that there is an abnormality in the vital data. On the other hand, the determination function 153 determines that the behavioral data is normal.

[0076] In such a third case, the estimation function 154 analyzes a change in the psychological state of the subject. For example, the estimation function 154 derives an analysis result that the change in the vital data is due to the occurrence of a near-miss incident such as a fall, because the vital data is not normal but there is no abnormality in the behavioral data.

[0077] (Action suggestion presentation process) 2, the presentation function 155 performs a process of presenting behavioral suggestions to the subject in accordance with the estimation result by the estimation function 154. Specifically, the estimation function 154 performs a process of presenting behavioral suggestions when an analysis related to dementia has been performed and when an analysis related to a psychological state has been performed.

[0078] For example, if the behavior performed by the subject is different from the prescribed behavior, the presentation function 155 presents the subject with a behavioral suggestion to perform the prescribed behavior, and if the behavior performed by the subject is the prescribed behavior, the presentation function 155 presents the subject with a behavioral suggestion to return the subject to a normal psychological state.

[0079] FIG. 6 is a diagram illustrating an example of the presentation process according to the first embodiment. For example, as shown in FIG. 6, when "Behavior: Abnormal, Vital Signs: Abnormal" and "Analysis Result: Suspected Behavioral and Psychological Symptoms Associated with Dementia" are displayed, the presentation function 155 suggests the next action as a suggested action. For example, when a subject stops working at the 15th item of a water leak test in an automobile production line, the presentation function 155 presents a suggested action explaining that the 15th test item has been completed and the next item is the 16th. The presentation function 155 can also present a question asking whether a detailed explanation of the testing method is required. In such a case, the presentation function 155 transmits information to the terminal device 23 for outputting the suggested action, for example, as text or audio.

[0080] 6, for example, when "Behavior: Normal, Vital Signs: Abnormal" and "Analysis Result: Happening Occurrence," the presentation function 155 suggests an action to calm the mind as a suggestion. For example, the presentation function 155 suggests to a subject whose heart rate is confirmed to be elevated during a visual inspection of an automobile production line worker to take deep breaths, etc. That is, the presentation function 155 transmits information to the terminal device 23 for displaying the suggestion in text, such as deep breathing, or outputting it as audio.

[0081] Here, the presentation function 155 can change the presentation process depending on the response from the subject. For example, if there is a change in the subject's behavioral data or vital data (for example, if the subject starts a predetermined next action or the vital data returns to a normal state), the presentation function 155 ends the information presentation process. On the other hand, for example, if there is no change in the subject's behavioral data or vital data even after a certain period of time has passed, the presentation function 155 enhances the display of text or audio output of action suggestions.

[0082] The presentation function 155 can present information on suggested actions not only to the subject but also to a confirmer (such as a caregiver who cares for the subject, a relative of the subject, or a colleague at work of the subject). That is, the presentation function 155 can transmit information on suggested actions for the subject to the terminal device 31. For example, the presentation function 155 transmits information indicating the subject's next action or information informing the subject that panic has occurred to the terminal device 31. This allows the confirmer to make appropriate comments to the subject.

[0083] (Data acquisition adjustment process) 2, when the information on the psychological state of the subject deviates from the information on the psychological state in normal times and the behavior of the subject differs from the predetermined behavior, the second acquisition function 152 increases the frequency of acquisition of the information on the psychological state of the subject. That is, the support device 100 starts a process for monitoring the change in the vital data of the subject at high resolution.

[0084] As described above, according to the first embodiment, the first acquisition function 151 acquires information about the behavior of the person receiving support. The second acquisition function 152 acquires information about the mental state of the person receiving support. The determination function 153 determines whether the information about the mental state of the person receiving support deviates from information about the person receiving support in normal times. The presentation function 155 presents behavioral suggestions according to the information about the person receiving support in normal times when the information about the person receiving support in normal times deviates from information about the person receiving support in normal times. Therefore, the support device 100 according to the first embodiment can provide behavioral suggestions according to the behavior of the person receiving support in cases where the person receiving support in normal times is not in a normal mental state, thereby enabling appropriate support to be provided to the person receiving support.

[0085] Furthermore, according to the first embodiment, the second acquisition function 152 acquires vital data of the subject. The determination function 153 determines whether the vital data of the subject deviates from the vital data in normal times. The presentation function 155 presents behavioral suggestions according to information on the subject's behavior when the vital data of the subject deviates from the vital data in normal times. Therefore, the support device 100 according to the first embodiment can appropriately determine the psychological state of the subject and enable appropriate support to be provided to the subject.

[0086] Furthermore, according to the first embodiment, the determination function 153 further determines whether the behavior performed by the subject is a predetermined behavior based on the information on the subject's behavior. When the information on the subject's psychological state deviates from the information on the subject's psychological state under normal circumstances, the presentation function 155 presents different behavior suggestions depending on whether the behavior performed by the subject is different from the predetermined behavior or whether the behavior performed by the subject is the predetermined behavior. Therefore, the support device 100 according to the first embodiment can detect unplanned behavior caused by a change in the psychological state and provide appropriate support for the behavior.

[0087] According to the first embodiment, the presenting function 155 presents the subject with a behavior suggestion for performing the predetermined behavior when the behavior performed by the subject is different from the predetermined behavior, and presents the subject with a behavior suggestion for returning the subject to a normal psychological state when the behavior performed by the subject is the predetermined behavior. Therefore, the support device 100 according to the first embodiment can provide appropriate support to return the subject to a normal psychological state.

[0088] According to the first embodiment, the second acquisition function 152 increases the frequency of acquisition of information on the subject's mental state when the information on the subject's mental state deviates from the information on the subject's normal mental state and the subject's behavior differs from the predetermined behavior. Therefore, the support device 100 according to the first embodiment makes it possible to appropriately acquire the subject's mental state.

[0089] According to the first embodiment, the determination function 153 compares information on the subject's psychological state with information on the subject's normal psychological state previously acquired from the subject, thereby determining whether the information on the subject's current psychological state deviates from the information on the subject's normal psychological state. Therefore, the support device 100 according to the first embodiment makes it possible to determine the psychological state according to the characteristics of the subject.

[0090] According to the first embodiment, the determination function 153 compares the information on the subject's psychological state with a predetermined threshold to determine whether the information on the subject's current psychological state deviates from the information on the subject's psychological state in normal times. Therefore, the support device 100 according to the first embodiment can determine the subject's psychological state through simple processing.

[0091] Furthermore, according to the first embodiment, the estimation function 154 estimates whether the subject is suspected of having dementia based on behavior and psychological state associated with dementia (BPSD) when information on the subject's psychological state deviates from information on the subject's normal psychological state and the subject's behavior differs from a predetermined behavior. Therefore, the support device 100 according to the first embodiment makes it possible to provide appropriate support to the subject even when the subject is a dementia patient.

[0092] (Other embodiments) In the above embodiment, the case where the target of the assistance device is a dementia patient has been described. However, the embodiment is not limited to this, and may be applied to, for example, patients with other diseases, elderly people, or children.

[0093] In the above-described embodiment, a case has been described in which vital data acquired by a wearable device is used as information related to the psychological state. However, the embodiment is not limited to this, and, for example, information input by the subject may be used as information related to the psychological state. For example, even if a dementia patient has difficulty interacting with others, they may be able to perform input actions (e.g., character input or voice input) on a PC. Therefore, for example, the subject performs an input operation related to their own psychological state on the terminal device 23, and the second acquisition function 152 acquires information related to the subject's psychological state from the terminal device 23.

[0094] In the above embodiment, the case where the subject's behavior is the work of an automobile production line worker has been described as an example. However, the assistance device 100 according to this embodiment can support the subject in various other situations. Some examples will be described below.

[0095] For example, if the subject is an employee who spends a lot of time seated at a desk, the subject's position hardly changes, making it difficult to determine behavioral data using location information. Therefore, the first acquisition function 151 acquires the operation history (such as an operation log) of the PC operated by the subject as behavioral data. The determination function 153 then compares the behavior plan with the operation history to determine whether there is an abnormality in the behavioral data.

[0096] Furthermore, if the subject is an employee who spends a lot of time seated at an office desk, the second acquisition function 152 can also acquire camera images from a PC camera installed in the PC as vital data. In such a case, the determination function 153 acquires the above-mentioned physical parameters from the subject's appearance depicted in the camera image. For example, the determination function 153 analyzes changes in facial expressions, respiratory status, heart rate, etc. through image analysis of the camera image to determine whether there is an abnormality in the vital data. Note that publicly known technology can be used as appropriate for this image analysis.

[0097] Furthermore, for example, if the subject is a worker (a worker who performs installation / maintenance, etc.) at a customer's site rather than in-house, the first acquisition function 151 can also acquire, as behavioral data, the check operations performed by the subject. A worker at a customer's site may check a checklist (check items) for a task and check off the items that he or she has performed. Therefore, the first acquisition function 151 acquires, as behavioral data, information on the check items that the subject has checked off, in addition to behavioral data based on camera images.

[0098] Then, the determination function 153 acquires the check items for the work described above as the action plan of the subject, and compares the acquired check items with the check items checked by the subject and the action data based on the camera image to determine whether or not there is an abnormality in the action. For example, if a check item is checked even though the analysis of the camera image does not confirm the point that should be checked, the determination function 153 determines that there is an abnormality in the action.

[0099] Furthermore, for example, if the subject is a patient in a hospital, it is unlikely that the subject will wear a work camera or carry a personal PC. Therefore, behavioral data (location information and time information) may be acquired from surveillance cameras in the hospital or from the registration status on the hospital network. For example, the first acquisition function 151 can acquire the subject's location information and time information within the hospital from camera images captured by surveillance cameras in the hospital, or from the location on the network where the subject is registered. The first acquisition function 151 identifies the subject in the camera image using face recognition technology for identifying individuals.

[0100] The determination function 153 then acquires the subject's action plan (such as test items and test order) registered in the electronic medical record or order system, and compares the acquired action plan with the subject's location information and time information to determine whether there is anything abnormal in the subject's behavior. That is, the determination function 153 identifies the next test item to be performed from the action plan, and determines whether there is anything abnormal in the subject's behavior depending on whether the subject is at the location where the identified test item will be performed.

[0101] Furthermore, if the subject is a patient in a hospital, the second acquisition function 152 may acquire camera images taken by a surveillance camera in the hospital as information related to the psychological state. For example, the second acquisition function 152 can identify the subject in the camera image using face recognition technology and acquire the above-mentioned physical parameters by analyzing the subject's behavior (wandering around, being confused, etc.).

[0102] In addition, in a hospital, when a test such as blood sampling is performed, the heart rate may increase or the subject may sweat. Therefore, the determination function 153 can also be configured not to determine that a change in vital signs during medical treatment / testing is abnormal. In such a case, for example, when the subject moves to a position where the next test item is to be performed, the determination function 153 stops making a determination based on vital data until the subject starts moving from that position.

[0103] In the above-described embodiment, an example has been described in which the first acquisition unit, the second acquisition unit, the determination unit, the estimation unit, and the presentation unit in this specification are realized by the first acquisition function, the second acquisition function, the determination function, the estimation function, and the presentation function of a processing circuit, respectively, but the embodiment is not limited to this. For example, the first acquisition unit, the second acquisition unit, the determination unit, the estimation unit, and the presentation unit in this specification may be realized by only hardware, only software, or a combination of hardware and software, in addition to being realized by the first acquisition function, the second acquisition function, the determination function, the estimation function, and the presentation function described in the embodiment.

[0104] Furthermore, the term "processor" used in the description of the above-mentioned embodiments refers to circuits such as a central processing unit (CPU), a graphics processing unit (GPU), an application specific integrated circuit (ASIC), a programmable logic device (e.g., a simple programmable logic device (SPLD), a complex programmable logic device (CPLD), and a field programmable gate array (FPGA)). Here, instead of storing a program in a memory circuit, the processor may be configured so that the program is directly embedded in the circuit. In this case, the processor realizes its function by reading and executing the program embedded in the circuit. Furthermore, each processor in the present embodiment is not limited to being configured as a single circuit for each processor, but may also be configured as a single processor by combining multiple independent circuits to realize its function.

[0105] The assistance program executed by the processor is provided in advance in a read-only memory (ROM) or a storage circuit. The assistance program may be provided in a format installable or executable by these devices, recorded on a computer-readable, non-transitory storage medium such as a compact disk (CD)-ROM, a flexible disk (FD), a recordable CD-R, or a digital versatile disk (DVD). The assistance program may also be stored on a computer connected to a network such as the Internet and provided or distributed by downloading it via the network. For example, the assistance program may be composed of modules including the above-described processing functions. In actual hardware, a CPU reads and executes the medical image processing program from a storage medium such as a ROM, whereby each module is loaded into a main memory device and generated on the main memory device.

[0106] In addition, in the above-described embodiments and modifications, the components of each device shown in the drawings are functional concepts and do not necessarily have to be physically configured as shown. In other words, the specific form of distribution or integration of each device is not limited to that shown in the drawings, and all or part of the devices can be functionally or physically distributed or integrated in any unit depending on various loads, usage conditions, etc. Furthermore, all or any part of the processing functions performed by each device can be realized by a CPU and a program analyzed and executed by the CPU, or can be realized as hardware using wired logic.

[0107] Furthermore, among the processes described in the above-mentioned embodiments and modifications, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically using a known method.In addition, the information including the processing procedures, control procedures, specific names, various data and parameters shown in the above documents and drawings can be changed as desired unless otherwise specified.

[0108] According to at least one of the embodiments described above, it is possible to provide appropriate support to a subject.

[0109] Although several embodiments have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope and spirit of the invention, as well as within the scope of the invention and its equivalents as defined in the claims. [Explanation of symbols]

[0110] 100 Support equipment 151 First Acquisition Function 152 Second Acquisition Function 153 Judgment Function 154 Estimation Function 155 Presentation function

Claims

1. a first acquisition unit that acquires information regarding the behavior of a support target; a second acquisition unit that acquires information about the subject's psychological state; a determination unit that determines whether or not the information regarding the psychological state of the subject deviates from information regarding the psychological state of the subject in normal times; a presentation unit that presents a behavioral suggestion according to information about the behavior of the subject when information about the subject's psychological state deviates from information about the subject's psychological state in normal times; An assistance device comprising:

2. the second acquisition unit acquires vital data of the subject; The determination unit determines whether or not the vital data of the subject deviates from vital data under normal circumstances; The support device according to claim 1 , wherein the presenting unit presents an action suggestion according to information on the subject's behavior when the subject's vital data deviates from normal vital data.

3. The determination unit further determines whether the behavior performed by the subject is a predetermined behavior in the information regarding the behavior of the subject, 2. The support device according to claim 1, wherein the presentation unit presents different behavioral suggestions when the information regarding the psychological state of the subject deviates from information regarding the psychological state of the subject under normal circumstances, and when the behavior performed by the subject is different from a predetermined behavior and when the behavior performed by the subject is a predetermined behavior.

4. 4. The support device according to claim 3, wherein the presentation unit presents, when the behavior performed by the subject is different from a predetermined behavior, a behavioral suggestion for the subject to perform the predetermined behavior, and, when the behavior performed by the subject is the predetermined behavior, presents, when the behavior performed by the subject is the predetermined behavior, a behavioral suggestion for the subject to return to a normal psychological state.

5. 4. The support device according to claim 3, wherein the second acquisition unit increases the frequency of acquisition of information regarding the psychological state of the subject when information regarding the psychological state of the subject deviates from information regarding the psychological state in normal times and when behavior performed by the subject differs from predetermined behavior.

6. 2. The support device according to claim 1, wherein the determination unit determines whether the information regarding the subject's current psychological state deviates from the information regarding the subject's psychological state at normal times by comparing the information regarding the subject's psychological state with information regarding the subject's normal psychological state previously obtained from the subject.

7. 2. The support device according to claim 1, wherein the determination unit determines whether the information regarding the subject's current psychological state deviates from information regarding the subject's psychological state in normal times by comparing the information regarding the subject's psychological state with a predetermined threshold.

8. 4. The support device according to claim 3, further comprising an estimation unit that, when information regarding the psychological state of the subject deviates from information regarding the psychological state in normal times and when a behavior performed by the subject differs from a predetermined behavior, estimates whether the subject is suspected of having dementia based on behavioral and psychological symptoms of dementia (BPSD).

9. Obtain information about the behavior of the recipient of support, obtaining information regarding the subject's psychological state; determining whether the information regarding the subject's psychological state deviates from information regarding the subject's psychological state in normal times; When the information about the psychological state of the subject deviates from the information about the psychological state in normal times, a behavioral suggestion is presented according to the information about the behavior of the subject. Support methods, including:

10. Obtain information about the behavior of the recipient of support, obtaining information regarding the subject's psychological state; determining whether the information regarding the subject's psychological state deviates from information regarding the subject's psychological state in normal times; When the information about the psychological state of the subject deviates from the information about the psychological state in normal times, a behavioral suggestion is presented according to the information about the behavior of the subject. A support program that causes a computer to execute each process.

Images