On-call transmission system, on-call transmission method and program

Abstract

To increase the probability of survival of a supported object person in sudden change of symptoms and to lighten the mental and physical burdens on staffs who work for medical and welfare sites.SOLUTION: An on-call transmission system used in medical and welfare sites photographs an image of a supported object person (for example, an image of the body of the supported object person including the face) in an on-call state by a camera etc., of an on-call terminal 10 making an on-call request, and outputs, on one screen, property information (at least one of groups of, for example, age data, data related to a main disease, and data related to a medical history) and physical information in sudden change of symptoms of the supported object person together with the photographed image.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a technique that is effective for on-call care in medical and welfare settings. [Background technology]

[0002] Traditionally, in medical and welfare settings (nursing care, home medical care, etc.), when the condition of the person receiving support (patient, care recipient, etc.) suddenly changes, an on-call is sent to a medical institution, etc. This on-call involves staff at the medical and welfare settings making a voice call to a nurse or doctor on standby to inform them of the sudden change in the condition of the person receiving support. For example, Patent Document 1 proposes a system that allows a support recipient to have a voice call via videophone or telephone with the support recipient's doctor when the support recipient's condition suddenly changes. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2015-82147 Summary of the Invention [Problem to be solved by the invention]

[0004] However, if the staff who communicate the symptoms of the person being supported in the event of a sudden change in their condition do not have the experience or skills to do so, or conversely, if the nurses or doctors who listen to the symptoms do not have the experience or skills to do so, the symptoms of the person being supported may not be communicated accurately, which could ultimately put the person in a dangerous situation. Therefore, there is a need for technology that can accurately communicate the symptoms of those being supported while on call. However, in Patent Document 1, it was not possible to accurately convey the symptoms of the person being supported while on call. Therefore, the present inventors focused on a system for accurately communicating the symptoms of a person being supported when on call, together with at least image information.

[0005] The present invention aims to provide an on-call communication system, an on-call communication method, and a program that, when a support recipient's condition suddenly changes, can increase the chances of saving the support recipient's life by communicating more accurate symptoms of the support recipient, along with at least image information, to on-call responders, thereby reducing the mental and physical burden on staff working in medical and welfare facilities. [Means for solving the problem]

[0006] The present invention is an on-call communication system used in medical and welfare settings, a photographing unit that takes images of the person being supported while on call; an output unit that outputs, on a single screen, attribute information of the support recipient and physical information of the support recipient at the time of the sudden change in symptoms together with the captured image; An on-call transmission system is provided.

[0007] According to the present invention, the on-call communication system outputs, on a single screen, an image of the support recipient, attribute information and physical information of the support recipient. As a result, when on-call, it becomes easier to communicate the symptoms of the person being supported more accurately to the responder, reducing the mental and physical burden on staff working in the medical and welfare fields.

[0008] Although the present invention is categorized as a system, the same effects and advantages can be obtained even when it is a method or a program. [Effects of the Invention]

[0009] According to the present invention, it is possible to increase the probability of saving the life of the person being supported when their condition suddenly changes, and also to reduce the mental and physical burden on staff working in medical and welfare facilities. [Brief explanation of the drawings]

[0010] [Figure 1]FIG. 1 is a diagram illustrating an overview of an on-call transmission system 1. [Figure 2] FIG. 1 is a diagram illustrating a functional configuration of an on-call transmission system 1. [Figure 3] 1 is a diagram showing a schematic diagram of an installation state of an on-call terminal 10. FIG. [Figure 4] 2 is a diagram showing in detail the functional configuration of an on-call terminal 10 of the on-call transmission system 1. FIG. [Figure 5] 10 is a flowchart showing attribute information registration processing executed by the on-call terminal 10. FIG. [Figure 6] 10 is a flowchart showing a physical information registration process executed by the on-call terminal 10. FIG. [Figure 7] 10 is a flowchart showing a first output process executed by the on-call terminal 10. FIG. [Figure 8] 2 is a diagram schematically illustrating an example of an output screen output by the on-call terminal 10. FIG. [Figure 9] 2 is a diagram schematically illustrating an example of an output screen output by the on-call terminal 10. FIG. [Figure 10] 10 is a flowchart showing a second output process executed by the on-call terminal 10. FIG. [Figure 11] FIG. 2 is a flowchart showing a learning model creation process executed by the on-call terminal 10. [Figure 12] 10 is a flowchart showing a third output process executed by the on-call terminal 10. FIG. [Figure 13] 2 is a diagram schematically illustrating an example of an output screen output by the on-call terminal 10. FIG. [Figure 14] 2 is a diagram schematically illustrating an example of an output screen output by the on-call terminal 10. FIG. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, embodiments of the present invention (hereinafter referred to as "embodiments") will be described in detail with reference to the accompanying drawings. In the following drawings, the same elements are designated by the same numbers or symbols throughout the description of the embodiments.

[0012] [Overview of On-Call Communication System 1] FIG. 1 is a schematic diagram for explaining an overview of an on-call transmission system 1. As shown in FIG. The components of the on-call transmission system 1 will be described with reference to FIG. The on-call communication system 1 is a system that includes at least an on-call terminal 10 used in medical and welfare settings, and a responder terminal 20 carried by an on-call responder (nurse, doctor, etc.). The on-call terminal 10 is a terminal device such as a tablet terminal, and is provided above the bed used by the support recipient 4. This on-call terminal 10 is connected to a communication device such as an earphone and a microphone via wired or wireless communication so that data communication is possible. The staff member wears this communication device and can talk to the on-call responder. The communication method executed by the on-call terminal 10 can be designed as appropriate. The responder terminal 20 is a terminal device such as a smartphone, a tablet terminal, etc. The responder can use the responder terminal 20 to talk to the staff member when on call. The on-call transmission system 1 may be a system in which the on-call terminal 10 and the responder terminal 20 are connected to each other so that they can communicate with each other via a computer having a server function, rather than directly communicating data between them. The computer may be implemented as a single computer, or may be implemented as a cloud computer or as multiple computers. In this specification, a cloud computer may refer to either a computer that uses any computer in a scalable manner to perform a specific function, or a computer that includes multiple functional modules to realize a system and uses the functions in any combination. The terminal devices that make up the on-call transmission system 1 are merely examples, and other terminals may be added in addition to the on-call terminal 10 and the responder terminal 20, or there may be multiple on-call terminals 10 and multiple responder terminals 20. The number, type, and functions of terminals other than the on-call terminal 10 and the responder terminal 20 can be designed as appropriate.

[0013] An outline of the processing steps when the on-call communication system 1 is used in medical and welfare settings will be described.

[0014] The on-call terminal 10 takes an image of the support recipient 4 when on-call (step S1). The on-call terminal 10 is provided above the bed of the support recipient 4, and takes an image of the face or body including the face of the support recipient 4 using its own camera.

[0015] The on-call terminal 10 outputs the captured image, as well as the attribute information of the support recipient 4 and the physical information of the support recipient 4 at the time of the sudden change, on one screen (step S2). The attribute information is, for example, data related to name, age (date of birth), main disease, medical history, etc. The attribute information includes at least one of a group consisting of age data, data related to main disease, and data related to medical history. The physical information is data relating to the body of the support recipient 4, such as oxygen saturation, pulse, blood pressure, and electrocardiogram. The on-call terminal 10 outputs on a single screen the attribute information of the support recipient 4 that was acquired in advance and the physical information of the support recipient 4 at the time of the sudden change that was acquired from a physical information measuring device attached to the support recipient 4, along with the captured image. The on-call terminal 10 transmits these to the responder terminal 20. The responder terminal 20 receives these and displays them on a single screen on its own display unit.

[0016] The above is an overview of the on-call communication system 1. This on-call communication system 1 makes it possible to reduce the mental and physical burden on staff working in medical and welfare facilities.

[0017] [Device configuration] 2 is a block diagram showing the configuration of the on-call transmission system 1. The device configuration of the on-call transmission system 1 will be described with reference to FIG. The on-call communication system 1 is a system used in medical and welfare settings, and is composed of at least an on-call terminal 10 installed above the bed used by the person being supported 4, and a responder terminal 20 carried by the person responding to the on-call. The on-call transmission system 1 is a system in which an on-call terminal 10 and a responder terminal 20 are connected to each other so that they can communicate data with each other via a network 7 such as a public line network. The on-call transmission system 1 is also a system in which the on-call terminal 10 and the responder terminal 20 are connected to each other so that they can communicate with each other. The number of on-call terminals 10 and responder terminals 20 is not particularly limited. Furthermore, the on-call transmission system 1 may be a system configured by adding terminals and devices other than the on-call terminals 10 and responder terminals 20. For example, the on-call transmission system 1 may be a system in which the on-call terminals 10 and responder terminals 20 not only perform direct data communication but are also connected to each other so as to be able to communicate via a computer having a server function. This computer may be realized, for example, by a single computer, or may be realized by multiple computers such as a cloud computer.

[0018] The on-call terminal 10 is provided above the bed used by the support recipient 4 and is a terminal device such as a tablet terminal (see FIG. 3). The on-call terminal 10 may also be installed in a movable location, such as an IV stand. The on-call terminal 10 is connected to a communication device via wired or wireless communication so as to enable data communication. The staff member wears this communication device and can communicate with the on-call responder. The communication device is not particularly limited, and the communication method used by the on-call terminal 10 is not particularly limited either.

[0019] The installation state of the on-call terminal 10 will be described with reference to Fig. 3. This figure is a diagram that schematically shows an example of the installation state when the on-call terminal 10 is used in a medical or welfare setting. In the figure, the support recipient 4 is shown lying on his back on a bed 31. A holder 32 for holding the on-call terminal 10 is installed near an end 310 of the bed 31 on the head side of the support recipient 4. This holder 32 may be, for example, an object of a predetermined shape (such as a rod) or a structure such as a wall or a pillar, and is not particularly limited as long as it is at least possible to attach the on-call terminal 10. A light 33 is attached to the holder 32 at a position above the head of the person being supported 4. This light 33 illuminates not only the head of the person being supported 4 but also the entire body. A first holder 34 is attached to the holder 32 above the light 33. The first holder 34 is provided with a predetermined mechanism (slide mechanism, locking mechanism, etc.) that allows the on-call terminal 10 to be detachably attached, and the on-call terminal 10 can be detachably attached. The first holder 34 is attached at a predetermined angle to the holder 32. This angle may be such that, when the on-call terminal 10 is attached to the first holder 34, the position of the camera of the on-call terminal 10 is at a position that allows the face of the support recipient 4 to be photographed. Furthermore, the first holder 34 may be fixed to the holder 32, or may have a movable mechanism that allows the angle relative to the holder 32 to be adjusted so that the position of the on-call terminal 10 can be adjusted. The holder 32 has a second holder 35 attached above the first holder 34. Like the first holder 34, the second holder 35 is provided with a predetermined mechanism (slide mechanism, locking mechanism, etc.) that allows the on-call terminal 10 to be detachably attached, and the on-call terminal 10 can be detachably attached. The second holder 35 is attached at a predetermined angle to the holder 32. This angle may be such that, when the on-call terminal 10 is attached to the second holder 35, the position of the camera of the on-call terminal 10 is at a position that allows the body, including the face, of the support recipient 4 to be photographed. The angle of the second holder 35 relative to the holder 32 is larger than the angle of the first holder 34 relative to the holder 32. The second holder 35 may be fixed to the holder 32, or may have a movable mechanism that allows the angle relative to the holder 32 to be adjusted so that the position of the on-call terminal 10 can be adjusted. The above is the installation status of the on-call terminal 10.

[0020] The on-call terminal 10 has a control unit such as a CPU (Central Processing Unit), GPU (Graphics Processing Unit), RAM (Random Access Memory), ROM (Read Only Memory), etc., and a communication unit such as a device that enables communication with other terminals and devices, and an output unit 11 that outputs on a single screen, along with captured images, attribute information of the support recipient 4 and physical information of the support recipient 4 in the event of a sudden change in their symptoms. The on-call terminal 10 includes a data storage unit such as a hard disk, semiconductor memory, recording medium, or memory card as a recording unit. The on-call terminal 10 includes, as a processing unit, various devices that execute various processes, an image capturing unit 12 that captures an image of the support recipient 4 when on-call, and the like.

[0021] Fig. 4 is a block diagram showing in more detail the configuration of the on-call terminal 10 of the on-call transmission system 1. The device configuration of the on-call terminal 10 of the on-call transmission system 1 will be further described based on Fig. 4. In the on-call terminal 10, a control unit (not shown) reads a predetermined program, thereby realizing an attribute information acquisition module 101, a physical information acquisition module 102, an emergency response module 103, and an output module 104 in cooperation with a communication unit (not shown). In addition, in the on-call terminal 10, the control unit reads a specified program and, in cooperation with the recording unit (not shown), realizes an attribute information registration module 105, a physical information registration module 106, an output result recording module 107, and a learning model creation module 108. In addition, in the on-call terminal 10, the control unit reads a predetermined program, thereby realizing an imaging module 109, an analysis module 110, a sudden change determination module 111, and an end determination module 112 in cooperation with a processing unit (not shown).

[0022] The responder terminal 20 is a terminal device such as a smartphone or tablet terminal carried by the responder on the on-call side. The responder can use the responder terminal 20 to communicate with the staff in response to an on-call from the on-call terminal 10. Note that the method of communication performed by the responder terminal 20 is not particularly limited. The responder terminal 20 is equipped with a CPU, GPU, RAM, ROM, etc. as a terminal control unit, a device for enabling communication with other terminals and devices, etc. as a communication unit, and a device for executing input and output of various information, etc. as an input / output unit.

[0023] Hereinafter, each process executed by the on-call transmission system 1 will be described together with the process executed by each of the modules described above. In this specification, each module may execute its processing content as its own function, or may execute its processing content via a predetermined application.

[0024] [Attribute information registration process executed by on-call terminal 10] The attribute information registration process executed by the on-call terminal 10 will be described with reference to Fig. 5. This figure is a flowchart showing the attribute information registration process executed by the on-call terminal 10.

[0025] The attribute information acquisition module 101 acquires attribute information of the support recipient 4 (step S10). The attribute information is, for example, data related to name, age (date of birth), main illness, medical history, etc. The attribute information includes at least one of a group consisting of age data, data related to the main illness, and data related to medical history. In addition to these, the attribute information may also include address, residence, recent symptoms, handover matters, common instructions for when fever occurs (medicine to be taken, etc.), preference information of the family of the support recipient 4 (hereinafter simply referred to as family) in the event of a sudden change (end-of-life care, transport to hospital, whether or not an AED (Automated External Defibrillator) is used, etc.), data related to the family (position of key people, contact information, personality, whether or not there are other problems, various insurance data), etc. The attribute information acquisition module 101 may acquire this attribute information from a predetermined external database in which the attribute information of the support recipient 4 is registered, or may acquire this attribute information by accepting direct input of this attribute information from a staff member or the like via a predetermined UI (User Interface), or may acquire this attribute information by some other method.

[0026] The attribute information registration module 105 registers the acquired attribute information (step S11). The attribute information registration module 105 registers the acquired attribute information by linking it to a predetermined identifier (management number, ID, name, etc.).

[0027] This completes the attribute information registration process. In the above-mentioned attribute information registration process, if it becomes necessary to update the attribute information (when a change is made to the matters to be handed over, when a change is made to the family member's desired information, etc.), the on-call terminal 10 acquires the changes to the attribute information that needs to be changed, and updates the registered attribute information based on the acquired changed attribute information. The on-call transmission system 1 executes the processing described below using the attribute information registered by the attribute information registration processing described above.

[0028] [Physical Information Registration Process Executed by the On-Call Terminal 10] The physical information registration process executed by the on-call terminal 10 will be described with reference to Fig. 6. The figure is a flowchart showing the physical information registration process executed by the on-call terminal 10. This physical information registration process is performed simultaneously with the first output process and the second output process, which will be described later.

[0029] The physical information acquisition module 102 acquires physical information of the support recipient 4 (step S20). The physical information is data related to the body of the support recipient 4, such as oxygen saturation, pulse, blood pressure, and electrocardiogram. Furthermore, the physical information may also include past data related to the body of the support recipient 4, such as past test results (blood tests, etc.). The physical information acquisition module 102 acquires physical information of the support recipient 4 from measuring devices (pulse oximeter, blood pressure monitor, electrocardiograph, etc.) attached to the support recipient 4. The measuring devices are connected to the on-call terminal 10 via wired or wireless communication or the like to enable data communication, and transmit the measurement results to the on-call terminal 10. The physical information acquisition module 102 receives the measurement results and acquires the physical information of the support recipient 4. The physical information acquisition module 102 may acquire the physical information of the support recipient 4 at all times, or may acquire the physical information of the support recipient 4 when the support recipient 4 is lying in bed. In this embodiment, the physical information acquisition module 102 will be described as acquiring the physical information of the support recipient 4 when the support recipient 4 is lying in bed. The physical information acquisition module 102 may acquire the physical information of the support recipient 4 from a predetermined external database, etc., or may acquire the physical information by accepting direct input of the physical information via a predetermined UI, etc., or may acquire the physical information by some other method.

[0030] The physical information registration module 106 registers the acquired physical information (step S21). The physical information registration module 106 registers the acquired physical information in association with the registered attribute information of the support recipient 4.

[0031] This completes the physical information registration process. The on-call communication system 1 executes the processes described below using the physical information acquired through the physical information registration process described above.

[0032] [First output process executed by on-call terminal 10] The first output process executed by the on-call terminal 10 will be described with reference to Fig. 7. This figure is a diagram showing a flowchart of the first output process executed by the on-call terminal 10. This first output process is a detailed description of the photographing process (step S1) for photographing an image of the support recipient 4 while on-call as described above, and the output process (step S2) for outputting, on a single screen, the attribute information of the support recipient 4 and physical information at the time of a sudden change in the symptoms of the support recipient 4, along with the photographed image. This first output process is a process that uses the attribute information registered by the attribute information registration process described above and the physical information acquired by the physical information registration process described above.

[0033] The photographing module 109 photographs an image of the support recipient 4 (step S30). The photographing module 109 photographs images such as moving images and still images of the support recipient 4 using a camera provided in the on-call terminal 10. When the on-call terminal 10 is attached to the first holder 34, the photographing module 109 photographs an image of the face of the support recipient 4, and when the on-call terminal 10 is attached to the second holder 35, the photographing module 109 photographs an image of the body of the support recipient 4, including the face. The on-call terminal 10 may be attached to the first holder 34 or the second holder 35 as an initial state. The on-call terminal 10 can be attached to either the first holder 34 or the second holder 35 by a staff member in response to an instruction from the on-call responder.

[0034] The analysis module 110 analyzes the image and the physical information (step S31). The analysis module 110 analyzes the captured image of the support recipient 4. The analysis module 110 extracts feature points, feature amounts, etc. from the image, and based on the extraction results, analyzes the current facial expression of the support recipient 4, whether there is a sudden change in symptoms, such as whether there is cyanosis. For example, the analysis module 110 compares the image with the facial expression, etc. when normal, and analyzes whether there is a sudden change in symptoms. Furthermore, based on the acquired physical information, the analysis module 110 analyzes whether there is a sudden change in the symptoms of the current support recipient 4, such as whether there is an abnormal oxygen saturation level, an abnormal pulse level, an abnormal blood pressure level, or an abnormal electrocardiogram level. For example, the analysis module 110 compares the oxygen saturation level, pulse level, blood pressure, electrocardiogram, etc., when normal with the physical information, and analyzes whether there is a sudden change in the symptoms. The analysis module 110 may analyze the acquired image of the support recipient 4 based on a learning model that is generated in advance by learning images of the face and body including the face at the time of a sudden change in symptoms, and the details thereof, as will be described later. The analysis module 110 may also analyze the acquired physical information of the support recipient 4 based on a learning model that is generated in advance by learning physical information at the time of a sudden change in symptoms, and the details thereof, as will be described later.

[0035] The sudden change determination module 111 determines whether or not the symptoms of the support recipient 4 have suddenly changed based on the analysis result (step S32). The sudden change determination module 111 determines whether or not the symptoms of the support recipient 4 have suddenly changed based on the analysis results of the acquired images or physical information. If the sudden change determination module 111 determines that the symptoms of the support recipient 4 have not suddenly changed (step S32 NO), that is, if the analysis results by the analysis module 110 do not indicate a sudden change in symptoms, the on-call terminal 10 again executes the processing of step S30 described above.

[0036] On the other hand, if the sudden change determination module 111 determines that the symptoms of the support recipient 4 have suddenly changed (step S32 YES), that is, if the analysis results by the analysis module 110 indicate a sudden change in symptoms, the sudden change response module 103 executes sudden change response processing (step S33). The response process in the event of an emergency includes, for example, notifying staff that the symptoms of the person being supported 4 have suddenly changed, making an on-call call to the person on call, notifying family members etc. that the symptoms of the person being supported 4 have suddenly changed, notifying emergency services that the symptoms of the person being supported 4 have suddenly changed, and continuing to take images. The emergency response module 103 receives a predetermined input from the staff (for example, tapping a predetermined button, etc.) and executes emergency response processing. After notifying the staff that the condition of the support recipient 4 has suddenly changed, the emergency response module 103 receives a predetermined input from the staff and executes an on-call call, etc. Furthermore, after an on-call is made, when a call is established between the staff member and the responder, the emergency response module 103 displays a predetermined icon or button on the display unit of the on-call terminal 10 itself. When the emergency response module 103 receives input of this icon or button from the staff member, it notifies the responder of the current address, whereabouts, etc. of the support recipient 4 by automated voice. The emergency response module 103 transmits the address or whereabouts included in the registered attribute information or set in advance to the responder terminal 20 as voice data. The responder terminal 20 receives this voice data and outputs voice based on this voice data. As a result, the emergency response module 103 notifies the responder of the current address, whereabouts, etc. of the support recipient 4 by automated voice.

[0037] The output module 104 outputs the captured image, as well as the attribute information of the support recipient 4 and the physical information of the support recipient 4 at the time of the sudden change, on one screen (step S34). The output module 104 transmits the captured image, as well as the attribute information of the support recipient 4 and the physical information of the support recipient 4 at the time of the sudden change, to the responder terminal 20. The output module 104 transmits to the responder terminal 20 a screen on which the image, attribute information, and physical information are arranged at a preset position within the screen. The responder terminal 20 receives these and displays them on its own display unit (see FIGS. 8 and 9). The output module 104 may display the image, attribute information, and physical information on one screen on the display unit of the on-call terminal 10. In this case, the output module 104 may also display the screen shown in Fig. 8 or 9, which will be described later, on the display unit of the on-call terminal 10 itself. Furthermore, the output module 104 may simply transmit the image, attribute information, and physical information, rather than transmitting a screen on which the image, attribute information, and physical information are arranged. In this case, the responder terminal 20 receives these and displays a screen on its own display unit according to the preset arrangement of the image, attribute information, and physical information.

[0038] An output screen output by the output module 104 will be described with reference to Fig. 8. This figure is a diagram that schematically shows an example of an output screen output by the output module 104. In this figure, an output screen 40 is shown when an image of the face of the support recipient 4 is captured. The output screen 40 has a first display field 41, a second display field 42, and a third display field 43. The first display field 41 and the third display field 43 are fields in which attribute information and physical information of the support recipient 4 are displayed. The second display field 42 is a field in which a captured image is displayed. The registered attribute information and acquired physical information are displayed in the first display field 41 and the third display field 43. For the physical information, the deviation between the current measurement result and the normal state may be displayed as numerical values ​​or characters, or if the deviation is large, the contents of the measurement result or physical information may be highlighted or an icon indicating this may be displayed to indicate that the situation is highly urgent. The second display field 42 displays the currently captured image 421 of the face of the support recipient 4. Note that, for the image 421, the analysis may highlight the areas where the symptoms have been determined to have suddenly changed and their details, or may display an icon indicating this, and output that the situation is highly urgent. The layout of the first display column 41, the second display column 42, and the third display column 43 is not limited to that shown in the figure, but can be designed as appropriate. Furthermore, the attribute information and physical information displayed in the first display column 41 and the third display column 43 are not limited to that shown in the figure, but can be designed as appropriate.

[0039] An output screen output by the output module 104 will be described with reference to Fig. 9. This figure is a diagram that schematically shows an example of an output screen output by the output module 104. In this figure, an output screen 50 is shown when an image of the body, including the face, of the support recipient 4 is captured. The output screen 50 has a first display field 51, a second display field 52, and a third display field 53. The first display field 51 and the third display field 53 are similar to the first display field 41 and the third display field 43 described above. In the second display field 52, an image 521 of the body including the face of the support recipient 4 taken this time is displayed. As with the image 421 described above, the image 521 may be displayed with highlighting of the areas where the analysis has determined that the symptoms have suddenly changed and the details thereof, or an icon indicating this, to output that the situation is highly urgent. The layout of the first display column 51, the second display column 52, and the third display column 53 is not limited to that shown in the figure and can be designed as appropriate. Furthermore, the attribute information and physical information displayed in the first display column 51 and the third display column 53 are not limited to that shown in the figure and can be designed as appropriate.

[0040] The on-call responder can view the output screen 40 or the output screen 50 displayed on the responder terminal 20 and observe the symptoms of the support recipient 4.

[0041] Returning to FIG. 7, the continuation of the first output process will be described. The end determination module 112 determines whether the on-call has ended (step S35). The end determination module 112 determines whether the on-call has ended based on whether or not an input indicating the end of the call has been made by the on-call terminal 10 or the responder terminal 20. If the end determination module 112 determines that the on-call has not ended (step S35 NO), the on-call terminal 10 continues to execute the process of step S34 described above.

[0042] On the other hand, if the end determination module 112 determines that the on-call has ended (YES in step S35), the output result recording module 107 records the image and physical information (step S36). The output result recording module 107 records the image and physical information output on one screen, linking them to the registered attribute information of the support recipient 4. The output result recording module 107 may record not only the images and physical information but also other information during on-call such as the contents of a call.

[0043] This completes the first output process.

[0044] [Second output process executed by on-call terminal 10] The second output process executed by the on-call terminal 10 will be described with reference to Fig. 10. This figure is a diagram showing a flowchart of the second output process executed by the on-call terminal 10. This second output process is a different detail from the first output process, which is a photographing process (step S1) for photographing an image of the support recipient 4 while on-call as described above, and an output process (step S2) for outputting, on a single screen, the attribute information of the support recipient 4 and physical information of the support recipient 4 at the time of a sudden change in the symptoms of the support recipient 4, along with the photographed image. This second output process is a process that uses the attribute information registered by the attribute information registration process described above and the physical information acquired by the physical information registration process described above. Note that detailed description of the same processes as the first output process described above will be omitted.

[0045] The sudden change response module 103 executes the sudden change response process (step S40). The on-call terminal 10 receives predetermined input from the staff member when there is a sudden change in the symptoms of the support recipient 4 (input to launch a predetermined application, input that the support recipient 4 has had a sudden change in their symptoms, etc.). In addition, when there is a sudden change in the symptoms of the support recipient 4, the staff member attaches the on-call terminal 10 to the first holder 34 or the second holder 35. The emergency response process includes, for example, making an on-call call to the on-call responder, notifying family members and others that the support recipient 4's symptoms have suddenly changed, and notifying emergency services that the support recipient 4's symptoms have suddenly changed. The emergency response module 103 receives a predetermined input from the staff (for example, tapping a predetermined button) and executes an emergency response process. Furthermore, after an on-call is made, when a call is established between the staff member and the responder, the emergency response module 103 displays a predetermined icon or button on the display unit of the on-call terminal 10 itself. When the emergency response module 103 receives input of this icon or button from the staff member, it notifies the responder of the current address, whereabouts, etc. of the support recipient 4 by automated voice. The emergency response module 103 transmits the address or whereabouts included in the registered attribute information or set in advance to the responder terminal 20 as voice data. The responder terminal 20 receives this voice data and outputs voice based on this voice data. As a result, the emergency response module 103 notifies the responder of the current address, whereabouts, etc. of the support recipient 4 by automated voice.

[0046] The photographing module 109 photographs an image of the support recipient 4 (step S41). The process of step S41 is similar to the process of step S30 described above.

[0047] The analysis module 110 analyzes the images and the physical information (step S42). The analysis module 110 analyzes the captured image of the support recipient 4. The analysis module 110 extracts feature points, feature amounts, etc. from this image, and based on the extraction results, analyzes the symptoms of the support recipient 4 at the time of a sudden change in their condition, such as their current facial expression and the presence or absence of cyanosis. Furthermore, based on the acquired physical information, the analysis module 110 analyzes the symptoms of the person being supported 4 at the time of a sudden change in their condition, such as whether or not there are abnormal oxygen saturation levels, abnormal pulse levels, abnormal blood pressure levels, or abnormal electrocardiogram levels. The analysis module 110 may analyze the acquired image of the support recipient 4 based on the learning results obtained in advance of images of the face and images of the body including the face at the time of a sudden change in symptoms, and the details thereof. The analysis module 110 may also analyze the acquired physical information of the support recipient 4 based on the learning results obtained in advance of physical information at the time of a sudden change in symptoms, and the details thereof.

[0048] The output module 104 outputs the captured image, as well as the attribute information of the support recipient 4 and the physical information of the support recipient 4 at the time of the sudden change, on one screen (step S43). The process of step S43 is similar to the process of step S34 described above.

[0049] The on-call responder can view the output screen 40 or the output screen 50 displayed on the responder terminal 20 and observe the symptoms of the support recipient 4.

[0050] The end determination module 112 determines whether the on-call has ended (step S44). The process of step S44 is similar to the process of step S35 described above. If the end determination module 112 determines that the on-call has not ended (NO in step S44), the on-call terminal 10 continues to execute the process of step S43 described above.

[0051] On the other hand, if the end determination module 112 determines that the on-call has ended (YES in step S44), the output result recording module 107 records the image and physical information (step S45). The process of step S45 is similar to the process of step S36 described above.

[0052] This completes the second output process.

[0053] [Learning model creation process executed by on-call terminal 10] The learning model creation process executed by the on-call terminal 10 will be described with reference to Fig. 11. The figure is a diagram showing a flowchart of the learning model creation process executed by the on-call terminal 10.

[0054] The learning model creation module 108 creates a learning model by adding, as annotation data, physical information and / or attribute information of the support recipient 4 at the time of the sudden change in symptoms to an image of the face and / or body including the face of the support recipient 4 at the time of the sudden change in symptoms (step S50). Here, the annotation data is training data for learning by a machine learning model, and is added as information related to at least the image of the support recipient 4 at the time of the sudden change in symptoms in order to give meaning to the data, link them, and combine them with each other.

[0055] The method of adding the annotation data is not particularly limited, and the data may be added manually, by using an automated tagging tool such as an annotation tool, etc. Furthermore, the method of acquiring the annotation data and the image of the face and / or body including the face of the support recipient 4 when the symptoms suddenly worsen is not limited, and is not limited to those created by the on-call terminal 10.

[0056] The learning model creation module 108 may assign, as the annotation data, diagnostic information of the support recipient 4 after a sudden change in symptoms diagnosed by a doctor. Here, the diagnostic information includes at least the name of the symptoms and / or the name of the disease diagnosed by the doctor, and may further include reference information for diagnosing the symptoms and the name of the disease.

[0057] This completes the learning model creation process.

[0058] [Third output process executed by on-call terminal 10] Fig. 12 is a diagram showing a flowchart of the third output processing executed by the on-call terminal 10. Fig. 13 and Fig. 14 are diagrams showing examples of output screens output by the on-call terminal 10. The third output processing executed by the on-call terminal 10 will be described with reference to Figs. 12 to 14.

[0059] In addition to the second output process described above, this third output process is a process that uses the learning model created by the learning model creation module 108 to analyze the sudden change in symptoms of the support recipient 4 and output candidate symptoms and / or candidate disease names. Note that detailed explanations of processes similar to the first and second output processes described above will be omitted.

[0060] As in the first output process described above, the photographing module 109 photographs an image of the support recipient 4 (step S60). At this time, the attachment position of the on-call terminal 10 may be either the first holder 34 or the second holder 35. Note that the attachment position and attachment method of the on-call terminal 10 are not limited as long as it is possible to photograph the face of the support recipient 4 or the entire body including the face, and for example, it may be a flexible arm equipped with a face recognition camera that recognizes the face of the support recipient 4 and automatically tracks it.

[0061] The analysis module 110 analyzes at least the image including the face image and the physical information of the support recipient 4 based on the learning model created by the learning model creation module 108 (step S61). The analysis module 110 analyzes the captured image of the support recipient 4 based on the learning model. For example, the analysis module 110 extracts feature points, feature quantities, etc. from the image, and analyzes the current facial expression of the support recipient 4 and the presence or absence of a sudden change in symptoms, such as cyanosis, based on the extraction results and the learning model, using the learning model that has learned physical information, attribute information, and facial expression changes during sudden changes that are similar to the support recipient 4. For example, the analysis module 110 compares the image with the normal facial expression, etc., and analyzes the presence or absence of a sudden change in symptoms, such as the presence or absence of abnormal oxygen saturation, abnormal pulse, abnormal blood pressure, and abnormal electrocardiogram. Furthermore, the analysis module 110 analyzes attribute information including at least information such as the medical history of the support recipient 4, and candidate symptoms and candidate disease names based on the physical information, based on the learning model.

[0062] When the analysis module 110 performs an analysis based on the learning model, if multiple similar analysis results are obtained (YES in step S62), the output module 104 outputs the auxiliary item 61 based on the analysis results (step S63). Here, the auxiliary item 61 is an auxiliary item 61 for further narrowing down the analysis results from the multiple similar analysis results that have been analyzed, and may be, for example, a selective instruction display for a responder such as a staff member to further confirm the condition of the support recipient 4, as shown in the example output screen 60 of Figure 13. When the staff member or the like makes a selection or input according to the auxiliary items 61 via the responder terminal 20, the analysis module 110 reanalyzes at least whether there is a sudden change in symptoms (step S64). Here, the analysis module 110 may also reanalyze candidate symptoms and / or candidate disease names related to the sudden change in the symptoms of the support recipient 4.

[0063] The sudden change determination module 111 determines whether or not the symptoms of the support recipient 4 have suddenly changed based on the analysis result of the analysis module 110 (step S65). If the sudden change determination module 111 determines that there has been no sudden change in the symptoms of the support recipient 4 (step S65 NO), that is, if the analysis results by the analysis module 110 do not indicate a sudden change in the symptoms, the on-call terminal 10 again executes the processing of step S60 described above.

[0064] On the other hand, if the sudden change determination module 111 determines that the symptoms of the support recipient 4 have suddenly changed (step S65 YES), that is, if the analysis results by the analysis module 110 indicate a sudden change in symptoms, the sudden change response module 103 executes sudden change response processing similar to the first and second output processing (step S66).

[0065] The output module 104 outputs on one screen the captured image, the attribute information of the support recipient 4, the physical information of the support recipient 4 at the time of the sudden change, and one or more candidate symptoms analyzed based on the learning model (step S67). The output module 104 transmits the captured image, the attribute information of the support recipient 4, the physical information of the support recipient 4 at the time of the sudden change, and the symptom candidates analyzed based on the learning model, to the responder terminal 20. The output module 104 transmits to the responder terminal 20 a screen on which at least the image, attribute information, physical information, and symptom candidates 71 are arranged at a predetermined position within the screen. The responder terminal 20 receives these and displays them on its own display unit (see FIG. 14). The output module 104 may display the image, attribute information, physical information, and symptom candidates 71 on a single screen, as in the output screen 70, on the display unit of the on-call terminal 10 itself. Furthermore, the output module 104 may simply transmit the image, attribute information, physical information, and symptom candidate 71, rather than transmitting a screen on which the image, attribute information, physical information, and symptom candidate 71 are arranged. In this case, the responder terminal 20 receives these and displays a screen on its own display unit according to the preset arrangement of the image, attribute information, and physical information.

[0066] The end determination module 112 determines whether the on-call has ended (step S68). The process of step S68 is similar to the processes of steps S35 and S44 described above. If the end determination module 112 determines that the on-call has not ended (step S68 NO), the on-call terminal 10 continues to execute the process of step S67 described above.

[0067] On the other hand, if the end determination module 112 determines that the on-call has ended (YES in step S68), the output result recording module 107 records the image and physical information (step S69). The process of step S69 is similar to the processes of steps S36 and S45 described above.

[0068] This completes the third output process.

[0069] Although the above-described processes are described as separate processes, the on-call terminal 10 can be configured to execute a combination of some or all of the above-described processes. Also, the on-call terminal 10 can be configured to execute each process at a timing other than the timing described above.

[0070] As mentioned above, the on-call communication system 1 is a system that is effective when on-call, but can also be used in other cases. For example, the on-call terminal 10 may accept predetermined input from the staff (launching an application, inputting a predetermined icon or button, etc.) and enable communication with the contracted doctor and family. This makes it possible to reduce the effort involved in "end-of-life care" by enabling communication between the staff, contracted doctor, and family. This case will be explained. When the on-call terminal 10 receives a predetermined input from the staff member, it calls the doctor terminal (mobile phone, smartphone, tablet terminal, etc.) carried by the contract doctor and the family terminal (mobile phone, smartphone, tablet terminal, etc.) carried by the family member. In response to this call, the doctor terminal and the family terminal start a call with the on-call terminal 10. As a result, a three-way call becomes possible between the staff member, the contract doctor, and the family member. During this call, the contracted doctor will explain to the family the condition of the person being supported 4 and confirm their wishes regarding end-of-life care. The on-call terminal 10 receives predetermined input from the staff (such as input of predetermined icons or buttons) and creates a consent form for end-of-life care. The on-call terminal 10 inputs necessary information (date, name of the person being supported 4, names, relationships, and addresses of family members, name and place of employment of the contracted doctor, name and occupation of the staff member, etc.) into a document in a predetermined format, and creates the consent form for end-of-life care. The consent form for end-of-life care may be prepared in advance. The on-call terminal 10 transmits the created end-of-life consent form to the family terminal. The family terminal receives this end-of-life consent form and displays it on its own display. The family terminal accepts input of a signature on this end-of-life consent form from the family. The family terminal transmits the end-of-life consent form after the signature has been input to the on-call terminal 10. The on-call terminal 10 receives this end-of-life consent form. The on-call terminal 10 links the received consent form for end-of-life care to the attribute information and registers it. The on-call terminal 10 may output the received consent form for end-of-life care to a printing device such as a printer and print it out. As a result of these processes, even if family members find it difficult to fulfill the requirements for end-of-life care due to work or other reasons, it becomes easier for them to fulfill the requirements for end-of-life care. As a result, it becomes possible to reduce the effort required for end-of-life care.

[0071] The above-described means and functions are realized by a computer (including a CPU, an information processing device, and various terminals) reading and executing a predetermined program. The program may be provided, for example, from a computer via a network (Software as a Service (SaaS)) or as a cloud service. The program may also be provided in a form recorded on a computer-readable recording medium. In this case, the computer reads the program from the recording medium, transfers it to an internal or external recording device, records it, and executes it. The program may also be pre-recorded on a recording device (recording medium) and provided to the computer from the recording device via a communication line.

[0072] Although the embodiments of the present invention have been described above, the present invention is not limited to these embodiments. Furthermore, the effects described in the embodiments of the present invention are merely a list of the most preferable effects resulting from the present invention, and the effects of the present invention are not limited to those described in the embodiments of the present invention.

[0073] A first aspect disclosed in this embodiment is an on-call communication system used in medical and welfare settings, an imaging unit 12 that captures an image of the support recipient when on call; an output unit 11 that outputs, on a single screen, the attribute information of the support recipient and the physical information of the support recipient at the time of the sudden change in the symptoms together with the captured image; An on-call transmission system comprising:

[0074] In a second aspect disclosed in this embodiment, the attribute information includes at least one of a group consisting of age data, data on a main disease, and data on a medical history, 10. An on-call delivery system according to the first aspect.

[0075] A third aspect disclosed in this embodiment is a camera of an on-call terminal that requests an on-call, The on-call terminal is provided above the bed of the person being supported and takes an image of the body including the face of the person being supported. 10. An on-call delivery system according to the first aspect.

[0076] A fourth aspect disclosed in this embodiment includes an analysis unit that analyzes the condition of the support recipient from at least the image captured by the imaging unit and the physical information; a sudden change determination unit that determines a sudden change in the symptoms of the support recipient based on the analysis result obtained by the analysis unit; a sudden change response unit that notifies at least a set target of the determination result made by the sudden change determination unit; 10. The on-call delivery system of claim 3, further comprising:

[0077] A fifth aspect disclosed in this embodiment further includes a learning model creation unit that associates and learns a facial image, physical information, and attribute information of the support recipient at the time of a sudden change in the support recipient's symptoms, and creates a learning model that analyzes the condition of the support recipient, The analysis unit analyzes a condition of the support recipient, including at least symptom candidates, from an image of the face of the support recipient based on the learning model. An on-call delivery system according to a fourth aspect.

[0078] A sixth aspect disclosed in this embodiment is such that the output unit outputs one or more of the symptom candidates and / or auxiliary items for narrowing down the symptom candidates based on the analysis result; The analysis unit re-analyzes the condition of the support recipient, including the symptom candidates, based on the input or selected auxiliary items. An on-call delivery system according to a fifth aspect. [Explanation of symbols]

[0079] 1 On-call communication system 4. Support recipients 7 Network 10 On-call terminals 11 Output section 12 Photography Department 20 Responder terminal 31 beds 310 End 32 Holder 33 Light 34 First Holder 35 Second holder 40,50,60,70 output screen 41,51 1st display column 42,52 2nd display column 421,521 images 43 3rd display column 61 Supplementary items 71 Symptom candidates

Claims

1. An on-call communication system used in medical and welfare settings, a photographing unit that takes images of the person being supported while on call; an output unit that outputs, on a single screen, attribute information of the support recipient and physical information of the support recipient at the time of the sudden change in symptoms together with the captured image; An on-call transmission system comprising:

2. The attribute information includes at least one of a group consisting of age data, data on a main disease, and data on a medical history. The on-call delivery system of claim 1 .

3. The photographing unit is a camera of an on-call terminal that requests an on-call, The on-call terminal is provided above the bed of the person being supported and takes an image of the body including the face of the person being supported. The on-call delivery system of claim 1 .

4. an analysis unit that analyzes the condition of the support recipient from at least the image taken by the imaging unit and the physical information; a sudden change determination unit that determines a sudden change in the symptoms of the support recipient based on the analysis result obtained by the analysis unit; The on-call communication system according to claim 3 , further comprising: an emergency change response unit that notifies at least a set target of the determination result made by the emergency change determination unit.

5. a learning model creation unit that associates and learns a facial image, physical information, and attribute information of the support recipient at the time of a sudden change in the support recipient's symptoms after the diagnosis of the symptoms, and creates a learning model that analyzes the condition of the support recipient; The on-call communication system according to claim 4 , wherein the analysis unit analyzes the condition of the support recipient, including at least possible symptoms, from an image of the face of the support recipient based on the learning model.

6. the output unit outputs one or more of the symptom candidates and / or auxiliary items for narrowing down the symptom candidates based on the analysis results; The on-call communication system according to claim 5 , wherein the analysis unit reanalyzes the condition of the support recipient, including possible symptoms, based on the input or selected auxiliary items.

7. An on-call communication method executed by a computer for use in a medical or welfare setting, comprising: taking an image of a support recipient while on call; outputting, on a single screen, the attribute information of the support recipient and the physical information of the support recipient at the time of the sudden change in the symptom together with the captured image; An on-call communication method comprising:

8. For computers used in medical and welfare settings, taking an image of the support recipient while on call; a step of outputting, on one screen, attribute information of the support recipient and physical information of the support recipient at the time of the sudden change in symptoms together with the captured image; A computer-readable program for executing the program.

Images