On-Call Transmission System, On-Call Transmission Method, and Program

Abstract

Increase the survival probability of the support target in case of sudden symptom changes and reduce the mental and physical burden on the staff working in the medical and welfare fields. 【Solution means】The on-call transmission system used in the medical and welfare fields captures an image of the support target during on-call (for example, an image of the body including the face of the support target) with a camera or the like of the on-call terminal 10 that requests on-call, and together with the captured image, the attribute information of the support target (for example, at least one of a group consisting of age data, data on the main disease, and data on the medical history) and the physical information at the time of sudden symptom changes of the support target are output on one screen.

Description

Technical Field

[0001] The present invention relates to a technology effective for on-call performed in the medical and welfare fields.

Background Art

[0002] Conventionally, in the medical and welfare (nursing care, home medical care, etc.) fields, when the symptoms of a support target person (patient, care recipient, etc.) suddenly change, an on-call to a medical institution or the like is made. This on-call is for the staff at the medical and welfare site to convey the symptoms at the time of the sudden change of the support target person to the waiting nurse or doctor by making a voice call. For example, in Patent Document 1, a system for making a voice call by video phone or phone between the attending physician of a support target person and the support target person when the condition of the support target person suddenly changes has been proposed.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, if the experience and skills of the staff who convey the symptoms at the time of the sudden change of the support target person are immature, or conversely, if the experience and skills of the nurse or doctor on the side listening to the symptoms are immature, the symptoms of the support target person may not be accurately transmitted, and as a result, there is a risk of putting the support target person in a dangerous state. Therefore, a technology for accurately transmitting the symptoms of a support target person during on-call is required. However, in Patent Document 1, the symptoms of a support target person during on-call could not be accurately transmitted. Therefore, the inventor of the present invention focused on a mechanism for accurately transmitting the symptoms of a support target person during on-call together with at least image information.

[0005] The present invention aims to provide an on-call transmission system, an on-call transmission method, and a program that can increase the survival probability of a support target person by transmitting more accurate symptoms of the support target person, together with at least image information, to on-call responders in the event of an emergency of the support target person, and can reduce the mental and physical burden on staff working in the medical and welfare fields.

Means for Solving the Problems

[0006] The present invention is an on-call transmission system used in the medical and welfare fields, a photographing unit that photographs an image of a support target person during on-call, an output unit that outputs, on a single screen, the photographed image, the attribute information of the support target person, and the physical information at the time of an emergency change in the symptoms of the support target person 、 An analysis unit that analyzes the state of the support target person from at least the image captured by the imaging unit and the physical information; A sudden change determination unit that determines a sudden change in the symptoms of the support target person from the analysis result analyzed by the analysis unit; A response unit during a sudden change that notifies at least a set target of the determination result determined by the sudden change determination unit; Comprising; The imaging unit is a camera of an on-call terminal that requests on-call, The on-call terminal is provided above the bed of the support target person and captures an image of the body including the face of the support target person. provides an on-call transmission system.

[0007] According to the present invention, the on-call transmission system outputs, on a single screen, an image of the support target person, the attribute information of the support target person, and the physical information. As a result, during on-call, it becomes easy to transmit the symptoms of the support target person to the responder side more accurately, and the mental and physical burden on staff working in the medical and welfare fields is reduced.

[0008] Although the present invention is in the category of a system, the same operations and effects are achieved by a method and a program.

Effects of the Invention

[0009] According to the present invention, it is possible to increase the survival probability of the person to be supported in case of sudden symptom change and also reduce the mental and physical burden on the staff working in the medical and welfare fields.

Brief Description of Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Best Mode for Carrying Out the Invention

[0011] Hereinafter, with reference to the accompanying drawings, embodiments for carrying out the present invention (hereinafter referred to as embodiments) will be described in detail. In the following drawings, the same elements are denoted by the same numbers or symbols throughout the description of the embodiments.

[0012] [Overview of the On-Call Transmission System 1] FIG. 1 is a schematic diagram for explaining the overview of the on-call transmission system 1. Based on FIG. 1, the components of the on-call transmission system 1 will be described. The on-call transmission system 1 is a system including at least an on-call terminal 10 used at medical and welfare sites and a responder terminal 20 held by the on-call responder (such as a nurse or a doctor). The on-call terminal 10 is provided above the bed used by the support target person 4 and is a terminal device such as a tablet terminal. This on-call terminal 10 is connected to a communication device such as a wired or wireless communication so that a communication device such as an earphone and a microphone can be data-communicated. The staff wears this communication device and can communicate with the on-call responder side. Note that the call method executed by the on-call terminal 10 can be designed as appropriate. In addition, the responder terminal 20 is a terminal device such as a smartphone or a tablet terminal. The responder can communicate with the staff during on-call using the responder terminal 20. Note that the on-call transmission system 1 may be a system in which the on-call terminal 10 and the responder terminal 20 are not only directly data-communicated but also connected so as to be able to communicate via a computer having a server function. The computer may be realized by, for example, one computer or may be realized by a plurality of computers such as a cloud computer. The cloud computer in this specification may be either one that uses an arbitrary computer in a scalable manner when performing a specific function or one that includes a plurality of functional modules to realize a certain system and freely combines and uses those functions. The terminal devices constituting the on-call transmission system 1 are merely examples. In addition to the on-call terminal 10 and the responder terminal 20, terminals or the like may be added, and there may be a plurality of on-call terminals 10 or a plurality of responder terminals 20. Regarding terminals other than the on-call terminal 10 and the responder terminal 20, their number, type, and functions can be designed as appropriate.

[0013] The outline of the processing steps when the on-call transmission system 1 is used in the medical and welfare fields will be described.

[0014] The on-call terminal 10 takes a picture of the image of the support target person 4 during on-call (step S1). The on-call terminal 10 is provided above the bed of the support target person 4 and takes a picture of the face of the support target person 4 or an image of the body including the face by the camera it has.

[0015] The on-call terminal 10 outputs, on one screen, the captured image together with the attribute information of the support target person 4 and the physical information of the support target person 4 in case of sudden change (step S2). The attribute information is, for example, data regarding name, age (date of birth), main disease, medical history, etc. The attribute information includes at least one of a group consisting of age data, data regarding the main disease, and data regarding the medical history. The physical information is data regarding the body of the support target person 4 and is, for example, oxygen saturation, pulse, blood pressure, electrocardiogram, etc. The on-call terminal 10 outputs, on one screen, the captured image together with the attribute information of the support target person 4 acquired in advance and the physical information of the support target person 4 in case of sudden change acquired from the measuring device for physical information attached to the support target person 4. The on-call terminal 10 transmits these to the responder terminal 20. The responder terminal 20 receives these and displays them on its display unit on one screen.

[0016] The above is the outline of the on-call transmission system 1. According to the on-call transmission system 1, it is possible to reduce the mental and physical burden on the staff working in the medical and welfare fields.

[0017] [Device Configuration] FIG. 2 is a block diagram showing the configuration of the on-call transmission system 1. Based on FIG. 2, the device configuration of the on-call transmission system 1 will be described. The on-call transmission system 1 is a system used in the medical and welfare fields, and is composed of at least an on-call terminal 10 provided above the bed used by the support target person 4 and a responder terminal 20 held by the on-call responder side. The on-call transmission system 1 is a system in which the on-call terminal 10 and the responder terminal 20 are connected so as to be capable of data communication via a network 7 such as a public switched telephone network. Also, the on-call transmission system 1 is a system in which the on-call terminal 10 and the responder terminal 20 are connected so as to be capable of making a call. Note that the number of the on-call terminal 10 and the responder terminal 20 is not particularly limited. Also, the on-call transmission system 1 may be a system configured by adding terminals and devices other than the on-call terminal 10 and the responder terminal 20. For example, the on-call transmission system 1 may be a system in which the on-call terminal 10 and the responder terminal 20 are not only directly data-communicated but also connected so as to be capable of making a call via a computer having a server function. This computer may be realized by, for example, a single computer or may be realized by a plurality of computers such as a cloud computer.

[0018] The on-call terminal 10 is provided above the bed used by the support target person 4 and is a terminal device such as a tablet terminal (see Fig. 3). Further, the on-call terminal 10 may be installed in a movable location such as a drip stand. The on-call terminal 10 is connected to the communication device for data communication via wired or wireless communication or the like. The staff wears this communication device and can communicate with the on-call responder side. Note that the communication device is not particularly limited, and the communication method performed by the on-call terminal 10 is also not particularly limited.

[0019] Based on Fig. 3, the installation status of the on-call terminal 10 will be described. This figure is a diagram schematically showing an example of the installation status when the on-call terminal 10 is used in a medical and welfare site. In this figure, the support target person 4 is shown lying on the back on the bed 31. A holder 32 for holding the on-call terminal 10 is installed near the end 310 on the head side of the support target person 4 of the bed 31. This holder 32 may be, for example, an object having a predetermined shape (such as a rod shape) or a structure such as a wall or a pillar, and is not particularly limited as long as it can at least attach the on-call terminal 10. A light 33 is attached to the holder 32 at a position above the head of the support target person 4. This light 33 illuminates not only the head of the support target person 4 but also the whole body. The holder 32 has a first holder 34 attached above this light 33. The first holder 34 is provided with a predetermined mechanism (such as a slide mechanism, a locking mechanism, etc.) for detaching and attaching the on-call terminal 10, and can detachably attach the on-call terminal 10. The first holder 34 is attached to the holder 32 at a predetermined angle. This angle may be such that when the on-call terminal 10 is attached to the first holder 34, the position of the camera of the on-call terminal 10 comes to a position where it can photograph the face of the support target person 4. Also, the first holder 34 may be fixed to the holder 32, or may have a movable mechanism capable of adjusting the angle with respect to the holder 32 so that the position of the on-call terminal 10 can be adjusted. Above this first holder 34, a second holder 35 is attached to the holder 32. Similar to the first holder 34, the second holder 35 is provided with a predetermined mechanism (such as a slide mechanism, a locking mechanism, etc.) for detaching and attaching the on-call terminal 10, and can detachably attach the on-call terminal 10. The second holder 35 is attached to the holder 32 at a predetermined angle. This angle may be such that when the on-call terminal 10 is attached to the second holder 35, the position of the camera of the on-call terminal 10 comes to a position where it can photograph the body including the face of the support target person 4. The angle of the second holder 35 with respect to the holder 32 is larger than the angle of the first holder 34 with respect to the holder 32. Also, the second holder 35 may be fixed to the holder 32, or may have a movable mechanism capable of adjusting the angle with respect to the holder 32 so that the position of the on-call terminal 10 can be adjusted. The above is the installation situation of the on-call terminal 10.

[0020] The on-call terminal 10 includes, as a control unit, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a RAM (Random Access Memory), a ROM (Read Only Memory), etc., and as a communication unit, a device for enabling communication with other terminals, devices, etc., and an output unit 11 that outputs, on a single screen, the attribute information of the support target person 4 and the physical information at the time of a sudden change in the symptoms of the support target person 4, together with the captured image. The on-call terminal 10 includes, as a recording unit, a data storage unit such as a hard disk, a semiconductor memory, a recording medium, a memory card, etc. The on-call terminal 10 includes, as a processing unit, various devices for executing various processes, a photographing unit 12 for photographing an image of the support target person 4 during on-call, etc.

[0021] FIG. 4 is a block diagram showing in more detail the configuration of the on-call terminal 10 of the on-call transmission system 1. Based on FIG. 4, the device configuration of the on-call terminal 10 of the on-call transmission system 1 will be further described. In the on-call terminal 10, when a control unit (not shown) reads a predetermined program, in cooperation with a communication unit (not shown), an attribute information acquisition module 101, a physical information acquisition module 102, a sudden change response module 103, and an output module 104 are realized. Also, in the on-call terminal 10, when the control unit reads a predetermined program, in cooperation with a recording unit (not shown), an attribute information registration module 105, a physical information registration module 106, an output result recording module 107, and a learning model creation module 108 are realized. Also, in the on-call terminal 10, when the control unit reads a predetermined program, in cooperation with a processing unit (not shown), a photographing module 109, an analysis module 110, a sudden change determination module 111, and an end determination module 112 are realized.

[0022] The responder terminal 20 is a terminal device such as a smartphone or a tablet terminal held by the responder side during on-call. The responder can communicate with the staff in response to an on-call from the on-call terminal 10 using the responder terminal 20. Note that the call method used by the responder terminal 20 is not particularly limited. The responder terminal 20 includes, as a terminal control unit, a CPU, a GPU, a RAM, a ROM, etc., and as a communication unit, a device or the like that enables communication with other terminals, devices, etc., and as an input / output unit, a device or the like that executes input / output of various information.

[0023] Hereinafter, each process executed by the on-call transmission system 1 will be described in conjunction with the processes executed by the above-described respective modules. In this specification, each module may execute its processing content as a function it has, or may execute it via a predetermined application.

[0024] [Attribute information registration process executed by the on-call terminal 10] Based on FIG. 5, the attribute information registration process executed by the on-call terminal 10 will be described. This figure is a diagram showing a flowchart of the attribute information registration process executed by the on-call terminal 10.

[0025] The attribute information acquisition module 101 acquires the attribute information of the support target person 4 (step S10). The attribute information is, for example, data regarding name, age (date of birth), main disease, past history, etc. The attribute information includes at least one of a group consisting of age data, data regarding the main disease, and data regarding the past history. In addition to these, the attribute information may include address, residence, recent symptoms, matters to be conveyed, common instructions (medications to be taken, etc.) when having a fever, hope information (watching, hospital transfer, presence or absence of using an AED (Automated External Defibrillator), etc.) of the family of the support target person 4 (hereinafter also simply referred to as family) in case of an emergency, data regarding the family (positioning of the key person, contact information, personality, presence or absence of other problems, various insurance data), etc. The attribute information acquisition module 101 may acquire the attribute information of the support target person 4 from a predetermined external database or the like in which the attribute information is registered, or may receive the direct input of the attribute information from a staff member or the like via a predetermined UI (User Interface) or the like, and may acquire the attribute information, or may acquire the attribute information by other methods.

[0026] The attribute information registration module 105 registers the acquired attribute information (step S11). The attribute information registration module 105 registers the acquired attribute information in association with a predetermined identifier (management number, ID, name, etc.).

[0027] The above is the attribute information registration process. In the above-described attribute information registration process, when the attribute information needs to be updated (when the items to be postponed are changed, when the desired information of the family members is changed, etc.), the on-call terminal 10 acquires the change content regarding the attribute information that needs to be changed, and may update the registered attribute information based on the acquired changed attribute information. The on-call transmission system 1 executes the following processes using the attribute information registered by the above-described attribute information registration process.

[0028] [Physical information registration process executed by the on-call terminal 10] Based on FIG. 6, the physical information registration process executed by the on-call terminal 10 will be described. This figure is a diagram showing a flowchart of the physical information registration process executed by the on-call terminal 10. This physical information registration process is a process that is performed simultaneously with the first output process and the second output process described later.

[0029] The physical information acquisition module 102 acquires the physical information of the support target person 4 (step S20). The physical information is data related to the body of the support target person 4, for example, oxygen saturation, pulse, blood pressure, electrocardiogram. Further, the physical information may include past data related to the body such as past examination results (blood test, etc.) of the support target person 4. The physical information acquisition module 102 acquires the physical information of the support target person 4 from the measuring device (pulse oximeter, sphygmomanometer, electrocardiograph, etc.) attached to the support target person 4. The measuring device is connected to the on-call terminal 10 via wired or wireless communication or the like so as to enable data communication, and transmits the measurement result to the on-call terminal 10. The physical information acquisition module 102 receives this measurement result and acquires the physical information of the support target person 4. The physical information acquisition module 102 may always acquire the physical information of the support target person 4, or may acquire the physical information of the support target person 4 when the support target person 4 is lying in bed. In the present embodiment, the physical information acquisition module 102 will be described as acquiring the physical information of the support target person 4 when the support target person 4 is lying in bed. Note that the physical information acquisition module 102 may acquire the physical information of the support target person 4 from a predetermined external database or the like, may accept direct input of this physical information via a predetermined UI or the like, and acquire this physical information, or may acquire this physical information by other methods.

[0030] The physical information registration module 106 registers the acquired physical information (step S21). The physical information registration module 106 registers the acquired physical information in association with the attribute information of the support target person 4 that has been registered.

[0031] The above is the physical information registration process. The on-call transmission system 1 executes the processes described later using the physical information acquired by the physical information registration process described above.

[0032] [First output process executed by on-call terminal 10] Based on FIG. 7, the first output process executed by the on-call terminal 10 will be described. This figure is a diagram showing a flowchart of the first output process executed by the on-call terminal 10. This first output process is the details of the imaging process (step S1) of capturing an image of the support target person 4 during on-call as described above, and the output process (step S2) of outputting the attribute information of the support target person 4 and the physical information at the time of a sudden change in the symptoms of the support target person 4 on one screen together with the captured image. This first output process is a process that uses the attribute information registered by the above-described attribute information registration process and the physical information acquired by the above-described physical information registration process.

[0033] The imaging module 109 captures an image of the support target person 4 (step S30). The imaging module 109 captures an image such as a video or a still image of the support target person 4 using the camera provided in the on-call terminal 10. When the on-call terminal 10 is attached to the first holder 34, the imaging module 109 captures an image of the face of the support target person 4, and when the on-call terminal 10 is attached to the second holder 35, the imaging module 109 captures an image of the body including the face of the support target person 4. As an initial state, the on-call terminal 10 may be attached to the first holder 34 or may be attached to the second holder 35. Note that the on-call terminal 10 changes its attachment position to either the first holder 34 or the second holder 35 according to an instruction from the on-call responder side by the staff.

[0034] The analysis module 110 analyzes the image and the physical information (step S31). The analysis module 110 analyzes the captured image of the support target person 4. The analysis module 110 extracts feature points, feature amounts, etc. of this image, and based on the extraction results, analyzes the presence or absence of a sudden change in symptoms such as the current expression of the support target person 4 and the presence or absence of cyanosis. For example, the analysis module 110 compares the normal expression, etc. with the image to analyze the presence or absence of a sudden change in symptoms. In addition, based on the acquired physical information, the analysis module 110 analyzes whether there is an abrupt change in symptoms such as whether there is an abnormal value of oxygen saturation, whether there is an abnormal value of pulse, whether there is an abnormal value of blood pressure, and whether there is an abnormal value of electrocardiogram for the current support target person 4. For example, the analysis module 110 compares the oxygen saturation, pulse, blood pressure, electrocardiogram, etc. in the normal state with the physical information to analyze whether there is an abrupt change in symptoms. Note that the analysis module 110 may also analyze the acquired image of the support target person 4 based on a learning model that is learned and generated in advance with an image of the face and an image of the body including the face at the time of an abrupt change in symptoms and its content, which will be described later. In addition, the analysis module 110 may also analyze the physical information of the support target person 4 acquired based on a learning model that is learned and generated in advance with the physical information at the time of an abrupt change in symptoms and its content, which will be described later.

[0035] Based on the analysis result, the abrupt change determination module 111 determines whether the symptoms of the support target person 4 have abruptly changed (step S32). Based on the analysis result of the acquired image or physical information, the abrupt change determination module 111 determines whether the symptoms of the support target person 4 have abruptly changed. When the abrupt change determination module 111 determines that the symptoms of the support target person 4 have not abruptly changed (step S32 NO), that is, when no abrupt change in symptoms is recognized in the analysis result by the analysis module 110, the on-call terminal 10 executes the process of step S30 described above again.

[0036] On the other hand, when the abrupt change determination module 111 determines that the symptoms of the support target person 4 have abruptly changed (step S32 YES), that is, when an abrupt change in symptoms is recognized in the analysis result by the analysis module 110, the response module 103 at the time of abrupt change executes the response process at the time of abrupt change (step S33). The response process at the time of abrupt change is, for example, to notify the staff that the symptoms of the support target person 4 have abruptly changed, to execute an on-call call to the on-call responder, to notify the family, etc. that the symptoms of the support target person 4 have abruptly changed, to notify the emergency institution that the symptoms of the support target person 4 have abruptly changed, and to continue taking pictures. The emergency response module 103 receives a predetermined input from the staff (for example, a tap input of a predetermined button, etc.) and executes emergency response processing. Note that after the emergency response module 103 notifies the staff that the condition of the support target person 4 has changed suddenly, it receives a predetermined input from the staff and executes operations such as making an on-call call. Furthermore, when a call is established between the staff and the responder after the on-call call is made, the emergency response module 103 displays predetermined icons and buttons on the display unit of the on-call terminal 10 itself. When the emergency response module 103 receives an input of this icon or button from the staff, it automatically notifies the responder of the current address, residence, etc. of the support target person 4 by voice. The emergency response module 103 transmits the address or residence included in the registered attribute information or preset as voice data to the responder terminal 20. The responder terminal 20 receives this voice data and outputs a voice based on this voice data. As a result, the emergency response module 103 notifies the responder of the current address, residence, etc. of the support target person 4 by automatic voice.

[0037] The output module 104 outputs the captured image, the attribute information of the support target person 4, and the physical information of the support target person 4 at the time of sudden change on one screen (step S34). The output module 104 transmits the captured image, the attribute information of the support target person 4, and the physical information of the support target person 4 at the time of sudden change to the responder terminal 20. The output module 104 transmits a single screen with the image, attribute information, and physical information arranged at preset positions within the screen to the responder terminal 20. The responder terminal 20 receives these and displays them on its own display unit (see FIGS. 8 and 9). Note that the output module 104 may also display the image, attribute information, and physical information on the display unit of the on-call terminal 10 itself on one screen. In this case, the output module 104 may also display the screen shown in FIG. 8 or FIG. 9 described later on the display unit of the on-call terminal 10 itself. Further, the output module 104 may simply transmit the image, attribute information, and body information, instead of transmitting a single screen on which the image, attribute information, and body information are arranged. In this case, the responder terminal 20 may receive these and display a single screen corresponding to the preset arrangement of the image, attribute information, and body information on its own display unit.

[0038] Based on FIG. 8, the output screen output by the output module 104 will be described. This figure is a diagram schematically showing an example of the output screen output by the output module 104. In this figure, an output screen 40 when an image of the face of the support target person 4 is taken is shown. The output screen 40 has a first display column 41, a second display column 42, and a third display column 43. The first display column 41 and the third display column 43 are columns in which the attribute information and body information of the support target person 4 are displayed. The second display column 42 is a column in which the taken image is displayed. In the first display column 41 and the third display column 43, the registered attribute information and the acquired body information are displayed. Regarding the body information, the deviation between the current measurement result and the normal state may be displayed numerically or in characters, etc. For those with a large deviation width, the measurement result, the content of the body information, etc. may be highlighted or an icon indicating the same may be displayed to output that the urgency is high. In the second display column 42, an image 421 of the face of the support target person 4 taken this time is displayed. Regarding the image 421, in the analysis content, a part where the symptom is judged to have changed suddenly and its content, etc. may be highlighted or an icon indicating the same may be displayed to output that the urgency is high. The arrangement of each of the first display column 41, the second display column 42, and the third display column 43 is not limited to that shown in the figure and can be designed as appropriate. Also, the attribute information and body information displayed in the first display column 41 and the third display column 43 are not limited to those shown in the figure and can be designed as appropriate.

[0039] Based on FIG. 9, the output screen output by the output module 104 will be described. This figure is a diagram schematically showing an example of the output screen output by the output module 104. In this figure, an output screen 50 when an image of the body including the face of the support target person 4 is captured is shown. The output screen 50 has a first display column 51, a second display column 52, and a third display column 53. The first display column 51 and the third display column 53 are the same as the above-described first display column 41 and third display column 43. In the second display column 52, an image 521 of the body including the face of the support target person 4 captured this time is displayed. Regarding the image 521, similar to the above-described image 421, in the analysis content, highlighting of the location and content where the symptoms are determined to have changed suddenly, and an icon indicating the same may be displayed, and it may be output that the urgency is high. The arrangement of each of the first display column 51, the second display column 52, and the third display column 53 is not limited to that shown in the figure and can be designed as appropriate. Also, the attribute information and body information displayed in the first display column 51 and the third display column 53 are not limited to those shown in the figure and can be designed as appropriate.

[0040] The on-call responder can view the output screen 40 or the output screen 50 displayed on the responder terminal 20 and observe the symptoms of the support target person 4.

[0041] Returning to FIG. 7, the continuation of the first output process will be described. The end determination module 112 determines whether the on-call has ended (step S35). The end determination module 112 determines whether the on-call has ended based on whether there is an input for ending the call by the on-call terminal 10 or the responder terminal 20. When the end determination module 112 determines that the on-call has not ended (step S35 NO), the on-call terminal 10 continues to execute the process of step S34 described above.

[0042] On the other hand, when the end determination module 112 determines that the on-call has ended (step S35 YES), the output result recording module 107 records the image and physical information (step S36). The output result recording module 107 records the image and physical information output on one screen in association with the attribute information of the support target person 4 that has been registered. Note that in addition to the image and physical information, the output result recording module 107 may also record contents other than the image and physical information during the on-call, such as the call content.

[0043] The above is the first output process.

[0044] [Second output process executed by the on-call terminal 10] Based on FIG. 10, the second output process executed by the on-call terminal 10 will be described. This figure is a diagram showing a flowchart of the second output process executed by the on-call terminal 10. This second output process is different in detail from the first output process, which is the imaging process (step S1) of capturing an image of the support target person 4 during the on-call described above, and the output process (step S2) of outputting the attribute information of the support target person 4 and the physical information at the time of sudden change of the symptoms of the support target person 4 on one screen together with the captured image. This second output process is a process that uses the attribute information registered by the above-described attribute information registration process and the physical information acquired by the above-described physical information registration process. Note that detailed descriptions of the same processes as the above-described first output process will be omitted.

[0045] The sudden change response module 103 executes a sudden change response process (step S40). The on-call terminal 10 receives a predetermined input (input for starting a predetermined application, input indicating that the symptoms of the support target person 4 have suddenly changed, etc.) from the staff when the symptoms of the support target person 4 suddenly change. Also, when the symptoms of the support target person 4 suddenly change, the staff attaches the on-call terminal 10 to the first holder 34 or the second holder 35. The emergency response process includes, for example, having the on-call responder initiate an on-call call, notifying family members, etc. that the symptoms of Support Target 4 have changed suddenly, and notifying the emergency institution that the symptoms of Support Target 4 have changed suddenly. The emergency response module 103 receives a predetermined input from the staff (e.g., a tap input on a predetermined button, etc.) and executes the emergency response process. Furthermore, after the on-call call is initiated, when a call is established between the staff and the responder, the emergency response module 103 displays a predetermined icon or button on the display unit of the on-call terminal 10 itself. When the emergency response module 103 receives an input of this icon or button from the staff, it notifies the responder of the current address and residence, etc. of Support Target 4 by automatic voice. The emergency response module 103 transmits the address and residence included in the registered attribute information or preset as voice data to the responder terminal 20. The responder terminal 20 receives this voice data and outputs a voice based on this voice data. As a result, the emergency response module 103 notifies the responder of the current address and residence, etc. of Support Target 4 by automatic voice.

[0046] The imaging module 109 captures an image of Support Target 4 (step S41). The process of step S41 is the same as the process of step S30 described above.

[0047] The analysis module 110 analyzes the image and physical information (step S42). The analysis module 110 analyzes the captured image of Support Target 4. The analysis module 110 extracts feature points, feature amounts, etc. of this image, and based on the extraction results, analyzes the symptoms of Support Target 4 at the time of a sudden change in symptoms, such as the current expression of Support Target 4 and the presence or absence of cyanosis. In addition, based on the acquired physical information, the analysis module 110 analyzes the symptoms of Support Target 4 at the time of a sudden change in symptoms, such as the presence or absence of abnormal values of oxygen saturation, the presence or absence of abnormal values of pulse, the presence or absence of abnormal values of blood pressure, and the presence or absence of abnormal values of electrocardiogram of the current Support Target 4. Note that the analysis module 110 may analyze the acquired image of the support target person 4 based on a learning result obtained by previously learning an image of the face or an image of the body including the face at the time of a sudden change in symptoms and its content. Further, the analysis module 110 may analyze the body information of the support target person 4 acquired based on a learning result obtained by previously learning the body information at the time of a sudden change in symptoms and its content.

[0048] The output module 104 outputs the captured image, the attribute information of the support target person 4, and the body information of the support target person 4 at the time of sudden change on one screen (step S43). The process of step S43 is the same as the process of step S34 described above.

[0049] The on-call responder can view the output screen 40 or the output screen 50 displayed on the responder terminal 20 and observe the symptoms of the support target person 4.

[0050] The end determination module 112 determines whether the on-call has ended (step S44). The process of step S44 is the same as the process of step S35 described above. When the end determination module 112 determines that the on-call has not ended (step S44 NO), the on-call terminal 10 continues to execute the process of step S43 described above.

[0051] On the other hand, when the end determination module 112 determines that the on-call has ended (step S44 YES), the output result recording module 107 records the image and the body information (step S45). The process of step S45 is the same as the process of step S36 described above.

[0052] The above is the second output process.

[0053] [Learning model creation process executed by the on-call terminal 10] Based on FIG. 11, the learning model creation process executed by the on-call terminal 10 will be described. This figure is a diagram showing a flowchart of the learning model creation process executed by the on-call terminal 10.

[0054] The learning model creation module 108 creates a learning model by attaching the physical information and / or attribute information of the support target person 4 at the time of sudden symptom change as annotation data to the image of the face and / or the body including the face of the support target person 4 at the time of sudden symptom change (step S50). Here, the annotation data is teacher data for training a machine learning model, and is attached as information related to at least the image of the support target person 4 at the time of sudden symptom change in order to assign meaning and association to the data and combine them with each other.

[0055] The method of attaching the annotation data is not particularly limited, and the data may be attached by a manual method or a method using a tagging automation tool such as an annotation tool. Also, the method of acquiring the annotation data and the image of the face and / or the body including the face of the support target person 4 at the time of sudden symptom change is not limited and is not limited to those created by the on-call terminal 10.

[0056] Note that the learning model creation module 108 may attach the diagnosis information of the support target person 4 after sudden symptom change diagnosed by a doctor as the annotation data. Here, the diagnosis information includes at least the symptom name and / or disease name diagnosed by a doctor, and may further include reference information for diagnosing the symptom and disease.

[0057] The above is the learning model creation process.

[0058] [Third Output Process Executed by On-Call Terminal 10] FIG. 12 is a diagram showing a flowchart of a third output process executed by the on-call terminal 10. FIGS. 13 and 14 are diagrams schematically showing examples of output screens output by the on-call terminal 10. Based on FIGS. 12 to 14, the third output process executed by the on-call terminal 10 will be described.

[0059] In addition to the second output process described above, this third output process is a process of analyzing a sudden change in the symptoms of the support target person 4 and outputting symptom candidates and / or disease name candidates by using the learning model created by the learning model creation module 108. Note that detailed descriptions of the processes similar to the first and second output processes described above are omitted.

[0060] Similar to the first output process described above, the imaging module 109 captures an image of the support target person 4 (step S60). At this time, the mounting position of the on-call terminal 10 may be either the first holder 34 or the second holder 35. Note that the mounting position and mounting method of the on-call terminal 10 are not limited as long as the face or the entire body including the face of the support target person 4 can be captured. For example, it may be a flexible arm equipped with a face recognition camera that recognizes the face of the support target person 4 and automatically tracks it.

[0061] The analysis module 110 analyzes an image and body information including at least an image of the face of the support target person 4 based on the learning model created by the learning model creation module 108 (step S61). The analysis module 110 analyzes the image of the person 4 to be supported captured based on the learning model. For example, the analysis module 110 extracts feature points, feature quantities, etc. of this image, and based on the extraction results and the learning model, from the learning model that has learned the physical information, attribute information similar to the person 4 to be supported, and the expression changes during rapid changes, it analyzes the presence or absence of rapid changes in symptoms such as the current expression of the person 4 to be supported and the presence or absence of cyanosis. For example, the analysis module 110 compares the normal expression, etc. with the image, and analyzes the presence or absence of rapid changes in symptoms such as the presence or absence of rapid changes in symptoms, the presence or absence of abnormal values of oxygen saturation, the presence or absence of abnormal values of pulse, the presence or absence of abnormal values of blood pressure, and the presence or absence of abnormal values of electrocardiogram. Furthermore, the analysis module 110 analyzes attribute information including at least information such as the medical history of the person 4 to be supported and symptom candidates and disease name candidates according to the physical information based on the learning model.

[0062] When a plurality of approximate analysis results are obtained when the analysis module 110 analyzes based on the learning model (step S62 YES), the output module 104 outputs the auxiliary item 61 based on the analysis results (step S63). Here, the auxiliary item 61 is an auxiliary item 61 for further narrowing down the analysis results from the plurality of analyzed approximate analysis results. For example, as shown in the output screen example 60 of FIG. 13, it may be a selection-type instruction display for the responder such as a staff to further confirm the state of the person 4 to be supported. When the staff or the like makes a selection or input corresponding to the auxiliary item 61 via the responder terminal 20, the analysis module 110 re-analyzes at least the presence or absence of rapid changes in symptoms (step S64). Here, the analysis module 110 may also re-analyze the symptom candidates and / or disease name candidates related to the rapid changes in the symptoms of the person 4 to be supported.

[0063] The rapid change determination module 111 determines whether or not the symptoms of the person 4 to be supported have changed rapidly based on the analysis results of the analysis module 110 (step S65). When the acute change determination module 111 determines that the symptoms of the support target person 4 have not changed acutely (step S65 NO), that is, when no acute change in symptoms is recognized in the analysis result by the analysis module 110, the on-call terminal 10 executes the process of step S60 described above again.

[0064] On the other hand, when the acute change determination module 111 determines that the symptoms of the support target person 4 have changed acutely (step S65 YES), that is, when an acute change in symptoms is recognized in the analysis result by the analysis module 110, the acute change response module 103 executes an acute change response process in the same manner as the first and second output processes (step S66).

[0065] The output module 104 outputs, on one screen, the captured image, the attribute information of the support target person 4, the physical information of the support target person 4 at the time of acute change, and one or more symptom candidates analyzed based on the learning model (step S67). The output module 104 transmits, to the responder terminal 20, the captured image, the attribute information of the support target person 4, the physical information of the support target person 4 at the time of acute change, and the symptom candidates analyzed based on the learning model. The output module 104 transmits to the responder terminal 20 one screen in which at least the image, the attribute information, the physical information, and the symptom candidates 71 are arranged at preset positions within the screen. The responder terminal 20 receives these and displays them on its own display unit (see FIG. 14). Note that the output module 104 may display, on the display unit of the on-call terminal 10 itself, the image, the attribute information, the physical information, and the symptom candidates 71 on one screen like the output screen 70. Also, instead of transmitting one screen in which the image, the attribute information, the physical information, and the symptom candidates 71 are arranged, the output module 104 may simply transmit the image, the attribute information, the physical information, and the symptom candidates 71. In this case, the responder terminal 20 may receive these and display, on its own display unit, one screen corresponding to the preset arrangement of the image, the attribute information, and the physical information.

[0066] The end determination module 112 determines whether the on-call has ended (step S68). The process of step S68 is the same as the processes of step S35 and step S44 described above. When the end determination module 112 determines that the on-call has not ended (step S68 NO), the on-call terminal 10 continues to execute the process of step S67 described above.

[0067] On the other hand, when the end determination module 112 determines that the on-call has ended (step S68 YES), the output result recording module 107 records the image and body information (step S69). The process of step S69 is the same as the processes of step S36 and step S45 described above.

[0068] The above is the third output process.

[0069] Although the above-described processes are described as separate processes, the on-call terminal 10 may be configured to execute some or all of the above-described processes in combination. Also, the on-call terminal 10 may be configured to execute each process at a timing other than the timing described in each process.

[0070] As described above, the on-call transmission system 1 is a system effective during on-call, but can also be used in other cases. For example, the on-call terminal 10 may receive a predetermined input (such as starting an application, inputting a predetermined icon or button) from a staff member and enable communication with the entrusted doctor and family members. Thereby, it becomes possible to reduce the labor related to "being present at the deathbed" through communication among the staff member, the entrusted doctor, and the family members. This case will be described. When the on-call terminal 10 receives a predetermined input from a staff member, it makes a call to the doctor terminal (such as a mobile phone, smartphone, tablet terminal, etc.) held by the entrusted doctor and the family terminal (such as a mobile phone, smartphone, tablet terminal, etc.) held by the family. In response to this call, the doctor terminal and the family terminal start a call with the on-call terminal 10. As a result, a call among the staff member, the entrusted doctor, and the family becomes possible. In this call, the entrusted doctor explains the condition of the support target person 4 to the family and confirms the intention of watching at the end of life. The on-call terminal 10 receives a predetermined input from the staff member (such as input of a predetermined icon or button), and creates a consent form for watching at the end of life. The on-call terminal 10 inputs necessary items (date, name of the support target person 4, name / relationship / address of the family, name / workplace name of the entrusted doctor, name / occupation of the staff member, etc.) into a document in a predetermined format in advance, and creates a consent form for watching at the end of life. Note that the consent form for watching at the end of life may be created in advance. The on-call terminal 10 transmits the created consent form for watching at the end of life to the family terminal. The family terminal receives this consent form for watching at the end of life and displays it on its own display unit. The family terminal accepts the input of the signature from the family for this consent form for watching at the end of life. The family terminal transmits the consent form for watching at the end of life after the signature input to the on-call terminal 10. The on-call terminal 10 receives this consent form for watching at the end of life. The on-call terminal 10 registers the received consent form for watching at the end of life by associating it with the attribute information. The on-call terminal 10 may output the received consent form for watching at the end of life to a printing device such as a printer and have it printed. As a result of these processes, even when it is difficult for the family to satisfy the matters necessary for watching at the end of life due to work or the like, it becomes easier to satisfy the matters necessary for watching at the end of life. As a result, it is possible to reduce the effort related to "watching at the end of life".

[0071] The above-described means and functions are realized by a computer (including a CPU, an information processing device, and various terminals) reading and executing a predetermined program. The program may be provided, for example, in the form of being provided from a computer via a network (SaaS: Software as a Service) or in the form of a cloud service. Also, the program may be provided in a form recorded on a computer-readable recording medium. In this case, the computer reads the program from the recording medium, transfers it to an internal recording device or an external recording device, records it, and then executes it. Further, the program may be pre-recorded in a recording device (recording medium), and provided to the computer via a communication line from the recording device.

[0072] As described above, the embodiments of the present invention have been explained, but the present invention is not limited to these above-described embodiments. Also, the effects described in the embodiments of the present invention are merely an enumeration of the most preferable effects resulting from the present invention, and the effects according to the present invention are not limited to those described in the embodiments of the present invention.

[0073] The first aspect disclosed in this embodiment is an on-call transmission system used in the medical and welfare fields, a photographing unit 12 that photographs an image of a support target person during on-call, and an output unit 11 that outputs, on one screen, the photographed image together with the attribute information of the support target person and the physical information at the time of a sudden change in the symptoms of the support target person. An on-call transmission system comprising the above.

[0074] The second aspect disclosed in this embodiment is that the attribute information includes at least one of a group consisting of age data, data on the main disease, and data on the past history, The on-call transmission system according to the first aspect.

[0075] The third aspect disclosed in this embodiment is that the photographing unit is a camera of an on-call terminal that requests an on-call, The on-call terminal is provided above the bed of the person to be supported, and captures an image of the body including the face of the person to be supported. The on-call transmission system according to the first aspect.

[0076] A fourth aspect disclosed in this embodiment includes an analysis unit that analyzes the state of the person to be supported from at least the image captured by the imaging unit and the body information. A sudden change determination unit that determines a sudden change in the symptoms of the person to be supported from the analysis result analyzed by the analysis unit. A response unit at the time of sudden change that notifies at least a set target of the determination result determined by the sudden change determination unit. The on-call transmission system according to the third aspect, further comprising:

[0077] A fifth aspect disclosed in this embodiment further includes a learning model creation unit that associates and learns the face image, body information, and attribute information of the person to be supported at the time of sudden change in symptoms when the symptoms are diagnosed, and creates a learning model for analyzing the state of the person to be supported. Based on the learning model, the analysis unit analyzes the state including at least the symptom candidates of the person to be supported from the face image of the person to be supported. The on-call transmission system according to the fourth aspect.

[0078] A sixth aspect disclosed in this embodiment is that the output unit outputs one or more of the symptom candidates and / or auxiliary items for narrowing down the symptom candidates based on the analyzed result. Based on the input or selected auxiliary items, the analysis unit analyzes the state including the symptom candidates of the person to be supported again. The on-call transmission system according to the fifth aspect.

Explanation of reference numerals

[0079] 1 On-call transmission system 4 Person to be supported 7 Network 10 On-call terminal 11 Output unit 12 Imaging unit 20 Respondent terminal 31 Bed 310 End portion 32 Fixture 33 Light 34 First holder 35 Second holder 40, 50, 60, 70 Output screens 41, 51 First display column 42, 52 Second display column 421, 521 Images 43 Third display column 61 Auxiliary item 71 Symptom candidates

Claims

1. An on-call transmission system used in the medical and welfare fields, a photographing unit that photographs an image of a support target person during on-call, an output unit that outputs, on a single screen, the photographed image together with the attribute information of the support target person and the physical information at the time of a sudden change in the symptoms of the support target person, an analysis unit that analyzes the state of the support target person from at least the image photographed by the photographing unit and the physical information, a sudden change determination unit that determines a sudden change in the symptoms of the support target person from the analysis result analyzed by the analysis unit, a response unit at the time of sudden change that notifies at least a set target of the determination result determined by the sudden change determination unit, comprising the photographing unit is a camera of an on-call terminal that requests on-call, the on-call terminal is provided above the bed of the support target person and photographs an image of the body including the face of the support target person, an on-call transmission system.

2. The attribute information includes at least one of a group consisting of age data, data related to the main disease, and data related to the past medical history, The on-call transmission system according to claim 1.

3. further comprising a learning model creation unit that creates a learning model for analyzing the state of the support target person by associating and learning the face image, physical information, and attribute information of the support target person at the time of a sudden change in the symptoms diagnosed, The analysis unit analyzes the state including at least the symptom candidates of the support target person from the face image of the support target person based on the learning model, according to the on-call transmission system of claim 1.

4. The output unit outputs one or more of the symptom candidates and / or auxiliary items for narrowing down the symptom candidates based on the analyzed result, The analysis unit re-analyzes the state including the symptom candidates of the support target person based on the input or selected auxiliary items, according to the on-call transmission system of claim 3.

Images