Remote diagnosis support device, and consultation support device

Abstract

To provide a remote diagnosis support device that can smoothly make communication without causing a doctor and the like to display a face such as a patient and the like.SOLUTION: A remote diagnosis support device 1 comprises: an avatar image identification processing unit 32 that acquires identification information on a patient avatar image; an avatar image display data generation processing unit 33 that generates display data on the identified patient avatar image; an avatar image output processing unit 34 that outputs the generated patient avatar image to a doctor side terminal 3; a voice information acquisition processing unit 35 that acquires voice information on the patient from a patient side terminal 2; an analysis processing unit 36 that analyzes a state of the patient on the basis of the voice information; a patient state output processing unit 37 that outputs the analyzed state of the patient to the doctor side terminal 3; a text information acquisition processing unit 38 that acquires text information input from the doctor side terminal 3; a conversion processing unit 39 that converts the text information into the sound information; and a sound information output processing unit 40 that outputs the converted sound information to the patient side terminal 2.SELECTED DRAWING: Figure 5

Description

Technical Field

[0001] The present invention relates to a remote medical support device and a consultation support device.

Background Art

[0002] Conventionally, a technique for communicating with a person in a remote location via a communication network such as the Internet is known. For example, Patent Document 1 describes this type of technique.

[0003] Patent Document 1 relates to a remote medical system in which a doctor diagnoses and treats a patient in a remote location. In the remote medical system of Patent Document 1, the doctor-side terminal device includes a monitor that displays the face of the patient and an imaging unit that captures the face of the doctor, and it is described that even in remote medical treatment, the doctor and the patient can receive diagnosis and treatment with their eyes meeting.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] Communication between a doctor and a patient does not always preferably occur with each other looking at the face. For example, for a counselor such as a patient, communication may not proceed smoothly due to the face being photographed.

[0006] The present invention has been made in view of such a situation, and an object thereof is to provide a remote medical support device and a consultation support device capable of enabling smooth communication between a counselor such as a patient and a responder such as a doctor.

Means for Solving the Problems

[0007] In order to achieve the above object, one aspect of the present invention includes an avatar image specifying means for acquiring specifying information for specifying a patient avatar image from a patient terminal, an avatar image display data generating means for generating display data for displaying the specified patient avatar image, an avatar image output means for outputting the patient avatar image generated by the avatar image display data generating means to a doctor terminal, a voice information acquiring means for acquiring voice information of a patient from the patient terminal, an analyzing means for analyzing the state of the patient based on the voice information, a patient state output means for outputting the analyzed state of the patient to the doctor terminal, a text information acquiring means for acquiring text information input from the doctor terminal, a converting means for converting the text information into voice information, and a voice information output means for outputting the converted voice information to the patient terminal.

[0008] Further, one aspect of the present invention includes an avatar image specifying means for acquiring specifying information for specifying a counselor avatar image from a counselor terminal, an avatar image display data generating means for generating display data for displaying the specified counselor avatar image, an avatar image output means for outputting the counselor avatar image generated by the avatar image display data generating means to a respondent terminal, a text information acquiring means for acquiring text information input from the respondent terminal, a converting means for converting the text information into voice information, and a voice information output means for outputting the converted voice information to the counselor terminal.

Advantages of the Invention

[0009] According to the present invention, it is possible to provide a remote medical support device and a consultation support device that enable smooth communication between a counselor such as a patient and a respondent such as a doctor.

Brief Description of the Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Embodiments for Carrying Out the Invention

[0011] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In the description from the second embodiment onward, the same reference numerals are given to the configurations common to the first embodiment, and the description thereof will be omitted as appropriate.

[0012] <First Embodiment> First, the overall system configuration will be described. FIG. 1 is a diagram showing an information processing system 100 to which a telemedicine support device 1 according to the first embodiment of the present invention is applied. The information processing system 100 shown in FIG. 1 is realized by a telemedicine support device 1 that transmits and receives various information to and from a patient-side terminal 2 and a doctor-side terminal 3 via a communication network such as the Internet.

[0013] The telemedicine support device 1 is a consultation support device that executes various controls to perform communication between a patient and a doctor using an avatar image, and functions as a server.

[0014] The patient-side terminal 2 is a counselor-side terminal used by the patient who is the counselor. The patient-side terminal 2 is composed of a smartphone, a tablet, a personal computer, etc. The patient-side terminal 2 may exchange various information with the remote medical support device 1 through a pre-installed program, or may exchange various information through a web browser.

[0015] The doctor-side terminal 3 is a responder-side terminal used by the doctor who is the responder to the consultation. The doctor-side terminal 3 is composed of a personal computer, a tablet, a smartphone, etc. The doctor-side terminal 3 may exchange various information with the remote medical support device 1 through a pre-installed program, or may exchange various information through a web browser.

[0016] <Hardware Configuration> Next, an example of the hardware constituting the remote medical support device 1 will be described. FIG. 2 is a block diagram showing the hardware configuration of the remote medical support device 1 according to the first embodiment. The remote medical support device 1, which is also a consultation support device, includes a CPU (Central Processing Unit) 11 as a processor, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a bus 14, an input / output interface 15, an output unit 16, an input unit 17, a storage unit 18, a communication unit 19, and a drive 20.

[0017] The CPU 11 executes various processes according to a program recorded in the ROM 12 or a program loaded from the storage unit 18 to the RAM 13. The RAM 13 also appropriately stores data and the like necessary for the CPU 11 to execute various processes. The CPU 11, ROM 12, and RAM 13 are interconnected via the bus 14. The input / output interface 15 is also connected to this bus 14.

[0018] An output / input interface 15 is connected to an output unit 16, an input unit 17, a storage unit 18, a communication unit 19, and a drive 20. The output unit 16 is composed of a display, a speaker, etc., and outputs various information as images and sounds. The input unit 17 is composed of a keyboard, a mouse, etc., and inputs various information. The storage unit 18 is a storage means composed of a hard disk, a DRAM (Dynamic Random Access Memory), etc., and stores various data. The communication unit 19 communicates with other devices via a network including the Internet.

[0019] A removable medium 21 made of a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, etc. is appropriately mounted on the drive 20. The program read from the removable medium 21 by the drive 20 is installed in the storage unit 18 as necessary. Also, the removable medium 21 can store various data stored in the storage unit 18 in the same manner as the storage unit 18.

[0020] The hardware configuration described here is merely an example. The computer described in this embodiment including the remote medical support device 1 may have a configuration common to that of FIG. 2, or may have a different configuration. Also, the computer may be composed of two or more computers, or may be composed of a computer on the cloud using cloud computing technology.

[0021] Next, an example of the hardware configuration of the patient-side terminal 2 and the doctor-side terminal 3 will be described. In this embodiment, the patient-side terminal 2 and the doctor-side terminal 3 have the same configuration, but are not limited thereto. FIG. 3 is a block diagram showing the hardware configuration of the patient-side terminal 2 or the doctor-side terminal 3 according to the first embodiment.

[0022] As shown in FIG. 3, the patient terminal 2 or the doctor terminal 3 includes a CPU 111, a ROM 112, a RAM 113, a bus 114, an input / output interface 115, a display unit 116, an input unit 117, a storage unit 118, a communication unit 119, a drive 120, a photographing unit 122, a microphone 123, and a speaker 124.

[0023] The CPU 111 executes various processes according to a program recorded in the ROM 112 or a program loaded from the storage unit 118 into the RAM 113. The RAM 113 also appropriately stores data and the like necessary for the CPU 111 to execute various processes. The CPU 111, the ROM 112, and the RAM 113 are interconnected via the bus 114. The input / output interface 115 is also connected to this bus 114.

[0024] Connected to the input / output interface 115 are the display unit 116, the input unit 117, the storage unit 118, the communication unit 119, the drive 120, the photographing unit 122, the microphone 123, and the speaker 124. The display unit 116 is composed of a display or the like and outputs images of various information. The input unit 117 is composed of a touch panel display, buttons, a keyboard, or the like and accepts input of various information. The storage unit 118 is composed of a hard disk, a DRAM (Dynamic Random Access Memory), or the like and stores various data. The communication unit 119 communicates with other devices via a network including the Internet.

[0025] A removable medium 121 made of a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory is appropriately mounted on the drive 120. A program read from the removable medium 121 by the drive 120 is installed in the storage unit 118 as necessary. Also, the removable medium 121 can store various data stored in the storage unit 118 in the same manner as the storage unit 118.

[0026] The imaging unit 122 is an imaging device such as a camera that captures images. In this embodiment, the imaging unit 122 captures the face of the user of the terminal.

[0027] The microphone 123 is a voice input device that inputs voice. In this embodiment, the voice of the user of the terminal is acquired as voice information by the microphone 123.

[0028] The speaker 124 is a voice output device that outputs voice. In this embodiment, the voice information obtained by converting the text information input on the doctor side terminal 3 is output by the speaker 124.

[0029] The hardware configuration of the patient side terminal 2 or the doctor side terminal 3 described here is merely an example. For example, a part of the configuration described in FIG. 3 (imaging unit 122, microphone 123, speaker 124, etc.) may be arranged outside the terminal main body and connected by wire or wirelessly. Further, the patient side terminal 2 and the doctor side terminal 3 may have different hardware configurations.

[0030] <Functional configuration> Next, the functional configuration of the remote medical support device 1 that constitutes the information processing system 100 will be described. FIG. 4 is a functional block diagram showing an example of the functional configuration of the remote medical support device 1 according to the first embodiment. As shown in FIG. 4, the remote medical support device 1 includes an inquiry reception processing unit 25, an online call processing unit 26, and a prescription response processing unit 27 as functional units realized on a processor (CPU 11).

[0031] The inquiry reception processing unit 25 is an inquiry reception means for preliminarily receiving an inquiry for receiving a doctor's diagnosis from a patient. The inquiry reception processing unit 25 acquires information indicating the patient's response to the inquiry input through the input unit 117 of the patient side terminal 2 via the communication network. For example, the inquiry reception processing unit 25 can display an inquiry screen for displaying the inquiry content on the display unit 116 of the patient side terminal 2 through an application or a web browser, and allow the response to the inquiry to be input through this inquiry screen.

[0032] The online call processing unit 26 is an online call processing means for performing online call processing to realize consultations including medical examinations by doctors through online calls. The online call processing unit 26 communicates with each of the patient-side terminal 2 and the doctor-side terminal 3, and constructs a call environment for receiving medical treatment on the communication network. In the present embodiment, the online call processing unit 26 performs an online call using the patient's avatar image. Details of the online call processing by the online call processing unit 26 will be described later.

[0033] The prescription form corresponding processing unit 27 performs processing related to the prescription form prescribed by the doctor based on the telemedicine conducted through the online call provided by the online call processing unit 26. The prescription form corresponding processing unit 27 transmits prescription form specifying information for specifying the prescription form input through the input unit 117 of the doctor-side terminal 3 to the patient-side terminal 2. The prescription form corresponding processing unit 27 can also transmit the prescription form specifying information to the patient-side terminal 2 in the form of an identification code such as a QR code (registered trademark). In this case, the patient can display the identification code on the display unit 116 of his or her patient-side terminal 2 and present the prescription form at a pharmacy or a contact sales business that provides the prescription form.

[0034] In addition, the prescription form corresponding processing unit 27 can transmit the prescription form specifying information to the terminal of the provider that provides drugs or the like corresponding to the prescription form specified in advance. The provider is, for example, a pharmacy or a contact lens merchant. The prescription form corresponding processing unit 27 can also transmit the prescription form specifying information to the terminal of the provider designated by the patient through the patient-side terminal 2. In this way, the patient can select the means for delivering the drug. As a result, the prescription form is sent to the designated pharmacy or contact lens sales business, and the patient can receive the drug when returning home.

[0035] In the case of a drug for which a pharmacist has an obligation to explain, the prescription response processing unit 27 may transmit connection destination information indicating an address or the like for viewing a video or making a video call to fulfill the obligation to the patient terminal 2. Further, the prescription response processing unit 27 may display a video or a video call screen on a monitor provided at a designated location such as a locker designated as the location where the patient receives the prescription. The patient can make a video or a video call through the monitor by presenting information indicating receipt of the prescription (for example, prescription specific information).

[0036] Further, in the storage unit 18 which is a storage means of the remote medical support device 1, a database for registering information such as user information for identifying a patient, a patient avatar image, and a doctor avatar image is constructed. The user information includes information such as the patient's name and address, the patient's medical treatment result, the content of the prescription, the destination of the prescription, and an identification signal for identifying the patient terminal 2 used by the patient. These pieces of information registered in the database are used by the consultation reception processing unit 25, the online call processing unit 26, the prescription response processing unit 27, and the like. Note that the database may be physically arranged outside the remote medical support device 1, and information registration and reading may be performed via a communication network.

[0037] Next, with reference to FIG. 5, details of the online call processing by the remote medical support device 1 of the present embodiment will be described. FIG. 5 is a functional block diagram showing an example of a functional configuration related to the online call of the remote medical support device 1 according to the first embodiment.

[0038] As shown in FIG. 5, the remote medical support device 1 includes, as functional units of the online call processing unit 26, an authentication processing unit 31, an avatar image identification processing unit 32, an avatar image display data generation processing unit 33, an avatar image output processing unit 34, an audio information acquisition processing unit 35, an analysis processing unit 36, a patient state output processing unit 37, a text information acquisition processing unit 38, a conversion processing unit 39, an audio information output processing unit 40, a face image display request acquisition processing unit 41, a display confirmation request output processing unit 42, a face image display data generation processing unit 43, and a face image display data output processing unit 44.

[0039] The authentication processing unit 31 is an authentication means for photographing a patient's face image and performing a process for collating the photographed face image with the personal identification card with a face image. The information of the photographed face image and the personal identification card with a face image is stored, for example, in the storage unit (database) 18. The authentication processing unit 31 acquires the face image of the patient and the face image of the personal identification card, and determines whether it is the person himself / herself by image analysis. For the determination by image analysis, known techniques such as a method of identifying as the person when the degree of coincidence of feature points in the image is equal to or more than a predetermined value can be used.

[0040] The method for acquiring the face image of the patient and the face image of the personal identification card is not particularly limited. For example, the authentication processing unit 31 may acquire the face image of the patient and the face image of the identification card through the photographing unit 122 of the patient-side terminal 2 connected to the communication network. Further, the authentication processing unit 31 may acquire the face image of the patient and the face image of the identification card through an independent photographing device different from the photographing unit 122 of the patient-side terminal 2. In this case, the authentication processing unit 31 can acquire the image photographed by the photographing device through the communication network.

[0041] The avatar image specifying processing unit 32 is an avatar image specifying means for performing a process for acquiring specifying information for specifying a patient-specific avatar image from the patient-side terminal 2. The patient-specific avatar image is an avatar image for a counselor displayed on the doctor-side terminal 3 instead of displaying an image of the patient's face. The avatar image specifying processing unit 32 specifies the avatar image based on an operation for specifying the patient-specific avatar image of the patient through the input unit 117 of the patient-side terminal 2.

[0042] The method for specifying the patient avatar image is not particularly limited. For example, the avatar image specifying processing unit 32 may display an avatar specifying screen on the patient terminal 2, and specify the patient avatar image selected by the patient based on the operation content of the patient on this avatar specifying screen. The specification of the patient avatar image on the avatar specifying screen may be in a form of selection from a plurality of pre-prepared patient avatar images, may be in a form of customization by the patient, or may be in a form of uploading an image prepared by the patient as the avatar image.

[0043] The avatar image specifying processing unit 32 registers the specified patient avatar image in the storage unit 18 in association with an identification signal for identifying the patient terminal 2. The patient avatar image is an image such as a picture or a photograph of a person, an animal, an object, etc. The identification signal only needs to be information that can identify the patient terminal 2 or the patient who holds the patient terminal 2, and is not particularly limited. As the identification information, for example, various information such as a MAC address, a cookie, a patient ID, etc. can be adopted. When the avatar image specifying processing unit 32 receives the identification number of the patient terminal 2, it specifies the patient avatar image corresponding to the received identification number registered in the storage unit 18 as the patient avatar image to be displayed on the doctor terminal 3. In this way, the identification signal is used as the specifying information. In other words, the specifying information also includes the identification signal of the patient terminal 2. The avatar image specifying processing unit 32 causes the specified patient avatar image to be displayed on the doctor terminal 3 via the avatar image display data generation processing unit 33 and the avatar image output processing unit 34.

[0044] In addition, the avatar image specifying processing unit 32 can also receive information for specifying the doctor avatar image from the patient terminal 2. The doctor avatar image is an avatar image for the respondent displayed on the patient terminal 2 instead of displaying the image of the doctor's face. The doctor avatar image is an image such as a picture or a photograph of a person, an animal, an object, etc. For example, when an operation for specifying the doctor avatar image is performed through the input unit 117 of the patient terminal 2, the information for specifying the doctor avatar image is notified to the avatar image specifying processing unit 32.

[0045] When the avatar image specifying processing unit 32 acquires information for specifying a doctor's avatar image from the patient terminal 2, it associates an identification signal for identifying the patient terminal 2 with the doctor's avatar image and registers them in the storage unit 18. When a doctor's avatar image corresponding to the identification number received from the patient terminal 2 is registered in the storage unit 18, the avatar image specifying processing unit 32 sets this doctor's avatar image as the doctor's avatar image to be displayed on the patient terminal 2.

[0046] Furthermore, the avatar image specifying processing unit 32 can determine the doctor's avatar image to be displayed on the patient terminal 2 based on the results specified from the patient terminal 2. For example, when a plurality of types of doctor's avatar images have been specified by the patient terminal 2 in the past, the doctor's avatar image that has been specified the most number of times among the candidates can be specified as the doctor's avatar image to be displayed on the patient terminal 2. Also, instead of just one patient, the doctor's avatar image that has been specified the most number of times among multiple patients may be specified as the default doctor's avatar image to be displayed on the patient terminal 2.

[0047] The avatar image display data generation processing unit 33 is an avatar image display data generation means that performs processing for generating display data for displaying the specified patient's avatar image. The avatar image display data generation processing unit 33 sets the patient's avatar image specified by the patient as the image to be displayed as this patient's avatar.

[0048] Also, the avatar image display data generation processing unit 33 can also generate display data for displaying the doctor's avatar image. When the doctor's avatar image is specified by the avatar image specifying processing unit 32 or the doctor's avatar image corresponding to the patient's identification signal is registered in the storage unit 18, the avatar image display data generation processing unit 33 generates display data for the specified doctor's avatar image.

[0049] The avatar image output processing unit 34 is an avatar image output means for performing processing to output the display data of the patient avatar image generated by the avatar image display data generation processing unit 33 to the doctor-side terminal 3. The avatar image output processing unit 34 transmits display data for displaying the avatar image to the display unit 116 of the doctor-side terminal 3 via the communication network.

[0050] Also, when the display data of the doctor avatar image is generated by the avatar image display data generation processing unit 33, the avatar image output processing unit 34 outputs the doctor avatar image to the patient-side terminal 2.

[0051] The voice information acquisition processing unit 35 is a voice information acquisition means for performing processing to acquire the voice information of the patient from the patient-side terminal 2. The voice information acquisition processing unit 35 acquires the voice information acquired by the patient-side terminal 2 via the communication network.

[0052] The method for acquiring voice information is not particularly limited. For example, the voice information acquisition processing unit 35 may acquire the voice information of the patient through the microphone 123 of the patient-side terminal 2 connected to the communication network. Alternatively, the voice information of the patient may be acquired through a microphone-equipped headset connected to the patient-side terminal 2 by wire or wirelessly separately from the microphone 123 of the patient-side terminal 2.

[0053] The analysis processing unit 36 is an analysis means for performing processing to analyze the state of the patient based on the voice information acquired by the voice information acquisition processing unit 35. The state of the patient is the presence or absence and symptoms of medical conditions such as mental disorders and neurological disorders. Mental disorders include, for example, schizophrenia, depression, PTSD, etc. Neurological disorders include, for example, Alzheimer's disease, Parkinson's disease, etc. The analysis processing unit 36 analyzes the state of the patient by analyzing the voice information.

[0054] The analysis processing unit 36 of this embodiment analyzes the patient's condition by using the vocal cord vibration information and the intonation of speech included in the voice information to be analyzed. The analysis processing unit 36 identifies the vocal cord vibration information and the intonation information from the voice information, and estimates the patient's condition from the identified vocal cord vibration information and intonation information.

[0055] For example, the estimation of the patient's condition by the analysis processing unit 36 can be performed using a learning model constructed such that the vibration information and the intonation information are input values and the patient's condition is an output value. The learning model can be constructed by learning a dataset in which the patient's condition is labeled as correct data for the vibration information and the intonation information. Also, the patient's condition may be estimated based on a preset rule-based algorithm. For example, the analysis processing unit 36 may digitize the vibration information and the intonation information as input data, and automatically estimate the patient's condition based on a predetermined threshold value or combination defined in the rule base. The estimation of the patient's condition by the analysis processing unit 36 can utilize known techniques.

[0056] The patient condition output processing unit 37 is a patient condition output means that performs processing for outputting the analyzed patient's condition to the doctor-side terminal 3. The patient condition output processing unit 37 transmits information for displaying the analyzed patient's condition to the display unit 116 of the doctor-side terminal 3 via the communication network.

[0057] The text information acquisition processing unit 38 is a text information acquisition means that performs processing for acquiring the text information input from the doctor-side terminal 3. The text information acquisition processing unit 38 acquires text information indicating the content of the text input through the input unit 117 of the doctor-side terminal 3.

[0058] The conversion processing unit 39 is a conversion means that performs processing for converting the text information into voice information. The voice conversion processing is performed, for example, by an algorithm in which voices corresponding to characters are set and voice information corresponding to the text information is generated. It may be performed using known techniques. The generation of voice information can utilize known techniques.

[0059] The voice information output processing unit 40 is voice information output means that performs processing for outputting the voice information converted by the conversion processing unit 39 to the patient-side terminal 2. The voice information output processing unit 40 transmits information for outputting voice information to the speaker 124 of the patient-side terminal 2 via the communication network.

[0060] The face image display request acquisition processing unit 41 is face image display request acquisition means that performs processing for acquiring a display request for a face image from the doctor-side terminal 3. When the operation of the request means of the doctor-side terminal 3 is performed, a display request for a face image is transmitted from the doctor-side terminal 3 to the face image display request acquisition processing unit 41. The request means is, for example, a GUI (Graphical User Interface) on the screen displayed on the display unit 116 of the doctor-side terminal 3, and the doctor can transmit the display request to the face image display request acquisition processing unit 41 by selecting through the input unit 117 or the like. The input unit 117 of the doctor-side terminal 3 functions as request means for inputting a display request for the face image of the patient.

[0061] When the display confirmation request output processing unit 42 acquires a display request for a face image from the doctor-side terminal 3, it is display confirmation request output means that performs processing for outputting a request for confirming the display of the face image to the patient-side terminal 2. The display confirmation request output processing unit 42 transmits notification information for notifying the patient-side terminal 2 that there is a display request for a face image via the communication network. When the patient-side terminal 2 receives the notification information, it displays on the display unit 116 that there is a display request for a face image, and confirms with the patient whether to display the face image. In this way, the display unit 116 of the patient-side terminal 2 functions as confirmation means for confirming the display request for the face image with the patient.

[0062] The face image display data generation processing unit 43 is a face image display data generation means that acquires a face image from the imaging unit 122 of the patient-side terminal 2 when a display confirmation input is made through the input unit 117 by a patient who has seen the display confirmation displayed on the display unit 116. The face image display data generation processing unit 43 performs processing for generating display data of the acquired face image. The display data of the face image is for displaying the actual face of the patient at the time of diagnosis, and is used for a doctor to judge symptoms and confirm the communication state, etc.

[0063] The face image display data output processing unit 44 is a face image display data output means that performs processing for outputting the generated face image display data to the doctor-side terminal 3 by the face image display data generation processing unit 43.

[0064] <Flow of processing> Next, with reference to FIG. 6, the flow of the online call processing will be described. FIG. 6 is a sequence diagram showing an example of the flow of the online call processing by the remote medical support device 1 according to the first embodiment.

[0065] In step S1, the imaging unit 122 of the patient-side terminal 2 captures a face image of the patient receiving medical treatment. The face image captured by the imaging unit 122 is transmitted to the remote medical support device 1 via the communication network by the communication unit 119 of the patient-side terminal 2.

[0066] In step S2, the imaging unit 122 of the patient-side terminal 2 captures an identity card of the patient including the face (photo) of the patient receiving medical treatment. The image of the identity card including the face image captured by the imaging unit 122 is transmitted to the remote medical support device 1 via the communication network by the communication unit 119 of the patient-side terminal 2.

[0067] In step S3, the authentication processing unit 31 of the remote medical support device 1 performs a comparison between the face image of the patient and the face image on the personal identification card. In this example, the authentication processing unit 31 determines that the face image of the patient matches the face image on the personal identification card, and thus determines that it is the patient himself / herself. If the face image of the patient does not match the face image on the personal identification card, the authentication processing unit 31 may send a notification to the patient-side terminal 2 requesting a retake of the photo or the like. If the authentication processing unit 31 cannot authenticate that it is the patient himself / herself, subsequent processing may not be performed, or medical treatment may be performed on the condition that authentication confirmation after medical treatment is required, etc.

[0068] In step S4, based on the information displayed on the display unit 116 of the patient-side terminal 2, the patient performs an operation on the input unit 117 for setting the patient avatar image, thereby specifying the patient avatar image. The specific information indicating the specified patient avatar image is transmitted by the communication unit 119 of the patient-side terminal 2 to the remote medical support device 1 via the communication network.

[0069] In step S5, the avatar image specifying processing unit 32 of the remote medical support device 1 specifies the patient avatar image to be displayed on the doctor-side terminal 3 based on the specific information transmitted from the patient-side terminal 2, and the avatar image display data generation processing unit 33 generates the display data of the specified patient avatar image. Then, the avatar image output processing unit 34 transmits the display data of the patient avatar image to the doctor-side terminal 3 by the communication unit 19.

[0070] In step S6, the patient avatar image is output as the patient's image on the display unit 116 of the doctor-side terminal 3.

[0071] In step S7, based on the information displayed on the display unit 116 of the patient-side terminal 2, the patient performs an operation on the input unit 117 for setting the doctor avatar image, thereby specifying the doctor avatar image. The specific information indicating the specified doctor avatar image is transmitted by the communication unit 119 of the patient-side terminal 2 to the remote medical support device 1 via the communication network.

[0072] In step S8, the avatar image identification processing unit 32 of the remote medical support device 1 identifies the doctor's avatar image to be displayed on the patient terminal 2 based on the identification processing transmitted from the patient terminal 2, and the avatar image display data generation processing unit 33 generates the display data of the identified doctor's avatar image. Then, the avatar image output processing unit 34 transmits the display data of the doctor's avatar image to the patient terminal 2 via the communication network by the communication unit 19.

[0073] In step S9, the doctor's avatar image is output as the doctor's image to the display unit 116 of the patient terminal 2.

[0074] In step S10, the speech of the patient is acquired as voice information by the microphone 123 of the patient terminal 2. The acquired voice information is transmitted to the remote medical support device 1 via the communication network by the communication unit 119 of the patient terminal 2.

[0075] In step S11, the voice information acquisition processing unit 35 of the remote medical support device 1 acquires the voice information transmitted from the patient terminal 2, and the analysis processing unit 36 analyzes the state of the patient based on the voice information. Then, the patient state output processing unit 37 outputs the analysis result of the analysis processing unit 36 to the doctor terminal 3 via the communication network by the communication unit 19.

[0076] In step S12, the state of the patient analyzed by the analysis processing unit 36 is output to the display unit 116 of the doctor terminal 3.

[0077] In step S13, the text input through the input unit 117 of the doctor terminal 3 is transmitted to the remote medical support device 1 via the communication network by the communication unit 119. The text input by the doctor is, for example, text indicating the doctor's findings, answers to the patient, advice, etc.

[0078] In step S14, the text information acquisition processing unit 38 of the remote medical support device 1 acquires the text information transmitted from the doctor-side terminal 3, and the conversion processing unit 39 converts the text information into voice information. Then, the voice information output processing unit 40 transmits the converted voice information to the patient-side terminal 2 via the communication network by the communication unit 19.

[0079] In step S15, the patient-side terminal 2 outputs, by the speaker 124, the voice information converted from the text information received from the remote medical support device 1. As a result, the patient can listen to the doctor's findings, answers to the patient, advice, etc. input in text by the doctor in voice.

[0080] In step S16, when an operation of selecting the display of the patient's face image is performed through the input unit 117 of the doctor-side terminal 3, a face image display request is transmitted to the remote medical support device 1 via the communication network by the communication unit 119.

[0081] In step S17, the face image display request acquisition processing unit 41 of the remote medical support device 1 acquires the face image display request from the doctor-side terminal 3, and the display confirmation request output processing unit 42 notifies the fact that the doctor has selected the face image display and transmits, to the patient-side terminal 2 via the communication network by the communication unit 19, information for displaying a screen asking the patient to select a confirmation button.

[0082] In step S18, when a patient performs a selection operation of the confirmation button for the face image display displayed on the display unit 116 of the patient-side terminal 2 through the input unit 117, the imaging by the imaging unit 122 is started, and the patient's face image is transmitted to the remote medical support device 1 via the communication network by the communication unit 119.

[0083] In step S19, the face image display data generation processing unit 43 of the remote medical support device 1 generates display data of the patient's face image captured by the imaging unit 122, and transmits the display data generated by the face image display data output processing unit 44 to the doctor-side terminal 3 via the communication network by the communication unit 19.

[0084] In step S20, a face image of the patient is displayed on the display unit 116 of the doctor terminal 3. The face image of the patient may be displayed in place of the patient avatar image, or may be displayed together with the patient avatar image. After confirming the face of the patient, the doctor ends the telemedicine.

[0085] As described above, the telemedicine support device 1 of the present embodiment includes an avatar image specifying processing unit 32 that acquires specifying information for specifying a patient avatar image from the patient terminal 2, an avatar image display data generation processing unit 33 that generates display data for displaying the specified patient avatar image, an avatar image output processing unit 34 that outputs the patient avatar image generated by the display data generation means to the doctor terminal 3, a voice information acquisition processing unit 35 that acquires voice information of the patient from the patient terminal 2, an analysis processing unit 36 that analyzes the state of the patient based on the voice information, a patient state output processing unit 37 that outputs the analyzed state of the patient to the doctor terminal 3, a text information acquisition processing unit 38 that acquires text information input from the doctor terminal 3, a conversion processing unit 39 that converts the text information into voice information, and a voice information output processing unit 40 that outputs the converted voice information to the patient terminal 2.

[0086] Thereby, the patient can convey his / her state to the doctor online without showing his / her face to the doctor through the medical treatment using the patient avatar image. The patient can communicate smoothly without being stressed about the display of his / her face. In addition, the doctor can efficiently perform medical treatment by using the analysis result indicating the state of the patient based on the voice information of the patient. Furthermore, since the doctor's reply during medical treatment can also be converted from voice information to text, the patient can consult about his / her own situation and state without overly being conscious of the presence of the doctor.

[0087] In addition, the telemedicine support device 1 of the present embodiment further includes an authentication processing unit 31 that captures a face image of the patient and collates the captured face image with the personal identification card with the face image.

[0088] This can avoid the situation where a third party other than the patient undergoes medical treatment using the avatar image.

[0089] In addition, the remote medical treatment support device 1 of the present embodiment further includes a face image display request acquisition processing unit 41 that acquires a face image display request from the doctor-side terminal 3, a display confirmation request output processing unit 42 that outputs a request to confirm the display of the face image to the patient-side terminal 2 when the face image display request is acquired, a face image display data generation processing unit 43 that acquires the face image from the patient-side terminal 2 and generates display data of the acquired face image when the display confirmation is input from the patient-side terminal 2, and a face image display data output processing unit 44 that outputs the generated display data of the face image to the doctor-side terminal 3.

[0090] This enables the doctor to confirm the patient's face image before making a final diagnosis, and also allows for diagnoses that require seeing the patient's face. In addition, it can surely prevent impersonation by a third party other than the patient.

[0091] In addition, the remote medical treatment support device 1 of the present embodiment further includes a storage unit 18 that stores the identification signal for identifying the patient-side terminal 2 and the patient's avatar image in association with each other. The specific information for specifying the patient's avatar image includes the identification signal for identifying the patient-side terminal 2. When the avatar image specifying processing unit 32 receives the identification signal for identifying the patient-side terminal 2, it displays the patient's avatar image associated with this identification signal.

[0092] This allows the previously set patient's avatar image to be displayed in the next medical treatment without the need for the patient to set the patient's avatar image again once the patient has set the patient's avatar image once, thus reducing the effort required for the patient to receive online medical treatment.

[0093] In addition, in the present embodiment, the avatar image display data generation processing unit 33 generates display data for displaying the doctor's avatar image, and the avatar image output processing unit 34 outputs the doctor's avatar image generated by the avatar image display data generation processing unit 33 to the patient-side terminal 2. The doctor's avatar image can be specified from the patient-side terminal 2, and stores the identification signal for identifying the patient-side terminal 2 and the doctor's avatar image in association with each other, and can determine the doctor's avatar image based on the identification signal for identifying the patient-side terminal 2. The doctor's avatar image can be determined based on the results specified from the patient-side terminal 2.

[0094] As a result, the image of the doctor during the medical examination can be changed to the doctor's avatar image set by the patient, so that the patient can communicate more smoothly without being conscious of the doctor's expression or the like.

[0095] In addition, in the present embodiment, the voice information of the patient includes vocal cord vibration information and intonation information of speech, and the state of the patient includes the presence or absence of mental disorders and neurological disorders.

[0096] As a result, the doctor can refer to the presence or absence of mental disorders and neurological disorders analyzed using the vocal cord vibration information and intonation information of speech, and can perform telemedicine more efficiently.

[0097] <Second Embodiment> In the above embodiment, the telemedicine support device 1 for supporting telemedicine has been described, but the application is not limited to telemedicine.

[0098] FIG. 7 is a functional block diagram showing an example of the functional configuration of the consultation support device 1a according to the second embodiment. The consultation support device 1a according to the second embodiment supports the user of the respondent-side terminal 3a, who is the respondent, to receive an online consultation from the user of the counselor-side terminal 2a, who is the counselor. In the second embodiment, the type of consultation is not particularly limited regardless of medical treatment.

[0099] The configuration of the respondent terminal 3a is the same as that of the doctor terminal 3, and the configuration of the counselor terminal 2a is the same as that of the patient terminal 2. The configuration of the consultation support device 1a in the second embodiment is different from that in the first embodiment in that it does not include some of the configurations provided by the remote medical support device 1 in the first embodiment.

[0100] As shown in FIG. 7, the consultation support device 1a in the second embodiment includes an avatar image specifying processing unit 32 that acquires specific information for specifying the counselor's avatar image from the counselor terminal 2a, an avatar image display data generation processing unit 33 that generates display data for displaying the specified counselor's avatar image, an avatar image output processing unit 34 that outputs the counselor's avatar image generated by the avatar image display data generation processing unit 33 to the respondent terminal 3a, a text information acquisition processing unit 38 that acquires text information input from the respondent terminal 3a, a conversion processing unit 39 that converts the text information into voice information, and a voice information output processing unit 40 that outputs the converted voice information to the counselor terminal 2a.

[0101] Thereby, the counselor can consult the respondent about his / her own state online without showing his / her face to the respondent through a consultation using the counselor's avatar image. The counselor can communicate smoothly without being stressed about the display of his / her face. Furthermore, since the respondent's answer to the consultation is also converted from voice information to text, the counselor can consult about his / her own situation and state without being overly conscious of the respondent's presence.

[0102] Note that, similar to the first embodiment, the consultation support device 1a that supports the counselor and the respondent may also include configurations such as an authentication processing unit 31, a voice information acquisition processing unit 35, an analysis processing unit 36, a patient state output processing unit 37, a face image display request acquisition processing unit 41, a display confirmation request output processing unit 42, a face image display data generation processing unit 43, and a face image display data output processing unit 44. Regarding the additional configurations, it is assumed that the patient in the first embodiment is replaced with the counselor and the doctor is replaced with the respondent. For example, the patient state output processing unit 37 can be a counselor state output processing unit that outputs the state of the counselor.

[0103] In this way, some components of the remote medical support device 1 of the first embodiment can be omitted, or some components can be added to the consultation support device 1a of the second embodiment.

[0104] As described above, the embodiments of the present invention have been described. However, the present invention is not limited to the above-described embodiments, and modifications, improvements, etc. within the scope that can achieve the object of the present invention are included in the present invention.

[0105] For example, the above-described series of processes can be executed by hardware or by software. In other words, the functional configurations of FIGS. 1 to 7 are merely examples and are not particularly limited. That is, it is sufficient that the remote medical support device 1 or the consultation support device 1a is provided with a function capable of executing the above-described series of processes as a whole, and the functional blocks used to realize this function are not particularly limited to the examples of FIGS. 1 to 7. Also, the locations of the functional blocks and the database are not particularly limited to FIGS. 1 to 7 and may be arbitrary. For example, at least a part of the functional blocks and the database required for executing various processes may be transferred to the patient-side terminal 2 (consultant-side terminal 2a), the doctor-side terminal 3 (responder-side terminal 3a), other computers, etc. Conversely, the functional blocks and the database of the patient-side terminal 2 (consultant-side terminal 2a) and the doctor-side terminal 3 (responder-side terminal 3a) may be transferred to a server or the like. Also, one functional block may be configured by hardware alone, by software alone, or by a combination thereof.

[0106] When the series of processes are executed by software, the program constituting the software is installed in a computer or the like from a network or a recording medium. The computer may be a computer incorporated in dedicated hardware. Also, the computer may be a computer capable of executing various functions by installing various programs, for example, a general-purpose smartphone or a personal computer in addition to a server.

[0107] A recording medium containing such a program is not only constituted by a removable medium (not shown) distributed separately from the apparatus main body in order to provide the program to a user or the like, but also constituted by a recording medium or the like provided to the user or the like in a state pre-installed in the apparatus main body.

[0108] In this specification, the steps of describing the program recorded on the recording medium include not only the processes performed in time series in accordance with the order, but also the processes that are not necessarily processed in time series and are executed in parallel or individually. Also, in this specification, the term "system" shall mean the entire apparatus composed of a plurality of devices, a plurality of means, and the like.

Explanation of Reference Numerals

[0109] 1: Remote medical support device, 1a: Counselor support device, 2: Patient-side terminal, 2a: Counselor-side terminal, 3: Physician-side terminal, 3a: Respondent-side terminal, 31: Authentication processing unit, 32: Avatar image identification processing unit, 33: Avatar image display data generation processing unit, 34: Avatar image output processing unit, 35: Voice information acquisition processing unit, 36: Analysis processing unit, 37: Patient state output processing unit, 38: Text information acquisition processing unit, 39: Conversion processing unit, 40: Voice information output, 41: Face image display request acquisition processing unit, 42: Display confirmation request output processing unit, 43: Face image display data generation processing unit, 44: Face image display data output processing unit, 100: Information processing system

Claims

1. an avatar image identification means for acquiring identification information for identifying a patient avatar image from a patient-side terminal; an avatar image display data generating means for generating display data for displaying the identified patient avatar image; an avatar image output means for outputting the patient avatar image generated by the avatar image display data generation means to a doctor's terminal; a voice information acquiring means for acquiring voice information of a patient from the patient-side terminal; an analysis means for analyzing a state of the patient based on the voice information; a patient condition output means for outputting the analyzed patient condition to the doctor's terminal; A text information acquisition means for acquiring text information inputted from the doctor's terminal; A conversion means for converting the text information into audio information; a voice information output means for outputting the converted voice information to the patient side terminal; A remote medical support device equipped with the above-mentioned.

2. The method further includes an authentication means for photographing a face image of the patient and comparing the photographed face image with a face image-bearing personal identification card. The remote medical support device according to claim 1.

3. a facial image display request acquisition means for acquiring a facial image display request from the doctor's terminal; a display confirmation request output means for outputting a request to confirm display of the face image to the patient side terminal when the display request of the face image is acquired; a facial image display data generating means for acquiring the facial image from the patient's terminal when a display confirmation is input from the patient's terminal, and generating display data for the acquired facial image; a facial image display data output means for outputting the display data of the generated facial image to the doctor's terminal; The remote medical support device according to claim 1 , further comprising:

4. a storage unit that stores an identification signal for identifying the patient-side terminal and the patient avatar image in association with each other, the identification information for identifying the patient avatar image includes the identification signal for identifying the patient-side terminal, the avatar image specifying means, upon receiving the identification signal for identifying the patient-side terminal, causes the patient avatar image associated with the identification signal to be displayed on the doctor-side terminal; The remote medical support device according to claim 1.

5. the avatar image display data generating means generates display data for displaying a doctor avatar image; the avatar image output means outputs the doctor avatar image generated by the avatar image display data generation means to the patient-side terminal; the doctor avatar image can be identified by the patient-side terminal, the avatar image specifying means stores an identification signal for identifying the patient-side terminal and the doctor avatar image in association with each other, and determines the doctor avatar image based on the identification signal for identifying the patient-side terminal; The doctor avatar image can be determined based on the performance identified by the patient-side terminal. The remote medical support device according to claim 1.

6. The voice information of the patient includes vocal cord vibration information and speech intonation information, The patient's condition includes the presence or absence of psychiatric and neurological disorders; 6. A remote medical support device according to claim 1.

7. an avatar image specifying means for acquiring, from a client terminal, specification information for specifying a client avatar image; an avatar image display data generating means for generating display data for displaying the specified client avatar image; avatar image output means for outputting the client avatar image generated by the avatar image display data generation means to a respondent terminal; a text information acquiring means for acquiring text information inputted from the respondent terminal; A conversion means for converting the text information into audio information; a voice information output means for outputting the converted voice information to the client terminal; A consultation support device comprising:

Images