Information processing device, terminal, and information processing method

Abstract

To facilitate communication between users and healthcare professionals during face-to-face meetings conducted via a communication network. [Solution] The information processing device 1 communicates with a user terminal 2 used by a user, and also communicates with a medical professional terminal 3 used by a medical professional who conducts an online interview with the user. The device includes a relay unit 131 that transmits image data of the user received from the user terminal 2 to the medical professional terminal 3, a determination unit 132 that determines whether the state of the image data satisfies predetermined conditions, and an acquisition unit 133 that acquires supplementary information, which is information to supplement the image data, when the determination unit 132 determines that the state of the image data satisfies predetermined conditions. The relay unit 131 transmits the supplementary information to the medical professional terminal 3 when the determination unit 132 determines that the state of the image data satisfies predetermined conditions.

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, a terminal, and an information processing method.

Background Art

[0002] A system is disclosed in which a medical worker remotely conducts an interview such as a medical consultation with a user via a communication network such as the Internet (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] When a user and a medical worker conduct an interview via a communication network, there is a problem that communication is more difficult than when the interview is conducted face-to-face in person.

[0005] The present invention has been made in view of these points, and an object of the present invention is to facilitate communication when a user and a medical worker conduct an interview via a communication network.

Means for Solving the Problems

[0006] An information processing device according to a first aspect of the present invention includes: a relay unit that communicates with a user terminal used by a user and with a medical professional terminal used by a medical professional who conducts an online interview with the user, and transmits image data of the user received from the user terminal to the medical professional terminal; a determination unit that determines whether the state of the image shown in the image data satisfies predetermined conditions; and an acquisition unit that, when the determination unit determines that the state of the image shown in the image data satisfies the predetermined conditions, acquires supplementary information which is information to supplement the image data, wherein the relay unit transmits the supplementary information to the medical professional terminal when the determination unit determines that the state of the image shown in the image data satisfies the predetermined conditions.

[0007] If the acquisition unit determines that the image state indicated by the image data satisfies the predetermined conditions, it may request the user terminal to acquire the supplementary information and acquire the supplementary information generated on the user terminal from the user terminal.

[0008] The acquisition unit may input the image data into the large-scale language model and instruct it to generate the supplementary information corresponding to the image data, and acquire the supplementary information output from the large-scale language model.

[0009] The relay unit communicates with the user terminal via a first communication network and with the medical professional terminal via a second communication network, thereby transmitting the image data received from the user terminal to the medical professional terminal. The predetermined condition may include that the image state indicated by the image data indicates that the communication quality of the first communication network is below the predetermined quality.

[0010] The acquisition unit may acquire the supplementary information, which is explanatory information describing the user's state, based on the image data. The determination unit determines whether the image state indicated by the image data received from the medical professional terminal satisfies predetermined conditions. If the determination unit determines that the image state indicated by the image data received from the medical professional terminal satisfies the predetermined conditions, the acquisition unit identifies a predetermined region included in the image data received from the user terminal, and processes the image data to obtain processed image data that includes the identified predetermined region and has a smaller data size than the image data. The relay unit may then transmit the processed image data obtained by the acquisition unit to the medical professional terminal as the image data.

[0011] The acquisition unit may identify the predetermined region included in the image shown by the image data based on the medical questionnaire information showing the user's medical questionnaire, the medical history information showing the user's medical history, or the interview history information showing the interview history.

[0012] The image data shows an image including an image of the user's affected area, and the acquisition unit may identify the user's affected area based on the acquired questionnaire information, medical history information, or interview history information, and identify the predetermined region showing the user's affected area included in the image shown by the image data.

[0013] When the relay unit transmits the processed image data as the image data to the medical professional's terminal, it may also transmit information to the medical professional's terminal indicating that the image data has been processed.

[0014] The relay unit relays information relating to the interview between the user terminal and the terminal used by the user's associates and the medical professional terminal. If the determination unit determines that the image state indicated by the image data satisfies the predetermined conditions, it may reduce the amount of data received from the associate terminal and transmit the data to at least one of the medical professional terminal and the user terminal.

[0015] If the determination unit determines that the image state indicated by the image data satisfies the predetermined conditions, the acquisition unit may acquire the supplementary information, which has a smaller data volume than the image data. The relay unit may transmit the image data and the supplementary information to the medical professional terminal when the determination unit determines that the image state indicated by the image data satisfies the predetermined conditions.

[0016] A terminal according to a second aspect of the present invention is a terminal used by a user, comprising: a medical professional terminal used by a medical professional who conducts an online interview with the user; a transmission unit that transmits image data of the user to an information processing device that relays communication with the terminal; a determination unit that determines whether the state of the image shown by the image data satisfies predetermined conditions; and an acquisition unit that acquires supplementary information, which is information to supplement the image data, when the determination unit determines that the state of the image shown by the image data satisfies the predetermined conditions, wherein the transmission unit transmits the supplementary information to the information processing device when the determination unit determines that the state of the image shown by the image data satisfies the predetermined conditions.

[0017] An information processing method according to a third aspect of the present invention includes the steps of: transmitting image data of the user received from the user terminal to the medical professional terminal by a computer that communicates with a user terminal used by a user and with a medical professional terminal used by a medical professional who conducts an online interview with the user; determining whether the state of the image shown by the image data satisfies predetermined conditions; and, if the computer determines that the state of the image shown by the image data satisfies the predetermined conditions, acquiring supplementary information which is information to supplement the image data, wherein in the transmission step, if the computer determines that the state of the image shown by the image data satisfies the predetermined conditions, it transmits the supplementary information to the medical professional terminal. [Effects of the Invention]

[0018] According to the present invention, an effect is achieved that communication can be facilitated when a user and a medical worker have an interview via a communication network. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] [Figure 1] This is a diagram for explaining an overview of a communication system. [Figure 2] This is a diagram showing the functional configuration of an information processing apparatus. [Figure 3] This is a flowchart showing the flow of processing in which the information processing apparatus transmits image data received from a user terminal to a medical worker terminal. [Figure 4] This is a diagram showing an example of conducting a medical interview that also includes the user's related parties. DETAILED DESCRIPTION OF EMBODIMENTS FOR CARRYING OUT THE INVENTION

[0020] [Overview of Communication System S] Figure 1 is a diagram for explaining an overview of communication system S. The communication system S includes an information processing apparatus 1, a user terminal 2, and a medical worker terminal 3, and is a system for realizing online medical interviews between a user using the user terminal 2 and a medical worker using the medical worker terminal 3.

[0021] The information processing apparatus 1 is a computer for providing an online medical interview service. The user terminal 2 is a terminal capable of wireless communication, such as a personal computer or a smartphone, used by a user who utilizes an online medical service for conducting online interviews with medical workers. For example, by executing an interview application program for the user to conduct medical interviews with medical workers, the user terminal 2 can conduct medical interviews with the medical worker using the medical worker terminal 3.

[0022] The medical professional terminal 3 is a wireless communication-enabled terminal, such as a personal computer or smartphone, used by medical professionals providing online medical services. For example, the medical professional terminal 3 can conduct medical consultations with users on user terminal 2 by running an application program for consultations.

[0023] Medical consultations include, for example, online medical consultations conducted by a doctor (as a healthcare professional) with a user (as a patient), and online medication guidance provided by a pharmacist to a user regarding prescription or over-the-counter medications. In the following explanation, a medical consultation will be referred to as a "medical consultation," and a consultation application will also be referred to as a "consultation app."

[0024] The information processing device 1 relays communication between the user terminal 2 and the medical professional terminal 3 related to medical consultations. Specifically, the information processing device 1 receives image data of the user and audio data representing the user's voice transmitted from the user terminal 2 and transmits them to the medical professional terminal 3. In addition, the information processing device 1 receives image data of the medical professional and audio data representing the medical professional's voice transmitted from the medical professional terminal 3 and transmits them to the user terminal 2.

[0025] The information processing device 1 determines whether the image state indicated by the image data of the user satisfies predetermined conditions. For example, the image state indicated by the image data indicates that the communication quality of the communication between the user terminal 2 and the medical professional terminal 3 is below a predetermined quality. If the information processing device 1 determines that the predetermined conditions are met, it acquires supplementary information, which is information to supplement the image data of the user, and transmits the supplementary information to the medical professional terminal 3.

[0026] In this way, the information processing device 1 can make it easier to view the user's image through supplementary information, even when the communication quality between the user terminal 2 and the medical professional terminal 3 deteriorates, making it difficult for the medical professional to view the user's image. As a result, the information processing device 1 can facilitate communication between the user and the medical professional when they conduct an interview via a communication network.

[0027] [Functional configuration of the information processing device 1] Next, the functional configuration of the information processing device 1 will be described. Figure 2 is a diagram showing the functional configuration of the information processing device 1. The information processing device 1 includes a communication unit 11, a storage unit 12, and a control unit 13.

[0028] The communication unit 11 is a communication interface for sending and receiving data with user terminals 2 and medical personnel terminals 3, as well as external devices such as communication equipment that manages the communication network. The memory unit 12 is a storage medium for storing various types of data, and includes ROM, RAM, and hard disk. The memory unit 12 stores the program to be executed by the control unit 13. The memory unit 12 stores the program that causes the control unit 13 to function as a relay unit 131, a determination unit 132, and an acquisition unit 133.

[0029] The control unit 13 is, for example, a CPU. The control unit 13 functions as a relay unit 131, a determination unit 132, and an acquisition unit 133 by executing a program stored in the memory unit 12.

[0030] The relay unit 131 relays information related to medical consultations between the user terminal 2 and the medical professional terminal 3. The relay unit 131 communicates with the user terminal 2 via a first communication network and also communicates with the medical professional terminal 3, which is used by medical professionals conducting online medical consultations with the user, via a second communication network, thereby relaying information related to consultations between the user terminal 2 and the medical professional terminal 3.

[0031] For example, when the relay unit 131 receives a request from the user terminal 2 to start a medical consultation between the user and a medical professional using the medical professional terminal 3, and also receives a request from the medical professional terminal 3 to start a medical consultation between the medical professional and the user, it begins relaying information related to the medical consultation between the user terminal 2 and the medical professional terminal 3.

[0032] For example, the relay unit 131 receives image data showing an image of the user transmitted by the user terminal 2 and audio data showing the user's voice collected by the user terminal 2 via the first communication network, and transmits the image data and audio data to the medical professional terminal 3 via the second communication network. Similarly, the relay unit 131 receives image data showing an image of the medical professional taken by the medical professional terminal 3 and audio data showing the medical professional's voice collected by the medical professional terminal 3 via the second communication network, and transmits the image data and audio data to the user terminal 2 via the first communication network.

[0033] When the relay unit 131 receives a request to end the medical consultation from the user terminal 2 or the medical professional terminal 3, it terminates the relay of information related to the medical consultation between the user terminal 2 and the medical professional terminal 3.

[0034] The determination unit 132 determines whether the communication quality of the communication between the user terminal 2 and the medical professional terminal 3 is below a predetermined quality. For example, the determination unit 132 determines whether the communication quality of the communication between the user terminal 2 and the medical professional terminal 3 is below a predetermined quality by determining whether at least one of the voice state indicated by the user's voice data received from the user terminal 2 and the image state indicated by the image data of the user satisfies a first condition, which is a predetermined condition. Here, the first condition is that at least one of the voice state indicated by the user's voice data received from the user terminal 2 and the image state indicated by the image data indicates that the communication quality of the first communication network is below a predetermined quality.

[0035] Specifically, first, the determination unit 132 analyzes the image data received from the user terminal 2. Then, using known analysis techniques, the determination unit 132 identifies the degree of edge blurring in the image, and if the identified degree of blurring exceeds a predetermined threshold, it determines that the communication quality of the first communication network is below a predetermined quality, i.e., that the first condition is met. Similarly, the determination unit 132 analyzes the audio and images shown in the user's audio data and image data received from the user terminal 2 using known analysis techniques. Then, the determination unit 132 determines that the communication quality of the first communication network is below a predetermined quality, i.e., that the first condition is met, if the amount of noise per unit time contained in the audio or image shown in the analyzed audio or image data is above a predetermined amount, if the number of interruptions in the audio or image per unit time is predetermined, or if the size of the audio or image is below a predetermined amount. The determination unit 132 determines that the communication quality of the communication between the user terminal 2 and the medical professional terminal 3 is below a predetermined quality if at least one of the voice state indicated by the user's voice data received from the user terminal 2 and the image state indicated by the image data of the user that captured the user satisfies the first condition.

[0036] The determination unit 132 may determine that the communication quality of the communication between the user terminal 2 and the medical professional terminal 3 is below a predetermined quality by determining whether at least one of the voice state indicated by the voice data of the medical professional received from the medical professional terminal 3 and the image state indicated by the image data of the medical professional satisfies the second condition. In this case, the second condition is that at least one of the voice state indicated by the voice data of the medical professional received from the medical professional terminal 3 and the image state indicated by the image data indicates that the communication quality of the second communication network is below a predetermined quality.

[0037] Specifically, the determination unit 132 analyzes the image data received from the medical professional terminal 3 and identifies the degree of edge blurring in the image. If the identified degree of blurring exceeds a predetermined threshold, the determination unit 132 determines that the communication quality of the second communication network is below a predetermined quality, i.e., that the second condition is met. Similarly, the determination unit 132 analyzes the audio and images shown in the audio and image data of the medical professional received from the medical professional terminal 3 using known analysis techniques. If the amount of noise per unit time contained in the audio or image shown in the analyzed audio or image data is above a predetermined amount, if the number of interruptions in the audio or image per unit time is predetermined, or if the size of the audio or image is below a predetermined amount, the determination unit 132 determines that the communication quality of the second communication network is below a predetermined quality, i.e., that the second condition is met. The determination unit 132 determines that the communication quality of the communication between the user terminal 2 and the medical professional terminal 3 is below a predetermined quality if at least one of the voice state indicated by the voice data of the medical professional received from the medical professional terminal 3 and the image state indicated by the image data of the medical professional that captures the medical professional satisfies the second condition.

[0038] Furthermore, if the determination unit 132 detects that the communication quality of the communication between the user terminal 2 and the medical professional terminal 3 is below a predetermined quality if the audio data received and analyzed from the medical professional terminal 3 contains audio indicating poor communication quality related to the medical consultation, such as "difficult to see" or "image is jerky," the determination unit 132 may determine that the communication quality of the communication between the user terminal 2 and the medical professional terminal 3 is below a predetermined quality.

[0039] The acquisition unit 133 acquires supplementary information when the determination unit 132 determines that the communication quality of the communication between the user terminal 2 and the medical professional terminal 3 is below a predetermined quality. Specifically, the acquisition unit 133 acquires supplementary information, which is information to supplement the image data, when the determination unit 132 determines that the image state indicated by the image data received from the user terminal 2 satisfies a first condition. Furthermore, the acquisition unit 133 acquires supplementary information, which is information to supplement the image data received from the user terminal 2, when the determination unit 132 determines that the image state indicated by the image data received from the medical professional terminal 3 satisfies a second condition.

[0040] Here, supplementary information is, for example, information that is smaller in data size compared to image data, and is descriptive information that explains the user's condition based on the image data, such as the user's appearance, mood, emotions, or medical condition as seen in the image data, or the condition of the user's affected area. For example, if the acquisition unit 133 determines that the image state shown by the image data received from the user terminal 2 satisfies the first condition, or if the acquisition unit 132 determines that the image state shown by the image data received from the medical professional terminal 3 satisfies the second condition, it requests the user terminal 2 to acquire supplementary information.

[0041] When user terminal 2 receives a request to obtain supplementary information, it obtains the supplementary information by analyzing the image data it transmits to information processing device 1. User terminal 2 generates, for example, image data and a prompt instructing the large-scale language model to generate descriptive information describing the user's state based on the image data, and inputs the prompt into the large-scale language model. User terminal 2 may also include information indicating the user's symptoms, which it has previously received from the user, in the prompt and input the prompt into the large-scale language model.

[0042] The user terminal 2 then generates supplementary information by acquiring explanatory information output from the large-scale language model. The user terminal 2 transmits the generated supplementary information to the information processing device 1. The acquisition unit 133 acquires the supplementary information generated on the user terminal 2 from the user terminal 2.

[0043] The acquisition unit 133 acquired supplementary information from the user terminal 2, but is not limited to this. The acquisition unit 133 may also input image data acquired from the user terminal 2 into the large-scale language model, instruct it to generate supplementary information corresponding to the image data, and acquire the supplementary information output from the large-scale language model.

[0044] The relay unit 131, when the determination unit 132 determines that the communication quality of the communication between the user terminal 2 and the medical professional terminal 3 is below a predetermined quality, that is, when the determination unit 132 determines that the image state indicated by the image data acquired from the user terminal 2 satisfies the first condition, or when the determination unit 132 determines that the image state indicated by the image data received from the medical professional terminal 3 satisfies the second condition, transmits the supplementary information acquired by the acquisition unit 133 to the medical professional terminal 3.

[0045] For example, if the determination unit 132 determines that the communication quality of the communication between the user terminal 2 and the medical professional terminal 3 is below a predetermined quality, the relay unit 131 transmits the image data and supplementary information to the medical professional terminal 3.

[0046] Alternatively, the relay unit 131 may transmit supplementary information acquired by the acquisition unit 133 to the user terminal 2 instead of transmitting image data. Furthermore, when the acquisition unit 133 acquires supplementary information from the user terminal 2, the relay unit 131 may transmit instruction information to the user terminal 2 to transmit the supplementary information instead of the image data, thereby receiving the supplementary information from the user terminal 2 and not receiving the image data. In this way, the information processing device 1 can reduce the load on the first communication network.

[0047] Furthermore, if the determination unit 132 determines that the communication quality of the communication between the user terminal 2 and the medical professional terminal 3 is below a predetermined quality, and then determines that the communication quality of the communication between the user terminal 2 and the medical professional terminal 3 exceeds the predetermined quality, the relay unit 131 may transmit image data to the medical professional terminal 3 without transmitting supplementary information. In this case, the acquisition unit 133 may choose not to acquire the supplementary information.

[0048] Furthermore, if the medical consultation is related to the diagnosis of eczema or injury on the user's skin, the image data may include images of the affected area of ​​the user. In this case, the acquisition unit 133 may identify a predetermined region included in the image shown by the image data received from the user terminal 2 if the determination unit 132 determines that the state of the image shown by the image data received from the medical professional terminal 3 satisfies the first condition, or if the determination unit 132 determines that the state of the image shown by the image data received from the medical professional terminal 3 satisfies the second condition. Here, the predetermined region may be a region showing an image of the affected area of ​​the user included in the image data.

[0049] For example, the acquisition unit 133 acquires questionnaire information showing the user's questionnaire, medical history information showing the user's medical history, or interview history information showing the interview history at the start or during the start of a medical interview. Then, the acquisition unit 133 identifies the user's affected area based on the acquired questionnaire information, medical history information, or interview history information, and identifies a predetermined region that shows the image of the user's affected area included in the image data received from the user terminal 2. For example, the acquisition unit 133 generates a prompt instructing the large-scale language model to identify a predetermined region from the image data based on, for example, the questionnaire information, medical history information, or interview history information, and inputs the prompt, the questionnaire information, medical history information, or interview history information, and the image data into the large-scale language model. Then, the acquisition unit 133 identifies a predetermined region based on the information indicating the predetermined region output from the large-scale language model.

[0050] When the acquisition unit 133 identifies a predetermined region, it processes the image data received from the user terminal 2 to obtain processed image data that includes the identified predetermined region and has a smaller data volume than the original image data. The acquisition unit 133 may extract a predetermined region from the image shown by the image data received from the user terminal 2 and use the image data showing the extracted predetermined region as the processed image data, or it may generate the processed image data by reducing the data volume of regions other than the predetermined region in the image shown by the image data received from the user terminal 2.

[0051] The relay unit 131 then transmits the processed image data acquired by the acquisition unit 133 to the medical professional terminal 3 as image data received from the user terminal 2. When the relay unit 131 transmits the processed image data to the medical professional terminal 3 as image data, it may also transmit supplementary information to the medical professional terminal 3 indicating that the image data has been processed. In this way, the information processing device 1 can make the medical professional aware that the image data has been processed.

[0052] [Operation Flow] Next, we will explain the processing flow related to the application of communication preferential services in the information processing device 1. Figure 3 is a flowchart showing the processing flow in which the information processing device 1 transmits image data received from the user terminal 2 to the medical professional terminal 3. The processing shown in Figure 3 starts when the interview application is executed on the user terminal 2.

[0053] The relay unit 131 receives image data of the user captured from the user terminal 2 (S1). Next, the determination unit 132 determines whether the communication quality of the communication between the user terminal 2 and the medical professional terminal 3 is below a predetermined quality (S2). If the determination unit 132 determines that the communication quality is below the predetermined quality (YES in S2), it moves to S3; if it determines that the communication quality is not below the predetermined quality (NO in S2), it moves to S5.

[0054] In S3, the acquisition unit 133 acquires supplementary information for the image data received from the user terminal 2. Subsequently, the relay unit 131 transmits the image data received from the user terminal 2 and the supplementary information to the medical professional terminal 3 (S4).

[0055] In S5, the relay unit 131 transmits the image data received from the user terminal 2 to the medical professional terminal 3. Next, the determination unit 132 determines whether the medical consultation has ended (S6). If the determination unit 132 determines that the medical consultation has ended (YES in S6), it terminates the process related to this flowchart. If it determines that the medical consultation has not ended (NO in S6), it moves the process to S1.

[0056] [Example 1] In the embodiment described above, the medical consultation is conducted between the user of user terminal 2 and the medical professional using medical professional terminal 3. However, it is not limited to this, and may also be conducted between the user of user terminal 2 and related parties of the user and the medical professional using medical professional terminal 3. Related parties of the user may be, for example, the user's caregiver or guardian.

[0057] Figure 4 shows an example of a medical consultation that includes the user's associates. As shown in Figure 4, the relay unit 131 relays communication between the user terminal 2, the medical professional terminal 3, and the associate terminal 4 used by the user's associates. Specifically, the relay unit 131 transmits the user's captured image and audio data received from the user terminal 2 to the medical professional terminal 3 and the associate terminal 4. The relay unit 131 also transmits the medical professional's captured image and audio data received from the medical professional terminal 3 to the user terminal 2 and the associate terminal 4.

[0058] Furthermore, the relay unit 131 transmits the captured images and audio data of the person concerned, received from the person concerned terminal 4, to the user terminal 2 and the medical professional terminal 3. When the determination unit 132 determines that the communication quality of the communication between the user terminal 2 and the medical professional terminal 3 is below a predetermined quality, the relay unit 131 reduces the amount of data received from the person concerned terminal 4 transmitted to at least one of the user terminal 2 and the medical professional terminal 3.

[0059] For example, the relay unit 131 degrades the data received from the relevant party terminal 4, that is, reduces the amount of data, and transmits it to at least one of the user terminal 2 and the medical professional terminal 3. Alternatively, the relay unit 131 may reduce the amount of data transmitted to at least one of the user terminal 2 and the medical professional terminal 3 by not transmitting the data received from the relevant party terminal 4 to at least one of the user terminal 2 and the medical professional terminal 3. In this way, in a medical consultation in which relevant parties participate, it is possible to suppress the strain on communication capacity caused by data received from the relevant party terminal 4 of a third party, and to suppress a deterioration in communication quality.

[0060] [Differentiation 2] In the above-described embodiment, the relay unit 131 transmits supplementary information to the medical professional terminal 3 when the determination unit 132 determines that the communication quality of the communication between the user terminal 2 and the medical professional terminal 3 is below a predetermined quality; however, it is not limited to this. The relay unit 131 may also transmit supplementary information to the medical professional terminal 3 when the communication quality of the communication between the user terminal 2 and the medical professional terminal 3 is not below a predetermined quality.

[0061] In this case, for example, the determination unit 132 determines whether the state of the image shown in the image data satisfies predetermined conditions. The predetermined conditions are, for example, that the state of the image shown in the image data is easy for medical professionals to see, and specifically, that the brightness of the image shown in the image data is above a first threshold and below a second threshold. In this way, the information processing device 1 can output supplementary information to the medical professional terminal 3 if the image data received from the user terminal 2 is too bright or too dark and is difficult for medical professionals to see. This makes it easier for medical professionals to understand the state of the user's affected area, etc., as shown in the user's image data.

[0062] [Difference 3] In the above-described embodiment, the determination unit 132 determined whether the communication quality of the communication between the user terminal 2 and the medical professional terminal 3 was below a predetermined quality based on image data received from the user terminal 2, but it is not limited to this. The determination unit 132 may, for example, identify the communication quality such as throughput between the user terminal 2 and the information processing device 1, and the communication quality such as throughput between the medical professional terminal 3 and the information processing device 1. The determination unit 132 may then determine whether the communication quality of the communication between the user terminal 2 and the medical professional terminal 3 is below a predetermined quality by determining whether at least one of these identified communication quality parameters is below a predetermined quality.

[0063] In this case, for example, the determination unit 132 determines whether the state of the image shown in the image data satisfies predetermined conditions. The predetermined conditions are, for example, that the state of the image shown in the image data is easy for medical professionals to see, and specifically, that the brightness of the image shown in the image data is above a first threshold and below a second threshold. In this way, the information processing device 1 can output supplementary information to the medical professional terminal 3 if the image data received from the user terminal 2 is too bright or too dark and is difficult for medical professionals to see. This makes it easier for medical professionals to understand the state of the user's affected area, etc., as shown in the user's image data.

[0064] [Differentiation Example 4] In the above-described embodiment, the information processing device 1 functions as a determination unit 132 and determines whether the image state indicated by the image data transmitted by the user terminal 2 satisfies predetermined conditions, but the invention is not limited to this.

[0065] For example, the control unit of the user terminal 2 may function as the determination unit 132. The user terminal 2 may then determine whether the image state indicated by the image data of the user that it transmits to the information processing device 1 meets predetermined conditions. Alternatively, the control unit of the user terminal 2 may determine whether the image state indicated by the image data received from the medical professional terminal 3 meets predetermined conditions. If the control unit of the user terminal 2 determines that the predetermined conditions are met, it may acquire supplementary information for the image data of the user. In this way, the load on the information processing device 1 is reduced, while facilitating communication between the user and the medical professional when they conduct an interview via a communication network.

[0066] [Effects of Information Processing Device 1] As described above, the information processing device 1 according to this embodiment communicates with a user terminal used by a user, and also communicates with a medical professional terminal 3 used by a medical professional who conducts an online interview with the user. The device transmits image data of the user received from the user terminal 2 to the medical professional terminal 3, and when it determines that the state of the image data meets predetermined conditions, it acquires supplementary information, which is information to supplement the image data, and transmits it to the medical professional terminal 3. In this way, the information processing device 1 can facilitate communication between the user and the medical professional when they conduct an interview via a communication network.

[0067] Furthermore, this invention will make it possible to contribute to Goal 9 of the United Nations-led Sustainable Development Goals (SDGs), "Build resilient infrastructure, promote inclusive and sustainable industrialization and foster innovation."

[0068] Although the present invention has been described above using embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments, and various modifications and changes are possible within the scope of its gist. For example, all or part of the apparatus can be configured by functionally or physically distributing and integrating in any unit. Furthermore, new embodiments resulting from any combination of multiple embodiments are also included in the embodiments of the present invention. The effects of the new embodiments resulting from the combinations are combined with the effects of the original embodiments. [Explanation of symbols]

[0069] 1. Information Processing Device 2 User terminals 3. Medical personnel terminals 4. Related parties' terminals 11 Communications Department 12 Storage section 13 Control Unit 131 Relay Unit 132 Judgment section 133 Acquisition Department

Claims

1. A relay unit that communicates with a user terminal used by the user and with a medical professional terminal used by a medical professional conducting an online interview with the user, thereby transmitting image data of the user received from the user terminal to the medical professional terminal. A determination unit that determines whether the image state shown by the image data satisfies predetermined conditions, When the determination unit determines that the image state indicated by the image data satisfies the predetermined conditions, the acquisition unit acquires supplementary information, which is information to supplement the image data. It has, When the determination unit determines that the state of the image shown in the image data satisfies the predetermined conditions, the relay unit transmits the supplementary information to the medical professional terminal. Information processing device.

2. When the acquisition unit determines that the image state indicated by the image data satisfies the predetermined conditions, it requests the user terminal to acquire the supplementary information and acquires the supplementary information generated on the user terminal from the user terminal. The information processing apparatus according to claim 1.

3. The acquisition unit inputs the image data into the large-scale language model, instructs it to generate the supplementary information corresponding to the image data, and acquires the supplementary information output from the large-scale language model. The information processing apparatus according to claim 1.

4. The relay unit communicates with the user terminal via the first communication network and with the medical professional terminal via the second communication network, thereby transmitting the image data received from the user terminal to the medical professional terminal. The predetermined conditions include the fact that the image state indicated by the image data indicates that the communication quality of the first communication network is below the predetermined quality. The information processing apparatus according to claim 1.

5. The acquisition unit acquires the supplementary information, which is explanatory information describing the user's state, based on the image data. The information processing apparatus according to claim 1.

6. The determination unit determines whether the image state indicated by the image data received from the medical professional's terminal satisfies predetermined conditions. When the acquisition unit determines that the state of the image shown in the image data received from the medical professional terminal satisfies the predetermined conditions, the determination unit identifies a predetermined region included in the image shown in the image data received from the user terminal, and processes the image data to acquire processed image data that includes the identified predetermined region and has a smaller data size than the image data. The relay unit transmits the processed image data acquired by the acquisition unit as image data to the medical professional terminal. The information processing apparatus according to claim 1.

7. The acquisition unit identifies the predetermined region included in the image shown by the image data based on the questionnaire information showing the user's questionnaire, the medical history information showing the user's medical history, or the interview history information showing the interview history. The information processing apparatus according to claim 6.

8. The aforementioned image data shows an image including an image of the affected area of ​​the user. The acquisition unit identifies the affected area of ​​the user based on the acquired questionnaire information, medical history information, or interview history information, and identifies the predetermined region that indicates the affected area of ​​the user included in the image shown by the image data. The information processing apparatus according to claim 7.

9. When the relay unit transmits the processed image data as the image data to the medical professional's terminal, it transmits information to the medical professional's terminal indicating that the image data has been processed. The information processing apparatus according to claim 6.

10. The relay unit relays information related to the interview between the user terminal and the terminal used by the user's associates and the medical professional terminal. When the determination unit determines that the image state indicated by the image data satisfies the predetermined conditions, it reduces the amount of data received from the associate terminal and transmits the data to at least one of the medical professional terminal and the user terminal. The information processing apparatus according to claim 1.

11. When the acquisition unit determines that the image state indicated by the image data satisfies the predetermined conditions, the determination unit acquires the supplementary information, which has a smaller data volume than the image data. The information processing apparatus according to claim 1.

12. When the determination unit determines that the state of the image data shown by the image data satisfies the predetermined conditions, the relay unit transmits the image data and the supplementary information to the medical professional terminal. The information processing apparatus according to claim 1.

13. A device used by the user, A medical professional terminal used by a medical professional conducting an online interview with the user, and an information processing device that relays communication between the terminal and the medical professional, and a transmission unit that transmits image data of the user captured by the medical professional, A determination unit that determines whether the image state shown by the image data satisfies predetermined conditions, When the determination unit determines that the image state indicated by the image data satisfies the predetermined conditions, the acquisition unit acquires supplementary information, which is information to supplement the image data. It has, When the determination unit determines that the state of the image shown by the image data satisfies the predetermined conditions, the transmission unit transmits the supplementary information to the information processing device. Terminal.

14. A computer executes The process involves communicating with a user terminal used by the user, and also communicating with a medical professional terminal used by a medical professional conducting an online interview with the user, thereby transmitting image data of the user received from the user terminal to the medical professional terminal. A step of determining whether the image state shown by the image data satisfies predetermined conditions, When it is determined that the image state shown by the image data satisfies the predetermined conditions, the step is to acquire supplementary information which is information to supplement the image data. It has, In the transmission step, if the computer determines that the image state indicated by the image data satisfies the predetermined conditions, it transmits the supplementary information to the medical professional terminal. Information processing methods.

Images