Server device, display control method and program

The medical device enhances telemedicine systems by converting oral communication to text, detecting keywords, and confirming related information, addressing challenges in emergency medical settings and home nursing programs.

JP7757351B2Active Publication Date: 2025-10-21PHC HLDG CORP
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
JP2023111429
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2023-07-06
Publication Date
2025-10-21
Estimated Expiration
2043-07-06

AI Technical Summary

Technical Problem

In emergency medical settings, telemedicine systems face challenges in accurately sharing information due to unclear audio, multiple locations participating remotely, and difficulties for late-joining doctors to understand conversations, especially in home nursing programs where nurses input information while conversing with doctors.

Method used

A medical device with a communication control unit that processes conversation information, detects predetermined keywords, extracts related information, and displays it as provisional data for confirmation before finalizing as accurate information on both local and remote terminals.

Benefits of technology

Ensures accurate sharing of conversation information by converting oral communication to text, detecting keywords, and confirming related information, enhancing understanding and accuracy in telemedicine systems.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007757351000001
    Figure 0007757351000001
  • Figure 0007757351000002
    Figure 0007757351000002
  • Figure 0007757351000003
    Figure 0007757351000003
Patent Text Reader

Abstract

To provide a technique for sharing conversation information exchanged in a remote medical system.SOLUTION: A server device includes: a communication control unit that controls communication between a first information processing terminal placed at a medical site and a second information processing terminal placed remotely from the medical site; a keyword detection unit that determines whether a predetermined keyword is included in conversation information exchanged between the first information processing terminal and the second information processing terminal, and extracts related information related to the detected keyword; and a display control unit that displays the detected keyword and the related information as provisional information and, upon receiving a confirmation operation, displays the provisional information as confirmed information.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present disclosure relates to a server device, a display control method, and a program. [Background technology]

[0002] Recent advances in information and communication technology have promoted the use of telemedicine. For example, in telemedicine, images of the patient are shared between the hospital where the patient is taken and a hospital located far away from the hospital, and conversations between medical staff at both hospitals are transmitted. Through this type of telemedicine, doctors at the local hospital can provide more appropriate treatment for the patient with the advice of the patient's primary physician and specialists at the remote hospital.

[0003] Known telemedicine tools for realizing such telemedicine include those described in the following documents. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] U.S. Patent No. 10,483,007 Summary of the Invention [Problem to be solved by the invention]

[0005] On the other hand, in emergency medical settings, such as emergency medical care and neonatal care, oral communication is the primary method of communication. When telemedicine systems are used in such settings, ensuring the accuracy of information and sharing it among medical staff can become even more difficult. For example, treatment is often conducted primarily through the conversations of doctors and nurses at the patient's location, making it difficult for doctors at remote locations to confirm the patient's condition and make decisions. Furthermore, if the audio becomes unclear due to the speaker's position or microphone angle, it can become even more difficult for doctors at remote locations to understand the conversation. Furthermore, when multiple locations participate remotely, doctors who join late or who are absent for a short time find it difficult to understand the content of the conversation.

[0006] Furthermore, when a nurse visits a patient's home alone to receive a diagnosis from a remote doctor, such as in a home nursing program, the nurse must converse with the doctor while providing care, which often makes it difficult for the nurse to input information using a keyboard, and diagnosis and advice may be provided through voice communication. This raises concerns that the remote doctor may not be able to accurately grasp the information due to mispronunciations or poor audio quality.

[0007] In view of the above problems, one object of the present disclosure is to provide a technique for sharing conversation information exchanged in a remote medical system. [Means for solving the problem]

[0008] One aspect of the present disclosure is a medical device comprising: a communication control unit that controls communication between a first information processing terminal disposed at a medical site and a second information processing terminal disposed remotely from the medical site; a communication control unit that determines whether a predetermined keyword is included in conversation information exchanged between the first information processing terminal and the second information processing terminal; and a communication control unit that determines whether a predetermined keyword is included in conversation information exchanged between the first information processing terminal and the second information processing terminal, and From the conversation information a keyword detection unit for extracting the detected keywords and the related information as provisional information; The first information processing terminal and the second information processing terminal Display, From the first information processing terminal or the second information processing terminal When a confirmation operation is accepted, the provisional information is set as the confirmed information. The first information processing terminal and the second information processing terminal and a display control unit that displays the information. [Effects of the Invention]

[0009] According to the present disclosure, conversation information exchanged in a remote medical system can be shared. [Brief explanation of the drawings]

[0010] [Figure 1] FIG. 1 is a schematic diagram illustrating a telemedicine system according to one embodiment of the present disclosure. [Figure 2] FIG. 2 is a diagram illustrating patient information shared in a telemedicine system according to an embodiment of the present disclosure. [Figure 3] FIG. 3 is a block diagram illustrating a hardware configuration of a server device according to an embodiment of the present disclosure. [Figure 4] FIG. 4 is a block diagram illustrating a functional configuration of a server device according to an embodiment of the present disclosure. [Figure 5] FIG. 5 is a diagram illustrating registered keyword information according to an embodiment of the present disclosure. [Figure 6] FIG. 6 is a diagram illustrating an example of a screen in a remote medical system according to an embodiment of the present disclosure. [Figure 7] FIG. 7 is a diagram illustrating an example of a screen in a remote medical system according to an embodiment of the present disclosure. [Figure 8] FIG. 8 is a flowchart illustrating a display control process according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings.

[0012] In the following embodiment, a telemedicine system for sharing conversation information between information processing terminals is disclosed.

[0013] [Telemedicine System] A telemedicine system according to an embodiment of the present disclosure will be described with reference to Fig. 1. Fig. 1 is a schematic diagram illustrating a telemedicine system according to an embodiment of the present disclosure.

[0014] 1, the telemedicine system 10 includes an information processing terminal 20, a user terminal 30, and a server device 100. The information processing terminal 20, the user terminal 30, and the server device 100 are communicatively connected via, for example, a network (not shown).

[0015] The information processing terminal 20 is placed, for example, at a medical site where a patient is present, acquires images of the patient and medical staff, conversations uttered by the patient and medical staff, and transmits the acquired images, conversations, etc. to the server device 100. The information processing terminal 20 also receives data acquired from the server device 100 and displays the received data, etc. on a monitor.

[0016] The user terminal 30 is used, for example, by a doctor who is remote from the medical site where the patient is, and provides the remote doctor with images, conversations, etc. received from the information processing terminal 20 via the server device 100 via a monitor and speaker. The user terminal 30 also transmits speech, messages, etc. sent by the remote doctor to the server device 100.

[0017] The server device 100 exchanges information between the information processing terminal 20 and the user terminal 30, as described in detail below. In the following embodiment, the server device 100 acquires voice information of a conversation between a patient, doctor, nurse, etc., of the information processing terminal 20 and a doctor (e.g., a primary care physician, a specialist, etc.) of the user terminal 30. For example, the server device 100 may perform voice recognition on the acquired voice information and detect whether a predetermined keyword is included in the acquired conversation information as a recognition result of text data. When a predetermined keyword is detected in the acquired conversation information, the server device 100 extracts related information related to the detected keyword and displays the extracted related information as provisional information. For example, when "body temperature" is detected in the conversation information as a predetermined keyword, the server device 100 detects a numerical value corresponding to the body temperature from the context before and after "body temperature" in the conversation information and displays the detected numerical value together with "body temperature" as related information on the information processing terminal 20 and the user terminal 30 as provisional information. Then, when a confirmation operation for the displayed provisional information is received, the server device 100 displays the keyword and related information on the information processing terminal 20 and the user terminal 30 as confirmed information.

[0018] For example, in the example shown in FIG. 2, keywords such as "body temperature," "weight," "blood pressure," "breathing," "tracheal intubation," and "age in weeks" can be detected. Then, as information related to "body temperature" and "tracheal intubation," "36.0°C" and "yes" are displayed as confirmed information. Also, as information related to "weight" and "age in weeks," "2,200g" and "30 weeks" are displayed as provisional information, waiting for a confirmation operation by the user.

[0019] As a result, conversation information exchanged orally between the medical staff at the site where the information processing terminal 20 is located and a remote advisor, specialist, etc. is displayed as text data on the screen, enabling the conversation information to be shared. Also, keywords and related information automatically extracted by the server device 100 are initially displayed as provisional information, and are then displayed as final information after confirmation by the user. This allows the keywords and related information to be shared as accurate information.

[0020] Here, the server device 100 is realized by any type of computing device, information processing device, etc., and may have, for example, a hardware configuration as shown in Fig. 3. That is, the server device 100 has a drive device 101, a storage device 102, a memory device 103, a processor 104, a user interface (UI) device 105, and a communication device 106, which are interconnected via a bus B.

[0021] Programs or instructions for implementing various functions and processes described below in the server device 100 may be stored on a removable storage medium such as a CD-ROM (Compact Disk-Read Only Memory) or flash memory. When the storage medium is inserted into the drive device 101, the programs or instructions are installed from the storage medium to the storage device 102 or the memory device 103 via the drive device 101. However, the programs or instructions do not necessarily have to be installed from the storage medium; they may be downloaded from an external device via a network or the like. The storage device 102 is implemented by a hard disk drive or the like and stores installed programs or instructions as well as files, data, etc. used to execute the programs or instructions. The memory device 103 is implemented by a random access memory, static memory, etc. and, when a program or instruction is activated, reads and stores the program, instruction, data, etc. from the storage device 102. The storage device 102, the memory device 103, and the removable storage medium may be collectively referred to as a non-transitory storage medium.

[0022] The processor 104 may be realized by one or more central processing units (CPUs), graphics processing units (GPUs), processing circuitry, etc., each of which may be composed of one or more processor cores, and executes various functions and processes of the server device 100 (described below) in accordance with programs, instructions, and data such as parameters required to execute the programs or instructions stored in the memory device 103. The user interface (UI) device 105 may be composed of input devices such as a keyboard, mouse, camera, and microphone, output devices such as a display, speaker, headset, and printer, and input / output devices such as a touch panel, and implements an interface between a user and the server device 100. For example, a user operates the server device 100 by manipulating a graphical user interface (GUI) displayed on a display or touch panel using a keyboard, mouse, etc. The communication device 106 is realized by various communication circuits that execute communication processes with external devices and communication networks such as the Internet and a local area network (LAN).

[0023] However, the above-described hardware configuration is merely an example, and the server device 100 according to the present disclosure may be realized by any other appropriate hardware configuration.

[0024] [Server device] Next, a server device 100 according to an embodiment of the present disclosure will be described. Fig. 4 is a block diagram showing a functional configuration of the server device 100 according to an embodiment of the present disclosure. As shown in Fig. 4, the server device 100 includes a communication control unit 110, a keyword detection unit 120, and a display control unit 130. For example, one or more functional units of the communication control unit 110, the keyword detection unit 120, and the display control unit 130 may be realized by one or more processors 104 executing one or more programs or instructions.

[0025] The communication control unit 110 controls communication between the information processing terminal 20 placed at the medical site and the user terminal 30 placed remotely from the medical site. For example, when the communication control unit 110 receives video information, audio information, text information, etc. from the information processing terminal 20 and the user terminal 30, it transmits the received video information, audio information, text information, etc. to the information processing terminal 20 and the user terminal 30 in any one format such as a video conference, an online conference, or a chat, or in a combination of any two or more formats.

[0026] Here, the communication control unit 110 may perform speech recognition on voice information received from the information processing terminal 20 and the user terminal 30, for example, conversation information exchanged orally between the user of the information processing terminal 20 and the user terminal 30, and convert the conversation information into text information. Furthermore, the communication control unit 110 may convert text information received from the information processing terminal 20 and the user terminal 30, for example, text information such as advice sent by the user of the user terminal 30, into voice information, and provide the information processing terminal 20 with not only text information but also voice information.

[0027] The keyword detection unit 120 determines whether predetermined keywords are included in the conversation information exchanged between the information processing terminal 20 and the user terminal 30, and extracts related information related to the detected keywords. For example, in the case of perinatal care, keywords may be terms related to a patient's vital signs, medical history, treatment, etc., such as "age after birth," "weight," "blood pressure," "breathing," "tracheal intubation," and "infectious disease," and may be registered in advance by a user, etc. Furthermore, the related information may be a numerical value for each keyword (e.g., "30 weeks" for "age after birth" and "36.0°C" for "body temperature"), an answer (e.g., "yes" or "no" for "tracheal intubation"), etc.

[0028] The registered keywords may be registered in the registered keyword information as shown in FIG. 5, for example. In the illustrated example, "weeks after birth" is registered as the keyword number "#001," and it is registered that the value of "weeks after birth" is expressed in units of "weeks." Furthermore, "weight" is registered as the keyword number "#002," and it is registered that the value of "weight" is expressed in units of "g." Similarly, keywords such as "body temperature," "blood pressure," "respiration," "tracheal intubation," and "infectious disease," along with the numerical unit of each keyword or answer candidates such as "yes" or "no," may be registered in the registered keyword information. Furthermore, a priority may be set for each keyword, as shown in the figure.

[0029] For example, when conversation information exchanged between information processing terminal 20 and user terminal 30 includes the content "The baby is 30 weeks old," the keyword detection unit 120 detects "the baby is 30 weeks old" as a keyword and may extract "30 weeks old" as related information using the "weeks" corresponding to the "the baby is 30 weeks old" registered in the registered keyword information as a clue. Similarly, the keyword detection unit 120 may extract related information such as numerical values ​​and answers corresponding to each keyword included in the conversation information.

[0030] The display control unit 130 displays the detected keywords and related information as provisional information, and upon receiving a confirmation operation, displays the provisional information as final information. Specifically, upon acquiring keywords included in conversation information and related information corresponding to the keywords, the display control unit 130 may first display the acquired keywords and related information as provisional information in text format on the information processing terminal 20 and the user terminal 30. That is, the keywords and related information are acquired by speech recognition and word detection by the server device 100, and there is a possibility of misrecognition and / or misdetection. For this reason, the acquired keywords and related information may be adopted as final information only after being approved by the user.

[0031] After the keywords and related information are displayed as provisional information on the monitors of the information processing terminal 20 and the user terminal 30, the display control unit 130 may display the displayed provisional information as confirmed information upon receiving a confirmation operation that the provisional information is correct. For example, in the example screen shown in FIG. 2, "body temperature" and "tracheal intubation" are displayed as confirmed information upon receiving a confirmation operation. On the other hand, "weight" and "number of weeks old" have not received a confirmation operation and are displayed as provisional information. At this time, the display control unit 130 may highlight (for example, blink) the provisional information to prompt the user to confirm the provisional information.

[0032] Here, the confirmation operation may be a touch operation on the monitor screen of the information processing terminal 20 or the user terminal 30. For example, when a touch operation is performed on the provisional information displayed on the monitor screen of the information processing terminal 20 or the user terminal 30, the display control unit 130 may determine that the provisional information has been approved. On the other hand, when a slide operation or the like is performed on the provisional information displayed on the monitor screen of the information processing terminal 20 or the user terminal 30, the display control unit 130 may determine that the provisional information has been rejected. In this case, the display control unit 130 may request the information processing terminal 20 and the user terminal 30 to re-input.

[0033] Alternatively, the confirmation operation may be a voice operation on the information processing terminal 20 or the user terminal 30. For example, if "30 weeks old" is displayed as provisional information, and an affirmative voice response such as "30 weeks old is fine" is received from the user, the display control unit 130 may determine that the provisional information has been approved. On the other hand, if an unaffected voice response such as "The baby is not 30 weeks old" is received, the display control unit 130 may determine that the provisional information has been rejected and request re-entry into the information processing terminal 20 and the user terminal 30. Furthermore, when confirming "30 weeks old," the display control unit 130 may highlight "30 weeks old" on the monitor screen of the information processing terminal 20 and / or the user terminal 30.

[0034] Here, when the detected keyword is transmitted from the information processing terminal 20, the display control unit 130 may be configured to accept a confirmation operation from the information processing terminal 20. That is, the display control unit 130 may be configured to be able to accept a confirmation operation for the provisional information of the keyword and the related information from the information processing terminal 20 or the user terminal 30 of the user who uttered the keyword and the related information, and may not be configured to accept a confirmation operation from a terminal other than the utterance side.

[0035] In one embodiment, the display control unit 130 may associate the detected keywords with related information and display them on the information processing terminal 20 and the user terminal 30. For example, the display control unit 130 may display each detected keyword and related information together with an image of the patient and an image of the participating doctor so that the correspondence between each keyword and the related information of the keyword can be understood. Also, as shown in the figure, provisional information may be displayed with "(provisional)" and final information may be displayed with "(final)". Furthermore, provisional information may be highlighted, such as by flashing, to prompt a finalization operation.

[0036] For example, the display control unit 130 may display keywords and related information according to a set display mode. For example, if the conversation information includes "age 30 weeks, tracheal intubation completed, weight 2,200 g, body temperature 36.0°C," the display control unit 130 may display the keywords and related information in chronological order of the utterances. For example, the display control unit 130 may display keywords that were uttered more recently at the top (live mode). In this case, for the above-mentioned conversation information, the display control unit 130 may display "body temperature 36.0°C (confirmed)," "weight 2,200 g (tentative)," "tracheal intubation yes (confirmed)," and "age 30 weeks (confirmed)" from the top of the keyword screen on a keyword screen showing keywords and related information, as shown in FIG. 6.

[0037] Alternatively, the display control unit 130 may display keywords and related information in accordance with priority. For example, the display control unit 130 may display keywords with higher priority at the top (priority mode). Here, the priority of each keyword may be set in the registered keyword information. In the example shown in FIG. 5, "age after birth" has the highest priority A, "weight" and "tracheal intubation" have the next highest priority B, and "body temperature" has the next highest priority C. According to this priority, the display control unit 130 may display "age after birth: 30 weeks (confirmed)," "weight: 2,200 g (tentative)," "tracheal intubation: yes (confirmed)," and "body temperature: 36.0°C (confirmed)" on the keyword screen from the top, as shown in FIG. 7. Furthermore, keywords with high priority and related information may be highlighted.

[0038] The display control unit 130 may further determine the display order of each keyword and related information according to a frequency mode and a history mode. The frequency mode displays keywords detected more frequently in conversation information at a higher position, while the history mode may display keywords in chronological order of the conversation progress. The display control unit 130 may also display only predetermined keywords and their related information (registration mode), or may display general medical terms that appear in the conversation information in addition to the predetermined keywords and their related information (general medical terminology mode). The user of the information processing terminal 20 and the user terminal 30 may set which display mode to use.

[0039] The displayed keywords and related information may be highlighted by user operations of the information processing terminal 20 and the user terminal 30. The information processing terminal 20 and the user terminal 30 do not necessarily need to display the same screen. For example, the information processing terminal 20 may display a patient image in a relatively small size, and the keyword screen in a relatively large size. On the other hand, the user terminal 30 may display a patient image in a relatively large size, and the keyword screen in a relatively small size.

[0040] Furthermore, keywords may be changed depending on the patient's symptoms and the type of disease. Furthermore, conversation information is not necessarily limited to audio information, and may be input as text information. For example, the information processing terminal 20 or the user terminal 30 may be muted, and conversation information may be input via a keyboard. Furthermore, the speaker may be identified in the conversation information, and the identified speaker may be displayed. For example, in FIGS. 6 and 7, an image of the speaking doctor is displayed with a black frame. This makes it possible to clearly identify the questioner and the answerer. Furthermore, the communication control unit 110 may perform control so that a confirmation operation is not performed on the content of a question asked by a questioner based on the utterance of the questioner.

[0041] [Display control processing] Next, a display control process according to an embodiment of the present disclosure will be described. Fig. 8 is a flowchart showing the display control process according to an embodiment of the present disclosure. The display control process is executed by the above-described server device 100, and more specifically, may be realized by one or more processors 104 of the server device 100 executing one or more programs or instructions stored in one or more memory devices 103.

[0042] 8, in step S101, the server device 100 acquires conversation information. For example, the conversation information may be conversation information in a voice format indicating a conversation exchanged between the information processing terminal 20 and the user terminal 30. For example, the server device 100 may perform voice recognition on the conversation information and acquire text data of the utterance included in the conversation information.

[0043] In step S102, the server device 100 determines whether the conversation information includes a predetermined keyword. Specifically, the server device 100 refers to registered keyword information in which the keyword to be extracted is registered, and determines whether the conversation information includes the keyword registered in the registered keyword information. If the keyword is detected in the conversation information (S102: YES), the display control process proceeds to step S103, and if the keyword is not detected in the conversation information (S102: NO), the display control process returns to step S101.

[0044] In step S103, the server device 100 displays the detected keyword and related information as provisional information. Specifically, the server device 100 extracts a numerical value or a response related to the detected keyword from the conversation information, associates the keyword with the related information, and displays the associated information as provisional information on the information processing terminal 20 and the user terminal 30. Thereafter, the server device 100 waits for a confirmation operation on the keyword and related information.

[0045] In step S104, the server device 100 determines whether a confirmation operation has been received. If a confirmation operation has been received (S104: YES), the display control process proceeds to step S105. If a confirmation operation has not been received (S104: NO), the display control process continues to wait for a confirmation operation.

[0046] In step S105, the server device 100 displays the keyword and the related information as confirmed information. When the keyword and the related information are determined as confirmed information, medical staff using the information processing terminal 20 and the user terminal 30 can provide medical treatment, advice, and treatment based on the confirmed confirmed information.

[0047] The server device 100 and the display control process described above enable more accurate information sharing between on-site medical staff and remote doctors by displaying oral utterances in the medical field as text data. Note that while the above-described embodiment has been described focusing on on-site medical staff and remote doctors, the present disclosure is not limited thereto and may be operated by patients, their family members, etc.

[0048] In addition, the following supplementary notes are provided in relation to the above description. (Appendix 1) a communication control unit that controls communication between a first information processing terminal placed in a medical site and a second information processing terminal placed remotely from the medical site; a keyword detection unit that determines whether a predetermined keyword is included in conversation information exchanged between the first information processing terminal and the second information processing terminal, and extracts information related to the detected keyword; a display control unit that displays the detected keyword and the related information as provisional information, and, upon receiving a confirmation operation, displays the provisional information as confirmed information; A server device having: (Appendix 2) The server device according to claim 1, wherein the display control unit associates the detected keyword with the related information and displays the associated information on the first information processing terminal and the second information processing terminal. (Appendix 3) 3. The server device according to claim 1, wherein the related information indicates a numerical value or an answer related to the keyword. (Appendix 4) A server device described in any one of Appendices 1 to 3, wherein if the detected keyword is sent from the first information processing terminal, the display control unit accepts the confirmation operation from the first information processing terminal. (Appendix 5) A server device as described in any one of Appendices 1 to 4, wherein the confirmation operation includes at least one of a touch operation on a monitor screen of the first information processing terminal or the second information processing terminal and a voice operation on the first information processing terminal or the second information processing terminal. (Appendix 6) 6. The server device according to any one of appendices 1 to 5, wherein the display control unit displays the keyword and the related information in accordance with a set display mode. (Appendix 7) 7. The server device of claim 6, wherein the display mode is selected from a live mode, a priority mode, a frequency mode, a history mode, a registration mode, and a medical terminology mode. (Appendix 8) Acquiring conversation information communicated between a first information processing terminal located at a medical site and a second information processing terminal located remotely from the medical site; determining whether a predetermined keyword is included in the conversation information and extracting information related to the detected keyword; displaying the detected keyword and the related information as provisional information, and when a confirmation operation is received, displaying the provisional information as confirmed information; A display control method performed by a computer. (Appendix 9) Acquiring conversation information communicated between a first information processing terminal located at a medical site and a second information processing terminal located remotely from the medical site; determining whether a predetermined keyword is included in the conversation information and extracting information related to the detected keyword; displaying the detected keyword and the related information as provisional information, and when a confirmation operation is received, displaying the provisional information as confirmed information; A program that causes a computer to execute the following.

[0049] Although the examples of the present disclosure have been described in detail above, the present disclosure is not limited to the specific embodiments described above, and various modifications and variations are possible within the scope of the gist of the present disclosure as set forth in the claims. [Industrial Applicability]

[0050] The present disclosure is useful for telemedicine systems. [Explanation of symbols]

[0051] 10 Telemedicine System 20 Information processing terminal 30 User terminals 100 Server device 110 Communication control unit 120 Keyword detection section 130 Display control unit

Claims

1. a communication control unit that controls communication between a first information processing terminal placed at a medical site and a second information processing terminal placed remotely from the medical site; a keyword detection unit that determines whether a predetermined keyword is included in conversation information exchanged between the first information processing terminal and the second information processing terminal, and extracts information related to the detected keyword from the conversation information; a display control unit that displays the detected keyword and the related information as provisional information on the first information processing terminal and the second information processing terminal, and, when a confirmation operation is received from the first information processing terminal or the second information processing terminal, displays the provisional information as confirmed information on the first information processing terminal and the second information processing terminal; A server device having:

2. The server device according to claim 1 , wherein the display control unit associates the detected keyword with the related information and displays the associated information on the first information processing terminal and the second information processing terminal.

3. The server device according to claim 1 , wherein the related information indicates a numerical value or an answer related to the keyword.

4. The server device according to claim 1 , wherein, when the detected keyword is transmitted from the first information processing terminal, the display control unit accepts the confirmation operation from the first information processing terminal.

5. 2. The server device according to claim 1, wherein the confirmation operation includes at least one of a touch operation on a monitor screen of the first information processing terminal or the second information processing terminal, and a voice operation on the first information processing terminal or the second information processing terminal.

6. The server device according to claim 1 , wherein the display control unit displays the keyword and the related information in accordance with a set display mode.

7. The server device according to claim 6 , wherein the display mode is selected from a live mode, a priority mode, a frequency mode, a history mode, a registration mode, and a medical terminology mode.

8. Acquiring conversation information communicated between a first information processing terminal located at a medical site and a second information processing terminal located remotely from the medical site; determining whether the conversation information includes a predetermined keyword, and extracting information related to the detected keyword from the conversation information; displaying the detected keyword and the related information as provisional information on the first information processing terminal and the second information processing terminal, and when a confirmation operation is received from the first information processing terminal or the second information processing terminal, displaying the provisional information as confirmed information on the first information processing terminal and the second information processing terminal; A display control method performed by a computer.

9. Acquiring conversation information communicated between a first information processing terminal located at a medical site and a second information processing terminal located remotely from the medical site; determining whether the conversation information includes a predetermined keyword, and extracting information related to the detected keyword from the conversation information; displaying the detected keyword and the related information as provisional information on the first information processing terminal and the second information processing terminal, and when a confirmation operation is received from the first information processing terminal or the second information processing terminal, displaying the provisional information as confirmed information on the first information processing terminal and the second information processing terminal; A program that causes a computer to execute the following.

Citation Information

Patent Citations

  • Speech recognition device and program for the same

    JP2002215184A

  • Method of accumulating voice memo relating to schedule

    JP2016195428A

  • Guidance support device, guidance support system, and program

    JP2022022129A

  • Medical care system including online medical care

    JP2023048799A

  • JPP6987417B