Program, image management device and online medical treatment system

Abstract

To allow for introducing an online medical care system without having to add new PC and monitor, and for using the online medical care system on a device other than a device with an electronic medical record system.SOLUTION: A corporative program for an online medical care system provided herein makes a control unit of an image management device perform a display step for displaying a face image of a patient captured by an image capturing unit of a user terminal and a medical image(s) stored in a storage unit of the image management device on a display unit of the image management device.SELECTED DRAWING: Figure 5

Description

[Technical field]

[0001] The present invention relates to a program, an image management device, and an online medical examination system. [Background technology]

[0002] Due to the spread of the new coronavirus, patients refraining from visiting hospitals as a result, and the government's temporary relaxation of online medical consultations, online medical consultations are becoming more common. To realize online medical consultations, PCs (Personal Computers) and monitors for online consultations are required.

[0003] Meanwhile, medical facilities are equipped with electronic medical record systems and image management systems for managing medical images, such as those described in Patent Document 1. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2014-139722 A Summary of the Invention [Problem to be solved by the invention]

[0005] Small clinics have limited space, so there is also limited space available for installing the PC for the electronic medical record system and the image management device for the image management system. Therefore, adding new PCs and monitors when introducing an online medical treatment system creates problems such as taking up space and being expensive.

[0006] In addition, when displaying the patient's face image for online medical consultation on the PC of the electronic medical record system, the electronic medical record system is used frequently, which makes operation inconvenient. For example, since the electronic medical record system contains a lot of medical information, it is necessary to enlarge the window of the electronic medical record system, but in that case, there is a possibility that the patient's face image will be hidden behind the window of the electronic medical record system. For this reason, there is also a desire to use the online medical consultation system on a device separate from the electronic medical record system.

[0007] The objective of the present invention is to make it possible to introduce an online medical consultation system without adding a new PC or monitor, and to make it possible to use the online medical consultation system on a device separate from the electronic medical record system. [Means for solving the problem]

[0008] In order to solve the above problems, the program according to the present invention comprises: An online medical treatment system in which a patient's user terminal having an imaging unit, an image management device having a storage unit for storing medical images and a display unit for displaying the medical images, are connected via a network. A program to be executed by a computer of the system, a display step of displaying, on the display unit of the image management device, a face image of the patient photographed by the photographing unit of the user terminal and the medical image stored in the storage unit of the image management device; Run the command, The medical image is At least one of an X-ray image, a CT image, an MRI image, and an ultrasound image It is.

[0010] Further, the image management device according to the present invention comprises: An image management device that is connected to a user terminal of a patient having an imaging unit via a network, and has a storage unit that stores medical images and a display unit that displays the medical images, a display control means for displaying, on the display unit of the image management device, a facial image of a patient photographed by the photographing unit of the user terminal and the medical image stored in the storage unit of the image management device; Equipped with The medical image is At least one of an X-ray image, a CT image, an MRI image, and an ultrasound image It is.

[0011] In addition, the online medical treatment system according to the present invention comprises: An online medical consultation system in which a patient's user terminal having an imaging unit and an image management device having a storage unit for storing medical images and a display unit for displaying the medical images are connected via a network, The facial image of the patient captured by the imaging unit of the user terminal and the facial image of the image management device a display control means for displaying the medical images stored in a storage unit on the display unit of the image management device; Equipped with The medical image is At least one of an X-ray image, a CT image, an MRI image, and an ultrasound image It is. Effect of the Invention

[0020] According to the present invention, it is possible to introduce an online medical examination system without adding a new PC or monitor. Also, it is possible to use the online medical examination system on a device separate from the electronic medical record system. [Brief description of the drawings]

[0021] [Figure 1] 1 is a diagram illustrating an example of the overall configuration of an online medical consultation system. [Diagram 2] 2 is a block diagram showing a functional configuration of the image management device of FIG. 1. [Diagram 3] 2 is a block diagram showing the functional configuration of the user terminal of FIG. 1. [Figure 4A] FIG. 13 is a diagram showing the flow of online medical consultation processing. [Figure 4B] FIG. 13 is a diagram showing the flow of online medical consultation processing. [Diagram 5] FIG. 4B is a diagram showing an example of a screen display on a display unit of an image management device in step S11 of FIG. 4A. [Figure 6] FIG. 4B is a diagram showing another example of the screen display of the display unit of the image management device in step S11 of FIG. 4A. [Figure 7]FIG. 4C is a diagram showing an example of a screen display on a display unit of a user terminal in step S18 of FIG. 4B. [Figure 8] 13 is a diagram showing a schematic diagram of a screen displayed on a display unit of the image management device when an affected area still image capturing button is pressed; FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0022] Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings, however, the scope of the present invention is not limited to the illustrated examples.

[0023] (Configuration of online medical treatment system) Fig. 1 is a diagram showing an example of the overall configuration of an online medical consultation system 100 according to an embodiment of the present invention. Online medical consultation is conducted using two or more terminals, and involves mutual transmission of video (images) and audio between a doctor and a patient. As shown in Fig. 1, the online medical consultation system 100 is configured by connecting an image management device 1 that stores and manages patient information including medical images, and a user terminal 2 used by a patient via a communication network N (network) so that data can be transmitted and received. That is, the image management device 1 and the user terminal 2 are connected to each other via the communication network N so that they can communicate with each other bidirectionally, and can share processing information related to, for example, network connection and disconnection, image sharing, and the like, bidirectionally. The number of user terminals 2 is not particularly limited.

[0024] (Image Management Device Configuration) The image management device 1 is a device that stores and manages patient information including medical images, such as a PACS (Picture Archiving and Communication System). Medical images are images used in the medical field (images of the results of photographing or measuring the human body), and include X-ray images, MRI images, CT images, etc., but may also be images in the widely used JPEG, GIF, etc., such as images of patients photographed by a user terminal 2. The image management device 1 also has a function for performing online medical examinations with the user terminal 2.

[0025] Fig. 2 is a block diagram showing the functional configuration of image management device 1. As shown in Fig. 2, image management device 1 is configured with control unit 11, storage unit 12, operation unit 13, display unit 14, communication unit 15, audio input unit 16, audio output unit 17, shooting unit 18, etc., and each unit is connected by bus 19.

[0026] The control unit 11 is configured to include a CPU (Central Processing Unit), a RAM (Random Access Memory), etc. The CPU of the control unit 11 reads out the system program and various processing programs stored in the storage unit 12 in response to an operation of the operation unit 13, expands them in the RAM, and executes various processes according to the expanded programs.

[0027] The memory unit (storage unit) 12 is composed of a non-volatile semiconductor memory, a hard disk, etc. The memory unit 12 stores (keeps) system programs, various processing programs (application programs), parameters required for executing the programs, data such as processing results, etc. Each program is stored in the form of readable program code, and the control unit 11 sequentially executes operations according to the program codes.

[0028] In this embodiment, the storage unit 12 stores an online medical examination program 121, an examination management program 122, a linking program 123, and the like as application programs.

[0029] The online medical consultation program 121 is an application program for realizing online medical consultation with the user terminal 2. The online medical consultation program 121 includes, for example, a program for causing the control unit 11 to execute the operation of the online medical consultation program 121 described below.

[0030] The examination management program 122 is an application program for storing and managing patient information including medical images. The examination management program 122 includes, for example, a program for causing the control unit 11 to execute the operation of the examination management program 122 described below.

[0031] The linking program 123 is a program for linking the online medical consultation program 121 and the examination management program 122. The linking program 123 includes, for example, a program for causing the control unit 11 to execute the operation of the linking program 123 described below.

[0032] The online medical consultation program 121, the examination management program 122, and the linking program 123 constitute a program that causes the control unit 11 to execute the display step, the storage step, and the second display step recited in the claims.

[0033] The image DB 124 is a database that stores (keeps) medical images in association with patient attribute information and examination information of the patient who is the subject of the image. The image DB 124 includes a patient master that stores (keeps) patient attribute information of registered patients that is associated with medical images. Here, patient information is information about a patient, and includes patient attribute information, medical images, examination information, etc. Patient attribute information is information for identifying a patient, and includes patient ID, name, date of birth, gender, etc. Examination information is information about an examination, and includes information for identifying the examination, such as examination ID, examination date and time, modality (CT, DR, CR, US, MRI, general-purpose camera, etc.), examination area, examination purpose, series number, image number, etc., as well as information generated in relation to the examination, such as image interpretation (medical care) reports, schema information, and diagnosis results. Furthermore, medical images and patient attribute information and examination information corresponding to medical images are collectively referred to as medical information.

[0034] The reservation DB 125 is a database that stores reservation information for online medical treatment. The reservation DB 125 includes a user information master that stores user information (user ID, name, date of birth, sex, contact information, etc.) of registered patients. Here, the reservation information includes a reservation ID, a user ID, a name, a date of birth, a gender, contact information, a reservation date and time, a purpose of the examination, and the like.

[0035] Furthermore, the storage unit 12 stores an online medical consultation program 221 on the user terminal 2 side.

[0036] The operation unit 13 is configured with a keyboard equipped with cursor keys, numeric input keys, various function keys, etc., and a pointing device such as a mouse, and outputs instruction signals input by key operations on the keyboard or mouse operations to the control unit 11. The operation unit 13 may also be equipped with a touch panel on the display screen of the display unit 14, and in this case, outputs instruction signals input via the touch panel to the control unit 11.

[0037] The display unit 14 is composed of a monitor such as an LCD (Liquid Crystal Display) or a CRT (Cathode Ray Tube), and displays input instructions and data from the operation unit 13 according to instructions of a display signal input from the control unit 11.

[0038] The communication unit 15 transmits and receives data to and from external devices via a communication network N, such as a local area network (LAN), a wide area network (WAN), or the Internet.

[0039] The voice input unit 16 is constituted by a microphone or the like, and converts voice into an electrical signal and inputs it. The audio output unit 17 is composed of a speaker, earphones, etc., and outputs audio to the outside. The image capturing unit 18 is configured with a web camera equipped with a CCD (Charge Coupled Device) or the like, and captures video and still images.

[0040] (User device configuration) The user terminal 2 is not particularly limited as long as it is a terminal used by a patient, and may be a general-purpose device connected to the communication network N and equipped with a display capable of displaying medical images, a video device such as a webcam capable of performing medical treatment, and an audio device such as a microphone. For example, it may be a portable terminal such as a notebook PC (Personal Computer), a mobile phone, or a smartphone, or a stationary device such as a desktop PC.

[0041] Fig. 3 is a block diagram showing the functional configuration of the user terminal 2. As shown in Fig. 3, the user terminal 2 is configured to include a control unit 21, a storage unit 22, an operation unit 23, a display unit 24, a communication unit 25, an audio input unit 26, an audio output unit 27, an image capturing unit 28, etc., and each unit is connected via a bus 29.

[0042] The control unit 21 is configured to include a CPU (Central Processing Unit), a RAM (Random Access Memory), etc. In response to an operation of the operation unit 23, the CPU of the control unit 21 reads out a system program and various processing programs (application programs) stored in the storage unit 22, expands them in the RAM, and executes various processes according to the expanded programs.

[0043] The storage unit 22 is composed of a non-volatile semiconductor memory, a hard disk, etc. The storage unit 22 stores system programs, various processing programs (application programs), parameters required for executing the programs, data such as processing results, etc. Each program is stored in the form of readable program code, and the control unit 21 sequentially executes operations according to the program codes.

[0044] In this embodiment, the storage unit 22 stores an online medical consultation program 221 downloaded from the image management device 1 as an application program.

[0045] The online medical consultation program 221 is an application program for accessing the image management device 1 via the communication network N and realizing online medical consultation at the user terminal 2. The online medical consultation program 221 includes, for example, a program for causing the control unit 11 to execute the operation of the online medical consultation program 221 described below. For example, it includes a linking program 221a for causing the display unit 24 to display a shared image (described in detail later) transmitted from the image management device 1 via the communication unit 25 and operation information showing operations on the image management device 1.

[0046] The operation unit 23 is configured with a keyboard equipped with cursor keys, numeric input keys, various function keys, etc., and a pointing device such as a mouse, and outputs instruction signals input by key operations on the keyboard or mouse operations to the control unit 21. The operation unit 23 may also be equipped with a touch panel on the display screen of the display unit 24, and in this case, outputs instruction signals input via the touch panel to the control unit 21.

[0047] The display unit 24 is composed of a monitor such as an LCD (Liquid Crystal Display) or a CRT (Cathode Ray Tube), and displays input instructions and data from the operation unit 23 according to instructions of a display signal input from the control unit 21.

[0048] The communication unit 25 transmits and receives data to and from external devices via a communication network N such as a LAN, a WAN, or the Internet.

[0049] The voice input unit 26 is constituted by a microphone or the like, and converts voice into an electrical signal and inputs it. The audio output unit 27 is configured with a speaker, earphones, etc., and outputs audio to the outside. The image capturing unit 28 is configured with a web camera equipped with a CCD (Charge Coupled Device) or the like, and captures video and still images.

[0050] (Online medical treatment system operation) Next, the operation of the online medical consultation system 100 will be described. The operation of the online medical consultation program 221 described below is realized by cooperation between the control unit 21 of the user terminal 2 and the online medical consultation program 221. The operation of the online medical consultation program 121 is realized by cooperation between the control unit 11 of the image management device 1 and the online medical consultation program 121. The operation of the examination management program 122 is realized by cooperation between the control unit 11 of the image management device 1 and the examination management program 122. The operation of the linkage program 123 is realized by cooperation between the control unit 11 of the image management device 1 and the linkage program 123.

[0051] When a patient wishes to receive online medical care, the patient starts the online medical care program 221 by the operation unit 23 in the user terminal 2. When the online medical care program 221 is started, the online medical care program 221 displays a menu screen in a window allocated to the online medical care program 221 on the display unit 24.

[0052] When user registration is selected from the menu screen, the online medical treatment program 221 displays a user registration screen on the display unit 24 and accepts input of user registration information related to the patient (user), such as name, date of birth, sex, and contact information, and transmits the input user registration information to the image management device 1 via the communication unit 25 to issue a user registration request. When the online medical treatment program 121 of the image management device 1 receives a user registration request and user registration information from the user terminal 2 via the communication unit 15, it issues a user ID for identifying the user (patient), associates the user ID with the user registration information, and registers it as user information in the user information master of the reservation DB 125, and transmits the user ID and a registration completion notice to the online medical treatment program 221 of the user terminal 2 via the communication unit 15. When the online medical treatment program 221 of the user terminal 2 receives the user ID and the registration completion notice from the image management device 1 via the communication unit 25, it displays the received information on the display unit 24 and stores the user ID and user registration information in the storage unit 22.

[0053] When "reserve medical treatment" is selected from the menu screen, the online medical treatment program 221 displays a reservation screen on the display unit 24, accepts input of user information such as user ID and name, reservation information such as reservation date and time, and purpose of consultation, and transmits the input reservation information to the image management device 1 via the communication unit 25 to request a medical treatment reservation. When the online medical treatment program 121 of the image management device 1 receives a request for a medical treatment reservation and reservation information from the user terminal 2 via the communication unit 15, it issues a reservation ID for identifying the reservation, associates the reservation ID with the reservation information and registers it in the reservation DB 125, and also transmits the reservation ID and a reservation completion notice to the user terminal 2 via the communication unit 15. When the control unit 21 of the user terminal 2 receives the reservation ID and reservation completion notice from the image management device 1, it displays the received information on the display unit 24, stores the reservation ID and reservation information in the storage unit 22, and ends the reservation process.

[0054] When "visit a medical appointment" is selected from the menu screen, the online medical consultation program 221 displays a list of appointment information (appointment ID, appointment date and time, etc.) on the display unit 24, and when the appointment information for the appointment to be visited is selected using the operation unit 23, the online medical consultation program 221 accesses the image management device 1 via the communication unit 25 and executes the operations of the online medical consultation program 221 for the online medical consultation processing shown in Figures 4A to 4B.

[0055] 4A and 4B are diagrams showing the flow of the online medical treatment process executed by the online medical treatment system 100. As shown in FIG.

[0056] In the image management device 1, the link program 123 can cause the control unit 11 to execute processing for specifying in advance, before connection to the user terminal 2 via the network, the display range and display method of the medical information to be transmitted to and displayed on the user terminal 2 in the online medical consultation processing, in response to the operation of the operation unit 13. The display range of the medical information includes the display area of ​​the medical image and the range of medical information to be displayed together with the medical image (items to be displayed, etc.). The display method of the medical information that can be specified includes, for example, a display method equivalent to the hanging protocol of the PACS (for example, the number of medical images to be displayed, arrangement, magnification, inversion, rotation, etc.), and display items on the medical image (overlay character information, annotation information, etc.). The display range of the medical image that can be specified includes the display area of ​​the medical image, and narrowing down the medical images to be displayed according to conditions (modality, site, series number, image number, etc.). In addition, a display method for making the doctor and the patient recognize it in the same way, such as highlighting the clicked part (making it bold, changing the color, blinking), may be included. The display range of the medical information other than the medical image that can be specified includes display items such as patient attribute information, examination information, and medical institution information, and display items and display parts of graphs and tables such as diagnosis and interpretation reports and schema information of the examination information, diagnosis results, and vital data. The information of the specified display range and display method (called shared specification information) is stored in the storage unit 12.

[0057] Hereinafter, the flow of the online medical treatment process executed in the online medical treatment system 100 will be described with reference to Figs. 4A and 4B. The online medical consultation program 221 of the user terminal 2 transmits the reservation ID of the reservation designated by the operation unit 23 to the image management device 1 to request for online medical consultation (step S1).

[0058] In the image management device 1, when the communication unit 15 receives the reservation ID and the request for online medical consultation from the user terminal 2, the online medical consultation program 121 searches the reservation DB 125 for reservation information corresponding to the reservation ID sent from the user terminal 2, and if reservation information corresponding to the reservation ID and whose reservation date and time is within a predetermined range from the current time is present in the reservation DB 125, it waits for the input of an instruction to start online medical consultation (an instruction to permit consultation) by the operation unit 13 (i.e., by the doctor) (step S2). Note that if there is no reservation information corresponding to the reservation ID and whose reservation date and time is within a predetermined range from the current time, a notification such as "There is no corresponding reservation" is sent to the user terminal 2, and the online medical consultation process is terminated.

[0059] When the operation unit 13 instructs the start of online medical consultation (step S2; YES), the online medical consultation program 121 establishes a network connection with the user terminal 2 (step S3) and notifies the link program 123 of the start of online medical consultation (step S4).

[0060] Next, the online medical consultation program 121 displays an online medical consultation screen 141 (see FIG. 5) for displaying an image of the patient (e.g., a facial image) in a window allocated for the online medical consultation program 121 on the screen of the display unit 14, and starts a video call with the user terminal 2 (step S5). That is, the display of the video (patient image) transmitted from the user terminal 2 on the online medical consultation screen 141, the output of the patient's voice transmitted from the user terminal 2 from the audio output unit 17, and the transmission of the image captured by the imaging unit 18 (such as the doctor's face) and the voice input by the audio input unit 16 (the doctor's voice) to the user terminal 2 are started.

[0061] When a network connection with the image management device 1 is established in the user terminal 2, the online medical consultation program 221 displays an online medical consultation screen 241 for displaying images of the doctor, etc., on the display unit 24, and starts a video call with the image management device 1 (step S6).

[0062] In addition, when a network connection with the user terminal 2 is established in the image management device 1, the online medical consultation program 121 obtains user information corresponding to the received reservation ID (i.e., user information of the patient who is the user of the user terminal 2) from the user information master of the reservation DB 125 and outputs it to the linkage program 123 (step S7).

[0063] When the link program 123 acquires the user information from the online medical consultation program 121, it associates the acquired user information with the patient information of the patient of the user terminal 2 in the image management device 1 (step S8).

[0064] Here, in step S8, the user information and the patient information are associated with each other by any one of the following (1) to (3). (1) The name, date of birth, sex, and contact information items of the user information are compared with the corresponding items of each patient information (e.g., patient attribute information in the patient master) in the image DB 124, and patient information that matches the acquired user information in a predetermined number of items or more is extracted as candidate patient information. Next, the candidate patient information is displayed on the display unit 14, and one piece of patient information is selected from the candidate patient information using the operation unit 13 (by the operator). The selected patient information is then associated with the user information. (2) A table associating user information and patient information of the same patient is created in advance and stored in the memory unit 12, the table is referred to to acquire the patient information stored in association with the acquired user information, and the acquired patient information is associated with the user information. In the case of (2), for example, when the user is registered, the user information and patient information are associated with each other and stored in a table using the method of (3). (3) The name, date of birth, sex, and contact information of the user information are compared with the corresponding items of each patient information (for example, patient attribute information of the patient master) of the image DB 124, and the patient information in which the predetermined items are the same as or most similar to the user information (the number of matching items is the largest) is associated with the user information. Note that an input screen for inputting whether or not to associate the patient information with the user information by the operation unit 13 (by the operator) may be displayed on the display unit 14 to display the patient information in which the predetermined items are the same as or most similar to the user information, and the operator may confirm the display. For example, in order to clearly show the operator the points to be checked, a list may be displayed that compares the names, dates of birth, sex, etc. of the user information and the patient information, or a method may be used that does not allow the operator to overlook (always check) the information to be checked on the screen, such as highlighting, enlarging, or displaying the information by color or sound, without using a separate screen. In the above (1) to (3), as an example of associating user information with patient information, an example of associating user information with patient attribute information has been given, but as another example, for example, user information may be associated with a medical image, or user information may be associated with supplementary information included in a medical image.

[0065] Next, the linkage program 123 outputs the patient information associated with the user information in step S8 to the examination management program 122, and instructs the program to limit the information to be displayed to the medical information contained in the patient information while a network connection with the user terminal 2 is established (prohibiting the display of medical information, including medical images, contained in patient information that is not associated with the user information) (step S9). For example, the examination management program 122 prohibits display of patient information that is not associated with user information in the patient list or examination list displayed on the display unit 14. This makes it possible to prevent doctors from selecting the wrong patient and suppresses mistakes in selecting patients. Also, for example, medical images included in patient information that is not associated with user information are prohibited from being displayed on the display unit 14. This makes it possible to prevent doctors from making mistakes in selecting medical images and suppress mistakes in selecting patients. It is preferable to prohibit the network connection for the entire time that the network connection is established, but the prohibition may be applied for at least a part of the period.

[0066] Next, the linkage program 123 causes the examination management program 122 to display a viewer screen 142 on the display unit 14 in a window for the examination management program 122 allocated on the screen of the display unit 14, in which medical information including medical images included in the patient information associated with the user information in step S8 is displayed (step S10).

[0067] The examination management program 122 searches and reads out medical information, including the medical images of the latest examination and the examination information of the medical images, contained in the patient information associated with the user information in step S8, from the image DB 124, and displays the viewer screen 142 on which the medical information including the medical images is displayed on the display unit 14 (step S11: display step). The displayed medical images include images of the affected area captured by the user terminal 2 during a past online medical consultation.

[0068] Fig. 5 shows an example of the screen display of the display unit 14 displayed in step S11 of Fig. 4A. As shown in Fig. 5, the display unit 14 displays an online medical consultation screen 141 displaying a facial image of the patient who is the user of the user terminal 2, and a viewer screen 142 displaying medical images (including medical information) of the patient on the same screen. This allows a doctor to refer to the medical images while performing online medical consultation. In addition, the linking program 123 displays the online medical consultation screen 141 displaying the facial image of the patient and the viewer screen 142 displaying the medical images of the patient in different areas on the same screen, thereby preventing the medical images and the facial image of the patient from overlapping on the screen, thereby improving user convenience.

[0069] In addition, the linking program 123 may instruct the examination management program 122 to display the face image on the online medical consultation screen 141 and the medical image on the viewer screen 142 in such a manner that at least a part of them overlap with each other in step S10. This allows the attention area of ​​the medical image to be displayed large and easy to see. In addition, the linking program 123 may instruct the examination management program 122 to display the face image of the patient on the online medical consultation screen 141 only in the medical image display area 142a of the viewer screen 142, as shown in FIG. 6, for example. This prevents the face image of the patient from being hidden even if the doctor widens the range of the window on which the viewer screen 142 is displayed in order to display the medical image in a larger size, thereby improving user convenience.

[0070] Next, the linkage program 123 acquires the display information of the viewer screen 142 and area information (coordinates) of each piece of information displayed on the viewer screen 142 from the examination management program 122 (step S12), and deletes (for example, cuts out or paints black) unnecessary information other than the information in the display range specified by the sharing designation information of the viewer screen 142 with reference to the sharing designation information stored in the storage unit 12, and generates image data of a shared image corresponding to the display range specified by the sharing designation information (step S13). At this time, the shared image is generated by deleting unnecessary information other than the information in the display range specified by the sharing designation information so that items other than the sharing designation information are not displayed to the patient, but the unnecessary information other than the information in the display range specified by the sharing designation information may be displayed to the doctor. Therefore, the information displayed on the viewer screen 142 of the display unit 14 may be continued to be displayed as it is, including the unnecessary information, without replacing it with a shared image. In this case, the unnecessary information on the viewer screen 142 may be made identifiable as an item not displayed to the patient by lightening the color or attaching a mark or the like. The linkage program 123 then outputs image data of the shared image to the online medical consultation program 121, and instructs the online medical consultation program 121 to transmit the image data of the shared image to the user terminal 2 (step S14). The linkage program 123 also instructs the online medical consultation program 121 to prohibit transmission of medical information, including medical images not included in the patient information associated with the user information in step S8, to the user terminal 2 while a network connection is established with the user terminal 2, and to prohibit (prohibit storage of) recording and screen copying (screen capture) of the shared image in the user terminal 2 (step S15). It is preferable to prohibit the network connection for the entire time that the network connection is established, but the prohibition may be applied for at least a part of the period.

[0071] When the online medical consultation program 121 receives the shared image from the collaboration program 123, it transmits the shared image to the user terminal 2 via the communication unit 15 (step S16), and instructs the user terminal 2 to prohibit recording and screen copying of the shared image while a network connection with the image management device 1 is established (step S17). In step S17, for example, the link program 221a of the user terminal 2 is instructed to hide the record button and the screen copy button displayed on the display unit 24, and to disable the screen capture function of the OS.

[0072] In the user terminal 2, when the shared image and the instruction to prohibit recording and copying the screen are received from the image management device 1 via the communication unit 25, the online medical consultation program 221 displays the shared image on the online medical consultation screen 241 of the display unit 24 (step S18). In addition, the recording button and the screen copy button are hidden, and the screen capture function is turned off to prevent recording and copying the screen (step S19). In step S18, security warning information to the effect that recording and screen copying are prohibited may be displayed in advance on the screen of the user terminal 2, or an operational warning to the effect that recording and image copying functions will be unavailable for a certain period of time may be displayed. In conjunction with this display, the user may be asked to perform an operation to obtain consent, and after the operation is performed, the display may transition to step S18, or the prohibition control may transition to step S19.

[0073] In this way, the link program 123 associates the user information of the patient using the user terminal 2 with the patient information of the patient, reads out medical information including medical images included in the patient information associated with the user information from the image DB 124, and transmits the read medical information including medical images as a shared image to the user terminal 2. In addition, the online medical consultation program 121 is prohibited from transmitting medical information including medical images not included in the patient information associated with the user information of the patient using the user terminal 2 to the user terminal 2. This makes it possible to prevent information of another patient from being shown to the user of the user terminal 2 due to a patient mistake, thereby resolving security issues. Furthermore, since the shared image displayed on the user terminal 2 displays only information within a pre-specified display range, it is possible to prevent unnecessary information that should not be shown to the patient from being displayed. In addition, while a network connection with the image management device 1 is established, the user terminal 2 is prohibited from recording or copying the screen, i.e., the medical information displayed on the user terminal 2 is prohibited from being stored in the user terminal 2. Therefore, even if there is an error in associating user information with patient information, it is possible to prevent information of another patient from being stored in the user terminal 2.

[0074] Fig. 7 is a diagram showing an example of a screen display displayed in step S18 on the display unit 24. As shown in Fig. 7, the user terminal 2 displays a shared image, that is, an online medical consultation screen 241 displaying medical information of a patient who is the user of the user terminal 2.

[0075] The doctor observes the medical information displayed on the viewer screen 142 and uses the operation unit 13 to operate, for example, the parts of the medical information that are findings (for example, by specifying an area with a pointer or annotation, etc.) and provides explanations to the patient. The patient observes the medical information displayed on the display unit 24 and uses the operation unit 23 to operate, for example, the part of the medical information about which the patient wants to ask a question (for example, by specifying the part with a pointer or by specifying an area with an annotation, etc.) and ask the doctor a question.

[0076] The collaboration program 123 monitors operations on the viewer screen 142 performed by the operation unit 13, and when it detects an operation of the operation unit 13 on the medical information displayed on the viewer screen 142 of the display unit 14 (for example, designating an area using a pointer or an annotation, etc.), it identifies the operation performed, generates operation information of the identified operation (position information (coordinates) on the shared image corresponding to the operated position and the operation content), outputs it to the online medical consultation program 121, and instructs the display of drawing information indicating the identified operation at the corresponding position of the shared image displayed on the display unit 24 of the user terminal 2 (step S20). Here, the link program 123 detects the operation of the operation unit 13 on the medical information displayed on the viewer screen 142 of the display unit 14, for example, by using area information (coordinates) of each piece of information displayed on the viewer screen 142 acquired in step S12, and identifies the performed operation (the operated position in the medical information and the operation content). Also, by using the shared image generated in step S13, it identifies position information on the shared image of the position corresponding to the position operated by the operation unit 13.

[0077] The online medical consultation program 121 transfers the operation information input from the collaboration program 123 to the user terminal 2 via the communication unit 15, and instructs the display of drawing information at a position corresponding to the position information of the shared image displayed on the display unit 24 of the user terminal 2 (step S21).

[0078] When the user terminal 2 receives the operation information transmitted from the image management device 1 via the communication unit 25, the collaboration program 221a generates drawing information indicating the operation performed on the image management device 1 based on the operation information, and displays the drawing information at a position corresponding to the above-mentioned position information on the shared image displayed on the display unit 24 (step S22).

[0079] Meanwhile, in the user terminal 2, the collaboration program 221a monitors operations on the shared image (medical information) displayed on the display unit 24 by the operation unit 23, and when it detects an operation of the operation unit 23 on the shared image (for example, designation using a pointer or designation of an area using an annotation, etc.), it generates operation information of the performed operation (operated position information (coordinates) and operation content) and transmits it to the image management device 1 via the communication unit 25 (step S23).

[0080] In the image management device 1, when the communication unit 15 receives the operation information transmitted from the user terminal 2, the online medical consultation program 121 transfers the received operation information to the link program 123 (step S24). When the operation information transmitted from the user terminal 2 is transferred from the online medical consultation program 121, the linking program 123 identifies the operation performed on the shared image in the user terminal 2 and a position on the medical information displayed on the viewer screen 142 corresponding to the operation position in the user terminal 2 based on the transferred operation information, generates drawing information indicating the identified operation, outputs it to the examination management program 122 together with the identified position information, and instructs the display of the drawing information at the identified position (step S25). The examination management program 122 displays the drawing information indicating the operation performed on the user terminal 2 on the medical information displayed on the viewer screen 142 according to the instruction of the linking program 123 (step S26).

[0081] In online medical care, if the doctor and the patient cannot share the designated parts on the medical information (particularly the medical image), it is assumed that it is difficult to verbally explain the problem part and its shape to the patient who has little medical knowledge, and it is even more difficult to answer verbal questions from the patient about the medical information (particularly the medical image). However, in this embodiment, drawing information according to the doctor's operation on the medical information is displayed on the medical information of the user terminal 2, and drawing information according to the patient's operation on the medical information is displayed on the medical information of the image management device 1, so that the doctor's explanation becomes smoother and the patient's understanding can be improved. It also becomes possible for the doctor to accurately understand questions from the patient.

[0082] The operations of steps S20 to S22 described above are performed each time an operation is performed on the medical information displayed on the display unit 14 by the operation unit 13. Also, the operations of steps S23 to S26 are performed each time an operation is performed on the medical information displayed on the display unit 24 by the operation unit 23.

[0083] Furthermore, on the viewer screen 142, it is possible to switch the medical image to be displayed to a medical image taken on a different date and time, or to switch to display multiple images for comparative reading. Each time the medical image is switched, medical information including the switched and displayed medical image may be shared with the user terminal 2. For example, the linkage program 123 detects switching of display of medical images by the operation unit 13 using area information (coordinates) of each piece of information displayed on the viewer screen 142 acquired from the examination management program 122. Then, when a switching instruction is detected, as described above, the linkage program 123 may acquire the display information of the viewer screen 142, area information (coordinates) of each piece of information displayed on the viewer screen 142, and the displayed medical image from the examination management program 122 to generate a shared image, and cause the online medical consultation program 121 to display the shared image on the user terminal 2.

[0084] When the operation unit 13 instructs the online medical consultation to end, the online medical consultation program 121 disconnects the network connection with the user terminal 2 via the communication unit 15 (step S27). In addition, the online medical consultation screen 141 is closed (step S28), and the link program 123 is notified of the end of the online medical consultation (step S29). When the linkage program 123 is notified of the end of the online medical consultation, it instructs the examination management program 122 to release the patient restriction (step S30).

[0085] The examination management program 122, in accordance with an instruction from the link program 123, removes the restriction on patients to be displayed (step S31).

[0086] When the network connection is cut off, the online medical consultation program 221 of the user terminal 2 closes the online medical consultation screen 241 (step S32) and releases the prohibition on recording and copying the screen (step S33).

[0087] As described above, the linkage program 123 causes the control unit 11 to execute a display step of displaying, on the display unit 14 of the image management device 1, the patient's facial image captured by the imaging unit 28 of the user terminal 2 and the medical image stored in the storage unit (memory unit 12) of the image management device 1. Therefore, since the image management device 1 can display the patient's facial image in addition to the medical image, it is possible to introduce an online medical treatment system without adding a new PC or monitor. Also, since the online medical treatment system can be used on a device other than the electronic medical record system, the patient's facial image will not be hidden behind the electronic medical record window even if the window of the electronic medical record containing a large amount of information is enlarged. Also, when performing online medical treatment while viewing medical images, displaying the patient's facial image for online medical treatment on the image management device 1 has the advantage of making it easier to meet the patient's gaze compared to displaying it on a terminal other than the image management device 1.

[0088] For example, by displaying a medical image and an image of a patient's face on the same screen, a doctor can refer to the medical image while providing online medical care. Furthermore, by displaying the medical image and the patient's facial image in separate areas on the same screen, the medical image and the patient's facial image do not overlap on the screen, improving user convenience.

[0089] Furthermore, by displaying the medical image and the patient's facial image on the same screen with at least a portion of them overlapping, it is possible to display a larger area of ​​interest in the medical image. Furthermore, by displaying the patient's face image only within the display area of ​​the medical image, even if a doctor expands the area of ​​the window displaying the viewer screen 142 in order to display a larger medical image, the patient's face image is prevented from being hidden, thereby improving user convenience.

[0090] During online medical consultation in the online medical consultation process, the linkage program 123 may display, for example, a face image capture button 143a, an affected area still image capture button 143b, and an affected area video capture button 143c in a predetermined area of ​​the display unit 14 (see FIG. 8). In response to pressing of the face image capture button 143a, the affected area still image capture button 143b, and the affected area video capture button 143c, the linkage program 123 may perform the following operations in cooperation with the control unit 11.

[0091] For example, when the face image capture button 143a is pressed by the operation unit 13, an image of the patient (image captured by the capture unit 28) displayed on the online medical consultation screen 141 of the display unit 14 at that timing is acquired from the online medical consultation program 121. Then, the acquired image of the patient is sent to the examination management program 122, and the examination management program 122 stores, for example, the image of the patient in the patient master of the image DB 124 in association with the patient attribute information of the patient information associated with the user information in step S8 (storage step). This function allows the facial image of the patient to be stored in the storage unit 12, so that, for example, when the patient ID and patient name are displayed on the display unit 14 by the examination management program 122 at a later date (for example, when performing the above-mentioned steps S10 to S11), the facial image of the patient can be read out from the image DB 124 and displayed next to them. As a result, it is possible to prevent the image management device 1 from mistaking a patient for another.

[0092] Also, for example, when the affected area still image capturing button 143b is pressed by the operation unit 13, the image of the patient (e.g., an image of the affected area of ​​the patient captured by the imaging unit 28) displayed on the online medical consultation screen 141 of the display unit 14 at that timing is fixedly displayed on the online medical consultation program 121, and the image is acquired from the online medical consultation program 121. Then, the acquired image of the patient is transmitted to the examination management program 122, and the examination management program 122 associates the image of the patient with the patient attribute information and examination information (e.g., imaging date (examination date), modality (general-purpose camera), etc.) included in the patient information associated with the user information in step S8, and stores the image in the image DB 124 as a medical image (storage step), and also reads out an image of the same patient captured in the online medical consultation in the past from the image DB 124 and displays it in the medical image display area 142a of the viewer screen 142 (second display step). FIG. 8 is a diagram showing a schematic view of a screen displayed on the display unit 14 when the affected area still image capture button 143b is pressed. With this function, for example, a doctor can instruct a patient to face the affected area to the lens of the imaging unit 28 and press the affected area still image capture button 143b to display an image of the affected area currently and an image of the affected area captured previously side by side on the display unit 14, making it possible to compare the current condition of the affected area with the previous condition of the affected area. In addition, an image of the patient's affected area captured during online medical care is stored in the image DB 124, so that it can be read out from the image DB 124 as a previous image during a later online medical care and displayed on the display unit 14 side by side with the image of the affected area captured on the same day for comparison.

[0093] Also, for example, when the affected area video capture button 143c is pressed by the operation unit 13, the image of the patient (image captured by the imaging unit 28) displayed on the online medical consultation screen 141 of the display unit 14 is acquired from the online medical consultation program 121 until the affected area video capture button 143c is pressed again. Then, the acquired video of the patient is displayed on the online medical consultation screen 141 by the online medical consultation program 121. Also, the examination management program 122 associates the video of the patient with the patient attribute information and examination information (e.g., imaging date (examination date), modality) included in the patient information associated with the user terminal 2 in step S8 and stores it in the image DB 124 as a medical image (storage step), and also reads out a video of the same patient captured in the online medical consultation in the past from the image DB 124 and displays it in the medical image display area of ​​the viewer screen 142 (second display step). With this function, for example, a doctor can instruct a patient to move the affected area facing the lens of the imaging unit 28 and press the affected area video capture button 143c, thereby displaying a current video image of the affected area and a previously captured video image of the affected area side by side on the display unit 14, making it possible to compare the current movement of the affected area with the past movement of the affected area. In addition, since an image of the patient's affected area captured during online medical care is stored in the image DB 124, it can be read out from the image DB 124 as a past image during a later online medical care and displayed on the display unit 14 side by side with the image of the affected area captured on the same day for comparison.

[0094] An example of an embodiment of the present invention has been described above, but the description of the above embodiment is a preferred example of the online medical consultation system according to the present invention, and the present invention is not limited to this.

[0095] For example, in the above embodiment, the linking program 123 has been described as causing the control unit 11 of the image management device 1 to execute each step of the present invention, but the computer of the present invention may be a computer such as a server or a PC that is separate from the image management device 1. Also, a cloud server or the like may be used for the image management device 1, or only processing programs such as the online medical treatment program and the linking program may be placed in a virtual space such as a cloud or on a network, and various information (including images) managed in a local environment may be exchanged via communication.

[0096] The linking program 123 may be included in the online medical consultation program 121 or the examination management program 122. Alternatively, the online medical consultation program 121, the examination management program 122, and the linking program 123 may be configured as one program, or each may be configured as multiple programs.

[0097] Furthermore, the display unit of image management device 1 may be integrated with the main body of image management device 1, or may be separate. In the above embodiment, the user terminal 2 transmits a reservation ID when making a request to receive online medical care, but instead of the reservation ID, user information such as a user ID may be transmitted to the image management device 1. Then, the online medical care program 121 searches the reservation DB 125 for reservation information corresponding to the user information transmitted from the user terminal 2, and if reservation information corresponding to the user information and having a reservation date and time within a predetermined range from the current time is present in the reservation DB 125, it may wait for an instruction to start online medical care (an instruction to permit consultation) to be input by the operation unit 13 (i.e., by the doctor).

[0098] In addition, the specific details of the configuration, control content, order, and the like shown in the above embodiment can be modified as appropriate without departing from the spirit of the present invention. [Explanation of symbols]

[0099] 100 Online medical treatment system 1 Image management device 11 Control section 12 Storage section 121 Online Medical Treatment Program 122 Inspection Management Program 123 Collaborative Programs 13 Control section 14 Display section 15 Communications Department 16 Audio input section 17 Audio output section 18. Photography Department 19 Bus 2 User terminal 21 Control section 22 Memory section 221 Online Medical Treatment Program 221a Collaborative Program 23 Control section 24 Display 25 Communications Department 26 Audio input section 27 Audio output section 28 Photography Department 29 Bus

Claims

1. A program to be executed by a computer of an online medical care system in which a patient's user terminal having an imaging unit, and an image management device having a storage unit for storing medical images and a display unit for displaying the medical images are connected via a network, a display step of displaying, on the display unit of the image management device, a face image of the patient photographed by the photographing unit of the user terminal and the medical image stored in the storage unit of the image management device; Run the command, The medical image is at least one of an X-ray image, a CT image, an MRI image, and an ultrasound image.

2. 2. The program according to claim 1, wherein said display step displays said medical image and said facial image on the same screen.

3. 3. The program according to claim 2, wherein said display step displays said medical image and said facial image in different areas on said same screen.

4. 3. The program according to claim 2, wherein said display step displays said medical image and said facial image on the same screen with at least a portion of them overlapping each other.

5. 5. The program according to claim 4, wherein said display step displays said face image only within a display area of ​​said medical image.

6. a storage step of storing, in the storage unit, an image of the patient taken by the imaging unit of the user terminal; The program according to any one of claims 1 to 5, further comprising causing the computer to execute the steps of:

7. 7. The program according to claim 6, wherein said display step displays, on said display unit, the image of said patient stored in said storage unit.

8. 8. The program according to claim 6, wherein the image of the patient is a facial image.

9. 8. The program according to claim 6, wherein the image of the patient is an image of an affected area.

10. a second display step of displaying, on the display unit, the image of the affected area of ​​the patient photographed by the photographing unit and the medical image stored in the storage unit; The program according to claim 1 , further comprising:

11. 11. The program according to claim 1, wherein the display step is executed by a Picture Archiving and Communication System (PACS).

12. An image management device that is connected to a user terminal of a patient having an imaging unit via a network, and has a storage unit that stores medical images and a display unit that displays the medical images, a display control means for displaying, on the display unit of the image management device, a facial image of a patient photographed by the photographing unit of the user terminal and the medical image stored in the storage unit of the image management device; Equipped with The medical image is at least one of an X-ray image, a CT image, an MRI image, and an ultrasound image.

13. An online medical consultation system in which a patient's user terminal having an imaging unit and an image management device having a storage unit for storing medical images and a display unit for displaying the medical images are connected via a network, a display control means for displaying, on the display unit of the image management device, a facial image of a patient photographed by the photographing unit of the user terminal and the medical image stored in the storage unit of the image management device; Equipped with The medical image is at least one of an X-ray image, a CT image, an MRI image, and an ultrasound image.

Images