Medical information processing system and medical information processing method

Abstract

Provide information related to the correctness of the confirmation of the abnormality detected in the medical image. The medical information processing system of the present embodiment includes an urgency determination unit and a display unit. The urgency determination unit determines the presence or absence of urgency of the disease related to the abnormality based on the type of at least one abnormality detection algorithm input into the medical image related to the subject, or information associated with the abnormality detected by inputting the medical image into the abnormality detection algorithm. When the display unit determines that the urgency exists, the display unit displays the confirmation information related to the confirmation of the abnormality and the urgency information indicating the urgency adjacent to the examination order related to the abnormality in the examination list showing the overview of the examination order.

Description

[0001] References to related applications:

[0002] This application is based on and claims the benefit of priority of Japanese Patent Application No. 2020-033940 filed on February 28, 2020 and Japanese Patent Application No. 2021-003734 filed on January 13, 2021, the entire contents of which are incorporated herein by reference. Technical Field

[0003] Embodiments generally relate to medical information processing systems and medical information processing methods. Background Art

[0004] In the past, there was a work list that displayed the order of examinations for image diagnosis by a radiologist. The radiologist inputs instructions related to the display of the examination based on the displayed work list. At this time, the medical image related to the indicated examination is displayed on the viewer. The radiologist reads the displayed medical image and records the diagnosis result in a reading report also called an image diagnosis report. For example, in the case of an urgent reading such as an acute case, a mark indicating the urgency is displayed on the work list. At this time, the radiologist gives priority to reading the examination with the urgent mark.

[0005] In recent years, due to the progress of image processing technology for medical images, it has gradually become possible to detect abnormalities in medical images through computer algorithms related to, for example, Computer-Aided Diagnosis (CAD). Abnormalities discovered by computer algorithms also include acute diseases such as acute appendicitis, acute myocardial infarction, and cerebral infarction. Acute diseases are abnormalities that require urgent diagnosis and treatment. However, the detection accuracy of abnormalities based on computer algorithms is not perfect. In other words, not all acute diseases detected by computer algorithms are correct. Therefore, sometimes radiologists give priority to reading medical images related to acute diseases detected by computer algorithms. At this time, there is a problem that the following situation occurs: the detection is a false detection by the computer algorithm, and there is no need for emergency reading by the radiologist. Summary of the invention

[0006] A medical information processing system of an embodiment includes a processing circuit and a display. The processing circuit determines whether there is urgency of a disease related to an abnormality based on the type of at least one abnormality detection algorithm input into a medical image related to a subject, or information associated with an abnormality detected by inputting the medical image into the abnormality detection algorithm. When it is determined that there is urgency, the display displays confirmation information related to confirmation of the abnormality and emergency information indicating urgency adjacent to the examination order related to the abnormality in an examination list showing a list of examination orders. BRIEF DESCRIPTION OF THE DRAWINGS

[0007] Figure 1 It is a diagram showing a configuration example of a medical information processing system according to an embodiment.

[0008] Figure 2 This is a flowchart showing an example of the procedure of the confirmation information providing process according to the embodiment.

[0009] Figure 3 It is a diagram showing an example of an additional purpose correspondence table according to an embodiment.

[0010] Figure 4 This is a diagram showing an example of confirmation information and emergency information in the check list according to the embodiment.

[0011] Figure 5 This is a diagram showing a display example of an enlarged image when the cursor is moved into the display area of ​​the thumbnail image corresponding to “aortic dissection” in the confirmation information according to the embodiment.

[0012] Figure 6 It means that in the implementation mode Figure 4 FIG. 1 is a diagram showing an example of a thumbnail image to which link information is attached in confirmation information related to “aortic dissection”.

[0013] Figure 7 It is a diagram showing an example of a key image and a confirmation reference image displayed in a confirmation layout according to the embodiment.

[0014] Figure 8 This is a diagram showing an example of confirmation information and emergency information in a check list according to a modified example of the embodiment.

[0015] Fig. 9 This is a diagram showing an example of confirmation information and emergency information in a check list according to a modified example of the embodiment. DETAILED DESCRIPTION

[0016] Hereinafter, the medical information processing system, the medical information processing method and the medical information processing program will be described in detail with reference to the accompanying drawings. In the following embodiments, the parts marked with the same reference figure marks are set to perform the same actions, and repeated descriptions are appropriately omitted. In addition, the medical information processing system of the present application is not limited to the embodiments shown below.

[0017] (Implementation Method)

[0018] A medical information processing system of an embodiment includes a processing circuit and a display. The processing circuit determines whether there is urgency of a disease related to an abnormality based on the type of at least one abnormality detection algorithm input into a medical image related to a subject, or information associated with an abnormality detected by inputting the medical image into the abnormality detection algorithm. When it is determined that there is urgency, the display displays confirmation information related to confirmation of the abnormality and emergency information indicating urgency adjacent to the examination order related to the abnormality in an examination list showing a list of examination orders.

[0019] The overall configuration of the medical information processing system according to the embodiment will be described. Figure 1 1 is a diagram showing a configuration example of a medical information processing system 1 according to an embodiment. The medical information processing system 1 includes an electronic medical record server device 3, a radiology department information server device 5, a medical image diagnosis device 7, a medical image management server device 9, a medical information processing server device 11, and a client device 20. In addition, the client device 20 may be provided in the medical information processing system 1 as one or more terminal devices provided for each of the above-mentioned various server devices. Figure 1 As shown in FIG. 1 , the medical information processing system 1 is described as a client-server system, but is not limited thereto. Figure 1 As shown in the frame of the dotted line 2, it is composed of a medical information processing server device 11 and a client device 20. In addition, the various server devices in the medical information processing system 1 can also be implemented as an integrated server that integrates the functions of the various server devices. That is, the server devices in the medical information processing system 1 can also be implemented by one integrated server.

[0020] In addition, the medical information processing system 1 can also be implemented as a separate medical information processing device. In this case, the medical information processing device has: a communication interface that integrates the functions of the first communication interface 13 and the second communication interface 21 as needed, a memory (storage unit) that integrates the storage contents of the first memory 15 and the second memory 23 as needed, a processing circuit (processing unit) that integrates the functions of the first processing circuit 17 and the second processing circuit 25 as needed, a display 27 (display unit), and an input interface 29 (input unit).

[0021] The electronic medical record server device 3 and the terminal device electrically connected to the electronic medical record server device 3 (hereinafter referred to as the electronic medical record terminal device) constitute an electronic medical record system. The electronic medical record system is an information system for managing electronic medical records for recording diagnosis and treatment content. The electronic medical record server device 3 is a computer device that performs processing related to the management of electronic medical records. The electronic medical record terminal device is used by doctors / nurses who input / reference electronic medical records. The electronic medical record server device 3 and the electronic medical record terminal device are connected to a communication network. The electronic medical record terminal device inputs an examination order for the subject through the instructions of a clinician. In the case where the examination order is a photograph of a subject related to image diagnosis, the examination order includes, for example, the examination site, the type of examination (information related to the examination content of the medical equipment (modality), etc.), the name of the disease (hereinafter referred to as the disease name), the purpose of the examination, etc. In addition, the examination order may also include information such as the patient ID of the subject being examined, the patient's name, the examination ID, and the examination date. In response to the input of the examination order, the electronic medical record server device 3 transmits the examination order together with the patient information of the subject and the like to the radiology department information server device 5 .

[0022] The radiology department information server device 5 and the terminal device electrically connected to the radiology department information server device 5 (hereinafter referred to as the radiology department terminal device) constitute a radiology department information system (hereinafter referred to as RIS (Radiology Information Systems)). RIS is an information system that manages the information of the radiology department in the hospital. The radiology department information server device (hereinafter referred to as the RIS server) 5 is a computer device that performs processing related to the management of the radiology department information. As an example of an action, the RIS server 5 receives an examination order from the electronic medical record server device 3, and obtains information related to the medical image diagnosis device 7 (such as the type of examination) from the examination order. The RIS server 5 sends the examination order to the medical image diagnosis device 7 determined by the examination order. In addition, when sending the examination order to the medical image diagnosis device 7, the RIS server 5 can also add information such as the patient ID and the examination date to the DICOM (Digital Imaging and Communications in Medicine) tag. The radiology department terminal device can also be used by radiologists to prepare film reading reports related to medical images.

[0023] The medical image diagnosis device 7 is a device that acquires medical images, such as an X-ray diagnosis device, an X-ray computed tomography (CT) device, and a magnetic resonance imaging (MRI) device. The medical image diagnosis device 7 performs imaging of the subject in response to an operation to start imaging by a technician or the like based on an inspection order from the RIS server 5. By performing the imaging, the medical image diagnosis device 7 collects data representing the state of the internal tissue of the subject. The medical image diagnosis device 7 generates a medical image based on the data, and sends the generated medical image together with the inspection order to the medical image management server device 9. In addition, the medical image diagnosis device 7 sends the generated medical image to the medical information processing server device 11.

[0024] The medical image management server device 9 and the terminal device electrically connected to the medical image management server device 9 (hereinafter referred to as the image management terminal device) constitute a medical image management system (hereinafter referred to as PACS (Picture Archiving and Communication Systems)). PACS is an information system that manages medical images such as X-ray CT images and MR images, as well as film reading reports also called image diagnosis reports. The medical image management server device (hereinafter referred to as the PACS server) 9 is a computer device that performs processing related to the management of medical images. After receiving the medical image and the examination order from the medical image diagnosis device 7, the PACS server 9 stores the medical image in association with the examination order. The medical image is accompanied by DICOM meta-information (hereinafter referred to as the accompanying information). The accompanying information includes the patient's name, patient ID, and instructions related to the medical image (such as slice thickness, slice number, presence or absence of contrast, etc.). The image management terminal device is used, for example, by radiologists to prepare film reading reports.

[0025] The medical information processing server device 11 includes a first communication interface 13, a first memory 15, and a first processing circuit 17. In addition, the first memory 15 and the first processing circuit 17 may be incorporated into other server devices such as the PACS server 9.

[0026] The first communication interface 13 performs data communication with, for example, the electronic medical record server device 3, the RIS server 5, the PACS server 9, and the second communication interface 21. The standard for communication through the first communication interface 13 can be any standard, for example, HL7 (Health Level 7: Health Information Exchange Standard), DICOM, or both. The first communication interface 13 outputs the data obtained through data communication with various server devices to the first memory 15. The first communication interface 13 receives an electrical signal of an input operation input to the input interface 29 in the client device 20 via the second communication interface 21. The first communication interface 13 outputs the received electrical signal to the first processing circuit 17.

[0027] The first memory 15 is a storage device such as a HDD (Hard disk Drive), an SSD (Solid State Drive), an integrated circuit storage device, etc. that stores various information. In addition to the HDD and SSD, the first memory 15 may also be a drive device that reads and writes various information between a portable storage medium such as a CD (Compact Disc), a DVD (Digital Versatile Disc), a flash memory, or a semiconductor memory element such as a RAM (Random Access Memory).

[0028] The first memory 15 stores various programs of the present embodiment. The first memory 15 stores data generated by executing the selection function 172, the abnormality detection function 173, the urgency judgment function 174, the confirmation information generation function 175, the layout generation function 176, etc. The generated data and these functions will be described later. The first memory 15 stores various diagnosis and treatment information collected from various server devices and the medical image diagnosis device 7 via the first communication interface 13. For example, the first memory 15 stores an inspection order and at least one medical image photographed in accordance with the inspection order. The inspection order is obtained by the first processing circuit 17, for example, from the electronic medical record server device 3 or the RIS server 5 via the first communication interface 13. The medical image is obtained by the first processing circuit 17 from the medical image diagnosis device 7 or the PACS server 9 via the first communication interface 13.

[0029] The first memory 15 stores an algorithm for detecting at least one abnormality in the medical image using a medical image (hereinafter referred to as an abnormality detection algorithm). The first memory 15 stores a plurality of abnormality detection algorithms corresponding to, for example, the type of abnormality, the type of medical image corresponding to the type of the medical image diagnostic device 7, the imaging part of the subject, etc. The abnormality detection algorithm is equivalent to, for example, an analysis application that takes a medical image as input and outputs the abnormal position in the medical image, the name of the disease related to the abnormality, various numerical values ​​related to the abnormality, the accuracy of the disease name, etc. as abnormality detection results. The abnormality detection results include, for example, a superimposed image and abnormality-related information. The superimposed image corresponds to an image formed by superimposing the abnormal position on the medical image with a color tone different from that of the medical image. The abnormality-related information corresponds to information associated with the abnormality such as the above-mentioned disease name, various numerical values ​​related to the abnormality, the accuracy of the disease name, etc.

[0030] The first memory 15 stores a correspondence table indicating the presence or absence of urgency for disease names (hereinafter referred to as a disease urgency correspondence table) or a correspondence table indicating the presence or absence of urgency for the types of abnormality detection algorithms (hereinafter referred to as an algorithm urgency correspondence table). In addition, the first memory 15 may also store a correspondence table in which an inspection purpose is further added to the disease urgency correspondence table or the algorithm urgency correspondence table (hereinafter referred to as an additional purpose correspondence table).

[0031] The analysis application is, for example, a trained model such as DNN, a rule-based analysis program, etc. In addition, the abnormality detection algorithm is not limited to these, and may also be various computer algorithms related to computer-aided diagnosis (hereinafter referred to as CAD). The first memory 15 stores the acceptance rate of the disease name in the output of the abnormality detection algorithm in correspondence with the associated abnormality detection algorithm. For example, the acceptance rate is determined based on the input of the radiologist's judgment (accept or ignore) on the abnormality detection result displayed on the display 27. That is, the acceptance rate is changed according to the radiologist's judgment result on the abnormality detection result.

[0032] In addition, the abnormality detection algorithm may also be stored in a memory in an analysis server device (hereinafter referred to as an analysis server) that detects abnormalities in medical images. In this case, the medical information processing system 1 also has an analysis server. In addition, the acceptance rate and abnormality detection results may also be stored in a memory in the PACS server 9. In this case, the PACS server 9 summarizes the judgment results of the radiologists in the client device 20 on the abnormality detection results to update the acceptance rate.

[0033] The first processing circuit 17 includes, as hardware resources, a processor such as a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a GPU (Graphics Processing Unit), and a memory such as a ROM (Read Only Memory), a RAM, etc. In addition, the first processing circuit 17 may also be implemented by an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), other complex programmable logic devices (CPLD), a simple programmable logic device (SPLD), etc.

[0034] The first processing circuit 17 has a system control function 171, a selection function 172, an abnormality detection function 173, an urgency determination function 174, a confirmation information generation function 175, and a layout generation function 176. In the system control function 171, the selection function 172, the abnormality detection function 173, the urgency determination function 174, the confirmation information generation function 175, and the layout generation function 176, each function is stored in the first memory 15 in the form of a program executable by a computer. The first processing circuit 17 executes the system control function 171, the selection function 172, the abnormality detection function 173, the urgency determination function 174, the confirmation information generation function 175, and the layout generation function 176 by a processor for executing the program expanded in the memory.

[0035] That is, the first processing circuit 17 is equivalent to a processor that realizes functions corresponding to each program by reading and executing the program from the first memory 15. In other words, the first processing circuit 17 in the state of reading each program has the function corresponding to the read program. In addition, each function (171 to 176) is not limited to the case where it is realized by a single processing circuit. It is also possible to combine multiple independent processors to form a processing circuit, and each processor realizes each function (171 to 176) by executing the program.

[0036] The first processing circuit 17 controls the various functions of the first processing circuit 17 based on the electrical signal corresponding to the input operation received from the operator via the input interface 29 through the system control function 171. Specifically, the first processing circuit 17 reads out the control program stored in the first memory 15 and expands it on the memory in the first processing circuit 17, and controls the various parts of the medical information processing server device 11 according to the expanded control program. In the case where the abnormality detection algorithm is mounted on the analysis server, the processing circuit (processor) in the analysis server has a selection function 172 and an abnormality detection function 173. In addition, the system control function 171, the urgency judgment function 174, the confirmation information generation function 175 and the layout generation function 176 can also be mounted on the PACS server 9. That is, the various functions in the medical information processing server device 11 can also be appropriately dispersed and configured in the analysis server and the PACS server 9. At this time, the medical information processing server device 11 is realized by the combination of the analysis server and the PACS server 9.

[0037] The selection function 172 selects at least one abnormality detection algorithm input to the medical image based on the medical image related to the subject. The abnormality detection function 173 detects abnormalities in the medical image by inputting the medical image to the selected abnormality detection algorithm. The urgency judgment function 174 judges whether there is urgency of the disease related to the abnormality, that is, whether it is necessary to urgently diagnose and treat the disease related to the detected abnormality, based on the information related to the abnormality or the type of the abnormality detection algorithm. In addition, the urgency judgment function 174 can also further use the inspection purpose in the inspection order of the subject related to the medical image to judge whether there is urgency. The confirmation information generation function 175 generates information for confirming the urgency of the abnormality detected by the abnormality detection algorithm (hereinafter referred to as confirmation information) based on the output from the abnormality detection algorithm. When it is judged that there is urgency, the layout generation function 176 generates a layout related to the display of the medical image containing the detected abnormality that can perform abnormality confirmation based on the radiologist (hereinafter referred to as confirmation layout). The confirmation layout is equivalent to a display layout suitable for the environment for reading the medical image related to the detected abnormality.

[0038] The first processing circuit 17 that realizes the system control function 171, the selection function 172, the abnormality detection function 173, the urgency judgment function 174, the confirmation information generation function 175, and the layout generation function 176 is an example of a system control unit, a selection unit, an abnormality detection unit, an urgency judgment unit, a confirmation information generation unit, and a layout generation unit. The selection function 172, the abnormality detection function 173, the urgency judgment function 174, the confirmation information generation function 175, and the layout generation function 176 realized by the first processing circuit 17 are described below in the order of performing a process of providing confirmation information to an operator such as a radiologist (hereinafter referred to as a confirmation information providing process).

[0039] The client device 20 has a second communication interface 21, a second memory 23, a second processing circuit 25, a display 27, and an input interface 29. The client device 20 can also be used as other terminal devices such as an image management terminal device. For example, the client device 20 is used by radiologists to prepare reading reports for medical images.

[0040] The second communication interface 21 performs data communication with the electronic medical record server device 3, the RIS server 5, the PACS server 9, and the first communication interface 13. The standard of the communication performed by the second communication interface 21 can be any standard, for example, HL7 (Hearth Level 7), DICOM, or both. The second communication interface 21 outputs the data obtained through the data communication with various server devices to the second memory 23. The second communication interface 21 sends the electrical signal of the input operation input to the input interface 29 to the first communication interface 13.

[0041] The second memory 23 is a storage device such as an HDD, SSD, or an integrated circuit storage device that stores various information. In addition to the HDD, SSD, and the like, the second memory 23 can also be a drive device that reads and writes various information between portable storage media such as CDs, DVDs, and flash memories, or semiconductor memory elements such as RAM, and the like. The second memory 23 stores various diagnosis and treatment information collected from various server devices via the second communication interface 21. For example, the second memory 23 stores an inspection order obtained by the second processing circuit 25 via the second communication interface 21, and at least one medical image photographed in accordance with the inspection order. The second memory 23 stores an inspection list (also referred to as a work list) that represents an overview of multiple inspection orders obtained. The inspection list will be described later in the order in which the confirmation information providing process is executed. The second memory 23 stores programs related to the display function 251.

[0042] The second processing circuit 25 has, for example, a processor such as a CPU, an MPU, or a GPU, and a memory such as a ROM or a RAM as hardware resources. In addition, the second processing circuit 25 can also be implemented by an ASIC, an FPGA, a CPLD, or an SPLD. The second processing circuit 25 has a display function 251, etc. The display function 251 is stored in the second memory 23 in the form of a program that can be executed by a computer. The second processing circuit 25 executes the display function 251 by a processor that executes the program expanded in the memory. That is, the second processing circuit 25 is equivalent to a processor that realizes the function corresponding to the program by reading out and executing the program from the second memory 23.

[0043] In other words, the second processing circuit 25 in the state of reading the program has the function corresponding to the read program. In addition, the display function 251 is not limited to the case where it is realized by a single processing circuit. It is also possible to combine a plurality of independent processors to form a processing circuit, and realize the display function 251 by executing the program by each processor. The second processing circuit 25 that realizes the display function 251 is an example of a display control unit. The second processing circuit 25 controls the display 27 for various displays in the display 27 through the display function 251. The details of the display function 251 will be described later in the order of executing the confirmation information providing process.

[0044] The display 27 displays various information. For example, the display 27 outputs a GUI (Graphical User Interface) for accepting various operations from the operator. As the display 27, for example, a liquid crystal display (LCD: Liquid Crystal Display), a CRT (Cathode Ray Tube: cathode ray tube) display, an organic EL display (OELD: Organic Electro Luminescence Display), a plasma display, or any other display can be used appropriately. In addition, the display 27 can be a desktop display, or it can be composed of a tablet terminal that can communicate wirelessly with the medical information processing server device 11.

[0045] When it is determined that there is an urgency through the urgency judgment function 174, the display 27 displays confirmation information related to the confirmation of the detected abnormality and emergency information indicating the urgency, adjacent to the inspection order related to the abnormality, in the inspection list representing the overview of the inspection order. At this time, the inspection list may also have an emergency release area related to the release of the display of the confirmation information and the emergency information. When a thumbnail image of a medical image containing an abnormality is displayed as confirmation information, the display 27, under the control of the display function 251, displays an enlarged image of the thumbnail image when the cursor moves into the display area of ​​the thumbnail image. The display 27 responds to the release operation in the emergency release area via the input interface 29 to release the display of the confirmation information and the emergency information. The display 27 responds to the specified operation in the display area of ​​the confirmation information to confirm that the layout displays at least one medical image related to the abnormality.

[0046] The input interface 29 receives various input operations from the operator, converts the received input operations into electrical signals, and outputs them to the second processing circuit 25. In addition, the converted electrical signals are output to the first processing circuit 17 via the second communication interface 21 and the first communication interface 13. For example, the input interface 29 receives selection instructions, various conditions, etc. from the operator. As the input interface 29, for example, a mouse, a keyboard, a trackball, a switch, a button, a joystick, a touch pad, a touch panel display, etc. can be used appropriately.

[0047] In addition, in the present embodiment, the input interface 29 is not limited to physical operation components such as a mouse, a keyboard, a trackball, a switch, a button, a joystick, a touchpad, and a touch panel display. For example, a processing circuit for receiving an electrical signal corresponding to an input operation from an external input device independently provided in the device and outputting the electrical signal to the first processing circuit 17 and the second processing circuit 25 is also included in the example of the input interface 29. In addition, the input interface 29 can also be composed of a tablet terminal or the like that can wirelessly communicate with the medical information processing server device 11.

[0048] The overall configuration of the medical information processing system 1 has been described above. Next, the procedure of the confirmation information providing process will be described. Figure 2 This is a flowchart showing an example of the procedure of confirmation information provision processing.

[0049] (Confirmation of information provision process)

[0050] (Step S201)

[0051] The selection function 172 determines the anatomical landmark from the medical image by using the existing image processing, thereby determining the inspection part. The selection function 172 determines the presence or absence of contrast in the medical image by analyzing the medical image using the existing segmentation algorithm. The selection function 172 extracts the presence or absence of contrast and the type of inspection such as the type of medical equipment related to the generation of the medical image from the accompanying information in the medical image. The selection function 172 selects at least one abnormality detection algorithm input to the medical image from a plurality of abnormality detection algorithms using the inspection type, inspection part, presence or absence of contrast, type of medical equipment, etc. In addition, the selection function 172 may also select an abnormality detection algorithm by extracting the inspection purpose, inspection type, inspection part, presence or absence of contrast, etc. based on the inspection order obtained from the electronic medical record server device 3 or the RIS server 5.

[0052] For example, when the medical image is an image based on contrast imaging and the examination site is the brain, the selection function 172 selects an abnormality detection algorithm related to cerebral infarction (hereinafter referred to as LVO (Large Vessel Occlusion)). In addition, when the medical image is an image based on non-contrast imaging and the examination site is the brain, the selection function 172 selects an abnormality detection algorithm related to cerebral hemorrhage (hereinafter referred to as ICH (Intracranial Hemorrhage)). In addition, when the medical image is an image based on non-contrast imaging and the examination site is the lung, the selection function 172 selects an abnormality detection algorithm for detecting lung nodules (hereinafter referred to as oncology).

[0053] (Step S202)

[0054] The abnormality detection function 173 inputs a medical image to the selected abnormality detection algorithm. The abnormality detection function 173 detects abnormalities in the input medical image by the abnormality detection algorithm and outputs abnormality detection results. The abnormality detection results are output in the form of JSON (Java Script (registered trademark) Object Notation: object notation). When no abnormality is detected in the medical image, the abnormality detection function 173 outputs that no abnormality is detected in the medical image (hereinafter referred to as abnormality not detected).

[0055] (Step S203)

[0056] When the abnormality detection function 173 outputs an abnormality detection result (Yes in step S203), the process of step S204 is executed. When the abnormality detection function 173 does not output an abnormality detection result, that is, when the abnormality detection function 173 outputs that no abnormality is detected (No in step S203), the confirmation information provision process ends.

[0057] (Step S204)

[0058] The urgency judgment function 174 uses the abnormality-related information or the type of abnormality detection algorithm to judge whether the abnormality detected by the abnormality detection function 173 is urgent. Specifically, the urgency judgment function 174 extracts the disease name from the abnormality-related information, and judges whether there is urgency by comparing the extracted disease name with the disease emergency correspondence table. Disease names judged to be urgent include, for example, stroke, cerebral hemorrhage, large vessel occlusion, etc. In addition, disease names judged to be non-urgent include, for example, lung nodules, various cancers, etc. The urgency judgment function 174 judges whether there is urgency by comparing the type of abnormality detection algorithm used for detecting abnormalities with the algorithm emergency correspondence table. Abnormality detection algorithms judged to be urgent include, for example, ICH, LVO, etc. Abnormality detection algorithms judged to be non-urgent include, for example, tumors, etc.

[0059] Alternatively, the urgency determination function 174 may extract the examination purpose from the examination order of the subject, and compare the extracted examination purpose with the additional purpose correspondence table to determine whether or not there is urgency. Figure 3 2 is a diagram showing an example of an additional destination correspondence table ALT. Figure 3 As shown, for example, when the purpose of the examination is to follow up (observe the progress) the subject, even if the urgency determination function 174 detects an abnormality, it is determined that there is no urgency.

[0060] When the urgency determination function 174 determines that there is an emergency (Yes in step S204), the process of step S205 and the process of step S206 are executed. At this time, the urgency determination function 174 sends the fact that the detected abnormality has an emergency to the client device 20 via the first communication interface 13 and the second communication interface 21. When the urgency determination function 174 determines that there is no emergency (No in step S204), the confirmation information provision process ends.

[0061] (Step S205)

[0062] The confirmation information generation function 175 generates confirmation information based on the abnormality detection result. The confirmation information includes, for example, a thumbnail image of a medical image including the detected abnormality, i.e., a superimposed image, a disease name related to the detected abnormality, a name of an abnormality detection algorithm (hereinafter referred to as an algorithm name), and at least one of an acceptance rate related to the disease name. That is, the confirmation information corresponds to information indicating a summary related to the abnormality detection result.

[0063] Specifically, the confirmation information generation function 175 searches the first memory 15 by using the examination part, disease name, and algorithm name in the medical image in which the abnormality is detected, thereby obtaining the acceptance rate corresponding to the abnormality detection result from the first memory 15. The confirmation information generation function 175 generates a thumbnail image by performing a predetermined reduction process on the superimposed image. At this time, the confirmation information generation function 175 associates the generated thumbnail image with the superimposed image as the source of the thumbnail image. In addition, the confirmation information generation function 175 extracts the disease name, algorithm name, and acceptance rate from the abnormality-related information in the abnormality detection result. The confirmation information generation function 175 generates confirmation information by integrating the thumbnail image, the disease name, the algorithm name, and the acceptance rate. The confirmation information is sent to the client device 20 via the first communication interface 13 and the second communication interface 21, and is stored in the second memory 23.

[0064] (Step S206)

[0065] The layout generation function 176 generates a confirmation layout based on the superimposed image. The confirmation layout corresponds to a display layout suitable for reading a medical image with a detected abnormality (hereinafter referred to as a key image). In the case where the key image is a CT image or an MRI image, the slice position of the key image corresponds to the slice position of the detected abnormality. The layout generation function 176 generates at least one image suitable for diagnosis, i.e., reading, of a disease related to the abnormality based on a plurality of medical images related to the subject. For example, the layout generation function 176 generates an orthogonal three-section image containing a key image, a large-angle image containing an abnormality, a curved MPR image (curved multi planar reconstruction) containing an abnormality, and the like by performing a section conversion process (multiplanar reconstruction) on the volume data related to the subject.

[0066] In addition, the layout generation function 176 generates various rendering images (3D images) containing abnormalities by rendering the volume data. In the following, for the sake of simplicity, the medical image containing abnormalities generated by the layout generation function 176 is referred to as a confirmation reference image. In addition, the confirmation reference image can also be generated by the confirmation information generation function 175. The confirmation reference image corresponds to an image that helps to confirm and diagnose the abnormality detection result. The layout generation function 176 generates a confirmation layout that can display a key image and a confirmation reference image. In addition, abnormality-related information can also be further displayed in the confirmation layout. The confirmation layout, the key image, and the confirmation reference image are sent to the client device 20 via the first communication interface 13 and the second communication interface 21, and stored in the second memory 23. In addition, the confirmation layout, the key image, and the confirmation reference image can also be stored in the first memory 15. The layout generation function 176 makes the thumbnail image accompanied by link information between the thumbnail image and the confirmation layout. In addition, the layout generation function 176 can also make the confirmation information accompanied by the link information. In the following, for the sake of simplicity, it is assumed that the thumbnail image is accompanied by link information.

[0067] (Step S207)

[0068] The display function 251 displays confirmation information and emergency information indicating urgency in the inspection list, and the inspection order related to the abnormality on the display 27 adjacently. Figure 4 This is a diagram showing an example of confirmation information CI and emergency information EI indicating urgency in the examination list SL. In the examination list SL, the examination orders are arranged, for example, in the order in which the examination orders are accepted or the order in which the medical images are acquired. In the examination order at the top of the examination list SL, an "emergency" mark is displayed according to the clinician's instructions to patient A. In addition, when there is no urgency in the items of the judgment result of the urgency judgment function 174 (hereinafter referred to as the CAD result), the emergency information EI is not displayed. Figure 4 In the examination list SL in the embodiment, as columns related to urgency, two columns, namely, the clinician's instructions and the CAD results, are shown, but not limited thereto. For example, in one column of the examination list SL, a mark of an emergency reading performed by a clinician and a mark of an emergency reading based on CAD results may be displayed in different display modes.

[0069] like Figure 4As shown, in the second stage of the examination order SOI in the examination list SL, the "urgent" sign is not displayed because there is no urgent instruction from the clinician to the patient B. On the other hand, in the second stage of the examination order SOI, the analysis result of the medical image based on the abnormality detection algorithm is judged to be urgent, so the character string "urgent" is displayed as urgent information EI in the item of the CAD result. In addition, confirmation information CI is displayed in the second stage of the examination order SOI.

[0070] exist Figure 4 In the confirmation information CI shown, the disease name "aortic dissection", the name of the abnormality detection algorithm that outputs the disease name "Cardiac Deep Mind", and the acceptance rate (Accept rate) "80%" of the abnormality detection algorithm that outputs the disease name are displayed together with the thumbnail image SI of the key image. In addition, in the confirmation information CI, the disease name "stroke", the name of the abnormality detection algorithm that outputs the disease name "stroke finder", and the acceptance rate (Accept rate) "95%" of the abnormality detection algorithm that outputs the disease name are displayed together with the thumbnail image SI of the key image.

[0071] When the cursor displayed on the display 27 is moved into the display area of ​​the thumbnail image SI by an instruction of an operator such as a radiologist, the display function 251 displays an enlarged image of the thumbnail image SI superimposed on the examination list SL on the display 27. In addition, the display function 251 may display the key image on the display 27 in a display area larger than the thumbnail image SI instead of the enlarged image. Figure 5 The figure shows a display example of the enlarged image EXI when the cursor KSR moves into the display area of ​​the thumbnail image SI corresponding to "aortic dissection" in the confirmation information CI. If the cursor KSR moves out of the display area of ​​the thumbnail image SI, the display function 251 cancels the display of the enlarged image EXI.

[0072] (Step S208)

[0073] If a predetermined operation is input in the display area of ​​the thumbnail image SI (Yes in step S208), the process of step S209 is executed. The predetermined operation is a simple operation in a state where the cursor KSR moves to the display area of ​​the thumbnail image SI, such as a click operation of a mouse. If the predetermined operation is not input in the display area of ​​the thumbnail image SI (No in step S208), the process of step S210 is executed. In addition, when the confirmation information CI is accompanied by link information, the area where the predetermined operation is effective is the display area of ​​the confirmation information CI. Figure 6 It means that Figure 4FIG. 1 is a diagram showing an example of a thumbnail image SI with link information attached to confirmation information CI related to "aortic dissection". Figure 6 The thumbnail image SI shown has “link information attached” written therein, but the text “link information attached” is not displayed when displayed on the display 27 .

[0074] (Step S209)

[0075] The display function 251 responds to the specified operation in the display area of ​​the confirmation information CI to display at least one medical image related to the detected abnormality, that is, the confirmation reference image, in the confirmation layout. Figure 4 as well as Figure 6 When a single-click operation is input in the state of the display area of ​​the thumbnail image SI shown, the display function 251 displays the key image and the confirmation reference image on the display 27 to confirm the layout. Figure 7 FIG. 4 is a diagram showing an example of a key image KI and a confirmation reference image CRI displayed in a confirmation layout CL. Figure 7 As shown, in the confirmation layout CL, an image reading environment for the key image KI and the confirmation reference image CRI is provided to an operator such as a radiologist.

[0076] (Step S210)

[0077] When the confirmation information CI is displayed adjacent to the inspection order, the inspection list SL has an emergency release area related to the display release of the confirmation information CI and the emergency information EI (hereinafter referred to as emergency display release). Figure 4 As shown, the emergency release area is, for example, a blank area in the inspection command SOI, an area for displaying the emergency information EI, etc. In addition, the emergency release area is not limited to the above examples, and can be set at any position in the display screen of the inspection list SL. If the operator inputs an instruction to release the emergency display via the input interface 29 (yes in step S210), the process of step S211 is executed. The input of the instruction to release the emergency display is equivalent to, for example, a single-click operation performed by a mouse in a state where the cursor KSR is moved to the emergency release area. In the case where the instruction to release the emergency display is not input (no in step S210), the confirmation information provision process is completed.

[0078] (Step S211)

[0079] The display function 251 responds to the input of the instruction to release the emergency display, and releases the display of the confirmation information CI and the emergency information EI in the inspection list SL. That is, the display 27 responds to the operation of releasing the emergency display in the emergency release area, and releases the display of the confirmation information CI and the emergency information EI. As a result, the confirmation information CI and the emergency information EI are not displayed in the inspection list SL. Based on the above, the confirmation information provision processing is completed. The processing of steps S201 to S211 is performed, for example, each time the medical image collected by the medical image diagnosis device 7 is sent to the medical information processing server device 11 or the analysis device according to the inspection order.

[0080] According to the medical information processing system 1 of the embodiment described above, based on the medical image related to the subject, at least one abnormality detection algorithm input to the medical image is selected, the abnormality in the medical image is detected by inputting the medical image to the abnormality detection algorithm, and the presence or absence of urgency of the disease related to the abnormality is judged based on the abnormality-related information or the type of the abnormality detection algorithm, and when it is judged that there is urgency, confirmation information CI and emergency information EI are displayed adjacent to the examination order related to the abnormality in the examination list SL. That is, according to the present medical information processing system 1, if the abnormality detection result output by the abnormality detection algorithm is a result with urgency, confirmation information CI and emergency information EI having at least one of the thumbnail image SI, the name of the disease related to the abnormality, the name of the abnormality detection algorithm, and the acceptance rate are displayed in the examination list SL.

[0081] In other words, information that can determine the correctness of abnormality detection results can be provided to operators such as radiologists on the check list SL. Therefore, according to the medical information processing system 1, the operator can confirm whether emergency reading is required and the correctness of abnormality detection results for medical images detected abnormal by the abnormality detection algorithm on the check list SL without performing formal reading preparation of displaying a reading screen of medical images according to the check list SL.

[0082] In addition, according to the medical information processing system 1, the purpose of the examination in the examination order of the subject related to the medical image is further used to determine whether there is urgency. Therefore, when the purpose of the examination is a follow-up after surgery or a follow-up after diagnosis and treatment, the disease related to the abnormality detected by the abnormality detection algorithm is judged to be non-urgent, thereby reducing the operator's workload related to emergency film reading.

[0083] Furthermore, according to the medical information processing system 1, when the thumbnail image SI of the medical image including the abnormality detected by the abnormality detection algorithm is displayed as the confirmation information CI on the display 27, the display 27 uses the movement of the cursor KSR into the display area of ​​the thumbnail image SI as an opportunity to display the enlarged image EXI obtained by enlarging the thumbnail image SI. Thus, the enlarged image EXI is displayed by the movement of the cursor KSR into the display area of ​​the thumbnail image SI without performing an additional operation such as a click operation with a mouse, and thus the workload of the operator in performing the operation can be reduced.

[0084] Furthermore, according to the medical information processing system 1, the check list SL has an emergency release area related to the release of the display of the confirmation information CI and the emergency information EI, and in response to the release operation in the emergency release area, the display of the confirmation information CI and the emergency information EI in the check list SL is released. Thus, the display of the confirmation information CI and the emergency information EI can be released by an operation in a state where the cursor KSR is moved to the emergency release area, and the workload of the operator can be reduced.

[0085] Furthermore, according to the medical information processing system 1, when it is determined that the detected abnormality is urgent, a confirmation layout CL is generated that can confirm the abnormality and is related to the display of the medical image containing the abnormality, and in response to the prescribed operation in the display area of ​​the confirmation information CI, at least one medical image related to the abnormality is displayed in the confirmation layout CL. That is, according to the medical information processing system 1, since the confirmation layout that can display the key image and the confirmation reference image is generated in advance, it is not necessary to retrieve the medical image with the abnormality before reading the film, and a simple operation such as a single-click operation on the display area of ​​the thumbnail image SI can immediately provide the operator with a film reading environment that can diagnose and confirm the disease of the object. As a result, the efficiency of confirming and diagnosing the abnormality detection results that are urgent for the film reading can be improved.

[0086] In addition, as another variation of the present embodiment, the present medical information processing system 1 may also be incorporated into a hospital information system (HIS). In addition, the present medical information processing system 1 may also be implemented through cloud computing, etc. In this case, the first communication interface 13, the first memory 15, and the first processing circuit 17 are mounted on a server on the network.

[0087] (Variation Example)

[0088] In this variant, the confirmation information includes at least one of an index related to the reliability of the abnormality detected by the abnormality detection algorithm (hereinafter referred to as a reliability index) and an index related to the priority of treating the abnormality (hereinafter referred to as a priority index). The reliability index includes a reliability or confidence level indicating the reliability and trustworthiness of the abnormality detection result (analysis result) output from the abnormality detection algorithm, an average value of multiple reliability values ​​related to the same cases and medical images in the past, a mode value of the reliability, a median value of the reliability, a histogram of the reliability, a standard deviation related to the reliability, and a confidence interval related to the reliability.

[0089] Reliability or confidence is, for example, a numerical value indicating the degree of accuracy of anomalies detected by an anomaly detection algorithm (confidence of the anomaly detection algorithm). The average value of the reliability, the mode value of the reliability, the median value of the reliability, the histogram of the reliability, the standard deviation associated with the reliability, the confidence interval associated with the reliability, etc. are indicators for the operator to judge the reliability of anomalies detected by the anomaly detection algorithm. In addition, the histogram of the reliability, the standard deviation associated with the reliability, the confidence interval associated with the reliability, etc. are equivalent to data indicating the deviation of multiple reliabilities corresponding to multiple identical anomalies detected in the past.

[0090] Priority indicators are numerical data such as the expected value of recovery of the specimen by treating the abnormality (e.g., mismatch ratio), the degree of good prognosis of the abnormality by the treatment, the degree of effectiveness of the treatment, and the priority of treating the abnormality. Priority indicators serve as judgment materials for whether the detected abnormality should be read and treated with priority, for example.

[0091] The anomaly detection function 173 outputs at least one of the reliability index and the priority index together with the anomaly detection result through the anomaly detection algorithm. In addition, the anomaly detection function 173 may also output at least one of the reliability index and the priority index by inputting the anomaly detection result into an algorithm different from the anomaly detection algorithm. The different algorithm is, for example, a trained model such as DNN, a rule-based analysis program, etc. In addition, at least one of the reliability index and the priority index may also be generated by the confirmation information generation function 175 based on the anomaly detection result output from the anomaly detection algorithm.

[0092] In addition, the abnormality detection function 173 or the confirmation information generation function 175 may also calculate and update the average value of reliability, the mode value of reliability, the median value of reliability, the histogram of reliability, the standard deviation related to reliability, and the confidence interval related to reliability, etc. in the reliability index based on the reliability index corresponding to the abnormality detection result output by the abnormality detection function 173 and the reliability index related to the same past case or medical image stored in the first memory 15. In this case, the updated average value, mode value, median value, histogram, standard deviation, confidence interval, etc. are stored in the first memory 15.

[0093] The first memory 15 stores a plurality of average values ​​of the reliability, mode values ​​of the reliability, histograms of the reliability, standard deviations associated with the reliability, and confidence intervals associated with the reliability for the same case and medical image in the abnormality detection result. In addition, the average values, mode values, histograms, standard deviations, and confidence intervals may be appropriately updated each time a new reliability index is output by the abnormality detection function 173.

[0094] (Confirmation information generation process)

[0095] The processing order in this modification is the same as Figure 6 The flowcharts shown are the same, but the steps in the different processes are described below.

[0096] (Step S205)

[0097] The confirmation information generation function 175 generates confirmation information by integrating thumbnail images, disease names, algorithm names, acceptance rates, and reliability indicators. In addition, the confirmation information generation function 175 generates confirmation information by integrating thumbnail images, disease names, algorithm names, acceptance rates, and priority indicators. In addition, the confirmation information generation function 175 can also generate confirmation information by integrating thumbnail images, disease names, algorithm names, acceptance rates, reliability indicators, and priority indicators.

[0098] (Step S207)

[0099] The display function 251 displays confirmation information and emergency information indicating urgency and an inspection order related to the abnormality on the display 27 in the inspection list. Figure 8 This is a diagram showing an example of confirmation information CI and emergency information EI indicating urgency in the check list SL. Figure 8 and Figure 4 The difference is that in the confirmation information CI, the reliability index is displayed corresponding to the abnormal detection result. Figure 8 As shown in FIG. 1 , the reliability CLV is represented in a range of 0 to 100, for example. Figure 8 As shown in FIG. 1 , for example, the reliability CLV of the abnormality detection result based on “Cardiac Deep Mind” is 80. In addition, Figure 8 As shown in FIG. 1 , for example, the reliability CLV of the abnormal detection result based on “Stroke Finder” is 75. Figure 8 As shown, bars representing confidence intervals (error bars) may also be displayed for the displayed reliability. Figure 8 As shown, a histogram HIS showing the distribution of the frequencies of a plurality of reliabilities may be displayed near a bar showing the range of the configuration of the reliabilities. In this case, the mode value MOD of the reliability, the median value MED of the reliability, and the average value MEA of the reliability may also be displayed in the histogram HIS.

[0100] Fig. 9 This is a diagram showing an example of confirmation information CI and emergency information EI indicating urgency in the check list SL. Fig. 9 and Figure 4 The difference is that in the confirmation information CI, the priority index is displayed according to the abnormality detection result. Fig. 9 In the example, the mismatch rate is displayed as a priority indicator. Fig. 9 As shown in FIG. 1 , the mismatch rate of the abnormal detection result based on “Cardiac Deep Mind” is 90%, and the mismatch rate of the abnormal detection result based on “Stroke Finder” is 75%. In addition, as an application example of this variant, when the confirmation information has a reliability index and a priority index, Figure 8 In the confirmation information CI shown, the display 27 also displays priority indicators such as the mismatch rate.

[0101] According to the medical information processing system 1 of the variation of the above-described embodiment, the confirmation information also has at least one of a reliability index related to the reliability of the detected abnormality and a priority index related to the priority of treating the abnormality. Thus, the display 27 also displays at least one of the reliability index and the priority index. Thus, according to this variation, the reliability of the abnormality detection result based on the abnormality detection algorithm and the statistical information related to the reliability can be prompted to the operator. In addition, according to this variation, the information related to the priority of treating the detected abnormality can be prompted to the operator. Therefore, according to the medical information processing system 1 of this variation, it is possible to easily confirm whether an emergency film reading is required and the correctness of the abnormality detection result, and it is possible to reduce the operator's workload such as judging the order of film reading related to the emergency film reading. Other effects are the same as those in the embodiment, so the description is omitted.

[0102] In the case where the technical idea in the present embodiment is realized by a medical information processing method, the medical information processing method is to judge the presence or absence of urgency of a disease related to an abnormality based on the type of at least one abnormality detection algorithm or information related to the abnormality, the abnormality detection algorithm is inputted into a medical image based on a medical image related to a subject, and the abnormality is detected by inputting the medical image into the abnormality detection algorithm, and when it is judged that there is urgency, confirmation information CI related to confirmation of the abnormality and emergency information EI indicating urgency are displayed adjacent to the examination order related to the abnormality on the display 27 in the examination list SL showing a list of examination orders. The processing order and effect in the medical information processing method are the same as those in the embodiment, so the description is omitted.

[0103] In the case where the technical idea in the present embodiment is implemented by a medical information processing program, the medical information processing program enables the computer to implement: judging the presence or absence of urgency of a disease related to the abnormality based on the type of at least one abnormality detection algorithm or information associated with the abnormality, wherein the abnormality detection algorithm is input into a medical image based on a medical image related to the subject, and the information associated with the abnormality is detected by inputting the medical image into the abnormality detection algorithm; and when it is judged that there is urgency, in the inspection list SL which is an overview of the inspection orders, displaying confirmation information CI related to the confirmation of the abnormality and emergency information EI indicating urgency adjacent to the inspection order related to the abnormality on the display 27.

[0104] For example, the confirmation information provision process can also be realized by installing a medical information processing program on a computer in a PACS server 9, an integrated server, etc. in a hospital information system and expanding it on a memory. In this case, the program that enables a computer to execute the method can also be stored in a storage medium such as a disk (hard disk, etc.), an optical disk (CD-ROM, DVD, etc.), or a semiconductor memory for distribution. The processing sequence and effect in the medical information processing program are the same as those in the embodiment, so the description is omitted.

[0105] According to at least one of the above-described embodiments, etc., information related to the correctness of abnormality confirmation detected in medical images can be provided. Therefore, according to the present medical information processing system 1, the operator's workload can be reduced, and time and labor can be reduced, thereby improving the throughput of film reading, etc., regarding the correctness of abnormality detection results with urgency for film reading.

[0106] Although several embodiments have been described, these embodiments are only provided as examples and are not intended to limit the scope of the present invention. In fact, the new embodiments described in the specification can be implemented in various other ways. In addition, various omissions, substitutions, and changes can be made without departing from the scope of the present invention. These embodiments and their variations are included in the scope and purpose of the invention, and are also included in the invention described in the claims and their equivalents.

Claims

1. A medical information processing system, wherein: have: an urgency determination unit that determines the urgency of a disease related to the abnormality based on the type of at least one abnormality detection algorithm inputted with the medical image related to the subject or information associated with the abnormality detected by inputting the medical image to the abnormality detection algorithm; The display unit, when it is determined that the urgency exists, displays confirmation information related to the confirmation of the abnormality and emergency information indicating the urgency adjacent to the inspection order related to the abnormality in an inspection list indicating a list of inspection orders; A selection unit, which selects at least one of the abnormality detection algorithms input into the medical image based on the medical image related to the subject; as well as an abnormality detection unit that detects abnormalities in the medical image by inputting the medical image into the abnormality detection algorithm, When a thumbnail image including the abnormal medical image is displayed as the confirmation information, the display unit displays an enlarged image of the thumbnail image in response to movement of a cursor into a display area of ​​the thumbnail image.

2. The medical information processing system according to claim 1, wherein: The confirmation information includes at least one of a thumbnail image of a medical image containing the abnormality, the name of the disease, the name of the abnormality detection algorithm, an acceptance rate related to the name of the disease, an indicator related to the reliability of the detected abnormality, and an indicator related to the priority of treating the abnormality.

3. The medical information processing system according to claim 1 or 2, wherein: The urgency determination unit further determines the presence or absence of the urgency using an examination purpose in an examination order of the subject related to the medical image.

4. The medical information processing system according to claim 1, wherein: The check list has an emergency release area related to release of display of the confirmation information and the emergency information, The display unit cancels the display of the confirmation information and the emergency information in response to the cancel operation in the emergency cancel area.

5. The medical information processing system according to claim 1, wherein: The apparatus further comprises a layout generating unit which generates a confirmation layout related to display of a medical image including the abnormality and capable of performing confirmation of the abnormality when it is determined that the urgency exists. The display unit displays at least one medical image related to the abnormality in the confirmation layout in response to a predetermined operation in the display area of ​​the confirmation information, The layout generating unit adds link information between the thumbnail image and the confirmed layout to the thumbnail image.

6. A medical information processing method, wherein: include: determining the urgency of a disease related to the abnormality based on the type of at least one abnormality detection algorithm inputted with the medical image related to the subject or information associated with the abnormality detected by inputting the medical image to the abnormality detection algorithm; If it is determined that the urgency exists, displaying confirmation information related to confirmation of the abnormality and emergency information indicating the urgency on a display adjacent to the inspection order related to the abnormality in an inspection list indicating a list of inspection orders; selecting, based on the medical image related to the subject, at least one of the abnormality detection algorithms input into the medical image; as well as detecting abnormalities in the medical image by inputting the medical image into the abnormality detection algorithm, When a thumbnail image including the abnormal medical image is displayed as the confirmation information, an enlarged image obtained by enlarging the thumbnail image is displayed in response to movement of a cursor into a display area of ​​the thumbnail image.

Images