Information processing system, information processing method, and storage medium

Abstract

The present application provides an information processing system, an information processing method and an information processing program, which can improve the diagnostic efficiency of a diagnosis performed by a photographer, a viewer and a diagnostician using CAD results. A first information processing device transmits an execution result of a lesion detection process performed on a medical image, a second information processing device performs control to display the medical image and the execution result, and transmits first input information input by the photographer with respect to the execution result, a third information processing device performs control to display the medical image, the execution result and the first input information, and transmits second input information input by the viewer with respect to the execution result, and a fourth information processing device performs control to display the medical image, the execution result and the second input information, and saves a comprehensive diagnosis result performed by the diagnostician.

Description

Technical Field

[0001] The present invention relates to an information processing system, an information processing method and an information processing program. Background Art

[0002] Computer-aided diagnosis (CAD) systems are currently used in the medical field. These systems assist human image diagnosis by using computers to detect lesions in images. Hereinafter, the results of computer-generated lesion detection processing on medical images will be referred to as "CAD results."

[0003] Patent Document 1, a technology related to CAD systems, discloses a medical diagnosis support system that obtains first diagnostic information by computer processing medical examination data and second diagnostic information obtained by a doctor or other image reader interpreting the medical examination data. If the processing range of the first diagnostic information does not cover the entire area of ​​the medical examination data, the medical diagnosis support system determines whether the processing range of the second diagnostic information is within the processing range of the first diagnostic information.

[0004] Furthermore, Patent Document 2 discloses a medical image display system that acquires examination result information regarding a medical image displayed on a display device, as well as computer-generated detection result information regarding medical images from past examinations of the same patient and under the same examination conditions as the medical image. Based on the acquired detection result information, the medical image display system extracts images of candidate abnormal shadow portions from the medical image currently displayed on the display device and images of candidate abnormal shadow portions from past examinations, arranges the extracted images in time series, and displays them in a list on the display device.

[0005] Patent document 3 discloses an image diagnosis support device that detects abnormal shadow candidates from medical images and determines the display order of medical images based on the malignancy, contrast, diagnostic difficulty, patient information, or imaging site of the detected abnormal shadow candidate parts.

[0006] Previous technical literature

[0007] Patent Literature

[0008] Patent Document 1: Japanese Patent Application Laid-Open No. 6-251038

[0009] Patent Document 2: Japanese Patent Application Laid-Open No. 2011-103095

[0010] Patent Document 3: Japanese Patent Application Laid-Open No. 2004-216008 Summary of the Invention

[0011] Technical issues to be solved by the invention

[0012] In the diagnosis of patients using medical images, photographers such as radiologists, image readers such as radiographers, and general diagnosticians often refer to CAD results to interpret the images. In this situation, if the current policy of "CAD results supporting human image diagnosis" and "humans bear the ultimate responsibility for diagnosis" is applied, the burden on photographers, image readers, and diagnosticians will not be reduced even with CAD-based diagnostic support.

[0013] In recent years, the accuracy of CAD results has improved, and the frequency of false lesion detections has gradually decreased. Furthermore, even if a CAD result contains a false lesion detection, if the error is on the safe side, the risk to the patient's life is low. In contrast, if the CAD result indicates that no lesion is detected, there is a risk of missed lesions for the patient.

[0014] Furthermore, if CAD is designed to detect even very small lesions using a computer for certain types of lesions, the number of detectable lesions increases, making it very cumbersome for human image readers. Therefore, some systems implement human observation of very small lesions, rather than active computer detection. For example, in lung diseases, tumors smaller than 5 mm are not considered for CAD detection.

[0015] Under the above premise, if there is a system that can implement the following process, it is believed that the diagnostic efficiency of the three parties using CAD results, namely, the photographer, reader and diagnostician, can be improved: for the lesions detected by CAD, the photographer, reader and diagnostician only perform simple confirmation, and focus on confirming the areas in the medical image where CAD has not detected any lesions.

[0016] The techniques described in Patent Documents 1 to 3 are techniques for improving the efficiency of medical image interpretation by readers who refer to CAD results, but are not techniques for improving the diagnostic efficiency of the three parties: the photographer, the reader, and the diagnostician.

[0017] The present invention has been made in view of the above circumstances, and its object is to provide an information processing system, an information processing method, and an information processing program that can improve the efficiency of diagnosis performed by the photographer, the reader, and the diagnostician using CAD results.

[0018] Means for solving technical problems

[0019] The information processing system of the present invention includes a first information processing device for computer-based medical image diagnosis, a second information processing device for a photographer who photographs medical images, a third information processing device for a reader who reads medical images, and a fourth information processing device for a diagnostician who performs a comprehensive diagnosis of a patient, wherein the first information processing device, the second information processing device, the third information processing device, and the fourth information processing device each have at least one processor, and the processor of the first information processing device performs the following processing: acquiring a medical image of a diagnosis object, performing lesion detection processing on the acquired medical image, and sending a lesion detection processing signal to the diagnostician. The processor of the second information processing device performs the following processing: controls the display of medical images and execution results, receives the first input information input by the photographer for the execution results, and sends the first input information; the processor of the third information processing device performs the following processing: controls the display of medical images, execution results, and the first input information, receives the second input information input by the reader for the execution results, and sends the second input information; the processor of the fourth information processing device performs the following processing: controls the display of medical images, execution results, and the second input information, receives the comprehensive diagnosis result performed by the diagnostician, and saves the diagnosis result.

[0020] Furthermore, in the information processing system of the present invention, the first input information may be information indicating approval or disapproval of the execution result.

[0021] Furthermore, in the information processing system of the present invention, the first input information may be information indicating an undetected lesion that is not included in the execution result.

[0022] Furthermore, in the information processing system of the present invention, the first input information may be information indicating deletion of a lesion included in the execution result.

[0023] Furthermore, in the information processing system of the present invention, the second input information may be information indicating approval or disapproval of the execution result and the first input information.

[0024] Furthermore, in the information processing system of the present invention, the second input information may be information indicating an undetected lesion that is not included in the execution result and the first input information.

[0025] Furthermore, in the information processing system of the present invention, the processor of the fourth information processing device may perform control to display the first input information in addition to the medical image and the second input information.

[0026] Furthermore, in the information processing system of the present invention, there may be multiple medical images of the diagnostic object, and when the execution result includes information representing more than one lesion, when displaying the medical image of the diagnostic object, the processors of the second information processing device, the third information processing device, and the fourth information processing device can control the status display to reduce the number of medical images.

[0027] Furthermore, the information processing method of the present invention is executed by an information processing system, which includes a first information processing device for performing computer-based medical image diagnosis, a second information processing device for a photographer for photographing medical images, a third information processing device for a reader for reading medical images, and a fourth information processing device for a diagnostician for performing a comprehensive diagnosis of a patient, wherein the processor of the first information processing device performs the following processing: acquiring a medical image of a diagnosis object, performing lesion detection processing on the acquired medical image, and transmitting the execution result of the lesion detection processing, and the processor of the second ... transmitting the execution result of the lesion detection processing. The processor of the information processing device performs the following processing: controls the display of medical images and execution results, receives the first input information input by the photographer regarding the execution results, and sends the first input information. The processor of the third information processing device performs the following processing: controls the display of medical images, execution results, and the first input information, receives the second input information input by the reader regarding the execution results, and sends the second input information. The processor of the fourth information processing device performs the following processing: controls the display of medical images, execution results, and the second input information, receives the comprehensive diagnosis results performed by the diagnostician, and saves the diagnosis results.

[0028] Furthermore, the information processing program of the present invention, in an information processing system including a first information processing device for computer-based medical image diagnosis, a second information processing device for a photographer who photographs medical images, a third information processing device for a reader who interprets medical images, and a fourth information processing device for a diagnostician who performs a comprehensive diagnosis of a patient, causes the processor of the first information processing device to execute the following processing: acquire a medical image of a diagnosis object, execute lesion detection processing on the acquired medical image, and transmit the execution result of the lesion detection processing, and cause the processor of the second information processing device to execute The following processing is performed: controlling the display of medical images and execution results, receiving the first input information input by the photographer regarding the execution results, and sending the first input information, so that the processor of the third information processing device performs the following processing: controlling the display of medical images, execution results, and the first input information, receiving the second input information input by the reader regarding the execution results, and sending the second input information, so that the processor of the fourth information processing device performs the following processing: controlling the display of medical images, execution results, and the second input information, receiving the comprehensive diagnosis result performed by the diagnostician, and saving the diagnosis result.

[0029] Effects of the Invention

[0030] According to the present invention, the efficiency of diagnosis by the photographer, the image reader, and the diagnostician using CAD results can be improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] Figure 1 This is a block diagram showing an example of the configuration of an information processing system.

[0032] Figure 2 This is a block diagram showing an example of the hardware configuration of an information processing device.

[0033] Figure 3 This is a block diagram showing an example of the functional configuration of the first information processing device.

[0034] Figure 4 This is a block diagram showing an example of the functional structure of the second information processing device.

[0035] Figure 5 This is a diagram showing an example of a display screen of the second information processing device.

[0036] Figure 6 This is a block diagram showing an example of the functional structure of the third information processing device.

[0037] Figure 7 This is a diagram showing an example of a display screen of the third information processing device.

[0038] Figure 8This is a block diagram showing an example of the functional structure of the fourth information processing device.

[0039] Figure 9 This is a diagram showing an example of a display screen of the fourth information processing device.

[0040] Figure 10 This is a flowchart showing an example of the first diagnostic support process.

[0041] Figure 11 This is a flowchart showing an example of the second diagnosis support process.

[0042] Figure 12 This is a flowchart showing an example of the third diagnostic support process.

[0043] Figure 13 This is a flowchart showing an example of the fourth diagnostic support process.

[0044] Figure 14 This is a diagram showing an example of a display screen of a second information processing device according to a modification. DETAILED DESCRIPTION

[0045] Hereinafter, examples of modes for implementing the technology of the present invention will be described in detail with reference to the drawings.

[0046] First, refer to Figure 1 The structure of the information processing system 10 involved in this embodiment is described. Figure 1 As shown, information processing system 10 includes information processing devices 11, 12, 13, 14, an image archiving system 15, and a shared server 16. Information processing devices 11, 12, 14, image archiving system 15, and shared server 16 are located in a facility known as an AI (Artificial Intelligence) center, where medical image diagnosis is primarily performed using computers. Information processing device 13 is located in a facility known as an imaging center, where medical image interpretation is primarily performed. Information processing devices 11, 12, 13, 14, image archiving system 15, and shared server 16 are each connected to a network and can communicate with one another.

[0047] Information processing device 11 is a first information processing device used for computer-based medical image diagnosis, such as CAD. Information processing device 12 is a second information processing device used by radiographers and other medical image photographers. Information processing device 13 is a third information processing device used by radiographers and other medical image readers. Information processing device 14 is a fourth information processing device used by diagnosticians and other general practitioners who perform comprehensive patient diagnoses. Examples of information processing devices 11 to 14 include computers such as personal computers and server computers.

[0048] The image storage system 15 is a system that stores image data representing medical images captured by an imaging device that captures medical images. The image storage system 15 transmits image data corresponding to requests from information processing devices 11 to 14, etc., to the device that originated the request. Examples of image storage systems 15 include PACS (Picture Archiving and Communication Systems). Examples of medical images include CT images captured by a CT (Computed Tomography) device, MRI images captured by an MRI (Magnetic Resonance Imaging), radiographic images captured by an FPD (Flat Panel Detector), and endoscopic images captured by an endoscope system. In this embodiment, an example of medical images in which multiple tomographic images captured by a CT device are used as diagnostic targets is described.

[0049] Shared server 16 includes a storage device that stores information added to medical images by information processing devices 11 to 14. Medical images stored in image archiving system 15 are associated with information added to these images and stored in shared server 16, using identification information such as patient IDs (IDentifiers) and study IDs.

[0050] Next, refer to Figure 2 The hardware structure of the information processing device 11 involved in this embodiment will be described. In addition, the hardware structure of the information processing devices 12 to 14 is the same as that of the information processing device 11, so the description thereof will be omitted. Figure 2As shown, information processing device 11 includes a CPU (Central Processing Unit) 20, a memory 21 serving as a temporary storage area, and a nonvolatile storage unit 22. Furthermore, information processing device 11 includes a display 23 such as a liquid crystal display, input devices 24 such as a keyboard and a mouse, and a network interface (I / F) 25 for connecting to a network. CPU 20, memory 21, storage unit 22, display 23, input device 24, and network I / F 25 are connected to a bus 27.

[0051] The storage unit 22 is implemented by an HDD (Hard Disk Drive), an SSD (Solid State Drive), a flash memory, or the like. The storage unit 22, serving as a storage medium, stores an information processing program 30. The CPU 20 reads the information processing program 30 from the storage unit 22, expands it into the memory 21, and executes the expanded information processing program 30.

[0052] Next, refer to Figure 3 The functional structure of the information processing device 11 involved in this embodiment is described. Figure 3 As shown, the information processing device 11 includes an acquisition unit 40, a detection unit 42, and a transmission unit 44. The CPU 20 of the information processing device 11 functions as the acquisition unit 40, the detection unit 42, and the transmission unit 44 by executing the information processing program 30.

[0053] The acquisition unit 40 acquires the medical image of the diagnostic target from the image storage system 15 via the network interface 25. The detection unit 42 performs lesion detection processing on the medical image acquired by the acquisition unit 40. For example, the detection unit 42 uses a well-known CAD lesion detection algorithm to perform lesion detection processing on the medical image. This algorithm is prepared in advance based on, for example, the imaging site and the type of lesion being detected. Furthermore, in the lesion detection processing of this embodiment, lesions of a size greater than a predetermined threshold are detected. This threshold is predetermined based on, for example, the imaging site and the type of lesion being detected.

[0054] The detector 42 may also perform lesion detection on medical images using a detection model obtained through machine learning such as deep learning. Furthermore, the detector 42 may perform lesion detection on medical images by filtering using a filter for lesion detection.

[0055] The sending unit 44 transmits the results of the lesion detection process performed by the detection unit 42 (hereinafter referred to as the "lesion detection result") to the shared server 16 via the network I / F 25. The shared server 16 stores the lesion detection result transmitted from the information processing device 11. When the detection unit 42 detects a lesion, the lesion detection result includes information indicating the detected lesion. Examples of information indicating the lesion include the type of lesion, the location of the lesion within the medical image, and the size of the lesion. On the other hand, when the detection unit 42 does not detect a lesion, the lesion detection result includes information indicating that no lesion was detected. Furthermore, the sending unit 44 can transmit the lesion detection result via the network I / F 25 to the information processing device 12.

[0056] Next, refer to Figure 4 The functional structure of the information processing device 12 according to this embodiment will be described. Figure 4 As shown, information processing device 12 includes acquisition unit 50, display control unit 52, reception unit 54, and transmission unit 56. CPU 20 of information processing device 12 functions as acquisition unit 50, display control unit 52, reception unit 54, and transmission unit 56 by executing information processing program 30.

[0057] The acquisition unit 50 acquires the medical image to be diagnosed from the image storage system 15 via the network I / F 25. The acquisition unit 50 also acquires the lesion detection result corresponding to the medical image to be diagnosed from the shared server 16 via the network I / F 25.

[0058] The display control unit 52 controls the display of the medical image and lesion detection result acquired by the acquisition unit 50 on the display 23. An example of the first display screen displayed on the display 23 of the information processing device 12 by this control is shown in FIG. Figure 5 middle.

[0059] like Figure 5 As shown, the first display screen includes a display area A1 for medical images, a display area A2 for patient information, a display area A3 for lesion detection results, and a display area A4 for inputting first input information entered by the photographer. Display area A1 displays a medical image of the diagnostic target acquired by the acquisition unit 50. The slice position of the medical image initially displayed in display area A1 is pre-set, and the photographer can switch the medical image displayed in display area A1 by, for example, scrolling with a mouse wheel.

[0060] The patient information such as the patient's name, age, and ID is displayed in the display area A2. When a lesion is detected by the information processing device 11, the lesion can be distinguishably displayed in the display area A3. In this case, for example, the medical image in which the lesion is detected is displayed in a state where the frame of the detected lesion is colored in the display area A3. Figure 5 shows an example in which lesions are detected from three medical images, with the detected lesions outlined by dashed lines. Furthermore, if no lesion is detected by the information processing device 11, a message indicating that no lesion has been detected is displayed in display area A3. In this case, for example, a message stating "No lesion detected" is displayed in display area A3.

[0061] Display area A4 includes a display area A5 for inputting information indicating approval or disapproval of the lesion detection result, and a display area A6 for inputting an additional report. If the photographer approves the lesion detection result by referring to display area A3, they input the information indicating approval by checking the "Positive" checkbox in display area A5 via input device 24. On the other hand, if the photographer disapproves of the lesion detection result by referring to display area A3, they input the information indicating disapproval by checking the "Negative" checkbox in display area A5 via input device 24. This information input via display area A5 is an example of first input information.

[0062] Furthermore, if an undetected lesion is found in a medical image that is not included in the lesion detection results, the photographer inputs information indicating the undetected lesion as first input information via input device 24. For example, the photographer inputs information indicating the location and size of the lesion by tracing the outer frame of the discovered lesion within the medical image displayed in display area A1, and inputs information indicating the type of the lesion in display area A6. Furthermore, if additional information is required, the photographer inputs that information in display area A6.

[0063] The receiving unit 54 receives the first input information input by the photographer regarding the lesion detection result input as described above. The transmitting unit 56 transmits the first input information received by the receiving unit 54 to the shared server 16 via the network I / F 25. The shared server 16 stores the first input information transmitted from the information processing device 12. Alternatively, the transmitting unit 56 may transmit the first input information to the information processing device 13 via the network I / F 25.

[0064] Next, refer to Figure 6 The functional structure of the information processing device 13 involved in this embodiment is described. Figure 6As shown, information processing device 13 includes acquisition unit 60, display control unit 62, reception unit 64, and transmission unit 66. CPU 20 of information processing device 13 functions as acquisition unit 60, display control unit 62, reception unit 64, and transmission unit 66 by executing information processing program 30.

[0065] The acquisition unit 60 acquires the medical image to be diagnosed from the image storage system 15 via the network I / F 25. The acquisition unit 60 also acquires the lesion detection result and the first input information corresponding to the medical image to be diagnosed from the shared server 16 via the network I / F 25.

[0066] The display control unit 62 controls the display 23 to display the medical image, lesion detection result, and first input information acquired by the acquisition unit 60. An example of the second display screen displayed on the display 23 of the information processing device 13 by this control is shown in FIG. Figure 7 middle.

[0067] like Figure 7 As shown, the second display screen includes a display area B1 for medical images, a display area B2 for patient information, a display area B3 for lesion detection results, a display area B4 for the input field for the second input information entered by the image reader, and a display area B7 for the first input information. Display area B4 includes a display area B5 for the input field indicating whether the lesion detection result is approved or not, and a display area B6 for the input field for additional reports. Display areas B1 to B6 are the same as display areas A1 to A6, and therefore their description is omitted here.

[0068] The display area B7 includes a display area B8 for information indicating whether the photographer agrees or disagrees with the lesion detection result, and a display area B9 for lesions that are not included in the lesion detection result and are found by the photographer and input as the first input information. Figure 7 , an example is shown in which the lesion detection result is displayed in the upper portion of the display area B8 and a check mark is placed on the "positive" in the lower portion, that is, an example in which the photographer agrees with the lesion detection result. Figure 7 In the example, the upper portion of the display area B9 displays the lesion found by the photographer, and the lower portion is provided with an input field for inputting information indicating whether the viewer agrees or disagrees with the lesion found by the photographer.

[0069] If the reader approves of the lesion detection result by referring to display area B3, they enter information indicating their approval of the lesion detection result by checking the "Positive" checkbox in display area B5 via input device 24. On the other hand, if the reader disapproves of the lesion detection result by referring to display area B3, they enter information indicating their disapproval of the lesion detection result by checking the "Negative" checkbox in display area B5 via input device 24. This information entered via display area B5 is an example of second input information.

[0070] Furthermore, if the viewer discovers an undetected lesion in the medical image that is not included in the execution results and the first input information, they input information indicating the undetected lesion as second input information via input device 24. For example, the viewer may enter information indicating the location and size of the lesion by tracing the outer frame of the discovered lesion within the medical image displayed in display area B1, and also enter information indicating the type of lesion in display area B6. If additional information is required, the viewer enters that information in display area B6.

[0071] Furthermore, if the reader agrees with the lesion found by the photographer and included in the first input information, he or she enters information indicating approval of the first input information by placing a check mark in the "Positive" checkbox in the display area B9 via the input device 24. On the other hand, if the reader disagrees with the lesion found by the photographer and included in the first input information, he or she enters information indicating disapproval of the first input information by placing a check mark in the "Negative" checkbox in the display area B9 via the input device 24. This information entered via the display area B9 is also an example of second input information.

[0072] The receiving unit 64 receives the second input information input by the image reader in response to the lesion detection results and the first input information input as described above. The transmitting unit 66 transmits the second input information received by the receiving unit 64 to the shared server 16 via the network I / F 25. The shared server 16 stores the second input information transmitted from the information processing device 13. Alternatively, the transmitting unit 66 can transmit the second input information to the information processing device 14 via the network I / F 25.

[0073] Next, refer to Figure 8 The functional structure of the information processing device 14 according to this embodiment will be described. Figure 8 As shown, information processing device 14 includes acquisition unit 70, display control unit 72, reception unit 74, and transmission unit 76. CPU 20 of information processing device 14 functions as acquisition unit 70, display control unit 72, reception unit 74, and transmission unit 76 by executing information processing program 30.

[0074] The acquisition unit 70 acquires the medical image to be diagnosed from the image storage system 15 via the network I / F 25. The acquisition unit 70 also acquires the lesion detection result and second input information corresponding to the medical image to be diagnosed from the shared server 16 via the network I / F 25.

[0075] The display control unit 72 controls the display of the medical image, lesion detection result, and second input information acquired by the acquisition unit 70 on the display 23. An example of the third display screen displayed on the display 23 of the information processing device 14 by this control is shown in FIG. Figure 9 middle.

[0076] like Figure 9 As shown, the third display screen includes a display area C1 for medical images, a display area C2 for patient information, a display area C3 for lesion detection results, a display area C4 for inputting comprehensive diagnostic results by the diagnostician, and a display area C7 for second input information. Display area C4 also includes a display area C5 for inputting information indicating approval or disapproval of the lesion detection results, and a display area C6 for inputting an additional report. Display areas C1 through C6 are identical to display areas B1 through B6, and their description is omitted here.

[0077] The display area C7 includes a display area C8 for information indicating whether the reader agrees or disagrees with the lesion detection result, and a display area C9 for lesions that are not included in the lesion detection result and are found by the reader and input as the second input information. Figure 9 , an example is shown in which the lesion detection result is displayed in the upper portion of the display area C8 and a check mark is placed on the "positive" in the lower portion, that is, an example in which the reader agrees with the lesion detection result. Figure 9 In the example, the upper portion of the display area C9 displays the lesion found by the image reader, and the lower portion is provided with an input field for inputting information indicating whether the diagnostician agrees or disagrees with the lesion found by the image reader.

[0078] When the diagnostician approves the lesion detection result by referring to the display area C3, he / she enters information indicating approval of the lesion detection result by checking the "positive" checkbox in the display area C5 via the input device 24. On the other hand, when the diagnostician disapproves of the lesion detection result by referring to the display area C3, he / she enters information indicating disapproval of the lesion detection result by checking the "negative" checkbox in the display area C5 via the input device 24.

[0079] Furthermore, when the diagnostician discovers an undetected lesion in the medical image that is not included in the execution result and the second input information, the diagnostician inputs information indicating the undetected lesion via the input device 24. For example, the diagnostician inputs information indicating the location and size of the lesion by tracing the outer frame of the discovered lesion in the medical image displayed in the display area C1, and inputs information indicating the type of the lesion in the display area C6.

[0080] Furthermore, when the diagnostician agrees with the lesion found by the reader and included in the second input information, the diagnostician enters information indicating approval of the second input information by placing a check mark in the "Positive" checkbox in the display area C9 via the input device 24. On the other hand, when the diagnostician disagrees with the lesion found by the reader and included in the second input information, the diagnostician enters information indicating disapproval of the second input information by placing a check mark in the "Negative" checkbox in the display area C9 via the input device 24.

[0081] The diagnostician then inputs a comprehensive diagnostic result into the display area C6 via the input device 24. Examples of comprehensive diagnostic results include messages such as "Suspected of having disease A, please visit hospital B." and "No particular problems." These are comprehensive diagnostic results related to the patient obtained by interpreting the medical images.

[0082] Receiving unit 74 receives various information including the comprehensive diagnostic results input as described above. Transmitting unit 76 transmits the various information including the comprehensive diagnostic results received by receiving unit 74 to shared server 16 via network I / F 25. Shared server 16 stores the information transmitted from information processing device 14. In other words, transmitting unit 76 stores the comprehensive diagnostic results received by receiving unit 74 in shared server 16.

[0083] Next, refer to Figures 10 to 13 The operation of the information processing system 10 according to this embodiment will be described. The CPU 20 of the information processing device 11 executes the information processing program 30. Figure 10 The first diagnostic support process is shown. Figure 10 The first diagnostic support process shown is executed when a photographer inputs an instruction to start the process via the input device 24 , for example.

[0084] Then, the CPU 20 of the information processing device 12 executes the information processing program 30 to execute Figure 11 The second diagnostic support process is shown. Figure 11 The second diagnostic support process shown is executed when the photographer inputs an instruction to start the process via the input device 24. The CPU 20 of the information processing device 13 executes the information processing program 30 to execute the second diagnostic support process. Figure 12The third diagnostic support process is shown. Figure 12 The third diagnostic support process shown is executed when the image interpreter inputs an instruction to start the process via the input device 24. The CPU 20 of the information processing device 14 executes the information processing program 30 to execute the third diagnostic support process. Figure 13 The fourth diagnostic support process is shown. Figure 13 The fourth diagnostic support process shown is executed when a diagnostician inputs an instruction to start the process via the input device 24 , for example.

[0085] exist Figure 10 In step S10, the acquisition unit 40 acquires the medical image of the diagnosis target from the image storage system 15 via the network I / F 25. In step S12, the detection unit 42 performs lesion detection processing on the medical image acquired in step S10. In step S14, the transmission unit 44 transmits the lesion detection result detected in step S12 to the shared server 16 via the network I / F 25. When step S14 is completed, the first diagnostic support process ends.

[0086] exist Figure 11 In step S20, the acquisition unit 50 acquires the medical image to be diagnosed from the image storage system 15 via the network I / F 25. Furthermore, the acquisition unit 50 acquires the lesion detection result corresponding to the medical image to be diagnosed from the shared server 16 via the network I / F 25.

[0087] In step S22, the display control unit 52 controls the display 23 to display the medical image and lesion detection result acquired in step S20. In step S24, as described above, the receiving unit 54 receives the first display screen (refer to FIG. 1 ) displayed on the display 23 after the processing in step S22 by the photographer. Figure 5 ) and input the first input information of the lesion detection result. In step S26, the transmission unit 56 transmits the first input information received in step S24 to the shared server 16 via the network I / F 25. When the processing of step S26 is completed, the second diagnosis support processing is completed.

[0088] exist Figure 12 In step S30, the acquisition unit 60 acquires the medical image to be diagnosed from the image storage system 15 via the network I / F 25. Furthermore, the acquisition unit 60 acquires the lesion detection result and the first input information corresponding to the medical image to be diagnosed from the shared server 16 via the network I / F 25.

[0089] In step S32, the display control unit 62 controls the display 23 to display the medical image, lesion detection result, and first input information acquired in step S30. In step S34, as described above, the receiving unit 54 receives the second display screen (refer to FIG. 1 ) displayed on the display 23 after the processing in step S32, which is received by the viewer. Figure 7 ) and the second input information inputted as the first input information. In step S36, the transmission unit 66 transmits the second input information received in step S34 to the shared server 16 via the network I / F 25. When the processing of step S36 is completed, the third diagnostic support processing ends.

[0090] exist Figure 13 In step S40, the acquisition unit 70 acquires the medical image to be diagnosed from the image storage system 15 via the network I / F 25. Furthermore, the acquisition unit 70 acquires the lesion detection result and the second input information corresponding to the medical image to be diagnosed from the shared server 16 via the network I / F 25.

[0091] In step S42, the display control unit 72 controls the display 23 to display the medical image, lesion detection result, and second input information acquired in step S40. In step S44, as described above, the receiving unit 74 receives the third display screen (refer to FIG. Figure 9 In step S46, the transmission unit 76 transmits the various information including the comprehensive diagnostic results received in step S44 to the shared server 16 via the network I / F 25. When the processing of step S46 is completed, the fourth diagnostic support processing is completed.

[0092] As described above, this embodiment enables a process in which the photographer, image reader, and diagnostician simply confirm computer-detected lesions and focus on areas in the medical image where no lesions have been detected. This improves the efficiency of the diagnostic process performed by the photographer, image reader, and diagnostician using CAD results.

[0093] In addition, in the above embodiment, it is also possible to adopt a method in which information indicating deletion of the lesion included in the lesion detection result is applied as the first input information and the second input information. In this case, as an example, Figure 14 As shown, the photographer enters a request to delete the lesion information included in the lesion detection results by checking the "Delete" checkbox in display area A5 via input device 24. In this case, shared server 16 deletes the information indicating the lesion from the lesion detection results.

[0094] Furthermore, in the above embodiment, the display control unit 72 can control the display 23 to display the first input information in addition to the medical image and the second input information. In this case, for example, the same display area as the display area B9 in the second display screen is provided in the third display screen.

[0095] Furthermore, in the above-described embodiment, when the lesion detection results include information indicating more than one lesion, the display control units 52, 62, and 72 may control the display of the medical images being diagnosed to be displayed with the number of medical images reduced. In this case, for example, when switching to display of tomographic images, the display control units 52, 62, and 72 may control the display of every other tomographic image, thereby reducing the number of medical images displayed by half.

[0096] Furthermore, in the above-described embodiment, for example, various processors as described below can be used as the hardware configuration of processing units that execute various processes, such as the functional units of information processing devices 11 to 14. These various processors include general-purpose processors (CPUs) that execute software (programs) to function as various processing units, as described above, as well as processors whose circuit configuration can be modified after manufacturing, such as FPGAs (Field Programmable Gate Arrays), programmable logic devices (PLDs), and application-specific integrated circuits (ASICs), which are processors with circuit configurations specifically designed to execute specific processes, such as dedicated circuits.

[0097] A single processing unit may be composed of one of these various processors, or a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs or a combination of a CPU and an FPGA). Furthermore, a single processor may constitute multiple processing units.

[0098] As examples of multiple processing units composed of a single processor, there is the following approach: A processor, such as in computers on client computers and servers, is constructed by combining one or more CPUs with software, and this processor functions as multiple processing units. A second approach is to use a processor, such as in system-on-chip (SoC) systems, that implements the functions of the entire system including multiple processing units on a single integrated circuit (IC). In this way, various processing units are constructed using one or more of these various processors as hardware.

[0099] Furthermore, as the hardware configuration of these various processors, more specifically, a circuit (circuitry) formed by combining circuit elements such as semiconductor elements can be used.

[0100] Furthermore, in the above embodiment, the information processing program 30 is described as being pre-stored (installed) in the storage unit 22, but the present invention is not limited to this. The information processing program 30 may also be provided by being recorded on a recording medium such as a CD-ROM (Compact Disc Read Only Memory), a DVD-ROM (Digital Versatile Disc Read Only Memory), or a USB (Universal Serial Bus) memory device. Furthermore, the information processing program 30 may be downloaded from an external device via a network.

[0101] Explanation of symbols

[0102] 10-Information processing system, 11, 12, 13, 14-Information processing device, 15-Image storage system, 16-Shared server, 20-CPU, 21-Memory, 22-Storage unit, 23-Display, 24-Input device, 25-Network I / F, 27-Bus, 30-Information processing program, 40, 50, 60, 70-Acquisition unit, 42-Detection unit, 44, 56, 66, 76-Transmission unit, 52, 62, 72-Display control unit, 54, 64, 74-Receiving unit, A1 to A6, B1 to B9, C1 to C9-Display area.

Claims

1. An information processing system comprising: A first information processing device for computer-based medical image diagnosis; a second information processing device for a photographer who takes medical images; a third information processing device for a reader who interprets medical images; a fourth information processing device for a diagnostician who performs a comprehensive diagnosis of a patient; Image storage system; and Shared servers, where The information processing system is composed of: The first information processing device, the second information processing device, the third information processing device, and the fourth information processing device each include at least one processor. The processor of the first information processing device performs the following processing: Acquire a medical image of a diagnosis object from the image storage system, Performing lesion detection processing on the acquired medical images, sending the execution result of the lesion detection process to the shared server, The processor of the second information processing device performs the following processing: performing control to display the medical image acquired from the image storage system and the execution result acquired from the shared server on a first display screen, the first display screen including an input area for information indicating approval or disapproval of the execution result and an input area for information indicating undetected lesions not included in the execution result, receiving an input from a photographer into an input area on the first display screen as first input information, Sending the first input information to the shared server, The processor of the third information processing device performs the following processing: performing control to display the medical image acquired from the image storage system, the execution result acquired from the shared server, and the first input information on a second display screen, the second display screen including an input area for information indicating approval or disapproval of the execution result, an input area for information indicating approval or disapproval of the first input information, and an input area for information indicating undetected lesions not included in the execution result and the first input information, receiving an input from the image reader into the input area on the second display screen as second input information, sending the second input information to the shared server, The processor of the fourth information processing device performs the following processing: performing control to display the medical image acquired from the image storage system, the execution result acquired from the shared server, and the second input information on a third display screen, the third display screen including an input area for information indicating approval or disapproval of the execution result, an input area for information indicating approval or disapproval of the second input information, and an input area for information indicating undetected lesions not included in the execution result and the second input information, receiving an input from a diagnosing person into an input area on the third display screen as a comprehensive diagnosis result, The diagnosis result is saved to the shared server.

2. The information processing system according to claim 1, wherein The first input information is information indicating that the lesion included in the execution result is to be deleted.

3. The information processing system according to claim 1, wherein: The processor of the fourth information processing device is configured to perform control to display the first input information in addition to the medical image and the second input information.

4. The information processing system according to claim 1, wherein: There are multiple medical images of the diagnosis object. In a case where the execution result includes information representing more than one lesion, when displaying a medical image of the diagnosis object, the processors of the second information processing device, the third information processing device, and the fourth information processing device are configured to perform control to display a state in which the number of medical images is reduced.

5. An information processing method, performed by an information processing system comprising a first information processing device for computer-based medical image diagnosis, a second information processing device for a photographer who photographs medical images, a third information processing device for a reader who interprets medical images, a fourth information processing device for a diagnostician who performs a comprehensive diagnosis of a patient, an image storage system, and a shared server, wherein: The information processing method includes: The processor included in the first information processing device performs the following processing: Acquire a medical image of a diagnosis object from the image storage system, Performing lesion detection processing on the acquired medical images, sending the execution result of the lesion detection process to the shared server, The processor included in the second information processing device performs the following processing: performing control to display the medical image acquired from the image storage system and the execution result acquired from the shared server on a first display screen, the first display screen including an input area for information indicating approval or disapproval of the execution result and an input area for information indicating undetected lesions not included in the execution result, receiving an input from a photographer into an input area on the first display screen as first input information, Sending the first input information to the shared server, The processor included in the third information processing device performs the following processing: performing control to display the medical image acquired from the image storage system, the execution result acquired from the shared server, and the first input information on a second display screen, the second display screen including an input area for information indicating approval or disapproval of the execution result, an input area for information indicating approval or disapproval of the first input information, and an input area for information indicating undetected lesions not included in the execution result and the first input information, receiving an input from the image reader into the input area on the second display screen as second input information, sending the second input information to the shared server, The processor included in the fourth information processing device performs the following processing: performing control to display the medical image acquired from the image storage system, the execution result acquired from the shared server, and the second input information on a third display screen, the third display screen including an input area for information indicating approval or disapproval of the execution result, an input area for information indicating approval or disapproval of the second input information, and an input area for information indicating undetected lesions not included in the execution result and the second input information, receiving an input from a diagnosing person into an input area on the third display screen as a comprehensive diagnosis result, The diagnosis result is saved to the shared server.

6. A storage medium, a non-transitory storage medium storing a program, wherein the program causes the information processing devices to execute information processing in an information processing system comprising a first information processing device for computer-based medical image diagnosis, a second information processing device for a photographer who photographs medical images, a third information processing device for a reader who interprets medical images, a fourth information processing device for a diagnostician who performs a comprehensive diagnosis of a patient, an image storage system, and a shared server. The information processing includes: The processor included in the first information processing device executes the following processing: Acquire a medical image of a diagnosis object from the image storage system, Performing lesion detection processing on the acquired medical images, sending the execution result of the lesion detection process to the shared server, The processor included in the second information processing device executes the following processing: performing control to display the medical image acquired from the image storage system and the execution result acquired from the shared server on a first display screen, the first display screen including an input area for information indicating approval or disapproval of the execution result and an input area for information indicating undetected lesions not included in the execution result, receiving an input from a photographer into an input area on the first display screen as first input information, Sending the first input information to the shared server, The processor included in the third information processing device executes the following processing: performing control to display the medical image acquired from the image storage system, the execution result acquired from the shared server, and the first input information on a second display screen, the second display screen including an input area for information indicating approval or disapproval of the execution result, an input area for information indicating approval or disapproval of the first input information, and an input area for information indicating undetected lesions not included in the execution result and the first input information, receiving an input from the image reader into the input area on the second display screen as second input information, sending the second input information to the shared server, The processor included in the fourth information processing device executes the following processing: performing control to display the medical image acquired from the image storage system, the execution result acquired from the shared server, and the second input information on a third display screen, the third display screen including an input area for information indicating approval or disapproval of the execution result, an input area for information indicating approval or disapproval of the second input information, and an input area for information indicating undetected lesions not included in the execution result and the second input information, receiving an input from a diagnosing person into an input area on the third display screen as a comprehensive diagnosis result, The diagnosis result is saved to the shared server.

Images