Program, information processing device, information processing system, and information processing method
The system addresses false positives in lesion detection by distinguishing and highlighting them differently from true positives, enhancing diagnostic efficiency and accuracy.
Patent Information
- Application Number
- JP2024214262
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2024-12-09
- Publication Date
- 2025-10-28
- Estimated Expiration
- 2042-06-14
AI Technical Summary
Lesion detection areas identified by computer processing, such as CAD and AI, often result in false positives, leading to annoyance for experienced doctors and potential misdiagnosis by inexperienced doctors.
A system that distinguishes and displays false positive lesion detection areas differently from true positives by comparing current and past images, using AI analysis and user input to highlight false positives in a distinct manner.
Enables users to recognize and differentiate false positive lesion detection areas, reducing repetitive false alarms and improving diagnostic accuracy.
Smart Images

Figure 0007761120000001 
Figure 0007761120000002 
Figure 0007761120000003
Abstract
Description
[Technical Field]
[0001] The present invention relates to a program, an information processing device, an information processing system, and an information processing method. [Background technology]
[0002] In recent years, computer-aided detection / diagnosis (CAD) systems have been put into practical use. These systems use computers to analyze medical images, and present the lesion detection areas detected by the image analysis to doctors for their judgment.
[0003] For example, Patent Document 1 discloses that annotations are added to lesion detection regions detected by CAD. Recently, computer processing such as AI (Artificial Intelligence) analysis based on machine learning and deep learning technology has been applied to medical images to identify potential lesion areas in the images. Systems capable of detecting areas have also been proposed. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Patent No. 4651353 Summary of the Invention [Problem to be solved by the invention]
[0005] Lesion detection areas detected by computer processing such as CAD and AI often have false positives, so doctors must determine whether the lesion detection areas detected by the computer are false positives.
[0006] However, when a computer detects lesions in a new image of the same patient, the computer may again detect and display as a lesion detection area even if that area corresponds to a lesion detection area that the doctor judged to be a false positive in the previous image. Therefore, for example, experienced doctors or doctors who have previously interpreted the image may find it annoying to see a false positive result displayed again, while inexperienced doctors or doctors who have not previously interpreted the image may run the risk of overlooking a false positive.
[0007] The present invention has been made in consideration of the above-mentioned problems in the conventional technology, and an object of the present invention is to enable a user to recognize false positive areas among lesion detection areas obtained by computer processing. [Means for solving the problem]
[0008] In order to solve the above problems, the program of the present invention comprises: On the computer, a first acquisition function that acquires information input by a user regarding a first analysis result including at least one lesion detection region obtained by computer processing of a first medical image of a patient, the information being input by a user regarding whether or not at least one of the lesion detection regions is a false positive or a true positive; a second acquisition function for acquiring a second analysis result including at least one lesion detection region obtained by computer processing of a second medical image of the patient; a display function that displays, among the lesion detection areas obtained by the second acquisition function, an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which the first acquisition function has obtained information that the area is a false positive or information that the area is considered to be a false positive, in a display mode that differs from a display mode that displays an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which the first acquisition function has obtained information that the area is not a false positive or information that the area is considered to be a false positive; Execute the following.
[0009] Further, the information processing device of the present invention comprises: a first acquisition means for acquiring information input by a user regarding a first analysis result including at least one lesion detection region obtained by computer processing of a first medical image of a patient, the information being input by a user regarding whether or not at least one of the lesion detection regions is a false positive or a true positive; a second acquisition means for acquiring a second analysis result including at least one lesion detection region obtained by computer processing of the second medical image of the patient; a display control means for displaying, among the lesion detection areas obtained by the second acquisition means, an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which the first acquisition means has obtained information that the area is a false positive or information that the area is considered to be a false positive, in a display manner different from that of an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which the first acquisition means has obtained information that the area is not a false positive or information that the area is considered to be a false positive; Execute the following.
[0010] Further, the information processing system of the present invention comprises: a first acquisition means for acquiring information input by a user regarding a first analysis result including at least one lesion detection region obtained by computer processing of a first medical image of a patient, the information being input by a user regarding whether or not at least one of the lesion detection regions is a false positive or a true positive; a second acquisition means for acquiring a second analysis result including at least one lesion detection region obtained by computer processing of the second medical image of the patient; a display control means for displaying, among the lesion detection areas obtained by the second acquisition means, an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which the first acquisition means has obtained information that the area is a false positive or information that the area is considered to be a false positive, in a display manner different from that of an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which the first acquisition means has obtained information that the area is not a false positive or information that the area is considered to be a false positive; Equipped with.
[0011] Further, the information processing method of the present invention comprises: a first acquisition step of acquiring information input by a user regarding a first analysis result including at least one lesion detection region obtained by computer processing of a first medical image of a patient, the information being input by a user regarding whether or not at least one of the lesion detection regions is a false positive or a true positive; a second acquisition step of acquiring a second analysis result including at least one lesion detection region obtained by computer processing of the second medical image of the patient; a display step of displaying, among the lesion detection areas obtained in the second acquisition step, an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which information indicating that the area is a false positive or information regarding that the area is a false positive obtained in the first acquisition step, in a display mode different from that of an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which information indicating that the area is not a false positive or information regarding that the area is not a false positive obtained in the first acquisition step; Includes. [Effects of the Invention]
[0012] According to the present invention, it becomes possible for a user to recognize false positive regions among lesion detection regions obtained by computer processing. [Brief explanation of the drawings]
[0013] [Figure 1] FIG. 1 is a system configuration diagram of a medical image display system. [Figure 2] FIG. 2 is a block diagram showing the functional configuration of a medical image management server. [Figure 3] FIG. 4 is a diagram illustrating a data configuration of a data management table. [Figure 4] FIG. 2 is a block diagram showing a functional configuration of the information processing device. [Figure 5] 10 is a flowchart showing a medical image analysis process executed by the medical image management server. [Figure 6]10 is a flowchart showing an interpretation support process executed by the information processing device. [Figure 7] FIG. 10 is a diagram showing an example of an interpretation screen. [Figure 8] 7 is a flowchart showing an analysis result display process executed in step S16 of FIG. 6. [Figure 9] 10A and 10B are diagrams illustrating an example of a display of an analysis result of a current image in the present embodiment. [Figure 10] 10A and 10B are diagrams illustrating an example of a display of an analysis result of a current image in the present embodiment. [Figure 11] FIG. 10 is a diagram showing an example of a display (display of a pop-up screen) for notifying the user that the lesion detection area in the analysis results of the current image includes an area corresponding to an area registered as a false positive in a past image. [Figure 12] FIG. 10 is a diagram showing an example of a display (changing the display mode of the mouse cursor) to notify the user that the lesion detection area in the analysis results of the current image includes an area corresponding to an area registered as a false positive in a past image. [Figure 13] FIG. 10 is a diagram showing an example of a display (a change in the window display mode) for notifying the user that the lesion detection area in the analysis results of the current image includes an area corresponding to an area registered as a false positive in a past image. [Figure 14] 10A and 10B are diagrams illustrating an example of a display of an analysis result of a current image in the present embodiment. [Figure 15] 10A and 10B are diagrams illustrating an example of a display of an analysis result of a current image in the present embodiment. DETAILED DESCRIPTION OF THE INVENTION
[0014] Hereinafter, an embodiment of a program, an information processing device, an information processing system, and an information processing method according to the present invention will be described, but the scope of the invention is not limited to the illustrated examples.
[0015] [Configuration of medical image display system] FIG. 1 shows the system configuration of a medical image display system 100 as an information processing system. As shown in FIG. 1, the medical image display system 100 is composed of a medical image management server 10, modalities 20, 20, ..., and an information processing device 30, and each device is capable of data communication via a communication network N. Note that the information processing device 30 only needs to be connectable to the medical image management server 10 via the communication network N as necessary. In the medical image display system 100, medical images and analysis results stored in the medical image management server 10 can be displayed on the information processing device 30. Each device constituting the medical image display system 100 conforms to the HL7 (Health Level Seven) and DICOM (Digital Image and Communications in Medicine) standards, and communication between each device is performed in accordance with HL7 and DICOM. Note that the number of information processing devices 30 is not particularly limited.
[0016] The modality 20 takes an image of a patient (subject) and generates image data of a medical image. Examples of the modality 20 include computed radiography (CR), digital radiography (DR), computed tomography (CT), magnetic resonance imaging (MRI), ultrasonography (US), nuclear medicine (NM), and endoscope (ES). The modality 20 also attaches image attribute information related to the medical image to the medical image, including the patient ID, patient name, date of birth, sex, imaging date and time, image ID, modality, body part, and direction. Image data of the medical image generated by the modality 20 is transmitted to the medical image management server 10 .
[0017] The medical image management server 10 stores and manages image data of medical images generated in the modality 20. The medical image management server 10 may be, for example, a PACS (Picture Archiving and Communication System).
[0018] The information processing device 30 is a computer device such as a PC (Personal Computer) or a tablet. The information processing device 30 is used when a user such as a doctor interprets a medical image.
[0019] [Medical Image Management Server Configuration] 2 shows the functional configuration of the medical image management server 10. The medical image management server 10 is configured with a control unit 11, a communication unit 12, an image analysis unit 13, a storage unit 14, etc., and each unit is connected by a bus 15.
[0020] The control unit 11 is composed of a CPU (Central Processing Unit), RAM (Random Access Memory), etc., and comprehensively controls the processing operations of each unit of the medical image management server 10. Specifically, the CPU reads out various processing programs stored in the storage unit 14, expands them in the RAM, and performs various processes in cooperation with the programs.
[0021] The communication unit 12 is configured with a network interface or the like, and transmits and receives data to and from external devices connected via the communication network N. For example, the communication unit 12 receives medical images obtained by imaging a patient using the modality 20. The communication unit 12 also transmits medical images and analysis results requested by the information processing device 30 to the information processing device 30.
[0022] The image analysis unit 13 performs computer processing on medical images obtained by photographing a patient and generates analysis result data. Here, the computer processing used is, for example, AI analysis using AI (Artificial Intelligence) to perform image diagnosis and image analysis, including the detection of lesion candidates using CAD (Computer Aided Diagnosis). The analysis result data includes, for example, DICOM Grayscale Softcopy Presentation State (GSPS) data, overlay data, etc. The analysis result data includes an analysis result ID for identifying the analysis result and information on the detected lesion detection area (such as the position, type of lesion, and content of accompanying information (annotation information)). The image analysis unit 13 is realized by software processing through cooperation between a program stored in the storage unit 14 and the CPU of the control unit 11.
[0023] The storage unit 14 is configured by an HDD (Hard Disk Drive), a non-volatile semiconductor memory, etc., and stores various processing programs, parameters and files required for executing the programs, etc.
[0024] The storage unit 14 also stores a user management table 141 and a data management table 142. The storage unit 14 also has a medical image storage area 143, an analysis result storage area 144, and an interpretation result storage area 145.
[0025] The user management table 141 is a table for managing users (medical professionals such as doctors) who use the medical image display system 100. The user management table 141 stores, for each user, a user ID, password, name, affiliation, email address, telephone number, etc., in association with each other. The user ID is the user's identification information. The password is used for authentication when the user accesses the medical image management server 10 from the information processing device 30. The name is the user's name. The affiliation is information such as the medical facility and department to which the user belongs. The email address is the user's email address. The phone number is the user's phone number.
[0026] The data management table 142 is a table for managing data in the medical image management server 10. 3 shows the data configuration of the data management table 142. In the data management table 142, for each medical image stored in the medical image storage area 143, the image ID, patient ID, imaging date and time, modality, body part, direction, analysis result ID, interpretation result ID, etc. are stored in association with each other. The image ID is identification information for the medical image. The patient ID is identification information for the patient who was the subject of the medical image capture. The capture date and time is the date and time when the medical image was captured. The modality is the modality with which the medical image was captured. The part is the part that was the subject of the medical image capture. The direction is the capture direction of the medical image. The analysis result ID is identification information for the analysis result obtained by the image analysis unit 13 analyzing the medical image. The interpretation result ID is identification information for identifying the interpretation results of the medical image by the user (doctor).
[0027] The medical image storage area 143 stores image data of medical images received from the modality 20 . The analysis result storage area 144 stores data on the results of computer-processed analysis of medical images. Data on the results of interpretation of medical images by a doctor who is a user is stored in the image interpretation result storage area 145. The image interpretation results include an image interpretation result ID, information on the lesion input area entered by the user (position, type of lesion, content of supplementary information (e.g., annotation information), etc.), and information on whether each of the lesion detection areas included in the analysis results by computer processing entered by the user is a false positive (including position information of each lesion detection area in the analysis results, etc.).
[0028] When the control unit 11 receives a medical image from the modality 20 via the communication unit 12, it stores the medical image in the storage unit 14 and causes the image analysis unit 13 to analyze the medical image.
[0029] When a request for obtaining medical images and analysis results is received from the information processing device 30 via the communication unit 12, the control unit 11 reads the medical images and the analysis results from the memory unit 14 and provides the read medical images to the information processing device 30 via the communication unit 12. When a request for acquiring a previous image and interpretation results for an acquired medical image is received from the information processing device 30 via the communication unit 12, the control unit 11 reads out the previous image and its interpretation results from the storage unit 14 and provides the read medical image to the information processing device 30 via the communication unit 12. Here, the previous image is an image of the same part (direction) of the same patient as the medical image acquired by the information processing device 30, but is an image taken on a different date and time than the medical image.
[0030] [Configuration of information processing device] 4 shows the functional configuration of the information processing device 30. The information processing device 30 is configured to include a control unit 31, an operation unit 32, a display unit 33, a communication unit 34, a storage unit 35, etc., and each unit is connected via a bus 36.
[0031] The control unit 31 is composed of a CPU, RAM, etc., and comprehensively controls the processing operations of each unit of the information processing device 30. Specifically, the CPU reads out various processing programs stored in the storage unit 35, expands them in the RAM, and performs various processes in cooperation with the programs.
[0032] The operation unit 32 is configured with a keyboard having cursor keys, letter and number input keys, various function keys, etc., and a pointing device such as a mouse, and outputs operation signals input by key operations on the keyboard or mouse operations to the control unit 31. Furthermore, if the operation unit 32 is configured with a touch panel layered on the display unit 33, it outputs an operation signal to the control unit 31 according to the position of a touch operation by the user's finger, etc.
[0033] The display unit 33 is configured to include a monitor such as an LCD (Liquid Crystal Display), and displays various screens according to instructions of a display signal input from the control unit 31.
[0034] The communication unit 34 is configured by a network interface or the like, and transmits and receives data to and from external devices connected via the communication network N.
[0035] The storage unit 35 is configured with a HDD, a nonvolatile semiconductor memory, etc., and stores various processing programs, parameters and files required for executing the programs, etc. For example, the storage unit 35 stores an interpretation support processing program 351. The interpretation support processing program 351 is a program for executing the interpretation support processing (see FIG. 6) described below.
[0036] In the image interpretation support process, the control unit 31 acquires information input by the user regarding whether each of the lesion detection regions obtained by computer processing is a false positive or not, in response to the first analysis result including at least one lesion detection region obtained by computer processing of the first medical image of the patient. That is, the control unit 31 functions as a first acquisition unit.
[0037] Furthermore, the control unit 31 acquires a second analysis result including at least one lesion detection region obtained by computer processing of the second medical image of the patient. That is, the control unit 31 functions as a second acquisition means.
[0038] Furthermore, control unit 31 displays, among the lesion detection areas included in the second analysis result obtained by the second acquisition means, areas corresponding to the lesion detection areas included in the first analysis result for which the first acquisition means has acquired information indicating that the area is a false positive, in a display mode different from that of areas corresponding to the lesion detection areas included in the first analysis result for which the first acquisition means has acquired information indicating that the area is not a false positive. That is, control unit 31 functions as display control means.
[0039] The first medical image is an image captured on a different date and time than the second medical image. In this embodiment, a case will be described in which the first medical image is a past image and the second medical image is a current image. The current image is a newly captured medical image to be interpreted. The past image is a medical image captured in the past of the same patient as the current image (if there are multiple medical images captured on an earlier date and time than the current image, the most recent one will be used). Furthermore, in this embodiment, the first analysis result is an analysis result obtained by computer processing the past image. The second analysis result is an analysis result obtained by computer processing the current image. In this embodiment, the term "false-positive lesion detection area in a past image" refers to a lesion detection area included in the analysis result of a past image for which the user has input information indicating that it is a false positive. In other words, the term "false-positive lesion detection area in a past image" refers to a "lesion detection area included in the first analysis result for which information indicating that it is a false positive has been acquired by the first acquisition means." Furthermore, "lesion detection areas that are not false positives in past images" refers to lesion detection areas included in the analysis results of past images for which the user has input information that they are not false positives. In other words, "lesion detection areas that are not false positives in past images" refers to "lesion detection areas that are included in the first analysis results for which information that they are not false positives has been acquired by the first acquisition means."
[0040] Furthermore, the control unit 31 acquires a lesion input area input by the user for the first analysis result including at least one lesion detection area obtained by computer processing of the first medical image of the patient. That is, the control unit 31 functions as a third acquisition unit.
[0041] In addition, the control unit 31 displays, from among the lesion detection areas included in the second analysis result obtained by the second acquisition means, areas excluding areas corresponding to the lesion detection areas included in the first analysis result for which information indicating a false positive has been acquired by the first acquisition means, and areas that do not correspond to the lesion input areas acquired by the third acquisition means, in a display mode different from that of the areas corresponding to the lesion input areas and the areas corresponding to the lesion detection areas included in the first analysis result for which information indicating a false positive has been acquired by the first acquisition means.
[0042] [Operation in a medical image display system] Next, the operation of the medical image display system 100 will be described. 5 is a flowchart showing the medical image analysis process executed by the medical image management server 10. This process is realized by software processing in cooperation between the CPU of the control unit 11 and a program stored in the storage unit 14.
[0043] In the medical image management server 10, when medical images obtained by photographing a patient from the modality 20 are received via the communication unit 12 (step S1), the control unit 11 stores the received medical images in the medical image storage area 143 of the storage unit 14 (step S2). The control unit 11 also associates the image ID, patient ID, photographing date and time, modality, body part, direction, etc. included in the image attribute information of the received medical images, and stores them in the data management table 142 (see FIG. 3) of the storage unit 14.
[0044] Next, control unit 11 causes image analysis unit 13 to analyze the received medical image (step S3). Image analysis unit 13 analyzes the medical image using AI (artificial intelligence) to acquire a lesion detection area, and generates data of the analysis result including information on the acquired lesion detection area.
[0045] Next, the control unit 11 stores the analysis results obtained by the image analysis unit 13 in the storage unit 14 in association with the medical image (step S4), and ends the medical image analysis process. Specifically, the control unit 11 stores the analysis results in the analysis result storage area 144 of the storage unit 14, and stores the analysis result ID of the analysis result in the record corresponding to the medical image that was the subject of analysis in the data management table 142 of the storage unit 14.
[0046] When a user (doctor) accesses the medical image management server 10 from the information processing device 30, the user inputs a user ID and password by operating the operation unit 32, and the control unit 31 transmits the input user ID and password to the medical image management server 10 via the communication unit 34. When the medical image management server 10 receives a user ID and password via the communication unit 12, the control unit 11 determines whether the received user ID and password match any of the user ID and password combinations pre-registered in the user management table 141 of the memory unit 14, and if there is a match, allows the user to use the information processing device 30.
[0047] 6 is a flowchart showing the interpretation support processing executed by the information processing device 30. This processing is realized by software processing in cooperation between the CPU of the control unit 31 and an interpretation support processing program 351 stored in the storage unit 35.
[0048] In the image interpretation support process, the control unit 31 acquires the current image (second medical image) and its analysis result (second analysis result) from the medical image management server 10 via the communication unit 34 (step S11). For example, the control unit 31 transmits a request for acquiring a medical image including an image ID specified by a user's operation on the operation unit 32 to the medical image management server 10 via the communication unit 34. The control unit 11 of the medical image management server 10 reads out a medical image corresponding to the image ID included in the acquisition request from the medical image storage area 143, and transmits the medical image to the information processing device 30 via the communication unit 12. The control unit 11 also refers to the data management table 142 of the storage unit 14 to identify an "analysis result ID" from a record corresponding to the "image ID" of the current image, reads out an analysis result corresponding to this "analysis result ID" from the analysis result storage area 144, and transmits the analysis result to the information processing device 30 via the communication unit 12. The control unit 31 may acquire the current image from the modality 20 .
[0049] Next, the control unit 31 displays the image interpretation screen 331 on which the acquired current image is displayed on the display unit 33 (step S12).
[0050] The interpretation screen is a screen that displays medical images and allows a user (doctor) to perform interpretation and input interpretation results. Fig. 7 shows an example of an interpretation screen 331. As shown in Fig. 7, the interpretation screen 331 is provided with a medical image display area 331a for displaying the medical image to be interpreted, an analysis result display button 133b for instructing the display of the analysis results, an end button 133c for instructing the end of interpretation, a tool display area 331d, etc.
[0051] On the interpretation screen 331, for example, when a doctor, who is the user, specifies (e.g., right-clicks) the position of a region that appears to be a lesion on the medical image displayed on the interpretation screen 331 using the operation unit 32, a menu item (e.g., a right-click menu) including the type of lesion is displayed near the specified position. When the type of lesion in the specified region is selected from the menu items using the operation unit 32, additional information (e.g., additional information (annotation information)) indicating that the specified region is a lesion detection region detected by the user (referred to as a lesion input region) is added to the specified region, and the specified region is input as a lesion input region. Information about the lesion input region (the position of the lesion input region, the type of lesion, the contents of the additional information, etc.) is temporarily stored in RAM.
[0052] When the interpretation screen 331 is displayed, the control unit 31 determines whether or not an input operation in the lesion input area is detected by the operation unit 32 (step S13). When it is determined that an input operation in the lesion input area has not been detected (step S13; NO), the control unit 31 proceeds to step S15. If it is determined that an input operation in the lesion input area has been detected (step S13; YES), the control unit 31 stores the input information in the lesion input area in the RAM (step S14), and proceeds to step S15.
[0053] In step S15, control unit 31 determines whether or not an instruction to display the analysis results (detection results of the lesion detection area by computer processing) has been issued (step S15). For example, when the analysis result display button 331b is pressed by the operation unit 32, it is determined that an instruction to display the analysis result has been given. When it is determined that the display of the analysis result has not been instructed (step S15; NO), the control unit 31 proceeds to step S19. When it is determined that an instruction to display the analysis result has been issued (step S15; YES), the control unit 31 executes an analysis result display process (step S16).
[0054] 8 is a flowchart showing the analysis result display processing executed by the information processing device 30. This processing is realized by software processing in cooperation with the CPU of the control unit 31 and the analysis result display processing program stored in the storage unit 35.
[0055] First, the control unit 31 inquires of the medical image management server 10 via the communication unit 34 whether or not there is a past image (first medical image) of the same patient as the current image (step S161). For example, the control unit 31 transmits the image ID of the current image to the medical image management server 10 and inquires whether there are any past images of the same patient as the current image. The control unit 11 of the medical image management server 10 refers to the data management table 142 of the storage unit 14, determines whether there are any medical images in the medical image storage area 143 that share the same "patient ID," "modality," "site," and "direction" as the current image, and notifies the information processing device 30 of the determination result via the communication unit 12.
[0056] If the medical image management server 10 notifies the controller 31 that there are no past images of the same patient as the current image (step S161; NO), the controller 31 displays additional information (annotation information) in the lesion detection area of the displayed current image, which is included in the analysis results obtained in step S11 (step S162), and proceeds to step S17 in Figure 6.
[0057] If the medical image management server 10 notifies the controller 31 that a past image of the same patient as the current image exists (step S161; YES), the controller 31 acquires the past image (first medical image) and its interpretation results from the medical image management server 10 via the communication unit 34 (step S163). The control unit 11 of the medical image management server 10 refers to the data management table 142 of the storage unit 14, extracts the most recent record of a medical image that has the same "patient ID," "modality," "site," and "direction" as the current image and whose "photographing date and time" is earlier than that of the current image, and obtains the image ID (image ID of the past image) included in the extracted record. Then, the control unit 31 reads out the medical image corresponding to the obtained image ID from the medical image storage area 143 of the storage unit 14. The control unit 31 also refers to the data management table 142, identifies the "image interpretation result ID" from the record corresponding to the obtained image ID, reads out the image interpretation result corresponding to this "image interpretation result ID" from the image interpretation result storage area 145, and transmits the read medical image (past image) and image interpretation result to the information processing device 30 via the communication unit 12.
[0058] Next, the control unit 31 compares the analysis results of the current image with the interpretation results of the past image, and determines whether or not the lesion detection area included in the analysis results of the current image (lesion detection area of the current image) contains an area that corresponds to a false positive lesion detection area in the past image (step S164). In step S164, the control unit 31 executes, for example, the following processes (1) to (4) to determine whether or not the lesion detection area included in the analysis result of the current image includes an area corresponding to a false positive lesion detection area in the past image.
[0059] (1) First, the control unit 31 aligns the current image with the previous image. Specifically, the control unit 31 performs enlargement, reduction, rotation, etc. on both or either of the current image and the previous image to align the positions of bones, organs, etc. in the images between the current image and the previous image.
[0060] (2) Next, in conjunction with the alignment of the current image and the previous image, control unit 31 adjusts the positions of the lesion detection region included in the analysis result of the current image and the false-positive lesion detection region in the previous image. Specifically, control unit 31 converts the position of the lesion detection region included in the analysis result of the current image or the false-positive lesion detection region in the previous image to the position after alignment of the images.
[0061] (3) Next, the control unit 31 superimposes the lesion detection area included in the analysis results of the current image after position adjustment with the false positive lesion detection area in the past image, and calculates the degree of overlap between each lesion detection area included in the analysis results of the current image and each lesion detection area included in the analysis results of the past image. For example, if the position of the lesion detection area is specified by one point (center position), the control unit 31 calculates the overlap rate (degree of overlap) between the lesion detection area in the current image and a pre-specified range (e.g., a circle with a predetermined radius) from the lesion center position in the false-positive lesion detection area in the past image. Here, the pre-specified range can be changed for each medical facility (e.g., the medical facility where the imaging was performed, the medical facility to which the user belongs), the requesting department, the modality, and the imaging site. Alternatively, the user (doctor) may specify any value as the pre-specified range. For example, when the position of the lesion detection region is specified by an area, the control unit 31 calculates the overlap rate (degree of overlap) between the lesion detection region of the current image and the false positive lesion detection region of the past image.
[0062] (4) Next, the control unit 31 determines whether the degree of overlap between each lesion detection area included in the analysis result of the current image and each false-positive lesion detection area included in the analysis result of the past image is equal to or greater than a predetermined threshold. The threshold used here may be changeable for each medical facility, requesting department, imaging site, and user. If the degree of overlap between the lesion detection area in the current image and the false-positive lesion detection area in the previous image is equal to or greater than a predetermined threshold, control unit 31 determines that the lesion detection area in the current image for which the overlap degree was calculated matches the false-positive lesion detection area in the previous image, i.e., that the lesion detection area in the current image for which the overlap degree was calculated corresponds to the false-positive lesion detection area in the previous image.If the degree of overlap between the lesion detection area in the current image and the false-positive lesion detection area in the previous image is less than a predetermined threshold, control unit 31 determines that the lesion detection area in the current image for which the overlap degree was calculated does not match the false-positive lesion detection area in the previous image, i.e., that the lesion detection area in the current image for which the overlap degree was calculated does not correspond to the false-positive lesion detection area in the previous image.If at least one of the lesion detection areas in the current image corresponds to a false-positive lesion detection area in the previous image, control unit 31 determines that the lesion detection area included in the analysis result of the current image corresponds to a false-positive lesion detection area in the previous image.
[0063] It is also possible to simply determine that the lesion detection areas in the current image that match, partially overlap, or include the false positive lesion detection areas in the past image are areas that correspond to the false positive lesion detection areas in the past image, without calculating the degree of overlap in steps (3) and (4) above.
[0064] In step S164, if it is determined that the lesion detection areas included in the analysis results of the current image include areas that correspond to false positive lesion detection areas in the past image (step S164; YES), the control unit 31 displays the lesion detection areas of the current image that correspond to false positive lesion detection areas in the past image in a display mode different from that of the areas that correspond to non-false positive lesion detection areas in the past image (step S165).
[0065] For example, in current image 50 shown in FIG. 9, regions corresponding to lesion detection regions 41 to 45 in past image 40 are lesion detection regions 51 to 55, respectively, and if lesion detection region 45 is a false-positive lesion detection region, control unit 31 displays lesion detection region 55, which is the region corresponding to lesion detection region 45, in current image 50 displayed on interpretation screen 331 in a manner different from lesion detection regions 51 to 54. For example, as shown in "Analysis Result Display" in FIG. 9, first incidental information (annotation information) M1 to be attached to lesion detection region 55 is displayed in a manner different from second incidental information (annotation information) M2 to be attached to the other lesion detection regions 51 to 54. For example, at least one selected from the group consisting of shape, line type, thickness, color, brightness, transparency, and symbol of first incidental information M1 is made different from that of second incidental information M2, and first incidental information M1 is displayed highlighted relative to second incidental information M2. Further, the first incidental information M1 may be highlighted relative to the second incidental information M2 by adding at least one identifying information such as a character or a symbol to the first incidental information M1. Fig. 9 shows an example in which the first incidental information M1 is highlighted relative to the second incidental information M2 by changing the line style of the first incidental information M1. Alternatively, as shown in FIG. 10, the first incidental information may be hidden in lesion detection area 55, so that lesion detection area 55 is displayed in a manner different from lesion detection areas 51 to .
[0066] Furthermore, the control unit 31 warns the user that the lesion detection region included in the analysis result of the current image contains a region that corresponds to a false positive lesion detection region in the past image (step S166), and proceeds to step S167.
[0067] In step S166, the control unit 31 issues a warning to the user, for example, by notifying the user of predetermined information, by changing the display mode of the mouse cursor on the image interpretation screen 331, or by changing the display mode of the window on the image interpretation screen 331. Changing the display mode of the window includes changing the color of the background area in the window relative to the medical image display area 331a in the window. The background area includes, for example, the tool display area 331d in the window.
[0068] For example, as shown in FIG. 11, a pop-up window 332 is displayed on the image interpretation screen 331 to notify that a lesion detection area determined to be a false positive in the past image has been detected from the current image. Alternatively, as shown in FIG. 12, the color (or shape) of the mouse cursor 333 may be changed. 13, the color of the window frame 331e of the interpretation screen 331 is changed from the normal display color (see FIG. 7) and displayed. Alternatively, the color of at least one of the background areas 331d, 331f (including the tool display area 331d) in the window is changed relative to the medical image display area 331a in the window.
[0069] On the other hand, in step S164, if it is determined that the lesion detection area included in the analysis result of the current image does not have an area corresponding to the false positive lesion detection area in the past image (step S164; NO), the control unit 31 proceeds to step S167.
[0070] In step S167, the control unit 31 compares the lesion detection areas included in the analysis results of the current image, excluding areas corresponding to false positive lesion detection areas in the past image, with the lesion input areas entered by the user in the past image, included in the interpretation results of the past image, and determines whether there are any areas in the lesion detection areas of the current image, excluding areas corresponding to false positive lesion detection areas in the past image, that do not correspond to lesion input areas in the past image (step S167).
[0071] If it is determined that the lesion detection areas of the current image, excluding areas corresponding to false-positive lesion detection areas in the past image, contain areas that do not correspond to lesion input areas entered by the user in the past image (step S167; YES), the control unit 31 displays the lesion detection areas of the current image, excluding areas corresponding to false-positive lesion detection areas in the past image, that are determined not to correspond to lesion input areas in the past image, in a display mode different from the lesion detection areas determined to correspond to lesion input areas in the past image and the areas corresponding to false-positive lesion detection areas (step S168), and proceeds to step S17 in Figure 6.
[0072] For example, if lesion detection area 56 in Figure 9 is a lesion detection area that is determined not to correspond to a lesion input area entered by the user in a previous image, lesion detection area 56 is displayed in a manner different from lesion detection areas 51 to 55. For example, as shown in Fig. 14, third incidental information (annotation information) M3 attached to lesion detection region 56 is displayed in a different display mode from the first incidental information M1 and the second incidental information M2 attached to the other lesion detection regions 51 to 55. In Fig. 14, the third incidental information M3 is highlighted differently from the first incidental information M1 and the second incidental information M2 by using a different line type from the first incidental information M1 and a different color (brightness) from the second incidental information M2. Note that when the first incidental information M1 is not displayed, lesion detection region 56 is displayed in a different display mode from the second incidental information M2 attached to the other lesion detection regions 51 to 54, as shown in Fig. 15.
[0073] As a result, the lesion detection area obtained by computer processing from the current captured image (current image), excluding the area corresponding to the false positive lesion detection area in the past image, and the area that does not correspond to the lesion input area entered by the user in the past image, is displayed in a manner different from the area corresponding to the lesion input area in the past image and the area corresponding to the false positive lesion detection area, making it possible for the user to easily grasp the new lesion detection area obtained by computer processing from the current captured image (current image).
[0074] In this embodiment, the lesion input region input by the user in the past image is the region directly designated by the user as a lesion candidate in the past image, but this is not limited to this, and the region may be the region determined not to be a false positive based on the false positive information input by the user for each lesion detection region in the analysis results of the past image. Alternatively, the region may be the combined region of the region directly designated by the user as a lesion candidate in the past image and the region determined not to be a false positive based on the false positive information input by the user for each lesion detection region in the analysis results of the past image.
[0075] On the other hand, in step S167, if it is determined that there is no area in the lesion detection area of the current image that does not correspond to the lesion input area input by the user in the past image (step S167; NO), the control unit 31 proceeds to step S17 in Figure 6.
[0076] Here, when the analysis results are displayed, the image interpretation screen 331 allows the user to input information as to whether or not the displayed lesion detection region is a false positive. For example, when the supplementary information (annotation information) displayed on the medical image (current image) displayed on the image interpretation screen 331 is selected (e.g., right-clicked) using the operation unit 32, the control unit 31 displays the items "Register as false positive" and "Register as true positive" in a menu item (e.g., a right-click menu). A doctor, who is the user, can input information on whether the lesion detection area indicated by the selected supplementary information is a false positive by selecting "Register as false positive" or "Register as true positive" from the displayed menu items using the operation unit 32. To simplify the input operation, the menu item may display only "Register as false positive," allowing only lesion detection areas determined by the doctor as false positives to be input, with areas with no input considered to have been input as true positives. Alternatively, the menu item may display only "Register as true positive," allowing only lesion detection areas determined by the doctor as true positives to be input, with areas with no input considered to have been input as false positives. The user may also continue to input the lesion input area.
[0077] In step S17 of FIG. 6, the control unit 31 determines whether information on whether the displayed lesion detection region is a false positive or not or whether an input operation on the lesion input region has been detected (step S17). When it is determined that information on whether the displayed lesion detection region is a false positive or an input operation in the lesion input region has not been detected (step S17; NO), the control unit 31 proceeds to step S19. If it is determined that information on whether the displayed lesion detection area is a false positive or an input operation on the lesion input area has been detected (step S17; YES), the control unit 31 stores the input information on whether the lesion detection area is a false positive or the input lesion input area in RAM (step S18) and proceeds to step S19.
[0078] In step S19, the control unit 31 determines whether or not an instruction to end the interpretation has been given by the operation unit 32 (step S19). For example, when the end button 331c displayed on the image interpretation screen 331 is pressed by the operation unit 32, the control unit 31 determines that an instruction to end the image interpretation has been issued. When it is determined that the end of interpretation has not been instructed by the operation unit 32 (step S19; NO), the control unit 31 determines whether or not the analysis results are being displayed (step S20). If it is determined that the analysis result is being displayed (step S20; YES), the control unit 31 returns to step S17. If it is determined that the analysis result is not being displayed (step S20; NO), the control unit 31 returns to step S13.
[0079] On the other hand, if it is determined in step S19 that the operation unit 32 has instructed to end the interpretation (step S19; YES), the control unit 31 assigns the image ID of the current image to the interpretation results stored in RAM (information on whether the lesion detection area included in the analysis result of the current image is a false positive or not and information on the lesion input area entered by the user), and transmits them to the medical image management server 10 via the communication unit 34 (step S21), and ends the interpretation support processing.
[0080] In the medical image management server 10, when the communication unit 12 receives the interpretation results from the information processing device 30, the control unit 11 associates the received interpretation results with the medical image and stores them in the interpretation result storage area 145. For example, the control unit 11 assigns an interpretation result ID to the received interpretation results and stores them in the interpretation result storage area 145, extracts a record of the image ID corresponding to the interpretation results from the data management table 142, and registers the interpretation result ID assigned to the received interpretation results in the "interpretation result ID" field of the extracted record.
[0081] As described above, according to this embodiment, the control unit 31 of the information processing device 30 obtains information on whether each of the lesion detection areas input by the user is a false positive for the analysis result (first analysis result) including at least one lesion detection area obtained by computer processing of the patient's past image (first medical image), obtains the analysis result (second analysis result) including at least one lesion detection area obtained by computer processing of the patient's current image (second medical image), and displays, among the lesion detection areas included in the analysis result of the current image, areas corresponding to false positive lesion detection areas in the past image in a display mode different from areas corresponding to lesion detection areas that are not false positive. Therefore, it is possible for the user to recognize false positive regions among the lesion detection regions obtained by computer processing, thereby preventing false positives from being overlooked.
[0082] For example, the control unit 31 displays, in different display modes, first annotated information (annotation information) to be attached to areas of the lesion detection areas included in the analysis results of the current image that correspond to false positive lesion detection areas in the past image, and second annotated information (annotation information) to be attached to areas that correspond to non-false positive lesion detection areas, thereby enabling the user to distinguish and recognize false positive lesion detection areas from non-false positive lesion detection areas among the lesion detection areas obtained by computer processing.
[0083] Furthermore, for example, the control unit 31 can hide the first ancillary information that is attached to areas of the lesion detection areas included in the analysis results of the current image that correspond to false positive lesion detection areas in the past image, thereby displaying the areas corresponding to false positive lesion detection areas included in the analysis results of the past image in a different display mode from the areas corresponding to non-false positive lesion detection areas, thereby eliminating the annoyance of having false positive results displayed again.
[0084] Furthermore, control unit 31 displays, among the lesion detection areas included in the analysis results of the current image, areas that do not correspond to the lesion input area entered by the user, excluding areas that correspond to the lesion detection areas that are false positives in the past image, in a display mode different from that of areas that correspond to the lesion input area and areas that correspond to the lesion detection areas that are false positives. This allows the user to easily recognize, for example, newly detected areas among the lesion detection areas included in the analysis results of the current image.
[0085] Furthermore, when there is a lesion detection area included in the analysis results of the current image that corresponds to a lesion detection area that is a false positive in the past image, control unit 31 notifies the user of predetermined information, changes the display mode of the mouse cursor, or changes the display mode of the window to display it. This allows the user to easily recognize that there is a lesion detection area included in the analysis results of the current image that corresponds to a lesion detection area that is a false positive in the past image.
[0086] Furthermore, control unit 31 highlights the first incidental information to be attached to regions of the lesion detection regions included in the analysis results of the current image that correspond to false-positive lesion detection regions in the past image, thereby displaying the regions in a different display mode from regions of the past image that correspond to non-false-positive lesion detection regions. This allows the user to easily recognize regions of the lesion detection regions included in the analysis results of the current image that correspond to false-positive lesion detection regions in the past image.
[0087] The above-described embodiments are merely examples of the program, information processing device, information processing method, and information processing system according to the present invention, and are not intended to limit the scope of the present invention. The detailed configuration and operation of each device constituting the system may also be modified as appropriate without departing from the spirit of the present invention.
[0088] For example, in the above embodiment, when an instruction to display the analysis results is given, among the lesion detection areas obtained by computer processing, areas corresponding to false-positive lesion detection areas in the past image are displayed in a display mode different from that of areas corresponding to non-false-positive lesion detection areas in the past image. However, this is not limited to this. For example, a predetermined operation button such as a switching button may be provided on the interpretation screen 331. When an instruction to display the analysis results is given, the control unit 31 may first, in cooperation with the interpretation support processing program 351, display among the lesion detection areas obtained by computer processing, areas corresponding to false-positive lesion detection areas in the past image in the same display mode as areas corresponding to non-false-positive lesion detection areas in the past image. Then, in response to a user pressing the switching button on the operation unit 32, switch among the lesion detection areas obtained by computer processing, areas corresponding to false-positive lesion detection areas in the past image, from the same display mode as that of areas corresponding to non-false-positive lesion detection areas in the past image to a different display mode. For example, the first incidental information to be attached to an area corresponding to a false-positive lesion detection area in a past image may be displayed in a different display mode from the display mode of the second incidental information to be attached to an area corresponding to a non-false-positive lesion detection area in a past image. Alternatively, the first incidental information may be displayed in a different display mode from the first incidental information by switching to non-display. This allows the user to distinguish between lesion detection areas obtained by computer processing that correspond to false positive lesion detection areas in past images and areas that correspond to non-false positive lesion detection areas in past images, if the user wishes to do so.
[0089] Furthermore, each time the above-mentioned switching button is pressed, the first ancillary information to be attached to the area corresponding to the false positive lesion detection area in the past image may be displayed in the following manner: (A) displayed in the same display format as the second ancillary information to be attached to the area corresponding to the non-false positive lesion detection area in the past image → (B) displayed in a display format different from the second ancillary information to be attached to the area corresponding to the non-false positive lesion detection area in the past image → (C) not displayed.
[0090] In addition, in the above embodiment, the first incidental information attached to the area corresponding to the false positive lesion detection area in the past image is displayed in a different display mode from the second incidental information attached to the area corresponding to the non-false positive lesion detection area in the past image, or the first incidental information is hidden, thereby displaying the two in different display modes. However, the control unit 31 may also display the two in different display modes by hiding the second incidental information in cooperation with the interpretation support processing program 351.
[0091] Furthermore, in the above embodiment, if the degree of overlap between the lesion detection area in the current image and the false-positive lesion detection area in the past image is equal to or greater than a predetermined threshold, the lesion detection area in the current image for which the degree of overlap was calculated is determined to match the false-positive lesion detection area in the past image, i.e., the lesion detection area in the analysis results of the current image is determined to correspond to the false-positive lesion detection area in the past image. However, even if a match is determined, if the degree of overlap is lower than a predetermined standard, there is a possibility of a mismatch. Therefore, for an area determined to correspond to a false-positive lesion detection area in the past image, the display of additional information (annotation information) may be changed depending on whether the degree of overlap is higher or lower than the standard.
[0092] In addition, in the above embodiment, the control unit 31 of the information processing device 30 functions as the first acquisition means, the second acquisition means, the third acquisition means, and the display control means, but a device other than the information processing device 30 may be equipped with each of the above means. In addition, in the above embodiment, the medical image management server 10 is equipped with the function of performing computer processing on medical images and generating analysis results, but a device other than the medical image management server 10 may also be equipped with the analysis function.
[0093] In the above embodiment, an example in which a chest image is used as a medical image is illustrated, but the imaging site is not limited to the chest. The medical image to be processed may be a plurality of slice images obtained by CT or the like, a multi-frame image (moving image), or an image obtained by 3D conversion of an image obtained by CT, MRI, or the like.
[0094] Furthermore, for example, when it is better not to display the additional information (annotation information) (if it becomes a nuisance), such as when playing back a moving image of a multi-frame image or when performing measurements, the analysis results may be automatically hidden.
[0095] In addition, in the above embodiment, the medical image management server 10 stores the image data of the medical image, the analysis result data, and the interpretation result data in separate areas (medical image storage area 143, analysis result storage area 144, interpretation result storage area 145), but at least one of the analysis result data and the interpretation result data may be incorporated into a medical image file containing the image data of the medical image.
[0096] The programs for executing the processes in each device may be stored on a portable recording medium, and a carrier wave may be used as a medium for providing program data via a communication line. [Explanation of symbols]
[0097] 10 Medical image management server 11 Control section 12 Communications Department 13 Image analysis unit 14 Storage section 20 Modalities 30 Information processing equipment 31 Control Unit 32 Operation section 33 Display section 331 Reading Screen 34 Communications Department 35 Storage section 100 Medical Image Display System 141 User Management Table 142 Data Management Table 143 Medical Image Storage Area 144 Analysis result storage area 145 Image interpretation result storage area 351 Image interpretation support processing program N Communication Network
Claims
1. On the computer, a first acquisition function that acquires information input by a user regarding a first analysis result including at least one lesion detection region obtained by computer processing of a first medical image of a patient, the information being input by a user regarding whether or not at least one of the lesion detection regions is a false positive or a true positive; a second acquisition function for acquiring a second analysis result including at least one lesion detection region obtained by computer processing of the second medical image of the patient; a display function that displays, among the lesion detection areas obtained by the second acquisition function, an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which the first acquisition function has obtained information that the area is a false positive or information that the area is considered to be a false positive, in a display mode that differs from a display mode that displays an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which the first acquisition function has obtained information that the area is not a false positive or information that the area is considered to be a false positive; A program that executes the following.
2. The program described in claim 1, characterized in that the display function displays, in different display modes, first incidental information to be attached to an area of the lesion detection area obtained by the second acquisition function that is in a positional relationship corresponding to the lesion detection area included in the first analysis result and for which information that the first acquisition function has obtained is a false positive or has deemed to be a false positive, and second incidental information to be attached to an area of the lesion detection area included in the first analysis result and for which information that the first acquisition function has obtained is not a false positive or has deemed to be a false positive.
3. The program described in claim 1, characterized in that the display function, in response to a specified user operation, switches the display mode of an area of the lesion detection area obtained by the second acquisition function that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which the first acquisition function has obtained information that the area is a false positive or has been deemed to be a false positive from the same display mode as an area of the lesion detection area included in the first analysis result for which the first acquisition function has obtained information that the area is not a false positive or has been deemed to be a false positive to a different display mode.
4. The program described in claim 3, characterized in that the display function, in response to a predetermined user operation, switches the display mode of first incidental information to be attached to an area of the lesion detection area obtained by the second acquisition function that is in a positional relationship corresponding to the lesion detection area included in the first analysis result and for which the first acquisition function has obtained information that the area is a false positive or has deemed to be a false positive, from the same display mode as the display mode of second incidental information to be attached to an area of the lesion detection area included in the first analysis result and for which the first acquisition function has obtained information that the area is not a false positive or has deemed to be a false positive, to a different display mode.
5. The program described in claim 2, characterized in that the display function hides first accompanying information to be attached to an area of the lesion detection area obtained by the second acquisition function that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which the first acquisition function has obtained information that the area is a false positive or has been deemed to be a false positive, thereby displaying the area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which the first acquisition function has obtained information that the area is a false positive or has been deemed to be a false positive in a display manner different from that of the area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which the first acquisition function has obtained information that the area is not a false positive or has been deemed to be a false positive.
6. The computer further comprises: execute a third acquisition function to acquire a lesion input region input by a user for at least one lesion detection region obtained by computer processing of a first medical image of a patient; The program according to claim 1, characterized in that the display function displays, from the lesion detection area obtained by the second acquisition function, an area that is excluding an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which information that the first acquisition function has obtained that the result is a false positive or that is deemed to be a false positive, and that is not in a positional relationship corresponding to the lesion input area obtained by the third acquisition function, in a display mode different from that of an area that is in a positional relationship corresponding to the lesion input area and an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which information that the first acquisition function has obtained that the result is a false positive or that is deemed to be a false positive.
7. 3. The program according to claim 2, wherein the first and second incidental information are annotation information.
8. The program described in claim 1, characterized in that when there is an area among the lesion detection areas obtained by the second acquisition function that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which information that the first acquisition function has obtained is a false positive or is considered to be a false positive is obtained, the display function notifies the user of specified information, changes the display mode of the mouse cursor to display it, or changes the display mode of the window to display it.
9. The program of claim 1, characterized in that the display function highlights first accompanying information to be attached to an area of the lesion detection area obtained by the second acquisition function that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which the first acquisition function has obtained information that the area is a false positive or has been deemed to be a false positive, thereby displaying the area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which the first acquisition function has obtained information that the area is a false positive or has been deemed to be a false positive in a different display manner from the area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which the first acquisition function has obtained information that the area is not a false positive or has been deemed to be a false positive.
10. The program according to claim 2, wherein the display function displays first incidental information to be attached to an area of the lesion detection area obtained by the second acquisition function that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which the first acquisition function has obtained information that the result is a false positive or that is deemed to be a false positive, and hides second incidental information to be attached to an area of the lesion detection area obtained by the second acquisition function that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which the first acquisition function has obtained information that the result is not a false positive or that is deemed to be a false positive, thereby displaying the area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which the first acquisition function has obtained information that the result is not a false positive or that is deemed to be a false positive in a different display manner from the area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which the first acquisition function has obtained information that the result is not a false positive or that is deemed to be a false positive.
11. The program of claim 1, wherein the display function displays the lesion detection area in the different display mode when it is determined that the lesion detection area included in the second analysis result has an area that is in a positional relationship corresponding to a false positive lesion detection area included in the first analysis result.
12. 12. The program according to claim 1, wherein the first medical image is an image captured on a different date and time from the second medical image.
13. a first acquisition means for acquiring information input by a user regarding a first analysis result including at least one lesion detection region obtained by computer processing of a first medical image of a patient, the information being input by a user regarding whether or not at least one of the lesion detection regions is a false positive or a true positive; a second acquisition means for acquiring a second analysis result including at least one lesion detection region obtained by computer processing of the second medical image of the patient; a display control means for displaying, among the lesion detection areas obtained by the second acquisition means, an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which the first acquisition means has obtained information that the area is a false positive or information that the area is considered to be a false positive, in a display mode different from a display mode for an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which the first acquisition means has obtained information that the area is not a false positive or information that the area is considered to be a false positive; An information processing device that executes the above.
14. The information processing device described in claim 13, characterized in that the display control means displays, in different display modes, first incidental information to be attached to an area of the lesion detection area obtained by the second acquisition means that is in a positional relationship corresponding to the lesion detection area included in the first analysis result, for which information that the first acquisition means has obtained that the area is a false positive or that is deemed to be a false positive, and second incidental information to be attached to an area of the lesion detection area included in the first analysis result, for which information that the first acquisition means has obtained that the area is not a false positive or that is deemed to be a false positive.
15. The information processing device described in claim 13, characterized in that the display control means, in response to a predetermined user operation, switches and displays an area of the lesion detection area obtained by the second acquisition means that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which the first acquisition means has obtained information that the area is a false positive or that is deemed to be a false positive from the same display mode as an area of the lesion detection area included in the first analysis result for which the first acquisition means has obtained information that the area is not a false positive or that is deemed to be a false positive, to a different display mode.
16. The information processing device described in claim 15, characterized in that the display control means, in response to a predetermined user operation, switches the display mode of first incidental information to be attached to an area of the lesion detection area obtained by the second acquisition means that is in a positional relationship corresponding to the lesion detection area included in the first analysis result, for which information that the first acquisition means has obtained information that the area is a false positive or that is deemed to be a false positive, from the same display mode as second incidental information to be attached to an area of the lesion detection area included in the first analysis result, for which information that the first acquisition means has obtained information that the area is not a false positive or that is deemed to be a false positive, to a different display mode.
17. The information processing device according to claim 14, characterized in that the display control means hides first incidental information to be attached to an area of the lesion detection area obtained by the second acquisition means that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which the first acquisition means has obtained information that the area is a false positive or has information that the area is considered to be a false positive, thereby displaying the area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which the first acquisition means has obtained information that the area is a false positive or has information that the area is considered to be a false positive in a display manner different from that of the area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which the first acquisition means has obtained information that the area is not a false positive or has information that the area is considered to be a false positive.
18. a third acquisition means for acquiring a lesion input area input by a user for at least one lesion detection area obtained by computer processing of a first medical image of a patient; 14. The information processing device according to claim 13, wherein the display control means displays, from the lesion detection area obtained by the second acquisition means, an area that is not in a positional relationship corresponding to the lesion input area obtained by the third acquisition means, excluding an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which information that the result is a false positive or information that the result is deemed to be a false positive obtained by the first acquisition means, in a display mode different from that of an area that is in a positional relationship corresponding to the lesion input area and an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which information that the result is a false positive or information that the result is deemed to be a false positive obtained by the first acquisition means.
19. 15. The information processing apparatus according to claim 14, wherein the first and second incidental information are annotation information.
20. The information processing device described in claim 13, characterized in that when there is an area among the lesion detection areas obtained by the second acquisition means that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which information that the first acquisition means has obtained is a false positive or information that is considered to be a false positive is obtained, the display control means notifies the user of specified information, changes the display mode of the mouse cursor, or changes the display mode of the window to display the information.
21. The information processing device described in claim 13, characterized in that the display control means highlights first incidental information to be attached to an area of the lesion detection area obtained by the second acquisition means that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which the first acquisition means has obtained information that the area is a false positive or information that the area is deemed to be a false positive, thereby displaying the area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which the first acquisition means has obtained information that the area is a false positive or information that the area is deemed to be a false positive in a display manner different from that of the area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which the first acquisition means has obtained information that the area is not a false positive or information that the area is deemed to be a false positive.
22. 15. The information processing device according to claim 14, wherein the display control means displays first incidental information to be attached to an area of the lesion detection area obtained by the second acquisition means that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which information that the first acquisition means has obtained that the area is a false positive or that is deemed to be a false positive, and hides second incidental information to be attached to an area of the lesion detection area obtained by the second acquisition means that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which information that the first acquisition means has obtained that the area is not a false positive or that is deemed to be a false positive, thereby displaying the area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which information that the first acquisition means has obtained that the area is not a false positive or that is deemed to be a false positive in a display manner different from the area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which information that the first acquisition means has obtained that the area is not a false positive or that is deemed to be a false positive.
23. 14. The information processing device according to claim 13, wherein the display control means displays the lesion detection area included in the second analysis result in the different display mode when it determines that the lesion detection area included in the second analysis result has an area that is in a positional relationship corresponding to a false positive lesion detection area included in the first analysis result.
24. The first medical image is an image taken on a different date and time from the second medical image.
24. The information processing device according to claim 13, wherein:
25. a first acquisition means for acquiring information input by a user regarding a first analysis result including at least one lesion detection region obtained by computer processing of a first medical image of a patient, the information being input by a user regarding whether or not at least one of the lesion detection regions is a false positive or a true positive; a second acquisition means for acquiring a second analysis result including at least one lesion detection region obtained by computer processing of the second medical image of the patient; a display control means for displaying, among the lesion detection areas obtained by the second acquisition means, an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which the first acquisition means has obtained information that the area is a false positive or information that the area is considered to be a false positive, in a display mode different from a display mode for an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which the first acquisition means has obtained information that the area is not a false positive or information that the area is considered to be a false positive; An information processing system comprising:
26. a first acquisition step of acquiring information input by a user regarding a first analysis result including at least one lesion detection region obtained by computer processing of a first medical image of a patient, the information being input by a user regarding whether or not at least one of the lesion detection regions is a false positive or a true positive; a second acquisition step of acquiring a second analysis result including at least one lesion detection region obtained by computer processing of the second medical image of the patient; a display step of displaying, among the lesion detection areas obtained in the second acquisition step, an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which information indicating that the area is a false positive or information that is considered to be a false positive has been obtained in the first acquisition step, in a display mode different from that of an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which information indicating that the area is not a false positive or information that is considered to be a false positive has been obtained in the first acquisition step; An information processing method including:
Citation Information
Patent Citations
Medical image processor and method of detecting abnormal shadow candidate
JP2004344232A
Diagnostic imaging support system and diagnostic imaging support method
JP2005102862A
Image diagnosis supporting device and method
JP2005328977A
Diagnostic imaging support system and its method
JP2005334219A
Medical image processor and program
JP2012011109A