Program, information processing device, information processing system and information processing method
Patent Information
- Application Number
- JP2024214262
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-12-09
- Publication Date
- 2025-02-14
- Estimated Expiration
- 2042-06-14
AI Technical Summary
【0012】 本発明によれば、コンピューター処理により得られた病変検出領域のうち偽陽性の領域をユーザーが認識することが可能となる。
Smart Images

Figure 2025023329000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a program, an information processing device, an information processing system, and an information processing method. [Background technology]
[0002] In recent years, computer-aided detection / diagnosis (CAD) systems have been put into practical use. These systems use computers to analyze medical images, and present lesion detection areas detected by image analysis to doctors for their judgment.
[0003] For example, Patent Document 1 discloses that annotations are added to lesion detection regions detected by CAD. Recently, computer processing such as AI (Artificial Intelligence) analysis based on machine learning and deep learning technology has been applied to medical images to detect potential lesion areas in the images. Systems capable of detecting such regions have also been proposed. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Patent No. 4651353 Summary of the Invention [Problem to be solved by the invention]
[0005] Lesion detection areas detected by computer processing such as CAD and AI often have false positives, so doctors must determine whether the lesion detection areas detected by the computer are false positives or not.
[0006] However, when a computer detects lesions in a new image of the same patient, there are cases where the computer again detects and displays as a lesion detection area a region that corresponds to a lesion detection area that a doctor judged to be a false positive in a previous image. Therefore, for example, experienced doctors or doctors who have previously interpreted the images may feel annoyed when a false positive result is displayed again, while inexperienced doctors or doctors who have not previously interpreted the images may be at risk of overlooking a false positive result.
[0007] The present invention has been made in consideration of the problems in the conventional technology described above, and has an object to enable a user to recognize false positive areas among lesion detection areas obtained by computer processing. [Means for solving the problem]
[0008] In order to solve the above problems, the program of the present invention comprises: On the computer, a first acquisition function for acquiring information input by a user regarding a first analysis result including at least one lesion detection region obtained by computer processing of a first medical image of a patient, the information being input by a user regarding whether or not at least one of the lesion detection regions is a false positive or a true positive; a second acquisition function for acquiring a second analysis result including at least one lesion detection region obtained by computer processing of a second medical image of the patient; a display function that displays, among the lesion detection areas obtained by the second acquisition function, an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which information that the area is a false positive or information that is considered to be a false positive has been obtained by the first acquisition function, in a display mode different from that of an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which information that the area is not a false positive or information that is considered to be a false positive has been obtained by the first acquisition function; Execute the command.
[0009] Further, the information processing device of the present invention comprises: a first acquisition means for acquiring information input by a user with respect to a first analysis result including at least one lesion detection region obtained by computer processing of a first medical image of a patient, the information being related to whether or not at least one of the lesion detection regions is a false positive or a true positive; A second acquisition means for acquiring a second analysis result including at least one lesion detection region obtained by computer processing of a second medical image of the patient; a display control means for displaying, among the lesion detection areas obtained by the second acquisition means, an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which information that it is a false positive or information that it is considered to be a false positive has been obtained by the first acquisition means, in a display mode different from a display mode for an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which information that it is not a false positive or information that it is considered to be a false positive has been obtained by the first acquisition means; Execute the command.
[0010] In addition, the information processing system of the present invention comprises: a first acquisition means for acquiring information input by a user with respect to a first analysis result including at least one lesion detection region obtained by computer processing of a first medical image of a patient, the information being related to whether or not at least one of the lesion detection regions is a false positive or a true positive; A second acquisition means for acquiring a second analysis result including at least one lesion detection region obtained by computer processing of a second medical image of the patient; a display control means for displaying, among the lesion detection areas obtained by the second acquisition means, an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which information that it is a false positive or information that it is considered to be a false positive has been obtained by the first acquisition means, in a display mode different from a display mode for an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which information that it is not a false positive or information that it is considered to be a false positive has been obtained by the first acquisition means; Equipped with.
[0011] The information processing method of the present invention further comprises: a first acquisition step of acquiring information input by a user regarding a first analysis result including at least one lesion detection region obtained by computer processing of a first medical image of a patient, the information being regarding whether or not at least one of the lesion detection regions is a false positive or a true positive; a second acquisition step of acquiring a second analysis result including at least one lesion detection region obtained by computer processing of a second medical image of the patient; a display step of displaying, among the lesion detection areas obtained in the second acquisition step, an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which information indicating that the area is a false positive or information considered to be a false positive has been obtained in the first acquisition step, in a display mode different from that of an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which information indicating that the area is not a false positive or information considered to be a false positive has been obtained in the first acquisition step; Includes. Effect of the Invention
[0012] According to the present invention, it becomes possible for a user to recognize false positive regions among lesion detection regions obtained by computer processing. [Brief description of the drawings]
[0013] [Figure 1] FIG. 1 is a system configuration diagram of a medical image display system. [Diagram 2] 2 is a block diagram showing a functional configuration of a medical image management server. FIG. [Diagram 3] FIG. 4 is a diagram showing a data configuration of a data management table. [Figure 4] FIG. 2 is a block diagram showing a functional configuration of an information processing device. [Diagram 5] 13 is a flowchart showing a medical image analysis process executed by the medical image management server. [Figure 6]11 is a flowchart showing an interpretation support process executed by the information processing device. [Figure 7] FIG. 13 is a diagram showing an example of an interpretation screen. [Figure 8] 7 is a flowchart showing an analysis result display process executed in step S16 of FIG. 6. [Figure 9] 11A and 11B are diagrams illustrating an example of a display of an analysis result of a current image in the present embodiment. [Figure 10] 11A and 11B are diagrams illustrating an example of a display of an analysis result of a current image in the present embodiment. [Figure 11] FIG. 13 is a diagram showing an example display (display of a pop-up screen) for notifying a user that the lesion detection area in the analysis results of the current image includes an area corresponding to an area registered as a false positive in a past image. [Figure 12] FIG. 13 is a diagram showing an example of a display (changing the display mode of the mouse cursor) for notifying a user that the lesion detection area in the analysis results of the current image includes an area corresponding to an area registered as a false positive in a past image. [Figure 13] FIG. 13 is a diagram showing an example of a display (change in the window display mode) for notifying a user that the lesion detection area in the analysis results of the current image includes an area corresponding to an area registered as a false positive in a past image. [Figure 14] 11A and 11B are diagrams illustrating an example of a display of an analysis result of a current image in the present embodiment. [Figure 15] 11A and 11B are diagrams illustrating an example of a display of an analysis result of a current image in the present embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0014] Hereinafter, an embodiment of a program, an information processing device, an information processing system, and an information processing method according to the present invention will be described, however, the scope of the invention is not limited to the illustrated examples.
[0015] [Configuration of medical image display system] FIG. 1 shows the system configuration of a medical image display system 100 as an information processing system. As shown in FIG. 1, the medical image display system 100 is composed of a medical image management server 10, modalities 20, 20, ..., and an information processing device 30, and each device is capable of data communication via a communication network N. The information processing device 30 only needs to be connectable to the medical image management server 10 via the communication network N as necessary. In the medical image display system 100, medical images and analysis results stored in the medical image management server 10 can be displayed on the information processing device 30. Each device constituting the medical image display system 100 complies with the HL7 (Health Level Seven) and DICOM (Digital Image and Communications in Medicine) standards, and communication between each device is performed in accordance with HL7 and DICOM. The number of information processing devices 30 is not particularly limited.
[0016] The modality 20 captures an image of a patient (subject) and generates image data of a medical image. For example, the modality 20 may be computed radiography (CR), digital radiography (DR), computed tomography (CT), magnetic resonance imaging (MRI), ultrasonography (US), nuclear medicine (NM), or endoscope (ES). Moreover, the modality 20 attaches image attribute information related to the medical image to the medical image. The image attribute information includes a patient ID, a patient name, a date of birth, a sex, a photographing date and time, an image ID, a modality, a part, a direction, and the like. Image data of the medical image generated by the modality 20 is transmitted to the medical image management server 10 .
[0017] The medical image management server 10 stores and manages image data of medical images generated in the modality 20. An example of the medical image management server 10 is a picture archiving and communication system (PACS).
[0018] The information processing device 30 is a computer device such as a PC (Personal Computer) or a tablet. The information processing device 30 is used when a user such as a doctor interprets a medical image.
[0019] [Medical Image Management Server Configuration] 2 shows the functional configuration of the medical image management server 10. The medical image management server 10 is configured with a control unit 11, a communication unit 12, an image analysis unit 13, a storage unit 14, etc., and each unit is connected by a bus 15.
[0020] The control unit 11 is composed of a CPU (Central Processing Unit), a RAM (Random Access Memory), etc., and comprehensively controls the processing operations of each unit of the medical image management server 10. Specifically, the CPU reads out various processing programs stored in the storage unit 14, loads them into the RAM, and performs various processes in cooperation with the programs.
[0021] The communication unit 12 is configured with a network interface or the like, and transmits and receives data to and from external devices connected via the communication network N. For example, the communication unit 12 receives medical images obtained by photographing a patient using the modality 20. In addition, the communication unit 12 transmits medical images and analysis results requested by the information processing device 30 to the information processing device 30.
[0022] The image analysis unit 13 performs computer processing on medical images obtained by photographing a patient, and generates data of the analysis results. Here, the computer processing is, for example, AI analysis using AI (Artificial Intelligence) that performs image diagnosis and image analysis including detection of lesion candidates by CAD (Computer Aided Diagnosis). The analysis result data is composed of, for example, DICOM GSPS (Grayscale Softcopy Presentation State) data, overlay data, etc. The analysis result data includes an analysis result ID for identifying the analysis result, and information on the detected lesion detection area (position, type of lesion, contents of supplementary information (annotation information), etc.). The image analysis unit 13 is realized by software processing through cooperation between a program stored in the storage unit 14 and the CPU of the control unit 11 .
[0023] The storage unit 14 is configured with an HDD (Hard Disk Drive), a non-volatile semiconductor memory, etc., and stores various processing programs, parameters and files necessary for executing the programs, etc.
[0024] The storage unit 14 also stores a user management table 141 and a data management table 142. The storage unit 14 also has a medical image storage area 143, an analysis result storage area 144, and an interpretation result storage area 145.
[0025] The user management table 141 is a table for managing users (medical professionals such as doctors) who use the medical image display system 100. The user management table 141 stores, for each user, a user ID, password, name, affiliation, email address, telephone number, etc. in association with each other. The user ID is identification information of the user. The password is used for authentication when the user accesses the medical image management server 10 from the information processing device 30. The name is the name of the user. The affiliation is information such as the medical facility and department to which the user belongs. The email address is the email address of the user. The phone number is the phone number of the user.
[0026] The data management table 142 is a table for managing the data in the medical image management server 10 . 3 shows the data configuration of the data management table 142. In the data management table 142, for each medical image stored in the medical image storage area 143, an image ID, a patient ID, a shooting date and time, a modality, a part, a direction, an analysis result ID, an interpretation result ID, etc. are stored in association with each other. The image ID is identification information of the medical image. The patient ID is identification information of the patient who was the subject of the medical image. The shooting date and time is the date and time when the medical image was captured. The modality is the modality with which the medical image was captured. The part is the part that was the subject of the medical image. The direction is the shooting direction of the medical image. The analysis result ID is identification information of the analysis result obtained by the image analysis unit 13 analyzing the medical image. The interpretation result ID is identification information for identifying the interpretation result of the medical image by the user (doctor).
[0027] The medical image storage area 143 stores image data of medical images received from the modalities 20 . The analysis result storage area 144 stores data on the analysis results of medical images by computer processing. Data on the results of interpretation of medical images by a doctor who is a user is stored in the image interpretation result storage area 145. The image interpretation result includes an image interpretation result ID, information on the lesion input area input by the user (position, type of lesion, contents of supplementary information (e.g., annotation information), etc.), and information on whether each of the lesion detection areas included in the analysis results by computer processing input by the user is a false positive (including position information of each lesion detection area in the analysis results, etc.).
[0028] When the control unit 11 receives a medical image from the modality 20 via the communication unit 12, it stores the medical image in the storage unit 14 and causes the image analysis unit 13 to analyze the medical image.
[0029] When a request for obtaining medical images and analysis results is received from the information processing device 30 via the communication unit 12, the control unit 11 reads the medical images and the analysis results from the memory unit 14, and provides the read medical images to the information processing device 30 via the communication unit 12. When there is a request for acquiring a previous image and interpretation results for an acquired medical image from the information processing device 30 via the communication unit 12, the control unit 11 reads out the previous image and its interpretation results from the storage unit 14, and provides the read out medical image to the information processing device 30 via the communication unit 12. Here, the previous image is an image of the same part (direction) of the same patient as the medical image acquired by the information processing device 30, but is an image captured on a different date and time than the medical image.
[0030] [Configuration of information processing device] 4 shows the functional configuration of the information processing device 30. The information processing device 30 includes a control unit 31, an operation unit 32, a display unit 33, a communication unit 34, a storage unit 35, etc., and each unit is connected via a bus 36.
[0031] The control unit 31 is composed of a CPU, a RAM, etc., and comprehensively controls the processing operations of each unit of the information processing device 30. Specifically, the CPU reads out various processing programs stored in the storage unit 35, expands them in the RAM, and performs various processes in cooperation with the programs.
[0032] The operation unit 32 includes a keyboard having cursor keys, letter / number input keys, various function keys, etc., and a pointing device such as a mouse, and outputs operation signals input by key operations on the keyboard or mouse operations to the control unit 31. In addition, when the operation unit 32 includes a touch panel layered on the display unit 33, it outputs an operation signal to the control unit 31 according to the position of a touch operation by the user's finger, etc.
[0033] The display unit 33 is configured to include a monitor such as an LCD (Liquid Crystal Display), and displays various screens according to instructions of a display signal input from the control unit 31.
[0034] The communication unit 34 is configured with a network interface and the like, and transmits and receives data to and from external devices connected via the communication network N.
[0035] The storage unit 35 is configured with a HDD, a non-volatile semiconductor memory, etc., and stores various processing programs, parameters and files required for executing the programs, etc. For example, the storage unit 35 stores an interpretation support processing program 351. The interpretation support processing program 351 is a program for executing an interpretation support processing (see FIG. 6) described later.
[0036] In the image interpretation support process, the control unit 31 acquires information input by the user regarding a first analysis result including at least one lesion detection region obtained by computer processing of a first medical image of a patient, as to whether each of the lesion detection regions obtained by computer processing is a false positive or not. That is, the control unit 31 functions as a first acquisition unit.
[0037] Furthermore, the control unit 31 acquires a second analysis result including at least one lesion detection area obtained by computer processing of the second medical image of the patient. That is, the control unit 31 functions as a second acquisition unit.
[0038] Furthermore, control unit 31 displays, among the lesion detection areas included in the second analysis result obtained by the second acquisition means, an area corresponding to a lesion detection area included in the first analysis result for which information has been acquired by the first acquisition means that it is a false positive, in a display mode different from that of an area corresponding to a lesion detection area included in the first analysis result for which information has been acquired by the first acquisition means that it is not a false positive. That is, control unit 31 functions as a display control means.
[0039] The first medical image is an image captured at a different date and time from the second medical image. In this embodiment, a case will be described where the first medical image is a past image and the second medical image is a current image. The current image is a newly captured medical image to be interpreted. The past image is a medical image captured in the past of the same patient as the current image (if there are multiple medical images captured earlier than the current image, the most recent one). In this embodiment, the first analysis result is an analysis result obtained by computer processing the past image. The second analysis result is an analysis result obtained by computer processing the current image. In this embodiment, a "false positive lesion detection area in a past image" refers to a lesion detection area included in the analysis result of a past image for which the user has input information that it is a false positive. In other words, a "false positive lesion detection area in a past image" refers to a "lesion detection area included in the first analysis result for which information that it is a false positive has been acquired by a first acquisition means." Furthermore, the term "lesion detection area in a past image that is not a false positive" refers to a lesion detection area included in the analysis result of a past image for which the user has input information that it is not a false positive. In other words, the term "lesion detection area in a past image that is not a false positive" refers to a "lesion detection area included in the first analysis result for which information that it is not a false positive has been acquired by the first acquisition means."
[0040] Furthermore, the control unit 31 acquires a lesion input area input by the user for the first analysis result including at least one lesion detection area obtained by computer processing of the first medical image of the patient. That is, the control unit 31 functions as a third acquisition unit.
[0041] In addition, the control unit 31 displays, among the lesion detection areas included in the second analysis result obtained by the second acquisition means, areas excluding areas corresponding to the lesion detection areas included in the first analysis result for which information has been acquired by the first acquisition means that they are false positives, and areas that do not correspond to the lesion input areas acquired by the third acquisition means, in a display mode different from that of the areas corresponding to the lesion input areas and the areas corresponding to the lesion detection areas included in the first analysis result for which information has been acquired by the first acquisition means that they are false positives.
[0042] [Operation in medical image display systems] Next, the operation of the medical image display system 100 will be described. 5 is a flowchart showing the medical image analysis process executed by the medical image management server 10. This process is realized by software processing through cooperation between the CPU of the control unit 11 and a program stored in the storage unit 14.
[0043] In the medical image management server 10, when a medical image obtained by photographing a patient from the modality 20 is received via the communication unit 12 (step S1), the control unit 11 stores the received medical image in the medical image storage area 143 of the storage unit 14 (step S2). The control unit 11 also associates the image ID, patient ID, photographing date and time, modality, part, direction, etc. included in the image attribute information of the received medical image, and stores them in the data management table 142 (see FIG. 3) of the storage unit 14.
[0044] Next, control unit 11 causes image analysis unit 13 to analyze the received medical image (step S3). Image analysis unit 13 analyzes the medical image using AI (Artificial Intelligence) to obtain a lesion detection region, and generates data of the analysis result including information on the obtained lesion detection region.
[0045] Next, the control unit 11 stores the analysis result obtained by the image analysis unit 13 in the storage unit 14 in association with the medical image (step S4), and ends the medical image analysis process. Specifically, the control unit 11 stores the analysis result in the analysis result storage area 144 of the storage unit 14, and stores the analysis result ID of the analysis result in the record corresponding to the medical image that was the subject of analysis in the data management table 142 of the storage unit 14.
[0046] When a user (doctor) accesses the medical image management server 10 from the information processing device 30, the user inputs a user ID and password by operating the operation unit 32, and the control unit 31 transmits the input user ID and password to the medical image management server 10 via the communication unit 34. In the medical image management server 10, when a user ID and password are received via the communication unit 12, the control unit 11 determines whether the received user ID and password match any of the user ID and password combinations pre-registered in the user management table 141 of the memory unit 14, and if there is a match, allows the user to use the information processing device 30.
[0047] 6 is a flowchart showing the image interpretation support processing executed by the information processing device 30. This processing is realized by software processing in cooperation with the CPU of the control unit 31 and an image interpretation support processing program 351 stored in the storage unit .
[0048] In the image interpretation support process, the control unit 31 acquires a current image (second medical image) and its analysis result (second analysis result) from the medical image management server 10 via the communication unit 34 (step S11). For example, the control unit 31 transmits an acquisition request for a medical image including an image ID specified by a user's operation on the operation unit 32 to the medical image management server 10 via the communication unit 34. The control unit 11 of the medical image management server 10 reads out a medical image corresponding to the image ID included in the acquisition request from the medical image storage area 143, and transmits the medical image to the information processing device 30 via the communication unit 12. The control unit 11 also refers to the data management table 142 of the storage unit 14, identifies an "analysis result ID" from a record corresponding to the "image ID" of the current image, reads out an analysis result corresponding to this "analysis result ID" from the analysis result storage area 144, and transmits the analysis result to the information processing device 30 via the communication unit 12. The control unit 31 may acquire a current image from the modality 20 .
[0049] Next, the control unit 31 displays the image interpretation screen 331 on which the acquired current image is displayed on the display unit 33 (step S12).
[0050] The interpretation screen is a screen that displays medical images and allows a user (doctor) to perform interpretation and input interpretation results. Fig. 7 shows an example of an interpretation screen 331. As shown in Fig. 7, the interpretation screen 331 is provided with a medical image display area 331a for displaying the medical image to be interpreted, an analysis result display button 133b for instructing the display of the analysis results, an end button 133c for instructing the end of interpretation, a tool display area 331d, and the like.
[0051] On the interpretation screen 331, for example, when a doctor who is a user specifies (e.g., right-clicks) the position of an area that is thought to be a lesion on the medical image displayed on the interpretation screen 331 using the operation unit 32, a menu item (e.g., a right-click menu) including the type of lesion is displayed near the specified position. When the type of lesion in the specified area is selected from the menu items using the operation unit 32, additional information (e.g., additional information (annotation information)) indicating that the specified area is a lesion detection area detected by the user (referred to as a lesion input area) is added to the specified area, and the specified area is input as a lesion input area. Information on the lesion input area (the position of the lesion input area, the type of lesion, the contents of the additional information, etc.) is temporarily stored in the RAM.
[0052] When the interpretation screen 331 is displayed, the control unit 31 determines whether or not an input operation in the lesion input area is detected by the operation unit 32 (step S13). When it is determined that an input operation in the lesion input area has not been detected (step S13; NO), the control unit 31 proceeds to step S15. When it is determined that an input operation in the lesion input area has been detected (step S13; YES), the control unit 31 stores the input information in the lesion input area in the RAM (step S14), and proceeds to step S15.
[0053] In step S15, control unit 31 determines whether or not a command has been issued to display the analysis results (detection results of the lesion detection area by computer processing) (step S15). For example, when the analysis result display button 331b is pressed by the operation unit 32, it is determined that an instruction to display the analysis result has been given. When it is determined that the display of the analysis result has not been instructed (step S15; NO), the control unit 31 proceeds to step S19. When it is determined that an instruction to display the analysis result has been given (step S15; YES), the control unit 31 executes an analysis result display process (step S16).
[0054] 8 is a flowchart showing an analysis result display process executed by the information processing device 30. This process is realized by software processing through cooperation between the CPU of the control unit 31 and an analysis result display processing program stored in the storage unit 35.
[0055] First, the control unit 31 inquires of the medical image management server 10 via the communication unit 34 whether or not a past image (first medical image) of the same patient as the current image exists (step S161). For example, the control unit 31 transmits the image ID of the current image to the medical image management server 10 and inquires whether or not there is a past image of the same patient as the current image. The control unit 11 of the medical image management server 10 refers to the data management table 142 of the storage unit 14, determines whether or not there is a medical image in the medical image storage area 143 that has the same "patient ID," "modality," "site," and "direction" as the current image, and notifies the information processing device 30 of the determination result via the communication unit 12.
[0056] If the medical image management server 10 notifies the control unit 31 that there are no previous images of the same patient as the current image (step S161; NO), the control unit 31 displays additional information (annotation information) in the lesion detection area of the displayed current image, which is included in the analysis results obtained in step S11 (step S162), and proceeds to step S17 in Figure 6.
[0057] If the medical image management server 10 notifies the user that a past image of the same patient as the current image exists (step S161; YES), the control unit 31 acquires the past image (first medical image) and its interpretation results from the medical image management server 10 via the communication unit 34 (step S163). The control unit 11 of the medical image management server 10 refers to the data management table 142 of the storage unit 14, extracts a record of a medical image having the same "patient ID", "modality", "site", and "direction" as the current image and having an earlier and most recent "photographing date and time" than the current image, and obtains the image ID (image ID of the past image) included in the extracted record. Then, reads out a medical image corresponding to the obtained image ID from the medical image storage area 143 of the storage unit 14. The control unit 31 also refers to the data management table 142, identifies an "interpretation result ID" from the record corresponding to the obtained image ID, reads out the interpretation result corresponding to this "interpretation result ID" from the interpretation result storage area 145, and transmits the read out medical image (past image) and interpretation result to the information processing device 30 via the communication unit 12.
[0058] Next, the control unit 31 compares the analysis results of the current image with the interpretation results of the past image, and determines whether or not the lesion detection area included in the analysis results of the current image (lesion detection area in the current image) contains an area that corresponds to a false positive lesion detection area in the past image (step S164). In step S164, the control unit 31 executes, for example, the following processes (1) to (4) to determine whether or not the lesion detection area included in the analysis result of the current image includes an area corresponding to a false positive lesion detection area in the past image.
[0059] (1) First, the control unit 31 aligns the current image with the previous image. Specifically, the control unit 31 performs enlargement, reduction, rotation, etc., on both or either one of the current image and the previous image, and aligns the positions of bones, organs, etc. in the images between the current image and the previous image.
[0060] (2) Next, control unit 31 adjusts the positions of the lesion detection region included in the analysis result of the current image and the false positive lesion detection region in the past image in conjunction with the alignment of the current image and the past image. Specifically, control unit 31 converts the positions of the lesion detection region included in the analysis result of the current image or the false positive lesion detection region in the past image to positions after alignment of the images.
[0061] (3) Next, control unit 31 superimposes the lesion detection area included in the analysis results of the current image after position adjustment with the false positive lesion detection areas in the past image, and calculates the degree of overlap between each lesion detection area included in the analysis results of the current image and each lesion detection area included in the analysis results of the past image. For example, when the position of the lesion detection area is specified by one point (center position), the control unit 31 calculates the overlap rate (degree of overlap) between the lesion detection area of the current image and a range (e.g., a circle of a predetermined radius) specified in advance from the lesion center position in the false positive lesion detection area of the past image. Here, the range specified in advance can be changed for each medical facility (medical facility where imaging was performed, medical facility to which the user belongs, etc.), requesting department, modality, and imaging site. In addition, the user (doctor) may specify an arbitrary value as the range specified in advance. For example, when the position of the lesion detection region is specified by an area, control unit 31 calculates the overlapping rate (degree of overlap) between the lesion detection region in the current image and the false positive lesion detection region in the past image.
[0062] (4) Next, the control unit 31 judges whether the degree of overlap between each lesion detection area included in the analysis result of the current image and each false positive lesion detection area included in the analysis result of the past image is equal to or greater than a predetermined threshold. The threshold used here may be changeable for each medical facility, requesting department, imaging site, and user. When the degree of overlap between the lesion detection area of the current image and the false positive lesion detection area in the past image is equal to or greater than a predetermined threshold, the control unit 31 determines that the lesion detection area of the current image for which the overlap degree has been calculated matches the false positive lesion detection area in the past image, i.e., that the lesion detection area of the current image for which the overlap degree has been calculated corresponds to the false positive lesion detection area in the past image. When the degree of overlap between the lesion detection area of the current image and the false positive lesion detection area in the past image is less than a predetermined threshold, the control unit 31 determines that the lesion detection area of the current image for which the overlap degree has been calculated does not match the false positive lesion detection area in the past image, i.e., that the lesion detection area of the current image for which the overlap degree has been calculated does not correspond to the false positive lesion detection area in the past image. When at least one of the lesion detection areas of the current image corresponds to a false positive lesion detection area in the past image, the control unit 31 determines that the lesion detection area included in the analysis result of the current image includes an area corresponding to a false positive lesion detection area in the past image.
[0063] In addition, without calculating the degree of overlap in (3) to (4) above, it is also possible to simply determine that the lesion detection areas of the current image that match, overlap with, or include the false positive lesion detection areas in the previous image are the areas that correspond to the false positive lesion detection areas in the previous image.
[0064] In step S164, if it is determined that the lesion detection areas included in the analysis results of the current image include areas that correspond to false positive lesion detection areas in the past image (step S164; YES), the control unit 31 displays the lesion detection areas of the current image that correspond to false positive lesion detection areas in the past image in a display mode different from that of the areas that correspond to non-false positive lesion detection areas in the past image (step S165).
[0065] For example, in a current image 50 shown in FIG. 9, when the regions corresponding to the lesion detection regions 41 to 45 in the past image 40 are lesion detection regions 51 to 55, respectively, and the lesion detection region 45 is a false positive lesion detection region, the control unit 31 displays the lesion detection region 55, which is the region corresponding to the lesion detection region 45, in the current image 50 displayed on the interpretation screen 331 in a different manner from the lesion detection regions 51 to 54. For example, as shown in "Analysis Result Display" in FIG. 9, the first auxiliary information (annotation information) M1 to be attached to the lesion detection region 55 is displayed in a different display manner from the second auxiliary information (annotation information) M2 to be attached to the other lesion detection regions 51 to 54. For example, at least one selected from the group of shape, line type, thickness, color, brightness, transparency, and symbol of the first auxiliary information M1 is made different from that of the second auxiliary information M2, and the first auxiliary information M1 is highlighted with respect to the second auxiliary information M2. Further, the first incidental information M1 may be highlighted relative to the second incidental information M2 by adding at least one identifying information such as a character or a symbol to the first incidental information M1. Fig. 9 shows an example in which the first incidental information M1 is highlighted relative to the second incidental information M2 by changing the line style of the first incidental information M1. Alternatively, as shown in FIG. 10, the first incidental information may be hidden in lesion detection region 55, so that lesion detection region 55 is displayed in a manner different from lesion detection regions 51 to .
[0066] Furthermore, control unit 31 warns the user that the lesion detection region included in the analysis result of the current image contains a region that corresponds to a false positive lesion detection region in the past image (step S166), and proceeds to step S167.
[0067] In step S166, the control unit 31 issues a warning to the user, for example, by notifying the user of predetermined information, by changing and displaying the mouse cursor on the image interpretation screen 331, or by changing and displaying the window on the image interpretation screen 331. Changing the display mode of the window includes changing the color of the background area in the window with respect to the medical image display area 331a in the window. The background area includes, for example, the tool display area 331d in the window.
[0068] For example, as shown in FIG. 11, a pop-up window 332 is displayed on an interpretation screen 331 to notify that a lesion detection area determined to be a false positive in a past image has been detected in the current image. Alternatively, as shown in FIG. 12, the color (or shape) of the mouse cursor 333 may be changed. 13, the color of the window frame 331e of the image interpretation screen 331 is changed from the normal display color (see FIG. 7) and displayed. Alternatively, the color of at least one of the areas 331d, 331f (including the tool display area 331d) that become the background in the window is changed with respect to the medical image display area 331a in the window.
[0069] On the other hand, in step S164, when it is determined that the lesion detection region included in the analysis result of the current image does not have a region corresponding to the false positive lesion detection region in the past image (step S164; NO), the control unit 31 proceeds to step S167.
[0070] In step S167, the control unit 31 compares the lesion detection areas included in the analysis results of the current image, excluding areas that correspond to false positive lesion detection areas in the past image, with the lesion input areas entered by the user in the past image, included in the interpretation results of the past image, and determines whether there are any areas in the lesion detection areas of the current image, excluding areas that correspond to false positive lesion detection areas in the past image, that do not correspond to lesion input areas in the past image (step S167).
[0071] If it is determined that the lesion detection areas of the current image, excluding areas that correspond to false positive lesion detection areas in the past image, include areas that do not correspond to lesion input areas entered by the user in the past image (step S167; YES), the control unit 31 displays the lesion detection areas of the current image, excluding areas that correspond to false positive lesion detection areas in the past image, that are determined not to correspond to lesion input areas in the past image, in a display mode different from the lesion detection areas determined to correspond to lesion input areas in the past image and the areas that correspond to false positive lesion detection areas (step S168), and proceeds to step S17 in Figure 6.
[0072] For example, if lesion detection area 56 in Figure 9 is a lesion detection area that is determined not to correspond to a lesion input area input by the user in a previous image, lesion detection area 56 is displayed in a manner different from lesion detection areas 51 to 55. For example, as shown in Fig. 14, the third incidental information (annotation information) M3 to be added to the lesion detection region 56 is displayed in a display mode different from the first incidental information M1 and the second incidental information M2 to be added to the other lesion detection regions 51 to 55. In Fig. 14, the third incidental information M3 is highlighted differently from the first incidental information M1 and the second incidental information M2 by changing the line type from the first incidental information M1 and the color (brightness) from the second incidental information M2. When the first incidental information M1 is not displayed, the lesion detection region 56 is displayed in a display mode different from the second incidental information M2 to be added to the other lesion detection regions 51 to 54, as shown in Fig. 15.
[0073] As a result, the lesion detection area obtained by computer processing from the current captured image (current image), excluding areas corresponding to false positive lesion detection areas in the previous image, and areas that do not correspond to lesion input areas entered by the user in the previous image, are displayed in a manner different from the areas corresponding to lesion input areas in the previous image and the areas corresponding to false positive lesion detection areas, making it possible for the user to easily grasp the new lesion detection area obtained by computer processing from the current captured image (current image).
[0074] In this embodiment, the lesion input region input by the user in the past image is the region directly designated by the user as a lesion candidate in the past image, but this is not limited thereto, and may be a region determined to be not a false positive in the information on whether or not it is false positive input by the user for each lesion detection region in the analysis results of the past image. Alternatively, it may be a region that is a combination of a region directly designated by the user as a lesion candidate in the past image and a region determined to be not a false positive in the information on whether or not it is false positive input by the user for each lesion detection region in the analysis results of the past image.
[0075] On the other hand, in step S167, if it is determined that there is no area in the lesion detection area of the current image that does not correspond to a lesion input area input by the user in the past image (step S167; NO), the control unit 31 proceeds to step S17 in Figure 6.
[0076] Here, when the analysis result is displayed, the image interpretation screen 331 allows the user to input information as to whether or not the displayed lesion detection area is a false positive. For example, when the auxiliary information (annotation information) displayed on the medical image (current image) displayed on the image interpretation screen 331 is selected (e.g., right-clicked) by the operation unit 32, the control unit 31 displays the items "Register as false positive" and "Register as true positive" in a menu item (e.g., right-click menu). The doctor, who is the user, can input information on whether the lesion detection area indicated by the selected auxiliary information is a false positive or not by selecting "Register as false positive" or "Register as true positive" from the displayed menu items by the operation unit 32. Note that, in order to simplify the input operation, only "Register as false positive" may be displayed in the menu item, and only the lesion detection area determined by the doctor as a false positive may be input, and an area without input may be regarded as input as a true positive, or only "Register as true positive" may be displayed in the menu item, and only the lesion detection area determined by the doctor as a true positive may be input, and an area without input may be regarded as input as a false positive. Note that the user can still input the lesion input area.
[0077] In step S17 of FIG. 6, the control unit 31 determines whether information on whether the displayed lesion detection region is a false positive or not, or whether an input operation on the lesion input region is detected (step S17). When it is determined that information on whether or not the displayed lesion detection region is a false positive or an input operation in the lesion input region has not been detected (step S17; NO), the control unit 31 proceeds to step S19. If it is determined that information regarding whether or not the displayed lesion detection area is a false positive or an input operation in the lesion input area has been detected (step S17; YES), the control unit 31 stores the input information regarding whether or not the lesion detection area is a false positive or the input lesion input area in RAM (step S18) and proceeds to step S19.
[0078] In step S19, the control unit 31 determines whether or not an instruction to end the interpretation has been given through the operation unit 32 (step S19). For example, when the end button 331c displayed on the image interpretation screen 331 is pressed by the operation unit 32, the control unit 31 determines that an instruction to end the image interpretation has been issued. When it is determined that the end of interpretation has not been instructed by the operation unit 32 (step S19; NO), the control unit 31 determines whether or not the analysis result is being displayed (step S20). When it is determined that the analysis result is being displayed (step S20; YES), the control unit 31 returns to step S17. When it is determined that the analysis result is not being displayed (step S20; NO), the control unit 31 returns to step S13.
[0079] On the other hand, in step S19, if it is determined that the operation unit 32 has instructed to end the interpretation (step S19; YES), the control unit 31 assigns the image ID of the current image to the interpretation results stored in the RAM (information on whether the lesion detection area included in the analysis result of the current image is a false positive or not and information on the lesion input area entered by the user), and transmits them to the medical image management server 10 via the communication unit 34 (step S21), and terminates the interpretation support processing.
[0080] In the medical image management server 10, when the communication unit 12 receives the interpretation result from the information processing device 30, the control unit 11 associates the received interpretation result with the medical image and stores it in the interpretation result storage area 145. For example, the control unit 11 assigns an interpretation result ID to the received interpretation result and stores it in the interpretation result storage area 145, extracts a record of the image ID corresponding to the interpretation result from the data management table 142, and registers the interpretation result ID assigned to the received interpretation result in the "interpretation result ID" field of the extracted record.
[0081] As described above, according to this embodiment, the control unit 31 of the information processing device 30 obtains information as to whether each of the lesion detection areas input by the user is a false positive for the analysis result (first analysis result) including at least one lesion detection area obtained by computer processing of the patient's past image (first medical image), obtains the analysis result (second analysis result) including at least one lesion detection area obtained by computer processing of the patient's current image (second medical image), and displays, among the lesion detection areas included in the analysis result of the current image, areas that correspond to false positive lesion detection areas in the past image in a display mode different from areas that correspond to lesion detection areas that are not false positive. This allows the user to recognize false positive regions among the lesion detection regions obtained by computer processing, thereby preventing false positives from being overlooked.
[0082] For example, the control unit 31 displays, in different display modes, first additional information (annotation information) to be attached to areas corresponding to false positive lesion detection areas in the past image among the lesion detection areas included in the analysis results of the current image, and second additional information (annotation information) to be attached to areas corresponding to lesion detection areas that are not false positive, thereby enabling the user to distinguish and recognize false positive lesion detection areas from non-false positive lesion detection areas among the lesion detection areas obtained by computer processing.
[0083] Furthermore, for example, the control unit 31 can hide the first additional information to be attached to areas of the lesion detection areas included in the analysis results of the current image that correspond to false positive lesion detection areas in the past image, thereby displaying the areas corresponding to false positive lesion detection areas included in the analysis results of the past image in a display mode different from that of areas corresponding to lesion detection areas that are not false positive, thereby eliminating the annoyance of having false positive results displayed again.
[0084] Furthermore, control unit 31 displays areas that do not correspond to the lesion input area input by the user, excluding areas that correspond to lesion detection areas that are false positives in the past image, among the lesion detection areas included in the analysis result of the current image, in a display mode different from the areas that correspond to the lesion input area and the areas that correspond to the lesion detection areas that are false positives. Therefore, it becomes possible for the user to easily recognize, for example, newly detected areas among the lesion detection areas included in the analysis result of the current image.
[0085] Furthermore, when there is an area corresponding to a lesion detection area that is a false positive in the past image among the lesion detection areas included in the analysis result of the current image, control unit 31 notifies the user of predetermined information, changes the display mode of the mouse cursor, or changes the display mode of the window to display it. Therefore, it becomes possible for the user to easily recognize that there is an area corresponding to a lesion detection area that is a false positive in the past image among the lesion detection areas included in the analysis result of the current image.
[0086] Furthermore, control unit 31 highlights the first auxiliary information to be attached to the lesion detection areas included in the analysis result of the current image, which correspond to the false positive lesion detection areas in the past image, thereby displaying the areas in a different display mode from the areas corresponding to the lesion detection areas in the past image that are not false positives. This allows the user to easily recognize the lesion detection areas included in the analysis result of the current image, which correspond to the false positive lesion detection areas in the past image.
[0087] The above description of the embodiment is an example of the program, information processing device, information processing method, and information processing system according to the present invention, and is not limited thereto. The detailed configuration and detailed operation of each device constituting the system can be appropriately changed without departing from the spirit of the present invention.
[0088] For example, in the above embodiment, when an instruction to display the analysis result is given, among the lesion detection regions obtained by computer processing, the region corresponding to the false positive lesion detection region in the past image is displayed in a display mode different from the region corresponding to the non-false positive lesion detection region in the past image, but this is not limited to this. For example, a predetermined operation button such as a switching button is provided on the image interpretation screen 331, and when an instruction to display the analysis result is given, the control unit 31 may first, in cooperation with the image interpretation support processing program 351, display the region corresponding to the false positive lesion detection region in the past image among the lesion detection regions obtained by computer processing in the same display mode as the region corresponding to the non-false positive lesion detection region in the past image, and in response to the user pressing the switching button by the operation unit 32, switch the region corresponding to the false positive lesion detection region in the past image among the lesion detection regions obtained by computer processing from the same display mode as the region corresponding to the non-false positive lesion detection region in the past image to a different display mode. For example, the first incidental information to be attached to an area corresponding to a false positive lesion detection area in a past image may be displayed in a different display mode from the same display mode as the second incidental information to be attached to an area corresponding to a non-false positive lesion detection area in a past image. Alternatively, the first incidental information may be displayed in a different display mode from the first incidental information by switching to non-display. This makes it possible for a user to distinguish between lesion detection areas obtained by computer processing that correspond to false positive lesion detection areas in past images and areas that correspond to non-false positive lesion detection areas in past images.
[0089] In addition, each time the above-mentioned switching button is pressed, the first additional information to be attached to an area corresponding to a false positive lesion detection area in a past image may be displayed in the following manner: (A) displayed in the same display mode as the second additional information to be attached to an area corresponding to a lesion detection area in a past image that is not a false positive, (B) displayed in a display mode different from that of the second additional information to be attached to an area corresponding to a lesion detection area in a past image that is not a false positive, and (C) not displayed.
[0090] In addition, in the above embodiment, the first incidental information to be attached to an area corresponding to a false positive lesion detection area in a past image is displayed in a different display mode from the second incidental information to be attached to an area corresponding to a non-false positive lesion detection area in a past image, or the first incidental information is hidden, thereby displaying the two in different display modes; however, the control unit 31, in cooperation with the interpretation support processing program 351, may also display the two in different display modes by hiding the second incidental information.
[0091] Furthermore, in the above embodiment, when the degree of overlap between the lesion detection area of the current image and the false positive lesion detection area in the past image is equal to or greater than a predetermined threshold, the lesion detection area of the current image for which the degree of overlap has been calculated is determined to match the false positive lesion detection area in the past image, i.e., the lesion detection area in the analysis result of the current image is determined to be an area corresponding to the false positive lesion detection area in the past image, but even when it is determined to match, if the degree of overlap is lower than a predetermined standard, there may be a suspicion of mismatch. Therefore, for an area determined to correspond to a false positive lesion detection area in a past image, the display of auxiliary information (annotation information) may be changed depending on whether the degree of overlap is higher or lower than the standard.
[0092] In addition, in the above embodiment, the control unit 31 of the information processing device 30 functions as a first acquisition means, a second acquisition means, a third acquisition means, and a display control means, but a device other than the information processing device 30 may be equipped with each of the above means. In addition, in the above embodiment, the medical image management server 10 is equipped with the function of performing computer processing on medical images and generating analysis results, but a device other than the medical image management server 10 may be equipped with the analysis function.
[0093] In the above embodiment, an example of using a chest image as a medical image is illustrated, but the imaging site is not limited to the chest. The medical image to be processed may be a plurality of slice images obtained by CT or the like, a multi-frame image (moving image), or an image obtained by CT, MRI, or the like, which is converted into a 3D image.
[0094] In addition, when it is better not to display the additional information (annotation information) (when it becomes a nuisance), for example, during playback of a multi-frame image video or during measurement, the analysis results may be automatically hidden.
[0095] In addition, in the above embodiment, the medical image management server 10 stores image data of medical images, analysis result data, and interpretation result data in separate areas (medical image memory area 143, analysis result memory area 144, interpretation result memory area 145), but at least one of the analysis result data and the interpretation result data may be incorporated into a medical image file containing image data of the medical image.
[0096] The programs for executing the processes in each device may be stored in a portable recording medium. A carrier wave may be used as a medium for providing the program data via a communication line. [Explanation of symbols]
[0097] 10 Medical image management server 11 Control section 12 Communications Department 13 Image Analysis Section 14 Storage section 20 Modality 30 Information processing device 31 Control Unit 32 Operation section 33 Display section 331 Reading screen 34 Communications Department 35 Storage section 100 Medical image display system 141 User Management Table 142 Data Management Table 143 Medical Image Storage Area 144 Analysis result storage area 145 Reading result storage area 351 Image interpretation support processing program N Communication Network
Claims
1. On the computer, a first acquisition function for acquiring information input by a user regarding a first analysis result including at least one lesion detection area obtained by computer processing of a first medical image of a patient, the information being input by a user regarding whether or not at least one of the lesion detection areas is a false positive or a true positive; a second acquisition function for acquiring a second analysis result including at least one lesion detection region obtained by computer processing of a second medical image of the patient; a display function that displays, among the lesion detection areas obtained by the second acquisition function, an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which information that the area is a false positive or information that is considered to be a false positive has been obtained by the first acquisition function, in a display mode different from a display mode that displays an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which information that the area is not a false positive or information that is considered to be a false positive has been obtained by the first acquisition function; A program that executes the following.
2. The program described in claim 1, characterized in that the display function displays, in different display modes, first incidental information to be attached to an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result, where the first acquisition function has obtained information that the area is a false positive or has information deemed to be a false positive, and second incidental information to be attached to an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result, where the first acquisition function has obtained information that the area is not a false positive or has information deemed to be a false positive.
3. The program described in claim 1, characterized in that the display function, in response to a specified user operation, switches and displays an area of the lesion detection area obtained by the second acquisition function that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which the first acquisition function has obtained information that it is a false positive or information that it is deemed to be a false positive from the same display mode as an area of the lesion detection area included in the first analysis result for which the first acquisition function has obtained information that it is not a false positive or information that it is deemed to be a false positive, to a different display mode.
4. The program described in claim 3, characterized in that the display function, in response to a specified user operation, switches from a display mode that is the same as that of the second incidental information to be attached to an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result, for which information that the first acquisition function has obtained information that the lesion detection area is a false positive or information that is deemed to be a false positive, to a display mode that is different from that of the second incidental information to be attached to an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result, for which information that the first acquisition function has obtained information that the lesion detection area is not a false positive or information that is deemed to be a false positive.
5. The program according to claim 2, characterized in that the display function displays the area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result, for which the first acquisition function has obtained information that the area is a false positive or information that is deemed to be a false positive, in a display manner different from that of the area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result, for which the first acquisition function has obtained information that the area is a false positive or information that is deemed to be a false positive, in a display manner different from that of the area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result, for which the first acquisition function has obtained information that the area is not a false positive or information that is deemed to be a false positive.
6. The computer further comprises: execute a third acquisition function for acquiring a lesion input area input by a user for at least one lesion detection area obtained by computer processing of a first medical image of a patient; The program according to claim 1, characterized in that the display function displays, from the lesion detection area obtained by the second acquisition function, an area excluding an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result from which information that the first acquisition function has obtained information that the result is a false positive or that is deemed to be a false positive, and that does not have a positional relationship corresponding to the lesion input area obtained by the third acquisition function, in a display mode different from that of an area that is in a positional relationship corresponding to the lesion input area and an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result from which information that the first acquisition function has obtained information that the result is a false positive or that is deemed to be a false positive.
7. 3. The program according to claim 2, wherein the first and second incidental information are annotation information.
8. The program described in claim 1, characterized in that when there is an area among the lesion detection areas obtained by the second acquisition function that is in a positional relationship corresponding to a lesion detection area included in the first analysis result for which information that the first acquisition function has obtained is a false positive or is considered to be a false positive, the display function notifies the user of specified information, changes the display mode of the mouse cursor, or changes the display mode of a window to display the information.
9. The program of claim 1, characterized in that the display function highlights first auxiliary information to be attached to an area of the lesion detection area obtained by the second acquisition function that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which information that the lesion detection area is a false positive or information that is deemed to be a false positive has been obtained by the first acquisition function, thereby displaying the area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which information that the lesion detection area is a false positive or information that is deemed to be a false positive has been obtained by the first acquisition function in a different display manner from the area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which information that the lesion detection area is not a false positive or information that is deemed to be a false positive has been obtained by the first acquisition function.
10. The program according to claim 2, characterized in that the display function displays first incidental information to be attached to a region of the lesion detection region obtained by the second acquisition function, the region being in a positional relationship corresponding to the lesion detection region included in the first analysis result, for which information that the first acquisition function has obtained information that the lesion is not a false positive or information that the first acquisition function has obtained information that the lesion is not a false positive, in a display manner different from that of the region of the lesion detection region included in the first analysis result, the region being in a positional relationship corresponding to ... acquisition function, the region being in a positional relationship corresponding to the lesion detection region included in the first analysis result, the region being in a positional relationship corresponding to the lesion detection region included in the first acquisition function, the region being in a positional relationship corresponding to the lesion detection region included in the first analysis result, the region being in a positional relationship corresponding to the lesion detection region included in the first analysis result, the region being in a positional relationship corresponding to the lesion detection region included in the first acquisition function,
11. The program of claim 1 , wherein the display function displays the lesion detection area in the different display mode when it is determined that the lesion detection area included in the second analysis result has an area that is in a positional relationship corresponding to a false positive lesion detection area included in the first analysis result.
12. 12. The program according to claim 1, wherein the first medical image is an image captured at a different date and time from the second medical image.
13. a first acquisition means for acquiring information input by a user with respect to a first analysis result including at least one lesion detection area obtained by computer processing of a first medical image of a patient, the information being related to whether or not at least one of the lesion detection areas is a false positive or a true positive; a second acquisition means for acquiring a second analysis result including at least one lesion detection region obtained by computer processing of a second medical image of the patient; a display control means for displaying, among the lesion detection areas obtained by the second acquisition means, an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which information that it is a false positive or information that it is considered to be a false positive has been obtained by the first acquisition means, in a display mode different from a display mode for an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which information that it is not a false positive or information that it is considered to be a false positive has been obtained by the first acquisition means; An information processing device that executes the above.
14. The information processing device according to claim 13, characterized in that the display control means displays, in different display modes, first incidental information to be attached to an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result, where information that the area is a false positive or information that is deemed to be a false positive has been obtained by the first acquisition means, and second incidental information to be attached to an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result, where information that the area is not a false positive or information that is deemed to be a false positive has been obtained by the first acquisition means.
15. The information processing device according to claim 13, characterized in that the display control means, in response to a specified user operation, switches and displays an area of the lesion detection area obtained by the second acquisition means that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which the first acquisition means has obtained information that it is a false positive or information that it is deemed to be a false positive from the same display mode as an area of the lesion detection area included in the first analysis result for which the first acquisition means has obtained information that it is not a false positive or information that it is deemed to be a false positive, to a different display mode.
16. The information processing device according to claim 15, characterized in that the display control means, in response to a predetermined user operation, switches from a display mode that is the same as that of the second auxiliary information to be attached to an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result, for which information that the first acquisition means has obtained information that the area is a false positive or information that is deemed to be a false positive, to a display mode that is different from that of the first auxiliary information to be attached to an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result, for which information that the first acquisition means has obtained information that the area is not a false positive or information that is deemed to be a false positive.
17. The information processing device according to claim 14, characterized in that the display control means displays the area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result, for which information that the area is a false positive or information that is deemed to be a false positive was obtained by the first acquisition means, in a display mode different from that of the area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result, for which information that the area is a false positive or information that is deemed to be a false positive was obtained by the first acquisition means, by hiding first accompanying information to be attached to the area among the lesion detection areas obtained by the second acquisition means, the area being in a positional relationship corresponding to the lesion detection area included in the first analysis result, for which information that the area is a false positive or information that is deemed to be a false positive was obtained by the first acquisition means.
18. a third acquisition means for acquiring a lesion input area input by a user for at least one lesion detection area obtained by computer processing of a first medical image of a patient; 14. The information processing device according to claim 13, wherein the display control means displays, from the lesion detection area obtained by the second acquisition means, an area excluding an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result obtained by the first acquisition means for information that the result is a false positive or information deemed to be a false positive, and that does not have a positional relationship corresponding to the lesion input area obtained by the third acquisition means, in a display mode different from that of an area that is in a positional relationship corresponding to the lesion input area and an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result obtained by the first acquisition means for information that the result is a false positive or information deemed to be a false positive.
19. 15. The information processing apparatus according to claim 14, wherein the first and second auxiliary information are annotation information.
20. The information processing device described in claim 13, characterized in that when there is an area among the lesion detection areas obtained by the second acquisition means that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which information that the first acquisition means has obtained information that the area is a false positive or information that is considered to be a false positive is obtained, the display control means notifies the user of specified information, changes the display mode of the mouse cursor, or changes the display mode of a window to display the specified information.
21. The information processing device according to claim 13, characterized in that the display control means highlights first auxiliary information to be attached to an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result, for which information that the area is a false positive or information that is deemed to be a false positive has been obtained by the first acquisition means, among the lesion detection areas obtained by the second acquisition means, thereby displaying the area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result, for which information that the area is a false positive or information that is deemed to be a false positive has been obtained by the first acquisition means, in a display mode different from that of the area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result, for which information that the area is not a false positive or information that is deemed to be a false positive has been obtained by the first acquisition means.
22. 15. The information processing device according to claim 14, wherein the display control means displays first incidental information to be incidental to a region in a positional relationship corresponding to the lesion detection region included in the first analysis result for which information that the lesion detection region is false positive or information deemed to be a false positive has been obtained by the first acquisition means, out of the lesion detection region obtained by the second acquisition means, and hides second incidental information to be incidental to a region in a positional relationship corresponding to the lesion detection region included in the first analysis result for which information that the lesion detection region is not false positive or information deemed to be a false positive has been obtained by the first acquisition means, thereby displaying the region in a positional relationship corresponding to the lesion detection region included in the first analysis result for which information that the lesion detection region is not false positive or information deemed to be a false positive has been obtained by the first acquisition means, in a display mode different from that of the region in a positional relationship corresponding to the lesion detection region included in the first analysis result for which information that the lesion detection region is not false positive or information deemed to be a false positive has been obtained by the first acquisition means.
23. The information processing device according to claim 13, wherein the display control means displays the lesion detection area included in the second analysis result in the different display mode when it is determined that the lesion detection area included in the second analysis result has an area that is in a positional relationship corresponding to a false positive lesion detection area included in the first analysis result.
24. The first medical image is an image taken at a different date and time from the second medical image. The information processing device according to any one of claims 13 to 23,
25. a first acquisition means for acquiring information input by a user with respect to a first analysis result including at least one lesion detection area obtained by computer processing of a first medical image of a patient, the information being related to whether or not at least one of the lesion detection areas is a false positive or a true positive; a second acquisition means for acquiring a second analysis result including at least one lesion detection region obtained by computer processing of a second medical image of the patient; a display control means for displaying, among the lesion detection areas obtained by the second acquisition means, an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which information that it is a false positive or information that it is considered to be a false positive has been obtained by the first acquisition means, in a display mode different from a display mode for an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which information that it is not a false positive or information that it is considered to be a false positive has been obtained by the first acquisition means; An information processing system comprising:
26. a first acquisition step of acquiring information input by a user regarding a first analysis result including at least one lesion detection region obtained by computer processing of a first medical image of a patient, the information being regarding whether or not at least one of the lesion detection regions is a false positive or a true positive; a second acquisition step of acquiring a second analysis result including at least one lesion detection region obtained by computer processing of a second medical image of the patient; a display step of displaying, among the lesion detection areas obtained in the second acquisition step, an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which information indicating that the area is a false positive or information considered to be a false positive has been obtained in the first acquisition step, in a display mode different from that of an area that is in a positional relationship corresponding to the lesion detection area included in the first analysis result for which information indicating that the area is not a false positive or information considered to be a false positive has been obtained in the first acquisition step; An information processing method comprising:
Citation Information
Patent Citations
Medical image processor and method of detecting abnormal shadow candidate
JP2004344232A
Diagnostic imaging support system and diagnostic imaging support method
JP2005102862A
Image diagnosis supporting device and method
JP2005328977A
Diagnostic imaging support system and its method
JP2005334219A
Medical image processor and program
JP2012011109A