Display device, medical information display system, program, and display method

Abstract

To prevent a doctor from overlooking a lesion to be observed when the doctor performs diagnostic reading by displaying results of detecting a lesion candidate region by computer processing on medical information and results of detecting the lesion candidate region by the doctor.SOLUTION: A control unit 41 of a diagnostic reading terminal 4 distinguishably displays first display information and second display information so that both information when first display information (first annotation information, for example) showing a first lesion candidate region obtained by computer processing on medical information and second display information (second annotation information, for example) showing a second lesion candidate region specified by a user on the basis of the medical information are concurrently displayed on a display part 46.SELECTED DRAWING: Figure 7

Description

[Technical Field]

[0001] The present invention relates to a display device, a medical information display system, a program, and a display method. [Background technology]

[0002] Generally, PACS (Picture Archiving and Communication System) viewers are equipped with a function that allows users, such as doctors, to add annotations such as circles (ellipses), rectangles, and polygons to lesions in medical images. Recently, systems have been disclosed that can automatically detect potential lesion areas in medical images such as CT images, CR images, and MRI images by applying computer processing such as AI (Artificial Intelligence) analysis based on machine learning and deep learning technologies.

[0003] For example, Patent Document 1 discloses that annotating and displaying the locations checked by a doctor through interpretation and the locations detected through analysis processing by a diagnosis support system (CAD (Computer Aided Diagnosis)).

[0004] Furthermore, Patent Document 2 discloses that by adding identification information (such as letters, symbols, or figures) to "(A) annotations added by CAD," "(A) annotations added by CAD" and "(B) annotations added by the user" can be distinguished and printed out on film. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Patent No. 4651353 [Patent Document 2] Japanese Patent Application Laid-Open No. 2011-110173 Summary of the Invention [Problem to be solved by the invention]

[0006] Patent Document 1 describes that the analysis results of the diagnostic support system are superimposed on the doctor's diagnosis results (check results), and the doctor re-interprets the images to identify any differences between the two. In Patent Document 1, when the analysis results of the diagnostic support system and the doctor's diagnosis results are superimposed, the areas extracted by the CAD and the areas checked by the doctor happen to be displayed differently (Figure 4). However, in Patent Document 1, the color of the annotation for the areas checked by the doctor changes depending on the number of times the image is read (paragraph

[0017] ), so depending on the number of times the image is read, the areas extracted by the CAD and the areas checked by the doctor may have the same annotation, which may make it difficult to distinguish between the two. In fact, in Patent Document 1, the annotations made to areas that were not checked by the doctor but were extracted only by the CAD (Figure 7) and the annotations made to areas that were checked only by the doctor but overlooked by the CAD (Figure 8) are the same annotations, resulting in a situation where it is difficult to distinguish which annotation was made.

[0007] In fact, depending on the hospital's operational rules, it may become impossible to distinguish between annotations detected by AI (including conventional CAD) and annotations indicating areas that doctors should check, which could cause problems with image interpretation. For example, a diagnostic support system may have a rule that requires AI-detected lung nodules to be annotated with a circular shape, for example, in GSPS (Grayscale Softcopy Presentation State) format. Annotations can be set when creating a GSPS, but once a rule is set, circular annotations are permanently assigned to lung nodules. On the other hand, independently of this, hospitals may have a rule that requires users, such as radiologists, to annotate lung nodules with a circular shape as part of their interpretation of images. In such cases, the annotations for lung nodules made by the user (radiologist) and those detected by AI may end up with the same shape, potentially making it difficult to distinguish between the annotations made by the radiologist and those detected by the AI.

[0008] Even if the hospital predetermines rules for image interpretation based on the settings of the diagnostic support system, doctors may have to take the time to add annotations, which could hinder the speed of image interpretation. For example, if annotations made by AI detection are changed depending on the disease type (such as nodule type), doctors must first understand all of the annotations made as AI detection results and then make different annotations for each. This makes the doctor's work extremely cumbersome.

[0009] In this regard, Patent Document 2 discloses, as mentioned above, that by adding identification information (characters, symbols, figures, etc.) to "(A) annotations added by CAD," "(A) annotations added by CAD" and "(B) annotations added by the user" can be distinguished and output. However, Patent Document 2 addresses the issue of distinguishing between (A) and (B) when output externally (when printed on film), and merely describes that (A) and (B) can be distinguished and output externally (when printed on film). Patent Document 2 states that when displayed on a display unit (viewer), it is possible to select whether or not to display (A) and (B) separately, making it easy to distinguish between them (paragraph

[0007] ). In other words, Patent Document 2 states that (A) and (B) are distinguishable on the display unit (viewer), and does not address the issue of distinguishability when displayed on the display unit for interpretation.

[0010] However, if the next radiologist makes a diagnosis without being able to distinguish between annotations made by the radiologist and those made by the AI, the annotations made by the user (e.g., the primary radiologist) will be highly reliable, while the annotations made by the AI ​​may contain many false positives. As a result, the next radiologist will have to interpret the images while mixing highly reliable annotations made by the user and less reliable annotations made by the AI, which could result in the doctor missing important lesions. In addition, AI detection results cannot be used as a final diagnosis, and radiologists must confirm the AI ​​detection results. In this case, if it is not possible to distinguish between annotations made by radiologists and those made by AI, there is a risk that the AI ​​detection results that should actually be checked will be overlooked and the final diagnosis will be made without the final radiologist checking them.

[0011] The present invention has been made in consideration of the problems with the above-mentioned conventional technology, and aims to prevent doctors from overlooking lesions that should be seen when interpreting images by displaying the results of detection of lesion candidate areas by computer processing of medical information and the results of detection of lesion candidate areas by doctors. [Means for solving the problem]

[0012] In order to solve the above problems, the display device of the present invention comprises: a display control means for simultaneously displaying on a display unit first display information indicating a first lesion candidate region obtained by computer processing of medical information and second display information indicating a second lesion candidate region specified by a user based on the medical information; the display control means controls to selectably display first display candidate information, which is information corresponding to the second display information that is distinguishable from the first display information; a selection means for allowing a user to select the first display candidate information, When the first display information and the second display information are displayed simultaneously, the display control means adds the second display information based on the first display candidate information selected by the selection means so that the first display information and the second display information can be displayed distinguishably.

[0014] The medical information display system of the present invention further comprises: a display control means for simultaneously displaying on a display unit first display information indicating a first lesion candidate region obtained by computer processing of medical information and second display information indicating a second lesion candidate region specified by a user based on the medical information; the display control means controls to selectably display first display candidate information, which is information corresponding to the second display information that is distinguishable from the first display information; a selection means for allowing a user to select the first display candidate information, When the first display information and the second display information are displayed simultaneously, the display control means adds the second display information based on the first display candidate information selected by the selection means so that the first display information and the second display information can be displayed distinguishably.

[0016] The program of the present invention also includes: On the computer, A program for executing a display function that simultaneously displays, on a display unit, first display information indicating a first lesion candidate region obtained by computer processing of medical information and second display information indicating a second lesion candidate region identified by a user based on the medical information, the display function controls to selectably display first display candidate information that is information corresponding to the second display information that is distinguishable from the first display information; causing the computer to further execute a selection function for a user to select the first display candidate information; When the first display information and the second display information are displayed simultaneously, the display function adds the second display information based on the first display candidate information selected by the selection function so that the first display information and the second display information can be displayed distinguishably.

[0018] Further, the display method of the present invention comprises: A display method for simultaneously displaying on a display unit first display information indicating a first lesion candidate region obtained by computer processing of medical information and second display information indicating a second lesion candidate region identified by a user based on the medical information, the method comprising: the display step includes controlling to selectably display first display candidate information, which is information corresponding to the second display information that is distinguishable from the first display information; further comprising a selection step for a user to select the first display candidate information; In the display process, when the first display information and the second display information are displayed simultaneously, the second display information is added based on the first display candidate information selected in the selection process so that the first display information and the second display information can be displayed in a distinguishable manner. [Effects of the Invention]

[0020] According to the present invention, the results of detection of lesion candidate areas by computer processing of medical information and the results of detection of lesion candidate areas by a doctor are displayed, thereby preventing the doctor from overlooking lesions that should be seen when interpreting images. [Brief explanation of the drawings]

[0021] [Figure 1] 1 is a diagram illustrating the overall configuration of a medical information display system according to an embodiment of the present invention. [Figure 2] FIG. 2 is a block diagram showing the functional configuration of the image interpretation terminal of FIG. 1. [Figure 3] 3 is a flowchart showing the flow of image interpretation support processing A executed by the control unit in FIG. 2. [Figure 4] FIG. 10 is a diagram showing an example of an interpretation screen. [Figure 5] FIG. 10 is a diagram showing an example in which first display candidate information, second display candidate information, and a reason why the second display candidate information cannot be selected are displayed on an interpretation screen. [Figure 6] (a) is a diagram showing an example in which first display candidate information and second display candidate information are displayed in a selectable manner on the interpretation screen, (b) is a diagram showing an example of a notification screen that is displayed when the second display candidate information is selected in (a), and (c) is a diagram showing another example of a notification screen that is displayed when the second display candidate information is selected in (a). [Figure 7] FIG. 4 is a diagram showing a display example of an interpretation screen in step S8 of FIG. 3. [Figure 8] FIG. 10 is a diagram showing an example of an image interpretation screen on which an image interpretation finding input field is displayed. [Figure 9] 10 is a flowchart showing the flow of image interpretation support processing B executed by the control unit in FIG. 2. DETAILED DESCRIPTION OF THE INVENTION

[0022] Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings, but the present invention is not limited to the illustrated examples.

[0023] First Embodiment [Configuration of medical information display system] FIG. 1 shows an example of the system configuration of a medical information display system 100 according to the first embodiment. 1, the medical information display system 100 includes a modality 1, a console 2, an analysis device 3, an interpretation terminal 4, an image server 5, etc., which are connected via a communication network N such as a LAN (Local Area Network), a WAN (Wide Area Network), or the Internet. Each device that makes up the medical information display system 100 conforms to the HL7 (Health Level Seven) or DICOM (Digital Image and Communications in Medicine) standards, and communication between the devices is performed in accordance with HL7 or DICOM. Note that the number of modalities 1, consoles 2, analysis devices 3, interpretation terminals 4, etc. is not particularly limited.

[0024] The modality 1 is an image generating device such as an X-ray imaging device (DR, CR), an ultrasound diagnostic device (US), a CT, or an MRI, and generates medical images as medical information by capturing images of a patient's examination target area as a subject based on examination order information transmitted from a Radiology Information System (RIS) (not shown). The medical images generated by the modality 1 have, for example, supplementary information written in the header of the image file in accordance with the DICOM standard, such as patient information (patient ID, patient name, date of birth, age, sex, height, weight, etc.), examination information (examination ID, examination date and time, type of modality, examination area, requesting department, examination purpose, etc.), and medical image identification information (e.g., UID (Unique ID)). The medical images thus supplemented with supplementary information are transmitted to an analysis device 3 or an image server 5 via a console 2 or the like.

[0025] The console 2 is an imaging control device that controls imaging in the modality 1. The console 2 outputs imaging conditions and image reading conditions to the modality 1 and acquires image data of medical images captured in the modality 1. The console 2 is configured with a control unit, display unit, operation unit, communication unit, memory unit, etc. (not shown), and each unit is connected by a bus.

[0026] The analysis device 3 is a device that performs various analyses on medical images, which are medical information. The analysis device 3 is configured as a PC (Personal Computer), a mobile terminal, or a dedicated device. The analysis device 3 is configured with a control unit, a display unit, an operation unit, a communication unit, a memory unit, etc., which are not shown, and each unit is connected by a bus. For example, the analysis device 3 performs computer-processed analysis on the medical image, which is medical information transmitted from the console 2, to detect a lesion candidate region. Here, the computer processing may involve AI analysis using AI (Artificial Intelligence) to perform image diagnosis and image analysis, including the detection of a lesion candidate region using CAD (Computer Aided Diagnosis). The analysis device 3 then adds identification information for the medical image from which the lesion candidate region was detected to information (information about the first lesion candidate region, referred to as first information) indicating the lesion candidate region obtained (detected) by computer processing (referred to as a first lesion candidate region), and transmits the information to the image server 5 via the communication unit. There may be one or more first lesion candidate regions in a single medical image. There may also be no first lesion candidate region.

[0027] Here, the first information is generated for each medical image from which the lesion was detected. In this embodiment, a GSPS format file is used as the first information. The first information includes, for example, the type of lesion, position information (such as coordinates on the medical image) for each detected first lesion candidate region, and display information indicating the first lesion candidate region on the medical image (referred to as first display information). Lesion types include, for example, nodules and masses, but may also be more detailed classifications of lesions, such as nodule types (such as solid, P-solid, and GGN). The first display information is, for example, an annotation, and differs for each type (or type) of lesion. The annotation as the first display information (annotation indicating the first lesion candidate region) is referred to as first annotation information. In this embodiment, a case where the first display information is first annotation information will be described as an example.

[0028] The image interpretation terminal 4 is, for example, a PACS (Picture Archiving and Communication System) client (PACS viewer), and is a display device that reads out medical images and first information, which are medical information, from the image server 5 or the like, and displays them for image interpretation. A user (radiography doctor) interprets the medical image on the image interpretation terminal 4 and creates the radiology doctor's interpretation findings (radiography report, etc.) regarding the medical image.

[0029] FIG. 2 is a block diagram showing the functional configuration of the image interpretation terminal 4. As shown in FIG. As shown in Figure 2, the interpretation terminal 4 is configured with a control unit 41, a memory unit 42, a data acquisition unit 43, a data output unit 44, an operation unit 45, a display unit 46, etc., and each unit is connected by a bus 47.

[0030] The control unit 41 is configured with a CPU (Central Processing Unit), RAM (Random Access Memory), etc., and comprehensively controls the operation of each unit of the interpretation terminal 4. Specifically, the CPU reads out various processing programs stored in the program storage unit 421 of the storage unit 42, expands them in the RAM, and executes various processes in accordance with the programs. The control unit 41 executes interpretation support processing A and interpretation support processing B, which will be described later, thereby functioning as a third acquisition means, a display control means, and a notification means.

[0031] The storage unit 42 is configured with an HDD (Hard Disk Drive), a semiconductor memory, etc., and includes a program storage unit 421 that stores programs for executing various processes including the interpretation support process A and interpretation support process B described below. The storage unit 42 also stores parameters, files, etc. required for executing the programs stored in the program storage unit 421.

[0032] The data acquisition unit 43 is configured, for example, by a network interface or the like, and is configured to receive data from an external device connected by wire or wirelessly via the communication network N. In this embodiment, the data acquisition unit 43 is configured by a network interface or the like, but it can also be configured by a port into which a USB memory, an SD card, or the like can be inserted.

[0033] In this embodiment, the data acquisition unit 43 acquires, for example, examination list information from the image server 5, and acquires from the image server 5 the image data of the medical image of the examination specified from the examination list by operation of the first user (primary radiologist) and the above-mentioned first information. That is, the data acquisition unit 43 functions as a first acquisition means. Also, the data acquisition unit 43 acquires, for example, from the image server 5 the image data of the medical image of the examination specified from the examination list by operation of the second user (secondary radiologist), the first information, and second information indicating the lesion candidate region detected (identified) by the first user. That is, the data acquisition unit 43 functions as a second acquisition means. The image data, first information, and second information acquired by the data acquisition unit 43 are sent to the control unit 41.

[0034] Here, a lesion candidate region detected on a medical image by a first user is referred to as a second lesion candidate region, and information indicating the second lesion candidate region (information regarding the second lesion candidate region) is referred to as second information. The second information is generated for each medical image from which the second lesion candidate region is detected. There may be one, multiple, or none of the second lesion candidate regions. The second information includes, for example, the type of lesion and location information (such as coordinates on the medical image) of each second lesion candidate region, as well as display information indicating the second lesion candidate region on the medical image (referred to as second display information). Lesion types include, for example, nodules and masses, but may also be more detailed classifications of lesions, such as nodule types (such as solid, P-solid, and GGN). The second display information is, for example, an annotation, and differs depending on the type (or types) of lesion. The annotation as the second display information (annotation indicating the second lesion candidate region) is referred to as second annotation information. In this embodiment, the case where the second display information is second annotation information will be described as an example.

[0035] Furthermore, a lesion candidate region detected on a medical image by a second user is referred to as a third lesion candidate region, and information indicating the third lesion candidate region (information regarding the third lesion candidate region) is referred to as third information. The third information is generated for each medical image from which the region is detected. There may be one, multiple, or none of the third lesion candidate regions. The third information includes, for example, the type of lesion and location information (such as coordinates on the medical image) of each third lesion candidate region, as well as display information indicating the third lesion candidate region on the medical image (referred to as third display information). Lesion types include, for example, nodules and masses, but may also be more detailed classifications of lesions, such as nodule types (such as solid, P-solid, and GGN). The third display information is, for example, an annotation, and differs depending on the type (or types) of lesion. The annotation as the third display information (annotation indicating the third lesion candidate region) is referred to as third annotation information. In this embodiment, a case where the third display information is third annotation information will be described as an example.

[0036] The data output unit 44 is configured, for example, by a network interface or the like, and is configured to output data to an external device connected by wire or wirelessly via the communication network N. In this embodiment, the data output unit 44 is configured by a network interface or the like, but a connector for connecting to an external device, a port for various media such as a USB memory, or the like can also be used.

[0037] In this embodiment, the data output unit 44 associates second information indicating a second lesion candidate region identified by a first user (primary radiologist) on the interpretation terminal 4 and primary radiology findings with the identification information of the medical image and outputs them to the image server 5. In addition, the data output unit 44 also associates third information indicating a third lesion candidate region identified by a second user (secondary radiologist) and secondary radiology findings created by the second user based on the confirmation results of the first information and the second information with the identification information of the medical image and outputs them to the image server 5.

[0038] The operation unit 45 is composed of a keyboard with various keys, a pointing device such as a mouse, or a touch panel attached to the display unit 46. The operation unit 45 allows a user to input operations, and specifically outputs operation signals input by key operations on the keyboard, mouse operations, or touch operations on the touch panel to the control unit 41. The operation unit 45 functions as a selection means.

[0039] The display unit 46 is configured to include a monitor such as an LCD (Liquid Crystal Display), and displays various screens according to instructions of a display signal input from the control unit 41. The number of monitors is not limited to one, and multiple monitors may be provided.

[0040] The image server 5 is, for example, a PACS server, and stores in a database medical images output from the modality 1 via the console 2 in association with patient information, examination information, medical image identification information, first information, second information, third information, primary reading findings, secondary reading findings, examination reading status information (e.g., unread, primary reading in progress, waiting for secondary reading, secondary reading in progress, reading completed, etc.).

[0041] For example, when the image server 5 receives a medical image from the modality 1, it stores the medical image in the database in association with its accompanying information, such as patient information, examination information, medical image identification information, and interpretation status information (uninterpreted image). Furthermore, when the image server 5 receives first information and medical image identification information from the analysis device 3, it stores the received first information in the database in association with the medical image and examination information. In addition, the image server 5 extracts examination records that meet specified conditions (for example, the examination date and time is within a specified period or the interpretation status information is not indicating that interpretation is complete) from the database at specified time intervals, generates examination list information (including interpretation status information), and sends it to the interpretation terminal 4. In addition, the image server 5 reads out the medical images of the examination requested by the image interpretation terminal 4 from the database and transmits them to the image interpretation terminal 4, and updates the image interpretation status information of the examination, for example, during the primary image interpretation or secondary image interpretation. In addition, when the image server 5 receives the second information, which is the primary interpretation result, the primary interpretation findings, and the identification information of the medical image from the interpretation terminal 4, it stores the received second information and primary interpretation findings in the database in association with the medical image and examination information, and updates the interpretation status information of the examination corresponding to the medical image to waiting for secondary interpretation. In addition, when the image server 5 receives the third information, which is the secondary interpretation result, the secondary interpretation findings, and the identification information of the medical image from the interpretation terminal 4, it stores the received third information and secondary interpretation findings in the database in association with the medical image and examination information, and updates the interpretation status information of the examination corresponding to the medical image to interpretation completed.

[0042] In the medical information display system of this embodiment, when interpreting medical information (in this embodiment, medical images), the analysis device 3 performs computer processing (AI analysis) for analysis, and the first user, a primary radiologist, interprets the image. Based on the first information and second information, which are the results of detection of lesion candidate regions by the analysis device 3, the second user, a secondary radiologist, confirms the results and obtains final interpretation findings (secondary interpretation findings). The interpretation status information managed by the image server 5 conforms to this workflow, and the interpretation terminal 4 displays examination list information, allowing each user to recognize the examinations that need to be interpreted. For example, an examination with status information of "uninterpreted" is an examination that should be interpreted by the primary radiologist. An examination with status information of "awaiting secondary interpretation" is an examination that should be interpreted by the secondary radiologist. The detection result of the first lesion candidate region by computer processing (AI analysis) in the analysis device 3 is also referred to as the analysis result. The detection result of the second lesion candidate region or the third lesion candidate region by the radiologist is also referred to as the interpretation result.

[0043] [Operation of the image reading terminal] Next, the operation of the image interpretation terminal 4 when the image interpretation doctor, who is the user, performs image interpretation will be described.

[0044] (Interpretation by a primary radiologist) First, the operation of the primary image interpretation physician when performing image interpretation will be described. In the image interpretation terminal 4, the primary image interpretation doctor operates the operation unit 45 to display the examination list information on the display unit 46, and then operates the operation unit 45 to select an "uninterpreted" examination from the examination list information.

[0045] When an "uninterpreted" examination is selected from the examination list information by operating the operation unit 45, the control unit 41 executes the interpretation support process A shown in Fig. 3. The interpretation support process A is executed by the control unit 41 in cooperation with the program stored in the program storage unit 421.

[0046] In the image interpretation support process A, first, the control unit 41 acquires the medical image and first information of the selected examination from the image server 5 using the data acquisition unit 43 (step S1). For example, the control unit 41 transmits the examination ID of the selected examination to the image server 5 via the data output unit 44, requests the transmission of image data of the medical image corresponding to the examination ID and the first information, and acquires the image data of the medical image of the selected examination and the first information from the image server 5 via the data acquisition unit 43.

[0047] Next, the control unit 41 causes the display unit 46 to display the image interpretation screen 461 on which the acquired medical image is displayed (step S2).

[0048] Fig. 4 is a diagram showing an example of the image interpretation screen 461. As shown in Fig. 4, the image interpretation screen 461 is provided with a patient information display field 461a for displaying patient information, an image display field 461b for displaying medical images, a result display button 461c, a findings input button 461d, an end button 461e, a mark display button 461g, an image switching button 461h, and the like. The result display button 461c is a button for instructing that the analysis results and interpretation results be displayed after interpretation. The finding input button 461d is a button for instructing input of image findings. The end button 461e is a button for instructing the end of interpretation. The mark display button 461g is a button for instructing that the first annotation information indicating the analysis results (i.e., the first lesion candidate area) be displayed during interpretation (during secondary interpretation, the second annotation information indicating the primary interpretation results (i.e., the second lesion candidate area) be further displayed). The image switching button 461h is a button for switching the medical image to be displayed when a plurality of medical images are taken in an examination.

[0049] In this embodiment, in order to prevent the radiologist from being influenced by the analysis results when interpreting the image, in step S2, the medical image is displayed in the image display field 461b without displaying the first annotation information indicating the analysis results. However, by pressing the mark display button 461g using the operation unit 45, the first annotation information indicating the analysis results by the analysis device 3 is displayed, and it is also possible to perform interpretation while checking the first annotation information. The primary radiologist interprets the medical image displayed in the image display field 461b, and when a second lesion candidate region that is thought to be a lesion is detected, the primary radiologist specifies the region (for example, the center of the region) using the operation unit 45.

[0050] The control unit 41 determines whether or not the mark display button 461g has been pressed to instruct display of the first annotation information (step S3). If it is determined that an instruction to display the first annotation information has been issued (step S3; YES), the control unit 41 displays the first annotation information on the medical image displayed in the image display field 461b based on the first information (step S4), and then proceeds to step S5. If it is determined that the display of the first annotation information has not been instructed (step S3; NO), the control unit 41 proceeds to step S5.

[0051] In step S5, control unit 41 determines whether or not the position of a second lesion candidate region has been designated by operation unit 45 (step S5). For example, when a medical image displayed in the image display field 461b is designated (e.g., clicked) by the operation unit 45, the control unit 41 displays, near the designated position, a menu 51 for selecting a process to be performed on the designated position, as shown in FIG. 5. When an item instructing the addition of a lesion mark (e.g., "pulmonary nodule mark") is selected from this menu 51, the control unit 41 determines that the position of a second lesion candidate region has been designated. Although not shown in FIG. 5, the menu 51 may also display a menu for selecting the display of marks for other types of lesions, such as "tumor mark," in addition to the "pulmonary nodule mark." Furthermore, in addition to the display shown in FIG. 5, it may also be possible to select the addition of marks for each type of lesion that is further classified (e.g., nodule type (Solid, P-Solid, GGN, etc.)).

[0052] If it is determined that the position of the second lesion candidate region has not been designated (step S5; NO), control unit 41 proceeds to step S7.

[0053] If it is determined that the position of the second lesion candidate region has been designated (step S5; YES), control unit 41 assigns second annotation information to the second lesion candidate region (step S6), and proceeds to step S7.

[0054] In step S6, the control unit 41, for example, as shown in Figure 5, etc., displays first display candidate information 52 corresponding to second annotation information (candidate for second annotation information) indicating the candidate area of ​​the selected type of lesion near the selected item of the menu 51 in a selectable manner, and assigns (displays) annotation information (mark) corresponding to the candidate selected from the first display candidate information 52 as second annotation information at the position of the specified second lesion candidate area.

[0055] Generally, the primary radiologist selects the second annotation information from the first display candidate information 52 in accordance with, for example, the operational rules of the medical facility. However, if the primary radiologist selects the same mark as the first annotation information indicating the analysis results by the analysis device 3, when the result display button 461c is pressed to finally display the first annotation information indicating the analysis results and the second annotation information indicating the interpretation results, or when the secondary radiologist makes a final confirmation, it will be impossible to distinguish between the first annotation information indicating the analysis results and the second annotation information indicating the interpretation results. In particular, if the next secondary radiologist makes a diagnosis without being able to distinguish between the annotation information provided by the primary radiologist and the analysis device 3, the annotation information provided by the user (primary radiologist) will be highly reliable, while the annotation information provided by the analysis device 3 may contain many false positives. Therefore, the radiologist must interpret the image while mixing the highly reliable annotation information provided by the user and the less reliable annotation information provided by the analysis device 3, which may result in missing important lesions. In addition, the computer-generated analysis results cannot be used as a final, definitive diagnosis, and the radiologist making the final diagnosis (in this embodiment, the secondary radiologist) must confirm the analysis results provided by the analysis device 3. In this case, there is a possibility that the secondary radiologist will overlook analysis results that should have been reviewed and make the diagnosis final without reviewing them.

[0056] Therefore, the control unit 41 refers to the first information acquired from the analysis device 3 and controls so that annotation information identical to the first annotation information indicating the analysis result (annotation information indistinguishable from the first annotation information) is not displayed as the second annotation information indicating the interpretation result. For example, the control unit 41 performs one of the following controls (1) to (2).

[0057] (1) For example, when displaying the first display candidate information 52, the control unit 41 displays information corresponding to second annotation information that is distinguishable from the first annotation information as the first display candidate information 52. At this time, as shown in FIG. 5 , together with the first display candidate information 52, second display candidate information 53 corresponding to the same second annotation information as the first annotation information is displayed as unselectable display candidate information. For example, the second display candidate information 53 is displayed as unselectable display candidate information by graying it out or making it unpressable. In addition, at this time, it is preferable that the control unit 41 notify the user of the reason why the annotation information corresponding to the second display candidate information 53 cannot be displayed. The notification may be displayed, for example, as indicated by reference numeral 54 in FIG. 5 , or may be audio if the interpretation terminal 4 is configured to include an audio output unit.

[0058] (2) Alternatively, as shown in FIG. 6(a), the control unit 41 may display, together with the first display candidate information 52, second display candidate information 53 corresponding to the same second annotation information as the first annotation information, as selectable display candidate information in the same way as the first display candidate information 52. When the second display candidate information 53 is selected by the operation unit 45, the control unit 41 may notify the user of the reason why the second annotation information corresponding to the selected second display candidate information 53 is not displayed, as shown in FIG. 6(b), and may prompt the user to select from the first display candidate information 52. The notification may be, for example, a pop-up notification screen 55 as shown in FIG. 6(b), or may be audible if the interpretation terminal 4 is configured to include an audio output unit. 6(c), together with the notification, a message prompting the user to permit the change of the second annotation information to annotation information corresponding to one of the first display candidate information 52, rather than the annotation information selected by the user, and an "Allow" button 56 to be pressed by the user to permit the change may be displayed. When the "Allow" button 56 is pressed by the operation unit 45 and permission information indicating that the change is permitted is acquired, the control unit 41 may automatically change the second annotation information to annotation information that is different from the selected information and that is distinguishable from the first annotation information, and display the changed information. Alternatively, the first display candidate information 52 may be displayed and the user may select another candidate, thereby changing the second annotation information to annotation information that is distinguishable from the first annotation information and displaying the changed information.

[0059] The control unit 41 determines that the first annotation information and the second annotation information are distinguishable when at least one of the shape, line type, thickness, color, brightness, transparency, and symbol is different between the first annotation information and the second annotation information. Alternatively, even if the shape, line type, thickness, color, brightness, transparency, and symbol are the same between the first annotation information and the second annotation information, the control unit 41 may determine that the first annotation information and the second annotation information are distinguishable when at least one of the identification information of a character or a symbol is added to the second annotation information. That is, the control unit 41 displays, as the first display candidate information 52, annotation information that is different from the first annotation information in at least one of the shape, line type, thickness, color, brightness, transparency, and symbol, or that is the same as the first annotation information in the shape, line type, thickness, color, brightness, transparency, and symbol and has at least one of the identification information of a character or a symbol added. This makes it possible to display the first annotation information, which is the analysis result, and the second annotation information, which is the interpretation result, in a manner that allows them to be distinguished from each other when they are displayed simultaneously.

[0060] Control unit 41 temporarily stores in RAM the position (coordinates) of the second lesion candidate region specified by operation unit 45, the type of lesion, the second annotation information, and the date and time when the second lesion candidate region was specified (or the date and time when the second annotation information was selected). Furthermore, if the second annotation information is changed (for example, if the user selects second display candidate information 53 as the second annotation information and then changes it to different first display candidate information 52), control unit 41 temporarily stores in RAM the second annotation information before and after the change and the date and time when the change was made.

[0061] Once the interpretation and input of the interpretation results (designation of the second lesion candidate area and selection of the second annotation information) are completed, the primary interpretation physician can either press the result display button 461c to clearly display the first annotation information and the second annotation information on the medical image displayed in the image display field 461b and confirm the analysis results and interpretation results, or press the findings input button 461d to input the interpretation findings.

[0062] In step S7, the control unit 41 determines whether or not the result display button 461c has been pressed (step S7). If it is determined that the result display button 461c has not been pressed (step S7; NO), the control unit 41 proceeds to step S9. If it is determined that the result display button 461c has been pressed (step S7; YES), the control unit 41 simultaneously displays the first annotation information and the second annotation information in a distinguishable manner on the medical image displayed in the image display field 461b (step S8), and then proceeds to step S9.

[0063] Fig. 7 is a diagram showing a display example of the interpretation screen 461 in step S8. As shown in Fig. 7, in step S8, first annotation information A1 indicating the analysis result and second annotation information A2 indicating the interpretation result are simultaneously displayed on the medical image displayed in the image display field 461b. The first annotation information A1 and the second annotation information A2 are different and therefore displayed in a distinguishable manner, allowing the interpreting physician to distinguish between the analysis result and the interpretation result and confirm them separately.

[0064] In step S9, the control unit 41 determines whether or not the findings input button 461d has been pressed (step S9). When it is determined that the finding input button 461d has not been pressed (step S9; NO), the control unit 41 proceeds to step S11. If it is determined that the finding input button 461d has been pressed (step S9; YES), the control unit 41 displays the image reading finding input field 461f on the image reading screen 461 as shown in FIG. 8, accepts the input of the image reading finding (primary image reading finding) by the user (primary image reading physician), acquires the primary image reading finding (step S10), and proceeds to step S11.

[0065] In step S11, the control unit 41 determines whether or not the end button 461e has been pressed (step S11). If it is determined that the end button 461e has not been pressed (step S11; NO), the control unit 41 returns to step S3 and repeats the processes of steps S3 to S11.

[0066] If it is determined that end button 461e has been pressed (step S11; YES), control unit 41 creates second information indicating a second lesion candidate region (step S12). In step S12, the control unit 41 creates, in a file of a predetermined format, second information including the position (coordinates) of the second lesion candidate region, the type of lesion, and the second annotation information specified by the operation unit 45 before it is determined in step S11 that the end button 461e has been pressed, based on the information temporarily stored in the RAM. The second information file is provided with identification information for the medical image corresponding to the second information and a timestamp indicating when the second information was input. Note that if the second annotation information has been changed before it is determined in step S11 that the end button 461e has been pressed (for example, if the user selects second display candidate information 53 as the second annotation information and then changes it to another first display candidate information 52), the control unit 41 creates second information files for both the information before and after the change. Furthermore, if a second lesion candidate region is not detected, for example, information indicating that fact is created as the second information.

[0067] Then, the control unit 41 stores the created second information (if there is a change in the second annotation information, the second information before and after the change) and the primary interpretation findings in the memory unit 42 in association with the medical image (identification information of the medical image, patient information, and examination information) (step S13), and outputs the second information (if there is a change in the second annotation information, the second information before and after the change) and the primary interpretation findings to the image server 5 via the data output unit 44 in association with the identification information of the medical image (step S14), thereby completing the interpretation support process A.

[0068] When the image server 5 receives the second information and the primary interpretation findings from the interpretation terminal 4, it stores the received second information and the primary interpretation findings in the database in association with the medical image and examination information. Then, it updates the interpretation status information of the examination corresponding to the received medical image to waiting for secondary interpretation.

[0069] (Interpretation by a secondary radiologist) Next, the operation of the secondary image interpretation doctor when performing image interpretation will be described. In the image interpretation terminal 4, the secondary image interpretation doctor operates the operation unit 45 to display the examination list information on the display unit 46, and then operates the operation unit 45 to select an examination that is "awaiting secondary image interpretation" from the examination list information.

[0070] When an examination "awaiting secondary interpretation" is selected from the examination list information by operating the operation unit 45, the control unit 41 executes the interpretation support process B shown in Fig. 9. The interpretation support process B is executed by the control unit 41 in cooperation with the program stored in the program storage unit 421.

[0071] In the image interpretation support process B, first, the control unit 41 acquires the medical image, the first information, the second information, and the primary image interpretation findings of the selected examination from the image server 5 using the data acquisition unit 43 (step S21). For example, the control unit 41 transmits the examination ID of the selected examination to the image server 5 via the data output unit 44, requests the transmission of image data, first information, second information, and primary interpretation findings of the medical image corresponding to the examination ID, and acquires the medical image data, first information, second information, and primary interpretation findings of the selected examination from the image server 5 via the data acquisition unit 43.

[0072] Next, the control unit 41 causes the display unit 46 to display the image interpretation screen 461 on which the acquired medical image is displayed (step S22). The image interpretation screen 461 displayed in step S22 is the same as that shown in FIG. The secondary interpretation physician interprets the displayed medical image on the interpretation screen 461, and when a third lesion candidate region that is thought to be a lesion is detected, the secondary interpretation physician specifies the region (for example, the center of the region) using the operation unit 45. In addition, the secondary interpretation physician can display the first annotation information and the second annotation information on the medical image by pressing the mark display button 461g, and perform interpretation based on the confirmation results.

[0073] The control unit 41 determines whether or not the mark display button 461g has been pressed to instruct display of the first annotation information and the second annotation information (step S23). If it is determined that an instruction to display the first annotation information and the second annotation information has been issued (step S23; YES), the control unit 41 simultaneously displays the first annotation information and the second annotation information in a distinguishable manner on the medical image displayed in the image display field 461b based on the first information and the second information (step S24), and then proceeds to step S25. As described above, in the interpretation support process A, the second annotation information is different from the first annotation information, and therefore the first annotation information and the second annotation information are displayed in a distinguishable manner. This allows the secondary interpretation physician to distinguish between the analysis results and the interpretation results of the primary interpretation physician, preventing the secondary interpretation physician from overlooking a lesion that should be seen.

[0074] When it is determined that the display of the first annotation information and the second annotation information has not been instructed (step S23; NO), the control unit 41 proceeds to step S25.

[0075] In step S25, control unit 41 determines whether or not the position of a third lesion candidate region has been designated by operation unit 45 (step S25). For example, when a medical image displayed in the image display field 461b is designated (clicked) by the operation unit 45, the control unit 41 displays, for example, a menu 51 for selecting a process to be performed on the designated position near the designated position, as shown in FIG. 5. When an item instructing the addition of a lesion mark (e.g., "pulmonary nodule mark") is selected from this menu 51, the control unit 41 determines that the position of a third lesion candidate region has been designated. Although not shown in FIG. 5, the menu 51 also displays a menu for selecting the display of marks for other types of lesions, such as "tumor mark," in addition to the "pulmonary nodule mark." Furthermore, in addition to the display shown in FIG. 5, it may be possible to select the addition of marks for each type of lesion that is further classified (e.g., nodule type (Solid, P-Solid, GGN, etc.)).

[0076] If it is determined that the position of the third lesion candidate region has not been designated (step S25; NO), control unit 41 proceeds to step S27. If it is determined that the position of the third lesion candidate region has been specified (step S25; YES), the control unit 41 assigns third annotation information to the third lesion candidate region indicating that it is a third lesion candidate region (step S26), and proceeds to step S27.

[0077] Here, the control unit 41 assigns third annotation information, which is different from the first annotation information and indicates the third lesion candidate region detected by the secondary radiologist, but the third annotation information may be the same as or different from the second annotation information. Whether the third annotation information is the same as the second annotation information can be set in advance by the user, for example, by operating the operation unit 45.

[0078] For example, if the third annotation information is set to be the same as the second annotation information, when the user selects from menu 51 in Fig. 5 to mark the type of lesion included in the second information, control unit 41 automatically selects the same annotation information as the second annotation information corresponding to the selected type of lesion as the third annotation information, and displays it in the third lesion candidate area specified by the user via operation unit 45. This makes it possible to display the analysis results and the interpretation results of the radiologist in a manner that allows them to be distinguished when the analysis results and the interpretation results of the radiologist are displayed simultaneously.

[0079] Furthermore, for example, when the third annotation information is set to be different from the second annotation information, the control unit 41 selects display candidate information corresponding to the third annotation information and displays the third annotation information, for example, by using either method (1) or (2) described in step S6 of the above-mentioned interpretation support process A. At this time, the control unit 41 displays the third display candidate information, which is a candidate for the third annotation information, instead of displaying the first display candidate information 52, which is a candidate for the second annotation information. The third display candidate information is annotation information that is not used as either the first annotation information or the second annotation information. Furthermore, instead of displaying the second display candidate information 53, the control unit 41 displays the fourth display candidate information corresponding to the same annotation as the first annotation information or the second annotation information, and controls the user to select information corresponding to the third annotation information from the third display candidate information instead of the fourth display candidate information. This makes it possible to simultaneously display the first annotation information, which is the analysis result, the second annotation information, which is the interpretation result of the primary radiologist, and the third annotation information, which is the interpretation result of the secondary radiologist, in a manner that allows each to be distinguished.

[0080] Control unit 41 temporarily stores in RAM the position (coordinates) of the third lesion candidate region specified by operation unit 45, the type of lesion, the third annotation information, and the date and time when the third lesion candidate region was specified (or the date and time when the third annotation information was selected). Furthermore, if there is a change in the third annotation information (for example, if the user selects fourth display candidate information as the third annotation information and then changes to another third display candidate information), control unit 41 temporarily stores in RAM the third annotation information before and after the change and the date and time when the change was made.

[0081] When the input of the interpretation results (input of the third annotation information) is completed, the secondary interpretation physician can either press the result display button 461c to display the first annotation information, the second annotation information, and the third annotation information on the medical image displayed in the image display field 461b and confirm the analysis results and interpretation results, or press the findings input button 461d to input the interpretation findings (secondary interpretation findings).

[0082] In step S27, the control unit 41 determines whether or not the result display button 461c has been pressed (step S27). If it is determined that the result display button 461c has not been pressed (step S27; NO), the control unit 41 proceeds to step S29. If it is determined that the result display button 461c has been pressed (step S27; YES), the control unit 41 simultaneously displays the first annotation information, the second annotation information, and the third annotation information in a distinguishable manner on the medical image displayed in the image display field 461b (step S28), and proceeds to step S29.

[0083] Here, if an annotation different from the second annotation information is assigned as the third annotation information in step S26, the first annotation information indicating the analysis result by the analysis device 3, the second annotation information indicating the interpretation result by the primary radiologist, and the third annotation information indicating the interpretation result by the secondary radiologist are displayed in a distinguishable manner in step S28. The secondary radiologist can confirm the first annotation information and the second annotation information, make a definitive diagnosis based on the confirmation result and his / her own interpretation result, and prepare radiology findings. Furthermore, if the same annotation as the second annotation information is assigned as the third annotation information in step S26, the analysis results and the interpretation results by the radiologist are displayed in a distinguishable manner in step S28, so that the secondary radiologist can distinguish between the computer analysis results and the interpretation results by the radiologist and create interpretation findings. In either case, the analysis results by the analysis device 3 and the interpretation results by the radiologist are displayed separately, preventing highly reliable interpretation results (for example, a suspected lesion area detected by the primary radiologist) from being overlooked or making a definitive diagnosis without checking the computer-processed analysis results that should actually be seen.

[0084] In addition, the interpretation screen 461 may be provided with buttons for switching the display of each piece of annotation information ON / OFF (such as a first switching button for switching the first annotation information ON / OFF, a second display button for switching the second annotation information ON / OFF, and a third display button for switching the third annotation information ON / OFF), making it possible to switch the annotations displayed on the medical image. For example, each piece of annotation information may be displayed on the medical image or the display may be erased. This allows the secondary interpretation physician to perform interpretation efficiently.

[0085] In step S29, the control unit 41 determines whether or not the findings input button 461d has been pressed (step S29). When it is determined that the finding input button 461d has not been pressed (step S29; NO), the control unit 41 proceeds to step S31. If it is determined that the finding input button 461d has been pressed (step S29; YES), the control unit 41 displays the image reading finding input field 461f on the image reading screen 461 as shown in FIG. 8, accepts the input of the image reading findings by the second user, the secondary image reading physician, and acquires the secondary image reading findings (step S30), and proceeds to step S31. The secondary image interpretation findings may be prepared as separate findings from the primary image interpretation findings, or may be prepared by the secondary image interpretation physician correcting the primary image interpretation findings. The secondary image interpretation physician makes a definitive diagnosis based on the analysis results, the primary image interpretation results, and the secondary image interpretation results, and prepares the secondary image interpretation findings.

[0086] In step S31, the control unit 41 determines whether or not the end button 461e has been pressed (step S31). If it is determined that the end button 461e has not been pressed (step S31; NO), the control unit 41 returns to step S23 and repeats the processes of steps S23 to S31.

[0087] When it is determined that end button 461e has been pressed (step S31; YES), control unit 41 creates third information indicating a third lesion candidate region (step S32). In step S32, the control unit 41 creates third information in a file of a predetermined format, based on the information temporarily stored in RAM. The third information includes the position (coordinates) of the third lesion candidate region specified by the operation unit 45 before it is determined in step S31 that the end button 461e has been pressed, the type of lesion, and the third annotation information. The third information file is provided with identification information for the medical image corresponding to the third information and a timestamp for when the third information was input. Note that if the third annotation information has been changed before it is determined in step S31 that the end button 461e has been pressed (for example, if the user selects fourth display candidate information that cannot be used as the third annotation information and then changes to another third display candidate information), the control unit 41 creates third information files for both the information before and after the change. Furthermore, if a third lesion candidate region is not detected, for example, information indicating that fact is created as the third information.

[0088] Then, the control unit 41 stores the created third information (if there is a change in the third annotation information, the third information before and after the change) and secondary interpretation findings in the memory unit 42 in association with the medical image (identification information of the medical image, patient information, and examination information) (step S33), and outputs the third information (if there is a change in the third annotation information, the third information before and after the change) and secondary interpretation findings to the image server 5 via the data output unit 44 in association with the identification information of the medical image (step S34), and terminates the interpretation support process B.

[0089] When the image server 5 receives the third information and the secondary image findings from the image interpretation terminal 4, it stores the received third information and secondary image findings in the database in association with the medical image and examination information. Then, it updates the image interpretation status information of the examination corresponding to the received medical image to "interpretation completed."

[0090] <Second embodiment> In the first embodiment described above, the control unit 41 controls the selection of annotation information different from the first annotation information when the user selects the second annotation information so that the first annotation information and the second annotation information can be displayed in a distinguishable manner. However, the second annotation information that is distinguishable from the first annotation information may be stored in the memory unit 42 in advance, and when displaying the second annotation information, the control unit 41 may refer to the second annotation information stored in the memory unit 42 and display it.

[0091] For example, after first information is generated by AI analysis, the analysis device 3 refers to the first information and pre-assigns annotation information that is not used as the first annotation information and can be distinguished from the first annotation information as second annotation information for each type (or category) of lesion, and transmits this assigned information to the image server 5 together with the first information and identification information of the medical image from which the lesion was detected. The image server 5 stores the received first information and allocation information in a database in association with the medical image and examination information. When acquiring the medical image and the first information of the selected examination, the data acquisition unit 43 of the interpretation terminal 4 also acquires the allocation information, and the control unit 41 stores the acquired allocation information in the storage unit 42. When displaying the second annotation information in the specified second lesion candidate region, the control unit 41 displays the second annotation information by referring to the allocation information stored in the storage unit 42. This allows the control unit 41 to display the first annotation information and the second annotation information in a distinguishable manner when simultaneously displaying the first annotation information and the second annotation information on the display unit 46.

[0092] The allocation information of the second annotation information does not necessarily have to be generated by the analysis device 3, but may be generated by the image server 5 or the interpretation terminal 4, for example.

[0093] As described above, when the control unit 41 of the interpretation terminal 4 simultaneously displays on the display unit 46 first display information (e.g., first annotation information) indicating a first lesion candidate area obtained by computer processing of medical information and second display information (e.g., second annotation information) indicating a second lesion candidate area identified by the user based on the medical information, the control unit 41 displays the first display information and the second display information in a distinguishable manner. Therefore, when a doctor reads the medical information by displaying the detection results of the first lesion candidate area obtained by computer processing and the detection results of the second lesion candidate area obtained by the doctor, the doctor can distinguish whether the display information displayed on the medical image is the first display information showing the detection results by the analysis device 3 or the second display information showing the detection results by the user, thereby preventing the doctor from overlooking a lesion that should be seen.

[0094] For example, when the control unit 41 simultaneously displays first display information showing the detection results by the analysis device 3 and second display information showing the detection results by the primary radiologist, the control unit 41 displays the first display information and the second display information in a distinguishable manner, thereby assisting the secondary radiologist in efficiently and accurately creating radiological findings based on the detection results by the analysis device 3 and the confirmation results of the detection results by the primary radiologist.

[0095] For example, the control unit 41 displays selectable first display candidate information corresponding to second display information distinguishable from the first display information, and displays the selected first display candidate information as the second display information. Therefore, it is possible to display second display information distinguishable from the first display information.

[0096] Furthermore, for example, the control unit 41 displays the first display candidate information in a selectable manner, and displays second display candidate information corresponding to the same second display information as the first display information as unselectable display candidate information, and notifies the user of the reason why the information is unselectable. This prevents the user from selecting second information that is indistinguishable from the first display information, and makes it possible to display second display information that is distinguishable from the first display information.

[0097] Furthermore, for example, the control unit 41 displays the first display candidate information in a selectable manner, and also displays second display candidate information corresponding to the same second display information as the first display information as selectable display candidate information, and when the second display candidate information is selected, notifies the user of the reason why the second display information is not displayed. Therefore, even if the user selects second information that is indistinguishable from the first display information, it is possible to prevent the second display information from being displayed as the second display information, and it is possible to display second display information that is distinguishable from the first display information. Furthermore, when the user selects second information that is indistinguishable from the first display information, the control unit 41 acquires permission information indicating that the user has given permission to change the second display information, and when the permission information has been acquired, the control unit 41 changes the second display information, thereby making it possible to display the first display information and the second display information in a distinguishable manner.

[0098] Furthermore, for example, when the control unit 41 changes the second display information, the control unit 41 stores the second display information before the change corresponding to the changed second display information in the storage unit 42. Therefore, it is possible to save the history of the second display information.

[0099] Furthermore, for example, the control unit 41 displays the first display information and the second display information in a distinguishable manner by making at least one selected from the group consisting of shape, line type, thickness, color, brightness, transparency, and symbol different between the first display information and the second display information. Alternatively, the control unit 41 displays the second display information in a distinguishable manner by adding at least one identifying information, such as a character or a symbol, to the second display information. This allows the user to easily distinguish between the first display information and the second display information.

[0100] Furthermore, for example, control unit 41 stores second display information that is distinguishable from first display information indicating a first lesion candidate region in storage unit 42, and displays the second display information based on the information stored in storage unit 42. Therefore, the first display information and the second display information can be displayed in a distinguishable manner.

[0101] The present invention is not limited to the above-described embodiment, and various modifications are possible without departing from the spirit of the present invention.

[0102] For example, in the above embodiment, the medical information of the present invention is explained as a medical image, but the medical information is not limited to a medical image. Information obtained by various tests on patients may be broadly included in medical information, and may also include results obtained from various tests, such as electrocardiogram waveform data, heart sound data, data on blood flow, etc. The present invention may be applied when AI analysis is performed on such medical information, and first display information showing the results of the AI ​​analysis and second display information showing the doctor's interpretation results are displayed on the medical information.

[0103] In addition, in the above embodiment, the first display information is not changed, and second display information different from the first display information is selected. However, if the second display information is determined in advance by a facility or the like, the first display information may be changed to one that makes the second display information distinguishable, without changing the second display information.

[0104] In the above embodiment, the first information including the first display information is acquired in the GSPS format, but the format is not limited to this and may be an SR (Structured Report) format. Also, an image (capture image (screen capture)) in which the first display information (first annotation information) is displayed on a medical image may be generated by the analysis device 3, and this may be acquired and used as the first display information.

[0105] Furthermore, in the above embodiment, an example has been described in which the user selects the second display information, but if the second display information is predetermined based on the type of lesion, such as in a medical facility, that information may be stored in storage unit 42, and when the type of lesion and the second lesion candidate region are specified by operation unit 45, control unit 41 may display the second display information based on the information stored in storage unit 42. If the second display information for the specified lesion type is indistinguishable from (identical to) the first display information for any of the first lesion candidate regions, control unit 41 may display a user interface such as that shown in FIG. 5 or 6(a) to 6(c) to allow the user to select second display information that is distinguishable from the first display information, or may automatically select second display information that is distinguishable from the first display information in accordance with a predetermined priority order and display the second display information.

[0106] In addition, in the above embodiment, in Figure 1, the analysis device 3, the interpretation terminal 4, and the image server 5 are illustrated as separate and independent devices, but the interpretation terminal 4 and the image server 5, the analysis device 3 and the image server 5, and the analysis device 3, the interpretation terminal 4, and the image server 5 may be configured as a single device (display device). Furthermore, the first acquisition means, second acquisition means, third acquisition means, display unit, display control means, selection means, and notification means of the present invention may be distributed among a plurality of devices.

[0107] In the above description, examples have been disclosed in which a hard disk or a semiconductor nonvolatile memory is used as a computer-readable medium for the program according to the present invention, but the present invention is not limited to these examples. Portable recording media such as CD-ROMs can also be used as other computer-readable media. Furthermore, carrier waves can also be used as a medium for providing data for the program according to the present invention via a communication line.

[0108] In addition, the detailed configuration and operation of each device constituting the medical information display system can be modified as appropriate without departing from the spirit of the invention. [Explanation of symbols]

[0109] 1. Modality 2 Console 3 Analysis device 4. Image reading terminal 41 Control Unit 42 Storage section 421 Program Memory Unit 43 Data Acquisition Section 44 Data output section 45 Control section 46 Display section 47 Bus 5. Image Server 100 Medical Information Display System

Claims

1. a display control means for simultaneously displaying on a display unit first display information indicating a first lesion candidate region obtained by computer processing of medical information and second display information indicating a second lesion candidate region specified by a user based on the medical information; the display control means controls to selectably display first display candidate information, which is information corresponding to the second display information that can be distinguished from the first display information; a selection means for allowing a user to select the first display candidate information; When the first display information and the second display information are simultaneously displayed, the display control means adds the second display information based on the first display candidate information selected by the selection means so that the first display information and the second display information can be distinguished from each other. Display device.

2. a third acquisition means for acquiring image findings prepared by a second user based on the medical information; the third acquisition means acquires the image findings based on a confirmation result of the first display information and the second display information by the second user. The display device according to claim 1 .

3. 2. The display device according to claim 1, wherein the display control means displays the first display candidate information in a selectable manner, and displays second display candidate information corresponding to second display information identical to the first display information as non-selectable display candidate information.

4. The display device according to claim 3 , further comprising a notification unit that, when the second display candidate information is displayed as unselectable display candidate information, notifies the user of a reason why the second display candidate information is unselectable.

5. the display control means displays the first display candidate information in a selectable manner, and displays second display candidate information corresponding to second display information identical to the first display information as selectable display candidate information; The display device according to claim 1 , further comprising a notification unit that, when the second display candidate information is selected, notifies the user of a reason why the second display information is not displayed.

6. a permission information acquisition means for acquiring permission information permitting the second display information to be changed; The display device according to claim 5, wherein the display control means, when acquiring the permission information, changes the second display information to display the first display information and the second display information in a distinguishable manner.

7. The display device according to claim 6 , further comprising a storage unit configured to store, when the second display information is changed, the second display information before the change corresponding to the changed second display information.

8. The display device according to claim 1, wherein the display control means displays the first display information and the second display information in a distinguishable manner by making the first display information and the second display information different in at least one selected from the group consisting of shape, line type, thickness, color, brightness, transparency, and symbol.

9. The display device according to claim 1, wherein the display control means displays the first display information and the second display information in a distinguishable manner by adding at least one identification information, such as a character or a symbol, to the second display information.

10. The display device according to claim 1 , wherein the first display information is first annotation information, and the second display information is second annotation information.

11. The display device according to claim 1 , further comprising a storage unit that stores the second display information that can be distinguished from the first display information that indicates the first lesion candidate region.

12. a display control means for simultaneously displaying on a display unit first display information indicating a first lesion candidate region obtained by computer processing of medical information and second display information indicating a second lesion candidate region specified by a user based on the medical information; the display control means controls to selectably display first display candidate information, which is information corresponding to the second display information that can be distinguished from the first display information; a selection means for allowing a user to select the first display candidate information; When the first display information and the second display information are simultaneously displayed, the display control means adds the second display information based on the first display candidate information selected by the selection means so that the first display information and the second display information can be distinguished from each other. Medical information display system.

13. a third acquisition means for acquiring image findings prepared by a second user based on the medical information; the third acquisition means acquires the image findings based on a confirmation result of the first display information and the second display information by the second user. The medical information display system of claim 12.

14. On the computer, A program for executing a display function to simultaneously display on a display unit first display information indicating a first lesion candidate region obtained by computer processing of medical information and second display information indicating a second lesion candidate region specified by a user based on the medical information, the display function controls to selectably display first display candidate information that is information corresponding to the second display information that is distinguishable from the first display information; causing the computer to further execute a selection function for a user to select the first display candidate information; When the first display information and the second display information are simultaneously displayed, the display function adds the second display information based on the first display candidate information selected by the selection function so that the first display information and the second display information can be distinguished from each other. program.

15. The computer further comprises: executes a third acquisition function for acquiring image findings prepared by a second user based on the medical information; the third acquisition function acquires the image findings based on a confirmation result of the first display information and the second display information by the second user. The program according to claim 14.

16. The program according to claim 14, wherein the display function displays the first display candidate information in a selectable manner and displays second display candidate information corresponding to second display information identical to the first display information as non-selectable display candidate information.

17. The computer further comprises:

17. The program according to claim 16, further comprising a notification function for notifying the user of a reason why the second display candidate information is unselectable when the second display candidate information is displayed as unselectable display candidate information.

18. the display function displays the first display candidate information in a selectable manner, and displays second display candidate information corresponding to second display information identical to the first display information as selectable display candidate information; The computer further comprises: The program according to claim 14 , further comprising a notification function for notifying the user of a reason why the second display information is not displayed when the second display candidate information is selected.

19. The computer further comprises: Executing a permission information acquisition function to acquire permission information permitting the second display information to be changed; The program according to claim 18, wherein the display function, when acquiring the permission information, changes the second display information to display the first display information and the second display information in a distinguishable manner.

20. The computer further comprises:

20. The program according to claim 19, further comprising a storage function for, when the second display information is changed, storing the second display information before the change corresponding to the changed second display information.

21. The program of claim 14, wherein the display function displays the first display information and the second display information in a distinguishable manner by making the first display information and the second display information different in at least one selected from the group consisting of shape, line type, thickness, color, brightness, transparency, and symbol.

22. The program according to claim 14, wherein the display function displays the first display information and the second display information in a distinguishable manner by adding at least one identification information, such as a character or a symbol, to the second display information.

23. The program according to claim 14 , wherein the first display information is first annotation information, and the second display information is second annotation information.

24. The computer further comprises: The program according to claim 14 , which causes execution of a storage function of storing the second display information distinguishable from the first display information indicating the first lesion candidate region.

25. 1. A computer-implemented display method comprising: a display step of simultaneously displaying, on a display unit, first display information indicating a first lesion candidate region obtained by computer processing of medical information and second display information indicating a second lesion candidate region specified by a user based on the medical information; the display step includes controlling to selectably display first display candidate information, which is information corresponding to the second display information distinguishable from the first display information; further comprising a selection step for a user to select the first display candidate information; In the display step, when the first display information and the second display information are simultaneously displayed, the second display information is added based on the first display candidate information selected in the selection step so that the first display information and the second display information can be distinguished from each other. Display method.

26. a third acquisition step of acquiring image findings prepared by a second user based on the medical information; the third obtaining step obtains the image findings based on a confirmation result of the first display information and the second display information by the second user.

26. The display method according to claim 25.

Images