Information processing device, information processing method, and program

Abstract

To present the operation state of detection processing for detecting a lesion.SOLUTION: An information processing device comprises: an operation state acquisition unit which acquires information indicating the operation state of detection processing by a lesion detection unit for detecting a lesion from medical image data; and an information presentation unit which presents information about a reason why the detection processing cannot be executed when the information indicating the operation state is information indicating a state in which the detection processing cannot be executed.SELECTED DRAWING: Figure 3

Description

Technical Field

[0006] , ,

[0005] , , , ,

[0001] The present invention relates to an information processing apparatus, an information processing method, and a program.

Background Art

[0002] Computer-Aided Detection (CADe), which analyzes medical images by a computer and detects candidates for lesions that are abnormalities associated with diseases, is known. Further, with the development of Artificial Intelligence (AI) technology, the types of target lesions are expanding.

[0003] Patent Document 1 discloses a diagnostic support apparatus that divides a medical image into minute regions, calculates feature amounts for each of the minute regions, and overlays and displays an image with a different display density or display color on the medical image according to the feature amounts. Further, Patent Document 2 discloses a diagnostic support apparatus that detects abnormal shadow candidates based on detection conditions, investigates the detection performance of the abnormal shadow candidates for each detection condition of the abnormal shadow, and displays the investigated detection performance.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0005] <H However, with any of the methods of Patent Document 1 and Patent Document 2, when the detection result is not displayed, it is difficult to distinguish whether the lesion detection process has been executed and the lesion has not been detected, or the lesion has not been detected because the lesion detection process has not been executed.

[0006] In view of the above problems, the present invention provides an information processing technology capable of displaying the operating status of a lesion detection process. [Means for solving the problem]

[0007] An information processing apparatus according to one embodiment of the present invention has the following configuration. That is, the information processing apparatus according to the present invention includes an operating state acquisition means that acquires information indicating the operating state of a detection process by a lesion detection means that detects lesions from medical image data, The system includes, when the information indicating the operating status indicates that the detection process has not been performed and cannot be performed, information presenting means that presents information regarding the reason why the detection process cannot be performed. The information regarding the reason why the detection process cannot be performed includes information indicating that the lesion detection function for the target lesion has not been introduced to the lesion detection means. It is characterized by the following. [Effects of the Invention]

[0008] According to the present invention, the operating status of the lesion detection process can be displayed. [Brief explanation of the drawing]

[0009] [Figure 1] A diagram showing the configuration of the information processing system according to Embodiments 1 to 3. [Figure 2] A diagram showing the hardware configuration of the information processing device according to Embodiments 1 to 3. [Figure 3] A diagram showing the functional configuration of the information processing device according to Embodiment 1. [Figure 4] A diagram showing an example of the user interface screen of the information processing device according to Embodiment 1. [Figure 5] A flowchart illustrating the processing of the information processing device according to Embodiment 1. [Figure 6] A diagram showing the functional configuration of the information processing device according to Embodiment 2. [Figure 7] A diagram showing an example of the user interface screen of the information processing device according to Embodiment 2. [Figure 8] A flowchart illustrating the processing of the information processing device according to Embodiment 2. [Figure 9A]A diagram showing an example of a user interface screen of the information processing apparatus according to Embodiment 3. [Figure 9B] A diagram showing an example of a user interface screen of the information processing apparatus according to Embodiment 3. [Figure 10] A flowchart showing the processing of the information processing apparatus according to Embodiment 3. [Figure 11] A diagram showing the functional configuration of the information processing apparatus according to Embodiment 3.

Embodiments for Carrying Out the Invention

[0010] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the invention according to the claims. Although a plurality of features are described in the embodiments, not all of these plurality of features are essential for the invention, and the plurality of features may be arbitrarily combined. Further, in the accompanying drawings, the same or similar configurations are denoted by the same reference numerals, and redundant descriptions are omitted.

[0011] <Embodiment 1> In Embodiment ①, an information processing apparatus that displays medical images such as X-ray CT (Computed Tomography) images and MRI (Magnetic Resonance Imaging) images will be described.

[0012] The information processing apparatus of the present embodiment, for example, when a plurality of CADe operate and detect candidates for lesions (hereinafter, "candidates for lesions" will be referred to as "lesions"), presents the detection results to the user. Further, from the detection results (among the plurality of lesions detected by the plurality of CADe), the type of associated lesion related to at least one lesion is determined, and the results of the CADe corresponding to the type of the associated lesion are also presented. CADe can correspond to pulmonary nodules, chest wall tumors, peritoneal tumors, liver tumors, pancreatic tumors, kidney tumors, colorectal tumors, reticular shadows, honeycombed lungs, bronchiectasis, pleurisy, pleural effusion, tenosynovitis, bone erosion, osteitis, pancreatic hypertrophy, pancreatic necrosis, and the like.

[0013] (Configuration of Information Processing System) It should be noted that in the translation, for the part of "<実施形態1>", I translated it as "<Embodiment ①>" to maintain the form as in the original text. If there is a specific requirement to translate it into "Embodiment 1", it can be adjusted accordingly. Also, the " " and other tags are preserved as they are as required.FIG. 1 is a diagram showing the configuration of an information processing system 10 including the information processing apparatus of the present embodiment. In FIG. 1, the information processing system 10 includes a case database (hereinafter referred to as case DB) 102, an information processing apparatus 101, and a LAN (Local Area Network) 103 (network).

[0014] The case DB 102 stores medical image data captured by an apparatus such as a CT apparatus for capturing medical images. The case DB 102 further has a database function of providing the medical image data to the information processing apparatus 101 via the LAN 103. Specifically, the case DB 102 of the present embodiment is a known PACS (Picture Archiving and Communication Systems).

[0015] (Hardware Configuration) FIG. 2 is a diagram showing the hardware configuration of the information processing apparatus 101 of the present embodiment. In FIG. 2, the information processing apparatus 101 includes a storage medium 201, a ROM (Read Only Memory) 202, a CPU (Central Processing Unit) 203, and a RAM (Random Access Memory) 204. Further, the information processing apparatus 101 includes a LAN interface 205, an input interface 208, a display interface 206, and an internal bus 211.

[0016] The storage medium 201 is a storage medium such as an HDD (Hard Disk Drive) that stores the OS (Operating System), processing programs for performing various processes according to this embodiment, and various information. The ROM 202 stores programs for initializing the hardware and starting the OS, such as the BIOS (Basic Input Output System). The CPU 203 performs calculations when executing the BIOS, OS, and processing programs. The RAM 204 temporarily stores information when the CPU 203 executes programs. The LAN interface 205 is an interface for communication via LAN 103 that complies with standards such as IEEE (Institute of Electrical and Electronics Engineers) 802.3ab. The display 207 (display unit) displays the user interface screen, and the display interface 206 converts the screen information to be displayed on the display 207 into signals and outputs them to the display 207. The keyboard 209 performs key input, the mouse 210 specifies the coordinate position on the screen and inputs button operations, and the input interface 208 receives signals from the keyboard 209 and the mouse 210. The internal bus 211 transmits signals when communication occurs between blocks.

[0017] (Functional Configuration) Figure 3 shows the functional configuration of the information processing device 101 in this embodiment. In Figure 3, the information processing device 101 includes an image acquisition unit 311, a lesion detection unit 312, a detection result acquisition unit 313, a detected lesion designation unit 314, a related lesion determination unit 315, a related lesion detection acquisition unit 316, an operating status acquisition unit 317, and an information presentation unit 318. These functional configurations are realized when a predetermined computer program stored in the storage medium 201 is read into the RAM 204, and the CPU 203 executes arithmetic processing.

[0018] In Figure 3, the case database 102 stores medical image data 321-i (i=1,2,3,...) and provides the medical image data 321-i (i=1,2,3,...) to the information processing device 101 via the LAN 103. The medical image data 321-i (i=1,2,3,...) is, for example, a DICOM file.

[0019] (Image acquisition unit 311) The image acquisition unit 311 acquires medical image data 321-i (i=1,2,3,...) from the case database 102 via the LAN interface 205 and LAN 103. In this embodiment, the acquisition of medical image data 321-i (i=1,2,3,...) follows DICOM (Digital Imaging and Communications in Medicine).

[0020] (Lesion detection unit 312) The lesion detection unit 312 functions as multiple CADes and detects lesions from acquired medical image data 321-i (i=1,2,3,...). A detector trained with a Convolutional Neural Network (CNN) is used for lesion detection. For training the detector, a set of medical image data and data indicating the lesion area in the medical image data is used as training data. The training data medical image data is input to the CNN, and the parameters of the CNN are adjusted so that the error between the output value of the CNN and the data indicating the lesion area is small. The system may be configured to detect one lesion with one CNN, or it may be configured to detect multiple lesions with one CNN.

[0021] (Detection result acquisition unit 313) The detection result acquisition unit 313 acquires the detection results of multiple lesions by the lesion detection unit 312. The detection results include information indicating the type of detected lesion and information that can identify the location of the lesion within the medical image data 321-i (i=1,2,3,...). The information indicating the type of lesion is, for example, an ID (identification information) uniquely assigned to each type of lesion among the multiple detected lesions. The form of information that can identify the location of the lesion within the medical image data is, for example, coordinate information indicating the location of the lesion or a mask image that can be overlaid on the medical image data to display the location of the lesion. The form of information that can identify the location of the lesion may differ for each type of lesion.

[0022] (Detected lesion designation area 314) The detected lesion designation unit 314 detects an operation to designate at least one lesion (detection result of a lesion) from multiple lesions (detection results of lesions) acquired by the detection result acquisition unit 313, based on the user's operation. The user can designate at least one lesion from the detection results of multiple lesions by operating the mouse 210 or keyboard 209. The detection results of multiple lesions acquired by the detection result acquisition unit 313 are displayed in a list on the user interface screen 400 (for example, 402 in Figure 4), and the user can change the highlight position of the detection results in the lesion detection result display area 402 using the left click of the mouse 210 or the arrow keys or TAB key of the keyboard 209, and designate a lesion (detection result of a lesion) by operating the Enter key or space key. The detected lesion designation unit 314 accepts the designation of at least one lesion from the detection results of multiple lesions based on the user's operation. Note that at least one lesion can be designated from multiple lesions (detection results of lesions) acquired by the detection result acquisition unit 313 even without user operation. For example, if multiple lesions are acquired by the detection result acquisition unit 313, the detected lesion designation unit 314 designates the lesion with the largest area, the lesion with the highest severity, etc.

[0023] (Related lesion determination section 315) The related lesion determination unit 315 determines the type of lesion (related lesion) associated with the lesion specified by the detected lesion designation unit 314. The related lesion determination unit 315 determines the type of related lesion associated with the detected lesion. As a process for determining the type of related lesion, for example, the related lesion determination unit 315 may maintain the relationship between the lesion type and the related lesion type as information in a table format and determine the type of related lesion based on this table. Also, if there are multiple specified lesions, the related lesion determination unit 315 may obtain the type of related lesion by taking a logical OR or logical AND operation on the related lesion types obtained from the table for each specified lesion type. Whether to use OR or AND may be specified in advance as setting information, may be selected by the user at any time, or may be selected according to the combination of specified lesions. Also, the related lesion determination unit 315 may maintain combinations of multiple lesion types and their corresponding related lesion types as information in a table format and determine the type of related lesion using the information in the table format. Furthermore, the related lesion determination unit 315 may determine the type of related lesion from multiple combinations of lesion types based on rules that relate combinations of lesion types to the type of related lesion.

[0024] Tables and rules used to determine the type of related lesion are created based on medical knowledge, for example. Medical knowledge includes, for example, the relationship between primary and metastatic lesions, the relationship between complications, and the relationship related to assessing the risk of severe complications. Regarding the relationship between primary and metastatic lesions, for example, for a lung nodule suspected of being primary lung cancer, related lesions include tumors in the chest wall, peritoneum, liver, and pancreas, which are considered possible sites of metastasis from primary lung cancer. Similarly, for a lung nodule suspected of being metastatic lung cancer, related lesions include tumors in the colon, kidney, and mammary gland, which are considered possible primary lesions. Furthermore, reticular opacities in the lung may be associated with rheumatoid arthritis, and to differentiate this, tenosynovitis, bone erosion, and osteitis are considered related lesions. In the case of pancreatitis, pancreatic hypertrophy and pancreatic necrosis are considered related lesions to assess the risk of severe complications.

[0025] (Related lesion detection and acquisition unit 316) The related lesion detection and acquisition unit 316 acquires the detection results from the lesion detection unit 312 for the type of related lesion determined by the related lesion determination unit 315. In other words, the related lesion detection and acquisition unit 316 acquires the detection results of related lesions determined by the related lesion determination unit 315 from the detection results of multiple lesions by the lesion detection unit 312.

[0026] (Operating status acquisition unit 317) The operational status acquisition unit 317 acquires information (hereinafter also referred to as operational information) from the lesion detection unit 312 indicating the operational status of the detection process performed by the lesion detection unit 312, which detects lesions from medical image data. In addition, the operational status acquisition unit 317 acquires information indicating the operational status of the detection process performed by the lesion detection unit 312, which detects related lesions, according to the type of related lesion. Note that the operational status of the detection process can also be rephrased as the execution status or implementation status of the detection process.

[0027] The information indicating the operating status of Embodiment 1 includes information indicating whether or not lesion detection (lesion detection processing) has been performed by the lesion detection unit 312 for each type of lesion. That is, the information indicating the operating status includes information indicating that the lesion detection processing has been performed (performed and detected, performed and not detected) and information indicating that the lesion detection processing has not been performed. The information indicating the operating status also includes information indicating that the lesion detection processing is in progress, that is, information indicating that the lesion detection processing has started but has not yet finished. When the lesion detection processing is in progress, the operating status acquisition unit 317 may acquire information from the lesion detection unit 312 indicating the progress of the detection processing and the remaining time until the detection processing is completed, and the information presentation unit 318 may present (display) at least one of the progress of the detection processing and the remaining time until the detection processing is completed, acquired by the operating status acquisition unit 317, together with the information indicating the operating status on the display 207 (display unit).

[0028] Furthermore, the operational status acquisition unit 317 acquires information from the lesion detection unit 312 indicating the operational status of the detection process for the related lesion determined by the related lesion determination unit 315. In other words, the operational status acquisition unit 317 acquires information indicating the operational status of the detection process for the related lesion performed by the lesion detection unit 312 (hereinafter also referred to as related operational information).

[0029] Information indicating the operational status of the detection process for related lesions includes information indicating whether or not the lesion detection (related lesion detection process) for related lesions by the lesion detection unit 312 has been performed (performed or not performed). Similarly, for related lesions, information indicating the operational status of the detection process includes information indicating that the related lesion detection process has been performed (performed and detected, performed and not detected) and information indicating that the related lesion detection process has not been performed. In addition, information indicating the operational status of the detection process for related lesions includes information indicating that the related lesion detection process is in progress.

[0030] The operating status acquisition unit 317 may acquire information indicating the operating status for all lesion types detected by the lesion detection unit 312, or it may acquire only information indicating the operating status of the detection process for related lesions determined by the related lesion determination unit 315.

[0031] (Information presentation section 318) The information display unit 318, which presents information indicating the operating status, controls the display of the user interface screen 400 on the display 207. The information display unit 318 displays on the display 207 the detection results of related lesions acquired by the related lesion detection acquisition unit 316 and information indicating the operating status acquired by the operating status acquisition unit 317. The information display unit 318 also displays on the display 207 medical image data 321-i (i=1,2,3,...) acquired by the image acquisition unit 311 and the detection results of lesions acquired by the detection result acquisition unit 313. In displaying the detection results on the display 207, the information display unit 318 displays the detection results of related lesions in a way that distinguishes them from the detection results of other lesions (lesions acquired by the detection result acquisition unit 313).

[0032] In this embodiment, the information presentation unit 318 distinguishes and presents (displays) the detection results of multiple lesions detected by the lesion detection unit 312 and the detection results of related lesions. As shown in the user interface screen 400 of Figure 4, the information presentation unit 318 displays the detection results by dividing the display area, such as an area for displaying the detection results of related lesions (e.g., 403) and an area for displaying the detection results of other lesions (e.g., 402). However, the display of detection results by the information presentation unit 318 may be made distinguishable by, for example, changing the color of the text or background, or changing the icon image.

[0033] Furthermore, the information display unit 318 displays information in a way that distinguishes whether or not it is information indicating the operational status of the detection process for related lesions. In this embodiment, an example is described in which the display area of ​​the display 207 is divided in the same way as the detection results, but the information display unit 318 is not limited to this example, and may distinguish whether or not it is information indicating the operational status of the detection process for related lesions by changing the display of text or background colors, changing the display of icon images, etc. If the detection process by the lesion detection unit 312 is executed and a lesion is detected, the information display unit 318 displays the detected lesion.

[0034] (User interface screen) Figure 4 shows an example of the user interface screen 400 of the information processing device 101 in this embodiment. The user interface screen 400 is displayed on the display 207, and various operations by the user are input via the keyboard 209 and mouse 210.

[0035] In Figure 4, the user interface screen 400 has a medical image data display area 401, a lesion detection result display area 402, and a related lesion detection result display area 403.

[0036] The information display unit 318 displays medical image data acquired by the image acquisition unit 311 in the medical image data display area 401. The information display unit 318 can also control the display of the image data displayed in the medical image data display area 401 by changing the WL / WW (window level / window width), slice position, magnification, etc., in response to operations performed by the keyboard 209 or mouse 210.

[0037] Furthermore, the information display unit 318 displays the location of the lesion specified by the detected lesion designation unit 314 on the display of the medical image data. The information display unit 318 displays annotations 411 on the display of the medical image data in the medical image data display area 401, indicating the location of the lesion specified by the detected lesion designation unit 314, based on the lesion detection results acquired by the detection result acquisition unit 313. As an example of displaying the location of the designated lesion, for example, an image (overlay image) that highlights the lesion area may be displayed on the medical image.

[0038] The information display unit 318 displays the detection results of multiple lesions together with information indicating the operational status of the detection process for each lesion. In the lesion detection result display area 402, the information display unit 318 displays the lesion detection results (lesion detection results) 421-i (i=1,2,3,4,...) acquired by the detection result acquisition unit 313. The lesion detection results 421-i (i=1,2,3,4,...) correspond to the lesion detection results acquired by the detection result acquisition unit 313, and only the lesion detection results acquired by the detection result acquisition unit 313 are displayed in the lesion detection result display area 402.

[0039] In the lesion detection result display area 402, the information display unit 318 displays the lesion detection result 421-i (i=1,2,3,4,...) together with information indicating the operational status of the lesion detection process acquired by the operational status acquisition unit 317. For example, lesion detection result 421-1 indicates that a lesion of "lesion type 1-1" has been detected. The display of "Detected" is based on the operational status information and indicates that a lesion has been detected by the lesion detection unit 312 performing lesion detection (lesion detection process) (indicating that the detection process has been completed and a lesion has been detected).

[0040] In the display area 402 for lesion detection results, the "Detected" display for "Legacy Type 1-2," "Legacy Type 2-1," and "Legacy Type 2-2" is similar, indicating that each lesion type has been detected by the lesion detection unit 312. In other words, the detection process has been completed and a lesion has been detected.

[0041] Furthermore, in the lesion detection result display area 402, the detection result of a lesion can be specified by operations such as left-clicking the mouse 210 on the detection result. The detected lesion specification unit 314 detects an operation to specify at least one lesion from the multiple lesion detection results acquired by the detection result acquisition unit 313, based on the user's operation.

[0042] The information display unit 318 highlights and displays the specified detection result so that it can be distinguished from the detection results of other lesions. As an example of highlighting, it is also possible to highlight the border and background, as shown in lesion detection result 421-2. In addition to highlighting, it is also possible to combine the display of the detection result with an identification indicator (e.g., text or an icon image) to distinguish it from the detection results of other lesions.

[0043] In response to the specification of the lesion detection result in the lesion detection result display area 402, the information presentation unit 318 updates the display position of the annotation 411 based on the lesion detection position corresponding to the specified lesion detection result.

[0044] Furthermore, based on the detection results of related lesions obtained by the related lesion detection acquisition unit 316, the information presentation unit 318 updates the display content of the related lesion detection result display area 403. For example, if the designation of the lesion detection result in the lesion detection result display area 402 is changed, the information presentation unit 318 updates the display content of the related lesion detection result display area 403 based on the detection results of related lesions associated with the changed designated lesion.

[0045] The information display unit 318 displays the detection results of related lesions and information indicating the operational status of the detection process for related lesions. In the related lesion detection result display area 403, the information display unit 318 displays the detection results of related lesions (related lesion detection results) 431-i (i=1,2,3,4,...) acquired by the related lesion detection acquisition unit 316. The information display unit 318 displays the lesion type of the related lesion as the related lesion detection result 431-i (i=1,2,3,4,...).

[0046] In the related lesion detection result display area 403, the information presentation unit 318 displays the related lesion detection result 431-i (i=1,2,3,4,...) together with information indicating the operational status of the related lesion detection process acquired by the operational status acquisition unit 317. In the related lesion detection result display area 403, for example, as shown in the display of related lesion detection result 431-1, even if "lesion type 3" of the related lesion is not detected, the display indicates that it is not detected as an indication of the operational status of the detection process for the related lesion. The display of "not detected" is based on the information indicating the operational status of the detection process for the related lesion, and indicates that the related lesion was not detected despite the lesion detection (related lesion detection process) being performed by the lesion detection unit 312. In other words, it indicates that the detection process has been performed, but the lesion (related lesion) has not been detected.

[0047] If the detection process for related lesions has not been performed, the information indicating the operational status will show that it has not been performed. For example, in the display of related lesion detection results 431-3, the operational status of the detection process for "lesion type 5" of related lesions will show an indication that the detection process has not been performed ("Not performed"). The "Not performed" indication is based on the information indicating the operational status of the detection process for related lesions and indicates that the detection process for related lesions by the lesion detection unit 312 has not been performed.

[0048] (Processing flow) Figure 5 is a flowchart showing the processing of the information processing device 101 in this embodiment. This processing is started after the information processing device 101 is started, based on instructions from another system or user. When starting the processing, the case to be processed is specified.

[0049] In step S501, the image acquisition unit 311 acquires medical image data 321-i (i=1,2,3,...) of the case specified at startup from the case database 102 via the LAN 103.

[0050] In step S502, the lesion detection unit 312 detects a lesion from the medical image data 321-i (i=1,2,3,...) acquired in step S501.

[0051] In step S503, the information display unit 318 displays the medical image data 321-i (i=1,2,3,...) acquired in step S501 in the medical image data display area 401 of the user interface screen 400. It also changes the WL / WW, slice position, magnification, etc. of the displayed image based on the operation of the keyboard 209 and mouse 210.

[0052] In step S504, the detection result acquisition unit 313 acquires the lesion detection result from the lesion detection unit 312. The lesion detection result includes information indicating the type of lesion detected and information that allows for the identification of the lesion's location within the medical image data 321-i (i=1,2,3,...).

[0053] In step S505, the information display unit 318 displays the lesion detection result 421-i (i=1,2,3,4,...) in the lesion detection result display area 402 of the user interface screen 400, based on the lesion detection result obtained in step S504.

[0054] In step S506, the detected lesion designation unit 314 determines whether or not an operation to designate a lesion has been performed from the detection results of multiple lesions displayed in the lesion detection result display area 402. That is, the detected lesion designation unit 314 detects whether or not an operation to designate a lesion has been performed based on input from the keyboard 209 or mouse 210. If the detected lesion designation unit 314 detects a designation of a lesion in step S506 (Yes in step S506), the process proceeds to step S511. On the other hand, if no designation of a lesion is detected in the determination in step S506 (No in step S506), the process proceeds to step S507.

[0055] In step S507, the operating system (OS), which is not shown, determines the end of processing by the information processing device 101. The end of processing is determined by whether or not a termination operation is performed, such as shutting down the OS, turning off the power, closing a window, or stopping a process. If the OS detects a termination operation (Yes in step S507), processing is terminated. If no termination operation is detected (No in step S507), processing returns to step S503, and the same process is repeated from step S503.

[0056] On the other hand, when the detected lesion designation unit 314 detects the designation of a lesion (Yes in step S506), in step S511, the related lesion determination unit 315 determines related lesions associated with the designated lesion based on the designation of the lesion detection result detected in step S506.

[0057] In step S512, the related lesion detection and acquisition unit 316 acquires the detection results for the related lesions determined in step S511.

[0058] In step S513, the information display unit 318 displays the related lesion detection result 431-i (i=1,2,3,...) in the related lesion detection result display area 403 of the user interface screen 400, based on the related lesion detection result obtained in step S512.

[0059] In step S514, the operational status acquisition unit 317 acquires information (related operational information) indicating the operational status of the detection process for related lesions determined in step S511. The operational status acquisition unit 317 acquires information indicating whether or not the lesion detection process for related lesions by the lesion detection unit 312 has been performed (performed or not performed). The information indicating the operational status of the detection process for related lesions includes information indicating that the detection process for related lesions has been performed (performed and detected, performed and not detected), information indicating that the detection process for related lesions has not been performed, and information indicating that the detection process for related lesions is in progress.

[0060] In step S515, the information display unit 318 displays (presents) the information obtained in step S514, which indicates the operational status of the detection process for related lesions, in the related lesion detection result 431-i (i=1,2,3,...) of the related lesion detection result display area 403. After the processing in step S515 is completed, the process proceeds to step S507.

[0061] In step S507, if the OS detects a termination operation (Yes in step S507), the process terminates. If no termination operation is detected (No in step S507), the process returns to step S503, and the same process is repeated from step S503.

[0062] According to this embodiment, the operating status of the detection process for detecting lesions can be displayed. Furthermore, according to this embodiment, when the user specifies a detected lesion on the user interface screen, the type of related lesions associated with the specified lesion is automatically determined, and the detection results for the related lesions are displayed. Therefore, even if the number of lesions to be detected increases, it becomes easier to find whether or not there are detection results for other related lesions.

[0063] Furthermore, by displaying the operational status of the lesion detection process, it becomes easier to distinguish whether the lesion detection process was executed and no lesion was detected, or whether the process was not executed and therefore no lesion was detected, even if no lesion was detected.

[0064] (Modified version of Embodiment 1) The information processing device 101 may be, for example, an image processing workstation, an electronic medical record system, an integrated viewer that displays information from multiple types of devices, or a device that acquires medical images, such as an ultrasound diagnostic device.

[0065] Furthermore, the lesion detection unit 312 may be located on another device connected to the information processing device 101 via a network, such as an image processing server. The lesion detection unit 312 may also detect lesions at the time medical image data 321-i (i=1,2,3,...) is captured, or at the time medical image data 321-i (i=1,2,3,...) is saved to the case database 102. Additionally, the lesion detection unit 312 may perform lesion detection in the background when capturing medical image data or saving medical image data to the case database 102, and store the detection results in a storage device such as the case database 102. In this case, the detection result acquisition unit 313 only needs to acquire the detection results from the storage device.

[0066] The lesion detection unit 312 may detect multiple types of lesions from the acquired medical image data 321-i (i=1,2,3,...) using methods other than CNN, such as SVM (Support Vector Machine). Furthermore, the related lesion determination unit 315 may extract medical knowledge by processing past image interpretation reports, papers, and clinical guidelines, and create tables and rules to be used in determining related lesions.

[0067] <Embodiment 2> The information processing device 601 of Embodiment 2, in addition to the information processing device 101 of Embodiment 1, also provides information indicating the operational status of the detection process for related lesions. If the detection process for related lesions has not yet been performed, it provides information indicating whether the unperformed detection process can be performed. If the detection process for related lesions has not yet been performed and the unperformed detection process can be performed, the instruction unit 319 (Figure 6) of the information processing device 601 instructs the lesion detection unit 312 to perform the unperformed detection process. The system configuration of the information processing device 601 of Embodiment 2 is the same as in Figure 1, and the hardware configuration is the same as in Embodiment 1, which was explained using Figure 2, so a detailed explanation is omitted.

[0068] In the processing of the information processing device 601 described in Embodiment 2, the information indicating the operating status includes information indicating whether or not lesion detection (lesion detection processing) by the lesion detection unit 312 has been performed (performed or not performed), and information indicating whether or not the lesion detection processing can be performed. That is, the information indicating the operating status includes information indicating that the lesion detection processing has been performed (performed and detected, performed and not detected), information indicating that the lesion detection processing has not been performed, information indicating that the lesion detection processing is in progress, and information indicating whether or not the unperformed detection processing can be performed. In this embodiment, the unperformed detection processing is explained using the related lesion displayed in the related lesion detection result display area 403 as an example, but the same applies even if the detection processing for the lesion displayed in the lesion detection result display area 402 has not been performed.

[0069] (Functional block) Figure 6 shows the functional configuration of the information processing device 601 of this embodiment. Functional blocks identical to those of the information processing device 101 of Embodiment 1 described using Figure 3 are given the same numbers, and their descriptions are omitted. In Figure 6, the functional configuration of the information processing device 601 differs from that of the information processing device 101 of Embodiment 1 in that it includes an instruction unit 319. The functional configuration of the instruction unit 319 is realized when a predetermined computer program stored in the storage medium 201 is read into the RAM 204, and the CPU 203 executes arithmetic processing.

[0070] (Instruction section 319) The instruction unit 319 instructs the lesion detection unit 312 to perform the detection process if, in the information indicating the operational status of the detection process, the detection process has not yet been performed and the unperformed detection process is available for performance. In this embodiment, the instruction by the instruction unit 319 to perform the detection process for an unperformed related lesion is described in a configuration in which the instruction is performed after confirmation by the user via the instruction confirmation window 404.

[0071] (User interface screen) Figure 7 shows an example of the user interface screen 700 of the information processing device 601 of this embodiment. Note that parts identical to the user interface screen 400 of Embodiment 1 described using Figure 4 are given the same numbers, and their descriptions are omitted.

[0072] The information display unit 318 controls the display of the user interface screen 700 on the display 207. The user interface screen 700 in this embodiment has the same screen configuration as the user interface screen 400 described in Embodiment 1. In this embodiment, if the detection process for lesions (related lesions) has not yet been performed, the information display unit 318 displays information on the user interface screen 700 indicating whether the unperformed detection process can be performed from the related lesion detection results 431-i (i=1,2,3,...).

[0073] As shown in Figure 7, the information display unit 318 displays, in conjunction with the display of the related lesion detection result 431-4, an indication that the detection process for "lesion type 5" of the related lesion has not been performed ("Not performed") and an indication that the detection process can be performed ("Performable").

[0074] When the user specifies the display of related lesion detection result 431-4, the information display unit 318 displays the specified related lesion detection result 431-4 with a highlighted border and background to make it easier to distinguish from other related lesion detection results (e.g., 431-1, 431-2). In addition, as a highlighting method, it is also possible to combine identification displays (e.g., text or icon images) with the display of the detection result to distinguish it from other related lesion detection results.

[0075] When the user specifies that the related lesion detection result 431-4 should be displayed, the information display unit 318 displays an instruction confirmation window 404 on the display 207 to ask the user whether or not to perform the unperformed detection process. In other words, if the user specifies a related lesion detection result (e.g., 431-4) for which the detection process has not yet been performed and for which the unperformed detection process can be performed, the information display unit 318 displays the instruction confirmation window 404 on the display 207.

[0076] In the instruction confirmation window 404, the user can indicate whether or not to perform the unexecuted detection process by operating the keyboard 209 or mouse 210. If the user indicates "yes" in the instruction confirmation window 404, the instruction unit 319 instructs the lesion detection unit 312 to perform the detection process for the related lesion. On the other hand, if the user indicates "no" in the instruction confirmation window 404, the instruction unit 319 does not instruct the lesion detection unit 312 to perform the detection process for the related lesion.

[0077] (Processing flow) Figure 8 is a flowchart showing the processing of the information processing device 601 in this embodiment. Steps identical to those in the processing flow of Embodiment 1 described using Figure 5 are given the same numbers, and their descriptions are omitted.

[0078] In step S516, if the user performs a specified operation in the display of the related lesion detection result 431-i (i=1,2,3,...) (S515), the instruction unit 319 determines, based on information indicating the operating status of the detection process, whether the detection process has not been performed and whether the unperformed detection process can be performed. If the determination process in step S516 indicates that the detection process has not been performed and the unperformed detection process cannot be performed (No in step S516), the instruction unit 319 returns to step S507. On the other hand, if the detection process has not been performed and the unperformed detection process can be performed (Yes in step S516), the instruction unit 319 proceeds to step S521.

[0079] In step S521, the instruction unit 319 instructs the lesion detection unit 312 to perform the detection process for related lesions for which the information indicating the operating status in step S516 has not been performed and which has been determined to be possible. The process then returns to step S507, where the completion of the process is determined.

[0080] In this embodiment, the information presentation unit 318 displays an instruction confirmation window 404 on the display 207, as shown in Figure 7, to ask the user whether or not to perform a detection process that has not yet been performed but is possible to perform. If the user indicates "yes" in the instruction confirmation window 404, the instruction unit 319 instructs the lesion detection unit 312 to perform the detection process for the related lesion. If the user indicates "no" in the instruction confirmation window 404, the instruction unit 319 does not instruct the lesion detection unit 312 to perform the detection process for the related lesion, terminates the processing in this step, and returns the process to step S507.

[0081] According to this embodiment, the operating status of the detection process for detecting lesions can be displayed. Furthermore, according to this embodiment, when the user specifies a detected lesion on the user interface screen, the type of related lesions associated with the specified lesion is automatically determined, and the detection results for the related lesions are displayed. Therefore, even if the number of lesions to be detected increases, it becomes easier to find whether or not there are detection results for other related lesions.

[0082] Furthermore, by displaying the operational status of the lesion detection process, it becomes easier to distinguish whether the lesion detection process was executed and no lesion was detected, or whether the process was not executed and therefore no lesion was detected, even if no lesion was detected.

[0083] Furthermore, if the lesion detection process has not yet been performed and is feasible, instructing the system to perform the lesion detection process will facilitate the execution of the instructed, unperformed lesion (related lesion) detection process.

[0084] (Modified version of Embodiment 2) In Embodiment 2, the instruction by the instruction unit 319 to perform the detection process for unperformed related lesions is performed after confirmation by the user via the instruction confirmation window 404. However, the instruction unit 319 may also instruct the lesion detection unit 312 to perform the detection process based on information indicating the operating status. That is, without user confirmation, the instruction unit 319 may, in accordance with information indicating the operating status, instruct the lesion detection unit 312 to perform the detection process for unperformed lesions if the detection process has not yet been performed and the unperformed detection process is available.

[0085] <Embodiment 3> The configuration of the information processing system 10, including the information processing device 1101 in this embodiment, is the same as in Figure 1, and the hardware configuration of the information processing device 1101 is the same as the hardware configuration of the information processing device 101 of Embodiment 1, which was described using Figure 2.

[0086] Figure 11 shows the functional configuration of the information processing device 1101 of this embodiment. Functional blocks identical to those of the information processing device 101 of Embodiment 1 and the information processing device 601 of Embodiment 2 are given the same numbers, and their descriptions are omitted. In Figure 11, the functional configuration of the information processing device 1101 differs from that of the information processing device 101 of Embodiment 1 and the information processing device 601 of Embodiment 2 in that it includes a lesion detection introduction unit 320. The functional configuration of the lesion detection introduction unit 320 is realized when a predetermined computer program stored in the storage medium 201 is read into the RAM 204, and the CPU 203 executes arithmetic processing.

[0087] In the processing of the information processing device 1101 described in Embodiment 3, the information indicating the operating status includes information indicating whether or not lesion detection (lesion detection processing) by the lesion detection unit 312 has been performed (performance or non-performance), information indicating whether or not the lesion detection processing can be performed, and, if the detection processing that has not been performed cannot be performed (in the case of non-performance), information regarding the reason why the detection processing cannot be performed (reason for non-performance). The information presentation unit 318 presents information regarding the reason why the detection processing cannot be performed when the information indicating the operating status indicates that the detection processing cannot be performed.

[0088] In this embodiment, the information display unit 318 of the information processing device 1101, in addition to the configuration of the information processing device 601 of the second embodiment, displays information regarding the reason why a detection process cannot be performed (the reason for non-performance) when an unperformed detection process cannot be performed (i.e., not performed) in the information indicating the operating status. In this embodiment, the detection process for non-performance is explained using the related lesions displayed in the related lesion detection result display area 403 as an example, but the same applies when the detection process for a lesion displayed in the lesion detection result display area 402 is not performed.

[0089] (User interface screen) Figures 9A and 9B show an example of the user interface screen 900 of the information processing device 1101 of this embodiment. Note that parts identical to the user interface of Embodiment 1 described using Figure 4 and Embodiment 2 described using Figure 7 are given the same numbers, and their descriptions are omitted.

[0090] The information display unit 318 controls the display of the user interface screen 900 on the display 207. The user interface screen 900 of this embodiment (Figures 9A and 9B) has the same screen configuration as the user interface screen 700 described in Embodiment 2.

[0091] In this embodiment, if the information indicating the operating status shows that an unperformed detection process has not been performed, the information presentation unit 318 presents information regarding the reason for the non-performance on the user interface screen 900.

[0092] In this embodiment, the information regarding the reason why the detection process cannot be performed includes information indicating that the lesion detection function has not been introduced to the lesion detection unit 312 with respect to the specified lesion (related lesion), and information indicating that the medical image data is data that does not meet the conditions for performing the detection process by the lesion detection unit 312.

[0093] In the display examples in Figures 9A and 9B, the information display unit 318 displays, along with the display of the related lesion detection result 431-5, an indication that the detection process for "lesion type 6" of the related lesion cannot be performed ("Not performed") and an indication that the detection function for the specified lesion (related lesion) has not been introduced to the lesion detection unit 312 ("Not introduced").

[0094] Furthermore, the information display unit 318 displays, in conjunction with the display of the related lesion detection result 431-6, an indication that the detection process for "lesion type 7" of the related lesion has not been performed ("Not performed") and an indication that the medical image data is data that does not meet the conditions for the detection process ("Not met the conditions for the process").

[0095] The user interface screen 900 has a screen configuration that includes an installation confirmation window 405 (for example, Figure 9A) for confirming whether or not to install the detection function, and an image acquisition confirmation window 406 (for example, Figure 9B) for confirming whether or not to acquire image data (medical image data) that meets the implementation conditions. The information presentation unit 318 displays either the installation confirmation window 405 or the image acquisition confirmation window 406 on the user interface screen 900 depending on the reason why the detection process is not performed (not installed or not applicable conditions).

[0096] (Installation confirmation window 405: Figure 9A) Figure 9A illustrates the user interface screen 900 with the installation confirmation window 405 displayed. As shown in Figure 9A, when the user specifies the display of related lesion detection result 431-5 (not implemented, not installed), the information display unit 318 displays the specified related lesion detection result 431-5 with a border and background highlighted to make it easier to distinguish from the displays of other related lesion detection results (e.g., 431-2, 431-4, 431-6). In addition, as a highlighting feature, it is also possible to combine identification displays (e.g., text or icon images) with the display of the detection result to distinguish it from the detection results of other related lesions.

[0097] When the user specifies the display of related lesion detection results 431-5, the information display unit 318 displays an installation confirmation window 405 on the display 207 to ask the user whether or not to install the uninstalled detection function to the lesion detection unit 312. In other words, the information display unit 318 displays the installation confirmation window 405 on the display 207 when the user specifies the display of related lesion detection results (e.g., 431-5) where the detection process has not been performed and the detection function corresponding to the uninstalled detection process has not been installed to the lesion detection unit 312.

[0098] In the installation confirmation window 405, the user can instruct the lesion detection unit 312 whether or not to install the uninstalled detection function by operating the keyboard 209 or mouse 210. Here, the installation of the lesion detection function may include installing lesion detection software that the lesion detection unit 312 runs when it detects a lesion, or inputting information (for example, authentication information such as an activation key) to enable the uninstalled lesion detection function in the lesion detection software that detects lesions.

[0099] If the user selects "No" in the installation confirmation window 405, the instruction unit 319 will not perform any processing related to the installation of the uninstalled lesion detection function. On the other hand, if the user selects "Yes" in the installation confirmation window 405, the instruction unit 319 will perform the following processing.

[0100] (Installation of lesion detection software) In this embodiment, if the information regarding the reason why the detection process cannot be performed indicates that the function has not been implemented, the instruction unit 319 instructs the lesion detection implementation unit 320 to implement the unimplemented lesion detection function. When the user indicates "Yes" in the implementation confirmation window 405, the instruction unit 319 instructs the lesion detection implementation unit 320 to implement the unimplemented lesion detection function. The lesion detection implementation unit 320 downloads and stores lesion detection software that implements the unimplemented lesion detection function from an external server (not shown) via LAN interface 205 and LAN 103 to the storage medium 201. The lesion detection implementation unit 320 registers the lesion detection software with the lesion detection unit 312. The lesion detection unit 312 reads and executes the registered lesion detection software, thereby enabling the lesion detection process that was previously not possible to perform.

[0101] (Enter the activation key) If lesion detection software that enables the unimplemented lesion detection function is already stored in the storage medium 201, and the user indicates "Yes" in the installation confirmation window 405, the instruction unit 319 instructs the lesion detection installation unit 320 to install the unimplemented lesion detection function.

[0102] The lesion detection introduction unit 320 downloads an activation key (such as a predetermined string) from an external server (not shown) via LAN interfaces 205 and 103 to enable the lesion detection function that has not yet been installed in the lesion detection software, and temporarily stores it in RAM 204 or similar. The lesion detection introduction unit 320 registers the activation key with the lesion detection unit 312. The lesion detection unit 312 reads the lesion detection software from the storage medium 201 and sets the registered key, thereby enabling the lesion detection process that was previously unavailable.

[0103] (Image acquisition confirmation window 406: Figure 9B) Figure 9B is an example of the user interface screen 900 showing the image acquisition confirmation window 406. As shown in Figure 9B, when the user specifies the display of related lesion detection result 431-6 (not performed, not applicable conditions), the information display unit 318 displays the specified related lesion detection result 431-6 with a border and background highlighted to make it easier to distinguish from the displays of other related lesion detection results (e.g., 431-2, 431-3, 431-5). In addition, as a highlighting feature, it is also possible to combine identification displays (e.g., text or icon images) with the display of the detection result to distinguish it from the detection results of other related lesions.

[0104] When the user specifies that the related lesion detection result 431-6 should be displayed, the information display unit 318 displays an image acquisition confirmation window 406 on the display 207 to ask the user whether or not to acquire image data (medical image data) that meets the implementation conditions. In other words, the information display unit 318 displays the image acquisition confirmation window 406 on the display 207 when the user specifies that the detection process should not be performed and that the display of a related lesion detection result (e.g., 431-6) is data that does not meet the implementation conditions (not applicable conditions).

[0105] The information display unit 318 presents an image acquisition confirmation window 406 having a condition specification unit 407 (checkbox) that allows the user to add or change conditions for acquiring medical image data that satisfies the conditions for performing the detection process. The user can add or change the image acquisition conditions by operating the keyboard 209 or mouse 210 and specifying in the condition specification unit 407. In the image acquisition confirmation window 406 shown in Figure 9B, conditions 1 and 2 are specified (checked) by the condition specification unit 407, and condition 3 is excluded from the image acquisition conditions (unchecked). Here, the conditions for image acquisition include various conditions, such as the modality for imaging the medical image, reconstruction function, contrast conditions, time phase, imaging range, etc.

[0106] In the image acquisition confirmation window 406, the user can instruct the image acquisition unit 311 whether or not to acquire image data (medical image data) that meets the implementation conditions by operating the keyboard 209 or mouse 210. If the user instructs "Cancel" in the image acquisition confirmation window 406, the instruction unit 319 does not instruct the image acquisition unit 311 to acquire image data (medical image data) that meets the implementation conditions. On the other hand, if the user instructs "Execute" in the image acquisition confirmation window 406, the instruction unit 319 instructs the image acquisition unit 311 to acquire image data (medical image data) that meets the specified conditions. In other words, in this embodiment, if the information regarding the reason why the detection process cannot be performed indicates that the data is outside the implementation conditions, the instruction unit 319 instructs the image acquisition unit 311 to acquire medical image data that satisfies the implementation conditions for the detection process.

[0107] The image acquisition unit 311 may generate medical image data that meets the implementation conditions from already acquired medical image data, or it may send an order to an ordering system or the like to acquire medical image data that meets the implementation conditions from an external source.

[0108] When the image acquisition unit 311 receives an instruction to acquire an image from the instruction unit 319, it performs the acquisition process of image data (medical image data) that conforms to the specified conditions. When acquiring medical image data from an external source, the image acquisition unit 311 outputs imaging instructions, including conditions such as image reconstruction, to an ordering system including a hospital information system (HIS) or radiology information system (RIS) (not shown) via the LAN 103. The image acquisition unit 311 may acquire image data acquired by the HIS or RIS modality based on the specified conditions, or it may acquire image data that conforms to the conditions from the case database 102 or a picture archiving and communication system (PACS) (not shown). The image acquisition unit 311 stores the acquired image data in the storage medium 201. The image data acquired by the image acquisition unit 311 conforms to the conditions for performing lesion detection (application conditions), and the lesion detection unit 312, by using the image data acquired by the image acquisition unit 311, enables the lesion detection process, which was previously not possible, to be performed.

[0109] (Processing flow) Figure 10 is a flowchart showing the processing of the information processing device 1101 in this embodiment. Steps that are the same as those in the processing flow of Embodiment 1 described using Figure 5 and the processing flow of Embodiment 2 described using Figure 8 are given the same numbers and their descriptions are omitted.

[0110] In step S517, if the user performs a specified operation in the display of the related lesion detection result 431-i (i=1,2,3,...) (S515), the instruction unit 319 determines, based on information indicating the operational status of the detection process, whether the detection process is not to be performed and whether the reason for not performing it has not been implemented. If the determination process in step S517 determines that the detection process is not to be performed and the reason for not performing it has not been implemented (Yes in step S517), the instruction unit 319 proceeds to step S531.

[0111] In step S531, the instruction unit 319 instructs the lesion detection introduction unit 320 to introduce the lesion detection function, which has not yet been introduced. Upon receiving the instruction from the instruction unit 319, the lesion detection introduction unit 312 performs the introduction process to introduce the lesion detection function. The specific process for introducing the lesion detection function is as described with reference to the introduction confirmation window 405.

[0112] In this embodiment, when an instruction is given, the user can instruct the lesion detection unit 312 whether or not to introduce the unintroduced detection function in the introduction confirmation window 405 by operating the keyboard 209 or mouse 210. If the user indicates "yes" in the introduction confirmation window 405, the instruction unit 319 instructs the lesion detection introduction unit 320 to introduce the unintroduced lesion detection function. If the user indicates "no" in the introduction confirmation window 405, the instruction unit 319 does not perform the processing related to the introduction of the unintroduced lesion detection function, terminates the processing in this step, and proceeds to step S518.

[0113] On the other hand, if the determination process in step S517 determines that the detection process should not be performed, and the reason for not performing the process is not that it has not been implemented (No. in step S517), the instruction unit 319 proceeds to step S518.

[0114] In step S518, if the user performs a specified operation in the display of the related lesion detection result 431-i (i=1,2,3,...) (S515), the instruction unit 319 determines, based on information indicating the operational status of the detection process, whether the detection process is not to be performed and whether the reason for not performing it is outside the conditions for performance. If the determination process in step S518 determines that the detection process is not to be performed and the reason for not performing it is outside the conditions for performance (Yes in step S518), the instruction unit 319 proceeds to step S541.

[0115] In step S541, the instruction unit 319 instructs the image acquisition unit 311 to acquire image data (medical image data) that meets the specified conditions. When the image acquisition unit 311 receives the instruction from the instruction unit 319 to acquire image data (medical image data), it performs an acquisition process to acquire image data (medical image data) that meets the specified conditions. The specific process is as described with reference to the image acquisition confirmation window 406.

[0116] In this embodiment, when an instruction is given, the user can instruct the image acquisition unit 311 whether or not to acquire image data (medical image data) that meets the execution conditions by operating the keyboard 209 or mouse 210 in the image acquisition confirmation window 406. If the user instructs "Execute" in the image acquisition confirmation window 406, the instruction unit 319 instructs the image acquisition unit 311 to acquire image data (medical image data) that meets the specified conditions. If the user instructs "Cancel" in the image acquisition confirmation window 406, the instruction unit 319 does not instruct the image acquisition unit 311 to acquire image data (medical image data) that meets the execution conditions, and terminates the processing of this step.

[0117] On the other hand, if the determination process in step S518 determines whether the detection process should be performed or not, and the reason for not performing the process is not outside the conditions for performing the process (No. in step S518), the instruction unit 319 returns the process to step S507.

[0118] According to this embodiment, the operating status of the detection process for detecting lesions can be displayed. Furthermore, according to this embodiment, when the user specifies a detected lesion on the user interface screen, the type of related lesions associated with the specified lesion is automatically determined, and the detection results for the related lesions are displayed. Therefore, even if the number of lesions to be detected increases, it becomes easier to find whether or not there are detection results for other related lesions.

[0119] Furthermore, by displaying the operational status of the lesion detection process, it becomes easier to distinguish whether the lesion detection process was executed and no lesion was detected, or whether the process was not executed and therefore no lesion was detected, even if no lesion was detected.

[0120] Furthermore, if the lesion detection process has not yet been performed and is feasible, instructing the system to perform the lesion detection process will facilitate the execution of the instructed, unperformed lesion (related lesion) detection process.

[0121] Furthermore, even if a detection process is not performed and a detection function corresponding to the unperformed detection process has not been introduced, it becomes easy to introduce the necessary lesion detection function into the lesion detection unit 312 by instructing the introduction of the lesion detection function.

[0122] Furthermore, even if the detection process is not performed and the medical image data does not meet the performance conditions, it becomes easier to obtain the medical image data necessary to perform the lesion detection process by instructing the system to acquire medical image data that meets the performance conditions.

[0123] (Other embodiments) The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC) that implements one or more functions.

[0124] The invention is not limited to the embodiments described above, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, claims are attached to disclose the scope of the invention. [Explanation of Symbols]

[0125] 101: Information processing device, 311: Image acquisition unit, 312: Lesion detection unit, 313: Detection result acquisition unit, 314: Detected lesion designation unit, 315: Related lesion determination unit, 316: Related lesion detection acquisition unit, 317: Operating status acquisition unit, 318: Information presentation unit, 319: Instruction unit, 320: Lesion detection introduction unit

Claims

1. An operating status acquisition means that acquires information indicating the operating status of the detection process by a lesion detection means that detects lesions from medical image data, If the information indicating the operating status indicates that the detection process has not been performed and cannot be performed, the information presenting means presents information regarding the reason why the detection process cannot be performed. An information processing device comprising, wherein the information regarding the reason why the detection process cannot be performed includes information indicating that the lesion detection function for the target lesion has not been introduced to the lesion detection means.

2. The information processing device according to claim 1, characterized in that, when the detection process by the lesion detection means is performed and a lesion is detected, the information presentation means presents the detected lesion.

3. Image acquisition means for acquiring the aforementioned medical image data, A lesion detection means for detecting lesions from the aforementioned medical image data, Related lesion determination means for determining the type of related lesions related to the aforementioned lesion, The system further comprises related lesion detection and acquisition means for acquiring the detection result of the related lesion by the lesion detection means, according to the type of related lesion, The operating status acquisition means acquires information indicating the operating status of the detection process for the related lesion by the lesion detection means, The information processing apparatus according to claim 1 or 2, wherein the information presentation means further presents information indicating the operating status of the detection process for the related lesion.

4. The information processing apparatus according to claim 3, characterized in that the information presentation means distinguishes between the detection results of a plurality of lesions detected by the lesion detection means and the detection results of related lesions and presents them on the display means.

5. The information display means is characterized in that it displays together the detection results of multiple lesions and information indicating the operating status of the detection process for each lesion, as described in claim 3 or 4.

6. The information processing apparatus according to claim 3 or 4, characterized in that the information presentation means presents together the detection result of the related lesion and information indicating the operating status of the detection process for the related lesion.

7. The information processing apparatus according to claim 3, characterized in that the information presentation means presents the location of at least one lesion on the display of the medical image data.

8. The information processing apparatus according to any one of claims 1 to 7, characterized in that the information indicating the operating status includes information indicating that the detection process by the lesion detection means is being performed.

9. When the detection process is in progress, the operating status acquisition means obtains from the lesion detection means information indicating the progress of the detection process and information indicating the remaining time until the detection process is completed. The information processing apparatus according to claim 8, characterized in that the information presentation means presents at least one of the progress of the detection process and the remaining time until the detection process is completed, together with the information indicating the operating status.

10. The information processing apparatus according to any one of claims 1 to 7, further comprising an instruction means for instructing the lesion detection means to perform the detection process.

11. The information processing apparatus according to claim 10, characterized in that the instruction means instructs the lesion detection means to perform the detection process when the detection process has not been performed and the detection process is performable.

12. The information processing apparatus according to claim 10, characterized in that the information regarding the reason why the detection process cannot be performed includes information indicating that the medical image data is data that does not meet the conditions for performing the detection process by the lesion detection means.

13. The information processing device according to claim 10, characterized in that the instruction means instructs the lesion detection introduction means to introduce a lesion detection function that has not yet been introduced.

14. The information processing apparatus according to claim 12, characterized in that the information presentation means presents an image acquisition confirmation window having a condition specification unit that can add or change conditions for acquiring medical image data that satisfies the conditions for performing the detection process.

15. The information processing apparatus according to claim 12, characterized in that the instruction means instructs the image acquisition means to acquire medical image data that satisfies the conditions for performing the detection process.

16. A step of acquiring information indicating the operating status of the detection process by a lesion detection means that detects lesions from medical image data, If the information indicating the operating status indicates that the detection process has not been performed and cannot be performed, the step of providing information regarding the reason why the detection process cannot be performed, An information processing method characterized in that the information relating to the reason why the detection process cannot be performed includes information indicating that the lesion detection function for the target lesion has not been introduced to the lesion detection means.

17. A program that causes a computer to function as one of the means of an information processing device according to any one of claims 1 to 15.

Images