X-ray CT apparatus, information processing system, information processing method, and program
Patent Information
- Application Number
- JP2022159395
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2022-10-03
- Publication Date
- 2025-10-06
AI Technical Summary
Inference results from X-ray CT devices with photon counting CT function vary depending on whether they are performed on material discrimination image data or CT image data, requiring appropriate display of these results.
The X-ray CT apparatus includes a reconstruction processing unit to generate CT and substance discrimination image data, a first inference unit for material discrimination, a second inference unit for CT image data, and a display control unit to display the inference results of both units on a display unit.
Enables the simultaneous display of inference results from both material discrimination and CT image data, allowing operators to accurately interpret and compare the findings.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to an X-ray CT apparatus equipped with a photon-counting CT function, an information processing system, an information processing method, and a program. [Background technology]
[0002] An X-ray CT device equipped with a photon-counting CT (Computed Tomography) function counts individual incident X-rays and measures the energy of the incident X-rays to obtain an X-ray spectrum. From the obtained X-ray spectrum, the materials contained in the subject can be identified and material decomposition image data can be generated. In addition, an X-ray CT device equipped with a photon-counting CT function can reconstruct CT image data (integral image data). (For example, see Patent Document 1)
[0003] On the other hand, inference tasks performed by neural networks include classification tasks, such as classifying image data into classes, and detection tasks, such as detecting what is captured in what position in the image data. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2018-175866 A Summary of the Invention [Problem to be solved by the invention]
[0005] The inference results may differ depending on whether the inference task is performed on material decomposition image data acquired by an X-ray CT device equipped with a photon counting CT function or on CT image data (integral image data). Therefore, it is required to appropriately display the inference results performed on material decomposition image data and the inference results performed on CT image data.
[0006] However, the problems to be solved by the embodiments disclosed in this specification and the drawings are not limited to the above problems. Problems corresponding to the effects of each configuration shown in the embodiments described below can also be positioned as other problems. [Means for solving the problem]
[0007] In order to achieve the object of the present invention, the X-ray CT apparatus of the present invention comprises an X-ray tube that irradiates X-rays, a detector that detects X-rays irradiated from the X-ray tube and transmitted through a subject, a reconstruction processing unit that reconstructs the shooting data output by the detector and generates CT image data and material decomposition image data, a first inference unit that performs inference on the material decomposition image data, a second inference unit that performs inference on the CT image data, and a display control unit that displays at least one of the inference results of the first inference unit and the inference results of the second inference unit on a display unit.
[0008] The information processing system of the present invention includes a first inference unit that performs inference on material decomposition image data generated by reconstructing shooting data output by a detector of an X-ray CT device, a second inference unit that performs inference on CT image data, and a display control unit that displays at least one of the inference results of the first inference unit and the second inference unit on a display unit.
[0009] The information processing method of the present invention includes a step of generating CT image data and material decomposition image data based on X-rays irradiated from an X-ray tube and transmitted through a subject, and a step of displaying at least one of the inference results of a first inference section that performs inference on the material decomposition image data and the inference results of a second inference section that performs inference on the CT image data on a display section. Effect of the Invention
[0010] According to the present invention, at least one of the inference results obtained by performing inference on material decomposition image data and the inference results obtained by performing inference on CT image data can be displayed. [Brief description of the drawings]
[0011] [Figure 1] FIG. 1 is a diagram showing an example of the configuration of an X-ray CT apparatus according to the present invention. [Diagram 2] FIG. 2 is a diagram showing an example of the peripheral configuration of an inference unit of the X-ray CT apparatus of the present invention. [Diagram 3] FIG. 2 is a diagram showing one display form of the display unit in the X-ray CT apparatus of the present invention. [Figure 4] FIG. 2 is a diagram showing one display form of the display unit in the X-ray CT apparatus of the present invention. [Diagram 5] 4 is a flowchart showing an example of the operation of the X-ray CT apparatus of the present invention. [Figure 6] FIG. 2 is a diagram showing an example of the peripheral configuration of an inference unit of the X-ray CT apparatus of the present invention. [Figure 7] 4 is a flowchart showing an example of the operation of the X-ray CT apparatus of the present invention. [Figure 8] FIG. 2 is a diagram showing an example of the peripheral configuration of an inference unit of the X-ray CT apparatus of the present invention. [Figure 9] 4 is a flowchart showing an example of the operation of the X-ray CT apparatus of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0012] Hereinafter, an X-ray CT apparatus, an information processing system, an information processing method, and a program according to an embodiment will be described with reference to the drawings. Note that parts with the same reference numerals perform the same operations, and redundant explanations will be omitted as appropriate. Hereinafter, an embodiment will be described with reference to the drawings.
[0013] A first embodiment of the present invention will be described with reference to Figs. 1 to 5. An example of the configuration of an X-ray CT apparatus according to the first embodiment will be described with reference to Fig. 1. The X-ray CT apparatus 1 shown in Fig. 1 includes a gantry 10, a bed apparatus 30, and a console apparatus 40. In the embodiment, the rotation axis of the rotating frame 13 in a non-tilted state or the longitudinal direction of a top plate 33 of the bed apparatus 30 is defined as the Z-axis direction, the axial direction perpendicular to the Z-axis direction and horizontal to the floor surface is defined as the X-axis direction, and the axial direction perpendicular to the Z-axis direction and perpendicular to the floor surface is defined as the Y-axis direction.
[0014] For example, the gantry device 10 and the bed device 30 are installed in a CT examination room, and the console device 40 is installed in a control room adjacent to the CT examination room. The console device 40 does not necessarily have to be installed in the control room. For example, the console device 40 may be installed in the same room as the gantry device 10 and the bed device 30. In any case, the gantry device 10, the bed device 30, and the console device 40 are connected to each other by wire or wirelessly so that they can communicate with each other.
[0015] The gantry device 10 is a scanning device having a configuration for performing X-ray CT imaging of the subject P. The gantry device 10 includes an X-ray tube 11, a detector 12, a rotating frame 13, an X-ray high voltage device 14, a control device 15, a wedge 16, a collimator 17, and a data acquisition device 18 (hereinafter also referred to as a DAS (Data Acquisition System)). For convenience of explanation, only a part of the configuration is shown here.
[0016] The X-ray tube 11 is a vacuum tube that generates X-rays by irradiating thermoelectrons from a cathode (filament) to an anode (target) by application of a high voltage from the X-ray high voltage device 14 and supply of a filament current. Specifically, X-rays are generated by the thermoelectrons colliding with the target. For example, the X-ray tube 11 may be a rotating anode type X-ray tube that generates X-rays by irradiating a rotating anode with thermoelectrons. The X-rays generated by the X-ray tube 11 are shaped into a cone beam via a collimator 17, for example, and irradiated to the subject P. The X-ray tube 11 is an example of an X-ray generating unit.
[0017] The detector 12 detects X-rays irradiated from the X-ray tube 11 and transmitted through the subject P, and outputs a signal corresponding to the X-ray dose to the DAS 18. The detector 12 has, for example, a plurality of X-ray detection element rows in which a plurality of X-ray detection elements are arranged in the channel direction along one arc centered on the focal point of the X-ray tube 11. The detector 12 has, for example, a row structure in which a plurality of X-ray detection element rows in which a plurality of X-ray detection elements are arranged in the channel direction are arranged in the slice direction (row direction). The detector 12 is a photon-counting detector. The reconstruction processing unit can also reconstruct CT image data (integral image data) with a high S / N ratio by counting photons of the X-rays transmitted through the subject P using the photon-counting detector.
[0018] The detector 12 can be classified into an energy integration function and a photon counting function according to the measurement method performed by the DAS 18 on the converted signal. In the energy integration function, the energy of the X-rays transmitted through the subject P is integrated over a certain period of time to measure the total energy of the X-rays transmitted over a certain period of time. In the photon counting function, the number of X-ray photons contained in the X-rays transmitted through the subject P is measured by dividing them into multiple energy bands (also called energy bins or simply bins). This makes it possible to perform material fractionation based on the imaging data obtained for each energy band. Here, the imaging mode when material fractionation is performed is called the material fractionation mode (material decomposition image mode), and the imaging mode when material fractionation is not performed is called the non-material decomposition mode (integral image mode).
[0019] The rotating frame 13 supports the X-ray generating unit and the X-ray detecting unit rotatably around a rotation axis Z. Specifically, the rotating frame 13 is an annular frame that supports the X-ray tube 11 and the detector 12 facing each other and rotates the X-ray tube 11 and the detector 12 by a control device 15. The rotating frame 13 is rotatably supported by a fixed frame (not shown) made of a metal such as aluminum. More specifically, the rotating frame 13 is connected to an edge of the fixed frame via a bearing. The rotating frame 13 receives power from a drive mechanism of the control device 15 and rotates around the rotation axis Z at a constant angular velocity.
[0020] The rotating frame 13 further includes and supports the X-ray high voltage device 14 and the DAS 18 in addition to the X-ray tube 11 and the detector 12. The rotating frame 13 is housed in a substantially cylindrical housing in which an opening (bore) 19 forming an imaging space is formed. The opening substantially coincides with the FOV. The central axis of the opening coincides with the rotation axis Z of the rotating frame 13. The imaging data generated by the DAS 18 is transmitted, for example, from a transmitter having a light-emitting diode (LED) to a receiver (not shown) having a photodiode provided in a non-rotating part (fixed frame) of the gantry 10 by optical communication, and is then transferred to the console device 40. The method of transmitting the imaging data from the rotating frame 13 to the non-rotating part of the gantry 10 is not limited to optical communication, and any method of non-contact data transmission may be used.
[0021] The X-ray high voltage device 14 has electric circuits such as a transformer and a rectifier, and includes a high voltage generator having a function of generating a high voltage to be applied to the X-ray tube 11 and a filament current to be supplied to the X-ray tube 11, and an X-ray control device that controls an output voltage according to the X-rays irradiated by the X-ray tube 11. The high voltage generator may be of a transformer type or an inverter type. The X-ray high voltage device 14 may be provided on the rotating frame 13, or on the fixed frame side of the gantry device 10.
[0022] The control device 15 has a processing circuit having a CPU (Central Processing Unit) and the like, and a driving mechanism for a motor, an actuator, and the like. The processing circuit has a processor such as a CPU or an MPU (Micro Processing Unit) and a memory such as a ROM (Read Only Memory) or a RAM (Random Access Memory) as hardware resources. The control device 15 may also be realized by an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA), another Complex Programmable Logic Device (CPLD), or a Simple Programmable Logic Device (SPLD). The control device 15 controls the X-ray high voltage device 14, the DAS 18, and the like according to commands from the console device 40. The processor realizes the above control by reading and executing a program stored in the memory.
[0023] The wedge 16 is a filter for adjusting the amount of X-rays irradiated from the X-ray tube 11. Specifically, the wedge 16 is a filter that transmits and attenuates the X-rays irradiated from the X-ray tube 11 so that the X-rays irradiated from the X-ray tube 11 to the subject P have a predetermined distribution. For example, the wedge 16 (wedge filter, bow-tie filter) is a filter made of processed aluminum so as to have a predetermined target angle and a predetermined thickness.
[0024] The collimator 17 is a lead plate or the like for narrowing down the irradiation range of the X-rays transmitted through the wedge 16, and a slit is formed by combining a plurality of lead plates or the like. The collimator 17 may also be called an X-ray aperture.
[0025] The DAS 18 generates digital data (also called imaging data) indicating count values of X-ray photons detected by the detector 12 for each of a plurality of energy bands. The imaging data is a set of count value data identified by the channel number of the X-ray detection element that generated the data, the row number, the view number indicating the collected view (projection angle), and the energy bin number. The DAS 18 is realized, for example, by an ASIC (Application Specific Integrated Circuit) equipped with circuit elements capable of generating imaging data. The imaging data is transferred to the console device 40.
[0026] The bed device 30 is a device for placing and moving a subject P to be scanned, and includes a base 31, a bed driving device 32, a top board 33, and a support frame 34. The base 31 is a housing that supports the support frame 34 so that it can move in the vertical direction.
[0027] The bed driving device 32 is a motor or actuator that moves the tabletop 33 on which the subject P is placed in the longitudinal direction of the tabletop 33. The bed driving device 32 moves the tabletop 33 under the control of the console device 40 or the control device 15. For example, the bed driving device 32 moves the tabletop 33 in a direction perpendicular to the subject P so that the body axis of the subject P placed on the tabletop 33 coincides with the central axis of the opening of the rotating frame 13. The bed driving device 32 may also move the tabletop 33 along the body axis direction of the subject P in accordance with X-ray CT imaging performed using the gantry device 10. The bed driving device 32 generates power by driving at a rotation speed according to the duty ratio of a drive signal from the control device 15. The bed driving device 32 is realized by a motor such as a direct drive motor or a servo motor.
[0028] The tabletop 33 provided on the upper surface of the support frame 34 is a plate on which the subject P is placed. The bed driving device 32 may move the support frame 34 in the longitudinal direction of the tabletop 33 in addition to the tabletop 33.
[0029] The console device 40 has a memory 41, a display unit 42, an operation unit 43, and a processing circuit 44. Data communication between the memory 41, the display unit 42, the operation unit 43, and the processing circuit 44 is performed via a bus. Note that, although the console device 40 will be described as being separate from the gantry device 10, the gantry device 10 may include the console device 40 or some of the components of the console device 40.
[0030] The memory 41 is a storage device such as an HDD (Hard Disk Drive), an SSD (Solid State Drive), or an integrated circuit storage device that stores various information. The memory 41 stores, for example, imaging data and reconstructed image data. In addition to the HDD or SSD, the memory 41 may be a drive device that reads and writes various information between a portable storage medium such as a CD (Compact Disc), a DVD (Digital Versatile Disc), or a flash memory, or a semiconductor memory element such as a RAM (Random Access Memory). The storage area of the memory 41 may be in the X-ray CT device 1 or in an external storage device connected via a network. For example, the memory 41 stores data of a CT image and a display image. The memory 41 also stores a control program according to the embodiment.
[0031] The display unit 42 displays various information. For example, the display unit 42 outputs medical images (CT images) generated by the processing circuit 44 and a GUI (Graphical User Interface) for receiving various operations from an operator. For example, a liquid crystal display (LCD), a cathode ray tube (CRT), an organic electroluminescence display (OELD), a plasma display, or any other display unit can be used as appropriate as the display unit 42. The display unit 42 may be provided on the gantry device 10. The display unit 42 may be a desktop type, or may be configured as a tablet terminal capable of wireless communication with the console device 40 main body.
[0032] The operation unit 43 receives various input operations from the operator, converts the received input operations into electrical signals, and outputs the electrical signals to the processing circuit 44. For example, the operation unit 43 receives from the operator collection conditions for collecting imaging data, reconstruction conditions for reconstructing a CT image, image processing conditions for generating a post-processed image from a CT image, and the like. As the operation unit 43, for example, a mouse, a keyboard, a trackball, a switch, a button, a joystick, a touchpad, a touch panel display unit, and the like can be used as appropriate. In the embodiment, the operation unit 43 is not limited to a device having physical operation parts such as a mouse, a keyboard, a trackball, a switch, a button, a joystick, a touchpad, and a touch panel display unit. For example, an electrical signal processing circuit that receives an electrical signal corresponding to an input operation from an external input device provided separately from the device and outputs the electrical signal to the processing circuit 44 is also included in the example of the operation unit 43. The operation unit 43 may be provided in the gantry device 10. The operation unit 43 may also be configured with a tablet terminal or the like capable of wireless communication with the console device 40 main body.
[0033] The processing circuitry 44 controls the operation of the entire X-ray CT apparatus 1 in response to an electrical signal of an input operation output from the operation unit 43. For example, the processing circuitry 44 has a processor such as a CPU, MPU, or GPU (Graphics Processing Unit) and a memory such as a ROM or RAM as hardware resources. The processing circuitry 44 executes a control unit 441, a reconstruction processing unit 442, an image analysis unit 443, an inference unit 444, a selection unit 225, and a display control unit 446 by a processor that executes a program expanded in the memory. Note that each function (the control unit 441, the reconstruction processing unit 442, the image analysis unit 443, the inference unit 444, the selection unit 225, and the display control unit 446) is not limited to being realized by a single processing circuit. A processing circuit may be configured by combining a plurality of independent processors, and each processor may execute a program to realize each function.
[0034] The control unit 441 controls each function of the processing circuit 44 based on an input operation received from an operator via the operation unit 43. Specifically, the control unit 441 reads out a control program stored in the memory 41, expands it on the memory in the processing circuit 44, and controls each unit of the X-ray CT apparatus 1 according to the expanded control program. In addition, the control unit 441 generates imaging data by performing pre-processing such as logarithmic conversion processing, offset correction processing, sensitivity correction processing between channels, and beam hardening correction on the imaging data output from the DAS 18.
[0035] The reconstruction processing unit 442 has a function of generating CT image data based on the imaging data output by the detector 12 (DAS 18). The reconstruction processing unit 442 reconstructs CT image data by, for example, backprojection processing of the imaging data stored in the memory circuitry 35. An example of the backprojection processing is backprojection processing by a Filtered Back Projection (FBP) method. The reconstruction processing unit 442 may perform the reconstruction processing by, for example, an iterative approximation method. The reconstruction processing unit 442 also generates CT image data by performing various image processing on the CT image data. The reconstruction processing unit 442 stores the reconstructed CT image data and the CT image data generated by various image processing in the memory 41.
[0036] The reconstruction processor 442 also calculates energy integral data by the sum of the counts (total value) of each energy bin, or the sum of the products of the representative values and counts of the energy bins, which are signals obtained by the photon-counting detector 12. The reconstruction processor 442 can also reconstruct CT image data (integral image data) by using the energy integral data.
[0037] Furthermore, as an application of the photon-counting X-ray CT apparatus 1, there is a technique for discriminating the type, abundance, density, etc. of the material contained in the subject P by utilizing the fact that the X-ray absorption characteristics differ for each material. This is called material decomposition. For example, the reconstruction processing unit 442 can perform material decomposition on the imaging data and obtain material decomposition information. Furthermore, the reconstruction processing unit 442 can reconstruct material decomposition image data indicating the material decomposition using the material decomposition information that is the result of the material decomposition.
[0038] For example, imaging data generated from counting results obtained by the photon-counting X-ray CT device 1 contains information on the energy spectrum of X-rays attenuated by passing through the subject P. Therefore, the reconstruction processing unit 442 can reconstruct material decomposition image data in which, for example, a specific energy component is visualized.
[0039] The image analysis unit 443 analyzes the material decomposition image data. By analyzing the material decomposition image data, it is possible to obtain the extent to which a predetermined material is contained in the material decomposition image data and the extent to which a predetermined lesion is contained in the material decomposition image data.
[0040] The inference unit 444 can perform inference on the material decomposition image data. The inference unit 444 can perform inference on the CT image data (integral image data). Therefore, the inference unit 444 can perform inference on each of the material decomposition image data and the CT image data. Furthermore, the inference unit 444 can perform inference on the composite image data of the material decomposition image data and the CT image data (integral image data).
[0041] Specifically, as shown in FIG. 2, the inference unit 444 has a first inference unit 450 that uses a neural network to perform inference on the material decomposition image data or the composite image data of the material decomposition image data and the CT image data, and a second inference unit 451 that uses a neural network to perform inference on the CT image data.
[0042] The first inference unit 450 acquires training data in advance. The training data is determined according to the inference task performed by the neural network and the target of classification.
[0043] Inference tasks performed by neural networks include a classification task to classify the classes of material decomposition image data, a detection task to detect which material is captured at which position in the material decomposition image data, a segmentation task to extract a target region from the material decomposition image data, etc. The material decomposition image data used as training data is material decomposition image data or composite image data of material decomposition image data and CT image data.
[0044] When training a neural network to perform a classification task, the first inference unit 450 acquires training data that pairs material decomposition image data with ground truth labels, which are labels that indicate the material objects captured in the material decomposition image data.
[0045] On the other hand, when training a neural network to perform a detection task, the first inference unit 450 obtains training data for the material decomposition image data that pairs an ROI (Region Of Interest), which indicates the position of a material target reflected in the material decomposition image data, with a correct answer image to which a correct answer label, which is a label indicating the target, has been assigned.
[0046] When training a neural network to perform a segmentation task, the first inference unit 450 obtains training data for the material decomposition image data, which pairs position information of pixels of material objects captured in the material decomposition image data with a correct image to which a correct label, which is a label indicating the material object, has been assigned.
[0047] Similarly, the second inference unit 451 acquires training data in advance. The training data is determined according to the inference task performed by the neural network and the target of classification.
[0048] Inference tasks performed by neural networks include classification tasks to classify the classes of CT image data (integral image data), detection tasks to detect what is captured in what position in the CT image data, and segmentation tasks to extract target areas from the CT image data.
[0049] When training a neural network that performs a classification task, the second inference unit 451 acquires training data that pairs CT image data with a correct answer label that is a label indicating an object that appears in the CT image data.
[0050] On the other hand, when training a neural network to perform a detection task, the second inference unit 451 acquires training data for the CT image data that pairs an ROI (Region Of Interest) indicating the position of an object captured in the CT image data with a correct image to which a correct label, which is a label indicating the object, has been assigned.
[0051] When training a neural network to perform a segmentation task, the second inference unit 451 acquires training data for the CT image data that pairs position information of pixels of a target that appears in the CT image data with a correct image to which a correct label, which is a label indicating the target, has been assigned.
[0052] The selection unit 445 selects at least one of the inference result of the first inference unit 450 that performs inference on material decomposition image data and the inference result of the second inference unit 451 that performs inference on CT image data (integral image data). In other words, the selection unit 445 can select which of the inference result of the first inference unit 450 that performs inference on material decomposition image data and the inference result of the second inference unit 451 that performs inference on CT image data (integral image data) to display on the display unit 42.
[0053] The selection unit 445 can select at least one of the inference results of the first inference unit 450 and the second inference unit 451 according to the examination order. Specifically, when the examination order includes an examination on the mammary gland (calcification examination), the selection unit 445 selects the inference result of the first inference unit 450 that infers material decomposition image data including calcium information. When the examination order includes an examination using a contrast agent (iodine examination), the selection unit 445 selects the inference result of the first inference unit 450 that infers material decomposition image data including iodine information. Furthermore, when the examination order includes an examination on the presence or absence of a metal (stent) (metal examination), the selection unit 445 selects the inference result of the first inference unit 450 that infers material decomposition image data including metal (stent) information.
[0054] In other words, when the examination order includes a predetermined first examination (calcification examination, iodine examination, metal examination, etc.), the selection unit 445 selects the inference result of the first inference unit 450 that performs inference on the material decomposition image data.
[0055] When the examination order does not include a predetermined first examination, the selection unit 445 selects the inference result of the second inference unit 451 that performs inference on CT image data (integral image data). When the examination order includes, for example, an examination related to a nodule, the selection unit 445 selects the inference result of the second inference unit 451 that performs inference on CT image data (integral image data). When the examination order includes an examination that cannot be performed using only material decomposition image data, the selection unit 445 selects the inference result of the second inference unit 451 that performs inference on CT image data (integral image data).
[0056] Furthermore, when the examination order includes a predetermined second examination (examination related to breast cancer (calcification examination and tumor examination)), the inference result of the first inference unit 450, which infers material decomposition image data including calcium information, and the inference result of the second inference unit 451, which performs inference on CT image data (integral image data), are required. The second examination is different from the first examination. Therefore, the selection unit 445 selects both the inference result of the first inference unit 450, which infers material decomposition image data including calcium information, and the inference result of the second inference unit 451, which performs inference on CT image data (integral image data).
[0057] The display control unit 446 controls the display unit 42 to display information on the process or results of each function or process of the processing circuit 44. The display control unit 446 causes the display unit 42 to display the inference result selected by the selection unit 445.
[0058] Fig. 3 shows one display form of the display unit 42 in the X-ray CT apparatus 1 of the present invention. When the selection unit 445 selects the inference result of the first inference unit 450 that performs inference on the material decomposition image data, the material decomposition image data is displayed on the display unit 42 as shown in Fig. 3. The display unit 42 may also display composite image data of the material decomposition image data and the CT image data.
[0059] The display unit 42 displays the material decomposition image data 300. The material decomposition image data 300 is a slice image of three-dimensional volume data. When the first inference unit 450 detects a predetermined substance (calcium, iodine, metal, etc.) in the material decomposition image data 300, it displays region information 302 related to the predetermined substance and information 304 on the substance name. The operator can recognize which substance exists at which position from the region information 302 related to the predetermined substance and information 304 on the substance name. When the first inference unit 450 detects a predetermined lesion in the material decomposition image data 300, the display control unit 446 displays region information 305 related to the lesion and information 307 on the lesion name.
[0060] Furthermore, the display control unit 446 can also display information 306 indicating that the first inference unit 450 has performed inference on the material decomposition image data 300. The operator can recognize that the material decomposition image data 300 has been used to infer the region information 302 and the material name information 304 related to a predetermined material. Therefore, the operator can recognize which material exists at which position. The operator can recognize that the material decomposition image data 300 has been used to infer the region information 305 and the lesion name information 307 related to a lesion. Therefore, the operator can recognize which lesion exists at which position.
[0061] 4 shows one display form of the display unit 42 in the X-ray CT apparatus 1 of the present invention. When the selection unit 445 selects the inference result of the second inference unit 451 that performs inference on CT image data (integral image data), the CT image data is displayed as shown in FIG.
[0062] The display unit 42 displays CT image data 301. The CT image data 301 is a slice image of three-dimensional volume data. When the second inference unit 451 detects a predetermined lesion (nodule, tumor, etc.) in the CT image data 301, the display control unit 446 displays region information 308 related to the predetermined lesion and information 310 on the lesion name. The operator can recognize which lesion exists at which position from the region information 308 related to the predetermined lesion and information 310 on the lesion name.
[0063] In addition, the display control unit 446 can also display information 312 indicating that inference has been made by the second inference unit 451 for the CT image data 301. The operator can recognize that the CT image data 301 has been used for inference.
[0064] Although the console device 40 has been described as a single console that executes multiple functions, multiple functions may be executed by separate consoles.
[0065] Next, an operation of the X-ray CT apparatus 1 of the present invention will be described below.
[0066] S100: A scan is performed to perform X-ray CT imaging of the subject P. While X-rays are generated by the X-ray tube 11, the X-ray tube 11 and the detector 12 are rotated around the rotation axis Z (subject P) to perform X-ray CT imaging.
[0067] S102: The detector 12 detects the X-rays transmitted through the subject P, and obtains imaging data, which is a signal related to the subject P. The imaging data is detection data obtained by bundling detection data from a predetermined number of detection elements in spatial units. In addition, the imaging data generated from the counting results obtained by the detector 12 includes information on the energy of the X-rays attenuated by transmitting through the subject P.
[0068] S104: The reconstruction processing unit 442 generates CT image data (integral image data) based on the imaging data output by the detector 12. The reconstruction processing unit 442 can reconstruct image data of, for example, a specific energy component.
[0069] S106: The reconstruction processing unit 442 performs material decomposition on the imaging data output by the detector 12, and reconstructs material decomposition image data using the result of the material decomposition. The reconstruction processing unit 442 generates material decomposition image data.
[0070] S108: The first inference unit 450 performs inference on the material decomposition image data and obtains an inference result. The second inference unit 451 performs inference on the CT image data (integral image data) and obtains an inference result.
[0071] S110: The selection unit 445 selects at least one of the inference result of the first inference unit 450 that performs inference on the material decomposition image data and the inference result of the second inference unit 451 that performs inference on the CT image data (integral image data). If the selection unit 445 selects the inference result of the first inference unit 450, the process proceeds to S112. If the selection unit 445 selects the inference result of the second inference unit 451, the process proceeds to S114.
[0072] S112: The selection unit 445 outputs the inference result of the first inference unit 450 to the display control unit 446. As shown in FIG. 3, the display control unit 446 causes the display unit 42 to display the inference result of the first inference unit 450 and the material decomposition image data 300. The display control unit 446 can also cause the composite image data of the material decomposition image data and the CT image data and the inference result of the first inference unit 450 to be displayed on the same screen. When the inference result of the first inference unit 450 includes a predetermined substance (calcium, iodine, metal, etc.), the display control unit 446 causes the region information 302 related to the predetermined substance and the information 304 on the substance name. When the inference result of the first inference unit 450 includes a lesion, the display control unit 446 causes the region information 305 related to the lesion and the information 307 on the lesion name.
[0073] The selection unit 445 may select both the inference result of the first inference unit 450 that infers material decomposition image data and the inference result of the second inference unit 451 that performs inference on CT image data (integral image data). In this case, the selection unit 445 outputs the inference result of the first inference unit 450 and the inference result of the second inference unit 451 to the display control unit 446. The display control unit 446 can also display the composite image data of the material decomposition image data and the CT image data, the inference result of the first inference unit 450, and the inference result of the second inference unit 451 on the same screen.
[0074] S114: The selection unit 445 outputs the inference result of the second inference unit 451 to the display control unit 446. The display control unit 446 displays the inference result of the second inference unit 451 and the CT image data 301 on the display unit 42, as shown in Fig. 4. The display control unit 446 can also display the CT image data 301 and the inference result of the second inference unit 451 on the same screen. When the inference result of the second inference unit 451 includes a lesion area, the display control unit 446 displays the region information 308 related to the lesion and the information 310 on the name of the lesion.
[0075] As described above, the inference unit 444 has a first inference unit 450 that performs inference on material decomposition image data using a neural network, and a second inference unit 451 that performs inference on CT image data using a neural network.
[0076] When the inference result obtained by performing inference on the material decomposition image data includes information on a specific material, the selection unit 445 selects the inference result obtained by performing inference on the material decomposition image data.When the inference result obtained by performing inference on the CT image data (integral image data) includes information on a specific lesion, the selection unit 445 selects the inference result obtained by performing inference on the CT image data (integral image data).
[0077] When the inference result performed on the material decomposition image data includes information about a specific material, and when the inference result performed on the CT image data (integral image data) includes information about a specific lesion, the selection unit 445 selects the inference result performed on the material decomposition image data and the inference result performed on the CT image data (integral image data).
[0078] Here, a modified example of the first embodiment will be described. As shown in FIG. 5, in S108, the first inference unit 450 performs inference on the material decomposition image data and obtains the inference result. The second inference unit 451 performs inference on the CT image data (integral image data) and obtains the inference result. The control unit 441 can compare the inference result of the first inference unit 450 that performed inference on the material decomposition image data with the inference result of the second inference unit 451 that performed inference on the CT image data (integral image data), calculate comparison information of the inference results, and display the information. The comparison information of the inference results indicates whether or not the inference result of the first inference unit 450 that performed inference on the material decomposition image data matches the inference result of the second inference unit 451 that performed inference on the CT image data (integral image data).
[0079] For example, when the inference result of the first inference unit 450 that performed inference on the material decomposition image data and the inference result of the second inference unit 451 that performed inference on the CT image data (integral image data) match, the selection unit 445 selects either the inference result of the first inference unit 450 that performed inference on the material decomposition image data or the inference result of the second inference unit 451 that performed inference on the CT image data (integral image data). The display control unit 446 may display that the inference result of the first inference unit 450 that performed inference on the material decomposition image data and the inference result of the second inference unit 451 that performed inference on the CT image data (integral image data) match.
[0080] When the inference result of the first inference unit 450 that performed inference on the material decomposition image data differs from the inference result of the second inference unit 451 that performed inference on the CT image data (integral image data), the inference result may be influenced by material decomposition, so the selection unit 445 selects the inference result of the first inference unit 450 that performed inference on the material decomposition image data. The display control unit 446 causes the display unit 42 to display the inference result of the first inference unit 450 and the material decomposition image data 300, as shown in FIG.
[0081] In addition, the display control unit 446 may display information indicating that the inference result of the first inference unit 450, which performed inference on the material decomposition image data, differs from the inference result of the second inference unit 451, which performed inference on the CT image data (integral image data).
[0082] The display control unit 446 may highlight an area where the inference result of the first inference unit 450 that performed inference on the material decomposition image data differs from the inference result of the second inference unit 451 that performed inference on the CT image data (integral image data). The highlighting is a frame display, a highlight display, or the like. The display control unit 446 can display an area where the inference result of the first inference unit 450 that performed inference on the material decomposition image data differs from the inference result of the second inference unit 451 that performed inference on the CT image data (integral image data) so that the area can be distinguished.
[0083] The display control unit 446 displays the inference result of the first inference unit 450, which performed inference on the material decomposition image data, and the inference result of the second inference unit 451, which performed inference on the CT image data (integral image data), on a composite image consisting of the material decomposition image data and the CT image data (integral image data). The operator can recognize which detection information is different from each inference result (detection information).
[0084] As described above, the X-ray CT apparatus of this embodiment includes the X-ray tube 11 for irradiating X-rays, the detector 12 for detecting the X-rays irradiated from the X-ray tube 11 and transmitted through the subject, the reconstruction processing unit 442 for reconstructing the imaging data output by the detector 12 to generate CT image data and material decomposition image data, the first inference unit 450 for performing inference on the material decomposition image data, the second inference unit 451 for performing inference on the CT image data, and the display control unit 446 for displaying at least one of the inference results of the first inference unit 450 and the second inference unit 451 on the display unit 42. Thus, the X-ray CT apparatus of this embodiment can display the inference results of the first inference unit for performing inference on the material decomposition image data and the inference results of the second inference unit for performing inference on the CT image data, so that the operator can check each of the inference results.
[0085] The information processing system of the present invention includes a first inference unit 450 that performs inference on material decomposition image data generated by reconstructing the shooting data output by a detector of an X-ray CT device, a second inference unit 451 that performs inference on CT image data, and a display control unit 446 that causes at least one of the inference results of the first inference unit 450 and the second inference unit 451 to be displayed on the display unit 42.
[0086] The information processing method of the present invention includes a step of generating CT image data and material decomposition image data based on X-rays irradiated from an X-ray tube and transmitted through a subject, and a step of displaying on a display unit 42 at least one of the inference results of a first inference unit 450 that performs inference on the material decomposition image data and the inference results of a second inference unit 451 that performs inference on the CT image data.
[0087] Next, a second embodiment of the present invention will be described with reference to Figs. 6 and 7. The difference from the first embodiment is that the selection unit 445 selects at least one of a first inference unit 450 that performs inference on material decomposition image data and a second inference unit 451 that performs inference on CT image data (integral image data). In this embodiment, the differences from the first embodiment will be mainly described.
[0088] When the selection unit 445 selects the material decomposition image data as the target of inference, the selection unit 445 selects the first inference unit 450. Then, the first inference unit 450 performs inference on the material decomposition image data. When the material decomposition image data is not the target of inference, the selection unit 445 selects the second inference unit 451. The second inference unit 451 performs inference on the CT image data (integral image data).
[0089] 6, the reconstruction processing unit 442 has a function of generating CT image data (integral image data) based on the imaging data output by the detector 12. The display control unit 446 causes the display unit 42 to display the CT image data. The reconstruction processing unit 442 also has a function of performing material decomposition on the imaging data output by the detector 12 and reconstructing material decomposition image data using the result of the material decomposition. The display control unit 446 can also cause the display unit 42 to display the material decomposition image data.
[0090] The selection unit 445 selects whether or not to use the material decomposition image data as a target of inference. When the material decomposition image data is selected as a target of inference (when the first inference unit 450 is selected), the first inference unit 450 performs inference on the material decomposition image data and obtains an inference result. The first inference unit 450 outputs the inference result of the first inference unit 450 to the display control unit 446.
[0091] The selection unit 445 may select at least one of the first inference unit 450 and the second inference unit 451 according to the examination order. Specifically, when the examination order includes an examination on the mammary gland (calcification examination), the selection unit 445 selects the first inference unit 450 that infers material decomposition image data including calcium information. When the examination order includes an examination using a contrast agent (iodine examination), the selection unit 445 selects the first inference unit 450 that infers material decomposition image data including iodine information. Furthermore, when the examination order includes an examination on the presence or absence of a metal (stent) (metal examination), the selection unit 445 selects the first inference unit 450 that infers material decomposition image data including metal (stent) information.
[0092] That is, when the examination order includes a predetermined first examination (calcification examination, iodine examination, metal examination, etc.), the selection unit 445 selects the first inference unit 450 that performs inference on the material decomposition image data.
[0093] When the examination order does not include a predetermined first examination, the selection unit 445 selects the second inference unit 451 that performs inference on the CT image data (integral image data). When the material decomposition image data is not selected as the inference target, that is, when the CT image data (integral image data) is selected as the inference target (the second inference unit 451 is selected), the second inference unit 451 performs inference on the CT image data (integral image data). The second inference unit 451 outputs the inference result of the second inference unit 451 to the display control unit 446.
[0094] Furthermore, when the examination order includes a predetermined second examination (examination related to breast cancer (calcification examination+tumor)), the inference result of the first inference unit 450 that infers material decomposition image data including calcium information and the inference result of the second inference unit 451 that performs inference on CT image data (integral image data) are required. Therefore, the selection unit 445 selects both the first inference unit 450 that infers material decomposition image data including calcium information and the second inference unit 451 that performs inference on CT image data (integral image data).
[0095] Next, an operation of the X-ray CT apparatus 1 of the present invention will be described below.
[0096] S100 to S104 are the same as those in FIG. 5, and therefore the description will be omitted.
[0097] S200: The selection unit 445 selects whether or not to use the material decomposition image data as an inference target. That is, the selection unit 445 selects at least one of the first inference unit 450 and the second inference unit 451. When the material decomposition image data is used as an inference target, that is, when the first inference unit 450 is selected, the process proceeds to S202. When the CT image data (integral image data) is used as an inference target, that is, when the second inference unit 451 is selected, the process proceeds to S210.
[0098] In the X-ray CT device 1, the imaging mode when material fractionation is not performed is usually set to a non-material decomposition mode (integral image mode). Therefore, since CT image data (integral image data) is usually acquired, the selection unit 445 selects the second inference unit 451 that performs inference on the CT image data (integral image data). Then, in the X-ray CT device, when the imaging mode when material fractionation is performed is set to the material fractionation mode (material decomposition image mode), the selection unit 445 selects the first inference unit 450 that performs inference on the material decomposition image data. The selection unit 445 selects at least one of the first inference unit 450 and the second inference unit 451 based on, for example, an examination order.
[0099] S202: When material decomposition image data is selected as an inference target (the first inference unit 450 is selected), the reconstruction processing unit 442 reconstructs and generates material decomposition image data indicating material decomposition.
[0100] S204: The first inference unit 450 performs inference on the material decomposition image data and obtains an inference result.
[0101] S206: The first inference unit 450 outputs the inference result of the first inference unit 450 to the display control unit 446. The display control unit 446 causes the inference result of the first inference unit 450 and the material decomposition image data 300 to be displayed on the display unit 42, as shown in FIG.
[0102] S210: When CT image data (integral image data) is used as the subject of inference, i.e., when the second inference unit 451 is selected, the reconstruction processing unit 442 does not reconstruct material decomposition image data indicating material decomposition using material decomposition information that is the result of material decomposition.
[0103] In other words, when the material decomposition image data is not selected as an inference target, the material decomposition image data indicating the material decomposition is not reconstructed using the material decomposition information that is the result of the material decomposition. The second inference unit 451 performs inference on the CT image data (integral image data) and acquires the inference result.
[0104] S212: The second inference unit 451 outputs the inference result of the second inference unit 451 to the display control unit 446. The display control unit 446 causes the display unit 42 to display the inference result of the second inference unit 451 and the CT image data 301 (integral image data), as shown in FIG.
[0105] As described above, the X-ray CT apparatus of this embodiment includes the X-ray tube 11 that irradiates X-rays, the detector 12 that detects the X-rays irradiated from the X-ray tube 11 and transmitted through the subject, a reconstruction processing unit 442 that reconstructs the imaging data output by the detector 12 and generates CT image data and material decomposition image data, a first inference unit 450 that performs inference on the material decomposition image data, a second inference unit 451 that performs inference on the CT image data, and a selection unit 445 that selects at least one of the first inference unit 450 and the second inference unit 451 based on an examination order.
[0106] Therefore, according to the X-ray CT device of this embodiment, the inference results of the first inference section that performs inference on material decomposition image data and the inference results of the second inference section that performs inference on CT image data can be displayed based on the examination order, thereby allowing the operator to check the inference results corresponding to the examination order.
[0107] The information processing system of this embodiment includes a first inference unit 450 that performs inference on material decomposition image data generated by reconstructing the shooting data output by the detector of the X-ray CT device, a second inference unit 451 that performs inference on the CT image data, and a selection unit 445 that selects at least one of the first inference unit 450 and the second inference unit 451 based on an examination order.
[0108] Moreover, the information processing method of the present embodiment includes a step of generating CT image data and material decomposition image data based on X-rays irradiated from an X-ray tube and transmitted through a subject, and a step of performing inference on at least one of the CT image data and the material decomposition image data based on an examination order.
[0109] Next, a third embodiment of the present invention will be described with reference to Figs. 8 and 9. The difference from the first and second embodiments is that an image analysis unit 443 that analyzes material decomposition image data is provided, and a selection unit 445 selects at least one of a first inference unit 450 that performs inference on material decomposition image data and a second inference unit 451 that performs inference on CT image data (integral image data) based on the analysis result of the image analysis unit 443. In this embodiment, the differences from the first and second embodiments will be mainly described.
[0110] 8, the reconstruction processing unit 442 has a function of generating CT image data (integral image data) based on the imaging data output by the detector 12. The display control unit 446 causes the display unit 42 to display the CT image data. The reconstruction processing unit 442 performs material decomposition on the imaging data output by the detector 12, and reconstructs material decomposition image data using the result of the material decomposition. The display control unit 446 can also cause the display unit 42 to display the material decomposition image data.
[0111] The image analysis unit 443 analyzes the material decomposition image data. The image analysis unit 443 can analyze the material decomposition image data and acquire what and how much of each material is contained in the material decomposition image data. The selection unit 445 can select an inference target based on the analysis result of the image analysis unit 443, i.e., the content information of a predetermined material contained in the material decomposition image data. In other words, at least one of the first inference unit 450 that performs inference on the material decomposition image data and the second inference unit 451 that performs inference on the CT image data (integral image data) is selected based on the analysis result of the image analysis unit 443, i.e., the content information of a predetermined material contained in the material decomposition image data.
[0112] The selection unit 445 can also select at least one of a first inference unit 450 that performs inference on the material decomposition image data and a second inference unit 451 that performs inference on the CT image data (integral image data) based on the analysis result of the image analysis unit 443, i.e., on the content information of a predetermined lesion included in the material decomposition image data. The image analysis unit 443 can analyze the material decomposition image data and obtain the type and extent of lesions included in the material decomposition image data.
[0113] The predetermined substance is any one of calcium, water, iodine, etc. The image analysis unit 443 can analyze, for example, what percentage of calcium is contained in the material decomposition image data as the content information of the predetermined substance in the material decomposition image data. The image analysis unit 443 can also determine whether or not the material decomposition image data contains calcium at a predetermined rate or more (a predetermined content rate or more). If the material decomposition image data contains calcium at a predetermined rate or more (a predetermined content rate or more), the selection unit 445 selects the first inference unit 450 that performs inference on the material decomposition image data. If the material decomposition image data does not contain calcium at a predetermined rate or more (a predetermined content rate or more), the selection unit 445 selects the second inference unit 451 that performs inference on the CT image data (integral image data).
[0114] The image analysis unit 443 can analyze, for example, what percentage of water is contained as information on the content of a specific material in the material decomposition image data. Water corresponds to, for example, blood, lymph, etc. The image analysis unit 443 can also determine whether or not the material decomposition image data contains water at a specific rate or more (a specific content rate or more). If the material decomposition image data contains water at a specific rate or more (a specific content rate or more), the selection unit 445 selects the first inference unit 450 that performs inference on the material decomposition image data. If the material decomposition image data does not contain water at a specific rate or more (a specific content rate or more), the selection unit 445 selects the second inference unit 451 that performs inference on the CT image data (integral image data).
[0115] Furthermore, the image analysis unit 443 can analyze, for example, the percentage of iodine contained as information on the content of a predetermined material in the material decomposition image data. The image analysis unit 443 can also determine whether or not the material decomposition image data contains iodine at a predetermined rate or more (a predetermined content rate or more). If the material decomposition image data contains iodine at a predetermined rate or more (a predetermined content rate or more), the selection unit 445 selects the first inference unit 450 that performs inference on the material decomposition image data. If the material decomposition image data does not contain iodine at a predetermined rate or more (a predetermined content rate or more), the selection unit 445 selects the second inference unit 451 that performs inference on the CT image data (integral image data).
[0116] In other words, when the material decomposition image data contains a predetermined material at a predetermined ratio or more, the selection unit 445 selects the first inference unit 450. When the material decomposition image data does not contain a predetermined material at a predetermined ratio or more, the selection unit 445 selects the second inference unit 451.
[0117] In addition, a setting unit (operation unit 43) for setting the type of material to be analyzed by the image analysis unit 443 may also be provided. The operator can select the type of material to be analyzed by the image analysis unit 443 via the setting unit. The operator selects, for example, calcium as the material to be analyzed by the image analysis unit 443 via the setting unit. When the material decomposition image data contains calcium at a predetermined rate or more (a predetermined content rate or more), the selection unit 445 selects a first inference unit 450 that performs inference on the material decomposition image data. When the material decomposition image data does not contain calcium at a predetermined rate or more (a predetermined content rate or more), the selection unit 445 selects a second inference unit 451 that performs inference on the CT image data (integral image data).
[0118] The operator selects, for example, iodine via the setting unit as a material to be analyzed by the image analysis unit 443. If the material decomposition image data contains iodine at a predetermined rate or more (a predetermined content rate or more), the selection unit 445 selects a first inference unit 450 that performs inference on the material decomposition image data. If the material decomposition image data does not contain iodine at a predetermined rate or more (a predetermined content rate or more), the selection unit 445 selects a second inference unit 451 that performs inference on the CT image data (integral image data).
[0119] The operator can also select, for example, calcium and a tumor via the setting unit as the material and lesion to be analyzed by the image analysis unit 443. When the material decomposition image data contains a material (calcium) at a predetermined ratio or more (a predetermined content rate or more), or when the material decomposition image data contains a lesion (tumor) at a predetermined ratio or more (a predetermined content rate or more), the selection unit 445 selects the first inference unit 450 that performs inference on the material decomposition image data.
[0120] Next, an operation of the X-ray CT apparatus 1 of the present invention will be described below.
[0121] S100 to S106 are the same as those in FIG. 5, and therefore the description will be omitted.
[0122] S300: The image analysis unit 443 analyzes the material decomposition image data, and the selection unit 445 can select an inference target based on the analysis result of the image analysis unit 443, i.e., content information of a predetermined material included in the material decomposition image data. The selection unit 445 selects at least one of the first inference unit 450 that performs inference on the material decomposition image data and the second inference unit 451 that performs inference on the CT image data (integral image data).
[0123] If the material decomposition image data is selected as the target of inference, the process proceeds to S302. If the material decomposition image data is not selected as the target of inference, the process proceeds to S310.
[0124] S302: The first inference unit 450 performs inference on the material decomposition image data and obtains an inference result.
[0125] S304: The first inference unit 450 outputs the inference result of the first inference unit 450 to the display control unit 446. As shown in Fig. 3, the display control unit 446 causes the display unit 42 to display the inference result of the first inference unit 450 and the material decomposition image data 300. The display control unit 446 can also cause the display unit 42 to display the analysis result of the image analysis unit 443. Specifically, the display control unit 446 can display information on the content of a predetermined material and information on the content of a predetermined lesion in the material decomposition image data on the display unit 42.
[0126] S310: When the CT image data (integral image data) is to be the subject of inference, that is, when the second inference unit 451 is selected, the second inference unit 451 performs inference on the CT image data (integral image data) and obtains an inference result.
[0127] S312: The second inference unit 451 outputs the inference result of the second inference unit 451 to the display control unit 446. As shown in Fig. 4, the display control unit 446 causes the display unit 42 to display the inference result of the second inference unit 451 and the CT image data 301 (integral image data). The display control unit 446 can also cause the display unit 42 to display the analysis result of the image analysis unit 443. Specifically, the display control unit 446 can display content information of a predetermined material in the material decomposition image data on the display unit 42.
[0128] As described above, the X-ray CT apparatus of this embodiment includes the X-ray tube 11 that irradiates X-rays, the detector 12 that detects the X-rays irradiated from the X-ray tube 11 and transmitted through the subject, a reconstruction processing unit 442 that reconstructs the imaging data output by the detector 12 to generate CT image data and material decomposition image data, a first inference unit 450 that performs inference on the material decomposition image data, a second inference unit 451 that performs inference on the CT image data, an image analysis unit 443 that analyzes the material decomposition image data, and a selection unit 445 that selects at least one of the first inference unit 450 and the second inference unit 451 based on the analysis result by the image analysis unit 443. Therefore, the operator can check the inference result corresponding to the material decomposition image data.
[0129] According to the information processing system of this embodiment, the system is equipped with a first inference unit 450 that performs inference on material decomposition image data generated by reconstructing the shooting data output by the detector of the X-ray CT device, a second inference unit 451 that performs inference on the CT image data, an image analysis unit 443 that analyzes the material decomposition image data, and a selection unit 445 that selects at least one of the first inference unit 450 and the second inference unit 451 based on the analysis result by the image analysis unit 443.
[0130] Moreover, the information processing method of this embodiment includes the steps of generating CT image data and material decomposition image data based on X-rays irradiated from an X-ray tube and transmitted through a subject, analyzing the material decomposition image data, and performing inference on at least one of the CT image data and the material decomposition image data based on the analysis results.
[0131] A computer program for realizing the functions of the above-described embodiments can be supplied to a computer via a network or memory (not shown), and the computer program can be executed by a processor (not shown). This is a computer program for causing a computer to execute the above-described information processing method. In other words, the computer program is a program for causing a computer to realize the functions of an information processing system. The memory stores the computer program. [Explanation of symbols]
[0132] 1 X-ray CT device 10. Gantry 11 X-ray tube 12 Detector 30 Sleeping device 40 Console device 42 Display section 43 Operation section 44 Processing circuit 441 Control Unit 442 Reconstruction Processing Unit 443 Image Analysis Unit 444 Reasoning Department 445 Selection Section 446 Display control section 450 First Reasoning Part 451 Second Reasoning Part
Claims
1. an X-ray tube that emits X-rays; a detector that detects X-rays emitted from the X-ray tube and transmitted through the subject; a reconstruction processing unit that reconstructs the imaging data output by the detector and generates CT image data and material decomposition image data; a first inference unit that performs inference on the material decomposition image data; and a second inference unit that performs inference on the CT image data. An X-ray CT apparatus comprising: a display control unit that displays at least one of the inference results of the first inference unit and the second inference unit on a display unit.
2. a selection unit that selects at least one of the inference result of the first inference unit and the inference result of the second inference unit, 2. The X-ray CT apparatus according to claim 1, wherein the display control unit displays the inference result selected by the selection unit.
3. 2. The X-ray CT apparatus according to claim 1, wherein the CT image data is integral image data.
4. 3. The X-ray CT apparatus according to claim 2, wherein the selection unit selects at least one of the inference result of the first inference unit and the inference result of the second inference unit in accordance with an examination order.
5. 5. The X-ray CT apparatus according to claim 4, wherein when the examination order includes a predetermined first examination, the selection unit selects the inference result of the first inference unit.
6. 5. The X-ray CT apparatus according to claim 4, wherein when the examination order does not include a predetermined first examination, the selection unit selects the inference result of the second inference unit.
7. 2. The X-ray CT apparatus according to claim 1, wherein, when the first inference unit detects a predetermined material in the material decomposition image data, the display control unit displays region information and material name information relating to the predetermined material.
8. 2. The X-ray CT apparatus according to claim 1, wherein the display control unit displays information indicating an inference made for the material decomposition image data.
9. The X-ray CT device according to claim 1, characterized in that, when the second inference unit detects a specified lesion in the CT image data, the display control unit displays area information and lesion name information relating to the specified lesion.
10. 2. The X-ray CT apparatus according to claim 1, wherein the display control unit displays information indicating an inference made on the CT image data.
11. 3. The X-ray CT device according to claim 2, wherein, when the selection unit selects both the inference result of the first inference unit and the inference result of the second inference unit, the display control unit displays the composite image data of the material decomposition image data and the CT image data, the inference result of the first inference unit, and the inference result of the second inference unit on the same screen.
12. The X-ray CT device according to claim 2, characterized in that when the inference results of the first inference unit and the second inference unit differ in inference results, the selection unit selects the inference result of the first inference unit.
13. 13. The X-ray CT apparatus according to claim 12, wherein the display control unit displays information indicating a difference between the inference result of the first inference unit and the inference result of the second inference unit.
14. 14. The X-ray CT apparatus according to claim 13, wherein the display control unit highlights an area where the inference result of the first inference unit differs from the inference result of the second inference unit.
15. The X-ray CT device described in claim 2, characterized in that when the inference results of the first inference unit and the second inference unit match, the selection unit selects either the inference result of the first inference unit or the inference result of the second inference unit.
16. a first inference unit that performs inference on material decomposition image data generated by reconstructing imaging data output by a detector of an X-ray CT device; and a second inference unit that performs inference on CT image data. An information processing system comprising: a display control unit that displays at least one of the inference result of the first inference unit and the inference result of the second inference unit on a display unit.
17. generating CT image data and material decomposition image data based on X-rays emitted from an X-ray tube and transmitted through a subject; An information processing method comprising a step of displaying on a display unit at least one of the inference results of a first inference unit that performs inference on the material decomposition image data and the inference results of a second inference unit that performs inference on the CT image data.
18. A program for causing a computer to execute the information processing method according to claim 17.