Medical information processing device, medical image diagnostic device, and medical information processing method
The medical information processing device enhances X-ray CT imaging by generating high-dose equivalent data and support information to review and optimize imaging protocols, addressing the lack of objective verification in existing systems.
Patent Information
- Application Number
- JP2020036082
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2020-03-03
- Publication Date
- 2024-11-14
- Estimated Expiration
- 2040-03-03
AI Technical Summary
Existing X-ray CT devices lack a technique for verifying and reviewing imaging protocols using objective indicators, which is crucial for optimizing image diagnosis workflows.
A medical information processing device with a data generation section, information generation section, and control section that performs a second imaging process with different conditions, generates high-dose equivalent data, and provides support information for reviewing imaging protocols based on image quality evaluation.
Enables the review of imaging protocols using objective indicators, reducing radiation exposure, shortening examination time, and optimizing workflows by allowing for adjustments based on high-dose equivalent image analysis.
Smart Images

Figure 0007583530000001 
Figure 0007583530000002 
Figure 0007583530000003
Abstract
Description
[Technical field]
[0001] The embodiments disclosed in this specification relate to a medical information processing apparatus, a medical image diagnostic apparatus, and a medical information processing method. [Background technology]
[0002] Usually, in imaging processing using an X-ray computed tomography imaging device (X-ray CT device), a positioning image is first obtained by imaging with a relatively low dose called positioning imaging, and then imaging (main imaging) with a higher dose than that of the positioning imaging is performed on the imaging region set using the positioning image for the purpose of obtaining a diagnostic image. In recent years, X-ray CT devices that obtain three-dimensional data in the positioning imaging have also appeared.
[0003] The imaging process using such an X-ray CT apparatus is performed according to an imaging protocol that is set prior to imaging. In setting the imaging protocol, for example, an imaging region, imaging conditions for positioning imaging and main imaging, an imaging range, reconstruction conditions, etc. are set. When the imaging process is started according to the imaging protocol, various processes included in the imaging protocol are performed according to the set imaging conditions, etc.
[0004] In addition, techniques are being developed that use artificial intelligence such as deep learning models to improve the quality and resolution of projection data and reconstructed images.
[0005] However, in image diagnosis using an X-ray CT scanner or the like, there is no established technology for verifying an imaging protocol once set using an objective index and reviewing the workflow related to image diagnosis. [Prior art documents] [Patent documents]
[0006] [Patent Document 1] JP 2019-93126 A Summary of the Invention [Problem to be solved by the invention]
[0007] One of the problems that the embodiments disclosed in this specification are intended to solve is to establish a technique for reviewing the workflow related to image diagnosis using objective indicators. [Means for solving the problem]
[0008] A medical information processing apparatus according to an embodiment includes a data generating unit, an information generating unit, and a control unit. The data generating unit generates second data corresponding to data obtained by a second imaging, which is scheduled to be performed after the first imaging and has imaging conditions different from those of the first imaging, based on first data acquired in the first imaging. The information generating unit generates support information by executing an evaluation process for evaluating image quality of the second data. The control unit generates the support information indicating image quality of the second data. the second data; and an image for setting a photographing range to be photographed in the second imaging on the second data. is displayed on the display unit before the second imaging is performed. [Brief description of the drawings]
[0009] [Figure 1] FIG. 1 is a block diagram showing an example of the configuration of an X-ray computed tomography apparatus incorporating a medical information processing apparatus according to an embodiment. [Diagram 2] FIG. 2 is a diagram for explaining an example of data generation processing executed by the data generation function 150d of the processing circuitry 150, in which low-dose projection data is input and high-dose equivalent projection data is output. [Diagram 3] FIG. 3 is a diagram for explaining an example of data generation processing executed by the data generation function 150d of the processing circuitry 150, which is an example in which low-dose projection data is input and high-dose equivalent reconstructed image data is output. [Figure 4] FIG. 4 is a diagram for explaining an example of data generation processing executed by the data generation function 150d of the processing circuitry 150, in which a low-dose reconstructed image is input and high-dose equivalent reconstructed image data is output. [Diagram 5]FIG. 5 is a flowchart showing the flow of the evaluation process and the support information generation process. [Figure 6] FIG. 6 is a diagram for explaining an example of the process of generating a high-dose equivalent image in step S3, which is an example in which low-dose equivalent projection data is input to generate high-dose equivalent projection data, and high-dose equivalent reconstruction data is output. [Figure 7] FIG. 7 is a diagram for explaining an example of the process of generating a high-dose equivalent image in step S3, which is an example in which low-dose projection data is input to generate low-dose reconstruction data, and high-dose equivalent reconstruction data is output. [Figure 8] FIG. 8 is a diagram showing an example of display of support information, high-dose equivalent images, etc., displayed on the display 42. In FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0010] Hereinafter, a medical information processing apparatus, a medical information processing method, and a medical information processing program according to an embodiment will be described in detail with reference to the accompanying drawings.
[0011] 1 is a block diagram showing an example of the configuration of an X-ray computed tomography imaging device 1 (hereinafter referred to as "X-ray CT device 1") incorporating a medical information processing device 100 according to an embodiment. As shown in FIG. 1, the X-ray CT device 1 includes a gantry device 10, a bed device 30, and a console device 40.
[0012] In this embodiment, the rotation axis of the rotating frame 13 in the non-tilted state or the longitudinal direction of the table top 33 of the bed device 30 is defined as the Z-axis direction, the axial direction perpendicular to the Z-axis direction and horizontal to the floor surface is defined as the X-axis direction, and the axial direction perpendicular to the Z-axis direction and perpendicular to the floor surface is defined as the Y-axis direction.
[0013] The gantry device 10 has an imaging system for capturing medical images used for diagnosis. That is, the gantry device 10 is an apparatus having an imaging system that irradiates an object P with X-rays and collects projection data from detection data of the X-rays that have passed through the object P, and has an X-ray tube 11, a wedge 16, a collimator 17, an X-ray detector 12, an X-ray high voltage device 14, a DAS (Data Acquisition System) 18, a rotating frame 13, a control device 15, and a bed device 30.
[0014] The X-ray tube 11 is a vacuum tube that irradiates thermoelectrons from a cathode (filament) to an anode (target) by application of a high voltage from an X-ray high voltage device 14.
[0015] The wedge 16 is a filter for adjusting the amount of X-rays irradiated from the X-ray tube 11. Specifically, the wedge 16 is a filter that transmits and attenuates the X-rays irradiated from the X-ray tube 11 so that the X-rays irradiated from the X-ray tube 11 to the subject P have a predetermined distribution.
[0016] The wedge 16 is, for example, a wedge filter or a bow-tie filter, which is a filter made by processing aluminum so as to have a predetermined target angle and a predetermined thickness.
[0017] The collimator 17 is a lead plate or the like for narrowing down the irradiation range of the X-rays transmitted through the wedge 16, and a slit is formed by combining a plurality of lead plates or the like.
[0018] The X-ray detector 12 detects X-rays irradiated from the X-ray tube 11 and passing through the subject P, and outputs an electrical signal corresponding to the X-ray dose to a data acquisition device (DAS 18). The X-ray detector 12 has, for example, a plurality of X-ray detection element rows in which a plurality of X-ray detection elements are arranged in the channel direction along one arc centered on the focal point of the X-ray tube 11. The X-ray detector 12 has, for example, a plurality of X-ray detection element rows in which a plurality of X-ray detection elements are arranged in the channel direction along one arc centered on the focal point of the X-ray tube. The X-ray detector 12 has, for example, a structure in which a plurality of X-ray detection element rows in which a plurality of X-ray detection elements are arranged in the channel direction are arranged in the slice direction (also called the body axis direction or row direction).
[0019] Moreover, the X-ray detector 12 is an indirect conversion type detector having, for example, a grid, a scintillator array, and an optical sensor array. The scintillator array has a plurality of scintillators, and the scintillator has a scintillator crystal that outputs light with a photon amount corresponding to the amount of incident X-rays. The grid is disposed on the X-ray incident side of the scintillator array, and has an X-ray shielding plate having a function of absorbing scattered X-rays. The optical sensor array has a function of converting into an electric signal corresponding to the amount of light from the scintillator, and has, for example, an optical sensor such as a photomultiplier tube (PMT). The X-ray detector 12 may be a direct conversion type detector having a semiconductor element that converts the incident X-rays into an electric signal.
[0020] X-ray high voltage device 14 has electric circuits such as a transformer and a rectifier, and includes a high voltage generator having a function of generating a high voltage to be applied to X-ray tube 11, and an X-ray control device that controls the output voltage according to the X-rays irradiated by X-ray tube 11. The high voltage generator may be of a transformer type or an inverter type. X-ray high voltage device 14 may be provided on rotating frame 13, or may be provided on the fixed frame (not shown) side of gantry device 10. The fixed frame is a frame that rotatably supports rotating frame 13.
[0021] The DAS 18 has an amplifier that performs an amplification process on the electric signals output from each X-ray detection element of the X-ray detector 12, and an A / D converter that converts the electric signals into digital signals, and generates detection data. The detection data generated by the DAS 18 is transferred to the console device 40.
[0022] The rotating frame 13 is an annular frame that supports the X-ray tube 11 and the X-ray detector 12 facing each other and rotates the X-ray tube 11 and the X-ray detector 12 by the control device 15. The rotating frame 13 may further support the X-ray high voltage device 14 and the DAS 18 in addition to the X-ray tube 11 and the X-ray detector 12. The detection data generated by the DAS 18 is transmitted, for example, by optical communication from a transmitter having a light-emitting diode provided on the rotating frame 13 to a receiver having a photodiode provided on a non-rotating part of the gantry 10 such as a fixed frame, and then transferred to the console device 40. The method of transmitting the detection data from the rotating frame 13 to the non-rotating part of the gantry 10 is not limited to optical communication, and other non-contact data transmission methods may be used.
[0023] The control device 15 has a processing circuit having a CPU and the like, and a driving mechanism such as a motor and an actuator. The control device 15 has a function of receiving an input signal from an input interface 43 attached to the console device 40 or an input interface attached to the gantry device 10, and controlling the operation of the gantry device 10 and the bed device 30. In addition, the control device 15 receives an input signal and controls the rotation of the rotating frame 13 and the operation of the gantry device 10 and the bed device 30.
[0024] For example, the control device 15 rotates the rotating frame 13 about an axis parallel to the X-axis direction based on inclination angle (tilt angle) information inputted by an input interface attached to the gantry 10, thereby tilting the gantry 10. The control function 150a of the control device 15 or the processing circuit 150 is an example of a control unit.
[0025] The bed device 30 is a device for placing and moving the subject P to be scanned, and includes a base 31, a bed driving device 32, a top plate 33, and a support frame 34. The base 31 is a housing that supports the support frame 34 so that it can move in the vertical direction. The bed driving device 32 is a motor or actuator that moves the top plate 33, on which the subject P is placed, in its longitudinal direction (the Z-axis direction in FIG. 1). The top plate 33, which is provided on the upper surface of the support frame 34, is a plate on which the subject P is placed. Note that the bed driving device 32 may move the support frame 34 in the longitudinal direction of the top plate 33 in addition to the top plate 33.
[0026] The bed driving device 32 moves the base 31 in the vertical direction in accordance with a control signal from the control device 15. The bed driving device 32 moves the tabletop 33 in the longitudinal direction in accordance with a control signal from the control device 15.
[0027] The console device 40 is a device that accepts operations of the X-ray CT apparatus 1 by a user and reconstructs X-ray CT image data from the X-ray detection data collected by the gantry device 10. The console device 40 includes a memory 41, a display 42, an input interface 43, and a processing circuit 150.
[0028] Here, the medical information processing device 100 according to this embodiment is realized by at least a processing circuit 150. Note that the medical information processing device 100 according to this embodiment may further include, for example, a memory 41, a display 42, and an input interface 43.
[0029] The memory 41 is realized by, for example, a semiconductor memory element such as a RAM (Random Access Memory), a flash memory, a hard disk, an optical disk, etc. The memory 41 stores, for example, projection data and reconstructed image data. The memory 41 is an example of a storage unit.
[0030] The memory 41 also stores dedicated programs for implementing a control function 150a, a preprocessing function 150b, a reconstruction processing function 150c, a data generating function 150d, and an information generating function 150e, which will be described later.
[0031] The display 42 is a monitor referred to by the user, and displays various types of information. For example, the display 42 outputs medical images (CT images) generated by the processing circuit 150, a GUI (Graphical User Interface) for receiving various operations from the user, and the like. For example, the display 42 is a liquid crystal display or a CRT (Cathode Ray Tube) display. The display 42 is an example of a display unit.
[0032] The input interface 43 accepts various input operations from a user, converts the accepted input operations into electrical signals, and outputs the electrical signals to the processing circuit 150. For example, the input interface 43 accepts from the user acquisition conditions for acquiring projection data, reconstruction conditions for reconstructing a CT image, image processing conditions for generating a post-processed image from the CT image, and the like. In addition, for example, the input interface 43 is realized by a mouse, a keyboard, a trackball, a switch, a button, a joystick, and the like. The input interface 43 is an example of an input unit.
[0033] The processing circuitry 150 controls the operation of the entire X-ray CT apparatus 1. The processing circuitry 150 has, for example, a control function 150a, a pre-processing function 150b, a reconstruction processing function 150c, a data generating function 150d, and an information generating function 150e. In the embodiment, each processing function performed by the components of the control function 150a, the pre-processing function 150b, the reconstruction processing function 150c, the data generating function 150d, and the information generating function 150e is stored in the memory 41 in the form of a program executable by a computer. The processing circuitry 150 is a processor that reads out the programs from the memory 41 and executes them to realize the functions corresponding to each program. In other words, the processing circuitry 150 in a state in which each program has been read out has each function shown in the processing circuitry 150 in FIG. 1.
[0034] In FIG. 1, the processing functions performed by the control function 150a, the pre-processing function 150b, the reconstruction processing function 150c, the data generation function 150d, and the information generation function 150e are described as being realized by a single processing circuit 150. However, the processing circuit 150 may be configured by combining a plurality of independent processors, and each processor may execute a program to realize the functions.
[0035] In other words, each of the above-mentioned functions may be configured as a program and one processing circuit may execute each program, or a specific function may be implemented in a dedicated, independent program execution circuit.
[0036] The term "processor" used in the above description refers to a circuit such as a CPU (Central Processing Unit), a GPU (Graphical processing unit), an Application Specific Integrated Circuit (ASIC), a programmable logic device (e.g., a Simple Programmable Logic Device (SPLD), a Complex Programmable Logic Device (CPLD), and a Field Programmable Gate Array (FPGA)). The processor achieves its function by reading and executing a program stored in the memory 41. Note that instead of storing the program in the memory 41, the processor may be configured to directly incorporate the program into its circuit. In this case, the processor achieves its function by reading and executing the program incorporated in the circuit.
[0037] The processing circuitry 150 controls various functions of the processing circuitry 150 using the control function 150a based on an input operation received from a user via the input interface 43. The processing circuitry 150 also causes the control function 150a to display a high-dose equivalent image and support information on the display 42. The processing circuitry 150 also causes the control function 150a to display a measurement tool for setting a region of interest and at least one GUI for executing control based on the support information on the display 42.
[0038] The processing circuitry 150 generates data by performing preprocessing such as logarithmic conversion processing, offset processing, inter-channel sensitivity correction processing, and beam hardening correction on the detection data output from the DAS 18 using the preprocessing function 150b. Note that the data before preprocessing (detection data) and the data after preprocessing may be collectively referred to as projection data. The processing circuitry 150 performs reconstruction processing using a filtered back projection method, an iterative reconstruction method, or the like on the projection data generated by the preprocessing function 150b using the reconstruction processing function 150c to generate CT image data. The processing circuitry 150 also converts the reconstructed CT image data into tomographic image data of an arbitrary cross section or three-dimensional image data using a known method based on an input operation received from a user via the input interface 43 using the reconstruction processing function 150c.
[0039] The processing circuit 150 uses the data generation function 150d to generate second data corresponding to data obtained by imaging under different imaging conditions from the first imaging, based on first data (e.g., positioning imaging as preliminary imaging, main imaging, etc.) acquired in the first imaging. Here, different imaging conditions refer to, for example, different tube voltages or tube currents during X-ray irradiation in the case of an X-ray CT device. Also, different imaging conditions refer to, for example, different intensity or frequency of electromagnetic pulses applied for imaging in the case of an MRI device.
[0040] Furthermore, imaging with imaging conditions different from the first imaging, in the case of an X-ray CT device, means, for example, a main imaging to be performed after a positioning imaging as the first imaging, a main imaging to be performed after a main imaging as the first imaging, etc. Also, imaging with imaging conditions different from the first imaging, in the case of an MRI device, means, for example, at least one of main imaging to be performed multiple times while changing the imaging conditions little by little after performing the first imaging as the main imaging.
[0041] Note that imaging under imaging conditions different from the first imaging may be called the second imaging. The second data corresponds to data more suitable for diagnosis than the first data (typically, corresponds to data acquired by the second imaging), but does not necessarily correspond to data acquired by the second imaging.
[0042] Moreover, the main imaging means imaging performed at a relatively high radiation dose in order to obtain an image (diagnostic image) for diagnosing a diagnostic target. The positioning imaging means imaging performed at a lower radiation dose than the main imaging in order to determine the imaging range of the main imaging. The imaging protocol is information including the diagnostic site, imaging conditions in the positioning imaging and the main imaging, contrast method, reconstruction conditions, image display method, etc. In the present embodiment, data (volume data) corresponding to a three-dimensional region of the subject is acquired by the main imaging and the positioning imaging.
[0043] In this embodiment, the data generation function 150d of the processing circuit 150 includes an AI model represented by, for example, a deep neural network.
[0044] 2, 3, and 4 are diagrams for explaining the data generation process executed by the data generation function 150d of the processing circuit 150. FIG.
[0045] 2, the processing circuit 150 uses a data generation function 150d to input projection data acquired by positioning imaging (hereinafter also referred to as "low-dose projection data"), and generates and outputs projection data having image quality equivalent to that of projection data acquired by main imaging (hereinafter referred to as "high-dose equivalent projection data"). Note that the data generation function 150d of the processing circuit 150 as the AI model shown in FIG. 2 can be generated by learning using training data in which, for example, low-dose projection data is input and high-dose equivalent projection data is used as teacher data.
[0046] 3, the processing circuitry 150 uses, for example, low-dose projection data as input, and generates and outputs reconstructed image data (hereinafter referred to as "high-dose equivalent reconstructed image data") having image quality equivalent to that of reconstructed image data reconstructed using projection data acquired by the main imaging, by using a data generation function 150d. Note that the data generation function 150d of the processing circuitry 150 as the AI model shown in FIG. 3 can be generated by learning using training data in which, for example, low-dose projection data is input, and high-dose equivalent reconstructed image data is used as teacher data.
[0047] 4, the processing circuitry 150 receives, for example, reconstructed image data (hereinafter referred to as "low-dose reconstructed image data") acquired by reconstruction processing using low-dose projection data, and generates and outputs high-dose equivalent reconstructed image data by using a data generation function 150d. Note that the data generation function 150d of the processing circuitry 150 as the AI model shown in FIG. 4 can be generated by learning using training data that receives, for example, low-dose reconstructed image data as input and uses high-dose reconstructed image data as teacher data.
[0048] The processing circuit 150 generates support information for supporting review of the second imaging, which is scheduled to be performed after the first imaging and has imaging conditions different from those of the first imaging, based on the quality of the second data (e.g., a positioning image or an image captured by the main imaging, etc.) using the information generation function 150e. For example, the processing circuit 150 executes an evaluation process using the generated high-dose equivalent projection data or high-dose equivalent reconstructed image data using the information generation function 150e, and generates support information for supporting review of the workflow including the imaging protocol based on the evaluation process. This information generation function 150e is realized by a rule-based calculation function, an AI model, or a combination of an AI model and a rule-based calculation function.
[0049] Here, "support information for supporting review of the second imaging having imaging conditions different from those of the first imaging" refers to information used for reviewing the imaging protocol, and reviewing the reconstruction and post-processing for the second imaging scheduled to be performed after the first imaging. Also, "evaluation processing using high-dose equivalent projection data or high-dose equivalent reconstructed image data" refers to processing for acquiring at least one of calculation of an evaluation value for evaluating the image quality of high-dose equivalent projection data, high-dose equivalent reconstructed image data, and an image generated from the high-dose equivalent projection data or high-dose equivalent reconstructed image data (hereinafter referred to as "high-dose equivalent image"), detection of an abnormal portion using the high-dose equivalent image, calculation of a substitution level for the high-dose equivalent image, and a judgment of necessity of the main imaging based on the evaluation value, the detection result, and the substitution level, and a judgment of suitability of the protocol of the main imaging.
[0050] In addition, "support information based on evaluation processing (hereinafter simply referred to as "support information")" is information for supporting the optimization of the workflow in image diagnosis, and includes at least one of the following: information acquired by evaluation processing (evaluation information), the result of determining whether or not actual imaging is necessary based on the evaluation information, a proposal to modify the protocol for actual imaging based on the evaluation information, and an alternative proposal for the protocol for actual imaging based on the evaluation information.
[0051] The evaluation process and the support information generation process executed by the information generation function 150e will be described below with some specific examples.
[0052] For example, the processing circuitry 150 performs evaluation using a statistical value and an image quality evaluation function for the high-dose equivalent reconstructed image by the information generating function 150e. For example, the processing circuitry 150 calculates a statistical value and an image quality evaluation function for a region of interest (which may be multiple) set on the high-dose equivalent image by the information generating function 150e. Here, the statistical value is, for example, an SD value, and the image quality evaluation function is, for example, a contrast ratio, a spatial resolution, an MTF (Modulation Transfer Function), an SSP (Slice Sensitivity Function), and the like. Furthermore, the processing circuitry 150 performs a judgment on the necessity of the main imaging and a judgment on the suitability of the protocol for the main imaging based on the statistical value and the image quality evaluation function as evaluation values by the information generating function 150e, and generates support information including the judgment result and the evaluation value serving as the basis.
[0053] The setting of the region of interest in the high-dose equivalent image may be performed manually using a measurement tool (described later), or it may be automatically set according to the diagnostic purpose by extracting parts or organs using region division processing (segmentation) or anatomical classification processing.
[0054] Furthermore, the processing circuit 150 inputs a high-dose equivalent image through the information generating function 150e, and outputs statistical values and an image quality evaluation function for the entire region or a partial region of the image. Note that an AI model equipped with such information generating function 150e can be realized, for example, by learning using training data in which the high-dose equivalent image is input data and the statistical values and the image quality evaluation function are teacher data. In addition, the high-dose equivalent image as input data may be an AI model in which the entire image is input and a region of interest setting is also included for calculating the statistical values and the image quality evaluation function, or it may be an AI model in which pixels within a region of interest set manually or automatically are input.
[0055] Furthermore, the processing circuitry 150 detects whether or not there is an abnormal portion such as a lesion by using the information generating function 150e as an input of a high-dose equivalent image. When the processing circuitry 150 detects an abnormal portion by using the information generating function 150e, the processing circuitry 150 judges whether or not the already set imaging protocol is appropriate for diagnosing the detected abnormal portion (judgment of suitability of the imaging protocol). When the processing circuitry 150 judges by the information generating function 150e that the already set imaging protocol is not appropriate, the processing circuitry 150 generates support information including a correction proposal for the imaging protocol required for examining the detected abnormal portion and an alternative proposal for the imaging protocol.
[0056] An AI model that performs such detection of abnormal regions can be realized, for example, by learning using training data in which multiple images as input data and abnormal region areas as detection results for each image are used as teacher data. An AI model that performs suitability determination of an imaging protocol can be realized by learning using training data in which multiple combinations of information on abnormal regions and imaging protocols as input data and imaging protocols (which may be multiple) required for examining the corresponding abnormal regions are used as teacher data. The suitability determination of an imaging protocol is not limited to an AI model, and may be a determination process using a table.
[0057] Moreover, the processing circuitry 150 acquires a substitutable level of the high-dose equivalent projection data or the high-dose equivalent reconstructed image data for the high-dose image by the information generating function 150e. The processing circuitry 150 judges whether or not to perform the main imaging based on the acquired substitutable level by the information generating function 150e.
[0058] The AI model for acquiring such a replaceability level can be realized by learning using training data in which, for example, multiple combinations of high-dose equivalent projection data and high-dose projection data, or multiple combinations of high-dose equivalent reconstructed image data and high-dose reconstructed image data are input data, and the replaceability levels (for example, five levels from level 1 to 5) are used as teacher data. In addition, the suitability of performing the main imaging based on the replaceability level may be realized by using the AI model, or may be realized by a judgment process using, for example, a table.
[0059] Furthermore, the processing circuitry 150 generates support information including imaging conditions and reconstruction conditions recommended for the actual imaging based on the high-dose equivalent projection data or the high-dose equivalent reconstructed image data through the information generating function 150e.
[0060] In addition, the AI model for acquiring the imaging conditions and reconstruction conditions recommended in such a main imaging can be realized by learning using training data in which, for example, high-dose equivalent projection data or high-dose equivalent reconstructed image data and an SD value desired by the user are input data, and imaging conditions and reconstruction conditions required in the main imaging to realize the SD value as the input data are used as teacher data. Also, for example, a combination of high-dose equivalent data and high-dose data (projection data or reconstructed image data actually acquired at a high dose in the main imaging) is used as input data, and imaging conditions and reconstruction conditions required in the main imaging to realize the image quality of the high-dose data as the input data are used as teacher data. Furthermore, a diagnosis site may be added as input data.
[0061] Next, the evaluation process and the support information generation process executed by the medical image processing apparatus 100 according to the embodiment will be described.
[0062] FIG. 5 is a flowchart showing the flow of the evaluation process and the support information generation process.
[0063] 5, first, the processing circuitry 150 receives input of patient information, imaging protocol, etc. by the control function 150a (step S1). Here, the diagnosis site (e.g., head, chest, etc.), imaging conditions for positioning imaging and main imaging, contrast method, reconstruction conditions, image display method, etc. are input as the imaging protocol via the input interface 43.
[0064] Next, the processing circuitry 150, through the control function 150a, executes low-dose positioning imaging to obtain low-dose projection data (step S2).
[0065] Next, the processing circuitry 150 generates a high-dose equivalent image using the low-dose projection data by the data generating function 150d (step S3).
[0066] 6 and 7 are diagrams for explaining the generation process of the high-dose equivalent image in step S3. As shown in Fig. 6, the processing circuitry 150 inputs the low-dose projection data and generates and outputs the high-dose equivalent projection data by using the data generation function 150d. The processing circuitry 150 generates and outputs the high-dose equivalent reconstructed image data from the high-dose equivalent projection data by using the reconstruction processing function 150c.
[0067] 7, the processing circuitry 150 generates and outputs low-dose equivalent reconstructed image data from the low-dose projection data using a reconstruction processing function 150c. The processing circuitry 150 generates and outputs high-dose equivalent reconstructed image data using an input of low-dose equivalent reconstructed image data using a data generating function 150d.
[0068] As shown in FIG. 3, the processing circuitry 150 receives low-dose projection data and generates and outputs high-dose equivalent reconstructed image data through a data generating function 150d.
[0069] Next, the processing circuit 150 executes an evaluation process by the information generating function 150e (step S4). As described above, this evaluation process performs, for example, calculation of an evaluation value of the image quality of the high-dose equivalent image, detection of an abnormal area using the high-dose equivalent image, calculation of a substitution level for the high-dose equivalent image, and a judgment of the necessity of the main imaging based on the evaluation value, the detection result, and the substitution level, and a judgment of the suitability of the protocol of the main imaging.
[0070] Next, the processing circuit 150 generates support information based on the evaluation process by the information generating function 150e (step S5). As described above, this support information generating process generates support information including, for example, the evaluation information acquired by the evaluation process, the result of the necessity / non-necessity determination based on the evaluation information, a proposal to modify the protocol for the actual imaging based on the evaluation information, an alternative protocol for the actual imaging based on the evaluation information, and the like.
[0071] Next, the processing circuitry 150 causes the control function 150a to display the high-dose equivalent image, support information, and the like on the display 42 (step S6).
[0072] 8 is a diagram showing an example of display of support information, a high-dose equivalent image, etc., displayed on the display 42. As shown in FIG. 8, a high-dose equivalent image 50, and support information 52 including an SD value, a contrast ratio, and a spatial resolution are displayed on the display 42. In addition, an image obtained by reconstructing low-dose projection data (a low-dose reconstructed image) can be displayed in place of the high-dose equivalent image, or in parallel with the high-dose equivalent image. By observing the displayed high-dose equivalent image 50, support information 52, etc., the user can consider and determine whether or not actual imaging is necessary and whether or not the imaging protocol that has already been set is appropriate.
[0073] Furthermore, the processing circuit 150, by the control function 150a, displays a measurement tool 51, which is a GUI for setting a region of interest, on the display 42 as necessary. When manually setting a region of interest in the evaluation process, the user can operate the measurement tool 51 via the input interface 43 and set a desired number of regions of interest at desired positions on the high-dose equivalent image 50. Furthermore, when a region of interest is set using the measurement tool 51, support information 52 corresponding to the region of interest is automatically set.
[0074] In addition, the processing circuit 150, using the control function 150a, displays on the display 42, as a GUI for executing control based on the support information, the following: imaging range change tools 53, 54, a skip instruction button 55 for instructing the skipping of a subsequent imaging (e.g., main imaging), a parameter adjustment button 56 for instructing the adjustment of various parameters included in the imaging conditions and reconstruction conditions, and an execution instruction button 57 for instructing the execution of a subsequent imaging.
[0075] For example, if the user determines to skip the actual imaging as a result of observing and examining the displayed high-dose equivalent image 50 and the support information 52, the user can skip the actual imaging included in the workflow by pressing the skip instruction button 55. Furthermore, if the user determines to change the imaging conditions and imaging range as a result of observing and examining the displayed high-dose equivalent image 50 and the support information 52, or if imaging conditions recommended by separate support information are presented, the user can change the imaging range and imaging conditions already set by executing input via the imaging range change tools 53, 54 and the parameter adjustment button 56. Furthermore, if the user determines that the actual imaging of only a specific range is necessary as a result of observing and examining the displayed high-dose equivalent image 50 and the support information 52, the user can set the range in which the image quality is insufficient for the high-dose equivalent image as the imaging range to be set in the actual imaging using the imaging range change tools 53, 54.
[0076] When the control function 150a displays a GUI to execute control based on the support information, the processing circuit 150 may highlight a button or the like corresponding to the control recommended by the device. For example, when the support information includes a determination result of "no need for actual imaging", the skip instruction button 55 is highlighted as the recommended control. The user can easily understand that the control corresponding to the highlighted button is recommended.
[0077] Next, the processing circuit 150 determines whether or not the user instructs the control function 150a to change the imaging protocol (step S7). If the user does not instruct the control function 150a to change the imaging protocol (No in step S7), the processing circuit 150 executes the subsequent imaging process such as the main imaging without changing the imaging protocol set in step S1 (step S8).
[0078] On the other hand, when the user instructs the control function 150a to change the imaging protocol (Yes in step S7), the processing circuit 150 changes the imaging protocol based on the input instruction from the user (step S9). The processing circuit 150 controls the operation related to imaging of the X-ray CT device 1 according to the changed imaging protocol by the control function 150a (step S10).
[0079] For example, when the imaging protocol is changed to "skip main imaging" in step S9, the processing circuit 150 skips main imaging by the control function 150a. Also, when the imaging protocol is changed by "change of imaging conditions" in step S9, the processing circuit 150 executes main imaging according to the changed imaging conditions by the control function 150a.
[0080] Also, for example, the image quality of the equivalent high-dose image can be spatially evaluated, and the imaging range can be changed so that the main imaging is performed only for areas that do not meet the criteria.
[0081] As described above, the medical information processing apparatus 100 according to the present embodiment includes a data generating function 150d as a data generating unit, an information generating function 150e as an information generating unit, and a control function 150a as a control unit. For example, based on positioning imaging as first data acquired in the first imaging (for example, positioning imaging), the data generating function 150d generates second data (for example, high-dose equivalent projection data or high-dose equivalent reconstructed image data) corresponding to data obtained by imaging under imaging conditions different from those of the first imaging. Based on the quality of the second data, the information generating function 150e generates support information for supporting review of the second imaging, which is scheduled to be performed after the first imaging and has imaging conditions different from those of the first imaging. For example, the information generating function 150e executes an evaluation process using the high-dose equivalent projection data or the high-dose equivalent reconstructed image data, and generates support information for supporting review of a workflow including an imaging protocol based on the evaluation process. The control function 150a causes the support information to be displayed on the display 42 as a display unit before the second imaging is performed.
[0082] The evaluation process performs calculation of an evaluation value for evaluating the image quality of a high-dose equivalent image, detection of an abnormal portion using the high-dose equivalent image, calculation of a substitution level for the high-dose equivalent image, determination of the necessity of actual imaging based on the evaluation value, the detection result, and the substitution level, and determination of the suitability of the protocol for actual imaging, etc. In addition, as support information based on the evaluation process, evaluation information acquired by the evaluation process, a result of the necessity of actual imaging based on the evaluation information, a revision proposal for the protocol for actual imaging based on the evaluation information, an alternative proposal for the protocol for actual imaging based on the evaluation information, etc. are generated.
[0083] The user can determine whether the imaging protocol already set is appropriate or not by using the support information based on the objective index of the high-dose equivalent image. In addition, for example, if the high-dose equivalent image has sufficient image quality and is at a level where diagnosis is possible, the main high-dose imaging can be omitted. In addition, for example, if the high-dose equivalent image does not have sufficient image quality and is at a level where diagnosis is possible, high-dose imaging can be performed under more optimal conditions by readjusting parameters such as imaging conditions, reconstruction conditions, and imaging range based on the support information. Furthermore, if a lesion that was not anticipated at the start of the examination and could not be identified only from the low-dose image is found in the high-dose equivalent reconstructed image, it becomes possible to consider replacing or adding an imaging protocol.
[0084] Therefore, by using an objective index, a high-dose equivalent image generated from low-dose data (projection data or reconstructed image data actually acquired at a low dose in positioning imaging), it is possible to realize a method for comprehensively and simply determining whether or not to perform high-dose imaging, readjusting parameters, and replacing or adding imaging protocols, and to establish a technology for reviewing the workflow of image diagnosis. As a result, it is possible to reduce radiation exposure, shorten examination times, and ease the burden on patients.
[0085] (Variation 1) In the above embodiment, only when the user explicitly changes the imaging protocol after displaying the support information, the imaging control is performed according to the changed imaging protocol. In contrast, the processing circuit 150 may automatically skip the actual imaging based on the determination result included in the generated support information by the control function 150a.
[0086] (Variation 2) In the above embodiment, the high-dose equivalent image and the like are used as a criterion for determining whether or not the actual imaging should be performed, whether or not the imaging protocol is appropriate, and the like. In contrast to this, for example, the processing circuitry 150 may use the high-dose equivalent image and the like as a non-contrast image and the like for the subtraction processing by the reconstruction processing function 150c, to generate a high-dose equivalent subtraction image and the like. Also, for example, the processing circuitry 150 may use the high-dose equivalent image and the like as an image and the like corresponding to one energy in dual energy imaging by the reconstruction processing function 150c, to generate a high-dose equivalent dual energy image and the like.
[0087] (Variation 3) The application of the medical information processing device 100 described in the above embodiment is not limited to image diagnosis using an X-ray CT device 1, but can also be applied to image diagnosis using, for example, a PCT-CT system, an angio-CT system, or a magnetic resonance imaging device. For example, when the medical information processing device 100 according to the above embodiment is applied to a PCT-CT system or an angio-CT system, in the imaging process using an X-ray CT device, it is possible to determine whether or not to perform the actual imaging, the suitability of the imaging protocol, etc., based on objective indicators such as high-dose equivalent images.
[0088] Furthermore, for example, when the medical information processing device 100 according to the above embodiment is applied to a magnetic resonance imaging device, for example, a sensitivity map or a locator acquired in a prescan (pre-imaging) executed prior to the main imaging is used to generate data equivalent to the MR data or image data acquired by the main imaging (data equivalent to the main imaging) as a data corresponding to the high-dose equivalent image of the above embodiment. The generated data equivalent to the main imaging can be used as an objective index to achieve the same effect as the above embodiment.
[0089] (Variation 4) In the above embodiment, the high-dose equivalent image and the like are used as a criterion for determining whether or not to perform the main imaging, whether or not the imaging protocol is appropriate, etc. However, the high-dose equivalent data may be used as a criterion for setting the imaging conditions, etc., of the main imaging.
[0090] For example, in a lung cancer screening test, low-dose positioning imaging is performed to acquire low-dose data. The processing circuit 150 generates high-dose equivalent data from the acquired low-dose data using the data generation function 150d. The processing circuit 150 detects an abnormal area using the high-dose equivalent data using the information generation function 150e. When an abnormal area is detected using the information generation function 150e, the processing circuit 150 executes evaluation processing using the high-dose equivalent data, and generates support information including at least one of optimal imaging conditions, imaging range, and reconstruction conditions for the main imaging of the abnormal area based on the obtained evaluation result.
[0091] (Variation 5) In the above embodiment, the case where the X-ray CT apparatus 1 has the function of the medical information processing apparatus 100 has been exemplified. However, the medical information processing apparatus 100 capable of communicating with the X-ray CT apparatus 1 may be realized by a medical workstation, a personal computer, or the like. The medical information processing apparatus 100 according to such modified example 1 receives data acquired by the X-ray CT apparatus 1 in real time, for example, and executes the above-mentioned evaluation process and support information generation process using the data. The generated support information is displayed in real time on the display 42 or the monitor of the X-ray CT apparatus 1.
[0092] (Variation 6) In order to evaluate the quality of raw data, it is not necessary to directly evaluate the raw data. For example, it is possible to indirectly evaluate the raw data by evaluating the quality of image data reconstructed using the raw data. In addition, it is not necessary to directly evaluate the image data in order to evaluate the quality of the image data. For example, it is possible to indirectly evaluate the image data by evaluating the quality of the raw data on which the image data is based.
[0093] According to at least one of the embodiments described above, a technique for reviewing a workflow relating to image diagnosis using an objective index can be established.
[0094] In addition, although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope of the invention and its equivalents described in the claims, as well as in the scope and spirit of the invention. [Explanation of symbols]
[0095] 1 X-ray CT device 10 Mounting device 11 X-ray tube 12 X-ray detector 13 Rotating Frame 14 High voltage X-ray device 15 Control device 16 Wedge 17 Collimator 18 DAS (Data Acquisition System) 30 Sleeping device 31 Foundation 32 Bed drive unit 33 Tabletop 34 Support frame 40 Console device 41 Memory 42 Display 43 Input Interface 150 Processing circuit 150a Control Function 150b Pre-processing function 150c Reconstruction Processing Function 150d Data Generation Function 150e Information Generation Function
Claims
1. a data generating unit that generates, based on first data acquired in a first imaging, second data corresponding to data obtained by a second imaging that is scheduled to be performed after the first imaging and has imaging conditions different from those of the first imaging; an information generating unit that generates support information by executing an evaluation process for evaluating image quality of the second data; a control unit that causes a display unit to display the support information indicating image quality of the second data, the second data, and an image that sets an imaging range to be captured in the second imaging on the second data before the second imaging is performed; A medical information processing device comprising:
2. The control unit causes the display unit to display at least one button related to control of the second imaging in association with the support information. The medical information processing device according to claim 1 .
3. The information generating unit generates the support information including at least one of information regarding the necessity of performing the second imaging, information regarding the suitability of a protocol for the second imaging, information regarding a correction of the protocol for the second imaging, and information related to the image quality, using the second data. The medical information processing device according to claim 1 .
4. the first imaging is low-dose imaging using an X-ray computed tomography imaging apparatus; The second imaging is high-dose imaging using an X-ray computed tomography imaging apparatus. The medical image processing device according to claim 1 .
5. The first imaging is a preliminary imaging or a main imaging using a magnetic resonance imaging apparatus, The second imaging is a main imaging using a magnetic resonance imaging apparatus. The medical image processing device according to claim 1 .
6. A control unit that executes control related to the second imaging based on the support information, The medical image processing device according to claim 1 .
7. The imaging device further includes an image generating unit that generates at least one of a subtraction image and a dual energy image using the second data. The medical image processing device according to claim 1 .
8. The information generation unit generates the support information including at least one of an imaging condition, an imaging range, and an image reconstruction condition related to the second imaging based on the image quality. The medical image processing device according to claim 1 .
9. a data generating unit that generates, based on first data acquired in a first imaging, second data corresponding to data obtained by a second imaging that is scheduled to be performed after the first imaging and has imaging conditions different from those of the first imaging; an information generating unit that generates support information by executing an evaluation process for evaluating image quality of the second data; a control unit that causes a display unit to display the support information indicating image quality of the second data, the second data, and an image that sets an imaging range to be captured in the second imaging on the second data before the second imaging is performed; A medical imaging diagnostic device comprising:
10. generating, based on first data acquired in a first imaging, second data corresponding to data obtained by a second imaging to be performed after the first imaging and having imaging conditions different from those of the first imaging; generating support information by executing an evaluation process for evaluating image quality of the second data; displaying, on a display unit before execution of the second imaging, the support information indicating image quality of the second data, the second data, and an image on the second data that sets an imaging range to be captured in the second imaging; A medical information processing method comprising:
Citation Information
Patent Citations
X-ray computerized tomographic apparatus and image noise simulation apparatus
JP2004329661A
Radiation image processing device and method and program
JP2015089429A
Magnetic resonance imaging device
JP2017113058A
Medical data processor, magnetic resonance imaging device and learned model creation method
JP2019093126A
X-ray CT device and scan planning device
JP2019122553A
