System and method for imaging system shortcut mode

By combining the imaging system with an edge computing system, using deep learning technology to automatically determine the scanning protocol and generate decision support, the problems of complex operation and poor image quality of the imaging system are solved, and efficient image acquisition and report generation are achieved.

CN112004471BActive Publication Date: 2024-11-12GE PRECISION HEALTHCARE LLC
View PDF 12 Cites 0 Cited by

Patent Information

Application Number
CN201980023558.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2018-04-13
Filing Date
2019-04-12
Publication Date
2024-11-12
Estimated Expiration
2039-04-12

AI Technical Summary

Technical Problem

The existing imaging system is complex to operate, and users need to train radiation physicians and technicians to select and prepare the correct scanning protocol for each patient, and image analysis needs to be performed by the doctor, resulting in poor image quality and slow clinical reporting time.

Method used

By coupling the imaging system to an edge computing system (ECS), personalized scanning protocols are automatically determined using deep learning technology, scans are automatically performed, and decision support is generated, reducing operator input, improving image quality and reporting efficiency.

Benefits of technology

Implementation of imaging with minimal inputs performed by the operator, automated scanning protocol selection and image analysis, improving image quality and clinical reporting efficiency, and simplifying the imaging process.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112004471B_ABST
    Figure CN112004471B_ABST
Patent Text Reader

Abstract

The present invention provides methods and systems for a quick mode of an imaging system. In one embodiment, the method for an imaging system includes receiving an identification of a subject to be scanned, automatically determining a personalized scanning protocol for the subject, automatically performing a scan of the subject to acquire imaging data according to the personalized scanning protocol, and displaying images and decision support, the images and decision support automatically generated from the imaging data. In this way, imaging of a subject (such as a patient) can be performed with minimal input or intervention by an operator of the imaging system.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority to U.S. Provisional Application No. 62 / 657,632, entitled “SYSTEMS AND METHODS FOR AN IMAGING SYSTEM EXPRESS MODE” and filed on April 13, 2018. The entire contents of the above application are hereby incorporated by reference for all purposes. Technical Field

[0003] Embodiments of the subject matter disclosed herein relate to non-invasive diagnostic imaging, and more particularly to imaging a subject with minimal input or intervention by an operator. Background Art

[0004] Non-invasive imaging techniques allow images of the internal structures of a patient or object to be obtained without performing an invasive procedure on the patient or object. Specifically, techniques such as computed tomography (CT) use various physical principles (such as differential transmission of x-rays through a target volume) to acquire image data and construct a tomographic image (e.g., a three-dimensional representation of the interior of the human body or other imaged structure).

[0005] As imaging systems become more powerful and complex, users may find the operation of the imaging systems too complex. Radiologists and technicians must be trained to select and prepare the correct scan protocol for each patient, and each patient may also be positioned differently within the imaging system for a given protocol. If any part of the scan preparation is incorrect, the quality of the resulting image or images may be too poor for clinical use, so the scan must be performed again. In addition, image analysis must be performed by a radiologist / physician, so the turn-around time for clinical reporting can be slow. Summary of the invention

[0006] In one embodiment, a method for an imaging system includes receiving an identification of a subject to be scanned, automatically determining a personalized scanning protocol for the subject, automatically performing a scan of the subject to acquire imaging data according to the personalized scanning protocol, and displaying an image and decision support automatically generated from the imaging data. In this way, imaging of a subject (such as a patient) can be performed with minimal input or intervention by an operator of the imaging system.

[0007] It should be understood that the above brief description is provided to introduce in a simplified form selected concepts that are further described in the detailed description. It is not meant to identify key or essential features of the claimed subject matter, the scope of which is solely defined by the claims that follow the detailed description. Furthermore, the claimed subject matter is not limited to implementations that solve any disadvantages noted above or in any part of this disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] The present invention will be better understood by reading the following description of non-limiting embodiments with reference to the accompanying drawings, in which:

[0009] Figure 1 A block schematic diagram illustrating a simplified exemplary system for expanding the capabilities of an imaging system according to one embodiment;

[0010] Figure 2 A high-level flow chart illustrating an exemplary method for synchronizing an imaging system with an edge computing system according to one embodiment is shown;

[0011] Figure 3 A high-level flow chart illustrating an exemplary method for generating deep learning training data using an imaging system according to one embodiment is shown;

[0012] Figure 4 A high-level flow chart illustrating an exemplary method for an imaging system express mode according to one embodiment is shown;

[0013] Figure 5 A high-level flow chart illustrating an exemplary method for managing applications on an edge computing system according to one embodiment is shown;

[0014] Figure 6 shows a pictorial view of an imaging system according to one embodiment;

[0015] Figure 7 shows a block schematic diagram of an exemplary imaging system according to one embodiment;

[0016] Figure 8 A diagram showing a method for expanding the capabilities of an imaging system according to one embodiment. Figure 1 a block schematic diagram of an exemplary system in more detail; and

[0017] Fig. 9 A flow chart illustrating an exemplary method for generating decision support output for an imaging system using an edge computing system, according to one embodiment, is shown. DETAILED DESCRIPTION

[0018] The following description relates to various embodiments of diagnostic imaging. In particular, systems and methods are provided for imaging a subject with minimal input or intervention by an operator. The processing power of an imaging system can be expanded by coupling the imaging system to an ECS, such as Figure 1 As shown in . Imaging data acquired by the imaging system can be transmitted or streamed to the ECS during scanning. Methods for synchronizing the transmission of imaging data to the ECS, such as Figure 2 The method described in allows imaging data to be processed by a deep learning (DL) application while scanning, thereby reducing the amount of time to obtain decision support. The DL application can be trained using additional information related to the acquisition of the imaging data and information characterizing the scanned subject, such as Figure 3 When coupled with the ECS, the expanded processing capabilities of the imaging system allow the imaging system to operate in a "express mode" where scans are performed with minimal intervention by an operator of the imaging system or input by the operator, such as Figure 4 New and updated DL applications can be retrieved from a remote repository, such as Figure 5 This allows ECS to provide the latest DL capabilities compatible with imaging systems. Figure 6 and Figure 7 An example of a CT imaging system that can be used to acquire images processed according to the present techniques is provided in.

[0019] The ECS is connected to the imaging system / scanner. The ECS includes a CPU / GPU that runs one or more virtual machines (VMs) configured for different types of tasks. Data is streamed in real time from the scanner to the ECS, which processes the data (in image and / or projection space) and returns the results. In this way, the imaging system appears to have additional processing power because the post-processing performed by the ECS is output through the imaging system's user interface along with the reconstructed image.

[0020] Data is streamed to the ECS in sync with the state of the scanner. Data is only transmitted from the scanner to the ECS when the scanner is not in a critical state. When in interventional mode (e.g., when a physician is performing an intervention such as a contrast injection at the scanner), the scanner does not transmit data at all to avoid data corruption.

[0021] The ECS provides task-based decision support. Specific tasks input to the imaging system trigger secondary tasks that are input to and executed by the ECS. For example, a task may specify a specific scanning protocol and / or image reconstruction type to be performed by the scanner, while a secondary task may specify the application of relevant post-processing techniques to the acquired data. These post-processing techniques may include deep learning analysis of the acquired data. Fig. 9As depicted in the method of , the ECS may select an appropriate DL application based on secondary tasks, inspection type, and / or other information, and generate decision support using the selected DL application. Each instance of decision support generated at the ECS may be saved with associated data (e.g., the DL application used, the inspection type, the final / edited inspection report). After a threshold amount of decision support has been generated and saved on the ECS, one or more of the DL applications may be retrained with new data locally (e.g., DL applications stored on the ECS) and globally (e.g., updated model weights may be sent to a central server along with data from other locations to create an updated global model).

[0022] Figure 1 A block diagram of an exemplary system 100 for expanding the capabilities of an imaging system 101 utilizing an edge computing system (ECS) 110, according to one embodiment, is shown. The imaging system 101 may include any suitable non-invasive imaging system, including, but not limited to, computed tomography (CT) imaging systems, positron emission tomography (PET) imaging systems, single photon emission computed tomography (SPECT) imaging systems, magnetic resonance (MR) imaging systems, X-ray imaging systems, ultrasound systems, and combinations thereof (e.g., multi-modal imaging systems, such as PET / CT, PET / MR, or SPECT / CT imaging systems). Figure 6 and Figure 7 An exemplary imaging system is further described.

[0023] The imaging system 101 includes a processor 103 and a non-transitory memory 104. One or more of the methods described herein may be implemented as executable instructions in the non-transitory memory 104, which when executed by the processor 103 cause the processor 103 to perform various actions. Figures 2 to 4 Such methods are further described.

[0024] The imaging system 101 also includes a scanner 105 for scanning a subject (such as a patient) to acquire imaging data. Depending on the type of imaging system 101, the scanner 105 may include a number of components necessary to scan the subject. For example, if the imaging system 101 includes a CT imaging system, the scanner 105 may include a CT tube and a detector array, as well as various components for controlling the CT tube and the detector array, as described herein. Figure 6 and Figure 7 As another example, if the imaging system 101 includes an ultrasound imaging system, the scanner 105 may include an ultrasound transducer. Thus, the term "scanner" as used herein refers to a component of an imaging system that is used and controlled to perform a scan of a subject.

[0025] The type of imaging data acquired by the scanner 105 also depends on the type of imaging system 101. For example, if the imaging system 101 includes a CT imaging system, the imaging data acquired by the scanner 105 may include projection data. Similarly, if the imaging system 101 includes an ultrasound imaging system, the imaging data acquired by the scanner 105 may include analog echoes and / or digital echoes of ultrasound waves emitted by an ultrasound transducer into a subject's body.

[0026] In some examples, the imaging system 101 includes a protocol engine 106 for automatically selecting and adjusting a scanning protocol for scanning a subject. The scanning protocol selected by the protocol engine 106 specifies a variety of settings for controlling the scanner 105 during the scanning of the subject. As further discussed herein, the protocol engine 106 may select or determine a scanning protocol based on the indicated primary task. Although the protocol engine 106 is depicted as a component separate from the non-transitory memory 104, it should be understood that in some examples, the protocol engine 106 may include a software module stored in the non-transitory memory 104 as executable instructions that, when executed by the processor 103, cause the processor 103 to select and adjust the scanning protocol.

[0027] The imaging system 101 also includes a user interface 107 configured to receive input from an operator of the imaging system 101 and display information to the operator. To this end, the user interface 107 may include one or more of an input device (including but not limited to a keyboard, a mouse, a touch screen device, a microphone, etc.) and an output device (including but not limited to a display device, a printer, etc.).

[0028] In some examples, the imaging system 101 also includes a camera 108 that is used to help automatically position the subject within the imaging system. For example, the camera 108 can capture a real-time image of the subject within the imaging system, and the processor 103 determines the position of the subject within the imaging system based on the real-time image. The processor 103 can then control the table motor controller, for example, to adjust the position of the table against which the subject rests, so as to position at least one region of interest (ROI) of the subject within the imaging system. In addition, in some examples, the scanning range can be determined at least approximately based on the real-time image captured by the camera 108.

[0029] The system 100 also includes an ECS 110 that is communicatively coupled to the imaging system 101 via a wired or wireless connection. The ECS 110 includes a plurality of processors 113 that run one or more virtual machines (VMs) 114 configured for different types of tasks. The plurality of processors 113 include one or more graphics processing units (GPUs) and / or one or more central processing units (CPUs). The ECS 110 also includes a non-volatile memory 115 that stores executable instructions that can be executed by one or more of the plurality of processors 113. The non-volatile memory 115 may also include a deep learning (DL) model 116 that can be executed by the virtual machines 114 of the plurality of processors 113. Although in Figure 1 Only one DL model is depicted in FIG. 1 , but it should be understood that ECS 110 may include more than one DL model stored in non-transitory memory.

[0030] In some examples, the system 100 also includes one or more external databases 130 to which the imaging system 101 and the ECS 110 can be communicatively coupled via the network 120. As illustrative and non-limiting examples, the one or more external databases 130 may include one or more of a hospital information system (HIS), a radiology information system (RIS), a picture archiving and communication system (PACS), and an electronic medical record (EMR) system. The imaging system 101 and / or the ECS 110 may retrieve information such as subject metadata, which may include metadata describing or relating to a particular subject to be scanned (e.g., the patient's age, gender, height, and weight), which may be retrieved from the EMR for the subject. As further described herein, the imaging system 101 and / or the ECS 110 may use the subject metadata retrieved from the one or more external databases 130 to automatically determine a scan protocol, train a deep learning model, and the like.

[0031] In some examples, system 100 also includes a repository 140 that is communicatively coupled to one or more of imaging system 101 and ECS 110 via network 120. Repository 140 stores a plurality of applications 142 that can be utilized by one or more of imaging system 101 and ECS 110. To this end, imaging system 101 and / or ECS 110 can retrieve one or more of plurality of applications 142 from repository 140 via network 120. Alternatively, repository 140 can push one of plurality of applications 142 to one or more of imaging system 101 and ECS 110. Figure 5 A method for retrieving an application from repository 140 is further described.

[0032] Figure 2 A high-level flow chart illustrating an exemplary method 200 for synchronizing an imaging system with an edge computing system (ECS) according to one embodiment is shown. Specifically, the method 200 involves streaming imaging data acquired during a scan from an imaging system (such as imaging system 101) to an ECS (such as ECS 110) for processing the imaging data while scanning. Figure 1 The method 200 is described with reference to the systems and components depicted in and described below, but it should be understood that the method can be implemented with other systems and components without departing from the scope of the present disclosure. The method 200 can be implemented as executable instructions in the non-transitory memory 104 of the imaging system 101, which can be executed by the processor 103 of the imaging system 101.

[0033] Method 200 starts at 205. At 205, method 200 receives an indication of an initial task, which is also referred to herein as a primary task. The initial task includes a clinical task to be performed by the imaging system, and therefore typically specifies what type of scan should be performed by the imaging system. The initial task is typically a clinical action that must be completed during the pre-scan and scan of an imaging prescription. Some examples of tasks related to pre-scanning are patient setup, receiving and viewing data from EMR, CDSS, and HIS / RIS, and selecting a protocol for scanning. Some examples of tasks related to scanning are patient positioning, image acquisition, and image reconstruction. In one example, method 200 may receive an indication of an initial task, for example, via user interface 107 of imaging system 101. That is, an operator of imaging system 101 may select an initial task or otherwise indicate an initial task via user interface 107. In another example, method 200 may automatically identify the initial task, for example, by evaluating the EMR of the subject to be scanned.

[0034] For example, the initial task may include or be defined by the diagnostic goal of the imaging scan (e.g., the reason for referring the patient to the imaging scan). Exemplary diagnostic goals may include diagnosing the presence (or absence) of a cerebral hemorrhage, diagnosing the presence (or absence) of a liver lesion, determining the presence or extent of a spinal fracture, and performing organ segmentation to plan for radiation therapy. Each diagnostic goal may be directed to a specific anatomical structure or a group of anatomical structures, and may therefore specify the type of scan / examination to be performed. For example, the diagnosis of a cerebral hemorrhage may be directed to the brain and may therefore specify that a non-contrast head scan be performed, the diagnosis of a liver lesion may be directed to the liver and may therefore specify that an abdominal scan be performed, and specifically, may specify that a multiphase liver study with contrast be performed at different timings, the diagnosis of a spinal fracture may be directed to the neck and / or back and may therefore specify that a complete non-contrast scan of the spine be performed, and the organ segmentation may be directed to the entire abdominal region (or even the entire body) and may therefore specify that a non-contrast whole body scan be performed. Each different scan type may have an associated set of scan parameters that specify how the scanner is controlled during the scan. For example, for a computed tomography scan, each different scan type may specify the specific tube current (mA), tube voltage (kV), and gantry rotation speed of the CT scanner during the scan.

[0035] Continuing at 210, method 200 determines whether the initial task is associated with a secondary task. The initial task specifies how the imaging data can be acquired, while the secondary task specifies how the imaging data can be processed. As non-limiting examples, the secondary tasks may include automatic lesion detection, organ classification, segmentation, or any type of post-processing method that can be applied to the imaging data. Secondary tasks are typically clinical actions that must be completed during a post-scan of an imaging prescription. Some examples of tasks related to post-scans are post-processing of images by applying a post-processing application.

[0036] In some examples, a particular initial task may always specify one or more secondary tasks to be performed in conjunction with the initial task or the primary task. Additionally or alternatively, the initial task indication received at 205 may specify one or more secondary tasks. For example, the initial task may not specify secondary tasks, but the operator of the imaging system may select secondary tasks when indicating the initial task. As a non-limiting example, the initial task may specify a brain scan, and the secondary tasks may include lesion detection. Since lesion detection may not be necessary for every brain scan, for specific situations where lesions may be suspected, the operator of the imaging system may optionally select a secondary task including lesion detection for the initial task of the brain scan. Additionally or as an alternative to the operator manually selecting a secondary task, in some examples, method 200 may automatically determine secondary tasks based on the initial task and subject metadata (such as the subject's EMR).

[0037] If the initial task is not associated with a secondary task ("No"), the method 200 proceeds to 212. At 212, the method 200 performs a scan according to the initial task instructions. The method 200 may further reconstruct and output one or more images from the imaging data acquired during the scan. Since no secondary tasks are associated with the initial task, the imaging data acquired at 212 is not streamed to the ECS. The method 200 then ends.

[0038] However, referring again to 210, if the initial task is associated with a secondary task ("YES"), the method 200 continues to 215. At 215, the method 200 outputs the secondary task indication to the ECS 110. The ECS 110 performs post-processing of the imaging data based on the secondary task indication.

[0039] At 220, method 200 begins scanning the subject with scanner 105 to acquire imaging data according to the initial task instructions. For example, method 200 begins scanning the subject according to a scan protocol associated with the initial task. As a non-limiting example, the scan protocol can be selected by protocol engine 106.

[0040] During the scan starting at 220, the method 200 synchronizes the imaging system 101 to the ECS 110 based on the state of the scanner 105. To this end, at 225, the method 200 evaluates the state of the scanner 105. At 230, the method 200 determines whether the scanner 105 is in a critical state. The scanner 105 may be in a critical state when asynchronous external operations may negatively affect its ability to meet basic safety requirements. For example, when active data acquisition is being performed, such as when the X-ray source is turned on and image data is being stored to a disk or memory storage location, the scanner 105 may be in a critical state. If the imaging system is synchronized with the ECS during such a time (so that imaging data can be sent from the imaging system to the ECS), it may cause the scan to fail (e.g., due to data loss, delays, or other problems), and the patient will need to be rescanned, thereby exposing the patient to additional radiation doses. Primarily, a CT scanner is in a critical state when the X-ray source is turned on or during a rapid acquisition sequence. Another example of a critical state is when the system is performing an interventional procedure, where both scan data storage and image display operations are time sensitive and essential for safety.

[0041] If the scanner is in a critical state (“YES”), the method 200 proceeds to 232 , where the method 200 continues scanning. More specifically, the method 200 continues scanning the subject, but does not transmit the acquired imaging data to the ECS 110 .

[0042] However, referring again to 230, if the scanner is not in a critical state ("NO"), the method 200 continues to 233, where the method 200 transmits the acquired imaging data to the ECS 110 for post-processing. The ECS 110 processes the transmitted imaging data according to the secondary task.

[0043] From both 232 and 233, method 200 proceeds to 235. At 235, method 200 determines whether the scan is complete. If the scan is not complete ("No"), method 200 proceeds back to 237, where method 200 continues scanning. Method 200 proceeds to 225 to re-evaluate the scanner state. Thus, method 200 continuously evaluates the state of scanner 105 during scanning to determine whether scanner 105 is in a critical state, and streams or transmits imaging data acquired during scanning to ECS 110 only when scanner 105 is not in a critical state. In other words, unless scanner 105 is in a critical state, method 200 continuously streams imaging data to ECS 110 as it is acquired during scanning. In this way, ECS 110 can receive and process imaging data while scanning. In addition, when scanner 105 is operating in a critical state, imaging data is not corrupted by being transmitted during the critical state, and the operation of imaging system 101 is not disturbed.

[0044] Once method 200 determines at 235 that the scan is complete ("YES"), method 200 proceeds to 240. At 240, method 200 reconstructs one or more images from the acquired imaging data. As a non-limiting example, method 200 may reconstruct one or more images using any suitable iterative or analytical image reconstruction algorithm.

[0045] At 245, the method 200 receives decision support from the ECS 110. The decision support includes the results of one or more post-processing algorithms applied to the imaging data that was streamed to the ECS 110 during the scan at 233. For example, if the examination is a brain hemorrhage examination performing a head scan, the decision support output may include an indication of whether a hemorrhage was detected. If the examination is a liver lesion examination scanning the liver, the decision support output may include whether a lesion was detected, and if a lesion was detected, the decision support output may include an indication of the size, shape, location, etc. of the lesion.

[0046] At 250, the method 200 outputs the one or more images and the decision support. For example, the method 200 may output the one or more images and the decision support to a display device for display to an operator of the imaging system 101. Additionally or alternatively, for example, the method 200 may output the one or more images and the decision support to a mass storage device for later viewing, or to a picture archiving and communication system (PACS) for viewing at a remote workstation. The method 200 then ends.

[0047] Thus, a method for an imaging system includes performing a scan of a subject to acquire imaging data, transmitting the imaging data during the scan to a computing device that is communicatively coupled to the imaging system and positioned external to the imaging system, receiving a decision support output from the computing device, the decision support output computed by the computing device from the imaging data, and displaying an image reconstructed from the imaging data and the decision support output. In this manner, deep learning techniques can be used to provide decision support in parallel with the acquisition of the imaging data, thereby reducing the time required to make an informed diagnosis.

[0048] Automated analysis of clinical images using deep learning (DL) techniques can greatly simplify and improve clinical diagnoses made by physicians using such images. However, preparing datasets to train DL algorithms can be difficult and time consuming, as images and corresponding diagnoses must be manually collated and prepared for input into the algorithms. Furthermore, such training datasets are unnecessarily limited with respect to the amount of potentially available information associated with the scans and that can be exploited by the DL algorithms. Therefore, as discussed below with respect to Figure 3 As described, the imaging system 101 outputs data suitable for input to a DL algorithm (such as a DL application 116 in the ECS 110). The output data includes scan data, image data, patient's EMR data, scanner type (and other scanner metadata), scan protocol, decision support output, and any clinical diagnosis associated with the scan. To this end, the imaging system can retrieve data from a hospital information system (HIS) and / or a radiology department information system (RIS) and the EMR of a given patient (to obtain patient data as well as clinical results). The output data can be used by the DL algorithm to optimize / personalize scan protocols for different patients and image quality targets, improve decision support, and potentially automate clinical diagnosis.

[0049] Figure 3 A high-level flow chart illustrating an exemplary method 300 for generating deep learning training data using an imaging system according to one embodiment is shown. Specifically, the method 300 involves training a deep learning model using all information and analysis thereof that may be potentially relevant to the quality of a reconstructed image. Figure 1The method 300 is described with reference to the systems and components of the present invention, but it should be understood that the method can be implemented with other systems and components without departing from the scope of the present disclosure. The method 300 can be implemented as executable instructions in the non-transitory memory 104 of the imaging system 101 and executed by the processor 103 of the imaging system 101.

[0050] The method 300 starts at 305. At 305, the method 300 receives a selection of a scan protocol. The scan protocol may be manually selected, such as by an operator via the user interface 107, or may be automatically selected, such as via the protocol engine 106.

[0051] At 310, the method 300 retrieves subject metadata for the subject to be scanned from one or more external databases. The subject metadata may include at least a subset of information related to the subject, and thus may include, but is not limited to, demographic information and medical history. The method 300 may retrieve the subject metadata from one or more databases 130, including one or more of a HIS, RIS, and EMR database, for example, via the network 120.

[0052] At 315, the method 300 performs a scan of the subject to acquire imaging data according to a scan protocol. For example, the method 300 may control the scanner 105 to scan the subject, wherein the scan protocol selected at 305 specifies control parameters of the scanner 105. At 320, the method 300 reconstructs an image from the imaging data acquired during the scan at 315. The method 300 may reconstruct the image using any suitable image reconstruction algorithm depending on the modality of the imaging system.

[0053] At 325, method 300 transmits the image reconstructed at 320 and / or the imaging data acquired at 315 to ECS 110. ECS 110 processes the image and / or imaging data using one or more DL algorithms to generate a decision support output. Figure 3 315, but it should be understood that in some examples, method 300 may transmit imaging data during the scan at 315 so that ECS 110 processes the imaging data concurrently with the scan at 315, as described above with respect to Figure 2 discussed.

[0054] The ECS 110 processes the images and / or imaging data during or after the scan is completed to generate decision support outputs. At 330, the method 300 receives decision support outputs computed for the images and / or imaging data from the ECS 110 using a learning model (eg, a DL algorithm such as a neural network).

[0055] At 335, method 300 displays the image and the decision support output. Both the image and the decision support output may be displayed via, for example, a display device of imaging system 101. Depending on the type of decision support output, the decision support output may be displayed overlaid or alongside the image.

[0056] At 340, method 300 receives a result decision related to the displayed image and decision support output. The result decision includes, for example, a clinical diagnosis made by a physician or radiologist based on the displayed image and decision support output. Additionally or alternatively, the result decision may include a ground truth related to the decision support output. For example, if the decision support output includes a detection or classification of an object (such as a lesion) in the image, the ground truth for the decision support output may include an indication that the detection or classification is correct or incorrect.

[0057] At 345, the method 300 updates the training data set with the imaging data, images, scan protocols, subject metadata, decision support outputs, resulting decisions, and system metadata. Since the training data set may be located remotely from the imaging system 101, rather than in the non-transitory memory 104 of the imaging system, in some examples, updating the training data set may include aggregating the imaging data, images, scan protocols, subject metadata, decision support outputs, resulting decisions, and system metadata into a single case to be added to the training data set. The system metadata includes information characterizing the imaging system 101 itself, such as the model of the imaging system 101, the manufacturing date of the imaging system 101, etc.

[0058] At 350, method 300 transmits the updated training data set to ECS 110 for updating the learning model used to generate the decision support output received at 330. In this way, additional data that may affect the performance of the learning model, such as subject metadata, system metadata, scanning protocols, and clinical diagnoses made by physicians based on the reconstructed images and / or the decision support output, may be utilized to improve the performance of the learning model. Method 300 then ends.

[0059] Thus, a method for an imaging system includes performing a scan of a subject according to a scan protocol to acquire imaging data; displaying an image and decision support associated with the image, the image being reconstructed from the imaging data, and the decision support being calculated using a learning model and the imaging data; and updating a training data set for the learning model with the imaging data, the image, the scan protocol, subject metadata describing the subject, the decision support, resulting decisions related to the image and the decision support, and system metadata related to the imaging system.

[0060] As imaging systems become more powerful and complex, users may find the operation of the imaging systems too complex. Radiologists and technicians must be trained to select and prepare the correct scan protocol for each patient, and each patient may also be positioned differently within the imaging system for a given protocol. If any part of the scan preparation is incorrect, the quality of the resulting image or images may be too poor for clinical use, so the scan must be performed again. In addition, image analysis must be performed by the radiologist / physician, so the turn-around time for clinical reporting may be slow. As discussed below with respect to Figure 4 As further described, the imaging system 101 may therefore include a "quick mode" that utilizes the expanded processing power provided by the ECS 110 and more sophisticated DL applications 116 to automate as many parts of the imaging process as possible. Hospital information system, radiology department information system, and electronic medical record data are used by the protocol engine 106 to select and personalize a scan protocol for a given patient, which in some examples may be assisted by deep learning. The patient is automatically positioned based on the imaging protocol and with the assistance of the camera. The camera further enables determination of the correct scan range for the patient so that the scan protocol can be further adjusted and personalized for the patient. Scanning and post-processing / decision support are automatically performed by the imaging system 101 and the ECS 110. The DL application 116 executed by multiple processors 113 of the ECS 110 provides automatic processing of the acquired data and at least a draft assessment of the reconstructed image.

[0061] Figure 4 A high-level flow chart illustrating an exemplary method 400 for an imaging system quick mode according to one embodiment is shown. Specifically, the method 400 relates to controlling an imaging system to scan a subject with minimal operator intervention or input. Figure 1 The method 400 is described with reference to the systems and components of the present disclosure, but it should be understood that the method can be implemented with other systems and components without departing from the scope of the present disclosure. The method 400 can be implemented as executable instructions in the non-transitory memory 104 of the imaging system 101 and the non-transitory memory 115 of the ECS 110, and can be executed by the processor 103 of the imaging system 101 and the plurality of processors 113 of the ECS 110.

[0062] The method 400 starts at 405. At 405, the method 400 receives an indication of a shortcut mode for scanning. The method 400 may receive the indication of the shortcut mode for scanning, for example, via the user interface 107 of the imaging system 101. In some examples, the user interface 107 may include a dedicated button, switch, or another mechanism for indicating that the shortcut mode of the imaging system 101 is desired to be used.

[0063] At 410, method 400 receives an identification of a subject to be scanned. In some examples, method 400 may receive the identification of a subject to be scanned via user interface 107. For example, an operator of imaging system 101 may manually input the identification of a subject to be scanned. In other examples, method 400 may automatically identify a subject to be scanned. As an illustrative and non-limiting example, method 400 may obtain a facial image of a subject via camera 108, and may employ facial recognition techniques to identify the subject based on the image.

[0064] At 415, the method 400 retrieves the EMR of the subject identified at 410, for example, by accessing the EMR in the one or more databases 130 via the network 120. At 420, the method 400 determines an initial task or a primary task based on the EMR. As discussed above, the primary task may indicate the clinical context of the scan, and thus may indicate what type of scan should be performed. The method 400 may determine the primary task from the EMR, which may include a physician's prescription for a particular type of scan.

[0065] At 425, the method 400 determines a scan protocol for the primary task. For example, the method 400 may input the primary task into the protocol engine 106 of the imaging system 101 to determine the scan protocol. In other examples, the primary task may be associated with a specific scan protocol. In addition, the scan protocol may be determined or adjusted based on the subject. For example, the scan protocol may specify a greater or lesser radiation dose depending on the age and size of the subject.

[0066] At 430, the method 400 positions the subject within the imaging system. In some examples, the method 400 may determine the position of the subject on the movable table relative to the imaging system, for example, by processing real-time images of the subject captured by the camera 108. The method 400 may control a table motor controller to adjust the position of the table, and therefore the subject, so that the region of interest to be scanned is within an imaging region of the imaging system (e.g., positioned within a gantry between a radiation source and a radiation detector).

[0067] At 435, method 400 determines a scan range for the subject. Method 400 may determine a scan range for the subject based on the real-time image captured by camera 108. For example, different subjects have different sized bodies, so the scan range should be adjusted accordingly. Therefore, method 400 may evaluate the image captured by camera 108 to determine the size and proportions of the subject, and may then set an appropriate scan range for the ROI that will scan the subject. At 440, method 400 uses the scan range determined at 435 to adjust the scan protocol.

[0068] At 445, the method 400 performs a scan of the subject according to the adjusted scan protocol to acquire imaging data. For example, the method 400 controls the scanner 105 to scan the subject according to the adjusted scan protocol. At 450, the method 400 outputs the imaging data to the ECS 110. Figure 2 As discussed, in some examples, imaging data may be output to ECS 110 for processing during scanning. ECS 110 processes the imaging data using the learning model to generate a decision support output. At 455, method 400 receives the decision support output from ECS 110.

[0069] Continuing at 460, method 400 reconstructs an image from the imaging data acquired at 445. Method 400 may reconstruct an image from the imaging data using any suitable image reconstruction technique. Figure 4 Reconstruction of the image is depicted as occurring after the imaging data is output to the ECS 110, but it should be understood that in some examples, the reconstructed image may be transmitted to the ECS 110, and the decision support output received at 455 may be generated by the ECS 110 based on the reconstructed image rather than the raw imaging data. At 465, the method 400 outputs the image and the decision support output to one or more of a display device for display, a mass storage device for subsequent retrieval and viewing, and a PACS. The method 400 then ends.

[0070] Therefore, a method for an imaging system includes receiving an identification of a subject to be scanned, automatically determining a personalized scanning protocol for the subject, automatically performing a scan of the subject to acquire imaging data according to the personalized scanning protocol, and displaying images and decision support, the images and decision support automatically generated from the imaging data.

[0071] As mentioned above, post-processing techniques for imaging systems are regularly improved over time. However, once an imaging system is installed, it is difficult to update the imaging system to include improved algorithms and new features. Figure 5 As further discussed, the application repository enables remote deployment of software applications for the imaging system. Figure 1As discussed, the imaging system 101 and / or the ECS 110 may be coupled to an application repository 140 via the network 120. In some examples, the imaging system 101 or the ECS 110 may retrieve new or updated applications 142 from the application repository 140. Alternatively, the application repository 140 may push the applications 142 to the ECS 110 and / or the imaging system 101. Furthermore, as discussed below, certain applications may only be compatible with specific combinations of the imaging system 101 and the ECS 110. For example, different applications may be displayed / deployed to a newer, high-power imaging system coupled to a low-power ECS versus an outdated, low-power imaging system coupled to a high-power ECS.

[0072] Figure 5 A high-level flow chart illustrating an exemplary method 500 for managing applications on an edge computing system (ECS) according to one embodiment is shown. Specifically, the method 500 involves retrieving new or updated applications for processing images and / or imaging data from an external repository. Figure 1 The method 500 is described with reference to the systems and components of the present disclosure, but it should be understood that the method can be implemented with other systems and components without departing from the scope of the present disclosure. The method 500 can be implemented as executable instructions in the non-transitory memory 115 of the ECS 110 and can be executed by one or more of the multiple processors 113 of the ECS 110.

[0073] Method 500 begins at 505. At 505, method 500 transmits an access request to a repository, such as repository 140. The access request may include identifications of imaging system 101 and ECS 110. Repository 140 includes a plurality of applications that may or may not be compatible with one or more of imaging system 101 and ECS 110. Thus, repository 140 determines which of the plurality of applications are compatible with a given combination of imaging system 101 and ECS 110 based on the identifications of imaging system 101 and ECS 110.

[0074] At 510 , method 500 receives a list of compatible applications from repository 140 . The list of compatible applications may include a subset of the plurality of applications stored in repository 140 .

[0075] At 515, method 500 receives a selection of an application from the list of compatible applications. For example, an operator of imaging system 101 may view the list of compatible applications and select a desired application from the list via user interface 107. Thus, the selection may be transmitted from imaging system 101 to ECS 110. In other examples, ECS 110 may include its own user interface for enabling selection of an application and thus may receive the selection of an application via the user interface.

[0076] Additionally or alternatively, the selection of the application can be automatic. For example, if repository 140 includes an updated version of an application that is already installed on ECS 110, method 500 can automatically select the updated version of the application from the list of compatible applications.

[0077] At 520, method 500 retrieves the selected application from repository 140 and installs it locally in non-transitory memory 115. Figure 1 The DL applications 116 in the non-transitory memory 115 of the ECS 110 depicted in FIG. 1 may include applications retrieved from the repository 140 .

[0078] At 525, the method 500 generates a decision support calculation from the imaging data received by the imaging system 101 using the application. For example, if the application includes a segmentation application, the method 500 may segment an image reconstructed from the imaging data acquired using the imaging system 101, and the segmentation of the image includes the decision support calculation. At 530, the method 500 outputs the decision support calculation to the imaging system 101. The method 500 then ends.

[0079] Thus, a method for an ECS communicatively coupled to an imaging system and positioned external to the imaging system includes receiving a list of compatible deep learning applications from an application repository communicatively coupled to the ECS via a network, retrieving a deep learning application selected from the list from the application repository, receiving imaging data from the imaging system, processing the imaging data with the deep learning application to generate a decision support calculation, and outputting the decision support calculation to the imaging system.

[0080] Figure 6An exemplary CT system 600 configured to allow for rapid and iterative image reconstruction is shown. Specifically, the CT system 600 is configured to image a subject 612 (such as a patient, an inanimate object, one or more manufactured parts) and / or a foreign object (such as a dental implant, a stent, and / or a contrast agent present within the body). In one embodiment, the CT system 600 includes a gantry 602, which in turn may also include at least one X-ray radiation source 604, which is configured to project an X-ray radiation beam 606 for imaging the subject 612. Specifically, the X-ray radiation source 604 is configured to project the X-rays 606 toward a detector array 608 positioned on opposite sides of the gantry 602. Although Figure 6 Only a single X-ray radiation source 604 is depicted, but in certain embodiments, multiple radiation sources may be employed to project multiple X-rays 606 to acquire projection data corresponding to the subject 612 at different energy levels.

[0081] Although a CT system is described by way of example, it should be understood that the present techniques may also be useful when applied to images acquired using other imaging modalities, such as tomosynthesis, MRI, C-arm angiography, etc. The present discussion of the CT imaging modality is provided merely as an example of one suitable imaging modality.

[0082] In some embodiments, the CT system 600 is communicatively coupled to an edge computing system (ECS) 610 that is configured to process the projection data using DL techniques. For example, as discussed above, the CT system 600 may transmit the projection data to the ECS 610 as it is acquired, and then the ECS 610 processes the projection data to provide decision support together with images reconstructed from the projection data.

[0083] In some known CT imaging system configurations, a radiation source projects a fan beam that is collimated to lie in the XY plane of a Cartesian coordinate system and is often referred to as an "imaging plane". The radiation beam passes through a subject being imaged, such as a patient or subject 612. The beam impinges on a radiation detector array after being attenuated by the object. The intensity of the attenuated radiation beam received at the detector array depends on the attenuation of the radiation beam by the object. Each detector element of the array produces a separate electrical signal that is a measure of the attenuation of the beam at the detector location. Attenuation measurements from all detectors are collected individually to produce a transmission profile.

[0084] In some CT systems, a gantry is used to rotate the radiation source and detector array in the imaging plane and around the object to be imaged so that the angle at which the radiation beam intersects the object is constantly changing. A set of radiation attenuation measurements (i.e., projection data) from the detector array at one gantry angle is called a "view". A "scan" of an object includes a set of views made at different gantry angles or viewing angles during one rotation of the radiation source and detector. It is conceivable that the benefits of the methods described herein are attributed to medical imaging modalities other than CT, so as used herein, the term view is not limited to the use described above with respect to projection data from one gantry angle. The term "view" is used to mean a data acquisition whenever there are multiple data acquisitions from different angles (whether from CT, PET or SPECT acquisitions), and / or any other modality (including modalities yet to be developed) and their combination in fusion embodiments.

[0085] In an axial scan, the projection data is processed to reconstruct an image corresponding to a two-dimensional slice taken through the object. A method for reconstructing an image from a set of projection data is known in the art as the filtered back projection (FBP) technique. Transmission and emission tomography reconstruction techniques also include statistical iterative methods such as maximum likelihood expectation maximization (MLEM) and ordered subset expectation reconstruction techniques and iterative reconstruction techniques. The method converts the attenuation measurements from the scan into an integer called a "CT number" or "Hounsfield unit", which is used to control the brightness of the corresponding pixel on the display device.

[0086] To reduce the total scan time, a "helical" scan can be performed. To perform a helical scan, the patient is moved while data for a specified number of slices is acquired. Such systems generate a single spiral from a cone beam helical scan. The spiral marked by the cone beam produces projection data from which an image in each specified slice can be reconstructed.

[0087] As used herein, the phrase "reconstructing an image" is not intended to exclude embodiments of the present disclosure in which data representing an image is generated rather than a visible image. Thus, as used herein, the term "image" broadly refers to both a visible image and data representing a visible image. However, many embodiments generate (or are configured to generate) at least one visible image.

[0088] Additionally or alternatively, the CT system 600 may be communicatively coupled to a “cloud” network 620 by communicating with the ECS 610 .

[0089] Figure 7 Shows something like Figure 6 The imaging system 700 of the CT system 600 may include the imaging system 700 described above. Figure 1In one embodiment, the imaging system 700 includes a detector array 608 (see Figure 6 ). The detector array 608 also includes a plurality of detector elements 702 that together sense an X-ray beam 606 passing through a subject 704 (such as a patient) (see Figure 6 ) to collect corresponding projection data. Thus, in one embodiment, the detector array 608 is fabricated in a multi-slice configuration including multiple rows of cells or detector elements 702. In such a configuration, one or more additional rows of detector elements 702 are arranged in a parallel configuration for acquiring projection data.

[0090] In some embodiments, the imaging system 700 is configured to traverse different angular positions around the subject 704 to collect the desired projection data. Thus, the gantry 602 and the components mounted thereon can be configured to rotate about the rotation center 706 to acquire, for example, projection data at different energy levels. Alternatively, in embodiments where the projection angle relative to the subject 704 varies over time, the mounted components can be configured to move along a general arc rather than along a section of a circle.

[0091] As the X-ray radiation source 604 and the detector array 608 rotate, the detector array 608 collects data of the attenuated X-ray beam. The data collected by the detector array 608 undergoes pre-processing and calibration to adjust the data to represent the line integral of the attenuation coefficient of the scanned subject 704. The processed data is generally referred to as a projection.

[0092] In dual-energy or multi-energy imaging, two or more sets of projection data of the imaging object are typically obtained using an energy-resolving detector of the detector array 608 at different tube peak kilovolt voltage (kVp) levels (which changes the peak and spectrum of the energy of the incident photons comprising the emitted X-ray beam), or alternatively, at a single tube kVp level or spectrum.

[0093] The acquired projection data sets can be used for base material decomposition (BMD). During BMD, the measured projections are converted into a set of density line integral projections. The density line integral projections can be reconstructed to form a density map or density image (such as a map of bone, soft tissue and / or contrast agent) for each corresponding base material. The density maps or density images can then be associated to form a volume rendering of the base material (e.g., bone, soft tissue and / or contrast agent) in the imaging volume.

[0094] Once reconstructed, the base material image produced by the imaging system 700 reveals internal features of the subject 704 represented by the density of the two base materials. The density image can be displayed to show these features. In traditional methods of diagnosing medical conditions (such as disease states), and more generally medical events, a radiologist or physician will consider a hard copy or display of a density image to identify characteristic features of interest. Such features may include lesions, size, and shape of specific anatomical structures or organs, as well as other characteristic structures that will be discernible in the image based on the skill and knowledge of the individual physician.

[0095] In one embodiment, the imaging system 700 includes a control mechanism 608 to control movement of components, such as rotation of the gantry 602 and operation of the X-ray radiation source 604. In certain embodiments, the control mechanism 708 also includes an X-ray controller 710 configured to provide power and timing signals to the X-ray radiation source 604. Additionally, the control mechanism 708 includes a gantry motor controller 712 configured to control the rotation speed and / or position of the gantry 602 based on imaging requirements.

[0096] In certain embodiments, the control mechanism 708 also includes a data acquisition system (DAS) 714 that is configured to sample analog data received from the detector element 702 and convert the analog data into digital signals for subsequent processing. The data sampled and digitized by the DAS 714 is transmitted to a computer or computing device 716. In one example, the computing device 716 stores the data in a storage device 718 such as a mass storage device. For example, the mass storage device 718 may include a hard drive, a floppy disk drive, a compact disk-read / write (CD-R / W) drive, a digital versatile disk (DVD) drive, a flash drive, and / or a solid-state storage drive.

[0097] In addition, the computing device 716 provides commands and parameters to one or more of the DAS 714, the X-ray controller 710, and the gantry motor controller 712 for controlling system operations, such as data acquisition and / or processing. In certain embodiments, the computing device 716 controls system operations based on operator input. The computing device 716 receives operator input, such as commands and / or scan parameters, via an operator console 720 operably coupled to the computing device 716. The operator console 720 may include a keyboard (not shown) and / or a touch screen to allow an operator to specify commands and / or scan parameters.

[0098] Although Figure 7Only one operator console 720 is shown, but more than one operator console may be coupled to the imaging system 700, e.g., for inputting or outputting system parameters, requesting exams, and / or viewing images. Additionally, in certain embodiments, the imaging system 700 may be coupled to multiple displays, printers, workstations, and / or the like located locally or remotely, e.g., within an institution or hospital or at an entirely different location, via one or more configurable wired and / or wireless networks, such as the Internet and / or a virtual private network.

[0099] In one embodiment, for example, the imaging system 700 includes or is coupled to a picture archiving and communication system (PACS) 724. In an exemplary embodiment, the PACS 724 is further coupled to a remote system (such as a radiology department information system, a hospital information system) and / or to an internal or external network (not shown) to allow operators at different locations to supply commands and parameters and / or gain access to image data.

[0100] The computing device 716 uses operator-supplied and / or system-defined commands and parameters to operate a table motor controller 726, which in turn can control a table 728, which can include a motorized table. Specifically, the table motor controller 726 moves the table 728 for properly positioning the subject 704 in the gantry 602 to acquire projection data corresponding to a target volume of the subject 704.

[0101] As previously described, the DAS 714 samples and digitizes the projection data collected by the detector elements 702. Subsequently, the image reconstructor 730 uses the sampled and digitized X-ray data to perform high-speed reconstruction. Figure 7 The image reconstructor 730 is shown as a separate entity, but in certain embodiments, the image reconstructor 730 may form part of the computing device 716. Alternatively, the image reconstructor 730 may not be present in the imaging system 700, and instead the computing device 716 may perform one or more functions of the image reconstructor 730. In addition, the image reconstructor 730 may be located locally or remotely, and may be operably connected to the imaging system 700 using a wired or wireless network. In particular, one exemplary embodiment may use computing resources in a "cloud" network cluster for the image reconstructor 730.

[0102] In one embodiment, the image reconstructor 730 stores the reconstructed image in a storage device or mass storage device 718. Alternatively, the image reconstructor 730 transmits the reconstructed image to a computing device 716 to generate usable patient information for diagnosis and evaluation. In certain embodiments, the computing device 716 transmits the reconstructed image and / or patient information to a display 732 that is communicatively coupled to the computing device 716 and / or the image reconstructor 730.

[0103] Various methods and processes further described herein may be stored as executable instructions in a non-transitory memory on a computing device in the imaging system 700. For example, the image reconstructor 730 may include such executable instructions in a non-transitory memory and may apply the methods described herein to reconstruct an image from scan data. In another embodiment, the computing device 716 may include instructions in a non-transitory memory and may apply the methods described herein, at least in part, to reconstruct an image after receiving a reconstructed image from the image reconstructor 730. In yet another embodiment, the methods and processes described herein may be distributed throughout the image reconstructor 730 and the computing system 716.

[0104] In one embodiment, the display 732 allows the operator to evaluate the imaged anatomy. The display 732 may also allow the operator to select a volume of interest (VOI) and / or request patient information, such as via a graphical user interface (GUI), for subsequent scanning or processing.

[0105] Figure 8 A diagram illustrating a method for expanding the capabilities of an imaging system or other device 802 according to one embodiment. Figure 1 A block diagram of an exemplary system 800 in more detail. The system 800 may include multiple imaging systems 802, such as any suitable non-invasive imaging system, including but not limited to a computed tomography (CT) imaging system, a positron emission tomography (PET) imaging system, a magnetic resonance (MR) imaging system, an ultrasound system, and combinations thereof (e.g., a multi-modality imaging system, such as a PET / CT or PET / MR imaging system), or other devices 802, such as an advanced workstation (AW) for visualizing images, a PACS, and a mobile client device, such as a tablet, iPad, smart phone, iPhone, etc. The multiple imaging systems and other devices 802 may be communicatively coupled to an edge computing system 804 via a network. The multiple imaging systems and other devices 802 and the edge computing system 804 may be communicatively coupled to a cloud network 806. Communications between the multiple imaging systems and other devices 802, the ECS 804, and the cloud network 806 are secure.

[0106] The ECS 804 may also be referred to as an on-premises cloud and may include data 808 from various inputs and sources (including EMRs, HIS / RIS data, holistic data, etc.) that may be communicatively coupled to a DL interface 810 and DL training 812. The ECS 804 may also include at least one edge host 814 that may include at least one edge platform 816 and an application store 818 having a plurality of applications 820.

[0107] The cloud network 806 may include data 822 from various inputs and sources and DL training 824. Additionally or alternatively, the cloud network 806 may include an application store with multiple applications 826. The cloud network 806 may also include an artificial intelligence (AI) interface for generating learning models or other models that can be used in the system 800.

[0108] Data from the system 800 may be shared and / or stored between multiple imaging systems and other devices 802, the ECS 804, and the cloud network 806. Post-processing may be performed on the data sent to the ECS before sending to DICOM. Quantification and segmentation may be performed on the imaging system before sending to the PACS.

[0109] Certain examples provide core processing capabilities organized into units or modules that can be deployed in a variety of locations. Off-device processing can be used to provide micro-clouds, mini-clouds, and / or global clouds, etc. For example, micro-clouds provide one-to-one configuration with imaging device consoles, which are targeted at ultra-low latency processing (e.g., stroking, etc.) for customers who do not have cloud connectivity, etc. Mini-clouds are deployed on customer networks, etc., which are targeted at low latency processing for customers who, for example, prefer to keep their data in-house. Global clouds are deployed throughout customer organizations to enable high-performance computing and management of operationally superior information technology infrastructure.

[0110] In certain other examples, one or more off-device processing engines (e.g., acquisition engines, reconstruction engines, diagnostic engines, etc., and their associated deployed deep learning network devices, etc.) may be included in the system 800. For example, the purpose of the examination, electronic medical record information, heart rate and / or heart rate variability, blood pressure, weight, prone / supine, head-first or feet-first visual assessment, etc. may be used to determine one or more acquisition settings, such as default field of view (DFOV), center, spacing, orientation, contrast injection rate, contrast injection timing, voltage, current, etc., thereby providing a "one-click" imaging device. Similarly, for example, nuclear information, slice thickness, slice spacing, etc. may be used to determine one or more reconstruction parameters, including image quality feedback. Acquisition feedback, reconstruction feedback, etc. may be provided to the system design engine to provide real-time (or substantially real-time (taking into account processing and / or transmission delays)) health analysis for the imaging device, as represented by one or more digital models (e.g., deep learning models, machine models, digital twins, etc.). One or more digital models may be used to predict the component health status of the imaging device in real-time (or substantially real-time (taking into account processing and / or transmission delays).

[0111] Fig. 9 A flow chart illustrating a method 900 for generating decision support output using one or more deep learning (DL) applications is shown. Figure 1 The method 900 is described with reference to the systems and components of the present disclosure, but it should be understood that the method can be implemented with other systems and components without departing from the scope of the present disclosure. The method 900 can be implemented as executable instructions in the non-transitory memory 115 of the ECS 110 and can be executed by one or more of the multiple processors 113 of the ECS 110.

[0112] At 905, an examination type and secondary tasks for decision support output related to an imaging scan are received. As explained above, when performing an imaging scan to diagnose a patient condition, an operator of the scanner may input an initial task or a primary task (as described above with respect to Figure 2 ), or the initial / primary task may be obtained from the patient's EMR (as explained above with respect to Figure 4 The initial task / primary task may include an indication of the examination type and may include associated secondary tasks. The examination type may include the target anatomical structure to be scanned and certain features of the scan used to perform the examination (such as a brain hemorrhage examination, a liver lesion examination, etc.). The associated secondary tasks may indicate decision support that will be generated and output with the images obtained during the imaging scan. Decision support may include hemorrhage detection, lesion detection, organ segmentation, etc.

[0113] At 910, an application is selected to be executed in order to generate a decision support output. The selected application may be a deep learning application (DL application) that utilizes imaging information sent from the scanner (e.g., as described above with respect to Figure 2 The DL model then generates a decision support output using the DL model and the input imaging information. The DL application may be selected based on the secondary task and the examination type. For example, if the examination is a brain examination to be performed to detect the presence of hemorrhage, the Cerebral Hemorrhage DL Application may be selected. If the examination is a liver scan to be performed to detect the presence of lesions, the Liver Lesion DL Application may be selected. In some examples, the same DL application may be applied to more than one examination type. For example, a Lesion Detection DL Application may be selected for both a Liver Lesion Examination and a Kidney Lesion Detection. In other examples, a separate DL application may be selected for each different examination type / secondary task combination. In such examples, different DL applications may be selected for liver and kidney lesion detection examinations.

[0114] The appropriate DL application may be selected according to a suitable mechanism. In some embodiments, the ECS may store a lookup table in a memory that indexes the DL application according to the examination type and the secondary task. Other mechanisms for selecting DL applications are possible. For example, instead of the ECS selecting the appropriate DL application, the operator may select the desired DL application, and an indication of the selected DL application may be sent to the ECS along with the examination type and the secondary task. In some embodiments, the selection of a particular DL application may automatically trigger a sequence of other DL applications to be triggered for pre-processing or post-processing of data for the primary task. For example, selecting a DL application for liver lesion detection may trigger an anatomical structure localization DL application that may be executed to reduce the acquired image to an image that includes only the liver.

[0115] At 915, a request for additional input is optionally sent. The additional input may include subject and / or scanner metadata or other information that may be used by the selected DL application to generate a decision support output. Thus, the request for additional input may be sent to an EMR, PACS, or other database storing the additional input. For example, as described above with respect to Figure 3As described, in addition to the images / imaging data obtained during the imaging scan of the subject, the DL application may also utilize various information as input to the corresponding DL model, including but not limited to subject information (e.g., demographic data, medical history) and scanner information. Scanner information may include the type of scanner (such as CT scanner or ultrasound), imaging category / type (such as contrast imaging, non-contrast imaging, Doppler, B mode), scanner settings (such as tube current and tube voltage), etc. Additional inputs may also include the subject's laboratory test results, previous diagnostic imaging scan results, and complementary images from other imaging modalities. In some embodiments, the additional inputs requested and / or used by the selected DL application may be based on the examination type and secondary tasks. For example, the ECS may store a lookup table that stores additional inputs requested based on the examination type and secondary tasks. As a non-limiting example, if the examination type is a non-contrast head CT scan to be analyzed by the cerebral hemorrhage detection DL application, the requested additional inputs may include laboratory reports, neurophysiological examination reports, the type of X-ray tube kVp and / or CT scan used during the scan. As another non-limiting example, if the exam type is a multiphase liver study utilizing contrast agent administered at different timings to be analyzed by the liver lesion detection module, additional inputs may include the scan type and x-ray tube kVp used during the scan, contrast agent timing, volume of contrast agent injected, ejection fraction of the heart, and / or previous CT studies used for the patient.

[0116] At 920, an image and / or imaging data is received from a scanner. Figure 2 and Figure 3As explained, the scanner may send the reconstructed image and / or raw imaging data to the ECS during and / or after the imaging scan. At 925, a decision support output is generated using the selected DL application. In order to generate the decision support output, the selected DL application may input the received image / image data together with any additional information specified by the DL application as input into the DL model executed by the DL application. The DL model may then output decision support. As explained above, decision support may include organ segmentation, anatomical structure identification, indication of whether bleeding, lesions, fractures, etc. are detected, etc. At 930, the decision support output is sent to a requesting device, such as a scanner that sends imaging information, and / or other devices, such as PACS, care provider devices, or other suitable devices. As explained above, the decision support output may be displayed or otherwise presented with the reconstructed image from the imaging scan. The decision support output may support the diagnosis or determination of clinical findings via the reconstructed image. The decision support output and the reconstructed image may be analyzed by one or more clinicians (such as radiologists). One or more clinicians may accept or reject the decision support output. For example, if the decision support output includes an indication of a lesion on the subject's liver, the clinician may agree to the lesion detection and accept the output, or disagree that the identified lesion is actually a lesion and reject the output. In the example where the decision support output includes organ segmentation, the clinician may edit or update the outline defining the organ, where the outline is generated by the DL application. In addition, the clinician may generate a final report with detailed and (if indicated) edited findings (e.g., updated outline, rejected decision support, etc.). The final report may be saved in the subject's EMR.

[0117] At 935, a final report that may include edited results is received (e.g., from an EMR database). The final report may be analyzed by the ECS (e.g., by a training data aggregator module of the ECS) to identify the inspection type and DL application used to generate the decision support included in the report, which may be tagged / stored with the final report. At 940, the tagged report (e.g., the final report, including the edited results where appropriate, and tagged with the inspection type and DL application) is placed in a training, test, and / or validation data set. Each data set may be stored on the ECS. In addition, each data set may be specific to a DL application. For example, each DL application may have a specific training data set, a test data set, and a validation data set. Therefore, the tagged report may be placed in a data set based on the DL application that is used to generate the decision support listed in the report. In at least some embodiments, within a data set for a specific DL application, the tagged report may be randomly or semi-randomly assigned to one of the training, test, and / or validation data sets.

[0118] At 945, method 900 includes determining whether the training data set includes a threshold number of reports. The threshold number of reports may be a number sufficient to accurately reflect the functionality of the DL model executed by the DL application, such as 100 reports. Thus, if the training data set for a given DL application reaches 100 reports, the answer at 945 includes "yes", otherwise the answer at 945 includes "no". If the answer at 945 is "no", method 900 returns. If the answer is "yes", method 900 proceeds to 950 to retrain the DL application with new data in the data set. In this way, the DL model can be fine-tuned by retraining with new data. The updated weights may be deployed locally for site-tuned models. For example, a DL model executed by a DL application on an ECS may include weighted connections, decision trees, and the like, and the DL model may be retrained so that the weights are updated to better fit the new data. As more and more data is collected, the DL model may become more accurate. By retraining the DL model locally (e.g., on an ECS) rather than globally via a central device such as a cloud, site-specific preferences in deploying DL models may be maintained. For example, a particular medical facility may prefer an aggressive lesion detection method to ensure that false negative detections are reduced, while a different medical facility may prefer to reduce false positives by taking a less aggressive lesion detection method. Such preferences can be established and maintained by allowing local retraining of appropriate DL models. In addition, local retraining of DL models can be used to customize DL models for specific patient demographics in certain parts of the world. For example, if most of the patient populations in a hospital are obese, the DL model may need to be tuned for such patient demographic imaging features. However, at least in some examples, a subset or all of the data and / or updated weights may be sent to a central device (e.g., cloud) together with data from other sites to create an updated global model, as shown at 955. The data sent back to the cloud may include images and other specific data sets that can be used to train a specific model. The global model may also be sent back to a locally stored DL application model.

[0119] A technical effect of the present disclosure is to automatically scan a subject with minimal input or intervention by a human operator. Another technical effect of the present disclosure is to scan a patient according to a scan protocol automatically selected by evaluating the patient's EMR. Yet another technical effect of the present disclosure is to automatically create a clinical report of the diagnostic images. Another technical effect of the present disclosure is to automatically position the subject within the imaging system.

[0120] In one embodiment, a method for an imaging system includes receiving an identification of a subject to be scanned, automatically determining a personalized scanning protocol for the subject, automatically performing a scan of the subject to acquire imaging data according to the personalized scanning protocol, and displaying images and decision support, the images and decision support automatically generated from the imaging data.

[0121] In a first example of the method, automatically determining a personalized scan protocol for a subject includes: retrieving an electronic medical record (EMR) for the subject; determining a primary task for scanning based on the EMR; and selecting a scan protocol according to the primary task. In a second example of the method that optionally includes the first example, automatically determining a personalized scan protocol for a subject also includes: determining a scan range for the subject using a camera; and adjusting the selected scan protocol using the scan range to create a personalized scan protocol. In a third example of the method that optionally includes one or more of the first and second examples, the method also includes automatically positioning the subject within the imaging system based on a real-time image captured by the camera. In a fourth example of the method that optionally includes one or more of the first to third examples, the method also includes: transmitting imaging data to an edge computing system (ECS) that is communicatively coupled to the imaging system and positioned outside the imaging system; and receiving decision support generated by the ECS from the imaging data from the ECS. In a fifth example of the method that optionally includes one or more of the first to fourth examples, the method also includes transmitting a secondary task associated with the primary task to the ECS, wherein the ECS generates decision support according to the secondary task. In a sixth example of the method, which optionally includes one or more of the first to fifth examples, the ECS generates decision support by inputting imaging data into a deep learning model. In a seventh example of the method, which optionally includes one or more of the first to sixth examples, the decision support includes a clinical diagnosis. In an eighth example of the method, which optionally includes one or more of the first to seventh examples, receiving an identification of a subject to be scanned includes processing a real-time image of the subject captured by a camera using facial recognition technology to automatically identify the subject. In a ninth example of the method, which optionally includes one or more of the first to eighth examples, the method also includes reconstructing an image from the imaging data.

[0122] In another embodiment, a system includes: an imaging system, the imaging system including at least a scanner and a processor, the processor configured to reconstruct an image from data acquired during scanning of a subject via the scanner; and a computing device, the computing device communicatively coupled to the imaging system and positioned external to the imaging system, the computing device configured to generate decision support calculations based on the data, wherein the processor is configured with executable instructions that, when executed, cause the processor to: retrieve an electronic medical record (EMR) for the subject from a database via a network; determine a primary task based on the EMR; determine a scan protocol based on the primary task; position the subject within the imaging system; determine a scan range for the subject; adjust the scan protocol using the scan range; perform a scan to acquire data; and output an image reconstructed from the data and a decision support calculation generated based on the data.

[0123] In a first example of the system, the processor automatically executes executable instructions in response to receiving an indication to operate in a shortcut mode. In a second example of the system, which optionally includes the first example, the imaging system also includes a display device, wherein the processor is configured to display images and decision support calculations via the display device. In a third example of the system, which optionally includes one or more of the first and second examples, the imaging system also includes a camera configured to capture a real-time image of the subject within the imaging system. In a fourth example of the system, which optionally includes one or more of the first to third examples, the subject is automatically positioned within the imaging system based on the real-time image captured by the camera. In a fifth example of the system, which optionally includes one or more of the first to fourth examples, the scanning range is determined from the real-time image captured by the camera. In a sixth example of the system, which optionally includes one or more of the first to fifth examples, the subject is automatically identified based on the real-time image captured by the camera.

[0124] In another embodiment, an imaging system includes: an X-ray source that emits an X-ray beam toward a subject to be imaged; a detector that receives X-rays attenuated by the subject; a data acquisition system (DAS) that is operably connected to the detector, and a computing device that is operably connected to the DAS and is configured with executable instructions in a non-volatile memory that, when executed, cause the computing device to: retrieve an electronic medical record (EMR) for the subject from a database via a network; automatically determine a scan protocol based on the EMR; automatically position a region of interest (ROI) of the subject between the X-ray source and the detector; determine a scan range for the ROI; adjust the scan protocol using the scan range; control the X-ray source to perform the scan; receive projection data acquired during the scan via the DAS; and output an image reconstructed from the projection data and decision support calculations generated by the projection data.

[0125] In a first example of an imaging system, the computing device is further configured with executable instructions in a non-volatile memory that, when executed, cause the computing device to: transmit projection data to an edge computing system (ECS) that is communicatively coupled to the imaging system and positioned outside the imaging system; and receive from the ECS a decision support calculation generated by the ECS from the projection data using a deep learning model. In a second example of an imaging system that optionally includes the first example, the imaging system further includes a table motor controller configured to adjust a position of a table on which a subject is placed, wherein automatically positioning a ROI of the subject between an X-ray source and a detector includes commanding the table motor controller to adjust a position of the table so that the ROI is positioned between the X-ray source and the detector.

[0126] As used herein, the elements or steps listed in the singular and beginning with the word "one" or "a kind of" should be understood as not excluding a plurality of the elements or steps, unless such exclusion is explicitly stated. In addition, the reference to "an embodiment" of the present invention is not intended to be interpreted as excluding the existence of additional embodiments that also include the cited features. In addition, unless explicitly stated to the contrary, the embodiment of "including", "comprising" or "having" an element or multiple elements with a specific characteristic may include additional such elements without the characteristic. The terms "including" and "in..." are used as the concise language equivalents of the corresponding terms "including" and "wherein". In addition, the terms "first", "second" and "third" etc. are only used as marks, and are not intended to impose numerical requirements or specific positional order on their objects.

[0127] This written description uses examples to disclose the invention, including the best mode, and also to enable a person skilled in the relevant art to practice the invention, including making and using any devices or systems and performing any included methods. The patentable scope of the invention is defined by the claims, and may include other examples that occur to a person skilled in the art. Such other examples are intended to fall within the scope of the claims if they have structural elements that do not differ from the literal language of the claims, or if they include equivalent structural elements with insignificant differences from the literal language of the claims.

Claims

1. A method for an imaging system, comprising: receiving an identification of a subject to be scanned; automatically determining a personalized scanning protocol for the subject; automatically performing a scan of the subject to acquire imaging data according to the personalized scanning protocol; as well as displaying images and decision support, said images and said decision support automatically generated from said imaging data, Decision support includes results related to clinical diagnosis obtained by one or more post-processing algorithms applied to imaging data.

2. The method of claim 1, wherein automatically determining a personalized scanning protocol for the subject comprises: retrieving electronic medical records for the subject; determining a primary task for the scan based on the electronic medical record; as well as The scanning protocol is selected according to the main task.

3. The method of claim 2, wherein automatically determining a personalized scanning protocol for the subject further comprises: determining a scanning range for the subject using a camera; as well as The selected scan protocol is adjusted using the scan range to create the personalized scan protocol. 4 . The method of claim 3 , further comprising automatically positioning the subject within the imaging system based on real-time images captured by the camera.

5. The method according to claim 3, further comprising: transmitting the imaging data to an edge computing system communicatively coupled to the imaging system and positioned external to the imaging system; and receiving, from the edge computing system, the decision support generated by the edge computing system from the imaging data. 6 . The method of claim 5 , further comprising transmitting a secondary task associated with the primary task to the edge computing system, wherein the edge computing system generates the decision support based on the secondary task.

7. The method of claim 5, wherein the edge computing system generates the decision support by inputting the imaging data into a deep learning model.

8. The method of claim 7, wherein the decision support comprises a clinical diagnosis.

9. The method of claim 3, wherein receiving the identification of the subject to be scanned comprises processing a real-time image of the subject captured by the camera using facial recognition technology to automatically identify the subject.

10. The method of claim 1, further comprising reconstructing the image from the imaging data.

11. A system comprising: an imaging system comprising at least a scanner and a processor configured to reconstruct an image from data acquired during scanning of a subject via the scanner; as well as a computing device communicatively coupled to the imaging system and positioned external to the imaging system, the computing device configured to generate a decision support calculation based on the data; The processor is configured with executable instructions, which when executed cause the processor to: retrieving electronic medical records for the subject from a database via a network; determining a primary task based on the electronic medical record; determining a scanning protocol based on the primary task; positioning the subject within the imaging system; determining a scanning range for the subject; adjusting the scanning protocol using the scanning range; performing the scanning to acquire the data; as well as outputting the image reconstructed from the data and the decision support calculations generated based on the data, Decision support includes results related to clinical diagnosis obtained by one or more post-processing algorithms applied to imaging data.

12. The system of claim 11, wherein the processor automatically executes the executable instructions in response to receiving an indication to operate in an express mode.

13. The system of claim 11, wherein the imaging system further comprises a display device, wherein the processor is configured to display the image and the decision support calculation via the display device.

14. The system of claim 11, wherein the imaging system further comprises a camera configured to capture real-time images of the subject within the imaging system.

15. The system of claim 14, wherein the subject is automatically positioned within the imaging system based on the real-time image captured by the camera.

16. The system of claim 14, wherein the scanning range is determined from the real-time image captured by the camera.

17. The system of claim 14, wherein the subject is automatically identified based on the real-time image captured by the camera.

18. An imaging system comprising: An X-ray source that emits an X-ray beam toward a subject to be imaged; a detector that receives the X-rays attenuated by the subject; a data acquisition system operably connected to the detector; as well as A computing device operably connected to the data acquisition system and configured with executable instructions in a non-transitory memory that, when executed, cause the computing device to: retrieving electronic medical records for the subject from a database via a network; automatically determining a scanning protocol based on the electronic medical record; automatically positioning a region of interest of the subject between the X-ray source and the detector; determining a scan range for the area of ​​interest; adjusting the scanning protocol using the scanning range; controlling the X-ray source to perform the scan; receiving, via the data acquisition system, projection data acquired during the scan; as well as outputting images reconstructed from the projection data and decision support calculations generated from the projection data, Decision support includes results related to clinical diagnosis obtained by one or more post-processing algorithms applied to imaging data.

19. An imaging system according to claim 18, wherein the computing device is further configured with executable instructions in a non-volatile memory, which, when executed, cause the computing device to: transmit the projection data to an edge computing system, which is communicatively coupled to the imaging system and positioned outside the imaging system; and receive from the edge computing system the decision support calculation generated by the edge computing system from the projection data using a deep learning model.

20. The imaging system of claim 18, further comprising a table motor controller configured to adjust a position of a table on which the subject is placed, wherein automatically positioning the region of interest of the subject between the X-ray source and the detector comprises commanding the table motor controller to adjust the position of the table so that the region of interest is positioned between the X-ray source and the detector.

Citation Information

Patent Citations

  • Medical image diagnosis apparatus, and x-ray ct apparatus, and image processor

    CN101143099A

  • Interactive protocoling between a radiology information system and a diagnostic system / modality

    CN101589392A

  • Model-based differential diagnosis of dementia and interactive setting of level of significance

    CN101681515A

  • Scan parameter policy

    CN102576387A

  • Contrast agent perfusion adaptive imaging system

    CN102988071A