SYSTEM AND METHOD FOR DETERMINING RADIATION PARAMETERS - Patent application

By using 3D imaging to model the patient's chest and determine radiation parameters, the system addresses the limitations of current CT scanner protocols, enabling dose determination and image acquisition during normal breathing and various respiratory phases.

JP7661327B2Active Publication Date: 2025-04-14DATA INTEGRITY ADVISORS LLC
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2022529883
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2019-12-04
Filing Date
2019-12-06
Publication Date
2025-04-14
Estimated Expiration
2039-12-06

AI Technical Summary

Technical Problem

Current CT scanner protocols require patients to hold their breath to calibrate radiation doses, limiting the ability to acquire x-ray images in different respiratory phases, which can provide valuable information.

Method used

The system uses 3D imaging techniques to measure and model the patient's chest position, allowing for the determination of radiation parameters and dose delivery while the patient breathes normally, enabling imaging in various respiratory phases.

Benefits of technology

This approach allows for more accurate and efficient determination of radiation doses, reducing patient exposure to unnecessary radiation and enabling the capture of valuable respiratory phase information.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007661327000046
    Figure 0007661327000046
  • Figure 0007661327000047
    Figure 0007661327000047
  • Figure 0007661327000048
    Figure 0007661327000048
Patent Text Reader

Abstract

The method includes positioning a patient in a first orientation relative to a radiation source. The method further includes measuring one or more positions of the patient's chest using 3D imaging techniques. While measuring the one or more positions of the patient's chest using the 3D imaging techniques, the method further includes generating a model of the patient's chest using the one or more positions of the patient's chest, updating the model of the patient's chest as the patient breathes, and exposing the patient to a dose of radiation using the radiation source, the dose being based on the model of the patient's chest.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] Some embodiments of the present disclosure relate to radiation imaging and therapy, and more particularly to systems and methods for determining radiation parameters (eg, dose) from a radiation source (eg, an x-ray imaging device or a radiation therapy device). [Background technology]

[0002] A computed tomography (CT) scan uses a computerized combination of many X-ray measurements taken from different angles to generate cross-sectional (tomographic) images (virtual "slices") of specific areas of the scanned subject, allowing medical professionals to see inside the subject (e.g., a patient) without surgery. One important parameter of a CT scan is the dose (e.g., number of photons) delivered in each measurement. Typically, the dose from an X-ray tube is controlled by setting the amount of current passing through a thermionic filament. If the dose is too low, the photons in the subject being imaged will be too attenuated, resulting in a poor signal-to-noise ratio in the image. If the dose is too high, the patient will be exposed to an unreasonable amount of potentially harmful radiation.

[0003] Therefore, in many CT scanners, a set of scout images is taken to calibrate the dose. During the scout protocol, the CT scanner positions the rotating gantry in a vertical position (e.g., 0 degrees). The patient is asked to hold their breath, and the couch moves rapidly through the bore. The gantry is then parked in a lateral position (e.g., 90 degrees), the patient again holds their breath, and the couch again moves rapidly through the bore. During the imaging protocol, the gantry rotates while the couch passes through the bore. As the gantry rotates 360 degrees and moves to the next adjacent couch position, the x-ray tube current is changed (based on the information gained by the scout images). Summary of the Invention

[0004] One major drawback of the above-described recon protocol is that because the calibration images are acquired while the patient is holding his / her breath, the images acquired during the imaging protocol must also be acquired while the patient is holding his / her breath. However, as will be discussed in more detail throughout this disclosure, a wealth of information can be obtained from acquiring X-ray images at different breathing phases. Thus, there is a need for systems and methods for determining radiation parameters (e.g., dose) of an X-ray imaging device while the patient is breathing. In some cases, these same principles can be applied to radiation therapy.

[0005] To that end, embodiments of the present disclosure provide a method for determining radiation parameters, performed at a radiation source (e.g., an x-ray imager or a radiation therapy source). The method includes positioning a patient in a first orientation relative to the radiation source. The method further includes measuring one or more positions of the patient's chest using 3D imaging techniques. The method further includes generating a model of the patient's chest using the one or more positions of the patient's chest while measuring the one or more positions of the patient's chest using the 3D imaging techniques, updating the model of the patient's chest as the patient breathes, and exposing the patient to a dose of radiation using the radiation source, the dose being based on the model of the patient's chest.

[0006] Further, some embodiments provide a non-transitory computer readable storage medium storing instructions that, when executed by a system including one or more processors, cause the one or more processors to perform a set of operations. The set of operations includes positioning a patient in a first orientation relative to a radiation source. The set of operations further includes measuring one or more positions of the patient's chest using 3D imaging techniques. The set of operations further includes generating a model of the patient's chest using the one or more positions of the patient's chest while measuring the one or more positions of the patient's chest using the 3D imaging techniques, updating the model of the patient's chest as the patient breathes, and exposing the patient to a dose of radiation using the radiation source, the dose being based on the model of the patient's chest. [Brief description of the drawings]

[0007] In order to more clearly describe the embodiments of the present disclosure or the technical solutions in the prior art, the drawings necessary for describing the embodiments or the prior art are briefly described. The drawings below are only a part of the embodiments of the present disclosure. Those skilled in the art can derive other drawings from the structures shown in the drawings without exerting their creative abilities.

[0008] [Figure 1] FIG. 1 is a schematic block diagram of a GREX imaging system including a hardware box, acquisition software, and post-processing software, according to some embodiments of the present disclosure. [Diagram 2] 1 is a schematic flow chart of a GREX image acquisition process according to some embodiments of the present disclosure. [Diagram 3] FIG. 1 is a schematic block diagram illustrating a top view of a 3D spatial position localizer of a GREX imaging system, according to some embodiments of the present disclosure. [Figure 4] 1 shows an example of two breaths that share the same maximum inspiratory phase in time but have radically different tidal volumes, according to some embodiments of the present disclosure. [Diagram 5] 1 shows examples of tidal volume percentiles (bottom two subplots) for a patient breathing normally (top left subplot) as well as a patient breathing irregularly (top right subplot), according to some embodiments of the present disclosure. [Figure 6] 1 is a schematic flow chart of a synchronization process according to some embodiments of the present disclosure. [Figure 7] 1 illustrates synchronized cardiac electrocardiogram (ECG) and pulmonary respiratory signals according to some embodiments of the present disclosure. [Figure 8] 1 is a schematic flow chart of a drift and signal noise removal process, according to some embodiments of the present disclosure. [Figure 9] 1 shows a plot of tidal volume versus time for an exemplary breath, according to some embodiments of the present disclosure. [Figure 10] 10 shows a plot of airflow versus tidal volume for the same breath shown in FIG. 9 in accordance with some embodiments of the present disclosure. [Figure 11] 1 is a schematic flow chart of a respiratory phase prediction process according to some embodiments of the present disclosure. [Figure 12] 1 illustrates an example of a gating window in time chosen based on the location of T and P waves in an ECG signal such that cardiac-induced pulmonary motion changes slowly, according to some embodiments of the present disclosure. [Figure 13] 11 is a schematic flow chart of another GREX procedure that uses cardiac phase prediction instead of real-time identification of cardiac gating windows, in accordance with some embodiments of the present disclosure. [Figure 14] 1 shows examples of trigger images at early expiratory phase, late expiratory phase, maximum expiratory phase, early inspiratory phase, late inspiratory phase, and maximum inspiratory phase (from left to right), according to some embodiments of the present disclosure. [Figure 15] 1 is a schematic flow chart of an image capture trigger process according to some embodiments of the present disclosure. [Figure 16] FIG. 1 is a schematic block diagram of variables used in illustrating the GREX image reconstruction algorithm according to some embodiments of the present disclosure. [Figure 17] FIG. 1 is a schematic block diagram of operating components of a GREX imaging system during an imaging procedure according to some embodiments of the present disclosure. [Figure 18] 1A-B are examples of transverse X-ray projection images at tissue depths of 0° (A) and 90° (B), according to some embodiments of the present disclosure. [Figure 19] 1 is an example of depth resolution from a narrow projection angle range (1) and a wide projection angle range (2) according to some embodiments of the present disclosure. [Figure 20] 1A-1C are examples of β imaging angle positions relative to the three primary imaging planes (left) and the imaging isocenter of the GREX imaging system in a top view (right), according to some embodiments of the present disclosure. [Figure 21A-21B]FIG. 1 is an example block diagram illustrating how a GREX imaging system converts 2D X-ray projection images into a still image cube and ultimately into a movie image cube, according to some embodiments of the present disclosure. [Figure 22] 22 is an illustration of the still image cube creation process shown in FIG. 21 according to some embodiments of the present disclosure. [Figure 23] 1 is a schematic flow chart of an image filtering process according to some embodiments of the present disclosure. [Figure 24] 13 shows an example of a closed-loop lung tissue trajectory of a tissue piece located in the left lung close to the heart caused by heart-lung interaction, according to some embodiments of the present disclosure. [Diagram 25] 1 is a schematic flow chart illustrating the operation of components of a biomechanical model according to some embodiments of the present disclosure. [Figure 26A] 1 is an illustration of the motion trajectories of lung tissue elements during a respiratory cycle according to some embodiments of the present disclosure. [Figure 26B] 11 is an illustration of displacement vectors between different respiratory phases according to some embodiments of the present disclosure. [Figure 27] 1 is a schematic flowchart of a multi-resolution 3D optical flow algorithm according to some embodiments of the present disclosure. [Figure 28A] 1 is a schematic flow chart illustrating movie creation using biointerpolation, according to some embodiments of the present disclosure. [Figure 28B] FIG. 13 is a block diagram illustrating intermediate image cube creation using a biometric data matrix according to some embodiments of the present disclosure. [Figure 29] Examples of standard radiographs of a healthy individual and a patient with a stage 1b upper left lung tumor (arrow) are shown. [Diagram 30] 1 illustrates an example of a GREX parameter map showing a health status index of a healthy individual and a GREX parameter map showing a health status index of a patient, according to some embodiments of the present disclosure. [Fig. 31A-31B] 1 is a flow diagram of a method for imaging the lungs of a patient, according to some embodiments of the present disclosure. [Fig. 32A-32B]FIG. 1 is a flow diagram of a method for gating a radiation source according to some embodiments of the present disclosure. [Fig. 33A-33C] FIG. 1 is a flow diagram of a method for determining a biophysical model of a patient's lungs according to some embodiments of the present disclosure. [Fig. 34A-34C] FIG. 1 is a flow diagram of a method for generating a 3D X-ray image cube animation according to some embodiments of the present disclosure. [Diagram 35] 1 illustrates an example of a patient positioning fixture (PPF) for supporting a patient (eg, a swivel chair), according to some embodiments. [Diagram 36] 1 illustrates an example of a Biological Event Monitoring Process (BEMP) card, according to some embodiments. [Fig. 37A-37B] FIG. 1 is a flow diagram illustrating a method for determining a dose of radiation to which a patient is exposed, according to some embodiments. [Fig. 38A-38C] 1 illustrates a process for generating a model of a patient's chest, according to some embodiments. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] The embodiments of the present disclosure are described in detail below. The same or similar elements or elements having the same or similar functions are assigned the same reference numerals throughout the specification. The embodiments described in this specification with reference to the drawings are explanatory and exemplary, and are used to generally understand the present disclosure. The embodiments should not be construed as limiting the present disclosure.

[0010] In this specification, unless otherwise specified, relative terms such as "center," "longitudinal," "lateral," "front," "rear," "right," "left," "inside," "outside," "lower," "top," "horizontal," "vertical," "upper," "lower," "top," and derivatives thereof (e.g., "horizontal," "downward," "upward," etc.) should be construed to refer to the orientations described or illustrated in the associated drawings. These relative terms are for convenience of description and do not require that the present disclosure be constructed or operated in a particular orientation.

[0011] In the present invention, unless otherwise specified, the terms "attached," "connected," "coupled," "fixed," and the like are used broadly, which may refer to various forms that one skilled in the art would understand depending on the particular situation, such as a fixed connection, a detachable connection, an integral type, a mechanical or electrical connection, a direct connection, an indirect connection through an intervening structure, internal communication between two elements, and the like.

[0012] In the present invention, unless otherwise specified, a structure in which a first feature is "above" or "below" a second feature may include embodiments in which the first feature is in direct contact with the second feature, and may also include embodiments in which the first and second features are not in direct contact with each other, but are in contact through an additional element formed between the first and second features. Furthermore, a first feature that is "above," "above," or "on top" of a second feature may include embodiments that mean that the first feature is directly or diagonally "above," "above," or "top" of the second feature, or simply means that the first feature is higher in height than the second feature, while a first feature that is "below," "below," or "bottom" of a second feature may include embodiments that mean that the first feature is directly or diagonally "below," "below," or "bottom" of the second feature, or simply means that the first feature is lower in height than the second feature.

[0013] FIG. 1 is a schematic block diagram of a GREX imaging system 100 including a hardware box 102, acquisition software 104 (e.g., stored in non-transitory memory), and post-processing software 106 (e.g., stored in non-transitory memory) in accordance with some embodiments of the present disclosure.

[0014] The hardware box 102 includes three measurement sensors (e.g., a 3D spatial position localizer 300, a respiratory phase sensor 110, and a cardiac phase sensor 112) that independently collect the patient's biosignals as time series, which serve as input to the acquisition software 104. The acquisition software 104 processes and filters the biosignals time series measurements and generates an imaging trigger signal (e.g., a signal to activate the X-ray unit 108). The imaging trigger signal targets a specific respiratory phase, or optionally a cardiac phase of the patient. The respiratory phase and cardiac phase are each defined by the biosignals time series measurements. A connecting cable transmits the imaging trigger signal from the acquisition software 104 to the X-ray unit 108, which acquires radiographic images of the respiratory and cardiac phases at the targeted respiratory phases. Once a series of images of the targeted respiratory and cardiac phases that define a complete respiratory cycle have been acquired, they are input to the post-processing software 106. The post-processing software constructs a biomechanical model of lung motion from the images of the targeted respiratory and cardiac phases. The biomechanical model is then used by the post-processing software to generate other diagnostic results. Although X-ray images are used as an example in this application, those skilled in the art should understand that the methods disclosed herein can be applied to other medical images with little effort. For example, the biomechanical model construction process is not limited to X-ray images, but other medical images (e.g., CT scans and MRIs) can also be used.

[0015] FIG. 2 is a schematic flow chart of a GREX image acquisition process 200 (e.g., performed by the acquisition software 104 of FIG. 1) according to some embodiments of the present disclosure. Specifically, the acquisition software 104 synchronizes and processes the time series measurements from the hardware box 102 to remove potential signal drift and noise. The acquisition software 104 then implements a phase prediction algorithm to predict the respiratory and cardiac phases from the synchronized, drift-free, and noise-free time series input. Based on the respiratory and cardiac phase prediction results, the acquisition software 104 uses a logic algorithm 118 to search for a match with the target respiratory and cardiac phases. Matching with the target respiratory and cardiac phases is a condition that allows the generation of an imaging trigger and thus the X-ray unit 108 to acquire images. Once the GREX images are acquired, the post-processing software uses the GREX images to diagnose new lung diseases. Until recently, GREX images were not widely used by medical professionals. For example, the acquired GREX images are used to build a biomechanical model that defines the shape of the chest as a function of respiratory and cardiac phases, without any need for time parameters.

[0016] The GREX-based imaging system is described herein in three sections: Section 1 relates to an embodiment of the hardware box 102; Section 2 covers an embodiment of the acquisition software 104; and Section 3 is an embodiment of the post-processing software 106. Each section describes in more detail the components and functions that make up the hardware box 102, acquisition software 104, and post-processing software 106 shown in FIG. 1.

[0017] Section 1. Hardware Box 102 In some embodiments, the hardware box 102 serves at least two purposes: first, to collect biosignals that define the anatomical shape of the chest, and second, to communicate with a digital diagnostic X-ray unit (e.g., X-ray unit 108).

[0018] The biosignal inputs that define the thorax anatomical shape include thorax dimensions (measured by 3D spatial localizer 300, FIG. 3), respiratory phase (measured by respiratory phase sensor 110), and cardiac phase (measured by ECG monitor). In hardware box 102, the biosignals are sampled in real time at 100 Hz to create a time series curve for each signal input. The output of hardware box 102, i.e., the time series curve, is sent to the acquisition software.

[0019] FIG. 3 is a schematic block diagram illustrating a top view of a 3D spatial position localizer 300 of the GREX imaging system 100, according to some embodiments of the present disclosure.

[0020] Section 1.1. 3D Spatial Position Localizer 300 The 3D spatial position localizer 300 measures the patient's body movements caused by breathing and heartbeat in real time and outputs them as a time series in a coordinate space (e.g., Cartesian, polar, hyperspherical, etc.). As shown in FIG. 3, the 3D spatial position localizer 300 includes three separate 3D detectors (e.g., detectors 302a-302c) fixed to balanced circular tracts on the ceiling of a room. There are 120° angular increments that separate the three 3D detectors 302a of the system from each other. The patient is located between the X-ray unit 108 and the X-ray detector panel 304, and the patient is located at the center of the ceiling-mounted 3D spatial position localizer 300. The system measures the patient's chest expansion (e.g., rise and fall) in a predefined coordinate space. Each 3D detector 302 has an unobstructed view of the patient's torso as well as one of the X-ray unit 108 and detector panel 304. Note that in some embodiments, more than three 3D detectors 302 may be used, but in some embodiments, less than three 3D detectors 302 are used. In some embodiments, the detector is a camera (e.g., the 3D imaging technique uses photogrammetry and / or structured light). In some embodiments, the detector is a LIDAR detector (e.g., the 3D imaging technique uses time-of-flight).

[0021] Using the real-time depth map, each 3D detector 302 creates a surface rendering of the patient. The simultaneous information from all three 3D detectors 302 is combined to form a volumetric skin surface position measurement (e.g., using ray casting techniques) that changes in real time based on the patient's respiratory and cardiac phases. The 3D spatial position localizer 300 uses the volumetric skin surface position measurements in at least two ways: (i) to define the spatial boundaries of the patient; and (ii) to determine the tissue positions of the patient. Based on prior information such as skin thickness, rib thickness, muscle thickness, and skeletal positions from a formal medical internal radiation dose (MIRD) anatomical database, the 3D spatial position localizer 300 estimates the real-time spatial positions of the lungs within the patient. The 3D spatial position localizer 300 uses the MIRD data to calculate the spatial boundary conditions of the lungs. The spatial boundary conditions will be utilized later in the post-processing software 106. For example, the 3D spatial position localizer 300 estimates of the lung spatial boundary conditions create an initial chest shape that the post-processing software 106 uses to simulate the cumulative tissue density along rays generated by the x-ray unit 108 .

[0022] Section 1.2. Respiratory Phase Sensor 110 The respiratory phase sensor 110 of the hardware box 102 measures the main physiological indices related to breathing: tidal volume and its first time derivative (e.g., rate of change of tidal volume over time, or flow rate). There are two methods of measuring tidal volume: direct tidal volume measurement and indirect tidal volume measurement. Direct tidal volume measurement uses a mouth spirometer, which consists of a turbine in a tube that rotates at a speed proportional to the flow rate of the patient's inhalation or exhalation. Indirect tidal volume measurement uses an abdominal belt (or other geometric measurement of the patient's chest, described below) that measures the patient's abdominal circumference change during breathing (see FIG. 1). A larger abdominal circumference indicates inhalation and a smaller abdominal circumference indicates exhalation. An abdominal belt cannot directly measure tidal volume. To convert abdominal circumference change into a physiologically meaningful quantity, the hardware box 102 correlates the abdominal circumference change with the estimated lung volume determined by the 3D spatial position localizer 300. For example, chest expansion is proportional to abdominal expansion during breathing. The abdominal belt and 3D spatial localizer 300 measurements may also be used together to estimate lung air content.

[0023] Tidal volume, as used herein, refers to the difference between the current lung volume and a predefined baseline (e.g., maximal exhalation without extra effort, maximal inhalation without extra effort, or other baseline volume). Based on the ideal gas law, the density difference between room air and internal air causes the air in the lungs to expand 11% over the tidal volume. Conservation of mass dictates that the body expands 11% over the inhalation volume. Thus, the lung tidal volume can be calculated using external body measurements calibrated to the internal air volume. The 3D spatial position localizer 300 also knows the patient's volumetric expansion rate during breathing, providing a secondary validation of the accuracy of the air volume and tidal volume measurements. That is, the body's volumetric expansion rate is compared to air volume estimates of the trachea, lungs, and bronchi obtained from x-ray images.

[0024] Section 1.3. Heart Rate Phase Sensor 112 As shown in FIG. 1, cardiac phase is measured using either an electrocardiogram (ECG) monitor or a blood volume pressure device (e.g., cardiac phase sensor 112). For example, with an ECG monitor, a clinician places leads on the patient's arm and a ground lead on the left lower side of the patient's abdomen (away from the diaphragm and abdominal belt). The human heart produces periodic, stationary electrical signals with characteristics that correspond to the phase of the heartbeat. Stationary signals are stochastic processes whose joint probability distribution does not change over time. Blood volume pressure devices use a light source and a light sensor to measure the optical attenuation of the patient's finger. The volume of circulating blood pumped with each heartbeat changes the optical attenuation of the finger. The optical attenuation is directly proportional to the cardiac phase.

[0025] Typically, a digital diagnostic x-ray unit (e.g., x-ray unit 108) is actuated by an analog plunger that attaches to a plug port. The plug port is uniquely configured to accept a plunger having a particular pin configuration. Each pin configuration includes an "acquisition pin" that receives a voltage signal that activates (e.g., gates) the x-ray unit. When a user presses the plunger, it sends a voltage pulse to the digital diagnostic x-ray unit. The digital diagnostic x-ray unit activates an imaging beam that penetrates the patient's body.

[0026] As shown in FIG. 1, the hardware box 102 sends the same voltage pulse (e.g., gate signal) from the acquisition software to the digital diagnostic x-ray unit 108 using a connecting cable. When the voltage pulse signal exceeds a predefined voltage threshold, it activates the digital diagnostic x-ray beam (e.g., gates the x-ray beam), and when the voltage pulse signal at the pin is below the predefined voltage threshold, the x-ray unit 108 is turned off. In some embodiments, the hardware box 102 generates a square wave signal with a pulse height greater than the predefined voltage threshold and maintains the pulse height during the image exposure. That is, it generates a square pulse of Y voltage lasting X seconds so that the x-ray unit 108 can take an x-ray image of the patient. A threshold voltage less than Y will not trigger the scanner, so the value of Y must be greater than the predefined voltage threshold to start x-ray imaging. The pulse duration X refers to the exposure time of the image, which starts from the moment the voltage Y exceeds the predefined voltage threshold and ends when the voltage falls below the predefined voltage threshold. When the voltage falls below the predefined voltage threshold, the x-ray unit 108 is turned off. The pulse duration is defined by the manufacturer's specifications, but is typically on the order of a few milliseconds.

[0027] Section 2. Acquisition Software 104 The acquisition software 104 collects the spatial, cardiac and pulmonary time series measured by the hardware box 102 and determines when to trigger the X-ray unit 108 to acquire X-ray images at specific respiratory and cardiac phases. The acquisition software 104 accurately overlays (e.g., synchronizes) the measured cardiac and pulmonary phases, processes (e.g., filters) the collected biological time series, figures out the appropriate imaging time, and generates an electronic trigger signal for the digital diagnostic X-ray unit 108. The electronic trigger signal (e.g., gate signal) activates the X-ray unit 108 to acquire a snapshot image of the chest geometry. It records the spatial, cardiac and pulmonary values ​​associated with the snapshot, defining the surface geometry of the chest at the time the image was taken. The process is fully automated and does not depend on user input. As shown in Figures 1 and 2, the process implemented by the acquisition software 104 includes four subcomponents: Section 2.1 (synchronization module 114), Section 2.2 (signal processing module 116), Section 2.3 (logic algorithm 118), and Section 2.4 (trigger generation module 120).

[0028] Section 2.1. Synchronization Module 114 The inputs to the synchronization module 114 include the signals of the 3D spatial position localizer 300, the respiratory phase sensor 110, and the cardiac phase sensor 112. The synchronization module 114 synchronizes these inputs with the clock of the X-ray unit 108. The physiological bio-signals are collected asynchronously and require subsequent synchronization. The reason for the asynchronous nature is that the respiratory cycle is slower than the cardiac cycle and is completely independent of the cardiac cycle. As mentioned above, the respiratory cycle and the cardiac cycle are measured separately by different sensors. The synchronization module 114 is configured to synchronize the respiratory phase sensor and the cardiac phase sensor with the acquired image. When an image is taken, the image shows the anatomical shape of the chest at a certain point in time, which is recorded by the intrinsic timing system of the X-ray unit 108 and is not necessarily synchronized with the bio-time series of the respiratory and cardiac sensors.

[0029] Time alone cannot distinguish between periods of irregular breathing and periods of normal breathing. In other words, if time were the only dimension defining a respiratory phase, images taken during normal breathing and images taken during abnormal breathing (such as coughing) would be computationally indistinguishable. FIG. 4 is an example of two breaths 400 (e.g., 400a and 400b) that share the same maximum inspiratory phase in time, but have radically different tidal volumes, according to some disclosed embodiments. When overlaid, it can be seen that the two breaths 400 are in fact different, despite their similar maximum inspiratory phase, because the tidal volumes are different in size. In some embodiments, the tidal volume refers to a measured volume value (e.g., in ml) relative to a reference volume value. For example, the reference volume value corresponds to the minimum volume value (e.g., maximum expiratory phase) of the lungs during normal breathing (e.g., when no extra effort is required to exhale and no forcing) of the patient. In some embodiments, the reference volume value is different for each patient. In some embodiments, the reference volume value is zero. In some embodiments, the tidal volume is measured at a point in time. The change in tidal volume over time is shown in Figure 4.

[0030] To overcome the time dimension problem, the GREX imaging system 100 defines the respiratory phases by physiological values ​​obtained from various physiological sensors in the hardware box 102, which is a more useful respiratory phase dimension than time. The function of the synchronization module 114 is mainly to ensure a seamless transition between the X-ray unit 108 and the GREX imaging system 100. In some embodiments, the acquisition software 104 uses a 30 second training window (described in detail in section 2.2 below) to calculate the tidal volume percentiles from the tidal volume time series observations collected during the training window. The acquisition software 104 defines the respiratory phases using the tidal volume percentiles rather than the peak-to-peak periods of the periodic cosine waves. The acquisition software 104 tidal volume percentiles are much more useful for defining the lung shape than the peak-to-peak periods of the periodic cosine waves, due to the variation of tidal volume from breath to breath.

[0031] FIG. 5 is an example of tidal volume percentiles (bottom two subplots) for a patient breathing normally (top left subplot) and for a patient breathing irregularly (top right subplot) according to some embodiments of the present disclosure. For quantitative evaluation of the tidal volume histogram of irregular breathing, the ratio of the tidal volume during normal inspiration to the tidal volume during abnormal inspiration is used as an index of the respiratory phase. The ratio has a threshold value that defines the probability of irregular breathing of the patient. As shown in the bottom two subplots of FIG. 5, vertical lines indicate the location of the 85th, 90th, 95th, and 98th percentile tidal volumes in the tidal volume histogram. During normal breathing (bottom left subplot of FIG. 5), the percentile values ​​of normal tidal volume (85 and 90) are closer to the percentile values ​​of abnormal tidal volume (95 and 98) than during irregular breathing (bottom right subplot of FIG. 5).

[0032] FIG. 6 is a schematic flow chart illustrating a synchronization process 600 between various sensors of the hardware box 102 and the diagnostic X-ray unit 108 according to some embodiments of the present disclosure. The hardware box 102 continuously collects respiratory phases defined by tidal volume percentiles, cardiac phases defined by ECG, and chest geometry in coordinates defined by the 3D spatial position localizer 300. The sensor signals on which these measurements are based must first be synchronized with each other before being synchronized with the X-ray unit 108. This is achieved by compensating for differences in the measurement channels of the various sensors and differences in electrical resistivity of the cables by matching trace lengths using impedance matching of the digital-to-analog converters. Since the clock (e.g., timing system) of the X-ray unit 108 is typically not synchronized with the clock of the hardware box 102, a connecting cable is configured to connect to a data acquisition board and interface the board with the clock of the X-ray unit 108. The clock of the X-ray unit 108 passes through a distribution buffer and is trace matched for each channel of the analog-to-digital converter. The converted digital signals are sent to a field programmable gate array where all signals are synchronized. Once the acquisition software 104 has properly synchronized the respiratory and cardiac phase sensor signals, the result will be similar to the example shown in FIG.

[0033] To avoid unnecessary radiation exposure to the patient, the acquisition software 104 will not send a trigger signal to activate the X-ray unit 108 via the connecting cable unless the components of the GREX imaging system 100 are properly synchronized. In some embodiments, a 30-second training window is used to verify the synchronization of the clocks of the hardware box 102 and the X-ray unit 108. Thus, the 30-second training window must include 30 seconds worth of samples. If the clocks of all the sensors of the hardware box 102 and the X-ray unit 108 do not show exactly 30 seconds worth of samples, they are not synchronized. If the above verification procedure reveals a discrepancy, the synchronization system will be restarted to correct the discrepancy. However, the 30-second training window is merely an example, and one skilled in the art will understand that the length of the training window is not critical as long as there is enough data to perform the synchronization process.

[0034] Section 2.2. Signal Processing Module 116 After the spatial location, respiratory period, and cardiac phase signals are synchronized, the acquisition software 104 processes the sensor signals to remove noise and finally estimate the patient's tidal volume with high accuracy. The noise present in the lung and heart measurement time series is due to the sensor electronics, electrodes, and background electrical signals. A series of filters to ensure temporal accuracy removes noise from the lung and heart measurement time series. The biological time series filtered by the series of filters can maintain temporal accuracy.

[0035] In some embodiments, two separate filters (e.g., wavelet filters) are used to remove signal drift and noise from the biological time series. Signal drift distorts measurements over time, such that measurements at the beginning of data collection do not match measurements at the end of data collection. Signal noise is not physiological in nature and can be a serious problem when calculating patient airflow from tidal volume measurements. FIG. 8 is a schematic flow chart of a drift and signal noise removal process 800 according to some embodiments of the present disclosure.

[0036] The acquisition software 104 requires a smooth tidal volume time series to calculate the first time derivative of tidal volume, e.g., airflow. If the tidal volume time series is not smooth, the first time derivative of tidal volume cannot generate a smooth curve. The curve will contain discontinuities that violate the biophysical reality of breathing. FIG. 9 is a plot of tidal volume versus time for an example breath, according to some embodiments of the present disclosure. FIG. 10 is a plot of airflow versus tidal volume for the same breath shown in FIG. 9, a continuous closed loop used by the post-processing software 106 for biomechanical modeling (see Section 3.1), according to some embodiments of the present disclosure.

[0037] The acquisition software 104 uses the filtered, time-accurate time series curve to perform two different functions. The first function of the acquisition software 104 is to generate respiratory phase predictions using a short prediction horizon. FIG. 11 is a schematic flow chart of a respiratory phase prediction process 1100 according to some embodiments of the present disclosure. The short prediction horizon is the "look ahead" of the prediction algorithm. The prediction algorithm predicts the future moment when the desired tidal volume and airflow (e.g., respiratory phase) will occur. The "desired" respiratory phase is the target that can trigger the diagnostic x-ray unit 108 to obtain the desired chest shape.

[0038] The short prediction horizon mitigates further sources of inaccuracy in respiratory prediction, such as breath-to-breath variations in respiratory amplitude and duration. As the prediction horizon limits approach zero, lung shape change also approaches zero (e.g., the lung shape becomes substantially constant). In other words, the lung shape is unlikely to change dramatically during the short prediction horizon. Thus, a short prediction horizon mitigates the impact of human respiratory variability on the prediction accuracy of the respiratory motion model.

[0039] The time-accurate filtered tidal volume time series serves as the input for the respiratory prediction algorithm. The respiratory prediction algorithm allows for fast, real-time, and accurate prediction of respiratory phases. For example, the respiratory prediction algorithm is based on an autoregressive integrated moving average (ARIMA) model. The ARIMA model does not assume that the input values ​​are stationary and is composed of polynomials, making it suitable for respiratory prediction. The polynomial coefficients of the ARIMA model are estimated during a 30-second training window starting at the beginning of the imaging exam. The number of polynomial coefficients of the ARIMA model, i.e., the order of the model, is verified by nonlinear optimization to minimize an information criterion search function to reduce or eliminate overfitting. If the order of the model is optimal for the collected training data, a tidal volume histogram (see section 2.1) is created and a probability density function is calculated using the log-likelihood objective function. As explained in section 2.1, the distribution of tidal volumes is intended to capture irregular breathing. If irregular breathing is detected, the training data is discarded and reacquired. If irregular breathing is not detected, the ARIMA model coefficients are estimated by maximum likelihood using the training data and the probability density function. The 30-second training window also serves as a pre-imaging device validation. Figure 11 shows the flow chart of the respiratory phase prediction process.

[0040] The second function of the acquisition software 104 is to identify the heartbeat phase so that the heart is in phase at each desired chest shape. The duration of the prediction range serves as an important parameter in the acquisition software 104's efforts to accurately predict human respiration since human respiration is a quasi-random function (each breath has its own profile). In some embodiments, the duration of the prediction range is longer than the sum of the latency of the digital diagnostic x-ray unit 108 and the exposure time of the x-ray imaging. The sum of the latency of the digital diagnostic x-ray unit 108 and the exposure time of the x-ray imaging is very short, on the order of 10 milliseconds. As a result, the prediction period is also short (on the order of 1-2 sensor measurement samples at an operating frequency of 100-1000 Hz).

[0041] When the acquisition software 104 looks for coincidences between cardiac and respiratory phases, it is unlikely that the phases represented by a single point in each time series will line up. As a result, imaging methods that look for single point coincidences take longer to complete because the acquisition software 104 must wait to find a highly unlikely match. However, the cardiac gating window expands the size of the coincidence window, so imaging takes less time.

[0042] To further reduce the computation time of the signal processing software, the signal processing software does not predict the cardiac phase. Instead, the signal processing software targets a specific gating window where the heart does not cause rapid displacement of the lungs. FIG. 12 is an example of an in-time gating window chosen based on the position of the T and P waves of an ECG signal such that the cardiac-induced lung motion changes slowly, according to some embodiments of the present disclosure. The dotted line indicates the lung motion due to the cardiac beat. The lung motion change rate (e.g., velocity) is represented by the slope of the dotted line. If the slope of the dotted line is small, the change rate is small and the corresponding cardiac phase is the ideal gating window. FIG. 12 shows that the gating window occurs (consistently) between the T and P waves and is more skewed toward the P waves. The cardiac-induced lung motion occurs minimally in the gating window.

[0043] The above describes a method to identify an ideal cardiac gating window that minimizes the physical impact of the heart on the lungs while maintaining a window in which the target respiratory phase can coincide with the desired cardiac phase. In some embodiments, the GREX imaging system 100 predicts the cardiac phase instead of gating it based on signal processing differences that distinguish the cardiac phase from the respiratory phase (e.g., the cardiac phase is periodic and stable). Because the cardiac phase is periodic and stable, an unsupervised multi-layer perceptron with backpropagation can predict the next heartbeat based on pattern extraction instead of a time series prediction process.

[0044] 13 is a schematic flow diagram of another GREX process 1300 using cardiac phase prediction instead of real-time identification of cardiac gate window, according to some embodiments of the present disclosure. In this case, 20 seconds (heart rates 20-22) of the training window are used to train the algorithm, and the remaining 10 seconds (heart rates 10-11) are used to validate the multi-layer perceptron node weights. The node weights are determined iteratively by gradient descent optimization until the model error on the training set is minimized. The trained model is applied to 10 seconds of validation data, and if the multi-layer perceptron's cardiac phase prediction on the validation data is poor, the node weights are recalculated.

[0045] Section 2.3. Logical Algorithms 118 Medical algorithms and systems already exist to identify the T and P waves of the ECG in the cardiac cycle. Because the cardiac phase sensor 112 continuously measures the cardiac cycle, the time interval between the T wave and the following P wave (equal to a certain percentage of the cardiac cycle and therefore proportional to the heart rate) is also known. The logic algorithm 118 uses ECG features within the time interval to introduce a short time lag before starting the gating window, such that the gating window starts, for example, halfway between the T and P waves and closes after the logic algorithm 118 identifies the P wave.

[0046] FIG. 14 is an example of triggered x-ray image frames corresponding to different respiratory phases of a respiratory cycle, such as early expiratory phase, late expiratory phase, maximum expiratory phase, early inspiratory phase, late inspiratory phase, and maximum inspiratory phase (from left to right), according to some embodiments of the present disclosure. In this case, the acquisition software 104 identifies at least six respiratory phases that represent a single respiratory cycle. During a training period, the acquisition software 104 generates a distribution of samples, and the logic algorithm 118 calculates tidal volume percentiles that define the target respiratory phase of the logic algorithm 118. The arrows shown in FIG. 14 point to the six cardiac gated frames that coincide with the target respiratory phases for which the logic algorithm 118 should generate an imaging trigger signal. Once the acquisition software 104 has acquired a respiratory phase, it generates an automatic verification to prevent duplicate imaging of the same respiratory phase.

[0047] FIG. 15 is a schematic flow diagram of an image capture trigger process 1500 according to some embodiments of the present disclosure. The cardiac phase sensor measurements are used to identify cardiac gate windows as described above with reference to FIG. 12. The respiratory phase sensor 110 measurements are used to predict respiratory phases as described above with reference to FIG. 11. The logic algorithm 118 identifies a match between the cardiac phase gate windows and the predicted respiratory phases. If a match is found, the list of respiratory phases is examined to determine if the respiratory phase has already been acquired. If the respiratory phase has been previously acquired, an imaging trigger pulse is not generated. If the respiratory phase has not yet been acquired, an imaging trigger pulse is generated and a snapshot of the patient's anatomy is acquired. The respiratory phases, cardiac phases, and 3D spatial position localizer 300 measurements are recorded and tagged with the image. Once all respiratory phases have been acquired, the respiratory phase list is updated to avoid duplicate image capture.

[0048] Section 2.4. Trigger Generation (Gate Control) The X-ray unit 108 has a port that contains a series of electrical pins. One of the pins accepts an electrical impulse that defines the timing and duration of radiation exposure. Based on the identified respiratory phase of the logic algorithm 118 within the cardiac gate window, a trigger generator generates a square wave trigger as an electrical impulse. A fiber optic cable with a vendor-specific mating plug transmits the generated trigger signal to the X-ray unit 108.

[0049] Section 3. Post-processing software The biometric imaging triggers identified by the hardware box 102 (section 1) and acquisition software 104 (section 2) provide higher quality data inputs (and filter out lower quality inputs) to the image reconstruction algorithms. Specifically, the biometric targeted image acquisition process during normal breathing improves image reconstruction and image post-processing techniques, thereby improving quality. Because a basic assumption of the underlying radiology mathematics presupposes anatomical equivalence at various probe imaging angles, the biometric targeted image acquisition process during normal breathing allows for more accurate correlation of multiple anatomical images taken of the same patient from different angles at different times (e.g., different breaths). The enhanced images serve as observations, and the biometric signals serve as inputs to a complex biomechanical model of chest geometry.

[0050] Section 3.1. GREX image acquisition for digital tomosynthesis For 3D reconstruction, multiple imaging angles are required. For GREX imaging, each angle must be acquired for each respiratory phase. The acquisition software 104 (section 2) creates trigger signals that allow the X-ray unit 108 to repeatedly image the chest at a particular geometry. The same geometry imaged at different imaging angles and different breaths results in a set of 2D projection images that are used to reconstruct the 3D. Many methods are already known for reconstructing 3D from multiple 2D projection images. One such exemplary method is the convolution backprojection algorithm, which uses a set of 2D projections to directly reconstruct a 3D density function. It is called the "FDK image reconstruction algorithm" and is disclosed in Feldkamp LA, Davis LC, Kress JW, "Practical cone beam algorithm", J Opt Soc Am 1, 612-619 (1984).

[0051] FIG. 16 is a schematic block diagram of variables used in an image reconstruction algorithm according to some embodiments of the present disclosure. To acquire a single projection image, the X-ray unit 108 moves through an angle β and the detector plane moves to maintain a perpendicularity to the X-ray unit 108. In some embodiments, the patient is moved and the X-ray unit 108 remains in the same position during the projection image acquisition. FIG. 17 shows a schematic illustration of an example process in which the X-ray unit 108 and the detector panel 304 of FIG. 3 move to obtain multiple imaging angles. For example, the X-ray unit 108 moves from position 1700a to position 1700b to position 1700c. The detector panel 304 moves from position 1702a to position 1702b to position 1702c. The detector plane rotates about an axis parallel to the detector plane and the imaging plane rotates about its parallel axis z. The positions of pixels in the detector plane and corresponding pixels in the imaging plane are separated by a distance s. Anatomical information (f(x, z / y)) of the imaging plane ((x, z) plane) at any depth y is calculated using the following equation (1).

number

[0052] In equation (1), N0 is the total number of projections, β is the angle of each projection, d is the source-to-image plane distance, s is the pixel-to-detector distance, p is the detector axis perpendicular to the rotation axis, ξ is the detector axis parallel to the rotation axis, R(β,p,ξ) corresponds to the cone beam projection data (e.g., the function R is the detector readout for a given angle, p coordinate, and ξ coordinate), h is a convolution filter, and W(p) is a weighting function. Essentially, equation (1) represents a combination of convolution, backprojection, and weighting.

[0053] The information of points lying in the mid-plane can be calculated from the projection data along the intersection of the detector plane with the mid-plane (y=0). Projections (constant, non-zero y) that intersect the detector plane along a line parallel to the mid-plane but are not in the mid-plane define a plane of their own. The plane is treated as another tilted mid-plane. Once a complete set of projection images is acquired ("complete" meaning that all rotation angles around the normal have been acquired), the density of the tilted plane is reconstructed using the Radon transform. To acquire a complete set of projection images, the source needs to be rotated 360° around the object along the tilted circle. For example, in CT imaging, a full 360° rotation is performed around the object. Note that the bolded word "imaged object" means, more precisely, that the bolded word explicitly conveys and defines the fundamental assumptions of the Radon transform (folded into the R(β, p, ξ) term in Eq. (1)) that, if violated, would prevent the representationality of the reconstruction of the imaged underlying true anatomical structure. By "imaging object" we mean that the Radon transform inputs are assumed to be different angle probes of a single fixed, non-moving, time- and space-invariant fixed anatomical object. GREX imaging subjects only accurate (occurring in different breaths but geometrically identical respiratory phases) Radon transform inputs to biodata-based targeting (i.e., "preselection"). Here, the respiratory phases (i.e., time-domain changes) used in GREX are geometrically, anatomically, and physically rigorously defined (i.e., definitionally correct formulation), and in fact we use the GREX imaging specific short prediction horizon and biodata-based prospective targeting, so we can say that the basic assumptions of the transform are definitionally and practically respected.

[0054] However, 360° rotation is not practical for GREX imaging because the large number of projection images required for 3D reconstruction of the torso increases clinical procedure time and increases the radiation dose to the patient. Instead, GREX imaging can use projection angles ranging up to <90° between -45°≦β≦45° or 0°≦β90°. Those skilled in the art should understand that the theoretical projection angle range does not exceed 90°, although experimental testing may identify a more optimal projection angle range. In some cases, -45°≦β≦45° may be preferred over 0°≦β<90° because -45°≦β≦45° keeps the radiation dose from the imaging procedure as low as reasonably achievable. X-ray photons traverse less human tissue in the projection angle range of -45°≦β≦45° compared to the projection angle range of 0°≦β≦90°, as shown in Figures 18A and 18B, and therefore may be lower energy photons, thereby depositing less dose.

[0055] To generate high quality 2D images without excessive radiation dose, the photon energy must be high enough to partially penetrate the patient's body, but not so high that it penetrates the patient completely. Patients with a thicker body require higher photon energy than those without. If |β|>45°, the body is much thicker than if |β|<45°. In general, as β→0°, the photon energy decreases. In some embodiments, the GREX imaging system 100 acquires six respiratory phases at five different projection angles for a total of 30 projections, although the number of projections may vary depending on the application of the GREX imaging technique. For example, in breast tomosynthesis, the symmetric curvature of the breast means that the breast surface is essentially equidistant from the light source at all projection angles. This means that tomosynthesis is suitable for breasts. Furthermore, the breast does not move when placed in a cradle. This is a typical clinical tomosynthesis approach, similar to breath-hold lung imaging.

[0056] The challenges of lung and heart motion can be solved by the GREX-based geometric definition of the respiratory phase as well as the GREX-based highly accurate and fast prospective targeting prediction algorithm (sections 2.1 and 2.2), so that the GREX imaging system 100 can handle the changing torso curvature using the biometric surface information collected by the 3D spatial positioning localizer (section 1.1). The biometric surface information also assists in image post-processing to attenuate tissue density within the imaging field, thus quantifying previously sparse attenuation sources, ultimately resulting in higher fidelity image reconstruction. In summary, the GREX imaging technology allows imaging of the lungs and heart without breath-holding ("dynamic") by digital tomosynthesis.

[0057] GREX-based 3D reconstructions may be patient-specific (custom medicine using individualized angles and corresponding arcs) or used as a "universal minimum procedure time and universal minimum delivered dose" (taking into account past reconstruction method statistics and the number of previous GREX-based datasets for the patient at approximately 5 discrete angles ±3 angles).

[0058] As shown in Fig. 19, when the X-ray unit 108 rotates through a narrow range of angles, the depth resolution is lower than when the X-ray unit 108 rotates through a wider range of angles. Any motion, regardless of magnitude, will cause image artifacts in the reconstructed image and will typically result in false positive cancer detection. However, the unique hardware box 102 (section 1) of the GREX imaging system 100 collects biosignals that inform the acquisition software 104 (section 2) when to take images so that the breast shape is clinically identical, thereby enabling smart breast digital tomosynthesis.

[0059] In some embodiments, the GREX imaging technique allows for varying projection angles during one respiratory phase, but multiple projection angles captured at different times (as defined by the quantitative definition of a "respiratory phase" in GREX imaging) all correspond to the same respiratory phase, i.e., all are considered to be imaging one chest shape. Furthermore, the GREX-based tomosynthesis approach allows for the acquisition of depth information, since the final photon count across all pixels of the detector and the distribution of photon counts in space at the detector surface reflect a single chest geometry probed at multiple angles.

[0060] In the GREX imaging technique, the x-ray unit 108 and detector panel 304 may also be mounted on a non-motorized arm or stand. An example of a manual arm in a GREX imaging procedure is illustrated in FIG. 1. In the β1 position, image the six required thoracic geometries (aka "GREX quantitatively defined respiratory phases"). 2. The clinician then physically re-orients the x-ray unit 108 and detector panel 304 to image the patient at position β2. 3. The orientation of the X-ray unit 108 and the detector panel 304 relative to the patient is verified by a 3D spatial localizer that allows imaging to be performed at β2. 4. Where, β2: If only four of the six required chest geometry images are acquired during the first breath, the patient continues to breathe normally in position β2 for subsequent breaths until the remaining two chest geometry images are acquired. 5. Now all six respiratory geometries have been acquired at β1 and β2, the x-ray arm can be repositioned to acquire each imaging angle in the following order: (β2→β3, β3→β4, β4→β5). 6. By the end of the procedure, the X-ray arm will move a total of only four times, as indicated by the workflow arrows →(β1 → β2, β2 → β3, β3 → β4, β4 → β5).

[0061] With the GREX imaging technique, the arm is moved only four times during the procedure, and the clinician only interacts with the X-ray arm to the extent of moving the arm from β1 to β5 over six respiratory phases (e.g., reorienting the X-ray machine 30 times), minimizing procedure time, clinician-equipment interaction during the procedure, and the degree of wear on the X-ray arm.

[0062] In some embodiments, the 3D spatial positioning localizer allows for prior position verification and safety interlocks for three individual elements, namely the patient's pose and position, the position of the X-ray unit 108, and the position of the detector in space, and also allows for collective consistency in the position / location of each element with respect to the positions of the axes and other elements. This priority position check and safety interlock is a result of GREX imaging's geometric definition of the respiratory phases. Thus, the GREX imaging system 100 (prospective respiratory phase prediction algorithm) can provide the user with a software-based safety quality assurance control function that prevents the trigger algorithm from starting "beam on" (in case of safety interlock) even if either the X-ray arm or the detector (or both) or the patient's pose is mispositioned (or inconsistent) in space for a certain angle β.

[0063] In some embodiments, a 3D spatial positioning localizer records all of the instrument's coordinates during the procedure, so that image reconstruction techniques have the advantage of allowing (post-hoc) quantification of each β angle and its associated uncertainty.

[0064] 21A and 21B are example block diagrams illustrating how the GREX imaging system 100 reconstructs a static image cube from 2D projection data acquired from each imaging angle position, according to some embodiments of the present disclosure. Specifically, FIGS. 21A and 21B show an example GREX imaging case where the coronal and sagittal views themselves form the outer limits / boundaries of the imaging angle position (e.g., projection angle). The x-ray projection images of the ith plane are obtained at a single imaging angle position (β) for each of the six respiratory shapes. i). The sum of the planar projections of i = 1 to i = n reconstructs (Eq. 1) the depth information at (x, y, z) of the (v1, f1) shape probed with the projections of i = 1 to i = n, each with a focal plane at a unique depth (relative to the other projections).

[0065] 2D projection image data is

number

[0066] The x-ray projection images acquired at each angle β are also acquired at the target respiratory phase identified using the ARIMA model (section 2.2). After the target respiratory phase is acquired, the x-ray unit 108 moves to the next imaging angle position. FIG. 22 illustrates an example where only the maximum inspiratory and expiratory phases are acquired by the acquisition software 104. In this example, the maximum inspiratory and expiratory phases are imaged at β1, and then the x-ray unit 108 moves to β2 and acquires the maximum inspiratory and expiratory phases at β2 as well. Once the target respiratory phases are acquired at all imaging angle positions, the images are classified according to their respective respiratory phases. The x-ray images are sorted according to the respiratory phases, and the projection images are grouped according to the six biologically defined respiratory phases. Although the respiratory phases are acquired during different breaths, the highly accurate ARIMA model ensures that the tidal volume and airflow parameters are the same even for x-ray projection images taken at different projection angles. GREX imaging biologically defines the "same chest shape" such that the lungs are present in the "same chest shape" at multiple time points. The ARIMA model (Section 2.2) is a fast prediction method so that GREX imaging will probe the same biological respiratory phase at different angles. Chest shape prediction error is minimized using the short prediction horizon of the ARIMA model. The associative equivalence of the depth information of the individual angles (to collectively generate the actual structural depth information) relies on the equivalence (consistency, within an approximation tolerance) of the geometrical position of the chest across the various probe angles. Thus, the accuracy of the respiratory phase prediction ensures successful image reconstruction.

[0067] The respiratory phase classified projection images are used to create static image cubes using the standard FDK image reconstruction algorithm given in Equation (1) (or a similar cone beam shape image reconstruction algorithm). The image reconstruction algorithm uses the respiratory phase classified projection images to create static image cubes classified by respiratory phase. Each respiratory phase has a separate image cube. The static image cubes are called static cubes because they represent an anatomical structure at a single respiratory phase. A 3D image cube movie is created from the 3D static image cubes by combining and temporally interpolating (see Section 3.3) the static cubes representing all the targeted respiratory phases.

[0068] The GREX imaging system 100 keeps radiation dose at the lowest reasonably achievable level through statistical image reconstruction. Each image acquired increases the dose of the entire imaging process (clinically undesirable) but provides additional information that is used in image reconstruction (clinically desirable). Conventional image reconstruction based on Fourier transform or filtered backprojection techniques are prone to image artifacts because they cannot handle missing information, e.g., missing projection angles β. For example, if projections are made every 10° instead of every 5°, half the information is available to create a still image cube, and roughly half the dose is used. Statistical iterative image reconstruction techniques can also handle missing information caused by incomplete image data sets.

[0069] The GREX imaging system 100 may use various existing statistical image reconstruction algorithms to complete the image reconstruction task (e.g., construct a still image cube), while the GREX imaging system 100 can improve upon conventional statistical image reconstruction algorithms by implementing a unique feedback step and adhering to mass conservation-based boundary conditions.

[0070] Since GREX images are biophysically defined by biophysical quantities governed by physical laws, fundamental principles of physics can be applied to the statistical image reconstruction of GREX. By biotagging each image and the resulting image cube, and further collecting a continuous biodata stream during the procedure even when the patient is not being imaged, the respiratory dynamics of mass exchange (inspiration-expiration) and volume change are known (solving the problem of an invariant lung tissue volume that is consistent over the course of the scan). Since the still image cubes can be constructed for the first time from movable organs such as the lungs, the law of conservation of mass can be applied. This is due to the speed and accuracy of the prospective prediction / triggering algorithms (sections 2.2 and 2.3) that accurately label and obtain the same chest shape at different time points. In other words, the mass of tissue in a still image cube must not change (e.g., by the law of conservation of mass) from any still image cube to the next still image cube. Based on the ideal gas law, the ratio of air at room temperature to the air in the lungs is 1.11. Obtaining the tidal volume of the image cube from the sensor data and using the mass / volume air curve with a ratio of 1.11 and deviation relative to room temperature, the inspired mass (absolute value and relative value as a ratio between the image cubes of two different respiratory phases) can be determined.

[0071] GREX imaging's conservation of mass-based boundary conditions are extremely useful because, for example, the presence of air can artificially darken voxels and adversely affect the ability of statistical image registration algorithms to accurately determine object density. By correcting acquired projections for differences in air volume and consistently isolating volumes that need to remain constant over the course of a scan (e.g., lung tissue mass), GREX imaging produces more accurate image reconstructions that are used to generate the static image cube.

[0072] Considering two GREX projections taken at different imaging angles and the same anatomically defined respiratory phase, the lung air volume is the same, but the way the air displaces the tissue may be different in the two projections, which causes the affected and erroneous nodule to have a darker intensity in the second projection compared to the first. As a result of this error, some of the tissue ("nodule") visible in the first projection will not be visible in the second projection, which will ultimately dull the intensity of the "nodule" in the resulting image cube (or be mistaken for background). The mass conservation-based boundary condition of the GREX imaging is realized as a feedback step that ensures that the lung mass is preserved between the aforementioned image cube with the dim nodule and another image cube (with a correct anatomical representation of the "nodule" intensity) from a later respiratory phase. The feedback step of the GREX imaging corrects the second projection of the erroneous image cube during reconstruction by updating the expected shape based on a simulation using the first projection as an absolute reference. This allows the reconstruction of the GREX statistical image to generate a more accurate static image cube.

[0073] In addition to existing statistical image reconstruction algorithms, the GREX post-processing software 106 improves anatomical imaging by incorporating edge definition filters (see Section 3.2), spatial boundary conditions (see Section 3.2) and smooth transitions between respiratory phases (described in Section 3.3) into the digital diagnostic X-ray images.

[0074] Section 3.2. Image Filters The quality of a digital diagnostic X-ray image depends on the settings of the X-ray unit 108 and the anatomical region being imaged. Each patient and anatomical region has a different electron density through which X-rays penetrate to produce an image. For example, imaging the femur requires more X-ray energy than imaging the chest because the lungs are primarily air and the femur is composed of bone. Given that high-energy X-rays penetrate the body more than low-energy X-rays, the number of X-rays that emanate from the body to reach the flat panel detector differs for high-energy X-rays and low-energy X-rays imaging the same anatomical shape. Too many X-rays emanate from the body, resulting in overexposure of the flat panel detector, similar to overexposure in optical photography. If the settings of the X-ray unit 108 are not optimal for the anatomical region being imaged, image quality will be significantly degraded. In clinical practice, commercial vendors devise imaging protocols for their digital diagnostic X-ray units that roughly estimate the optimal X-ray unit settings for a selected anatomical region. However, these rough estimates of optimal tube settings are not customized to address potentially significant anatomical variations between anatomical sites in different patients (e.g., stomach of an overweight person vs. stomach of an average weight person).In fact, existing imaging protocol settings by vendors are only rough estimates and are not suitable for producing high quality images.

[0075] When optimal x-ray unit settings and other imaging parameters are unknown prior to imaging (as is the case in today's medical community), digital image filters can be strategically utilized to improve image quality even when x-ray unit settings are not optimal. The improved image enhances the visibility of anatomical features that are nearly invisible to the human eye. For example, in the coronal plane, not all ribs may be visible in a digital diagnostic x-ray image. The post-processing software 106 filters the coronal image with an edge enhancement filter, such as a Laplacian filter, to display all rib boundaries on the resulting image, even if the rib boundaries on the original image are too subtle for the human eye (e.g., the radiologist's eye) to detect. The post-processing software 106 overlays the filtered image with the original image, highlighting previously invisible rib edges that were enhanced (e.g., after filtering) in the original image. Image filters that can be applied by the user include Laplacian, Hanning, Butterworth, Parzen, Wiener, Metz, Ramp, nonlinear spatial average, and hybrid filters.

[0076] In some embodiments, the post-processing software 106 uses the skin surface measurements of the 3D spatial position localizer 300 to calculate optimal imaging parameters for images taken at each respiratory phase. As the patient breathes, the electron density of the body changes as more air is inhaled and chest circumference increases. As the diameter of the patient increases, the distance between the patient and the x-ray unit 108 decreases, and the distance between the patient and the detector panel 304 also decreases, introducing additional image noise into the resulting x-ray image. The 3D spatial position localizer 300 tracks the patient's skin surface position in each image relative to the x-ray unit 108 and the detector panel 304. Tracking the skin surface position can provide unique measurements used in digital diagnostic x-ray examinations.

[0077] Current digital diagnostic radiology consists of scaling the dose index readings measured with an ionization chamber to the approximate body mass index of the patient. Radiologists currently perform only two measurements: one using a solid water cylindrical phantom with a diameter of 16 cm, which corresponds to the tissue density, and another using a substantially identical phantom with a diameter of 32 cm. The X-ray unit 108 includes "one size fits all" protocols for various anatomical locations, as defined by the vendor. For example, the vendor provides only a single protocol that includes imaging settings that the radiologist can select, regardless of the diameter of the patient's chest. This means that images are acquired with similar imaging settings for men with and without thick chests.

[0078] The 3D spatial position localizer 300 of the GREX imaging system 100 generates individual measurements of the patient's chest diameter in real time. The measurement is started when the technician selects the patient's customized X-ray unit settings. When the patient breathes, the chest diameter changes. If the patient's chest diameter changes, the technician cannot set the optimal imaging parameters to match the patient's chest diameter. However, with the real-time customized chest diameter measurements, it is possible to remove image noise in post-processing and simulate an X-ray image taken with optimal imaging parameters.

[0079] FIG. 23 is a schematic flow chart of an image filtering process 2300 for computing a noise-free lung image to simulate an image taken with optimal X-ray unit settings, according to some embodiments of the present disclosure. After acquiring the image as described in section 2, the trachea is identified using a line profile of a segment passing laterally (left to right) through the neck region. While the neck is composed of muscles, bones, and arteries, the trachea only contains air, which is significantly less dense than tissue, making it stand out from all other tissues. The line segment indicates the location of air, and small regions containing pixels assigned to air are identified. The image noise of the X-ray image is calculated by dividing the entire image into small patches. Gaussian noise is estimated separately for each patch, and the patch with the least amount of noise is used for texture mapping. The texture mapping method uses the gradient covariance matrix to estimate the initial texture level for each patch. For the patch with the smallest initial noise level, the noise level is re-estimated in an iterative process that continues until the noise estimate for the patch converges with additional iterations of the gradient covariance matrix. The weak texture patches are assumed to be in air. Air is likely to be present in locations far from the patient, e.g., the top corners of an x-ray image. Estimating the noise level of the patch gives a baseline noise level for the entire image. The baseline noise level identified by the iterative gradient covariance matrix is ​​then subtracted from the entire image to obtain an estimate of the noise-free air density in the trachea.

[0080] The post-processing software 106 overlays a human skeletal model (individually scaled for each patient) onto the surface location estimates provided by the 3D spatial localizer 300 to estimate the initial location of the lungs. The individually scaled patient skeleton is rigidly registered to the x-ray image using visible landmarks present on the skin surface (e.g., clavicle, rotator cuff, scapula, vertebrae). Rigid registration of the skeleton to the x-ray image gives the location of the rib cage from the skeleton. The rib cage itself presents boundary conditions for the edges of the lungs and pixel values ​​close to the noise-free air density estimate of the trachea. Both the edges of the lungs (through the location of the rib cage) and pixel values ​​close to the noise-free air density estimate of the trachea are automatically identified as seed locations by the region-forming algorithm (locations where the region-forming algorithm starts and then grows radially outward). The region-forming method is a region-based segmentation method. Segmentation begins by identifying a set of initial seed points for the image, then examining the neighboring pixels of the initial seed points to determine whether they need to be added to the region. This process is repeated in the same manner as in typical data clustering algorithms. In other words, the region formation algorithm uses the initial placement of seed pixels to expand outward using a statistical process that adds "similar" pixels. The region formation algorithm continues (continues to merge similar pixels) until the identified pixels are statistically different from the merged cluster.

[0081] In practice, in the GREX imaging system, the region forming algorithm "stops" (e.g., detects pixel dissimilarity) at important anatomical landmark interfaces (e.g., lungs surrounded by enhanced pixels of the rib cage). Pixels that the region forming algorithm does not identify as belonging to lung tissue are masked (a mask image is defined as an image that enhances the structure when subtracted from the original image) to form two separate images: (i) segmented lungs, and (ii) other body tissues. To provide an accurate and noise-free segmented lung volume (e.g., lung volume that is not visually hidden by non-lung tissues) that improves the diagnostic visibility of the radiologist, tissues related to the body mask (e.g., not related to the lungs and therefore less visually informative) are removed from the lung image. For example, pixels belonging to the intercostal muscles of each simulated imaging ray projection are completely subtracted from the segmented lung image. The body mask is subtracted as described above from the lung image to improve the visualization of the lung tissue, and the body mask is used to perform a second validation against the patient surface position calculated by the 3D spatial position localizer 300. For example, the post-processing software 106 calculates the number of pixels that the region-forming algorithm identifies as the body mask, and then calculates the body diameter at various locations along the height of the torso. This body diameter calculation should closely match the 3D spatial position localizer 300's estimate of the patient's body diameter. If it does not, this may indicate the need to recalibrate the 3D spatial position localizer 300 to improve accuracy.

[0082] If a clinical user desires a more accurate representation of the body mask (e.g., for clinical or educational reasons), the body mask image is simulated with optimal x-ray unit settings, thereby removing noise forms and potential sources of artifacts from the body mask. The body mask and segmented lungs are then recombined to form an x-ray image free of artifacts and noise, further improving clinical applications such as structure contouring holistically.

[0083] Section 3.3. Biomechanical Modeling The biomechanical model used in the post-processing software 106 is based on first principles of physics, namely the law of conservation of mass and the ideal gas law. The goal of the biomechanical model in the post-processing software 106 is to determine biophysical indices that will enhance the clinician's ability to diagnose disease. Biophysical indices of interest include, but are not limited to, stress and strain in lung tissue elements.

[0084] When a force is applied, a mechanical system generates stress. In the case of the lung, the element of the mechanical system is the lung tissue. The lung tissue visible in medical imaging consists of the parenchyma (including the alveolar sacs, alveolar walls, bronchi, and blood vessels). The parenchyma is directly involved in lung function. A suitable tissue element for biomechanical modeling needs to be small so as to be internally homogeneous, and statistically stable in response to respiratory stimuli. A typical voxel size in the lung medical imaging range is 1 mm. 3 ~3mm 3 , which corresponds to 125–375 alveoli. A voxel is considered to have approximately uniform density and to contain enough alveoli to provide a stable response to respiratory stimuli. The alveoli are arranged in a hexagonal array and expand due to the expansion normal stress from each shared alveolar wall. The sum of the expanding normal stresses of the lung tissue elements gives an estimate of the pressure experienced by the alveoli and caused by the respiratory stimuli. The expansion stress is countered by the reaction stress of the alveolar wall, and the two stresses are in equilibrium when airflow through the tissue element is zero. A spatial shift in the location of the lung tissue element in any one direction due to a change in the lung tidal volume can be modeled by the response of the tissue element to the normal stress on the corresponding surface of the lung tissue element. In other words, the biomechanical model includes a vector term that describes the response of the lung tissue element to an increase in tidal volume, which is related to the normal stress.

[0085] Strain is defined as the response of a mechanical system to a stress. From the perspective of an element (e.g., tissue), stress is a deformation force and strain is a restoring force. The stress vector on the lung tissue surface contains two components: (i) normal stress (associated with the outward or inward motion of the lung tissue elements resulting in expansion or contraction, respectively), and (ii) shear stress, which is orthogonal to the normal stress and results from the airflow-induced pressure imbalance. By definition, the orthogonal component of shear stress does not contribute to changes in lung volume. An illustration of the relationship between normal stress / shear stress and tidal volume / airflow can be found in the "airflow vs. tidal volume" plot shown in Figure 10. Exhalation corresponds to the lowest tidal volume where airflow is zero (left end of the curve). During inhalation, airflow is positive and tidal volume is increasing (top of the curve). As airflow slows, tidal volume is at its maximum. As the tidal volume approaches a maximum (the right end of the curve), airflow decreases rapidly and the air expelled from the lungs begins to increase. As the lungs expel more air, the tidal volume also begins to decrease. Tidal volume decreases when airflow is negative and continues to decrease until the tidal volume reaches residual capacity and airflow becomes zero (e.g., expiration). In essence, the motion of lung tissue elements is defined by the tidal volume and the airflow respiratory stimulus. The motion of lung tissue elements is due to normal and shear stresses acting on the elements. Changes in the shape of the lung tissue elements (e.g., compression, slenderness) are not modeled by stress. Rather, changes in the shape of the elements are modeled by strain.

[0086] Since medical analysis using models relies on the quantitative analysis of forces, models enable new diagnostic possibilities in the medical field: they allow visualization and analysis of the functional behavior of the lungs (e.g. the movement of the lung tissue) from a clinical perspective, essentially assessing the health of the lungs by the balance of stress and strain forces at each voxel of the lung.

[0087] The first step in model construction is to identify which tissues are part of the lungs and which are not. To this end, the GREX imaging technique takes several snapshots of the chest geometry in multiple configurations (six different respiratory phases). The lungs are segmented based on a region-forming segmentation algorithm that uses the air density of the trachea as the initial starting point for the region-forming algorithm. The GREX imaging system 100 uses two different deformable image registrations to construct the biomechanical model: one works on the lung tissues and the other works on the non-lung tissues (e.g. chest wall, ribs, liver, heart, trachea, esophagus, etc.). The results from the region-forming algorithm are differentiated between lung and non-lung tissues prior to the deformable image registration.

[0088] The GREX imaging system uses two deformable registrations, one for lungs and one for non-lungs, based on the fact that lungs have different motion and material properties than other tissues. If only one deformable image registration is used across lungs and other tissues, the registration would assign a higher weight to non-lung tissue than to lung tissue, i.e., it would unrealistically underweight lung tissue, thus unrealistically limiting the range of motion. The GREX imaging technology is built to visually resolve insidious lung motions, including computationally complex insidious motions on the lung surface.

[0089] Deformable image registration algorithms that can track tissue motion in images include optical flow algorithms. FIG. 27 is a schematic flow diagram of a multi-resolution 3D optical flow algorithm 2700 according to some embodiments of the present disclosure. Specifically, the 3D multi-resolution optical flow algorithm performs deformable image registration that identifies structures in two different images based on the brightness and / or contrast of each structure. To that end, given that non-lung tissue contains anatomical structures (e.g., ribs, chest muscles, sternum, etc.) that are characteristically brighter (e.g., at least 10 times denser) compared to lung tissue, using a single 3D multi-resolution optical flow algorithm for both non-lung and lung regions would result in the less dense lung tissue being artificially de-prioritized in the algorithm. The algorithm's computational resources are preferentially allocated to brighter contrast structures (e.g., ribs) present in the non-lung tissue. Since the computational resource allocation preferentially ignores the dynamics of the lung tissue, it directly violates the purpose of GREX imaging, which is to visually resolve the insidious motion of the lung tissue.

[0090] Since it is a feature of 3D multi-resolution optical flow algorithms to preferentially allocate resources to high contrast structures, we split the task of deformable image registration in the chest into two subtasks (e.g., two internally more homogeneous regions): (i) image registration of the lungs and (ii) image registration of non-lung tissues. In some embodiments, in order to analyze two separate task regions from the chest as a whole, identification of the lung surface (e.g., lung-non-lung boundary) is required prior to 3D multi-resolution optical flow deformable image registration. The lung surface can be identified with a region formation algorithm that starts inside the lung in the air-filled (e.g., visually dark) region, extends outward toward the lung surface boundary, and encounters high pixel contrast at the lung surface boundary. First, the region formation algorithm is performed.

[0091] The lungs are not attached to the chest wall, so lung motion is relatively independent of chest motion. In other words, rather than a predictable push-pull response at the lung surface boundaries, other tissue dynamics come into play. For example, a horizontally adjacent chest voxel will move vertically downwards, so a lung voxel will move horizontally into the space where the chest voxel previously resided.

[0092] To accurately model the complex motion dynamics, the GREX imaging system 100 quantifies the shear forces on the surfactant layer at the lung surface boundary. Two separate segmentations are applied to lung and non-lung tissues to obtain the basis for force estimation. The force estimation procedure can be performed (performed for each reconstructed respiratory phase image) by subtracting (e.g. removing the assigned values) the segmented lung pixels from the X-ray image. The pre-segmented lungs are masked from the original images providing an image containing all other tissues. The segmented chest shape from each image needs to be registered with each chest shape in the other images to know the position of each lung tissue element in all images. A multi-resolution optical flow algorithm performs image registration by calculating a displacement vector field that describes the displacement of all pixels in two images taken at different respiratory phases. Indeed, knowledge of the displacement vector field allows the spatial location of all lung tissue elements of the chest shape to be described with high accuracy. The difference between the displacement vector field of the segmented lung registration and the displacement vector field of the non-lung tissues gives the magnitude and direction of the shear forces in the lungs and chest wall.

[0093] After observing over 150 patients, we found that the relationship between displacement and tidal volume is linear. The relationship between displacement and airflow is also linear. The output of the multi-resolution optical flow algorithm is a displacement vector in coordinate space for each measured tidal volume and airflow magnitude. When the displacement vector is calculated for every respiratory phase, the result is a closed-loop trajectory (see Figure 10), which corresponds to the observation of the biomechanical model. As explained in more detail below, the parameters of the biomechanical model (which may include parameters representing normal stresses associated with tidal volume, normal stresses associated with airflow, and shear stresses associated with airflow) are obtained by applying a QR decomposition of each lung tissue element individually. The parameters are specific to each lung tissue element (e.g., each lung tissue element has a unique solution) and collectively describe the response of the lung tissue elements to a respiratory stimulus. The parameters of the biomechanical model are vectors that are globally scaled by the measured tidal volume and airflow (e.g., tidal volume and airflow are scalar values). The relationship of biomechanical model parameters, such as the angle between two (vectorized) parameters, is useful for diagnosing lung potential disease. Based on the intrinsic biomechanical model vector parameters of the lung tissue elements (e.g., each piece of tissue has different vector parameters), the displacements of the lung tissue elements are scaled to the chest shape. The chest shape is defined by measurements of tidal volume and airflow. The biomechanical model can be calculated for each patient or shared across multiple patients.

[0094] In some embodiments, the biomechanical model models the motion of the lung tissue in terms of the tidal volume (T v ), airflow (A f ), heart rate phase (H c ) are approximated as functions of several factors including: These values ​​are global values. For example, cardiac phase is the same for all tissue elements in the thorax. The global values ​​are treated as scalar numbers and are measured by the hardware described in section 1. Tidal volume, airflow, and cardiac phase are all measurements that vary over time. The intrinsic stress and strain values ​​for each tissue element are given by

number

number

number

number

number

number

number

number

[0095] FIG. 24 is an example of a closed-loop lung tissue motion trajectory of a tissue piece located in the left lung near the heart, caused in part by the heart-lung interaction, according to some embodiments of the present disclosure. The wave behavior shown in FIG. 24 results from the heart-lung interaction. FIG. 24 is a schematic block diagram illustrating a method for determining the position of a lung tissue piece moving within a closed-loop lung tissue motion trajectory based on the biomechanical model described above, according to some embodiments of the present disclosure. FIG. 24 illustrates a method for summing three vectors of the biomechanical model described in the above equations to calculate the displacement of a single tissue element from the origin to any position on the closed-loop trajectory.

[0096] Using a physiologically based biomechanical model to interpolate images acquired during the respiratory phase has the great advantage of being able to verify the accuracy of the output results of the biomechanical model with quantitative physical quantities. According to the ideal gas law, the ratio of the change in lung volume to the tidal volume is 1.11 at room temperature. In other words, the ratio of the room air density to the lung air density is 1.11. Therefore, the volume integral of the divergence of the normal stress vector should also be 1.11.

number

[0097] An example of how biomechanical modeling of the GREX imaging technique enhances diagnosis is the case of early stage lung tumors that are not visible to the radiologist's eye during imaging. The tumor is much smaller due to the image sensitivity, so it is invisible to the radiologist. Even if the tumor is invisible to the radiologist, its presence can affect the balance of forces within the lung because its electron density is greater than that of healthy lung tissue. The high electron density of the tumor means that the different material and mechanical properties of the tumor (e.g., different characteristic stress and strain parameters) will affect both the motion of the tumor and the motion of the local area around the tumor (e.g., healthy tissue close to the tumor site). The effect of the tumor on the local healthy lung tissue can be roughly analogized as the effect of mass on the space-time continuum under the theory of general relativity. When a massive object is present, space-time around the object is curved, and light behaves differently around the object than it would if that mass were not present. The same analogy applies to the lung, where the tumor distorts the motion trajectory of the adjacent healthy tissue, resulting in a different motion from that of the healthy lung. From the displacement vector map of the biomechanical model, the physician can immediately understand the changes in the composition and biomechanical properties of the lung tissue: when the tumor is pre-defined, the displacement vector field shows unnatural vector curl and other changed characteristics. The creation of the parameter map by the GREX imaging post-processing software 106 (see section 3.4) visually displays important diagnostic information that was previously invisible to the user. The GREX imaging parameter map is an example of how the GREX platform is opening new diagnostic possibilities in medicine.

[0098] FIG. 25 is a schematic flow chart illustrating the operation 2500 of components of a biomechanical model according to some embodiments of the present disclosure.

[0099] The process of the biomechanical model is to quantitatively interpolate two images (2D or 3D) acquired at different respiratory periods. Equation (2) shows that the solution of the biomechanical model is the displacement of the two respiratory periods.

number

number

number

[0100] FIG. 26A is an illustration of the motion trajectory of lung tissue elements during a respiratory cycle according to some embodiments of the present disclosure. In FIG. 26A, there are six images for each imaging angle, which correspond from left to right to each of the six respiratory phases of a complete respiratory cycle, namely, early inspiratory phase (EI), late inspiratory phase (LI), maximum inspiratory phase (MI), early expiratory phase (EE), late expiratory phase (LE), and maximum expiratory phase (ME), as shown in FIG. 14. According to the finite strain theory, the vector connecting the position of a particle in the undeformed configuration and the deformed configuration is called the displacement vector of the particle. Using a particular voxel in the EI image cube as a reference, the six images will show the deformation of the reference voxel in its original position, size, and shape during the respiratory cycle. As more and more air enters the lungs, the reference voxel starts to "bubble". In other words, the lung tissue corresponding to the reference voxel deforms as the voxel "bubbles". The displacement between the two respiratory phases

number

[0101] FIG. 26B shows that there are five deformable registrations (2→1, 3→1, 4→1, 5→1, 6→1) between the EI image cube and five other image cubes. These six image cubes represent the patient's thoracic anatomy at six corresponding predefined respiratory phases. For each voxel, a vector

number

number

number

[0102] Similarly, for a particular respiratory phase “n”, the tidal volume of the lung (T v ), airflow (A f ), heart rate phase (H c ) is the biometric data matrix,

number

[0103] For each voxel in the image cube, a biomechanical model of the parameter matrix

number

number

number

number

[0104] As mentioned above, there are many deformable image registration algorithms that can perform image registration of GREX imaging, including 3D multi-resolution optical flow algorithms. 3D multi-resolution optical flow algorithms calculate smooth (e.g., fluid-like) transitions between images taken at different observed tidal volumes. Two respiratory phases

number

number

[0105] The post-processing software 106 performs biointerpolation between the acquired image cubes to input data for all potential respiratory phases and create a complete movie of the chest. Typically, a movie requires at least 30 simulated images for smooth frame-to-frame transitions. FIG. 28A is a schematic flow chart illustrating movie creation 2800 using biointerpolation according to some embodiments of the present disclosure. As shown in FIG. 28B, the biometric data matrix corresponding to the EI image cube is: T v = 20 ml, (A f )=20ml / s, H c =0.10.

[0106] For each voxel in the intermediate simulated image cube at a particular instant of the respiratory cycle, e.g., EI+Δt, EI+2Δt, EI+3Δt, etc., a biomechanical model for the parameter matrix

number

[0107] Section 3.4. Parameter Maps One of the clinical advantages of GREX imaging technology is its unique parametric maps, which provide users with previously unavailable information about their patient's chest health using 2D plots, 2D color washes, 3D plots and 3D vector field maps.

[0108] FIG. 29 shows an example of a standard radiograph of a healthy individual (left) and a patient with a stage 1b upper left lung tumor (right indicated by an arrow). Both show standard radiographs used in the current radiography field. The diseased left lung on the right side of FIG. 29 is an early stage lung tumor that is not easily found on the standard radiograph because it is difficult to read and only displays anatomical information. In contrast, FIG. 30 shows the accompanying GREX parameter maps showing health status indicators of the same two patients according to some embodiments of the present disclosure. The parameter map on the right clearly shows that the patient has disease in the upper left lung, whereas the standard radiograph is ambiguous. Changing the frame level and image contrast will eventually show the non-ventilated area of ​​the upper left lung. However, if the user does not follow these steps, the chances of finding this early stage lung cancer tumor will be low. In other words, the GREX-generated parameter maps can significantly reduce the risk that the user will miss the disease.

[0109] First, the 2D color map in Figure 30 illustrates the normal stress versus tidal volume.

number

number

number

number

number

number

[0110] Next, we express the sum of the normal and shear stresses associated with the airflow as

number

number

number

number

[0111] Section 3.5. Diagnostic Disease Pointers Lung cancer, chronic obstructive pulmonary disease (COPD), lower respiratory tract infections, and tuberculosis all have disease pointers that can be seen with existing digital diagnostic x-ray imaging. However, diagnostic disease pointers are not always visible in the early stages of disease. However, as shown in Figures 29 and 30, GREX parameters can serve as diagnostic disease pointers in early disease stages. If the medical team only reviews standard x-rays, the presence of lung cancer may go undetected because the tumor is not large enough to be clearly visible on standard x-rays. GREX imaging uses biosignals in combination with biodata-based targeted multiple radiographs to diagnose disease by leveraging previously unavailable information about lung motion. The GREX process directly addresses early lung cancer, where digital diagnostic x-ray images tend to have low specificity. The existing sensitivity limitations of digital diagnostic x-ray-based diagnosis are addressed by biodata-based imaging, with patient-specific respiratory information indicative of disease. Clinicians can diagnose disease early in its development and continue to monitor patients as the disease progresses with visualization and parameter maps of lung tissue motion. Applying machine learning and finite element analysis techniques to uncover insidious patterns and baseline changes in lung function, users can detect disease at its onset, improving patient survival and improving treatment options.

[0112] Another example of how GREX can have a ripple effect on diagnostics is the classification of the etiology of lung disease. In biopsies, asbestos-induced lung disease presents differently from tobacco-induced lung disease. Asbestos is a natural silicate mineral made up of long, thin fibrous crystals composed of millions of microscopic fibers. Inhaled asbestos fibers penetrate the alveoli and eventually form a dense network that impairs alveolar function and reduces lung function. The dense network collects cancerous tissue, hence the name mesothelioma. Standard x-rays can only identify mesothelioma when plaque builds up. Plaque buildup appears as dense consolidation (blurring) on ​​lung images. GREX may detect insidious asbestos through parameter maps before the user can visually identify its presence. When asbestos forms a network, the elasticity of the lungs is locally reduced. This localized and subtle reduction in elasticity is visible in parameter maps (2D color wash, parameter ratios, histograms). For example, in tissues that have lost their elasticity, the tissue's trajectory during breathing becomes more circular than elliptical. This is because

number

[0113] Inhaled particles (non-fibrous) are completely different from fibrous asbestos particles. Inhaled particles are deposited in the lungs, "clogging" the airways, forming scar tissue, forming tumors instead of reticulum, and reducing lung function. GREX indicates the onset of particle deposition by detecting minute local changes in the dynamics of lung motion that are inconsistent with healthy characteristics. Tobacco contains tar and radon that deposit in the alveoli and dramatically alter lung function. GREX gives users a unique tool that can track the decline in lung function and show patients the destructive power of their smoking habit. COPD is another disease that can be elucidated more effectively with parameter maps than with current clinical methods. COPD is currently detected with spirometry tests and standard x-rays. These methods are not particularly sensitive and do not allow early detection of COPD. Detecting the disease as early as possible gives patients the opportunity to apply preventive treatment and change bad habits before it is too late.

[0114] Section 3.6. Video Presentations The advantage of the Video Presentation Graphic User Interface (GUI) is that it provides a clean and intuitive canvas for displaying planar and 3D video results. Features such as rotate view, pause video, and rulers are arranged in bins represented by tabs at the top of the screen. When a feature is selected, the tooltip changes to inform the user of the function in use. The GUI is designed to be lightweight, so the GUI also works well on older computer systems. Finally, the Video Presentation GUI works in conjunction with annotation / contouring, possible disease pointers, and cloud computing platforms.

[0115] Healthcare professional users prefer to highlight and leave notes directly on medical images instead of attaching additional documentation to images. Healthcare professional users want image annotation ("attention-grabbing" arrows and treatment notes) and anatomical contouring (drawing virtual lines around anatomical structures) capabilities in their imaging exams. Healthcare professional users are often part of a larger care team that collaborates in treating patients. The following example describes the current workflow and technical capabilities of a clinical care team.

[0116] When lung cancer patients undergo imaging tests, the images are read by a radiologist, the radiation oncologist prescribes radiation therapy, and the operating surgeon prescribes surgical intervention. Specifically, the radiologist draws a contour around the tumor site and passes the contoured image to the radiation oncologist.

[0117] The radiation oncologist writes prescriptions for radiation therapy and / or tumor removal surgery based on the images.

[0118] Based on the contour drawn by the radiologist and the radiation oncologist's tumor resection instructions, the surgeon removes the tumor.

[0119] The post-processing software 106 provides tools for users to annotate and contour directly on the video, further streamlining the healthcare workflow. This easy-to-use functionality enhances the healthcare workflow and reduces the chance of medical errors. The interactive nature of the user interface ensures that treatment indications and medical concerns are clearly visible to all users, and clinical notes are displayed correctly in the corresponding anatomical regions of interest.

[0120] 31A-31B are flow diagrams of a method 3100 for imaging the lungs of a patient. In some embodiments, some or all of the operations described below can be performed without human intervention (e.g., without intervention by a technician). In some embodiments, the method 3100 is performed by any of the devices described herein (e.g., the GREX imaging system 100 shown in FIG. 1). Some operations of the method 3100 are performed by a computer system including one or more processors and a memory storing instructions that, when executed by the one or more processors, cause the one or more processors to perform the operations of the method 3100. Some operations of the method 3100 may be combined or reordered in any manner.

[0121] The method includes positioning (3102) the patient in a first orientation relative to an X-ray imaging device (e.g., the GREX imaging system of FIG. 1). In some embodiments, the method 3100 is performed on an existing medical imaging system that is modified to perform certain operations described below. In some embodiments, positioning the patient in the first orientation includes moving (e.g., rotating) the patient to a first orientation (see, e.g., FIG. 35), while the X-ray imaging system (e.g., the X-ray unit and detector panel) remains in a fixed position. For example, in some embodiments, the patient is seated or standing in a patient positioning fixture (PPF), such as the PFF 3501 described with reference to FIG. 35. In some embodiments, positioning the patient in the first orientation relative to the X-ray imaging device includes rotating the patient positioning fixture. For example, in some embodiments, at the start of the method 3100, the patient positioning fixture is rotated such that the sagittal plane of the patient is positioned at a predetermined angle relative to the optical axis of the X-ray imaging device (e.g., the axis along which the X-ray imaging device transmits X-rays). In some embodiments, the pre-defined angle is selected from the group consisting of -45 degrees, -22.5 degrees, 0 degrees, 22.5 degrees, and 45 degrees.

[0122] In some embodiments, positioning the patient in the first orientation involves moving (e.g., rotating) the X-ray imaging system while the patient remains in a fixed position (see, e.g., FIG. 17).

[0123] In some embodiments, while the patient is positioned in a first orientation relative to the X-ray imaging device, a patient positioning fixture maintains the patient in a fixed position (e.g., stabilizes the patient's position) and a three-dimensional image of the patient's lungs can be reconstructed based on a "stationary object" assumption (e.g., see herein).

[0124] The method includes obtaining (3104) a volumetric measurement of the patient's breath (e.g., when the patient is breathing normally, the patient does not need to hold their breath). In some embodiments, the patient's breath volume measurement is a measurement (e.g., a direct measurement) of the patient's lung volume (e.g., instantaneous lung volume) or a derivative of the patient's lung volume (e.g., flow rate). In some embodiments, as described in more detail below, the patient's breath volume measurement is a measurement that can be converted to the patient's tidal volume (e.g., measuring chest rise and fall). Tidal volume, as used herein, refers to the difference between the current lung volume and a predefined baseline (e.g., maximal normal exhalation without extra effort, maximal normal inhalation without extra effort, or other baseline volume).

[0125] In some embodiments, the patient's respiration volume measurement is a geometric (spatial or positional) measurement of the patient's respiration.

[0126] In some embodiments, the patient's respiratory volume measurements include a chest rise (and / or chest fall) measurement of the patient (3106). In some embodiments, the patient's respiratory volume measurements are obtained (3108) using one or more of the following volumetric respiratory phase sensors: a three-dimensional scanner, a spirometer, an abdominal belt (e.g., respiratory phase sensor 110 of FIG. 1). In some embodiments, the method further includes creating (3110) a point cloud on the patient's chest surface. The patient's respiratory volume measurements are determined from the point cloud on the patient's chest surface.

[0127] In some embodiments, the 3D point cloud is used to determine the patient's respiratory volume measurements without generating a mesh reconstruction of the patient's chest (e.g., the raw output of the 3D point cloud is used to generate the patient's respiratory volume measurements without generating a mesh). In some embodiments, the point cloud on the patient's chest surface is acquired using 3D imaging techniques to measure one or more locations on the patient's chest (3112). For example, 3D imaging techniques include laser scanning techniques such as light detection and ranging (LIDAR). Laser scanning techniques are highly beneficial because some lasers can accurately measure the location of the patient's chest even when the patient is wearing clothing (e.g., the patient wears LIDAR transparent clothing while undergoing method 3100).

[0128] In some embodiments, the method 3100 further includes identifying (3114) one or more anatomical landmarks on the patient's chest surface (e.g., externally visible landmarks such as clavicle, trachea, sternal notch, sternum, xiphoid process, spine, etc.) using the point cloud on the patient's chest surface. The method further includes inferring the location of one or more internal anatomical landmarks within the patient's chest (e.g., the location of the patient's lungs) from the point cloud on the patient's chest surface. In some embodiments, the method includes generating a reconstruction of the patient (e.g., generating a computer model for the patient, also referred to as a "virtual patient"). In some embodiments, generating the reconstruction of the patient includes generating a reconstruction of the patient's internal anatomical structure. In some embodiments, the reconstruction of the patient's internal anatomical structure includes a computer model (e.g., a 3D model) of tissue density. In some embodiments, the reconstruction includes or is used to determine the location of absorption cross-sections (e.g., x-ray absorption cross-sections) at multiple locations within the body. In some embodiments, the reconstruction of the patient is used to determine the x-ray dose delivered by the x-ray imaging device (e.g., for each image).

[0129] The method includes determining 3116 a respiratory phase of the patient from the patient's respiratory volume measurements while the patient is positioned in a first orientation relative to the x-ray imaging device and while obtaining the patient's respiratory volume measurements (e.g., in real time as the patient is breathing normally). In some embodiments, the patient's respiratory phase is defined by a lung volume. Thus, in some embodiments, determining the lung's respiratory phase includes determining a lung volume.

[0130] In some embodiments, operations 3102 and onward are performed as part of the imaging period of method 3100. Method 3100 further includes performing a training period prior to the imaging period during which information about the patient's normal breathing is obtained. For example, during the training period, patient breathing volume measurements are obtained at regular intervals over multiple breathing cycles of the patient (e.g., 15, 20, 50 cycles of the patient's breathing cycle are considered to correspond to one breath). The volume measurements from the training period are then used to associate specific volume measurements with specific breathing phases. For example, a volume measurement corresponding to a tidal volume of 400 ml is associated with the maximum inspiration phase, and a volume measurement corresponding to a tidal volume of 0 ml is associated with the maximum expiration phase. Additionally, statistics (e.g., histograms) regarding the patient's breathing may be obtained during the training period and used to verify that the breathing acquired during imaging is "normal" breathing (e.g., no deep breathing, no abnormal breathing, etc.).

[0131] During the imaging period, in some embodiments, the patient's respiratory phase that is determined (3118) is a future (e.g., predicted) respiratory phase. That is, in some embodiments, determining the patient's respiratory phase based on the patient's respiratory volume measurements includes predicting the future respiratory phase from one or more current and / or past respiratory phases. For example, the prediction is based on a time series of respiratory phases. In some embodiments, predicting the future respiratory phase from one or more current and / or past respiratory phases includes generating an autoregressive integrated moving average (ARIMA) model. In some embodiments, the prediction uses data from a training period.

[0132] The method includes gating 3120 an X-ray imaging device to generate X-ray projection images (sometimes referred to as projection images) of the patient's lungs when it is determined that the patient's respiratory phases are consistent with a predefined respiratory phase (e.g., the lung volume is consistent with a predefined lung volume). In some embodiments, the X-ray projection images are images taken at a particular angle (e.g., determined by the patient's orientation relative to the X-ray imaging device). In some embodiments, the X-ray projection images are obtained using a single X-ray exposure. In some embodiments, the method includes abandoning gating of the X-ray imaging device (e.g., abandoning exposing the patient to X-ray radiation) when it is determined that the patient's respiratory phases are not consistent with a predefined respiratory phase.

[0133] In some embodiments, the method includes determining whether a current breath is irregular from the patient's breath volume measurements, and further including abandoning gating (e.g., acquisition) of the X-ray imager if the current breath is determined to be irregular (e.g., continuing to wait for a suitable breath for acquiring X-ray projection images for the respiratory phase).

[0134] In some embodiments, the predefined respiratory phase is a first predefined respiratory phase of a plurality of predefined respiratory phases (3122). In some embodiments, the method further includes gating an x-ray imager to generate respective x-ray projection images of the patient's lungs if the patient's respiratory phase is determined to coincide with any of the plurality of predefined respiratory phases while acquiring the patient's respiratory volume measurements. In some embodiments, the x-ray projection images of the patient's lungs (e.g., x-ray measurements) are acquired (3124) only if the patient's respiratory phase as determined by the patient's respiratory volume measurements coincides with any one of the plurality of predefined respiratory phases. Thus, the total x-ray exposure of the patient is reduced.

[0135] In some embodiments, the plurality of predefined respiratory phases includes an early expiratory phase, a late expiratory phase, a maximum expiratory phase, an early inhalation phase, a late inhalation phase, and a maximum inhalation phase in a complete respiratory cycle of the patient (3126) (see, e.g., FIG. 14). In some embodiments, x-ray projection images are obtained for each of the plurality of predefined respiratory phases while the patient is positioned in a first orientation relative to the x-ray imaging device.

[0136] In some embodiments, the X-ray projection image is a first X-ray projection image (3128), and the method further includes repositioning the patient (e.g., rotating the patient and / or the X-ray imaging system) to a second orientation relative to the X-ray imaging device. In some embodiments, the method includes continuing to determine a respiratory phase of the patient based on the patient's respiratory volume measurements while the patient is positioned in the second orientation relative to the X-ray imaging device and while continuing to obtain respiratory volume measurements of the patient. In some embodiments, the method includes gating the X-ray imaging device to generate a second X-ray projection image of the patient's lungs when the patient's respiratory phase is determined to match a predefined respiratory phase.

[0137] In some embodiments, the method further includes generating a still image cube corresponding to a predefined respiratory phase using the first X-ray projection image and the second X-ray projection image (see, e.g., FIG. 21). In some embodiments, the still image cube is a three-dimensional reconstruction of the patient's lung volume. In some embodiments, the X-ray projection images are obtained for each of a plurality of predefined respiratory phases while the patient is positioned in each of a plurality of orientations (including a first orientation and a second orientation) relative to the X-ray imaging device. In some embodiments, the plurality of orientations includes at least five orientations (e.g., −45 degrees, −22.5 degrees, 0 degrees, 22.5 degrees, 45 degrees). In some embodiments, the plurality of orientations includes more than five orientations (e.g., six, seven, eight, or more orientations). In some embodiments, the X-ray projection images are not obtained except for the plurality of predefined respiratory phases while the patient is positioned in each of a plurality of orientations (including a first orientation and a second orientation) relative to the X-ray imaging device. Thus, x-ray projection images are acquired in five orientations and six different respiratory phases, resulting in a total of 30 x-ray projection images (e.g., the x-ray imaging device acquires only these images by gating as described above).

[0138] As previously described herein, these 30 x-ray projection images can be used to reconstruct a 3D biomechanical model of lung motion. In some embodiments, a still image cube corresponding to a given respiratory phase (see, for example, FIG. 21) is generated 3130 from less than 10 x-ray projection images taken from various angles during the given respiratory phase.

[0139] Those skilled in the art should appreciate that method 3100 may be applied to motions other than lung motion due to breathing. For example, in some embodiments, the method includes positioning a patient in a first orientation relative to an X-ray imaging device. The method further includes obtaining 3D measurements of the patient's body part (e.g., 3D measurements of a position of the patient's body part). The method further includes determining whether a trigger criterion is met for triggering radiation exposure by the X-ray imaging device based on the 3D measurements of the patient's body part while the patient is positioned in the first orientation relative to the X-ray imaging device and while obtaining the 3D measurements of the patient's body part, and gating the X-ray imaging device to generate an X-ray image of the patient if the trigger criterion is determined to be met. In some embodiments, the X-ray image is an image of a portion of the patient's body (e.g., the patient's leg, abdomen, skull, etc.). In some embodiments, the trigger criterion includes a criterion that is met when the 3D measurements of the patient's body part indicate that the patient's body part is in a predetermined position (e.g., with respect to the imaging device). In some embodiments, the method includes relinquishing gating control of the X-ray imager (e.g., relinquishing exposure of the patient to X-rays) if it is determined that the trigger criteria have not been met. Additionally, in some embodiments, the method 3100 may be applied to other imaging that is not strictly X-ray based, such as positron emission tomography (PET) imaging and MRI imaging.

[0140] Method 3100 may also be applied to radiation therapy and radiation imaging. For example, in some embodiments, the method includes positioning a patient in a first orientation relative to a radiation therapy source. The method further includes obtaining 3D measurements of the patient's body part (e.g., 3D measurements of a position of the patient's body part). The method further includes determining whether a trigger criterion is met for triggering radiation exposure by the radiation therapy source based on the 3D measurements of the patient's body part while the patient is positioned in the first orientation relative to the radiation therapy source and while obtaining the 3D measurements of the patient's body part, and gating the radiation therapy source and exposing the patient to radiation (e.g., exposing the patient's body part to radiation) if the trigger criterion is determined to be met. In some embodiments, the trigger criterion includes a criterion that is met when the 3D measurements of the patient's body part indicate that the patient's body part is in a predetermined position (e.g., with respect to the imaging device). In some embodiments, the method includes abandoning exposing the patient to radiation if the trigger criterion is determined to be not met.

[0141] The particular order of operations described in Figures 31A-31B is merely an example, and the order described is not meant to imply that the operations are the only order in which they can be performed. Those skilled in the art will appreciate that the operations described herein can be rearranged in various ways. Other processes described herein with respect to other methods described herein can also be applied in a manner similar to the method 3100 described above with reference to Figures 31A-31B. Such processes are described with reference to, for example, Figures 2, 6, 8, 11, 13, 15, 21, 23, 25, 27, 28A-28B, 32A-32B, 33A-33C, and 34A-34C. For the sake of brevity, detailed descriptions will be omitted.

[0142] 32A-32B are flow diagrams of a method (3200) for gating a radiation source at the coincidence of a patient's respiratory and cardiac phases. In some embodiments, some or all of the operations described below can be performed without human intervention (e.g., without intervention by a technician). In some embodiments, the method 3200 is performed by any of the devices described herein (e.g., the GREX imaging system 100 shown in FIG. 1). Some operations of the method 3200 are performed by a computer system including one or more processors and a memory storing instructions that, when executed by the one or more processors, cause the one or more processors to perform the operations of the method 3200. Some operations of the method 3200 may be combined or reordered in any manner.

[0143] The method includes positioning a patient in a first orientation relative to a radiation source (3202). In some embodiments, the radiation source is an x-ray imaging device (3204). In some embodiments, the radiation source is a radiation therapy source (3206). For example, as shown in FIGS. 3 and 35, a patient (e.g., patient 3502) is positioned in a first position relative to a radiation source 3504 (e.g., x-ray unit 108). In some embodiments, positioning the patient includes moving (e.g., rotating) the patient, as in operation 3102 (FIG. 31A), and in some embodiments, positioning the patient includes moving (e.g., rotating) the x-ray device (e.g., x-ray source and detector).

[0144] The method includes obtaining (3208) a patient respiration measurement (e.g., using a respiratory phase sensor). In some embodiments, the patient respiration measurement is a patient respiration volume measurement in operation 3104 (FIG. 31A). In some embodiments, the patient respiration measurement is not a patient respiration volume measurement (e.g., a timing-based patient respiration measurement).

[0145] The method includes obtaining (3210) a cardiac function measurement of the patient. In some embodiments, the patient's cardiac function is measured (3304) using one or more sensors. In some embodiments, an electrocardiogram (ECG) is used to measure the patient's cardiac function (e.g., a 3-lead or 12-lead ECG). In some embodiments, the method includes obtaining a plurality of measurements of the patient's cardiac function that provide a time series of electrical signals that control the movement of the patient's heart.

[0146] Returning to imaging, while the patient is positioned in a first orientation relative to the radiation source and while obtaining the patient's respiration measurements (3212), the method includes determining the patient's respiratory phase from the patient's respiration measurements (3214) and determining the patient's cardiac phase (e.g., real-time) from the patient's cardiac function measurements (3216). For example, in some embodiments, the patient's cardiac phase is determined using a Zero Instruction Set Computer (ZISC) processor, as described with reference to Figure 36. The ZISC processor can identify when a predefined landmark in the cardiac cycle occurs (e.g., an S wave or a T wave) during a single cardiac cycle or portion of a cardiac cycle.

[0147] In some embodiments, the method further includes obtaining (3218) measurements of the patient's cardiac function from multiple cardiac cycles of the patient before gating the radiation source to expose the patient to radiation (operation 3222, described below). In some embodiments, the method includes using the measurements of the patient's cardiac function obtained from the multiple cardiac cycles to determine an average interval between a predefined cardiac phase and a start of a predefined window of the cardiac cycle. For example, the predefined window of the cardiac cycle represents the interval between the top of the R wave and the start of the gating window. For example, in some embodiments, operations 3202 and subsequent operations are performed as part of an imaging period of the method 3200. The method 3200 further includes performing a training period prior to the imaging period during which information regarding the patient's cardiac function is obtained. For example, during the training period, the patient's cardiac function ECG measurements are obtained at regular intervals over multiple cardiac cycles (e.g., 15, 20, 50 cycles of the patient's cardiac cycle, where one cycle corresponds to one full period of cardiac motion, such as from any T wave to the next T wave). The ECG measurements from the training period are then used to predict periods of cardiac motion calm during the imaging period, as described below.

[0148] In some embodiments, the measurements obtained from multiple cardiac cycles of the patient are waveform measurements (3220) of the multiple cardiac cycles (e.g., ECG measurements), and the method includes validating the waveform measurements of the multiple cardiac cycles as being statistically stable.

[0149] The method further includes gating (3222) the radiation source to expose the patient to radiation based on determining that the patient's respiratory phase coincides with a predefined respiratory phase and determining that the patient's cardiac phase coincides with a predefined window of the cardiac cycle. In some embodiments, gating the radiation source exposes the patient's lungs to radiation. In some embodiments, the predefined cardiac window corresponds to a period of quiescence of cardiac motion (e.g., a period during the cardiac cycle during which cardiac motion is minimal, as described with reference to FIG. 12). In some embodiments, gating the radiation source during the same cardiac cycle as the determined cardiac phase. In this manner, gating the exposure of the patient's lungs based on the coincidence of the respiratory phase with the predefined cardiac phase window ensures that a precise region of the lungs (e.g., a precise region of lung tissue) is exposed to radiation without perturbation or motion due to cardiac motion.

[0150] In some embodiments, the radiation source is an x-ray imager. Gating the radiation source to expose the patient to radiation includes gating the x-ray imager to generate x-ray projection images of the patient's lungs (3224). In some embodiments, as per method 3100 of FIGS. 31A-31B, x-ray projection images can be acquired for the x-ray imaging source and multiple patient orientations for multiple respiratory phases. These x-ray projection images can be used to generate movies of lung motion and / or biophysical models of the lungs (e.g., relating lung tissue motion to biophysical parameters such as stress, strain, elasticity, etc.). In some embodiments, according to method 3200, these images are acquired within a predefined cardiac window to minimize lung perturbation or motion due to cardiac motion.

[0151] In some embodiments, the radiation source is a radiation therapy source. Gating the radiation source to expose the patient to radiation includes gating the radiation therapy source to deliver a therapeutic dose to a lung region of the patient (3226). In these situations, it is important to deliver as much radiation dose as possible to diseased tissue (e.g., cancerous tissue) and as little radiation dose as possible to healthy tissue. Method 3200 improves radiation therapy devices by precisely delivering a dose to diseased tissue while minimizing radiation delivered to healthy tissue.

[0152] In some embodiments, determining that the patient's cardiac phase coincides with the predefined window of the cardiac cycle is to predict (3228) the predefined window of the cardiac cycle by detecting the predefined cardiac phase in real time (e.g., using the BEMP card of FIG. 36) and waiting a length of time corresponding to the average interval between the predefined cardiac phase and the beginning of the predefined window of the cardiac cycle. For example, in some embodiments, the peak of the T wave is detected and the average interval from the T wave to the ideal gating window is waited, at which point the radiation source is gated.

[0153] The particular order of operations described in Figures 32A-32B is merely an example, and the order described is not meant to imply that the operations are the only order in which they can be performed. Those skilled in the art will appreciate that the operations described herein can be rearranged in various ways. Other processes described herein with respect to other methods described herein can also be applied in a manner similar to the method 3100 described above with reference to Figures 32A and 32B. Such processes are described, for example, with reference to Figures 2, 6, 8, 11, 13, 15, 21, 23, 25, 27, 28A-28B, 31A-31B, 33A-33C, and 34A-34C. For the sake of brevity, detailed descriptions will be omitted.

[0154] 33A-33C are flow diagrams of a method 3300 for fitting data from registered images to generate a model of lung mechanical properties, according to some embodiments of the present disclosure. In some embodiments, some or all of the operations described below can be performed without human intervention (e.g., without intervention by a technician). In some embodiments, the method 3300 is performed by any of the devices described herein (e.g., the GREX imaging system 100 shown in FIG. 1). Some operations of the method 3300 are performed by a computer system including one or more processors and a memory storing instructions that, when executed by the one or more processors, cause the one or more processors to perform the operations of the method 3300. Some operations of the method 3300 may be combined or reordered in any manner.

[0155] The method includes extracting (3302) a plurality of displacement fields of the lung tissue from a plurality of X-ray measurements (e.g., X-ray images, or also referred to as X-ray projection images) corresponding to different respiratory phases of the lung. Each displacement field represents a motion of the lung tissue from a first respiratory phase to a second respiratory phase, each respiratory phase having a corresponding set of biometric parameters. In some embodiments, the X-ray measurements are X-ray projection images (also referred to as X-ray projection images) acquired by method 3100 and / or method 3200. In some embodiments, extracting the displacement field from the lung tissue includes identifying a portion of the lung tissue in one or more first X-ray projection images from the first respiratory phase as corresponding to the same portion of the lung tissue in one or more second X-ray projection images from the second respiratory phase, and determining a displacement of the portion of the lung tissue from the first respiratory phase to the second respiratory phase (see, e.g., FIG. 28B). In some embodiments, the identification is performed using a deformable image registration algorithm, as discussed above.

[0156] In some embodiments, the plurality of x-ray measurements includes a plurality of x-ray images obtained at a first respiratory phase for each of a plurality of orientations of the x-ray imaging device relative to the patient, thereby forming a plurality of x-ray images corresponding to the first respiratory phase and a plurality of x-ray images corresponding to the second respiratory phase. In some circumstances, at least one of the x-ray images corresponding to the first respiratory phase was acquired during a different patient respiratory cycle than a different x-ray image corresponding to the first respiratory phase (e.g., the images were acquired during the same phase, but at a different breath). In some embodiments, the method includes grouping the plurality of x-ray images by respiratory phase.

[0157] In some embodiments, the method includes extracting a plurality of vector fields, of which the displacement field is an example.

[0158] In some embodiments, one or more sensors are used to measure (3304) the patient's biosignals as one or more time series sequences, including a 3D spatial position localizer (e.g., 3D spatial localizer 300 of FIG. 3), a respiratory phase sensor, and a cardiac phase sensor. In some embodiments, the 3D spatial position localizer is configured to measure (3306) the patient's body movements caused by breathing and cardiac rhythm in real time and output the measurements as a time series. In some embodiments, the respiratory phase sensor is configured to measure (3308) one or more physiological indicators related to the patient's breathing, including tidal volume and its first time derivative. In some embodiments, the cardiac phase sensor is configured to measure (3310) a periodic-stationary electrical signal (e.g., an ECG signal) generated by the patient's heart. For example, the cardiac phase sensor measures a periodic-stationary electrical signal having characteristics corresponding to cardiac phases.

[0159] In some embodiments, a patient's vital signs measured by one or more sensors are used to trigger (3312) an X-ray unit to acquire X-ray images of the patient at specific respiratory and cardiac phases (see, e.g., method 3200).

[0160] In some embodiments, the x-ray unit includes a clock (3314), and the patient's vital signs measured by the one or more sensors are synchronized with the x-ray unit's clock. In some embodiments, the respective values ​​of the vital signs are recorded in association with the acquired x-ray image.

[0161] In some embodiments, the patient's vital signs measured during the training frame are used to build 3316 an optimized respiratory prediction model to predict the desired respiratory phase at which to trigger the x-ray unit to take an x-ray image of the patient.

[0162] The method includes calculating (3318) one or more biophysical parameters of the lung biophysical model using the plurality of displacement fields of the lung tissue between the different respiratory phases of the lung and the corresponding set of bioparameters. In some embodiments, calculating the one or more biophysical parameters includes calculating one or more derivatives (e.g., curl, slope, etc.) of the displacement field. In some embodiments, the biophysical parameters are biomechanical parameters (e.g., stress, strain, modulus of elasticity, elastic limit, etc.). In some embodiments, the one or more biophysical parameters define a physical relationship between the plurality of displacement fields of the lung tissue and the bioparameters associated with the different respiratory phases of the lung (3320). In some embodiments, the set of bioparameters associated with each respiratory phase includes a tidal volume and airflow of the lung at each respiratory phase, and a cardiac phase corresponding to each respiratory phase (3322). In some embodiments, the physical relationship between the plurality of displacement fields of the lung tissue and the bioparameters associated with the different respiratory phases of the lung is defined by the following equation:

number

[0163]

number

number

number

number

number

[0164] In some embodiments, the different respiratory phases of the lungs include an early expiratory phase, a late expiratory phase, a maximum expiratory phase, an early inhalation phase, a late inhalation phase, and a maximum inhalation phase in a complete respiratory cycle of the patient (3324).

[0165] In some embodiments, the method further comprises displaying a visual representation of the biophysical parameter. For example, FIG. 30 shows a visual representation of the biophysical parameter,

number

[0166] In some embodiments, the method further includes generating a plurality of medical image cubes corresponding to different respiratory phases of the lungs from the plurality of X-ray measurements corresponding to different respiratory phases of the lungs (3326) (see, for example, FIG. 21). In some embodiments, a plurality of displacement fields of the lung tissue are extracted from the plurality of medical image cubes corresponding to different respiratory phases of the lungs by delineating the lung tissue from the remaining portion of the first medical image cube by image segmentation and determining, for each voxel in the first medical image cube, a displacement vector between the voxel in the first medical image cube and the second medical image cube using intensity-based structure mapping between the first medical image cube and the second medical image cube (3328). A plurality of displacement fields of the lung tissue are extracted from the plurality of medical image cubes corresponding to different respiratory phases of the lungs by iteratively refining the displacement vectors of different voxels in the first medical image cube and their counterparts in the second medical image cube.

[0167] In some embodiments, the method includes selecting (3330) one or more of the plurality of medical image cubes as a reference medical image cube; determining a set of bio-parameters associated with each reference medical image cube; selecting one set of bio-parameters based on lung bio-measurements between two sets of bio-parameters associated with the two reference medical image cubes; and simulating the medical image cube between the two reference medical image cubes by applying the set of bio-parameters based on the lung bio-measurements to a bio-physics model.

[0168] The particular order of operations described in Figures 33A-33C is merely an example, and the order described is not meant to imply that the operations are the only order in which they can be performed. Those skilled in the art will appreciate that the operations described herein can be rearranged in various ways. Other processes described herein with respect to other methods described herein can also be applied in a manner similar to the method 3100 described above with reference to Figures 32A and 32B. Such processes are described, for example, with reference to Figures 2, 6, 8, 11, 13, 15, 21, 23, 25, 27, 28A-28B, 31A-31B, 32A-32B, and 34A-34C. For the sake of brevity, detailed descriptions will be omitted.

[0169] 34A-34C are flow diagrams illustrating a method 3400 for generating a 3D X-ray image cube movie from 2D X-ray images of a patient. In some embodiments, some or all of the operations described below can be performed without human intervention (e.g., without intervention by a technician). In some embodiments, the method 3300 is performed by any of the devices described herein (e.g., the GREX imaging system 100 shown in FIG. 1). Some operations of the method 3400 are performed by a computer system including one or more processors and a memory storing instructions that, when executed by the one or more processors, cause the one or more processors to perform the operations of the method 3300. Some operations of the method 3400 may be combined or reordered in any manner.

[0170] In some embodiments, the patient's vital signs are measured (3402) as one or more time series sequences using one or more sensors, where the one or more sensors include a 3D spatial position localizer, a respiratory phase sensor, and a cardiac phase sensor (see, e.g., methods 3100 and 3200).

[0171] In some embodiments, the method further includes identifying a cardiac phase gate window using measurements from one or more cardiac phase sensors, predicting a respiratory phase using measurements from one or more respiratory phase sensors, identifying a coincidence between the cardiac phase gate window and the predicted respiratory phase to generate an X-ray imaging pulse, and tagging an X-ray image corresponding to the X-ray imaging pulse with the respiratory phase, cardiac phase, and 3D spatial position localizer measurements (3406) (see, e.g., method 3200).

[0172] In some embodiments, the 3D spatial position localizer is configured to measure 3408 the patient's body movements caused by breathing and heartbeat in real time and output them as a time series (see, e.g., methods 3100 and 3200).

[0173] In some embodiments, the respiratory phase sensor is configured to measure 3410 one or more physiological indicators related to the patient's respiration, including tidal volume and its first time derivative. For example, tidal volume rate varies with time and airflow.

[0174] In some embodiments, the cardiac phase sensor is configured to measure 3412 a periodic, steady-state electrical signal generated by the patient's heart and having characteristics corresponding to cardiac phases.

[0175] In some embodiments, after being synchronized with the X-ray unit's clock, two separate filters are used to remove signal drift and noise from the patient's biosignals (3414).

[0176] In some embodiments, the patient's vital signs measured by one or more sensors are used to trigger the x-ray unit to acquire 3416 x-ray images of the patient at specific respiratory and cardiac phases.

[0177] In some embodiments, the x-ray unit includes a clock (3418). Patient vital signs measured by one or more sensors are synchronized with the x-ray unit's clock. Each value of the vital sign is recorded in association with the acquired x-ray image.

[0178] In some embodiments, the patient's vital signs are measured (3422) during a training frame (e.g., a training period) before taking an x-ray image of the patient, and the patient's vital signs measured during the training frame include a number of complete respiratory cycles of the patient (see, e.g., methods 3100 and 3200).

[0179] In some embodiments, multiple tidal volume percentiles for a complete respiratory cycle are identified (3424) using the patient's biosignals measured during the training frame, with each tidal volume percentile corresponding to one of the different respiratory phases.

[0180] In some embodiments, the patient's vital signs measured during the training frame are used to build 3426 an optimized respiratory prediction model to predict the desired respiratory phase at which to trigger the x-ray unit to take an x-ray image of the patient.

[0181] In some embodiments, the optimized respiratory prediction model is based on an autoregressive integrated moving average (ARIMA) model (3428).

[0182] In some embodiments, the desired respiratory phase for taking x-ray images of the patient is configured (3430) to coincide with a cardiac gating window during which cardiac-induced lung motion is slowly changing.

[0183] In some embodiments, the cardiac gating window is selected 3432 based on the location of T and P waves in an electrocardiogram (ECG) signal, which slowly changes cardiac-induced pulmonary motion.

[0184] The method includes transforming (3434) the first plurality of sets of x-ray images of the lungs taken at different projection angles into a second plurality of sets of x-ray images of the lungs corresponding to different respiratory phases.

[0185] In some embodiments, converting the first plurality of sets of x-ray images of the lungs taken at different projection angles into a second plurality of sets of x-ray images of the lungs corresponding to different respiratory phases further includes taking the first plurality of sets of x-ray images of the lungs at different projection angles (3436). Each set of the first plurality of sets of x-ray images corresponds to a different respiratory phase of the lungs at a particular projection angle. In some embodiments, converting the first plurality of sets of x-ray images of the lungs taken at different projection angles into a second plurality of sets of x-ray images of the lungs corresponding to different respiratory phases further includes reorganizing the first plurality of sets of x-ray images of the lungs into a second plurality of sets of x-ray images of the lungs by associated respiratory phase. Each set of the second plurality of sets of x-ray images corresponds to a respective respiratory phase of the lungs.

[0186] In some embodiments, the x-ray images within any particular set are geometrically resolved and temporally independent (3438).

[0187] In some embodiments, different respiratory phases of the lungs correspond to different tidal volume percentiles of lung movement (3440).

[0188] In some embodiments, the different respiratory phases of the lungs include an early expiratory phase, a late expiratory phase, a maximum expiratory phase, an early inhalation phase, a late inhalation phase, and a maximum inhalation phase in a complete respiratory cycle of the patient (3442).

[0189] In some embodiments, multiple x-ray images of the lungs taken at different projection angles all correspond to the same respiratory phase (3444).

[0190] In some embodiments, different respiratory phases of the lungs at a particular projection angle are collected 3446 from at least two respiratory cycles.

[0191] The method includes generating (3448) a still image cube from each of the second plurality of sets of x-ray images at each respiratory phase using a backprojection method.

[0192] The method includes combining (3450) still image cubes corresponding to different respiratory phases of the lungs into a 3D X-ray image cube movie by time interpolation.

[0193] The particular order of operations described in Figures 34A-34C is merely an example, and the order described is not meant to imply that the operations are the only order in which they can be performed. Those skilled in the art will appreciate that the operations described herein can be rearranged in various ways. Other processes described herein with respect to other methods described herein can also be applied in a manner similar to the method 3100 described above with reference to Figures 34A-34C. Such processes are described, for example, with reference to Figures 2, 6, 8, 11, 13, 15, 21, 23, 25, 27, 28A-28B, 31A-31B, 32A-32B, and 33A-33C. For the sake of brevity, detailed descriptions will be omitted.

[0194] FIG. 35 is an example of a patient positioning fixture (PPF) 3501 (e.g., a rotating chair) that supports a patient (3502), according to some embodiments. In some embodiments, the PPF 3501 rotates (e.g., along rotation 3503) to position the patient (2502) at multiple angles (e.g., orientations) relative to a radiation source (3504) (e.g., an x-ray imaging system or a radiation therapy system). For example, the PPF moves to move the patient to a desired position (e.g., the patient does not have to move independently) so that the radiation device 3504 can take x-ray images of the patient at various angles. In some embodiments, the patient rotates (3502) through multiple angles (e.g., along rotation 3502) without rotating the PPF 3501. In some embodiments, the PPF 3501 and / or the patient 3205 automatically rotate and / or move (e.g., using a motor) to a desired position. In some embodiments, a technician rotates and / or moves the patient 3502. In some embodiments, the flat panel detector unit 3505 is positioned behind the patient relative to the radiation device 3504 .

[0195] In some embodiments, one or more cameras 3506-1 to 3506-m are used to detect objects within a predefined area (e.g., a room) surrounding the PPF 3501. For example, the camera 3506 captures whether an object collides with the PPF 3501 as the PPF 3501 moves around (and rotates within) the predefined area. In some implementations, some effort is made to avoid collisions with the PPF 3501 (and the patient 3502).

[0196] In some embodiments, one or more 3D imaging sensors (eg, LIDAR sensors or structured light sensors) are used to geometrically monitor the respiration of the patient 3502, as in method 3100.

[0197] FIG. 36 is an example of a Biological Event Monitoring Process (BEMP) card 3600. The BEMP card 3600 includes a programmable analog filter, a programmable analog-to-digital converter (ADC) / digital signal processor (DSP) 3605, and a Zero Instruction Set Computer (ZISC) processor 3606. The BEMP card 3600 receives an analog input signal 3602 that includes a patient's biosignal. In some embodiments, the analog input 3602 includes an ECG signal. In some embodiments, the analog input is a 3-lead ECG signal or a 12-lead ECG signal. The ZISC processor 3606 detects predefined patterns in the analog input in real time. For example, the ZISC processor 3606 detects an R-wave in the ECG signal to predict when the next quiescent period of the patient's cardiac cycle will occur (e.g., within a TP interval). In some embodiments, the ZISC processor 3606 outputs a ZISC 4-bit weighted output that can be used to trigger a radiation source (e.g., an X-ray imaging system or a radiation therapy system). In some embodiments, the clock signal 3603 of the BEMP card 3600 is provided from an external source, such as a radiation source, so that the BEMP card 3600 can be synchronized to the radiation source.

[0198] The computational techniques described in the post-processing software 106 section are computationally resource intensive. Many community hospitals and small clinics do not have the computer hardware required to create the animations, calculate the biomechanical models, and provide users with a fast and smooth experience. Because the functions of the post-processing software 106 are performed in the cloud, users can access the powerful visualization tools of the post-processing software 106 on their treatment consoles, office desktops, or work laptops.

[0199] 37A and 37B are flow charts illustrating a method 3700 for determining a dose of radiation to which a patient is exposed, according to some embodiments. In some embodiments, some or all of the operations described below can be performed without human intervention (e.g., without intervention by a technician). In some embodiments, the method 3700 is performed by any of the devices described herein (e.g., the GREX imaging system 100 shown in FIG. 1). Some operations of the method 3700 are performed by a computer system including one or more processors and a memory storing instructions that, when executed by the one or more processors, cause the one or more processors to perform the operations of the method 3700. Some operations of the method 3700 may be combined or reordered in any manner.

[0200] It should be noted that in some embodiments, method 3700 is performed during an imaging protocol or phase (e.g., rather than a calibration protocol or phase). Additionally, although certain embodiments are described below with respect to modeling and illuminating a patient's chest, it should be understood that method 3700 may be used to model and irradiate a first portion of a patient's body other than the patient's chest, according to other embodiments.

[0201] The method 3700 includes positioning 3702 a patient in a first orientation relative to a radiation source. In some embodiments, the radiation source is an X-ray imaging source. Positioning of the patient relative to the radiation source is described in more detail throughout this disclosure, for example with reference to the GREX imaging system shown in FIG. 1. For brevity, those details will not be repeated here.

[0202] The method 3700 further includes using 3D imaging technology to measure one or more locations of the patient's chest (e.g., one or more locations of a skin surface of the patient's chest) (3704). As described above, in some embodiments, the 3D imaging technology is used to measure a first portion of the patient's body that is not the patient's chest (e.g., the patient's abdomen, skull, legs, feet). In some embodiments, the 3D imaging technology uses (e.g., is based on) optical light or ultraviolet light (e.g., is a non-X-ray imaging technology) (3706). In some embodiments, the 3D imaging technology uses sound (e.g., is a sound wave or ultrasound 3D imaging technology). In some embodiments, the 3D imaging technology uses a 3D imaging detector that is different from an X-ray detector used for X-ray imaging. In some embodiments, the 3D imaging technology is not a computed tomography (CT) technology. In some embodiments, the 3D imaging technology uses frequencies of light that do not penetrate the surface of the human body. In some embodiments, the dose of radiation has a first frequency of light and the 3D imaging technique uses a second frequency of light that is different (e.g., at least an order of magnitude different) from the first frequency of light. In some embodiments, the 3D imaging technique is a multispectral imaging technique. In some embodiments, the 3D imaging technique does not rely on the transmission of radiation through the patient's chest (e.g., the 3D imaging technique is performed using a light source and a detector (e.g., a camera) that images the surface of the patient illuminated by the light source). In some embodiments, the light frequency penetrates clothing worn by the patient during the method (e.g., penetrates plain clothing). In some embodiments, the 3D imaging technique obtains an image of the surface of the patient's chest and uses the image of the surface of the patient's chest to measure one or more locations of the patient's chest. In some embodiments, the 3D imaging technique includes light detection / ranging (LIDAR) (3708).

[0203] In some embodiments, measuring one or more locations on the patient's chest includes creating (3710) a point cloud on a surface of the patient's chest (e.g., as described with reference to FIG. 38A).

[0204] In some embodiments, the method 3700 includes measuring (3712) one or more locations of the patient's chest using 3D imaging techniques, while performing the operations described with reference to 3714-3730.

[0205] The method includes generating (3714) a model of the patient's chest (e.g., a model of a shape of a surface of the patient's chest, or more generally, a model of a first portion of the patient's body) using the one or more positions of the patient's chest. In some embodiments, generating the model of the patient's chest includes identifying (3716) one or more anatomical landmarks on a surface of the patient's chest using data from the 3D imaging technique, and creating (3718) a model of the patient's chest (e.g., a spatial distribution of density of the patient's chest) based on the one or more anatomical landmarks, where the model of the patient's chest is a model of internal anatomical structures of the patient's chest. In some embodiments, updating the model of the patient's chest as the patient breathes includes updating the positions of the one or more anatomical landmarks, and updating the model of the internal anatomical structures based on the updated positions of the one or more anatomical landmarks. In some embodiments, the model of the internal anatomical structure of the patient's chest includes a plurality of model points corresponding to regions within the patient's chest, and each model point of the plurality of model points is associated with an x-ray cross-section (e.g., based on a corresponding electron density of body tissue that is determined to be associated with the model point, e.g., using data from a Medical Internal Radiation Dose (MIRD) anatomical database).

[0206] The method includes updating (3720) the model of the patient's chest as the patient breathes (e.g., repeatedly performing some or all of the operations described with reference to generating the model of the patient's chest such that the model of the patient's chest is a real-time or near real-time model of the patient's chest as the patient breathes).

[0207] The method includes exposing the patient to a dose of radiation using a radiation source (3722). In some embodiments, the dose of radiation is applied to the patient's chest (or more generally to a first portion of the patient's body). The dose is based on a model of the patient's chest (e.g., one or more exposure parameters, such as a dose magnitude and / or duration, are based on a model of the patient's chest for a current respiratory phase that corresponds to the time the patient is exposed to the dose of radiation). In some embodiments, the method includes determining the dose based on the model of the patient's chest (e.g., automatically, without human intervention). In some embodiments, the dose of radiation is determined without acquiring a calibration x-ray image (3724). In some embodiments, the dose of radiation is determined according to x-ray cross sections of model points along a path of the radiation. In some embodiments, the dose is determined based on x-ray cross sections (e.g., electron density) along a vector through the model of the patient's chest, the vector being along a direction of propagation of the radiation from the radiation source (e.g., the vector is a beam direction image through the patient connecting the radiation source to the x-ray imaging detector).

[0208] In some embodiments, the radiation source is a radiotherapy source (3726) and the dose is a therapeutic dose, hi some embodiments, the radiation source is an X-ray imaging source and the dose is a diagnostic dose (e.g., a dose sufficient to provide a predetermined signal-to-noise ratio in the resulting image).

[0209] In some embodiments, the patient is breathing normally (3728) (eg, the patient is not holding their breath) when (eg, during) exposed to the dose of radiation.

[0210] In some embodiments, the method 3700 includes adjusting (3730) a dose of radiation for each of the multiple exposures based on the updated model of the patient's chest (e.g., by adjusting a current in a linear accelerator being used to generate the dose of radiation) over the multiple exposures at different times while measuring one or more positions of the patient's chest using 3D imaging techniques and continuing to update the model of the patient's chest as the patient breathes. To that end, in some embodiments, the dose of radiation is a first dose of radiation of the multiple doses of radiation to which the patient is exposed. In some embodiments, the patient is exposed to a first dose of radiation at a first respiratory phase, the first dose of radiation being based on the model of the patient's chest at the first respiratory phase. In some embodiments, the method includes exposing the patient to a second dose of radiation at a second respiratory phase different from the first respiratory phase, the second dose of radiation being based on the updated model at the second respiratory phase. In some situations, the second dose of radiation is obtained while the patient is positioned in a first orientation relative to the radiation source, and the second dose of radiation is further based on the first orientation (e.g., based on a vector through a model of the patient's chest). In some situations, the second dose of radiation is obtained while the patient is positioned in a second orientation relative to the radiation source, and the second dose of radiation is further based on the second orientation (e.g., based on a vector through a model of the patient's chest).

[0211] It should be noted that method 3700 may be used to determine radiation parameters for any of the radiation exposures described herein. For example, method 3700 may be combined with any of the other methods described herein to determine the dose and / or length of radiation exposure. Thus, for example, a biophysical model of the patient's lungs may be generated at the appropriate dose, as described with reference to method 3300.

[0212] 38A-38C illustrate a process for generating a model of a patient's chest, according to some embodiments. FIG. 38A illustrates the results of measurements of locations on a patient's chest 3800 using 3D imaging techniques (e.g., LIDAR, etc.). For example, in some embodiments, measurements of the location of the patient's chest (e.g., the location of the skin surface) are used to generate a point cloud 3802 on the surface of the patient's chest. As shown in FIG. 38B, one or more anatomical landmarks (such as the umbilicus of the patient 3800 and / or a portion of the clavicle of the patient 3800) may be identified from the point cloud. In some embodiments, as shown in FIG. 38C, a model (e.g., a 3D or internal model) of the patient's chest is based on the one or more anatomical landmarks. For example, in some embodiments, creating the model of the patient's chest includes scaling (e.g., "rigging") known skeletal and / or soft tissue structures based on the locations of the anatomical landmarks. For example, creating a model of a patient's chest may include generating model points having x-ray cross sections corresponding to the clavicle, sternal notch, sternum, xiphoid process, vertebrae, humerus, and other bones.

[0213] Throughout this specification, the terms "in an embodiment," "in some embodiments," "in one embodiment," "in another example," "in an example," "particular examples," or "some examples" mean that a particular feature, structure, material, or characteristic described in connection with an embodiment or example is included in at least one embodiment or example of the disclosure. Thus, the appearance of phrases such as "in some embodiments," "in one embodiment," "in another example," "in one example," "in a particular example," or "in some examples" in various places throughout this specification do not necessarily refer to the same embodiment or example of the disclosure. Furthermore, the particular features, structures, materials, or characteristics may be combined in any suitable manner in one or more embodiments or examples.

[0214] Although the embodiments have been presented and described above, it should be understood by those skilled in the art that the above embodiments do not limit the present disclosure, and that changes, substitutions, and modifications can be made without departing from the principle, spirit, and scope of the present disclosure.

Claims

1. A method for X-ray imaging executed by one or more processors included in a system, comprising: Positioning a patient in a first orientation relative to an x-ray imaging source; measuring one or more locations of the patient's chest using a 3D imaging technique different from X-ray imaging; measuring the one or more locations of the patient's chest using the 3D imaging technique; generating a model of the patient's chest using the one or more locations of the patient's chest; and updating the model of the patient's chest as the patient breathes; obtaining a plurality of x-ray images of the patient's chest, obtaining a first x-ray image of the patient's chest during a first respiratory stage, exposing the patient to a first dose of radiation using the x-ray imaging source, the first dose of radiation being calculated based on the model of the patient's chest, and a first magnitude of the dose being based on the model of the patient's chest during the first respiratory stage; acquiring a second x-ray image of the patient's chest at a second respiratory stage after the first x-ray image of the patient's chest has been acquired, exposing the patient to a second dose of radiation using the x-ray imaging source, the second dose of radiation being calculated based on the model of the patient's chest at the second respiratory stage, the second dose having a second magnitude different from the first magnitude; The method, wherein the first breathing stage or the second breathing stage is during an inspiration phase.

2. The method of claim 1 , wherein the 3D imaging technique uses optical light or ultraviolet light.

3. The method of claim 1 or 2, wherein the 3D imaging technique comprises Light Detection and Ranging (LIDAR).

4. The method of claim 1 , wherein the first or second dose of radiation is determined without obtaining a calibration x-ray image.

5. generating the model of the patient's chest, using data from the 3D imaging technique to identify one or more anatomical landmarks on a surface of the patient's chest; 5. The method of claim 1, further comprising: creating a model of the patient's chest based on the one or more anatomical landmarks, wherein the model of the patient's chest is a model of the internal anatomical structures of the patient's chest.

6. The method of any one of claims 1 to 5, wherein the patient is breathing normally when exposed to the first or second dose of radiation.

7. The method of any one of claims 1 to 6, wherein measuring the one or more locations of the patient's chest comprises creating a point cloud on a surface of the patient's chest.

8. 8. The method of any one of claims 1 to 7, wherein exposing the patient to the first or second doses of radiation using the x-ray imaging source based on the model of the patient's chest comprises adjusting the first or second doses of radiation over multiple exposures at different times.

9. The method of claim 1 , wherein the first x-ray image and the second x-ray image are acquired at different respiratory phases.

10. The method of claim 1 , wherein the first x-ray image is acquired midway through an inspiration phase of the patient.

11. The method of claim 10 , wherein the second x-ray image is acquired midway through the patient's exhalation phase.

12. 1. A non-transitory computer-readable storage medium storing instructions that, when executed by a system including one or more processors, cause the one or more processors to: Positioning a patient in a first orientation relative to an x-ray imaging source; measuring one or more locations of the patient's chest using a 3D imaging technique different from X-ray imaging; measuring the one or more locations of the patient's chest using the 3D imaging technique; generating a model of the patient's chest using the one or more locations of the patient's chest; and updating the model of the patient's chest as the patient breathes; obtaining a plurality of x-ray images of the patient's chest, obtaining a first x-ray image of the patient's chest during a first respiratory stage, exposing the patient to a first dose of radiation using the x-ray imaging source, the first dose of radiation being calculated based on the model of the patient's chest, and a first magnitude of the dose being based on the model of the patient's chest during the first respiratory stage; acquiring a second x-ray image of the patient's chest at a second respiratory stage after the first x-ray image of the patient's chest has been acquired, exposing the patient to a second dose of radiation using the x-ray imaging source, the second dose of radiation being calculated based on the model of the patient's chest at the second respiratory stage, the second dose having a second magnitude different from the first magnitude; The first respiratory stage or the second respiratory stage is during an inspiration phase.

13. A non-transitory computer readable storage medium storing instructions that, when executed by a system including one or more processors, cause the one or more processors to perform the method of any one of claims 2 to 11.

14. 1. A system comprising: one or more processors; and a memory storing instructions that, when executed by the one or more processors, cause the one or more processors to: Positioning a patient in a first orientation relative to an x-ray imaging source; measuring one or more locations of the patient's chest using a 3D imaging technique different from X-ray imaging; measuring the one or more locations of the patient's chest using the 3D imaging technique; generating a model of the patient's chest using the one or more locations of the patient's chest; and updating the model of the patient's chest as the patient breathes; obtaining a plurality of x-ray images of the patient's chest, obtaining a first x-ray image of the patient's chest during a first respiratory stage, exposing the patient to a first dose of radiation using the x-ray imaging source, the first dose of radiation being calculated based on the model of the patient's chest, and a first magnitude of the dose being based on the model of the patient's chest during the first respiratory stage; acquiring a second x-ray image of the patient's chest at a second respiratory stage after the first x-ray image of the patient's chest has been acquired, exposing the patient to a second dose of radiation using the x-ray imaging source, the second dose of radiation being calculated based on the model of the patient's chest at the second respiratory stage, the second dose having a second magnitude different from the first magnitude; The system, wherein the first breathing stage or the second breathing stage is during an inspiration phase.

15. 1. A system comprising: one or more processors; A system comprising: a memory storing instructions which, when executed by said one or more processors, cause said one or more processors to perform a method according to any one of claims 2 to 11.

Citation Information

Patent Citations

  • Respiration monitoring / Treating system

    JP1994054916A

  • Patient-specific and automated X-ray system adjustments based on optical 3D scene detection and interpretation.

    JP2015526231A

  • Medical image processing apparatus, medical image processing method, program, and medical image processing system

    JP2019130275A

  • Image processing method

    WO2015114834A1