Systems and methods for acquiring image data and generating images.
By acquiring projections from multiple poses and performing image stitching and reconstruction, the problem of imaging systems covering the entire subject's appearance was solved, achieving high-quality image data acquisition and 3D reconstruction.
Patent Information
- Application Number
- CN202580026560.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2024-04-05
- Filing Date
- 2025-04-02
- Publication Date
- 2026-11-10
AI Technical Summary
Existing imaging systems struggle to effectively cover areas or volumes of the subject beyond the range of a single pose when acquiring image data, resulting in incomplete image data and affecting the accuracy of 3D reconstruction.
By acquiring projections at multiple poses through the source and/or detector of a moving imaging system, and combining image stitching and reconstruction techniques, long views and 3D reconstructions are generated, utilizing multiple projection data to cover the full picture of the subject.
It enables the acquisition of complete image data of the subject's full appearance, improves the accuracy and completeness of 3D reconstruction, and ensures the appropriate quantity and quality of image data.
Smart Images

Figure CN123076898A_ABST
Abstract
Description
[0001] Cross-references to related applications
[0002] This application claims the benefit of U.S. Provisional Patent Application Serial No. 63 / 575,521, filed April 5, 2024, and U.S. Patent Application No. 63 / 575,492, filed April 5, 2024, the entire contents of which are incorporated herein by reference.
[0003] This application includes subject matter relating to concurrently filed U.S. Patent Application No. 63 / 575,492 (Attorney’s File No. A0012593US01 / 5074A-000331-US-PS1). The entire disclosure of each of the foregoing applications is incorporated herein by reference. Technical Field
[0004] This disclosure relates to imaging a subject, and more particularly to a system and method for acquiring image data for generating selected image visualizations. Background Technology
[0005] This section provides background information in connection with this disclosure, which is not necessarily prior art.
[0006] The subject (such as a human patient) may undergo surgery. This surgery may include procedures to correct or enhance the subject's anatomy. Enhancement of anatomy may include various procedures such as bone movement or reinforcement, insertion of implants (i.e., implantable devices), or other appropriate procedures.
[0007] Surgeons can use images of the subject based on the subject's projection to perform surgery on the subject. These images can be generated using imaging systems such as magnetic resonance imaging (MRI), computed tomography (CT), fluorescence examination (e.g., C-arm imaging), or other suitable imaging systems. Summary of the Invention
[0008] This section provides a general overview of this disclosure and is not a full disclosure of the complete scope or all features of this disclosure.
[0009] According to various embodiments, a system that utilizes an imaging system to acquire image data of a subject may use X-rays. The subject may be a living patient (e.g., a human patient). The subject may also be, or alternatively, an inanimate subject, such as a shell, enclosure, etc. The imaging system may include a movable source and / or a detector movable relative to the subject or object.
[0010] The imaging system may include a movable source and / or detector to create one or more projections of the subject. These one or more projections may be acquired along the movement path of the source and / or detector. The multiple projections may then be combined, for example, by stitching them together, to generate or form a long view (also known as a long film). Various projections may also, or alternatively, be combined with selected techniques to include a range of image data not present in a single projection. Therefore, multiple projections may include more than one projection acquired relative to the same pose (e.g., position and orientation) of the subject.
[0011] Imaging systems can be used to acquire image data of a subject at various poses relative to the subject. However, a subject may include a volume larger than a set or defined area or volume that can be imaged by a portion of the imaging system at a single pose. For example, a subject may include an area or size beyond what the imaging system can image at a single pose. Therefore, to acquire image data of the subject's full size, the imaging system can be positioned at multiple poses relative to the subject. Furthermore, if more than one projection is needed to acquire the entire area of the subject, it may also be necessary to acquire a sufficient number of projections and specific poses to generate a 3D reconstruction of the subject. The multiple projections used to acquire the image data can be determined or analyzed by the user or the system before acquiring the subject's image data.
[0012] The image data acquired from the subject can be differentiated or determined based on the type of image data acquired. For example, an imaging or control system can provide the user with output or information about the type or amount of image data to be acquired for a selected reconstruction. The user can review or analyze the output to determine or select the area to be imaged. The output can be provided to an analysis system or processor to evaluate the data to be acquired and / or where appropriate data will be needed.
[0013] Therefore, the imaging system can be operated to acquire image data of the subject in an appropriate manner to generate selected images. In various implementations, more than one image projection can be acquired at more than one pose to ensure that an appropriate amount of image data about the subject is acquired. The acquired image data can be acquired at more than one pose to allow for the reconstruction of images of the subject in a selected manner.
[0014] Further areas of applicability will become apparent from the description provided herein. The descriptions and specific examples in this overview are intended for illustrative purposes only and are not intended to limit the scope of this disclosure. Attached Figure Description
[0015] The accompanying drawings described herein are for illustrative purposes only, representing the selected embodiments and not all possible specific implementations, and are not intended to limit the scope of this disclosure.
[0016] Figure 1 This is an environmental view of the imaging system in the operating room; Figure 2 This is a detailed schematic diagram of an imaging system with a dual energy source system; Figure 3 This is the display of the imaging system parameter selection interface; Figure 4 It is a schematic diagram of one or more poses of the detector relative to the source point at one or more points according to various implementation schemes; Figure 5 These are schematic examples of long view images according to various implementation schemes, wherein the field of view is superimposed at a selected location relative to the long view image; Figure 6 These are schematic examples of long view images according to various implementation schemes, wherein the field of view is superimposed at a selected location relative to the long view image; Figure 7 These are schematic examples of long view images according to various implementation schemes, wherein the field of view is superimposed at a selected location relative to the long view image; Figure 8 These are exemplary views of two poses of a long view image according to various implementation schemes; Figure 9 It is a flowchart of the process for acquiring image data according to various implementation schemes; Figure 10 It is a schematic diagram of the 3D reconstruction estimation process and images; Figure 11 It is a schematic illustration of the filled area and the actual projected image; and Figure 12 This is a schematic diagram of the back projection process and the filled region image data generated from the 3D reconstructed image.
[0017] In several views of the accompanying drawings, corresponding reference numerals indicate the corresponding components. Detailed Implementation
[0018] The example implementation will now be described in more complete form with reference to the accompanying drawings.
[0019] This subject matter disclosure relates to exemplary embodiments of surgical procedures performed on subjects such as human patients. However, it should be understood that the systems and methods described herein are merely exemplary and are not intended to limit the scope of the claims included herein. In various embodiments, it should be understood that the systems and methods can be incorporated into and / or used on inanimate objects. For example, these systems can be used to image and register coordinate systems between two systems for use in manufacturing and maintenance systems, etc. For example, automobile assembly may use one or more robotic systems comprising separate coordinate systems that can be registered together for coordinated or joint actions. Therefore, the exemplary description of surgical procedures herein is not intended to limit the scope of the appended claims.
[0020] Individual components and their parts can also be tracked relative to a subject. For example, a tracking system can be incorporated into a navigation system to allow tracking and navigation of one or more instruments (which may be components) that can be tracked relative to a subject. The subject can also be tracked. The navigation system may include one or more tracking systems that track individual parts associated with the instrument, such as tracking devices. The tracking system may include a locator configured to determine the pose of the tracking device in the navigation system coordinate system. The pose may include any number of degrees of freedom, such as three-dimensional position (e.g., x, y, z) and orientation (e.g., yaw, pitch, and roll). Techniques, systems, or processes for determining the navigation system coordinate system may include those described in various references, including U.S. Patent Nos. 8,737,708, 9,737,235, 8,503,745, 8,175,681, and 11,135,025, all of which are incorporated herein by reference. Specifically, the locator is capable of tracking an object within a volume relative to a subject. The navigation volume in which the tracking device can be located may include, or be referred to as, a navigation coordinate system or navigation space. The determination or correlation between two coordinate systems may be, or also referred to as, registration between two coordinate systems.
[0021] Image data can be acquired for use and / or to generate images of selected portions of a subject (which may also be referred to as image visualization). The images can be displayed for viewing by users such as surgeons. In various embodiments, a graphical representation of the tracked portion or component (such as an instrument) can be superimposed on at least a portion of the image. This graphical representation can be entirely (e.g., generated by a processor module executing instructions) as a graphical representation of the instrument. According to various embodiments, the graphical representation can be superimposed on the image at an appropriate pose due to registration of the image space (also referred to as an image coordinate system) with the subject space. Methods for registering a subject-defined space to an image space can include those disclosed in U.S. Patent Nos. 8,737,708, 9,737,235, 8,503,745, and 8,175,681, all of which are incorporated herein by reference.
[0022] During the selected surgical procedure, due to the selected procedure, such as imaging of the subject, a first coordinate system can be registered to the subject space or the subject coordinate system. In various embodiments, the first coordinate system can be registered to the subject by imaging the subject using a reference point portion fixed relative to a first component or system (such as a robotic system or other instrument). The known position of the reference point relative to any portion (such as the robotic system or the subject) can be used to register the subject space relative to any coordinate system in which the reference point can be determined (e.g., by imaging or detection (e.g., touch)). Registration of the second coordinate system can allow tracking of additional elements not fixed to the first portion, such as a robot with a known coordinate system.
[0023] Tracking of instruments during surgery (such as surgical procedures or treatments) allows for surgical navigation. Navigation can be used to determine the pose of one or more parts, such as instruments. The pose can include any number of degrees of freedom, such as three-dimensional position (e.g., x, y, z) and orientation (e.g., yaw, pitch, and roll). When image data is used to define an image space, it can be correlated or registered with a physical space defined by a subject, such as a patient. Thus, according to various embodiments, the patient defines a patient space in which instruments can be tracked and navigated. The image space defined by the image data can be registered to the patient space defined by the patient. Registration can be performed using reference points that can be identified in both the image data and the patient space.
[0024] Figure 1This is a schematic diagram illustrating an overview of an operating room or surgical environment. In various embodiments, the operating room may include a surgical area where the robotic system 20 and a navigation system 26, which can be used for various surgical procedures, may be housed. The robotic system 20 may include those sold by Mazor Robotics Ltd., which has a presence in Israel, and / or Medtronic, Inc., which has a presence in Minnesota, USA, and / or those disclosed in U.S. Patent No. 11,135,025, such as the Mazor X. ™ A robotic guidance system, which is incorporated herein by reference, is described herein. The robotic system 20 can be used to assist in guiding selected instruments, such as drill bits, screws, ultrasonic (US) probes 33, etc., relative to a subject 30.
[0025] Robotic system 20 may include a mounting 34, such as a robotic base 38, that is fixed in place relative to subject 30. Robotic system 20 may include one or more arms 40, such as those including an end effector 44, which are capable of movement or pivoting relative to subject 30. The end effector 44 may be any suitable component, such as a tube, guide, or channel member. An imaging system, such as a US probe 33, may be attached to and / or replace the end effector. Robotic processor module 53 may be used to control (e.g., execute instructions) the movement of the end effector and determine its pose, such as relative to base 34. Due to the registration discussed above and executively disclosed in U.S. Patent No. 11,135,025, the pose of base 34 may be known in a coordinate system (such as the patient space and / or image coordinate system of patient 30), which is incorporated herein by reference.
[0026] Navigation system 26 can be used to navigate various parts based on the poses tracked by one or more tracking devices, including robot tracking device 54, subject tracking device 58, imaging system tracking device 62, tool tracking device 66, and / or US probe tracking device 81. Each tracking device can be used to track one or more parts, including those exemplified as being attached to the corresponding tracking device.
[0027] The imaging device or system 80 may be an additional or alternative imaging system that can be used to acquire preoperative, intraoperative, or postoperative or real-time image data of a subject (such as subject 30) and can be tracked using the image system tracking device 62. However, it should be understood that any suitable subject can be imaged, and any suitable surgery can be performed relative to the subject. In the example shown, the imaging device 80 includes an O-arm sold by Medtronic Navigation, Inc., which has a business location in Louisville, Colorado, USA. ® Imaging apparatus. Imaging apparatus 80 may have a generally annular stage housing 82 in which an image capture portion is movably disposed. Imaging apparatus 80 may include those disclosed in: U.S. Patent Nos. 7,188,998, 7,108,421, 7,106,825, 7,001,045, and 6,940,941; all of which are incorporated herein by reference in any appropriate portion thereof. It should also be understood that imaging apparatus 80 may additionally or alternatively include a fluorescein C-arm. Other exemplary imaging apparatuses may include fluoresceins, such as dual-plane fluorescein systems, overhead fluorescein systems, catheterization lab fluorescein systems, fixed C-arm fluorescein systems, isocentric C-arm fluorescein systems, 3D fluorescein systems, etc. Other suitable imaging apparatuses may also include MRI, CT, ultrasound, etc. Various imaging systems may include or use one or more imaging modalities, such as X-ray, magnetic resonance, ultrasound, positron emission tomography (PET) scans, combinations thereof, etc.
[0028] The position of the imaging systems 33, 80 and / or portions thereof (such as the image capture portion) can be precisely known relative to any other portion of the imaging devices 33, 80. Furthermore, a corresponding tracking device can be used to track one or more portions of the respective imaging system. Precise positioning and / or tracking can allow the imaging systems 33, 80 and / or the navigation system 26 to know their position relative to the patient 30 or other references. Additionally, as discussed herein, precise knowledge of the position of the image capture portion can be used in conjunction with the tracking system to determine the position of the image capture portion and image data relative to the tracked subject (such as patient 30). The pose (e.g., the distance between the US probe 33 and / or selected portions of the tracking device 81) can be determined or predetermined and stored for retrieval via a calibration process and / or fixtures (such as those disclosed in U.S. Patent Nos. 7,831,082, 8,320,653, and 9,138,204, all of which are incorporated herein by reference).
[0029] The imaging device 80 can be controlled by a controller, which may include one or more processor modules 97. Therefore, portions of the imaging system 80 can be in known and / or controlled poses relative to other portions (such as a gantry). Furthermore, the imaging system 80 can be tracked by a tracking device 62. As discussed herein, this allows the pose of one or more portions of the imaging system 80 to be known at selected times (such as when image data of the subject 30 is acquired by the navigation system 26). Furthermore, the pose of the imaging system or portions thereof can be planned and moved to a planned pose relative to the subject 30. Additionally, the tracking device 81 can be directly associated with the US probe 33. Therefore, the US probe 33 can be directly tracked using a navigation system as discussed herein. Alternatively or concurrently, the US probe 33 can be located and tracked using the robotic system 20. In any case, according to various embodiments, image data defining the acquired image space of the patient 30 can be registered relative to an object space (e.g., manually, inherently, or automatically). The object space can be the space defined by the patient 30 in the navigation system 26.
[0030] Patient 30 can also be tracked using a patient tracking device, DRF, or tracker 58 as the patient moves. Alternatively or otherwise, patient 30 can be fixed within a navigation space defined by navigation system 26 to allow for registration. As further discussed herein, registration of the image space with the patient space or subject space allows for navigation of device 68 using image data. When navigating device 68, the position of device 68 can be exemplified on display device 84 relative to acquired image data of patient 30. Additional and / or alternative display devices 84' may also be present to display images. Various tracking systems, such as tracking systems including optical locator 88 or electromagnetic (EM) locator 92, can be used to track device 68.
[0031] One or more tracking systems may be used to track the device 68 in the navigation system 26 and / or any other tracking device. According to various embodiments, these tracking systems may include an EM system with an electromagnetic tracking (EM) locator 94, an optical tracking system with an optical locator 88, and / or other suitable tracking systems not illustrated, such as an ultrasonic tracking system or other suitable tracking systems. As discussed herein, one or more of the tracking systems may be used to track the selected tracking devices sequentially or simultaneously. It should be understood that, unless otherwise discussed, a tracking device may be a part capable of being tracked using the selected tracking system. A tracking device does not necessarily refer to the entire component or structure to which the tracking device is attached or associated.
[0032] Image data acquired from imaging systems 33, 80, or any suitable imaging system may be acquired at an imaging device controller 96 and / or forwarded from the imaging device controller to a navigation computer and / or processor system 102, which may include a processor module 97. The navigation computer and / or processor system may be part of a controller or workstation 98 having a display 84 and a user interface 106. The processor system 102 may be a processor module as discussed herein, including integrated memory or communication systems to access external memory to execute instructions and / or operate as a specific integrated circuit (e.g., an ASIC). It is also understood that image data may not necessarily be stored in the controller 96 first, but may be sent directly to the workstation 98. The workstation 98 may provide facilities for displaying image data as image 108 on the display 84 and for saving, digitally processing, or printing hard copies of the received image data. The user interface 106, which may be a keyboard, mouse, stylus, touchscreen, or other suitable device, allows the user 72 to provide input to control the imaging device 80 or adjust image settings on the display 84 via the imaging device controller 96. Workstation 98 can also instruct image device controller 96 to adjust the image capture portion of imaging device 80 to obtain various two-dimensional images along different planes, thereby generating one or more representative two-dimensional and three-dimensional image data, which can be used to generate two-dimensional images, three-dimensional images, or more than one or both.
[0033] Continue to refer to Figure 1 The navigation system 26 may also include any one or more tracking systems, such as tracking systems including either or both of electromagnetic (EM) locators 94 and / or optical locators 88. The tracking system may include a controller and interface portion 110. The controller 110 may be connected to a processor portion 102, which may include a processor contained within a computer. The EM tracking system may include a Stealth Station sold by Medtronic Navigation, Inc., which has a business location in Louisville, Colorado. ® AXIEM ™ Navigation system; or may be an EM tracking system as described in U.S. Patent Nos. 7,751,865, 5,983,126, 5,913,820, or 5,592,939, all of which are incorporated herein by reference. It should be understood that navigation system 26 may also be or include any suitable tracking system, including STEALTHSTATION having an optical locator that can be used as an optical locator 88. ® TREON ® or S7 ™The tracking system is sold by Medtronic Navigation, Inc., located in Louisville, Colorado. Other tracking systems include acoustic, radiation, radar, etc. Navigation system 26 and / or the tracking system may be a hybrid system comprising components from multiple tracking systems. The tracking system may be used according to techniques generally known or described in the references combined above. Details are omitted herein unless the chosen operation disclosed in the subject matter is clearly stated.
[0034] Various parts of the navigation system 26, such as the device 68, and other parts described in detail below, may be equipped with at least one and typically multiple tracking devices 66. The device may also include more than one type or form of tracking device 66, such as an EM tracking device and / or an optical tracking device. According to various embodiments, the navigation system 26 can be used to track the device 68 relative to a patient 30. As discussed above, the tracking system can be used to track the device 68. Image data of the patient 30 or an appropriate subject can be used to assist the user 72 in guiding the device 68. Image data, which may include one or more images, can be registered to the patient 30. The image data defines an image space that is registered to a patient space defined by the patient 30. Registration can be performed automatically, manually, or in combination thereof, as discussed herein.
[0035] Typically, registration allows the generation of a transformation mapping of the physical position of the instrument 68 relative to the image space of the image data. This transformation mapping allows the tracking position of the instrument 68 to be displayed on the display device 84 relative to the image 108. A graphical representation 68i (also called an icon) can be used to illustrate the position of the instrument 68 relative to the image data 108.
[0036] Continue to refer to Figure 1 The subject registration system or method may use tracking device 58. Tracking device 58 may include trackable portions or components 120, but may also serve as or be operable as a reference point assembly. A clamp or other fixation portion 124 may be connected to the imageable reference point portion 120. Reference point portion 120 may include one or more individual or discrete components (e.g., spheres), or may include an interconnection of imageable portions (e.g., lines). However, it should be understood that reference point portion 120 may be separate from tracking device 58. Fixation portions 124 may be provided to fix any suitable portion, such as a portion of an anatomical structure. Figure 1 As illustrated, the reference point portion 120 may interconnect with vertebra 126 and / or portions of vertebra 126 that may form a vertebral column. In various embodiments, the connection may be to a spur. However, the reference point portion 120 may connect to any suitable portion, such as the skull, pelvis, etc.
[0037] For further reference Figure 2The imaging system 80 can move entirely or partially relative to the subject 30. For example, the source 174 and detector 178 can move 360° around the patient 30. The movement of the source 174 and detector 178 as a source / detector unit 198 within the gantry 82 can allow the source 174 to remain approximately 180° relative to the detector 178 (e.g., having a fixed internal gantry or rotor or moving system). Thus, the detector 178 can be described as moving around or around the subject 30 (e.g., in a circle or spiral), and it should be understood that, unless otherwise disclosed, the source 174 remains relative to the subject. However, as discussed herein, the detector can move relative to the source in small or very small amounts (e.g., arc lengths of about one degree (°) to about 30°, 5° to about 20°, 5° to about 15°, etc., and increments therein).
[0038] Furthermore, the platform 82 can be moved (also referred to as "swinging") approximately equidistantly about axis 202 in the direction of arrow 200 relative to the subject 30, such as by means of a trolley 160. Figure 1 As illustrated, the stand 82 may also be tilted relative to the long axis 31 of the patient 30, as illustrated by arrow 210. When tilted, the plane of the stand 82 may be tilted or form a non-orthogonal angle with the axis 206 of the subject 30.
[0039] The platform 82 can also move longitudinally relative to the subject 30 and / or the cart 160 along line 206 in the direction of arrow 214. Furthermore, the cart 160 can be moved to move the platform 82. Additionally, the platform 82 can move generally vertically relative to the cart 160 and / or the subject 30 in the direction of arrow 218, generally transverse to axis 206 and parallel to axis 202.
[0040] The imaging system 80 can be moved, either wholly or partially, to allow for the positioning of the source / detector unit (SDU) 198 relative to the subject 30. The imaging device 80 can be precisely controlled to move the SDU 198 relative to the subject 30 to generate accurate image data of the subject 30.
[0041] As discussed herein, source 174 may comprise one or more x-ray sources for imaging subject 30. In various embodiments, source 174 may comprise a single source that may be powered by more than one power source to generate and / or emit x-rays with different energy characteristics. In various embodiments, the source may emit x-rays at at least two different powers (such as with varying voltages). Furthermore, more than one x-ray source may be source 174 that can be powered to emit x-rays with different energy characteristics at selected times.
[0042] Continue to refer to Figure 2According to various embodiments, source 174 may include a single x-ray tube assembly 250, which may be connected to switch 254, which may interconnect a first power source 258 via connector or power line 262. As discussed above, X-rays may be emitted from x-ray tube 250. According to various embodiments, x-rays may be emitted toward detector 178 in a cone shape 270 and generally in a direction from x-ray tube 250 as indicated by an arrow, beam arrow, beam, or vector 274. Vector 274 may extend along an axis and may also be referred to as the central axis of the beam. Vector 274 may include selected lines or axes associated with further interaction of the beam, such as with filter components, as discussed further herein. As will be understood by those skilled in the art, switch 254 may turn tube 250 on or off to emit x-rays with selected characteristics.
[0043] Subject 30 may be positioned within X-ray cone 270 to allow image data of subject 30 to be acquired based on the emission of X-rays toward detector 178 in a direction of vector 274. Typically, the subject may attenuate (e.g., scatter or absorb) the X-rays. Unattenuated X-rays or C-rays passing through subject 30 reach detector 170.
[0044] According to various embodiments, imaging system 80 can operate x-ray tube 250 to generate a two-dimensional (2D) x-ray projection of subject 30 based on x-ray impact on or detection on a 2D or flat panel detector (such as detector 178), including selected portions of subject 30 or any area, region, or volume of interest. As discussed herein, the 2D x-ray projection can be reconstructed to generate and / or display selected images or image visualizations, including 2D images, a three-dimensional (3D) volumetric model of subject 28, selected portions of subject 28, or any area, region, or volume of interest, or more than one of the foregoing, to generate a four-dimensional (4D) image that may change over time. As discussed herein, the 2D x-ray projection can be image data acquired using imaging system 80, while a 3D volumetric model can be generated or modeled from the image data.
[0045] For reconstructing or forming a 3D volumetric image, appropriate techniques include Expectation Maximization (EM), Ordered Subset EM (OS-EM), Simultaneous Algebraic Reconstruction Technique (SART), and Total Variation Minimization (TVM), as generally understood by those skilled in the art. Applications performing 3D volumetric reconstruction based on 2D projection allow for efficient and complete volumetric reconstruction. Typically, algebraic techniques may include iterative processes to perform reconstruction of subject 30 for display as image 108.
[0046] Imaging system 80 or parts thereof (such as SDU 198) may be movable relative to subject 30, such as moving about the long axis 31 of subject 30. Therefore, as Figure 2 As illustrated, the imaging system 80 can be positioned such that the cone 270 can be used to acquire anterior-posterior projections, or the cone 270' can be used to acquire lateral projections. Therefore, multiple image projections of the subject 30 can be acquired from different perspectives.
[0047] Imaging system 80 can be moved relative to the subject to acquire one or more projections of image data at various poses relative to the subject. The pose relative to the subject is determined by the positioning of source 174 relative to detector 178 and relative to subject 30. Figure 2 As illustrated, for example, the first pose localization of source 174 relative to detector 178 can be referred to as front-to-back projection. For example... Figure 2 As illustrated, the second or alternative pose of source 174' relative to detector 178' relative to subject 30 may be referred to as a lateral pose or projection. Imaging system 80 may include movement of imaging component 198 relative to subject 30 in one or more poses, which include Figure 2 The two illustrated poses and / or numerous poses relative to a point within the subject 30 and / or the imaging system 80, may be referred to as isocenter 290. In various embodiments, isocenter 290 may be located at any chosen location within the imaging system 30 and may be located within the subject 30, such as on the long axis 31. However, in various embodiments, the subject 30 may not be located at isocenter 290 and / or the subject may have one or more portions and may be selected as images offset from the isocenter.
[0048] In various embodiments, the imaging system 80 can be substantially automatically controlled by an imaging system control 96, which may include a processor module 97, and / or controlled using one or more inputs from a user 72. For example, a display 84 may represent the imager 80i, such as... Figure 3As illustrated, the imager 80i allows selection of one or more projections of the subject to be acquired, such as front-to-back (AP), back-to-front (PA), right-side projection (R-LAT), or left-side projection (L-LAT). These projections can be selected by the user 72, such as using a touchscreen on the display 84 or other suitable input. Furthermore, alternative projections can be selected using other inputs, such as inputs displayed on other screens, inputs using input devices, etc. In various embodiments, for example, the user can select to acquire projections at 30° and 120°. As further discussed herein, various projections can be selected and / or reviewed to determine areas, regions, poses, etc., for acquiring image data of the subject 30, to select or generate images or visualizations of the subject 30. In any case, the user 72 can provide inputs for selecting and / or evaluating the positioning of the imaging system for acquiring images of the subject and / or reviewing the acquired images of the subject.
[0049] In various embodiments, the imaging system 80 may acquire one or more projections to allow the generation of a three-dimensional (3D) image or the reconstruction of the subject 30. The reconstruction of the subject 30 as a 3D image may be based on two or more projections through the subject to allow its generation. As those skilled in the art will understand, the generation of images based on one or more projections, which may be 2D projections (such as 3D image reconstruction), may be based on image processing of one or more projections. In various embodiments, 3D image reconstruction may be based on two or more 2D projections. In various embodiments, the 2D projections may be acquired substantially 90° or orthogonal to each other and include the subject 30.
[0050] Go to Reference Figure 4 The imaging assembly 80 may include an imager portion 198, which includes a source 174 and a generally opposite detector 178. For example... Figure 4 As illustrated, source 174 can be positioned to obtain a lateral image relative to subject 30. Detector 178 can be positioned relative to a portion or point of the source (such as the central pivot portion 300 of source 174). Source 174 can pivot or move about pivot point 300, such that central axis 274 can be positioned at more than one angle transmitted to isocenter point 290. Detector 178 can also be moved to different locations relative to isocenter point 290. For example, as... Figure 4As illustrated, source 174 can project cone 270 onto detector 178. As source 174 rotates about pivot 300, cone 270 can be positioned at different locations. Thus, cone 270 can have a first position 270a, at which cone 270 has a central axis 274a. The selected central axis 274a can be offset from the isocenter point 290 of imaging system 80. Furthermore, cone 270a can extend over the region of subject 30, such as being defined by the extent of the cone portion 270a passing through subject 30.
[0051] As source 174 pivots on pivot axis 300, detector 178 can move relative to subject 30. Thus, for example, the detector can be moved to detect X-rays in cones 270b and 270c. Each of these cones has a corresponding central axis 274b and 274c. Detector 178 can be moved such that central axes 274a, 274b, and 274c extend substantially perpendicular to the surface of detector 178. It should be understood that detector 178 can be positioned relative to source 174 at any appropriate number of locations without rotating the imaging assembly 198 of both source 174 and detector 178. Therefore, imaging system 80 can collect image data at several poses with a single orientation of imaging assembly 198, with the corresponding cones 270 and central axis 274 also associated thereto.
[0052] As discussed above, the imaging system 80 can be used to acquire images at one or more poses relative to the subject 30. The source 174 can project onto the beam cone 270 at various positions 270a, 270b, and 270c. Furthermore, the source 174 can move to a pose to generate a projection at a lateral position, such as by moving along path 301. Movement along path 301 can be in any suitable manner. Thus, the source 174 can rotate about a pivot 300 at the lateral imaging position. At the lateral imaging position, the source can pivot to project onto three different positions, such as cones 270d, 270e, and 270f. Each of the three cones 270d, 270e, and 270f can have a corresponding central axis 274d, 274e, and 274f. Therefore, the imaging system can project the cone 270 at three positions 270d, 270e, and 270f, which allows the corresponding central axes 274d, 274e, and 274f to be substantially perpendicular to the detector 178 at the lateral positions.
[0053] Therefore, as Figure 4 As illustrated, the imaging system 80 can be used to generate three pose projections in an AP orientation and three pose projections in a lateral orientation. The detector, in each of the three positions corresponding to its orientation, allows for the direct capture of X-ray or image data through the isocenter point between the points of source 174 and detector 178. Furthermore, as... Figure 4 As illustrated, the plane or line at which the projection is obtained changes relative to the isocenter point 290 or the subject 30.
[0054] The beam can be moved relative to the subject 30 to acquire image data of the subject 30. Given the range of the beam emitted by the source 174 and detected at the detector 178, a reconstruction space or volume 310 can be defined within the imaging system 80. However, the reconstruction space or volume 310 may not cover the entire subject 30, such as... Figure 4 As illustrated. Although subject 30 may be surrounded by at least a portion of the beam at one or more of these locations, such as Figure 4 As illustrated, however, the volumetric or spatial reconstruction 310 may include a space or volume that allows for the determinism of selection in the reconstruction. For example, a three-dimensional reconstruction may be based on two or more or other selected numbers of projections. Thus, the reconstruction space or volume 310 may be a space that includes selected numbers of projections and / or various orientations to ensure proper or selected reconstruction. Therefore, the acquired image data may include blurred regions, such as a first blurred region 314 and / or a second blurred region 318 that may be outside the reconstruction space 310. While a selected portion of the subject 30 may appear in a single projection or a selected number of projections within the blurred regions, the reconstruction may not include the subject's portion within the blurred regions and / or may not have a deterministic reconstruction of selection.
[0055] Furthermore, to aid in evaluating image data to acquire and / or determine or confirm selected imaging, projections with a selected orientation can be processed onto or within a single plane. For example, such as Figure 4 As illustrated, a uniform or common plane or surface 330 can be defined relative to a selected number of detector locations and / or beam locations (such as beam locations 270a, 270b, 270c). When a detector 178 is detected at a location of beams 270a, 270b, 270c, each of these beams traverses the region or plane 330. Processes such as back projection to a selected plane can be performed to display or process all projections at the uniform or single plane 330. It should be understood that a similar single plane 334 can be generated for each of beam locations 270d, 270e, and 270f. Thus, several projections in each of these orientations (such as the AP or lateral orientation of the imaging system) can be processed to allow for a uniform evaluation of the image projections.
[0056] In addition to the common plane 330 used for back projection or processing of the three detector projections from beams 270a, 270b, and 270c, a common plane 334 can also be defined for beams 270d, 270e, and 270f. Therefore, the system can define, or can be used to define, a common plane for positioning the detectors at any suitable location within the imaging system. Thus, blurred regions 314 and 318 can be defined relative to any portion of the subject 30, for which image data to be captured can be selected. Furthermore, common planes 330 and 334 can be used to identify or define regions for acquiring image data to perform three-dimensional reconstruction of the subject 30, such as in reconstruction region 310, as discussed above. Multiple positioning of the detector relative to a single pivot point 300 defined by source 174 can allow image data to be acquired relative to the subject 30 to determine and / or allow for three-dimensional reconstruction of selected or larger volumes of the subject. Multiple projections can be identified or evaluated together, such as by stitching multiple projections together and projecting them onto a single plane (such as a single plane 330, 334) to aid in the selection process.
[0057] refer to Figure 5 For example, the field of view region 370 can be identified relative to the subject 30 and / or the image based on image data collected at the exemplary detector pose. Figure 5 As exemplarily illustrated, the field of view can be determined by a single image capture of the detector at its position relative to the imaging system 80 and / or the subject. Figure 5 As illustrated schematically, subject 30 may have multiple elements, such as vertebrae schematically illustrated as circles. For example, within the field of view, subject may include five vertebrae V1 to V5. However, in various embodiments or options, the area to be imaged may extend beyond this field of view. Therefore, as discussed above, detector may be moved relative to subject and / or source 174 without moving the entire imaging assembly 198. When moving the detector, conditions such as... can be determined... Figure 6 The illustrated field of view 374. Field of view 374 may include or capture three vertebrae not in the first field of view 370, such as vertebrae V6 to V8. However, vertebrae V1 and V2 may also be included in the field of view identified in field of view 374. Therefore, subject 30 can be positioned within imaging assembly 80, allowing acquisition of images deviating from the isocenter or center of imaging system 80. However, the positioning of subject 30 may include subject 30 having a center or selected region for imaging, which may deviate from the isocenter of imaging system 80. Similarly, field of view 374 may allow a user to select a region of the subject to be imaged, identifying possible movement of the imaging system, thereby acquiring image data of the selected portion of the subject.
[0058] refer to Figure 7Field of view 378 may include a stitched-together field of view of two or more fields of view. Therefore, field of view 378 may include the subject's 11 vertebrae V1 to V11. Field of view 378 may include a stitched-together field of view of at least two or three fields of view, such as... Figure 4 As illustrated, stitching may include identifying common features through segmentation and stitching projections at different cone locations at a single source pivot point. Field of view 378 may allow user 72 and / or a selected system to analyze the image projection for evaluating the image data to be acquired for selected reconstruction. Furthermore, various features, such as a reference point system or array, may be identified in the projection to aid in registering two or more images together and / or to different coordinate systems, such as a physical space coordinate system. Field of view 378 may include a sufficiently large area or region to help identify portions of subject 30, thereby acquiring an appropriate amount of image data to perform reconstruction, such as its three-dimensional reconstruction.
[0059] Continue to refer to Figure 7 The reference point component may include, for example, Figure 1 The reference point component of the illustrated reference point component 120. However, as... Figure 7 As schematically illustrated, reference point assembly 120 may include a first reference point marker 120a, a second reference point marker 120b, a third reference point marker 120c, and a fourth reference point marker 120d. Based on reference point assembly 120, the reference point markers may be in a fixed and known pose relative to each other in physical or subject space. Therefore, the geometry and spatial positioning in the navigation space are known. Therefore, identifying the reference point markers in field of view 378 may allow for the determination or registration to the subject space of subject 30, other image data that may include the reference point assembly, etc. Therefore, reference point assembly 120 can be identified in field of view 378. However, reference point assembly 120 may be invisible in any of the other fields of view (such as field of view 370 or field of view 374). Given the positioning and / or size of reference point assembly 120, the reference point assembly may not appear at all or may not appear in any of the other fields of view. For example, in Figure 5 In the illustrated field of view 370, reference point elements 120d and 120a may be visible, but two other reference point elements 120b and 120c are not visible. Therefore, based on field of view 370, the registration or identification of the reference point assembly may be uncertain.
[0060] Imaging component 80 can be operated to allow the acquisition of one or more projections to generate an image such as... Figure 7The illustrated field of view 378. This allows for the identification of a portion of the subject to be imaged for further image data acquisition, such as for 3D reconstruction, and for identifying reference point components and their associated geometry. Including reference point components in the field of view of detector 178 in more than one pose can aid registration by ensuring that sufficient image data (e.g., the entire reference point component) is available for registration.
[0061] While the above discussion involves vertebrae, such as vertebra v1, stitching can be performed using any appropriate portion of the image. Therefore, the use of vertebrae is merely exemplary. Other portions may include rib sections, connecting elements (e.g., bolts), etc. Image portions are selected or identified to allow two or more projections to be stitched together. Thus, stitched images can be provided in any appropriate or relative orientation, such as along or across the spine.
[0062] Go to Reference Figure 8 Image projection can also be used to identify the size or volume of the subject (30) to help determine the appropriate dose or image volume acquisition for various purposes. As discussed above, the generation or reconstruction of images (such as 3D images) of the subject's choice can be selected. Therefore, determining the subject's size, location, etc., can be used to determine the dose and location of the imaging system. For example, as... Figure 8 As illustrated, the range or size of the subject can be determined. For example, in a large field of view of 378, such as Figure 7 As illustrated, the dimensions of the subject 30, such as external dimensions or ranges, can be determined. For example, as illustrated or displayed on display 84, a projection of the subject can be displayed to identify a first surface 390 and a second surface 394 in a first projection (such as AP projection 400). Similarly, a first range 404 and a second range 408 of the subject can be identified in a second projection 412 (such as a lateral projection). Thus, dimensions between the ranges, such as dimension 416, can be measured in the subject's projection. Dimension 416 can be used to determine the dosage of the imaging system to obtain appropriate or selected image data of the subject 30.
[0063] Furthermore, the size or location of various features, such as anatomical features including one or more vertebrae, can be identified. The boundaries of a vertebra may include, for example, a first boundary 420 and a second boundary 424 defined in the AP projection 400. Similarly, a third boundary 428 and a fourth boundary 432 may be defined in the lateral projection 412. For various purposes, such as ensuring appropriate portions of the subject are within the reconstruction volume 310, the extent or location of selected portions of anatomical structures can be selected or identified. As discussed above, various ambiguous areas may exist based on the first set of locations determined by the imaging system 80. Therefore, regions can be automatically and / or identified by the user 72 to query whether they will be within the reconstruction volume 310 and / or those portions within the reconstruction volume 310 can be identified. The user 72 and / or the system can determine whether portions identified in projections (such as projections 400, 412) are selected for reconstruction and / or for various purposes.
[0064] The various projections acquired using the imaging system 80 can be used for a variety of purposes. For example, such as Figure 4 As illustrated by the positioning of the imaging system, AP and lateral views can be collected as reconnaissance or planning images. The reconnaissance images can be used to determine which portions of the imaging system 80 will be within the reconstructed region 310 at a first set of parameters. As discussed above, fields of view 370, 374, 378 can be used to identify those portions within the fields of view and / or as selected portions for inclusion in the reconstructed field of view. Figure 8 The boundary portions identified in the illustrated projections 400 and 412 can also be used to identify regions or portions within the reconnaissance projection to help identify parameters, thereby enabling the imaging system 80 to acquire image data of the subject 30 for selected reconstruction. The selected reconstruction can be a three-dimensional reconstruction that can be identified or determined to be within the reconstruction boundary 310. Therefore, if the selected region or portion is not within the reconnaissance image or is identified as being in a blurred region, the parameters of the imaging system 80 can be automatically changed and / or the user 72 or other systems can be notified of possible blurring relationships or identified blurred regions in the reconstruction. A blurred region can be a part or component visible in one of the reconnaissance images but not reconstructed in the reconstructed image.
[0065] Refer to information about imaging systems and their various configurations. Figures 1 to 8 ,exist Figure 9The process 470 is illustrated below. Process 470 may allow the use of an imaging system to acquire image data of subject 30, such as using one or more reconnaissance images, as discussed above, and allows the identification and selection of appropriate image data for selected or appropriate image reconstruction. Reconstruction may include a three-dimensional image reconstruction of the subject based on the acquired image data. Various reconnaissance images may be acquired and reviewed automatically or by a user or both to ensure appropriate image data acquisition for selected or appropriate image reconstruction. Image reconstruction can be understood as being based on the acquired image data and used to generate images, such as 3D images. Image reconstruction may include or access models of one or more components (such as implants or reference point components) in a memory system to aid in image reconstruction.
[0066] Process 470 may begin in start box 474. Subsequently, in box 478, image data may be acquired by sweeping. Acquiring image data by sweeping may include positioning the image acquisition component 198 in an appropriate pose relative to the subject (such as a lateral or AP pose) and acquiring one or more projections at selected poses. Therefore, the image data acquired at one or more of these poses may include positioning the detector at more than one location where the source and detector are moved relative to a region (such as isocenter 290 or the subject 30 or other appropriate portion of the imaging system 80). Sweeping the image data may include a set of projections at more than one location on cones (such as cones 270a, 270b, and 270c).
[0067] After acquiring image data via sweeping, long film generation can occur within frame 482. Long film generation may include backprojecting or processing several projections at selected locations of the imaging component 198 into a single long film or long field of view, such as field of view 378. Long films can be generated by processing the acquired projections based on the known location of the subject relative to the relevant location of the source 174 in the detector 178. Figure 3 As illustrated, a long film can be determined or generated based on a selected common plane (such as common plane 330 or 334). The common plane allows for the viewing or generation of a long film that is substantially consistent across various parameters (such as size) within its scope. The generated long film can then be displayed or analyzed for various purposes, such as those discussed herein. In various embodiments, a long film can refer to an image reconstructed based on more than one image data collection or projection from detector 178.
[0068] Typically, long films allow for the identification of various features, such as reference points, anatomical features, structures within 30 minutes of the subject, or other appropriate features. Similarly, long films can be generated to include more than one part of the subject, such as bony portions, reference point portions, etc.
[0069] The reconstructed region can then be determined in box 486. Determining the image reconstruction region may include identifying the field of view used for image reconstruction, such as that illustrated in the elongated view generated in box 482. As discussed above, various fields of view may be determined or illustrated relative to the elongated view (such as field of view 370 or 374). In various embodiments, one or more fields of view may be associated with the individual positioning of the detector. Furthermore, however, the field of view may be used to illustrate those portions that can be included in the image reconstruction based on a reconnaissance view that can be reconstructed or stitched into the elongated film generated in box 482. As discussed above, the imaging system 80 may move relative to the subject 30 with various parameters (e.g., motion). Thus, based on the generated elongated film, a portion of the subject that will be included in the amount of image data collected from it for appropriate reconstruction can be illustrated. Determining the reconstruction region may be based on an analysis of the selection of image data and on generating the image data required for three-dimensional image reconstruction using various techniques.
[0070] In various embodiments, a reconstructed area of the long film can be displayed in frame 490. An example of the reconstructed area can be used in conjunction with display device 84 for viewing by user 72. User 72 can then help determine whether an appropriate area should be reconstructed. This may also include identifying blurred areas in frame 494. Blurred areas identified in frame 494 may also be illustrated relative to the long film and / or any suitable projection. Blurred areas can be identified as those portions included in the projection that do not or may not include sufficient image data for appropriate image reconstruction, such as image reconstruction with selected sharpness or confidence.
[0071] Similarly, the blurred area can be identified and displayed for the user 72 using a display device 84. For example, such as... Figure 6 As illustrated, a blurred region 496 can be displayed relative to the field of view 374. The blurred region 496 can be determined based on the geometry of the cone 270 relative to the subject in its various positions.
[0072] Based on the reconstructed regions and identified ambiguous regions determined in boxes 486 and 494, it can be determined in box 500 whether the reconstructed region is suitable. This determination in box 500 can be made by various suitable systems, such as by user 72 or a processing system, or a combination thereof. For example, in various implementations, user 72 can review the determined or exemplified reconstructed regions and identified ambiguous regions, and determine whether the reconstructable portion is suitable for the selected execution scheme and / or based on the selected parameters.
[0073] Furthermore, the system can analyze image data and potential blurred areas, as well as the area for image reconstruction, and determine whether the image reconstruction is appropriate. For example, a surgery such as the fusion of selected vertebrae can be predetermined or identified by the system. A processor (such as image processor 97 or navigation processor module 102) can determine whether the area for image reconstruction is suitable for the selected fusion, such as whether the appropriate vertebra will be reconstructed in the reconstruction.
[0074] The determinations in box 500 may be useful prior to any further processing (including reconstruction), as discussed further herein. However, the determinations in box 500 may also precede one or more processes. Thus, process 470 may include subprocesses that can occur individually, alternatively, and / or sequentially, as discussed herein.
[0075] If the image reconstruction region is determined to be unsuitable, the "No" path 504 can be followed to acquire additional image data sweeps in box 478. Additional and / or alternative image data sweeps can allow image data to be collected relative to subject 30 with imaging system 80 under different parameters (such as different orientations of imaging system 198 relative to subject 30, different doses, etc.). Therefore, process 470 can allow acquisition of image data for an appropriate region for image reconstruction, which can be determined in box 500. If the reconstruction region is suitable, the "Yes" path 510 can be followed.
[0076] The long film image generated in box 482 can be used for various purposes before or after acquiring image data to perform image reconstruction based on the long film generated from the image data acquired in box 478. Various optional processes can occur in process 470 at any appropriate time. For example, optional processes may include subprocess 520 for identifying reference points or reference point elements in the long image that can be imaged or generated. Subprocesses may include identifying reference points in the long image in box 524. Identifying reference points in the long film may include determining known component features or models of the reference point elements or applying known component features or models of the reference point elements to the image data, the reference point elements may include implants such as screws. Based on the known components of the reference point element components, reference point element components in the long film may be determined (e.g., boundaries are determined) in box 524. This can be a substantially automatic process based on a model of a known component including the reference point element or any suitable component and comparing that model with the long film. For example, reference point components, screw implants, etc., may have known components in their models (e.g., CAD models). The known interactions of X-rays with the component can then be used to determine its image properties on the long film. Therefore, a comparison can be made between the model with the known component and the long film to identify reference points on the long film. Based on the identification of these reference points on the long film, they can be identified in the reconstruction in box 528. Once the component of the reference point (e.g., the selected component and / or implant) is identified on the long film, it can also be identified in the image reconstruction. The image reconstruction is based on the acquired image data of the subject and therefore includes the reference point component.
[0077] Then, in box 532, the reconstructed or long film can be registered to previously acquired image data. The previously acquired image data may include image data of the subject acquired prior to acquisition in process 470. In various embodiments, for example, diagnostic images of the subject may be acquired using a computed tomography system, an MRI imaging system, etc. If reference point elements are present in the previously acquired images, they may also be identified in any suitable manner and used for registration or association with reference point elements identified in the long film as discussed above.
[0078] Therefore, the reference point and registration process 520 can be incorporated into process 470. This allows for the registration of image reconstruction portions and / or long-film reconnaissance images based on the identified reference point portions therein. A parameter sub-process 540 can also be performed. Sub-process 540 can include determining the subject size in box 544. As discussed above, the large field of view of the long film can be used to identify the extent or region of the subject to be imaged. Given the full or known extent of the subject, one or more parameters can be determined for the imaging system. Parameters can be set in box 548. Parameters can include, for example, the number of projections, parameters for energy or dose application to the imaging system, settings for the reconstructed field of view, and identification of isocenters or other appropriate parameters. Regarding dose application, this can be used to help select a dose modulation strategy, where certain poses of the source may have varying doses, which may be related to thickening of the subject in that pose or direction. Therefore, parameter sub-process 540 can be included in process 470.
[0079] However, once a suitable reconstruction region is determined in box 500, the "yes" path 510 leads to the acquisition of image data based on the appropriate reconstruction region in box 560. As discussed above, image data acquisition can be based on various parameters and poses. For example, the determination of the region for reconstruction can inform the imaging system 80's positioning relative to the subject 30 to acquire appropriate image data. Furthermore, as discussed above, various parameters such as dose application and projection amount can also be identified in box 560 for acquiring image data.
[0080] As discussed above regarding process 470, it can be useful and can be performed automatically (e.g., by executing instructions using a processor), manually, or in combination thereof, to evaluate image data for volumetric image reconstruction and to allow the use of one or more reconnaissance images to determine or select that image data. The reconnaissance images can be acquired long film images or projections based on image data acquired using an imaging system that can be stitched together.
[0081] However, during reconstruction, individual regions in the acquired image used for reconstruction can be processed or filtered within regions of image data that may not be considered in the region to be processed. Image data not in a region can include image data that is not present in the reconstructed image (including volume) during or after the reconstruction process. Therefore, the image data acquired in box 560 for reconstruction can be a region of the subject 30 that is less than or smaller than the length of the long film (e.g., in 2D, 3D, or any suitable region), such as... Figure 8 As exemplified in the example. Therefore, process 470 may include the truncation processing or truncation reduction subprocess in block 570.
[0082] The truncation process in box 570 can include various procedures, such as those discussed herein and in various figures (including, for example) Figure 10 The processes illustrated in ( ). Truncation processing 570 is understood to be optional and not required for reconstruction based on image data acquired in box 560. However, truncation processing can help process the image data used for reconstruction to account for regions outside or beyond the reconstruction region or volume and / or individual projections of the image data.
[0083] like Figure 10 As illustrated, one or more long films, such as AP film 576 and lateral long film 578, can be generated within frame 574 (e.g., by stitching). The two long films 576, 578 can be similar to or identical to films 400, 412 discussed above. Therefore, long films 576, 578 can each include various portions, such as external surfaces or edges, such as skin edges 582, 584. Edges can be boundaries or external surfaces, similar to the ranges 390, 394, 404, 408 discussed above. Thus, the entire range of subject 30 can be imaged and included within long films 576, 578. This allows for the reconstruction of the volume of 3D image 590 due to the 3D reconstruction estimation process 594.
[0084] The 3D estimation and reconstruction process 594 may include one or more processing steps that process one or more long films (such as long films 576, 578) into a 3D volume. Long films 576, 578 are examples of possible long films that can be processed by process 594. The 3D volume can then be viewed in various ways (such as slicing or volumetric imaging). The 3D reconstruction estimation process 594 may be based on various estimation or reconstruction processes and can be understood as an estimation based on image data acquired in long films 576, 578, which may not be optimal for accurate or selected 3D reconstruction. However, long films 576, 578 can be used for 3D reconstruction estimation to generate a 3D reconstruction estimate 590.
[0085] The 3D reconstruction estimation process 594 can be performed in various ways, such as utilizing physics or model information processing. For example, a model can be used to evaluate and / or be enhanced to generate a 3D reconstructed image 590 based on long films 576, 578. In various embodiments, for example, a model of the subject 30 (e.g., an anatomical atlas, CAD model, etc.) can be used to fit the long films 576, 578 to generate a 3D reconstruction estimate of 590. For example, the model can be enhanced based on the long films 576, 578. In various embodiments, a physics model and / or determination can be used to assist in performing the 3D reconstruction estimation process 594. The physics model or information may include physical information about the standard subject, such as the subject's density, the distance between the subject and detector 178, and / or various other information. Additionally or alternatively, various machine learning systems (e.g., neural network models, artificial intelligence models, etc.) can be used to generate the 3D reconstructed image 590. Various machine learning models can be trained on various long film image data to allow the generation of 3D reconstruction estimation images 590 in the 3D reconstruction estimation process 594 based on the current patient or current subject long films 576, 578. The training process can be performed in an appropriate manner, as understood by those skilled in the art. The current or new long films can then be used to generate the 3D reconstruction estimation images 590.
[0086] Therefore, in the truncation process 570, the generation or production of long films in box 574 can be performed. The generation of long films 576 and 578 can be performed as discussed above, such as identifying and evaluating reference points, stitching processes, etc. Using the long films generated from box 574, a 3D reconstruction estimation image 590 can be generated in box 596. The 3D reconstruction estimation image in box 596 can be based on the generated long films 576 and 578 and process 594, as discussed above and as... Figure 10 exemplified.
[0087] The truncation process 570 can then further include various processes, such as Figure 11 The processes illustrated. Initially, refer to... Figure 5 , Figure 6 and Figure 7 Various regions or fields of view 370, 374, 378 used for reconstruction can be evaluated at appropriate times. In various implementations, for example, field of view 370 can be a field of view that can be reconstructed based on image data that can be collected by imaging system 80. Fields of view (such as field of view 370) may include a selected portion of subject 30 to be reconstructed based on image data acquired using imaging system 80. Similarly, fields of view can be selected in a long film region or portion, such as field of view 600 ( Figure 10 A field of view of 600 can be compared to long film (such as long film 574) (similar to...). Figure 5The field of view 370 is illustrated or can be illustrated in any suitable manner. A field of view such as field of view 600 can then be selected for reconstruction.
[0088] Go to Reference Figure 11 The reconstructed region or volume can then be based on the image data evaluated for processing. For example, in Figure 11 In this context, the selected or actual projection 604 can be processed in a selective manner. For example, a ramp filter can be applied to the actual projection 604. It should be understood that the actual projection 604 can be an exemplary projection acquired during the acquisition of image data for reconstruction in block 560. Therefore, the actual projection 604 can be one of a plurality of projections acquired for reconstruction.
[0089] For the reconstruction process, the actual projection 604 and / or any selected number of projections can be processed for the reconstruction process and / or prior to the reconstruction process. For example, a ramp filter can be applied to a selected number of pixels or all pixels in the actual projection 604, such as pixel 610. The ramp filter can be a filter that processes pixel 610 relative to other pixels or weights that pixel. In various embodiments, the ramp filter can be a long-tailed filter that can evaluate or add pixel 610 values to pixels within the actual projection 604, such as pixels along line segments 614 and 616. However, the evaluation or processing of each of these pixels (such as pixel 610) can be chosen to have substantially equal portions, such that each of line segments 614, 616 is equal. Thus, filling regions or regions 620 and 624 can be added to either side of the actual projection 604 to allow pixel 610 to be evaluated, resulting in substantially equal pixel data on either side of pixel 610. Filling regions 620, 624 can be notified via 3D reconstruction estimation 590.
[0090] For further reference Figure 12 It can evaluate or process the 3D reconstructed estimated image 590 to generate fill region data for fill regions 620, 624. For example... Figure 12 As illustrated, the 3D reconstruction estimate 594 can be evaluated by back projection to generate data for the filled region. The actual projection 604 can be within region 630 of the 3D reconstruction estimate image 590. The filled region can be on either side of the reconstructed or actual projection region 630 and includes a filled region portion 620' and a filled region portion 624'.
[0091] The back projection can be generated from the 3D reconstructed image 590 based on the geometry of the imaging system 80. The geometry may include the localization of the source 174 and the detector 178 during image data acquisition to generate the 3D reconstructed image 590. Therefore, the back projection ray 634 can be projected through the 3D reconstructed estimated image 590 to generate filled region data.
[0092] The fill region generation process 640 may include, for example: Figure 12 The illustrated back projection generates filled region data 620, 620' and 624, 624' relative to the actual projection 604. The filled region data may include data portions outside the actual projection 604, such as the surface 582 of the subject 30. Pixel values in the filled region of 620 may be generated based on the back projection ray 634 in the back projection region 620'. The generated pixel values may be virtual or determined pixel values due to the back projection of the 3D reconstructed image 590.
[0093] Then, the pixel value of the pixel in the filled region can be used to evaluate or process pixel 610. Similarly, the pixel value in the filled region is based on the back projection or estimation of the region using the 3D reconstructed estimated image 590 generated using long films 574, 578 and related data. Therefore, based on the estimation of the 3D reconstructed image 590 and the related back projection based on the actual or real image data acquired by the subject 30, a ramp filter can be applied to pixels such as pixel 610 in the actual projection 604.
[0094] Therefore, the truncation process 570 can thus include processing of the actual projection included in process 470. For example, acquiring the actual or current projection can be performed in block 640. Acquiring the actual or current projection can include acquiring image data of subject 30 according to any appropriate process. Therefore, imaging system 80 can be used to acquire image data of subject 30. As discussed above, the image data acquired using imaging system 80 can be used to generate one or more projections of subject 30 for reconstruction. Reconstruction can include three-dimensional reconstruction using the acquired image data.
[0095] Then, in box 644, the truncation process 570 can be used to generate fill region data. As discussed above, the generated fill region data may include data generated due to backprojection processes such as using the 3D reconstructed estimate image 590 generated in box 578. The 3D reconstructed estimate image 590 can be used to generate backprojected fill region data, as discussed above and as in... Figure 12 As illustrated, the filling area data in box 644 can therefore be generated.
[0096] The generated padding data can be used to fill or add to the padding area of the actual projection. The actual projection can be a truncated portion of the subject. This means that the actual projection of the subject may only include the portion of the subject that can be imaged at a single pose of the detector. Therefore, a portion of the subject may extend beyond the boundaries of the actual projection.
[0097] The back projection used to generate fill data in box 644 may include a back projection of the entire 3D estimated reconstruction 590. The back-projected image (also referred to as a digital reconstructed ray photograph (DRR)) can then be matched or registered with the actual projection 630. Therefore, the boundaries of the actual projection and fill region data in the DRR from the back-projected image can be determined based on the 3D estimated reconstruction 590. This determination may include registration, such as 2D-to-2D registration, which may be automatic (e.g., performed by instructions executed via a processor module), manual, or a combination thereof. However, this determination allows fill region data to be generated from the 3D estimated reconstruction 590 (which is based on or generated on the image data of subject 30) outside the boundaries or edges of the actual projection 630, which serves as a truncated projection of subject 30.
[0098] Then, processing of the actual or current projection can occur in box 650. Processing of the actual projection can include applying a ramp filter to pixels in the actual projection, such as pixel 610. The ramp filter can include pixel values from a filled region, which includes filled region data generated from box 644. Thus, the actual projection can be filtered, including based on data from subject 30, which may be generated due to the back projection of the estimated image 590 via 3D reconstruction. This allows processing of the actual projection in the filled region with an appropriate amount of image data based on the actual image data acquired from subject 30.
[0099] Then, in box 654, truncation 570 can be used to remove padding data. Removing padding data from the true projection (such as actual projection 604) allows for reconstruction of the selected reconstruction without the estimated image data from the 3D reconstruction estimation image 590. Thus, the reconstruction of subject 30 can be based on an appropriate or selected amount of image data, but can be informed by the actual image data including the 3D reconstruction estimation image 590. However, as discussed above, the 3D reconstruction estimation image 590 can be an estimate based on a suboptimal amount of image data, and therefore removing padding image data in box 654 allows for either generating the optimal reconstructed image in process 470 or outputting image data in process 470.
[0100] An image or image data can then be output in box 660. The output image in box 660 may include image data that is useful or used in a selected image reconstruction (such as 3D image reconstruction). However, the output in box 660 can be used for various purposes, such as generating an image for display, storing it for later processing, or displaying it. However, in various embodiments, the output from box 66 can be used to generate an image reconstruction, such as a 3D image reconstruction in box 664, which may be based on the image data acquired from box 560. However, the generation of image reconstruction is also understood to be optional rather than mandatory.
[0101] Therefore, in various embodiments, the output image data can be stored for various purposes, such as later analysis and presentation, and / or can be displayed to user 72 or other suitable users. The reconstructed image from box 664 can be displayed using display device 84, such as image 108. Reconstruction output 570 may include data for three-dimensional image reconstruction based on image data acquired using an imaging system based on parameters, as discussed above. The output image data may include a reconstruction that also identifies portions including various features, as discussed above, such as reference points and various anatomical parts.
[0102] Then, process 470 can subsequently end in box 680. Ending process 470 in box 680 allows the image data to be used for various purposes, such as performing surgery, comparison or registration with additional images, surgical navigation, etc. As discussed above, registration of the image data with the subject can be performed to assist in various surgical procedures, such as surgical navigation. Therefore, process 470 can help generate image reconstructions or acquire image data suitable for image reconstruction to assist in various procedures, such as surgical navigation, including an example of the tracking pose of instrument 68 relative to the image reconstruction.
[0103] Example
[0104] Example 1 - A method for evaluating image data of a subject for reconstruction, the method comprising: acquiring first image data at a first pose of a detector relative to a first point of a source; acquiring second image data at a second pose of the detector relative to the first point of the source; analyzing the first image data and the second image data to determine a reconstruction volume having selected parameters based on the analysis of the first image data and the second image data; outputting a visual representation of at least one of the first image data or the second image data relating to the reconstruction volume having selected parameters; and outputting parameters for an imaging system, the parameters including at least parameters for locating the detector and the source to acquire the image data to generate the reconstruction.
[0105] Example 2 - According to the method of Example 1, the method further includes: processing the first image data and the second image data onto a first single image plane associated with the first pose of the detector and the second pose of the detector.
[0106] Example 3 - According to the method of Example 2, the analysis of the first image data and the second image data includes: determining a blurred region in the determined reconstruction based on the first image data and the second image data; wherein the blurred region includes image data of a portion of the subject in at least one of the first image data or the second image data, the image data being excluded from the generated reconstruction.
[0107] Example 4 - According to the method of Example 3, the method further includes: acquiring third image data at a third pose of the detector relative to a second point of the source; acquiring fourth image data at a fourth pose of the detector relative to the second point of the source; and processing the third image data and the fourth image data onto a second single image plane associated with the third pose and the fourth pose of the detector; wherein the first point is shifted from the second point.
[0108] Example 5 - According to the method described in Example 4, the method further includes: generating a first image onto the first single image plane based on the processed first image data and second image data; and generating a second image onto the second single image plane based on the processed third image data and fourth image data.
[0109] Example 6 - According to the method of Example 5, the method further includes: outputting a representation of at least one of the third image data or the fourth image data in relation to the reconstructed volume having selected parameters; wherein the output parameters for the imaging system are based at least on the output representation.
[0110] Example 7 - According to the method of Example 2, the method further includes: generating the image onto the first single image plane based on the processed first image data and second image data.
[0111] Example 8 - According to the method described in Example 7, the method further includes: identifying the reference point image portion in the generated image; determining the subject coordinate system pose of the reference point component; and registering the image coordinate system of the generated image with the subject coordinate system.
[0112] Example 9 - According to the method described in Example 7, the method further includes: identifying the implant image portion in the generated image; determining the subject coordinate system pose of the implant component; and registering the image coordinate system of the generated image with the subject coordinate system.
[0113] Example 10 - According to the method of Example 7, the method further includes: displaying a field-of-view representation superimposed on the generated image; and receiving an input to move the displayed field-of-view representation to a selected location; wherein the output is an instruction for the imaging system to locate the detector and the source to obtain image data to generate the reconstruction based on the selected location of the displayed field-of-view representation.
[0114] Example 11 - The method according to Example 10, wherein receiving input to move the displayed field of view representation to the selected location is based on user input.
[0115] Example 12 - According to the method of Example 7, the method further includes: identifying the range of the subject in the generated image; and determining a dose parameter for the output parameters for the imaging system.
[0116] Example 13 - A system for evaluating image data of a subject for image reconstruction, the system comprising: a processor module configured to execute instructions to: acquire first image data at a first pose of a detector relative to a first point of a source; acquire second image data at a second pose of the detector relative to the first point of the source; analyze the first image data and the second image data to determine a reconstruction volume having selected parameters based on the analysis of the first image data and the second image data; and output a representation of at least one of the first image data or the second image data relating to the reconstruction volume having selected parameters; and a storage system for storing parameters for controlling an imaging system, the parameters including at least parameters for locating the detector and the source to acquire image data to generate the image reconstruction.
[0117] Example 14 - The system according to Example 13, wherein the processor module is configured to execute additional instructions to: process the first image data and the second image data into an image at a first single image plane associated with the first pose of the detector and the second pose of the detector.
[0118] Example 15 - The system according to Example 14, wherein the processor module is configured to execute additional instructions to analyze the first image data and the second image data to: determine a blurred region in the determined image reconstruction based on the first image data and the second image data; wherein the blurred region includes image data of a portion of the subject in at least one of the first image data or the second image data, the image data being excluded from the generated image reconstruction.
[0119] Example 16 - The system according to Example 14, wherein the storage system is configured to store parameters for controlling the imaging system to: acquire third image data at a third pose of the detector relative to a second point of the source; and acquire fourth image data at a fourth pose of the detector relative to the second point of the source; and process the third image data and the fourth image data into a second image at a second single image plane associated with the third pose and the fourth pose of the detector; and set the first point to be shifted from the second point.
[0120] Example 17 - The system according to Example 14, wherein the processor module is configured to execute additional instructions to: identify a reference point image portion in the image reconstruction; determine the subject coordinate system pose of the reference point component; and register the image coordinate system of the first image with the subject coordinate system.
[0121] Example 18 - The system according to Example 14, wherein the processor module is configured to execute additional instructions to: identify an implant image portion in the first image; determine the subject coordinate system pose of the implant component; and register the image coordinate system of the first image with the subject coordinate system.
[0122] Example 19 - The system according to Example 14, wherein the processor module is configured to execute additional instructions to: display a field-of-view representation superimposed on the first image; and receive input to move the displayed field-of-view representation to a selected location; wherein parameters for controlling the imaging system are based on the selected location of the displayed field-of-view representation.
[0123] Example 20 - The system according to Example 14, wherein the processor module is configured to execute additional instructions to: identify the range of the subject in the generated image; and determine a dose parameter for the output parameters for the imaging system.
[0124] Example embodiments are provided to make this disclosure thorough and to fully communicate the scope of this disclosure to those skilled in the art. Numerous specific details, such as examples of particular components, apparatus, and methods, are set forth to provide a thorough understanding of embodiments of this disclosure. It will be apparent to those skilled in the art that specific details are not required, example embodiments may be embodied in many different forms, and should not be construed as limiting the scope of this disclosure. In some exemplary embodiments, well-known processes, well-known apparatus structures, and well-known techniques are not described in detail.
[0125] Instructions can be executed by a processor and can include software, firmware, and / or microcode, and can refer to programs, routines, functions, classes, data structures, and / or objects. The term "shared processor circuitry" covers a single processor circuitry that executes some or all of the code from multiple modules. The term "group processor circuitry" covers processor circuitry that, in conjunction with additional processor circuitry, executes some or all of the code from one or more modules. References to multiple processor circuitry cover multiple processor circuitry on a discrete die, multiple processor circuitry on a single die, multiple cores of a single processor circuitry, multiple threads of a single processor circuitry, or a combination thereof. The term "shared memory circuitry" covers a single memory circuitry that stores some or all of the code from multiple modules. The term "group memory circuitry" covers memory circuitry that, in conjunction with additional memory, stores some or all of the code from one or more modules.
[0126] The apparatus and methods described in this application may be implemented, in part or in whole, by a processor (also referred to as a processor module), which may include a special-purpose computer (e.g., created by configuring a processor) and / or a general-purpose computer for performing one or more specific functions embodied in a computer program. The computer program includes processor-executable instructions stored on at least one non-transitory, tangible computer-readable medium. The computer program may also include or depend on stored data. The computer program may include a basic input / output system (BIOS) that interacts with the hardware of the special-purpose computer, a device driver that interacts with a specific device of the special-purpose computer, one or more operating systems, user applications, background services, background applications, etc.
[0127] Computer programs may include: (i) assembly code; (ii) object code generated from source code by a compiler; (iii) source code for execution by an interpreter; (iv) source code for compilation and execution by a just-in-time (JIT) compiler; and (v) descriptive text for parsing, such as HTML (Hypertext Markup Language) or XML (Extensible Markup Language). As an example only, source code may be in C, C++, C#, Objective-C, Haskell, Go, SQL, Lisp, or Java. ®ASP, Perl, Javascript ® HTML5, Ada, Active Server Pages (ASP), Perl, Scala, Erlang, Ruby, Flash ® Visual Basic ® Lua or Python ® To write it.
[0128] Communication may include the wireless communications described in this disclosure, which may be wholly or partially compliant with IEEE Standard 802.11-2012, IEEE Standard 802.16-2009, and / or IEEE Standard 802.20-2008. In various specific implementations, IEEE 802.11-2012 may be supplemented by draft IEEE Standard 802.11ac, draft IEEE Standard 802.11ad, and / or draft IEEE Standard 802.11ah.
[0129] The terms processor, processor module, module, or “controller” are used interchangeably herein (unless otherwise specifically indicated), and each may be replaced by the term “circuit”. Any of these terms may refer to, be part of, or include the following: application-specific integrated circuit (ASIC); digital, analog, or mixed-signal analog / digital discrete circuit; digital, analog, or mixed-signal analog / digital integrated circuit; combinational logic circuit; field-programmable gate array (FPGA); processor circuitry (shared, dedicated, or grouped) that executes code; memory circuitry (shared, dedicated, or grouped) that stores code executed by the processor circuitry; other suitable hardware components that provide the described functionality; or some or all of the foregoing, such as in a system-on-a-chip.
[0130] Instructions can be executed by one or more processors or processor modules, such as one or more digital signal processors (DSPs), general-purpose microprocessors, application-specific integrated circuits (ASICs), field-programmable arrays (FPGAs), or other equivalent integrated or discrete logic circuits. Therefore, the terms "processor" or "processor module" as used herein may refer to any of the foregoing structures or any other physical structure suitable for implementing the described techniques. Furthermore, these techniques can be fully implemented in one or more circuit or logic elements.
[0131] The foregoing description of embodiments has been provided for purposes of illustration and description. The foregoing description is not intended to be exhaustive or limiting of this disclosure. Individual elements or features of a particular embodiment are generally not limited to that particular embodiment, but are interchangeable and may also be used in chosen embodiments where applicable, even if not specifically shown or described. The same element or feature may be varied in many ways. Such variations should not be considered as departing from this disclosure, and all such modifications are intended to be included within the scope of this disclosure.
Claims
1. A method for evaluating image data of a subject for reconstruction, the method comprising: First image data is acquired at the first pose of the detector relative to the first point of the source; Second image data is acquired at a second pose of the detector relative to the first point of the source; Analyze the first image data and the second image data to determine a reconstruction volume with selected parameters based on the analysis of the first image data and the second image data; Output a visual representation of at least one of the first image data or the second image data in relation to the reconstructed volume with selected parameters; as well as The output is parameters for the imaging system, including at least parameters for locating the detector and the source to obtain image data in order to generate the reconstruction.
2. The method according to claim 1, further comprising: The first image data and the second image data are processed onto a first single image plane associated with the first pose and the second pose of the detector.
3. The method according to claim 2, wherein analyzing the first image data and the second image data comprises: The blurred regions in the reconstruction are determined based on the first image data and the second image data; The blurred region includes image data of a portion of the subject from at least one of the first image data or the second image data, which will not be included in the generated reconstruction.
4. The method according to claim 2, further comprising: The image is generated onto the first single image plane based on the processed first and second image data.
5. The method according to claim 4, further comprising: Identify the reference point image portion in the generated image; Determine the subject's coordinate system pose of the reference point component; as well as The image coordinate system of the generated image is registered with the subject's coordinate system.
6. The method according to claim 4, further comprising: Identify the implant image portion in the generated image; Determine the subject's coordinate system pose of the implant component; as well as The image coordinate system of the generated image is registered with the subject's coordinate system.
7. The method according to claim 4, further comprising: Displays the field of view representation superimposed on the generated image; as well as Receive input to move the displayed field of view to the selected location; The output instructions for the imaging system to locate the detector and the source to obtain image data to generate the reconstruction are based on the selected location according to the displayed field of view representation.
8. The method according to claim 4, further comprising: Identify the extent of the subject in the generated image; as well as Determine the dose parameters used to output parameters for the imaging system.
9. A system for evaluating image data of a subject for image reconstruction, the system comprising: Processor module, the processor module being configured to execute instructions to: First image data is acquired at the first pose of the detector relative to the first point of the source; Second image data is acquired at a second pose of the detector relative to the first point of the source; Analyze the first image data and the second image data to determine a reconstruction volume with selected parameters based on the analysis of the first image data and the second image data; as well as Output a representation of at least one of the first image data or the second image data in relation to the reconstructed volume with selected parameters; and A storage system that stores parameters for controlling an imaging system, including at least parameters for locating the detector and the source to acquire image data to generate the image reconstruction.
10. The system of claim 9, wherein the processor module is configured to execute additional instructions to: The first image data and the second image data are processed into an image at a first single image plane associated with the first pose and the second pose of the detector.
11. The system of claim 10, wherein the processor module is configured to execute additional instructions to analyze the first image data and the second image data to: The blurred regions in the determined image reconstruction are determined based on the first image data and the second image data; The blurred region includes image data of a portion of the subject from at least one of the first image data or the second image data, which will not be included in the generated image reconstruction.
12. The system of claim 10, wherein the storage system is configured to store parameters for controlling the imaging system to: Third image data is acquired at the third pose of the detector relative to the second point of the source; as well as Fourth image data is acquired at the fourth pose of the detector relative to the second point of the source; as well as The third image data and the fourth image data are processed into a second image at a second single image plane related to the third pose and the fourth pose of the detector; Set the first point to be shifted from the second point.
13. The system of claim 10, wherein the processor module is configured to execute additional instructions to: Identify the reference point image portion in the image reconstruction; Determine the subject's coordinate system pose of the reference point component; and Register the image coordinate system of the first image with the subject's coordinate system.
14. The system of claim 10, wherein the processor module is configured to execute additional instructions to: Identify the implant image portion in the first image; Determine the subject's coordinate system pose of the implant component; and Register the image coordinate system of the first image with the subject's coordinate system.
15. The system of claim 10, wherein the processor module is configured to execute additional instructions to: Displays a field-of-view representation superimposed on the first image; as well as Receive input to move the displayed field of view to the selected location; The parameters used to control the imaging system are based on the selected positioning as shown in the displayed field of view representation.
16. The system of claim 10, wherein the processor module is configured to execute additional instructions to: Identify the extent of the subject in the generated image; and Determine the dose parameters used to output parameters for the imaging system.
Citation Information
Patent Citations
System and method for registration between coordinate systems and navigation
US11135025B2
Method and system for navigating a catheter probe
US5592939A
Position location system
US5913820A
Catheter location system and method
US5983126A
Breakable gantry apparatus for multidimensional x-ray based imaging
US6940941B2
