Tomographic imaging system with motion detection system
By using dynamic camera systems and motion analyzers in tomography imaging systems, the problem of motion detection in the prior art is solved, effective detection and correction of motion in or near the imaging area is achieved, and image quality and reliability are improved sex.
Patent Information
- Application Number
- CN202080059344.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2019-08-22
- Filing Date
- 2020-08-14
- Publication Date
- 2024-11-01
- Estimated Expiration
- 2040-08-14
AI Technical Summary
The existing tomography imaging systems are not reliable enough in motion detection, which may lead to confusion of image data and degradation of image quality, especially when motion outside the imaging zone is not effectively detected and corrected.
By introducing a dynamic camera system and a motion analyzer in the tomography imaging system, the dynamic camera system is used to receive and register dynamic image information in the image coordinate system, and transform the imaging area from the reference coordinate system to the image coordinate system through the operation unit. The motion analyzer derives motion information from the dynamic image information, identifies and corrects motion in or near the imaging area, thereby improving the accuracy and reliability of motion detection.
Effective detection and correction of motion in or near the imaging area is realized, the interference of motion on image data acquisition is reduced, the quality of tomography images is improved, and more reliable motion detection and image reconstruction are ensured.
Smart Images

Figure CN114269236B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a tomographic imaging system having a motion detection system. Background Art
[0002] Such a tomographic imaging system is known from US patent application US 2011 / 0201916.
[0003] The known tomographic imaging system is configured to obtain an MRI image simultaneously with an image obtained with a camera. The image obtained with the camera is correlated with the MRI image to generate motion correction data. Summary of the invention
[0004] It is an object of the present invention to provide a tomographic imaging system having a more reliable motion detection system.
[0005] This object is achieved by a tomographic imaging system, the system comprising:
[0006] a support that carries the image data acquisition system and defines a reference coordinate system,
[0007] a scan plan control for setting up the image data acquisition system to acquire image data from a selected imaging region in the reference coordinate system,
[0008] A motion detection system for detecting motion and comprising
[0009] A dynamic camera system for receiving dynamic image information registered in an image coordinate system of the dynamic system,
[0010] a computing unit configured to transform the selected imaging area from the reference coordinate system to the image coordinate system,
[0011] A motion analyzer is used to derive motion information from the transformed registered dynamic image information in the selected imaging region.
[0012] The tomographic imaging system of the present invention is, for example, a magnetic resonance examination system, a computed tomography (CT) system, an X-ray imaging system or a nuclear medicine imaging system. Such a tomographic imaging system includes a frame, which forms a support for carrying, for example, an X-ray source and an X-ray detector of a computed tomography system or a support for the main magnet of a magnetic resonance examination system. Other examples of tomographic imaging systems into which the present invention can be incorporated are nuclear medicine tomographic imaging systems, such as positron emission tomography (PET) systems, single photon emission computed tomography (SPECT) systems, and hybrid tomographic imaging systems, such as PET-CT systems and MRI-CT systems. The present invention can also be incorporated into tomographic image-guided radiotherapy systems, such as MR-LINAC systems. The support defines a reference coordinate system. Tomographic image data (such as an attenuation profile or a k-space profile) is collected in the reference coordinate system. The scan planning control is configured (e.g., in software) to set up the image data acquisition system to acquire tomographic image data from a selected imaging region in a reference coordinate system in which, for example, the portion of the patient's anatomy to be examined is to be placed. The selected imaging region may be set based on user input to the scan planning control, or may be applied to the scan planning control based on region identification from earlier survey images.
[0013] The motion detection system is camera-based and includes a dynamic camera system for receiving dynamic image information from the camera range of the camera system. The camera range is the volume to which the camera system is sensitive to collect dynamic image information, i.e., the field of view of the dynamic camera system. The dynamic image information of the camera system is registered in the image coordinate system of the camera system, i.e., in the correct coordinate system of the image sensor of the camera (i.e., in the image pixel coordinates). When the dynamic camera system is mounted on a support, there is an inherently defined geometric transformation between the reference coordinate system and the image coordinate system of the camera system. The transformation is derived based on the geometric configuration of the system; this may include moving parts, such as a patient support or a rotating gantry, and the geometric transformation may take into account these changes in the geometric configuration of the system. When the dynamic camera system is not fixedly mounted on a support, once the dynamic camera system is set up, it is necessary to calibrate the geometric transformation between the reference coordinate system and the image coordinate frame.
[0014] The selected imaging area is defined in a reference coordinate system and is geometrically reliably, robustly and stably related to the image coordinate system of the camera system. It is worth noting that the geometric transformation can be a 3D to 2D projection from a three-dimensional volume of the reference coordinate system to a two-dimensional region of the image coordinate system of the camera system. By means of a geometric transformation, the selected imaging area can be transformed to the image coordinate system, generating a transformed selected imaging area in the image coordinate system of the camera system. In other words, the selected imaging area is projected as a region of interest onto the image pixel coordinates of the image coordinate frame.
[0015] The motion analyzer is configured to derive motion from dynamic image information acquired by the camera system within the region of interest transformed from the selected imaging zone. This enables determination of whether motion occurs within or near the imaging zone; the imaging zone is defined in the reference coordinate system of the support. The motion analyzer is configured to identify changes in objects of features in the dynamic image information from the dynamic camera system. Such motion within or near the imaging zone may interfere with the image information acquired by the image data acquisition system, for example, in that motion corruption may confuse the computed tomography attenuation profile acquired by the X-ray detector or the k-space profile acquired by the RF receiving system of the magnetic resonance examination system. Therefore, in the event that motion is detected by the motion analyzer within or near the imaging zone, the detected motion can be adopted for motion correction of the image information, or in reconstructing a final image based on the acquired image information. On the other hand, the imaging process is not disturbed by motion that is picked up by the dynamic camera system and occurs outside the imaging zone and does not occur in the imaging zone and does not require correction.
[0016] The support (i.e., the gantry) defines an examination zone, in particular an area around which an X-ray source and an X-ray detector can rotate or a bore of a magnetic resonance examination system. The examination zone is a space in which an object to be imaged (i.e., a patient to be examined) can be positioned. During tomographic imaging, data profiles (X-ray attenuation, k-space profiles) are acquired from the object to be imaged (the patient to be examined) in the examination zone. The imaging zone defines a volumetric region of the object from which data profiles are acquired to reconstruct (one or more) tomographic images. Based on these profiles, tomographic images (e.g., computed tomography images or magnetic resonance images) can be reconstructed. These profiles are acquired from portions of the anatomical structure of the patient to be examined (i.e., in the selected imaging zone). The reconstructed image is applied to the output of the tomographic imaging system. Reconstructing a magnetic resonance image from the acquired k-space profile or attenuation profile can be performed on a panel of the tomographic imaging system. Alternatively, the reconstruction can be outsourced to a reconstruction facility corresponding to the tomographic imaging system online. That is, the acquired profile data and optionally also the motion correction data can be uploaded to a reconstruction facility (e.g., in the cloud), and the motion correction and image reconstruction can be performed by an off-site reconstruction facility, and the reconstructed image data returned to the user, for example, to a tomographic imaging system or a separate workstation.
[0017] In another detailed embodiment of the present invention, the motion detection system can access a volume contour of an object to be imaged. The volume contour can be represented by an image data set and represents the three-dimensional outer surface of the object in a reference coordinate system. The object is, for example, a body (part) of a patient to be examined.
[0018] By means of the scan plan control, an imaging region to be tomographically imaged by the tomographic imaging system may be selected in a reference coordinate system. The selection may be made automatically based on an instruction of which region of the object is to be examined, or the selection may be made manually. The scan plan control may be implemented in software and may be user controlled via a graphical user interface where the user may indicate a selection which is then planned to be imaged.
[0019] The region analyzer is configured to determine the region(s) of interest of the volume contour in the selected imaging region in a reference coordinate system / frame. The region analyzer is implemented in software that is capable of registering the volume contour and the selected imaging volume in the reference coordinate system. The computing unit is further configured to transform the portion of interest to the image coordinate system of the dynamic camera system. This defines the region of interest in the image coordinate system for the motion detection system for motion analysis.
[0020] The motion camera system is set up to acquire dynamic image information from the region of interest in a reference coordinate system. In this way, the dynamic camera system can capture motion within its range, which may include (part of) the selected imaging area. The motion analyzer derives motion only or primarily from the region of interest, while the dynamic camera system may also image outside the inspection area. It should be understood that in certain cases, the motion analyzer may include data taken from a region that is slightly larger than the region of interest (e.g., 1%, 3%, 5% or 10% larger in one or more dimensions) in order to also capture motion just outside the selected imaging area, as these motions may still have some impact on the images acquired by the tomographic scanning system.
[0021] The position and size of the acquisition range of the dynamic camera system can be adjusted according to the determined part of the region of interest in the volume contour in the image coordinate frame, so that the dynamic image information mainly relates to the movement of the part of interest. Therefore, the dynamic image information is a suitable basis for detecting movements that are actually important for the motion correction of the tomographic image information. The detection of movement can be accomplished by a software implementation of a motion analyzer, which can compare successive image frames of the dynamic image information to detect that features in the image information have moved. Any movement that may be within the range of the dynamic camera system but not within the (imaging) region of interest is avoided in the motion correction of the tomographic image information. That is, any movement that may be within the range of the dynamic camera system but will not or is unlikely to confuse the image quality of the tomographic image will not be considered for motion detection. Therefore, a more reliable motion detection is achieved.
[0022] The present invention eliminates the need to (eg, manually) limit the range of a camera to the imaging area and its immediate surroundings.
[0023] These and other aspects of the invention will be further described in detail with reference to the embodiments defined in the dependent claims.
[0024] In a preferred example of the tomographic imaging system of the present invention, the intrinsic coordinate system of the support is used as the reference coordinate system. The intrinsic coordinate system of the support can be a coordinate system defined by a magnet structure defining a magnet bore or a mounting support carrying an X-ray source and an X-ray detector. Alternatively, the reference coordinate system can be defined relative to another component of the tomographic imaging system that is well defined. In one example, the reference coordinate system can be linked to a patient carrier. The reference coordinate system then moves with the patient carrier, and the geometric transformation on the image coordinate system will take into account the movement of the patient carrier relative to the dynamic camera system. In this way, the reference coordinate system is practical and directly related to the examination area.
[0025] In a practical example of a tomographic imaging system, a dynamic camera system is mounted to a support so that its imaging range covers the position of the object or even at least the entire examination area. Thus, the dynamic camera can be used to monitor the situation in the examination area, not only for movement, but also for positioning of auxiliary equipment, for example, and can observe the patient to be examined in the examination area.
[0026] In another practical example of a tomographic imaging system, a separate depth camera is provided to acquire the volume profile. The depth camera can be mounted so that the volume profile can be acquired when the object (e.g., a patient to be examined) is outside the examination area. The depth camera is also calibrated for the coordinate system of the support. In another embodiment, the dynamic camera system is configured to also acquire the volume profile.
[0027] In yet another example, the volume contour may be acquired by the tomographic imaging system itself. Alternatively, the volume contour may be derived from a previous tomographic (e.g., MR or CT) examination, where the data is accessed from a PACS system. In the case of a magnetic resonance examination system, the volume contour may be derived from a survey scan of the magnetic resonance signals at a relatively low spatial resolution. In the case of a computed tomography system, the volume contour may be acquired from an attenuation profile of low X-ray dose and coarse spatial resolution.
[0028] In a further implementation, the volume profile is registered in a reference coordinate system of the support. In this way, the volume profile can be acquired in a reference system that is independent of the coordinate system of the dynamic camera system. For example, the volume profile can be acquired by a depth camera mounted to view an area outside the inspection area.
[0029] The present invention also relates to a motion detection method. According to the method of the present invention, the volume contour of the object to be tomographically imaged is accessed (from a memory) or has been acquired, for example, by a depth camera. An imaging region of interest to be tomographically imaged is planned. The planning can be done automatically according to instructions on what part to image, or can be done manually by a user interface that displays, for example, already acquired survey image information. During tomographic image acquisition, dynamic image information is also acquired, for example by a dynamic camera system. The volume contour and the imaging region are registered in an imaging coordinate system of a support of the tomographic imaging system. The dynamic image information is registered in a reference coordinate system of the dynamic camera system. In the reference coordinate system, the overlap of the volume contour with the imaging region is determined. This overlap is geometrically transformed from the reference coordinate system to the region of interest in the image coordinate system. The geometric transformation of a point in the 3D overlap to the 2D image coordinate system is a projection that can be determined by calibrating the dynamic camera system for the reference coordinate system, in which the tomographic image data is also acquired by the tomographic imaging system. The motion of the volume contour portion in the region of interest is then monitored by the dynamic image information. Monitored motion may be particularly interesting for correcting motion effects on tomographic image data. Motion correction for motion detected in a region of interest may be used to correct a k-space profile or an attenuation profile. Alternatively, motion correction may be used in reconstructing an image from the profile. Further, motion detection may be used to pause scanning when motion is detected and resume data acquisition after motion. In another additional example, detected motion may be used to stop data acquisition and reacquire data.
[0030] The invention also relates to a computer program comprising instructions for:
[0031] Select the imaging area to be tomographically imaged,
[0032] acquiring tomographic image data from a selected imaging region in a reference coordinate system,
[0033] receiving dynamic image information registered in the image coordinate system of the dynamic camera system,
[0034] projecting at least a portion of a selected imaging region from the reference coordinate system onto the image coordinate system, and
[0035] Motion information is derived from the projected registered dynamic image information in the selected imaging region.
[0036] When installed in a control processor of a tomographic imaging system, the tomographic imaging system is able to avoid motion that may be within the range of a dynamic camera system but not within the (imaging) region of interest for motion correction of tomographic image information. That is, any motion that may be within the range of a dynamic camera system but will not or is unlikely to confuse the image quality of the tomographic image will not be considered for motion detection. The present invention eliminates the need to (e.g. manually) limit the camera range to the imaging area and its immediate surroundings. Accordingly, when the computer program is installed in a control processor, the tomographic imaging system is able to perform motion detection in a more reliable manner. The computer program of the present invention may be provided on a data carrier such as a CD-ROM or USB stick. Alternatively, the computer program of the present invention may be downloaded from a data network such as the World Wide Web or a cloud-based data network.
[0037] These and other aspects of the invention will be elucidated with reference to the embodiments described hereinafter and with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS
[0038] Figure 1 shows a schematic side view of a tomographic imaging system of the present invention;
[0039] Figure 2 and Figure 3 A schematic side view of an embodiment of a tomographic imaging system of the present invention is shown. DETAILED DESCRIPTION
[0040] Figure 1A schematic side view of a tomographic imaging system of the present invention is shown. A support 10 of the tomographic imaging system defines an examination region 13 in which an object (e.g. a patient to be examined) can be placed for imaging. With the aid of a scan plan control 11, an imaging region 12, i.e. a portion of the object to be imaged, is defined in a reference coordinate system, and the tomographic imaging system is controlled to acquire tomographic image data 12 from the selected imaging region. A motion detection system 20 comprises a dynamic camera system 21 and a motion analyzer 22. The camera range 23 of the dynamic camera extends into the examination region 13 and includes the selected imaging region, but may extend beyond the imaging region 12 or even beyond the examination region 13. The selected imaging region is applied to a camera control 27 to control the dynamic camera 21 to capture the selected imaging region 12 in its range 23. Dynamic image information 26 of the dynamic camera system is applied to the motion analyzer 22. When the dynamic camera system is fixedly mounted to the support, there is an inherent geometric transformation between the reference coordinate system to the imaging coordinate system of the dynamic camera system itself. When the dynamic camera system is movable relative to the support, such geometric transformations may need to be calibrated each time the relative orientation and position of the dynamic camera system is changed. The operation unit 24, such as a computing processor, is configured or programmed to calculate the position in the selected imaging zone in the reference coordinate system to the image coordinate system of the dynamic camera system 21. That is, the position in the selected imaging zone is projected onto the image pixel coordinates of the dynamic image. The motion analyzer 22 is also configured to detect motion in the dynamic image, that is, changes in the position and orientation of features in the dynamic image. In addition, the motion analyzer 22 is configured to distinguish whether the motion detected in the image coordinate system is in the selected imaging zone 12 or near the selected imaging zone 12. Then, the detected motion in the imaging zone is applied to the reconstructor 14 of the tomographic imaging system (or for it). The reconstructor 10 also receives tomographic image data, such as a k-space profile or an attenuation profile, from the tomographic imaging system 10. In the images reconstructed from these k-space profiles or attenuation profiles, motion detected in or near the imaging region is taken into account and the reconstructed images are corrected or compensated for such motion. Alternatively, the motion detection data can be passed to the scan control unit to pause / resume the image data acquisition process. The reconstructed images have a low level of residual (if any) motion artifacts and are therefore of good diagnostic quality.
[0041] Figure 2 and Figure 3 A schematic side view of an embodiment of a tomographic imaging system of the present invention is shown. Figure 2 An embodiment of the tomographic imaging system of the present invention is schematically shown, which employs a volume contour 31 of a patient to be examined. Figure 2As shown, the volume profile can be acquired while the patient to be examined is still outside the examination area 13. For this purpose, for example, a 3D camera 25 is mounted to the ceiling of the examination room so that when the patient to be examined is placed on the patient carrier 16 but has not yet entered the position in the examination area 13 of the tomographic imaging system, the patient to be examined is in the field of view of the 3D camera. The 3D camera 25 is calibrated in a reference coordinate system. When the volume profile has been acquired by the 3D camera 25, the patient support 16 with the patient to be examined can be moved into the examination area 13, as indicated by the double arrow.
[0042] Figure 3The tomographic imaging system of the present invention utilizes a volume contour 31 of a patient to be examined. The 3D camera 25 applies its output in the form of 3D camera data to a volume contour unit 32, which is configured in software to calculate the volume contour 31 of the patient to be examined as a volume contour data set 33 based on the 3D camera data in a reference coordinate system. When the patient carrier 16 is in its final position and the imaging zone contains the part of the anatomical structure of the patient to be examined to be imaged, a region analyzer 34 analyzes the region of interest formed by (one or more) parts of the volume contour 31 falling in the reference coordinate system of the selected imaging zone 12. For this purpose, the position data of the patient to be examined are provided to the region analyzer 34. Information of the selected imaging zone 12 associated with the selected scan protocol is received from the scan plan control 11. That is, when the patient to be examined is in the position in which it is to be imaged, the region analyzer 34 calculates the volume region of interest formed by (one or more) parts of the volume contour 31 falling within the imaging zone 12 in the reference coordinate system of the tomographic imaging system. This region of interest of the volume contour 31 within the imaging zone 12 is fed to the camera control 27 to guide the camera 21 to focus on that portion of the volume contour. The region of interest in the reference coordinate system is then applied by the computing unit 24 to a geometric transformation to the image coordinate system. That is, the volume region of interest derived by the region analyzer 34 is projected onto the 2D image coordinate system as a region of interest in the image pixel coordinates. For this purpose, the computing unit 24 is configured in software to transform the region of interest of the volume contour 31 within the imaging zone from the support or gantry of the tomographic imaging system 10 to the image coordinate system of the camera system. The 2D region of interest 35 of the volume contour is applied to the motion analyzer 22. The dynamic image information 26 from the camera 21 is also applied to the motion analyzer 22. The motion analyzer 22 determines the overlap of the dynamic image information with the 2D region of interest by comparing the 2D region of interest with the dynamic image information. The overlap determines the portion of the motion detected in the dynamic image information, which may have a negative impact on the diagnostic image quality of the magnetic resonance image and needs to be corrected in the acquired data profile or reconstruction 14. Based on the determined motion, a motion correction that can be used to correct the tomographic image data can be derived.Alternatively, the motion correction can be employed for reconstructing a tomographic image from the tomographic image data to pause, resume, stop or repeat data acquisition.
Claims
1. A tomographic imaging system, comprising: a support that carries the tomographic image data acquisition system and defines a reference coordinate system, a scan plan control for setting the tomographic image data acquisition system to acquire tomographic image data from the selected imaging region in the reference coordinate system, A motion detection system for detecting motion and comprising: a dynamic camera system for receiving dynamic image information registered in an image coordinate system of the dynamic camera system, a computing unit configured to transform the selected imaging area from the reference coordinate system to the image coordinate system, a motion analyzer for deriving motion information from the transformed registered dynamic image information in the selected imaging region, The motion detection system has access to a volume profile from survey scan data or from the dynamic camera system, including a selected imaging region in the reference coordinate system; a region analyzer for determining a region of interest of the volume contour within the selected imaging region in the reference coordinate system, The computing unit is configured to transform the region of interest from the reference coordinate system to the image coordinate system of the dynamic camera system, thereby determining a transformed region of interest, and, a camera control for setting said acquisition of said dynamic camera system to acquire dynamic image information from at least said determined transformed region of interest, and A motion analyzer for deriving motion primarily from said dynamic image information from the transformed region of interest.
2. The tomographic imaging system of claim 1 having a gantry defining the reference coordinate system.
3. The tomographic imaging system according to claim 1, wherein: The dynamic camera system is mounted to the support such that at least a portion of the selected imaging area is within the range of the dynamic camera system.
4. The tomographic imaging system according to any one of claims 1 to 3, wherein: The motion detection system is provided with a depth camera to acquire the volume profile.
5. The tomographic imaging system according to claim 4, wherein: The depth camera is part of the dynamic camera system.
6. The tomographic imaging system according to any one of claims 1 to 3, configured to transform the derived or acquired volume contour to the reference coordinate system defined by the support.
7. A method for detecting motion of an object during tomographic imaging, comprising the steps of: Select the imaging area to be tomographically imaged, acquiring tomographic image data from a selected imaging region in a reference coordinate system, receiving dynamic image information registered in the image coordinate system of the dynamic camera system, projecting at least a portion of a selected imaging region from the reference coordinate system onto the image coordinate system, and deriving motion information from the projected registered dynamic image information in the selected imaging region, accessing, in said reference coordinate system, a volume contour of said object to be tomographically imaged, determining a region of interest of one or more portions of interest of the volume contour within the selected imaging region, Projecting the region of interest to a region of interest in an image coordinate system of the dynamic image information, Motion is derived from the dynamic image information primarily in the projected region of interest.
8. A computer program product comprising a computer program, the computer program comprising instructions which, when the computer program is run by a computer, cause the computer to perform the following steps: Select the imaging area to be tomographically imaged, acquiring tomographic image data from a selected imaging region in a reference coordinate system, receiving dynamic image information registered in the image coordinate system of the dynamic camera system, projecting at least a portion of a selected imaging region from the reference coordinate system onto the image coordinate system, and deriving motion information from the projected registered dynamic image information in the selected imaging region, accessing, in said reference coordinate system, a volume contour of an object to be tomographically imaged, determining a region of interest of one or more portions of interest of the volume contour within the selected imaging region, Projecting the region of interest to a region of interest in an image coordinate system of the dynamic image information, Motion is derived from the dynamic image information primarily in the projected region of interest.
