Multi-modal imaging system and coronary angiography catheter

By combining a multimodal imaging system with optical coherence tomography, ultrasound, and fluorescence imaging modules, the problem of inaccurate diagnosis caused by a single imaging module has been solved, enabling precise imaging and diagnosis of coronary arteries.

CN118975781AActive Publication Date: 2024-11-19DONGGUAN DIKAI MEDICAL

Patent Information

Application Number
CN202411101100.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-12
Publication Date
2024-11-19
Estimated Expiration
2044-08-12

AI Technical Summary

Technical Problem

In existing coronary angiography techniques, the single optical coherence tomography module results in inaccurate and incomplete image results, leading to subjective diagnostic results and difficulties in subsequent treatment.

Method used

A multimodal imaging system is used, combining optical coherence tomography, ultrasound imaging, and fluorescence imaging modules. Multimodal imaging images are generated through imaging region determination, image integration, and correction.

Benefits of technology

It provides more comprehensive and accurate medical images, enabling accurate determination of coronary artery location and type, and improving the objectivity and accuracy of diagnosis.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118975781A_ABST
    Figure CN118975781A_ABST
Patent Text Reader

Abstract

According to the multi-modal imaging system and the coronary angiography catheter, the coronary artery structure after the coronary angiography catheter enters the coronary artery of a patient and is injected with a contrast agent is obtained, the imaging area is determined based on the coronary artery structure, a basis is provided for multi-modal imaging, then optical scanning is conducted on the imaging area, and the imaging area is obtained. The method comprises the following steps: obtaining an optical coherence tomography image, carrying out fluorescence detection on an imaging region, obtaining a fluorescence imaging image, obtaining image types in multiple modes, providing a multi-mode image basis for providing a comprehensive and accurate medical image, and integrating the optical coherence tomography image, the ultrasonic imaging image and the fluorescence imaging image to obtain an optical coherence tomography image. According to the method, the position and the type of the coronary blood are accurately judged, the multi-modal imaging image is obtained, the multi-modal imaging system is combined with multiple imaging modes, more comprehensive and accurate medical images are provided, and doctors can obtain multiple types of medical image information at the same time.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of medical imaging equipment, and in particular to a multimodal imaging system and a coronary angiography catheter. Background Art

[0002] In diagnosis and treatment, coronary angiography is an important examination method for cardiovascular diseases. Through coronary angiography, doctors can understand the degree of coronary artery stenosis in patients in a short period of time, and make certain judgments on the patients based on this to decide whether to perform stent implantation.

[0003] Coronary angiography catheters can accurately enter the patient's coronary arteries and clearly display the anatomical structure and lesions of the coronary arteries by injecting contrast agents. Further imaging analysis is required to determine the extent of coronary artery stenosis. Currently, doctors usually determine the location and type of coronary vessels based on optical coherence tomography modules. Single image determination results in inaccurate and incomplete image results, which makes the diagnostic results subjective and brings certain difficulties to subsequent treatment. Summary of the invention

[0004] The present invention provides a multimodal imaging system and a coronary angiography catheter to solve the problems raised in the background technology.

[0005] A multimodal imaging system, comprising:

[0006] An imaging region determination module is used to obtain the coronary artery structure after the coronary angiography catheter enters the patient's coronary artery and injects contrast agent, and determine the imaging region based on the coronary artery structure;

[0007] An optical coherence tomography module, used for optically scanning an imaging area to obtain an optical coherence tomography image;

[0008] An ultrasonic imaging module, used for ultrasonically scanning an imaging area to obtain an ultrasonic imaging image;

[0009] A fluorescence imaging module, used to perform fluorescence detection on the imaging area to obtain a fluorescence imaging image;

[0010] The integration module is used to integrate the optical coherence tomography image, the ultrasound imaging image and the fluorescence imaging image to obtain a multimodal imaging image.

[0011] Preferably, the imaging area determination module includes:

[0012] A common imaging unit, used for performing common imaging of the coronary artery structure after the coronary angiography catheter enters the patient's coronary artery and the contrast agent is injected, so as to obtain a basic image of the coronary artery;

[0013] A difference determination unit, used for comparing the coronary artery basic image with the standard basic image to obtain an image difference;

[0014] The region determination unit is used to obtain the position region where the image difference is located on the coronary artery basic image, and expand it based on the region size and region characteristics of the position region to obtain the target region, and use the target region as the imaging region.

[0015] Preferably, the optical coherence tomography module comprises:

[0016] A marking unit, used to dynamically mark the imaging area based on the regional lesion characteristics to obtain a dynamic marking sequence, and determine a scanning tracking sequence based on the pathological marking sequence;

[0017] a scanning unit, configured to determine optical scanning parameters according to the scanning tracking sequence, and optically scan an imaging area according to the optical scanning parameters to obtain a scanning data set;

[0018] The image generating unit is used to perform dispersion correction on the scanned data set to obtain a target data set, and generate an optical coherence tomography image based on the target data set.

[0019] Preferably, the marking unit comprises:

[0020] a marking determination unit, for performing a transverse analysis of regional lesion characteristics and marking the lesion grade on the imaging region according to the extent of the lesion;

[0021] A marking sequence generating unit, used to perform longitudinal analysis on regional lesion characteristics based on lesion grade marks, determine position dynamic characteristics of lesion grade marks, and dynamically mark the imaging area based on the position dynamic characteristics to obtain a dynamic marking sequence;

[0022] The tracking sequence generating unit is used to determine the scanning area emphasis level based on the lesion level mark in the dynamic marking sequence, determine the scanning area dynamic characteristics based on the position dynamic characteristics in the dynamic marking sequence, and generate a scanning tracking sequence based on the scanning area emphasis level and the scanning area dynamic characteristics.

[0023] Preferably, the ultrasonic imaging module comprises:

[0024] An orientation determination unit, used for acquiring orientation information of an imaging area using an orientation sensor;

[0025] The ultrasonic imaging unit is used to determine ultrasonic scanning parameters based on the position information, and use the ultrasonic scanning parameters to perform ultrasonic scanning on the imaging area to obtain an ultrasonic imaging image.

[0026] Preferably, the fluorescence imaging module comprises:

[0027] A segmentation unit is used to perform fluorescence detection on the imaging area to obtain a real-time fluorescence image, determine the fluorescence spectrum wavelength of the real-time fluorescence image, and segment the real-time fluorescence image based on the fluorescence spectrum wavelength to obtain a fluorescence area image containing main information;

[0028] The fusion unit is used to perform saliency detection on the fluorescence area image and fuse it with the visible light image of the imaging area to obtain a fluorescence imaging image.

[0029] Preferably, the fusion unit comprises:

[0030] A detection unit, used to perform saliency detection on the fluorescent area image using a saliency detection algorithm to obtain a saliency fluorescent image, and to perform saliency detection on the visible light image using a saliency detection algorithm to obtain a saliency visible light image;

[0031] The image fusion unit is used to fuse the significant fluorescence image and the significant visible light image based on the image fusion technology to obtain the fluorescence imaging image.

[0032] Preferably, the integration module comprises:

[0033] A positioning unit, used to mark key positions of an imaging area to obtain position marking points, respectively obtain first position features, second position features and third position features of the position marking points in the optical coherence tomography image, the ultrasound imaging image and the fluorescence imaging image, and synchronously position the optical coherence tomography image, the ultrasound imaging image and the fluorescence imaging image based on the first position features, the second position features and the third position features to obtain positioning information;

[0034] A fusion unit, used for fusing the optical coherence tomography image, the ultrasound imaging image and the fluorescence imaging image based on the positioning information to obtain a fused imaging image;

[0035] A difference comparison unit, used to compare the main image features of the fused imaging image with the optical coherence tomography imaging image, the ultrasound imaging image and the fluorescence imaging image, respectively, to obtain image feature differences, and to determine whether the image feature differences are within a preset difference range;

[0036] If so, it is determined that there is no multi-type conflict in the fused imaging image, and the fused imaging image is used as the initial multi-modal imaging;

[0037] Otherwise, it is determined that there are multiple types of conflicts in the fused imaging image, and based on the image feature differences and in combination with the main image features, the fused imaging image is corrected to obtain an initial multimodal imaging image;

[0038] The processing unit is used to perform background weakening and lesion area ratio enlargement processing on the initial multimodal imaging image to obtain a final multimodal imaging image.

[0039] Preferably, the difference comparison unit comprises:

[0040] A weight determination unit, configured to determine a first correction weight based on the difference in the image feature difference, and determine a second correction weight based on the contribution of the main image feature to the diagnosis of the lesion;

[0041] The correction unit is used to determine a correction scheme based on the main image features, and determine a specific correction value in the correction scheme based on the first correction weight and the second correction weight, and correct the fused imaging image according to the specific correction value to obtain an initial multimodal imaging image.

[0042] Preferably, a coronary angiography catheter comprises: the coronary angiography catheter consists of a head end, a catheter and a catheter seat, the material of the head end is polyamide, and the material of the catheter is polyamide.

[0043] Compared with the prior art, the present invention has achieved the following beneficial effects:

[0044] 1) By obtaining the coronary artery structure after the coronary angiography catheter enters the patient's coronary artery and injects the contrast agent, the imaging area is determined based on the coronary artery structure to provide a basis for multimodal imaging. Then, the imaging area is optically scanned to obtain an optical coherence tomography image, and the imaging area is subjected to fluorescence detection to obtain a fluorescence imaging image. Image types under multiple modes are obtained to provide a multimodal image basis for providing comprehensive and accurate medical images. By integrating the optical coherence tomography image, the ultrasound imaging image and the fluorescence imaging image, the accurate determination of the position and type of coronary blood is achieved to obtain a multimodal imaging image. The multimodal imaging system combines multiple imaging modalities to provide more comprehensive and accurate medical images, allowing doctors to simultaneously obtain multiple types of medical image information.

[0045] 2) Marking key positions of the imaging area to obtain position marking points, respectively obtaining first position features, second position features and third position features of the position marking points in the optical coherence tomography image, the ultrasonic imaging image and the fluorescent imaging image, and synchronously positioning the optical coherence tomography image, the ultrasonic imaging image and the fluorescent imaging image based on the first position features, the second position features and the third position features to obtain positioning information, thereby achieving unified positioning of the optical coherence tomography image, the ultrasonic imaging image and the fluorescent imaging image, and providing a position basis for image integration, and then fusing the optical coherence tomography image, the ultrasonic imaging image and the fluorescent imaging image based on the positioning information to obtain a fused imaging image, thereby achieving fusion of multimodal images, making the viewing of multimodal images more convenient and accurate, and secondly, fusing the fused imaging image with the optical coherence tomography image, the ultrasonic imaging image and the fluorescent imaging image, respectively. The main image features of the fluorescence imaging images are compared to obtain image feature differences, and it is determined whether the image feature differences are within a preset difference range. If so, it is determined that there is no multi-type conflict in the fused imaging image, and the fused imaging image is used as the initial multimodal imaging; otherwise, it is determined that there is a multi-type conflict in the fused imaging image, and based on the image feature differences and combined with the main image features, the fused imaging image is corrected to obtain an initial multimodal imaging image to ensure the image accuracy of each mode of the initial multimodal imaging image. Finally, the initial multimodal imaging image is processed with background weakening and lesion area ratio increased to obtain a final multimodal imaging image, to achieve accurate determination of the location and type of coronary blood, and to obtain a multimodal imaging image. The multimodal imaging system combines multiple imaging modalities to provide more comprehensive and accurate medical images, allowing doctors to simultaneously obtain multiple types of medical image information.

[0046] Other features and advantages of the present invention will be described in the following description, and partly become apparent from the description, or understood by practicing the present invention. The purpose and other advantages of the present invention can be realized and obtained by the structures specifically pointed out in this application document.

[0047] The technical solution of the present invention is further described in detail below through the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings:

[0049] Figure 1 is a structural diagram of a multimodal imaging system in an embodiment of the present invention;

[0050] Figure 2 is a structural diagram of the imaging area determination module in an embodiment of the present invention;

[0051] Figure 3 4 is a structural diagram of the optical coherence tomography module described in an embodiment of the present invention. DETAILED DESCRIPTION

[0052] The preferred embodiments of the present invention are described below in conjunction with the accompanying drawings. It should be understood that the preferred embodiments described herein are only used to illustrate and explain the present invention, and are not used to limit the present invention.

[0053] Embodiment 1:

[0054] The present invention provides a multi-modal imaging system. Figure 1 As shown, including:

[0055] An imaging region determination module is used to obtain the coronary artery structure after the coronary angiography catheter enters the patient's coronary artery and injects contrast agent, and determine the imaging region based on the coronary artery structure;

[0056] An optical coherence tomography module, used for optically scanning an imaging area to obtain an optical coherence tomography image;

[0057] An ultrasonic imaging module, used for ultrasonically scanning an imaging area to obtain an ultrasonic imaging image;

[0058] A fluorescence imaging module, used to perform fluorescence detection on the imaging area to obtain a fluorescence imaging image;

[0059] The integration module is used to integrate the optical coherence tomography image, the ultrasound imaging image and the fluorescence imaging image to obtain a multimodal imaging image.

[0060] In this embodiment, the imaging region is determined based on the coronary artery structure according to common imaging results, such as grayscale images.

[0061] In this embodiment, the integration of the optical coherence tomography image, the ultrasound imaging image and the fluorescence imaging image includes operations such as image positioning, fusion and correction.

[0062] The beneficial effects of the above design scheme are: by obtaining the coronary artery structure after the coronary angiography catheter enters the patient's coronary artery and injects the contrast agent, the imaging area is determined based on the coronary artery structure to provide a basis for multimodal imaging, and then the imaging area is optically scanned to obtain an optical coherence tomography image, and the imaging area is subjected to fluorescence detection to obtain a fluorescence imaging image, and image types under multiple modes are obtained to provide a multimodal image basis for providing comprehensive and accurate medical images, and by integrating the optical coherence tomography image, the ultrasound imaging image and the fluorescence imaging image, the accurate determination of the coronary blood position and type is achieved to obtain a multimodal imaging image. The multimodal imaging system combines multiple imaging modalities to provide more comprehensive and accurate medical images, so that doctors can simultaneously obtain multiple types of medical image information.

[0063] Embodiment 2:

[0064] Based on Example 1, the present invention provides a multi-modal imaging system, such as Figure 2 As shown, the imaging area determination module includes:

[0065] A common imaging unit, used for performing common imaging of the coronary artery structure after the coronary angiography catheter enters the patient's coronary artery and the contrast agent is injected, so as to obtain a basic image of the coronary artery;

[0066] A difference determination unit, used for comparing the coronary artery basic image with the standard basic image to obtain an image difference;

[0067] The region determination unit is used to obtain the position region where the image difference is located on the coronary artery basic image, and expand it based on the region size and region characteristics of the position region to obtain the target region, and use the target region as the imaging region.

[0068] The beneficial effects of the above design scheme are: by performing ordinary imaging on the coronary artery structure after the coronary angiography catheter enters the patient's coronary artery and injects the contrast agent, a coronary artery basic image is obtained to provide an image basis for determining the imaging area, the coronary artery basic image is compared with the standard basic image to obtain the image difference, the position area where the image difference is located is obtained on the coronary artery basic image, and it is expanded based on the area size and area characteristics of the position area to obtain the target area, and the target area is used as the imaging area to provide a basis for multimodal imaging.

[0069] Embodiment 3:

[0070] Based on Example 1, the present invention provides a multi-modal imaging system, such as Figure 3 As shown, the optical coherence tomography module comprises:

[0071] A marking unit, used to dynamically mark the imaging area based on the regional lesion characteristics to obtain a dynamic marking sequence, and determine a scanning tracking sequence based on the pathological marking sequence;

[0072] a scanning unit, configured to determine optical scanning parameters according to the scanning tracking sequence, and optically scan an imaging area according to the optical scanning parameters to obtain a scanning data set;

[0073] The image generating unit is used to perform dispersion correction on the scanned data set to obtain a target data set, and generate an optical coherence tomography image based on the target data set.

[0074] The beneficial effects of the above-mentioned design scheme are as follows: by dynamically marking the imaging area based on the regional lesion characteristics to obtain a dynamic marking sequence, and based on the pathological marking sequence, determining a scanning tracking sequence, determining optical scanning parameters according to the scanning tracking sequence, optically scanning the imaging area according to the optical scanning parameters to obtain a scanning data set, performing dispersion correction on the scanning data set to obtain a target data set, and generating an optical coherence tomography image based on the target data set, thereby providing an optical coherence tomography image type for multimodal imaging.

[0075] Embodiment 4:

[0076] Based on Example 3, an embodiment of the present invention provides a multimodal imaging system, wherein the marking unit includes:

[0077] a marking determination unit, for performing a transverse analysis of regional lesion characteristics and marking the lesion grade on the imaging region according to the extent of the lesion;

[0078] A marking sequence generating unit, used to perform longitudinal analysis on regional lesion characteristics based on lesion grade marks, determine position dynamic characteristics of lesion grade marks, and dynamically mark the imaging area based on the position dynamic characteristics to obtain a dynamic marking sequence;

[0079] The tracking sequence generating unit is used to determine the scanning area emphasis level based on the lesion level mark in the dynamic marking sequence, determine the scanning area dynamic characteristics based on the position dynamic characteristics in the dynamic marking sequence, and generate a scanning tracking sequence based on the scanning area emphasis level and the scanning area dynamic characteristics.

[0080] In this embodiment, the transverse analysis of the regional lesion characteristics is to analyze the same image, and the longitudinal analysis of the regional lesion characteristics is to analyze multiple images acquired in multiple time periods.

[0081] The beneficial effects of the above-mentioned design scheme are as follows: by performing a horizontal analysis on the regional lesion characteristics, marking the lesion level on the imaging area according to the degree of the lesion, determining the lesion level characteristics on the same image, and providing a basis for determining the key level of the scanning area in the scanning tracking sequence; by performing a vertical analysis on the regional lesion characteristics based on the lesion level mark, determining the position dynamic characteristics of the lesion level mark, dynamically marking the imaging area based on the position dynamic characteristics, and obtaining a dynamic marking sequence, providing a basis for determining the dynamic characteristics of the scanning area in the scanning tracking sequence; finally, determining the key level of the scanning area based on the lesion level mark in the dynamic marking sequence, determining the dynamic characteristics of the scanning area based on the position dynamic characteristics in the dynamic marking sequence, and generating a scanning tracking sequence based on the scanning area key level and the scanning area dynamic characteristics, providing a basis for generating accurate optical coherence tomography images.

[0082] Embodiment 5:

[0083] Based on Example 1, an embodiment of the present invention provides a multimodal imaging system, wherein the ultrasound imaging module includes:

[0084] An orientation determination unit, used for acquiring orientation information of an imaging area using an orientation sensor;

[0085] The ultrasonic imaging unit is used to determine ultrasonic scanning parameters based on the position information, and use the ultrasonic scanning parameters to perform ultrasonic scanning on the imaging area to obtain an ultrasonic imaging image.

[0086] The beneficial effect of the above design scheme is: by using the azimuth sensor to obtain the azimuth information of the imaging area, based on the azimuth information, the ultrasonic scanning parameters are determined, and the ultrasonic scanning parameters are used to perform ultrasonic scanning on the imaging area to obtain an ultrasonic imaging image, thereby providing an ultrasonic imaging image type for multimodal imaging.

[0087] Embodiment 6:

[0088] Based on Example 1, the embodiment of the present invention provides a multimodal imaging system, wherein the fluorescence imaging module comprises:

[0089] A segmentation unit is used to perform fluorescence detection on the imaging area to obtain a real-time fluorescence image, determine the fluorescence spectrum wavelength of the real-time fluorescence image, and segment the real-time fluorescence image based on the fluorescence spectrum wavelength to obtain a fluorescence area image containing main information;

[0090] The fusion unit is used to perform saliency detection on the fluorescence area image and fuse it with the visible light image of the imaging area to obtain a fluorescence imaging image.

[0091] The beneficial effects of the above design scheme are: by performing fluorescence detection on the imaging area, a real-time fluorescence image is obtained, and the fluorescence spectrum wavelength of the real-time fluorescence image is determined, and based on the fluorescence spectrum wavelength, the real-time fluorescence image is segmented to obtain a fluorescence area image with main information, and the fluorescence area image is subjected to saliency detection and fused with the visible light image of the imaging area to obtain a fluorescence imaging image, thereby providing a fluorescence imaging image type for multimodal imaging.

[0092] Embodiment 7:

[0093] Based on Example 6, an embodiment of the present invention provides a multimodal imaging system, wherein the fusion unit includes:

[0094] A detection unit, used to perform saliency detection on the fluorescent area image using a saliency detection algorithm to obtain a saliency fluorescent image, and to perform saliency detection on the visible light image using a saliency detection algorithm to obtain a saliency visible light image;

[0095] The image fusion unit is used to fuse the significant fluorescence image and the significant visible light image based on the image fusion technology to obtain the fluorescence imaging image.

[0096] In this embodiment, the saliency detection algorithm is adaptively selected from existing saliency detection algorithms, and the image fusion technology is adaptively selected from existing image fusion technologies.

[0097] The beneficial effects of the above design scheme are: by using the saliency detection algorithm to perform saliency detection on the fluorescence area image, a saliency fluorescence image is obtained, and by using the saliency detection algorithm to perform saliency detection on the visible light image, a saliency visible light image is obtained, and based on the image fusion technology, the saliency fluorescence image and the saliency visible light image are fused to obtain a fluorescence imaging image, thereby ensuring the accuracy of the obtained fluorescence imaging image and providing a high-quality image foundation for the final multimodal imaging.

[0098] Embodiment 8:

[0099] Based on Example 1, the embodiment of the present invention provides a multi-modal imaging system, wherein the integration module includes:

[0100] A positioning unit, used to mark key positions of an imaging area to obtain position marking points, respectively obtain first position features, second position features and third position features of the position marking points in the optical coherence tomography image, the ultrasound imaging image and the fluorescence imaging image, and synchronously position the optical coherence tomography image, the ultrasound imaging image and the fluorescence imaging image based on the first position features, the second position features and the third position features to obtain positioning information;

[0101] A fusion unit, used for fusing the optical coherence tomography image, the ultrasound imaging image and the fluorescence imaging image based on the positioning information to obtain a fused imaging image;

[0102] A difference comparison unit, used to compare the main image features of the fused imaging image with the optical coherence tomography imaging image, the ultrasound imaging image and the fluorescence imaging image, respectively, to obtain image feature differences, and to determine whether the image feature differences are within a preset difference range;

[0103] If so, it is determined that there is no multi-type conflict in the fused imaging image, and the fused imaging image is used as the initial multi-modal imaging;

[0104] Otherwise, it is determined that there are multiple types of conflicts in the fused imaging image, and based on the image feature differences and in combination with the main image features, the fused imaging image is corrected to obtain an initial multimodal imaging image;

[0105] The processing unit is used to perform background weakening and lesion area ratio enlargement processing on the initial multimodal imaging image to obtain a final multimodal imaging image.

[0106] The beneficial effects of the above design scheme are as follows: by marking key positions of the imaging area to obtain position marking points, the first position features, second position features and third position features of the position marking points in the optical coherence tomography image, the ultrasonic imaging image and the fluorescent imaging image are respectively obtained, and the optical coherence tomography image, the ultrasonic imaging image and the fluorescent imaging image are synchronously positioned based on the first position features, the second position features and the third position features to obtain positioning information, thereby achieving unified positioning of the optical coherence tomography image, the ultrasonic imaging image and the fluorescent imaging image, providing a position basis for image integration, and then, based on the positioning information, the optical coherence tomography image, the ultrasonic imaging image and the fluorescent imaging image are fused to obtain a fused imaging image, thereby achieving the fusion of multimodal images, making the viewing of multimodal images more convenient and accurate, and secondly, the fused imaging image is respectively combined with the optical coherence tomography image, the ultrasonic imaging image and the fluorescent imaging image. The main image features of the acoustic imaging image and the fluorescent imaging image are compared to obtain the image feature difference, and it is determined whether the image feature difference is within the preset difference range. If so, it is determined that there is no multi-type conflict in the fused imaging image, and the fused imaging image is used as the initial multimodal imaging; otherwise, it is determined that there is multi-type conflict in the fused imaging image, and based on the image feature difference and combined with the main image features, the fused imaging image is corrected to obtain the initial multimodal imaging image, thereby ensuring the image accuracy of each mode of the initial multimodal imaging image. Finally, the initial multimodal imaging image is processed with background weakening and lesion area ratio increased to obtain the final multimodal imaging image, thereby achieving accurate determination of the location and type of coronary blood and obtaining a multimodal imaging image. The multimodal imaging system combines multiple imaging modalities to provide more comprehensive and accurate medical images, so that doctors can simultaneously obtain multiple types of medical image information.

[0107] Embodiment 9:

[0108] Based on Example 8, an embodiment of the present invention provides a multimodal imaging system, wherein the difference comparison unit includes:

[0109] A weight determination unit, configured to determine a first correction weight based on the difference in the image feature difference, and determine a second correction weight based on the contribution of the main image feature to the diagnosis of the lesion;

[0110] The correction unit is used to determine a correction scheme based on the main image features, and determine a specific correction value in the correction scheme based on the first correction weight and the second correction weight, and correct the fused imaging image according to the specific correction value to obtain an initial multimodal imaging image.

[0111] The beneficial effects of the above design scheme are: by determining the first correction weight based on the difference in the image feature differences, determining the second correction weight based on the contribution of the main image features to the diagnosis of the lesion, determining the correction scheme based on the main image features, and determining the specific correction value in the correction scheme based on the first correction weight and the second correction weight, correcting the fused imaging image according to the specific correction value to obtain an initial multimodal imaging image, thereby ensuring the image accuracy of each mode of the initial multimodal imaging image.

[0112] Embodiment 10:

[0113] Based on Example 1, the embodiment of the present invention provides a coronary angiography catheter, including: the coronary angiography catheter consists of a head end, a catheter and a catheter seat, the material of the head end is polyamide, and the material of the catheter is polyamide.

[0114] The beneficial effect of the above design scheme is that a basis is provided for imaging of a multi-modal imaging system by providing a coronary angiography catheter.

[0115] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention belong to the scope of this application document and its equivalent technology, the present invention is also intended to include these changes and variations.

Claims

1. A multimodal imaging system, characterized in that: include: An imaging region determination module is used to obtain the coronary artery structure after the coronary angiography catheter enters the patient's coronary artery and injects contrast agent, and determine the imaging region based on the coronary artery structure; An optical coherence tomography module, used for optically scanning an imaging area to obtain an optical coherence tomography image; An ultrasonic imaging module, used for ultrasonically scanning an imaging area to obtain an ultrasonic imaging image; A fluorescence imaging module, used to perform fluorescence detection on the imaging area to obtain a fluorescence imaging image; The integration module is used to integrate the optical coherence tomography image, the ultrasound imaging image and the fluorescence imaging image to obtain a multimodal imaging image.

2. A multimodal imaging system according to claim 1, characterized in that: The imaging area determination module comprises: A common imaging unit, used for performing common imaging of the coronary artery structure after the coronary angiography catheter enters the patient's coronary artery and the contrast agent is injected, so as to obtain a basic image of the coronary artery; A difference determination unit, used for comparing the coronary artery basic image with the standard basic image to obtain an image difference; The region determination unit is used to obtain the position region where the image difference is located on the coronary artery basic image, and expand it based on the region size and region characteristics of the position region to obtain the target region, and use the target region as the imaging region.

3. A multimodal imaging system according to claim 1, characterized in that: The optical coherence tomography module comprises: A marking unit, used to dynamically mark the imaging area based on the regional lesion characteristics to obtain a dynamic marking sequence, and determine a scanning tracking sequence based on the pathological marking sequence; a scanning unit, configured to determine optical scanning parameters according to the scanning tracking sequence, and optically scan an imaging area according to the optical scanning parameters to obtain a scanning data set; The image generating unit is used to perform dispersion correction on the scanned data set to obtain a target data set, and generate an optical coherence tomography image based on the target data set.

4. A multimodal imaging system according to claim 3, characterized in that: The marking unit comprises: a marking determination unit, for performing a transverse analysis of regional lesion characteristics and marking the lesion grade on the imaging region according to the extent of the lesion; A marking sequence generating unit, used to perform longitudinal analysis on regional lesion characteristics based on lesion grade marks, determine position dynamic characteristics of lesion grade marks, and dynamically mark the imaging area based on the position dynamic characteristics to obtain a dynamic marking sequence; The tracking sequence generating unit is used to determine the scanning area emphasis level based on the lesion level mark in the dynamic marking sequence, determine the scanning area dynamic characteristics based on the position dynamic characteristics in the dynamic marking sequence, and generate a scanning tracking sequence based on the scanning area emphasis level and the scanning area dynamic characteristics.

5. The multimodal imaging system according to claim 1, characterized in that: The ultrasonic imaging module comprises: An orientation determination unit, used for acquiring orientation information of an imaging area using an orientation sensor; The ultrasonic imaging unit is used to determine ultrasonic scanning parameters based on the position information, and use the ultrasonic scanning parameters to perform ultrasonic scanning on the imaging area to obtain an ultrasonic imaging image.

6. A multimodal imaging system according to claim 1, characterized in that: The fluorescence imaging module comprises: A segmentation unit is used to perform fluorescence detection on the imaging area to obtain a real-time fluorescence image, determine the fluorescence spectrum wavelength of the real-time fluorescence image, and segment the real-time fluorescence image based on the fluorescence spectrum wavelength to obtain a fluorescence area image containing main information; The fusion unit is used to perform saliency detection on the fluorescence area image and fuse it with the visible light image of the imaging area to obtain a fluorescence imaging image.

7. A multimodal imaging system according to claim 6, characterized in that: The fusion unit comprises: A detection unit, used to perform saliency detection on the fluorescent area image using a saliency detection algorithm to obtain a saliency fluorescent image, and to perform saliency detection on the visible light image using a saliency detection algorithm to obtain a saliency visible light image; The image fusion unit is used to fuse the significant fluorescence image and the significant visible light image based on the image fusion technology to obtain the fluorescence imaging image.

8. The multimodal imaging system according to claim 1, characterized in that: The integration module comprises: A positioning unit, used to mark key positions of an imaging area to obtain position marking points, respectively obtain first position features, second position features and third position features of the position marking points in the optical coherence tomography image, the ultrasound imaging image and the fluorescence imaging image, and synchronously position the optical coherence tomography image, the ultrasound imaging image and the fluorescence imaging image based on the first position features, the second position features and the third position features to obtain positioning information; A fusion unit, used for fusing the optical coherence tomography image, the ultrasound imaging image and the fluorescence imaging image based on the positioning information to obtain a fused imaging image; A difference comparison unit, used to compare the main image features of the fused imaging image with the optical coherence tomography imaging image, the ultrasound imaging image and the fluorescence imaging image, respectively, to obtain image feature differences, and to determine whether the image feature differences are within a preset difference range; If so, it is determined that there is no multi-type conflict in the fused imaging image, and the fused imaging image is used as the initial multi-modal imaging; Otherwise, it is determined that there are multiple types of conflicts in the fused imaging image, and based on the image feature differences and in combination with the main image features, the fused imaging image is corrected to obtain an initial multimodal imaging image; The processing unit is used to perform background weakening and lesion area ratio enlargement processing on the initial multimodal imaging image to obtain a final multimodal imaging image.

9. A multimodal imaging system according to claim 8, characterized in that: The difference comparison unit comprises: A weight determination unit, configured to determine a first correction weight based on the difference in the image feature difference, and determine a second correction weight based on the contribution of the main image feature to the diagnosis of the lesion; The correction unit is used to determine a correction scheme based on the main image features, and determine a specific correction value in the correction scheme based on the first correction weight and the second correction weight, and correct the fused imaging image according to the specific correction value to obtain an initial multimodal imaging image.

10. A multimodal imaging system according to claim 1, providing a coronary angiography catheter, comprising: The coronary angiography catheter consists of a tip, a catheter and a catheter seat. The tip is made of polyamide and the catheter is made of polyamide.

Citation Information

Patent Citations

  • Head-wearing molecule image navigation system

    CN104305957A

  • Method and system for predicting physiological condition evaluation parameters from blood vessel images

    CN115511778A

  • Angiography image processing method and system

    CN115511997A

  • System and method for improving optical coherence tomography (OCT) image resolution using k-linearization (KL) and dispersion correction (DC)

    CN116802456A

  • Systems and methods for evaluating vessels

    US20080228086A1

Cited By

  • Living body detection method and system based on multi-modal imaging integration analysis

    CN121059098A

  • A living body detection method and system based on multi-modal imaging integration analysis

    CN121059098B

  • Cross-modal calibration system, method, equipment and medium for infrared thermal imaging

    CN121987176A