Linkage display method and device of contrast image and CTA image, storage medium and electronic equipment

Abstract

The invention provides a contrastographic image and CTA image linkage display method and device, a storage medium and electronic equipment. The method comprises the following steps: acquiring a registration relationship between a contrast image and a CTA image; wherein the angiography image and the CTA image respectively comprise a target blood vessel segment; obtaining at least one blood vessel analysis image corresponding to the CTA image; based on the registration relation between the angiography image and the CTA image, linkage display is conducted on at least one blood vessel analysis image corresponding to the angiography image and the CTA image, and the angiography image and the at least one blood vessel analysis image synchronously display blood vessel information corresponding to the same blood vessel point on the target blood vessel segment. By obtaining the registration relation between the angiography image and the CTA image, the angiography image and the at least one blood vessel analysis image are displayed in a linkage mode, and the correspondence and the display effect of the angiography image and blood vessel information displayed in the at least one blood vessel analysis image are improved.

Description

Technical Field

[0001] The present disclosure relates to the field of image processing technology, and in particular to a method, device, storage medium, and electronic device for displaying angiography images and CTA images in a linked manner. Background Art

[0002] Currently, percutaneous coronary intervention (PCI) is a very important means of treating coronary heart disease.

[0003] In the process of implementing the present disclosure, it was found that there are at least the following technical problems in the existing technology: During PCI surgery, coronary angiography (CAG) is routinely used in clinical practice to observe vascular structure, but coronary angiography has limitations and cannot display information about blood vessels in different dimensions, resulting in poor display of vascular information. Summary of the Invention

[0004] The present disclosure provides a method, device, storage medium and electronic device for the linkage display of angiography images and CTA images, so as to realize the linkage display of different types of images of blood vessels, display a variety of information of blood vessels and improve the display effect.

[0005] According to one aspect of the present disclosure, a method for displaying angiographic images and CTA images in a linked manner is provided, comprising:

[0006] Acquiring a registration relationship between an angiography image and a CTA image; wherein the angiography image and the CTA image each include a target blood vessel segment;

[0007] acquiring at least one blood vessel analysis image corresponding to the CTA image;

[0008] Based on the registration relationship between the angiography image and the CTA image, the angiography image and at least one vascular analysis image corresponding to the CTA image are linked and displayed, wherein the angiography image and the at least one vascular analysis image synchronously display vascular information corresponding to the same vascular point on the target vascular segment.

[0009] Optionally, the blood vessel analysis image includes at least one of the following: a 3D reconstruction image, a curved surface reconstruction image, a diameter image, a multi-planar reconstruction image, and a probe image; wherein the 3D reconstruction image includes at least one of the following: a maximum intensity projection image and a volume rendering image.

[0010] Optionally, the registration relationship between the angiography image and the CTA image includes a registration relationship between the angiography image and a blood vessel point on the target blood vessel segment in the CTA image;

[0011] Linked display of the angiography image and at least one vascular analysis image corresponding to the CTA image includes: determining first vascular point information on the target vascular segment; determining second vascular point information corresponding to the angiography image and the at least one vascular analysis image based on the first vascular point information and the registration relationship; and displaying the corresponding second vascular point information on the angiography image and the at least one vascular analysis image, respectively.

[0012] Optionally, determining the first vessel point information on the target vessel segment includes at least one of the following: determining the first vessel point information on the target vessel segment through an index line in any one of the angiography image and the at least one vessel analysis image, wherein the angiography image and the at least one vessel analysis image respectively include the index line; obtaining an abnormal vessel point by performing abnormality identification on the CTA image, and determining the first vessel point information based on the abnormal vessel point.

[0013] Optionally, for any one of the angiography image and the at least one vascular analysis image, the vascular information includes at least one of position information of the vascular point in the image and corresponding vascular parameters in the image.

[0014] Optionally, the angiography image is a key frame angiography image in an angiography image sequence;

[0015] At least one of the following is superimposed and displayed on the key frame angiography image: a target registration centerline corresponding to the CTA image, a maximum intensity projection image reconstructed based on the CTA image, a volume rendering image, and a vascular abnormality display image.

[0016] Optionally, the angiography image includes a plurality of angiography images in an angiography image sequence corresponding to a full cardiac cycle;

[0017] The method further includes: dynamically playing a plurality of angiography images in the angiography image sequence corresponding to the full cardiac cycle, wherein each angiography image is superimposed and displayed with at least one of the following: a target registration centerline corresponding to the CTA image, a maximum density projection image reconstructed based on the CTA image, a volume rendering image, and a vascular abnormality display image.

[0018] Optionally, any of the angiographic images corresponds to a target registration centerline;

[0019] The method for determining the target registration centerline corresponding to any of the angiographic images includes: obtaining a first centerline of a target blood vessel segment in the angiographic image; obtaining a second centerline corresponding to the target blood vessel segment in the CTA image, wherein a projection angle of the second centerline is consistent with a projection angle of the angiographic image;

[0020] By constructing a displacement field and registering the first center line and the second center line, a registration relationship between the angiography image and the CTA image, as well as a target registration center line corresponding to the angiography image, is obtained.

[0021] Optionally, each of the angiographic images corresponds to at least one of a maximum intensity projection image, a volume rendering image, and a vascular abnormality display image;

[0022] The method for determining any one of the maximum density projection image, volume rendering image, and vascular abnormality display image corresponding to any of the angiography images includes: obtaining any one of the maximum density projection image, volume rendering image, and vascular abnormality display image corresponding to the CTA image; and performing deformation processing on any one of the maximum density projection image, volume rendering image, and vascular abnormality display image corresponding to the CTA image based on the displacement field corresponding to the registration processing to obtain any one of the maximum density projection image, volume rendering image, and vascular abnormality display image corresponding to the angiography image.

[0023] According to another aspect of the present disclosure, a device for displaying angiographic images and CTA images in a linked manner is provided, comprising:

[0024] a registration relationship acquisition module, configured to acquire a registration relationship between an angiography image and a CTA image, wherein the angiography image and the CTA image each include a target blood vessel segment;

[0025] an image acquisition module, configured to acquire at least one blood vessel analysis image corresponding to the CTA image;

[0026] an image display module configured to display, based on a registration relationship between the angiography image and the CTA image, the angiography image and at least one vascular analysis image corresponding to the CTA image in a linked manner, wherein the angiography image and the at least one vascular analysis image synchronously display vascular information corresponding to the same vascular point on the target vascular segment.

[0027] According to another aspect of the present disclosure, an electronic device is provided, comprising:

[0028] at least one processor; and

[0029] a memory communicatively connected to the at least one processor; wherein,

[0030] The memory stores a computer program that can be executed by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the method for displaying angiography images and CTA images described in any embodiment of the present disclosure.

[0031] According to another aspect of the present disclosure, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the method for displaying angiography images and CTA images described in any embodiment of the present disclosure when executed.

[0032] The technical solution of the disclosed embodiments improves the diversity and comprehensiveness of the display of target vascular segments by simultaneously displaying angiography images and at least one vascular analysis image corresponding to a CTA image on a display page. By acquiring the registration relationship between the angiography and CTA images, the angiography and at least one vascular analysis image are displayed in a linked manner, improving the correspondence and presentation quality of the vascular information displayed in the angiography and at least one vascular analysis diagram.

[0033] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become readily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0035] Figure 1 This is a flow chart of a method for displaying angiography images and CTA images in a linked manner, provided by an embodiment of the present disclosure;

[0036] Figure 2 is a schematic diagram of a display page provided by an embodiment of the present disclosure;

[0037] Figure 3 is a schematic diagram of a display page provided by an embodiment of the present disclosure;

[0038] Figure 4 is a flow chart of a registration process of angiography images and CTA images provided by an embodiment of the present disclosure;

[0039] Figure 5 This is a flow chart of a method for displaying angiography images and CTA images in a linked manner, provided by an embodiment of the present disclosure;

[0040] Figure 6 This is a schematic structural diagram of a device for displaying angiographic images and CTA images in a linked manner, provided by an embodiment of the present disclosure;

[0041] Figure 7It is a structural diagram of an electronic device provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0042] In order to enable those skilled in the art to better understand the solutions of the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the embodiments described are only part of the embodiments of the present disclosure, not all of the embodiments. Based on the embodiments of the present disclosure, all other embodiments obtained by ordinary technicians in this field without making creative efforts should fall within the scope of protection of the present disclosure.

[0043] It should be noted that the terms "first", "second", etc. in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that the numbers used in this way can be interchanged where appropriate, so that the embodiments of the present disclosure described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0044] Figure 1 This is a flowchart of a method for displaying angiography images and CTA images in a linked manner provided by an embodiment of the present disclosure. This embodiment is applicable to the case where multiple types of medical images corresponding to target vascular segments are obtained and multiple types of medical images are displayed in a linked manner. This method can be executed by a display device for angiography images and CTA images. The display device for angiography images and CTA images can be implemented in the form of hardware and / or software. The display device for angiography images and CTA images can be configured in electronic devices such as terminal devices and computer devices. Terminal devices include but are not limited to mobile phones, tablet computers, and PCs. Figure 1 As shown, the method includes:

[0045] S110 , obtaining a registration relationship between an angiography image and a CTA image; wherein the angiography image and the CTA image respectively include a target blood vessel segment.

[0046] S120: Acquire at least one blood vessel analysis image corresponding to the CTA image.

[0047] S130. Based on the registration relationship between the angiography image and the CTA image, display the angiography image and at least one vascular analysis image corresponding to the CTA image in a linked manner, wherein the angiography image and the at least one vascular analysis image synchronously display vascular information corresponding to the same vascular point on the target vascular segment.

[0048] In the disclosed embodiments, the angiography image and the CTA (CT Angiography) image are acquired from the same object, which may be a human or an animal, without limitation herein. The angiography image and the CTA image may include the same target vascular segment, which may be a coronary artery, or a localized vascular segment within a coronary artery. The angiography image and the CTA image may be acquired separately using corresponding acquisition devices, may be read from a database based on an object identifier, or may be imported from an external storage device, without limitation herein on the acquisition method of the angiography image and the CTA image.

[0049] In some embodiments of the present disclosure, the registration relationship between the angiography image and the CTA image can be obtained by pre-registering the angiography image and the CTA image. A registration file is generated based on the registration results of the angiography image and the CTA image. The registration file can represent the registration relationship between the angiography image and the CTA image. Optionally, the registration relationship between the angiography image and the CTA image includes the registration relationship between vascular points on the target vascular segment in the angiography image and the CTA image. Accordingly, the configuration file can include pairs of vascular points in the angiography image and the CTA image that have a registration relationship, which can be labeled as {(A1, B1), (A2, B2)…(An, Bn)}. Each vascular point pair includes a first vascular point on the target vascular segment in the angiography image and a second vascular point on the target vascular segment in the CTA image. Each vascular point pair can include the position information and / or identifiers of the vascular points in the registration relationship. For example, A1 can be the identifier of the first vascular point on the target vascular segment in the angiography image, and B1 can be the identifier of the second vascular point on the target vascular segment in the CTA image.

[0050] In this embodiment, the method for obtaining the registration relationship between the angiographic image and the CTA image is not limited. For example, the registration relationship can be obtained through a machine learning model, and the machine learning model can have an image registration function. The angiographic image and the CTA image are input into a pre-trained machine learning model to obtain the registration relationship between the angiographic image and the CTA image.

[0051] In some embodiments of the present disclosure, the vascular analysis image includes at least one of the following: a 3D reconstruction image, a curved surface reconstruction image, a diameter image, a multi-planar reconstruction image, and a probe image. The 3D reconstruction image can be obtained by performing three-dimensional reconstruction on a CTA image. For example, the 3D reconstruction image can include a three-dimensional model of the heart formed by the coronary vessels and myocardium. The 3D reconstruction image can be used to achieve a three-dimensional display of the target vascular segment. The curved surface reconstruction image can be understood as an image formed by processing a curved blood vessel and displaying it on the same two-dimensional plane. The curved surface reconstruction image is displayed with the center of the vascular lumen as the axis and can be used to display vascular abnormalities such as stenosis and plaques in the target vascular segment.

[0052] The diameter map is used to display diameter attribute information for a target vessel segment. This map is generated by distributing the vessel points along the vascular centerline along the horizontal axis and the diameter attribute information for each vessel point along the vertical axis from the proximal to the distal end of the target vessel segment. The diameter map can include at least one of a vessel diameter map and a plaque diameter map. The vessel diameter map can be used to display information such as the lumen diameter of the target vessel segment and further display stenosis abnormalities and physiological analysis information on the target vessel segment, including CT-QFR (Quantitative Flow Reserve). The plaque diameter map can display information such as the diameter and / or area of plaque at each vessel point on the target vessel segment and can reveal plaque abnormalities in the target vessel segment.

[0053] The probe image can represent the cross-sectional view of a certain blood vessel point on the target blood vessel segment. The cross-sectional view can display the cross-sectional information of the blood vessel point, which can be used to assist in the accurate assessment of lumen stenosis, plaque composition and blood vessel wall structure.

[0054] Multi-planar reconstruction (MPR) is used to display the image of the target vascular segment in the coronal plane, sagittal plane or any oblique plane, and can be used to observe the target vascular segment from multiple angles.

[0055] Optionally, the 3D reconstruction image includes at least one of the following: a maximum intensity projection image and a volume rendering image. The maximum intensity projection image can be understood as projecting the maximum density value along the projection direction onto a two-dimensional plane based on the 3D CTA image. It is primarily used to display high-density structures, such as target vascular segments. The maximum intensity projection image can highlight the outlines and boundaries of objects and clearly demonstrate the morphology and course of blood vessels.

[0056] The volume rendering image can be understood as a realistic three-dimensional image generated by classifying and calculating the voxels in the CTA image. It can display the surface and internal structure of the target vascular segment and provide rich three-dimensional spatial information. It can support the observation of the target vascular segment from different angles to obtain a three-dimensional visual effect.

[0057] Optionally, an image generation algorithm corresponding to each vascular analysis image is pre-set, and the vascular analysis image to be displayed can be determined according to image display requirements, and the image generation algorithm corresponding to the vascular analysis image is called. The CTA image is processed by the image generation algorithm to obtain the vascular analysis image.

[0058] In some embodiments of the present disclosure, in response to a triggering operation on a display page, an image type selection page is displayed. This image type selection page may include multiple selectable image types corresponding to CTA images. In response to a selection operation on the image type selection page, the image type of the vascular analysis image to be displayed is determined. Based on the determined image type, a corresponding image generation algorithm is invoked to generate the vascular analysis image to be displayed.

[0059] For example, see Figure 2 , Figure 2 is a schematic diagram of a display page provided by an embodiment of the present disclosure. Figure 2 The display page includes multiple display areas, each of which displays angiography images and vascular analysis images. Each display area corresponds to one image. The layout of the multiple display areas is not limited here. Figure 2 This is just an example. The type and number of images displayed on the display page can be determined according to display requirements.

[0060] Optionally, in response to the setting operation of each display area in the display page, the display position and display size of each image (i.e., at least one of the angiography image and the vascular analysis image) are adjusted to improve the flexibility and diversity of image display, meet the display needs of different quantities and types of images, and meet the display needs of corresponding images of different users.

[0061] Based on the above embodiment, the angiography image and at least one vascular analysis image are displayed in a linked manner. Specifically, the registration relationship between the angiography image and the CTA image serves as the corresponding relationship between the angiography image and the at least one vascular analysis image. When either image changes, the other image changes in a linked manner. It is understood that the at least one vascular analysis image is obtained by processing a CTA image. Accordingly, each vascular analysis image has the same vessel point identifier as the same vessel point in the CTA image. The registration relationship between the angiography image and the CTA image includes a registration relationship between the angiography image and the vascular point on the target vascular segment in the CTA image. For example, this can be a corresponding relationship between the identifier and / or position of the vascular point on the target vascular segment in the angiography image and the CTA image. Accordingly, the registration relationship between the angiography image and the CTA image can determine the corresponding relationship between the angiography image and the vascular point on the target vascular segment in each vascular analysis image. Based on this corresponding relationship, the angiography image and the at least one vascular analysis image can simultaneously display vascular information corresponding to the same vessel point on the target vascular segment.

[0062] For any of the angiography image and at least one vascular analysis image, the vascular information of the vascular points displayed in different images may be different. The vascular information displayed in different images includes the position information of the vascular points in the images and at least one of the corresponding vascular parameters in the images. For example, the angiography image displays the two-dimensional position information of the vascular points on the target vascular segment, and the 3D reconstruction image can display the three-dimensional position information of the vascular points on the target vascular segment. Taking the 3D reconstruction image as a three-dimensional model of the heart formed by the coronary vessels and the myocardium as an example, the three-dimensional model of the heart can display the blood supply influence of the vascular points on the myocardium. The blood supply relationship between the target vascular segment and the myocardium is predetermined. Multiple vascular points and myocardial points having a supply-demand relationship form the blood supply relationship between the target vascular segment and the myocardium. This blood supply relationship can be determined by the minimum distance between the vascular point on the target vascular segment and a myocardial point in the myocardium. That is, among the multiple vascular points and the multiple myocardial points, the vascular point with the minimum distance has a blood supply relationship with the myocardial point. For any vascular point, a local vascular segment located between the vascular point and the distal end of the vascular vessel is determined. Based on the blood supply relationship, a myocardial point corresponding to the vascular point located on the local vascular segment is determined. The myocardial blood supply area is determined based on the myocardial point corresponding to the vascular point on the local vascular segment. The myocardial blood supply parameters of the vascular point can be displayed in the 3D reconstructed image. The myocardial blood supply parameters can include one or more of the total regional proportion of the myocardial blood supply area, the regional proportion of the myocardial blood supply area in the left myocardium, and the regional proportion of the myocardial blood supply area in the right myocardium. Taking the 3D reconstructed image as a maximum density projection image as an example, the vascular shape of the target vascular segment is displayed through the maximum density projection image. Taking the 3D reconstructed image as a volume rendering image as an example, the volume rendering image can display the three-dimensional morphology of the vascular segment of the target vascular segment, and can also display the three-dimensional structure of the vascular vessel, including the vascular wall, lumen, and vascular branches.

[0063] Multi-planar reconstruction images are used to display the vascular morphology and course of the target vascular segment as well as the condition of the vascular lumen, such as the diameter of the vascular lumen, and whether there is stenosis or dilation.

[0064] The diameter map displays the location and diameter of a vessel point within the target vessel segment. This diameter information can be used to characterize the stenosis or plaque abnormality associated with the vessel point. For example, the vessel diameter map can display stenosis parameters, including at least one of lumen diameter, diameter stenosis rate, and area stenosis rate. For example, the plaque diameter map can display at least one of plaque diameter, maximum plaque angle, and maximum plaque thickness.

[0065] A cross section of the blood vessel point is displayed through the probe map, and at least one of lumen contour, lumen diameter, and plaque information is displayed through the cross section.

[0066] The surface reconstruction image displays the overall trend of the local vessel segment to which the vessel point belongs, as well as the location information of the vessel point on the local vessel segment, and information such as stenosis and plaque on the local vessel segment. It is understood that, for example, the target vessel segment is a coronary artery, which includes multiple local vessel segments, each of which is pre-classified.

[0067] In some embodiments of the present disclosure, the linked display of the angiography image and the at least one vascular analysis image corresponding to the CTA image includes: determining first vascular point information on the target vascular segment; determining second vascular point information corresponding to the angiography image and the at least one vascular analysis image based on the first vascular point information and the registration relationship; and displaying the corresponding second vascular point information through the angiography image and the at least one vascular analysis image, respectively.

[0068] The first vessel point information can be understood as the vessel point location / vessel point identifier of a vessel point on the target vessel segment. The vessel point can be determined for display from angiography images, CTA images, or vascular analysis images. The first vessel point information for the vessel point is determined. When the vessel point is determined from angiography images, the first vessel point information is the vessel point location / vessel point identifier in the angiography image. Based on a registration relationship, the corresponding second vessel point information in the CTA image is determined, i.e., the corresponding second vessel point information in at least one vascular analysis image. When the vessel point is determined from a CTA image or any vascular analysis image, the first vessel point information is the vessel point identifier in the CTA image. Accordingly, the vessel point information in at least one vascular analysis image is the first vessel point information. Based on the registration relationship, the corresponding second vessel point information in the angiography image is determined.

[0069] The angiography image and at least one blood vessel analysis image are updated respectively using the first blood vessel point information and the second blood vessel point information, thereby updating the display page.

[0070] In the above embodiment, determining the first vessel point information on the target vessel segment includes: obtaining abnormal vessel points by performing abnormality recognition on the CTA image, and determining the first vessel point information based on the abnormal vessel points.

[0071] An abnormality identification algorithm is used to identify abnormalities in the target vascular segment, thereby obtaining abnormal vascular points on the target vascular segment, namely, abnormal vascular points. For example, the abnormality identification algorithm may be a machine learning algorithm that sets an abnormality identification model and uses the abnormality identification model to identify abnormalities in the target vascular segment, thereby obtaining abnormal vascular points and identifying first vascular point information of the abnormal vascular points.

[0072] An abnormal vascular point is a vascular point with a set abnormality type, wherein the set abnormality type includes at least one abnormality type. The set abnormality types include, but are not limited to, stenosis, plaque, and obstruction. Accordingly, the abnormality recognition algorithm may correspond to the recognition algorithm for each of the above-mentioned set abnormality types. In some embodiments, the abnormality recognition model corresponding to each abnormality type is invoked to perform abnormality recognition on the target vascular segment, thereby obtaining abnormal vascular points of each abnormality type. In some embodiments, the abnormality recognition model is a multi-type recognition model capable of identifying multiple types of vascular abnormalities. The abnormality recognition model performs abnormality recognition on the target vascular segment to obtain abnormal vascular points and the abnormality types corresponding to the abnormal vascular points.

[0073] In some embodiments, the exception type is set as a pre-set one, and the display page includes an exception type setting control. In response to a triggering operation on the exception type setting control, the exception type setting page is displayed. The exception type setting page displays multiple exception types. In response to an exception type selection operation on the exception type setting page, the selected set exception type is obtained.

[0074] There can be one or more abnormal vessel points. Each identified abnormal vessel point can be used as a vessel point for display. Alternatively, for any abnormality type, the identified abnormal vessel points and the corresponding abnormality indicator are determined. For example, if the abnormality type is stenosis, the abnormality indicator can be the vessel diameter. The abnormality indicator can represent the degree of abnormality of the abnormal vessel point. The target vessel point is determined based on the abnormality indicator. For example, the abnormal vessel point with the greatest degree of abnormality is selected as the vessel point for display.

[0075] In the above embodiment, the angiography image and the at least one vascular analysis image can display vascular information of any vascular point on the target vascular segment. The vascular point can be determined in either the angiography image or the at least one vascular analysis image, specifically, by a vascular point selection operation.

[0076] Determining the first vessel point information on the target vessel segment may further include: determining the first vessel point information on the target vessel segment using an index line in either the angiography image or the at least one vessel analysis image, wherein the angiography image and the at least one vessel analysis image each include an index line, the index line may be located on the target vessel segment in either image, the index line may be draggable, and accordingly, the vessel point selection operation may be a drag operation on the index line. When a drag operation on the index line of either image is detected, a release position of the drag operation is determined, and the first vessel point information is determined based on the vessel point corresponding to the release position.

[0077] For example, see Figure 3 , Figure 3This is a schematic diagram of a display page provided by an embodiment of the present disclosure. Figure 3 The angiography image, 3D reconstruction image, surface reconstruction image, vascular diameter image, and probe image are displayed separately. In some disclosed embodiments, the 3D reconstruction image includes multiple types of three-dimensional images. Accordingly, the display page may include display areas for multiple types of 3D reconstruction images. The position, number, and size of the display areas in the display page can be adjusted according to display requirements. This enables the display of different types of 3D reconstruction images and improves the diversity of the display of target vascular segments. The image type in the display page can be selected and determined according to user needs, achieving targeted image display and flexibility in displaying target vascular segments.

[0078] In some embodiments of the present disclosure, the yellow line segment in the above-mentioned image represents an index line, and in response to a drag operation on the index line in the angiography image, the first vessel point information of the vessel point to be switched for display is determined based on the release position of the drag operation, and based on the registration relationship, the first vessel point information is determined to correspond to the second vessel point information in the CTA image. A method for linking and displaying angiography images and CTA images based on the second vessel information is provided. Specifically, the position information of the vessel point in the 3D reconstructed image is updated, and the vessel point is displayed in the 3D reconstructed image using a first rendering method, for example, a red disk is rendered at the vessel point. And, the myocardial blood supply area corresponding to the vessel point is displayed in the 3D reconstructed image using a second rendering method, wherein the second rendering method may include any one or more combinations of brightness display, transparency selection, color rendering, texture rendering, and dynamic rendering. Figure 3 Taking color rendering as an example, the myocardial blood supply area corresponding to a vessel point is rendered red. This means that the red area of the myocardium is the myocardial blood supply area to which the vessel point has a blood supply relationship. The 3D reconstruction image visually displays the location and size of the myocardial blood supply area affected by the vessel point corresponding to the index line. The 3D reconstruction image also displays the myocardial blood supply parameters corresponding to the vessel point.

[0079] Furthermore, based on the second vascular point information, the index point position in the surface reconstruction image and the diameter image is updated to ensure that the second vascular point information is at the vascular point position corresponding to the surface reconstruction image and the diameter image, respectively. The surface reconstruction image and the diameter image can reflect abnormal information of the vascular point after switching, such as abnormal stenosis information or abnormal plaque information.

[0080] And, based on the second blood vessel point information, the cross section in the probe map is updated, and the updated probe map is the cross section corresponding to the second blood vessel point information.

[0081] The technical solution provided in this embodiment improves the diversity and comprehensiveness of the display of target vascular segments by simultaneously displaying angiography images and at least one vascular analysis image corresponding to a CTA image on a display page. By acquiring the registration relationship between the angiography and CTA images, the angiography and at least one vascular analysis image are displayed in a linked manner, improving the correspondence and presentation quality of the vascular information displayed in the angiography and at least one vascular analysis diagram.

[0082] In some embodiments of the present disclosure, the registration process of the angiographic image and the CTA image may include the following steps: Figure 4 , Figure 4 4 is a flowchart of the registration process of angiography images and CTA images provided by the embodiment of the present disclosure.

[0083] S111 . Acquire a first centerline of a target blood vessel segment in an angiography image.

[0084] S112 , obtaining a second center line corresponding to the target blood vessel segment in the CTA image, wherein a projection angle of the second center line is consistent with a projection angle of the angiography image.

[0085] S113 , performing registration processing on the first center line and the second center line by constructing a displacement field to obtain a registration result of the angiography image and the CTA image.

[0086] The first centerline can be extracted from the angiography image using the centerline extraction model, and the three-dimensional centerline can be extracted from the CTA image using the centerline extraction model. The process of obtaining the second centerline by three-dimensional centerline projection is not described in detail here.

[0087] Optionally, by identifying key points in the angiography image and the CTA image, the matching relationship between the key points in the angiography image and the CTA image is determined, and a first displacement field is constructed based on the matching relationship between the key points in the angiography image and the CTA image; the second center line is deformed based on the first displacement field to obtain a first registration center line; a second displacement field is generated based on the first registration center line and the first center line, and the first registration center line is deformed based on the second displacement field to obtain a second registration center line, until the registration end condition is met and the registration process is completed.

[0088] The key points in the angiography image and the CTA image include but are not limited to branch points and stenosis points. Specifically, the first key point in the angiography image is identified, and the second key point in the CTA image is identified; wherein, there is at least one first key point and at least one second key point, and the number of the first key points and the number of the second key points may be the same or different. The point features of the first key point and the point features of the second key point are extracted. The point features of any key point include at least one of a position feature and an image feature, and the position feature represents the position information of the key point in space, for example, it may be coordinate information in the image. The image feature may be a feature vector, which is used to represent the global semantic features of the key point in the image. The point features of the first key point and the point features of the second key point may be respectively implemented based on feature extraction models. A matching relationship between the first key point and the second key point is established based on the point features of the first key point and the point features of the second key point.

[0089] Optionally, the matching relationship between the first key point and the second key point can be determined by the similarity between the point feature of the first key point and the point feature of the second key point. Optionally, the interaction features corresponding to the first key point and the second key point can be extracted respectively by the attention mechanism. The first key point is clustered by the interaction feature of the first key point to obtain a first key point group, and the second key point is clustered by the interaction feature of the second key point to obtain a second key point group. The first key point group and the second key point group with a matching relationship can be determined by the similarity between the center point features of each first key point group and the center point features of the second key point group. The center point features of any key point group can be determined based on the mean of the interaction features of multiple key points in the key point group. In the first key point group and the second key point group with a matching relationship, the first key point and the second key point with a matching relationship are determined. In the first key point group and the second key point group having a matching relationship, the first key points and the second key points therein are traversed, and for any first key point in the first key point group, key point matching is performed based on the interaction feature of the first key point and the interaction features with each second key point in the second key point group, and a second key point having a matching relationship with the first key point is determined. The first key point and the second key point having a matching relationship are determined based on the above method.

[0090] By extracting interactive features of key points in angiography and CTA images, feature enhancement and cross-modal feature alignment are achieved. The different vascular information provided by different cross-modal medical images is fused together through feature interaction, enriching the features and enabling more accurate image registration. Furthermore, feature interaction can better overcome the impact of modality differences, accurately matching and aligning vascular segments in images of different modalities, and improving image registration accuracy. Furthermore, by first determining a first and second key point group with a matching relationship, the matching range of key points is narrowed, and the first and second key points with a matching relationship are determined within the first and second key point groups. This reduces the computational complexity involved in determining the key point matching relationship and improves processing efficiency.

[0091] Based on the first key point and the second key point with a matching relationship, prior information is provided for constructing the displacement field, the accuracy of the displacement field is improved, and an effective displacement field is provided for the registration process. Optionally, constructing the first displacement field includes: determining a first displacement vector between the key points with a matching relationship in the angiography image and the CTA image; and, based on the positional relationship between other vascular points in the second centerline and the key points, determining a second displacement vector of the other vascular points; and forming the first displacement field based on the first displacement vector and the second displacement vector. Specifically, for the first key point and the second key point with a matching relationship, the first position information of the first key point and the second position information of the second key point are obtained, and a first displacement vector between the second position information and the first position information is determined. The first displacement vector can be used to move the second key point to the position of the first key point. The first displacement vector can be determined based on the horizontal position difference and the vertical position difference corresponding to the second position information and the first position information, respectively. For other vessel points other than the keypoints with a matching relationship, second displacement vectors are determined for the other vessel points based on the positional relationship between the other vessel points and the second keypoint. Optionally, the second displacement vectors for each other vessel point are determined based on the first displacement of at least one second keypoint using interpolation. On the second centerline, the first displacement vector of the second keypoint and the second displacement vectors of the other vessel points form a first displacement field.

[0092] The second center line is deformed based on the first displacement field, and the displacement vector corresponding to each blood vessel point in the second center line in the first displacement field is obtained. The corresponding blood vessel point is deformed to obtain the deformed position information of the blood vessel point. The deformed position information of multiple blood vessel points forms the first alignment center line.

[0093] To improve registration accuracy, the first registration centerline is optimized through multiple iterations of the registration process. Specifically, a second registration process is performed by optimizing the displacement field based on the first registration centerline and the first centerline to obtain a second displacement field. The second displacement field is generated by using the matching relationship between key points in the angiography and CTA images as a regularization condition and / or using the similarity function between the first registration centerline and the first centerline as an objective function to determine a third displacement vector for each vessel point in the first registration centerline, and then forming a second displacement field based on the third displacement vector.

[0094] The similarity function between the first registration centerline and the first centerline is used as the objective function to optimize the displacement field, determine the third displacement vector of each blood vessel point in the first registration centerline, and obtain the second displacement field. The displacement field can be updated based on the gradient descent method, and the displacement field is updated along the negative gradient direction of the objective function. Specifically, where θ k is the displacement field parameter in the k-th iteration displacement field, α is the learning rate, is the objective function J in θ k The gradient at .

[0095] The first registration centerline is deformed based on the second displacement field to obtain a second registration centerline. Iterative optimization continues based on the second registration centerline, and a third displacement field is determined based on the second registration centerline and the first centerline. Registration processing is then continued on the second registration centerline based on the third displacement field, and so on until the registration termination conditions are met, thereby obtaining the registration relationship between the angiographic image and the CTA image and the target registration centerline. The registration termination conditions include at least one of the following: the number of registrations reaches a preset number; or the registration metric values of the registration centerlines obtained from each registration converge with those of the first centerline.

[0096] On the basis of the above embodiment, when the registration process is completed, a correspondence is established between the first center line and the blood vessel points whose positions are consistent or within the error range in the target registration center line to obtain a registration relationship, and the above registration relationship is stored in the form of a configuration file for subsequent call.

[0097] Compared with the regular topological registration method, which has the problem of difficulty in handling missing / variant vascular branches, this embodiment realizes the registration of angiography images and CTA images by constructing a displacement field and optimizing the displacement field in multiple iterative registration processes. The above registration process is applicable to non-rigidly changing blood vessels and can achieve high-precision registration in the presence of missing / variant vascular branches.

[0098] In some embodiments of the present disclosure, the angiographic image is any angiographic image in an angiographic image sequence. The angiographic image sequence includes angiographic images of the coronary arteries acquired at a set projection schedule and time phase when the subject is injected with a contrast agent, and the angiographic image sequence includes multiple frames of angiographic images corresponding to different time points at a set projection angle.

[0099] In some embodiments of the present disclosure, the angiography image is a keyframe angiography image in an angiography image sequence, and the keyframe angiography image is displayed in conjunction with at least one vascular analysis image corresponding to the CTA image. Optionally, the keyframe angiography image may be the angiography image frame with the highest vascular clarity in the angiography image sequence. The vascular clarity of the angiography image may be determined based on an image quality assessment model. Optionally, the keyframe angiography image may be the angiography image frame with the highest similarity to the CTA image in the angiography image sequence. Specifically, a first centerline of the target vascular segment is extracted from each angiography image frame in the angiography image sequence, and a second centerline of the target vascular segment corresponding to the CTA image is extracted. A similarity metric is determined between the first and second centerlines of the target vascular segment in each angiography image frame, and the angiography image frame corresponding to the maximum similarity metric is determined as the keyframe angiography image. The projection angle of the second centerline is consistent with the projection angle of the angiography image. The second centerline of the target vascular segment in the CTA image may be obtained by projecting the three-dimensional centerline of the target vascular segment in the CTA image at the projection angle of the angiography image sequence. By identifying key frame angiography images in angiography image sequences, high-quality angiography features are provided for the display of target vascular segments and plaque maps, thereby improving the display effects of target vascular segments and plaque maps.

[0100] Based on the above embodiment, at least one of the following is superimposed and displayed on any of the aforementioned angiographic images or keyframe angiographic images: a target registration centerline corresponding to the CTA image, a maximum intensity projection image reconstructed based on the CTA image, a volume rendering image, and a vascular abnormality display image. The registration centerline may be a deformed centerline obtained by deforming a first centerline of a target vascular segment in any of the angiographic images or keyframe angiographic images during registration with a second centerline of the target vascular segment in the CTA image.

[0101] It is understood that the maximum density projection image and volume rendering image are three-dimensional images. To be superimposed and displayed on the angiography image (or keyframe angiography image), the maximum density projection image and volume rendering image are projected to obtain a two-dimensional maximum density projection image and a two-dimensional volume rendering image adapted to the angiography image (or keyframe angiography image). The projection angles of the two-dimensional maximum density projection image and the two-dimensional volume rendering image are consistent with those of the angiography image (or keyframe angiography image). Accordingly, the maximum density projection image and volume rendering image superimposed and displayed on the angiography image or keyframe angiography image are the two-dimensional images after projection processing. The vascular anomaly display image can be understood as an image obtained by performing vascular anomaly analysis on the CTA image, and the vascular anomaly display image includes marked vascular anomaly points. The vascular anomaly display image includes, but is not limited to, plaque images, stenosis images, and blockage images. The type and acquisition method of the above-mentioned analysis images are not limited here.

[0102] The target registration center line, maximum density projection image, volume rendering image and vascular abnormality display image are respectively registered with any angiography image or key frame angiography image, and can be superimposed and displayed on any angiography image or key frame angiography image.

[0103] In some embodiments, the CTA image is processed to obtain at least one of an initial maximum density projection image, an initial volume rendering image, and a vascular abnormality display image. The initial maximum density projection image, the initial volume rendering image, and the vascular abnormality display image are deformed using a target displacement field to obtain at least one of the maximum density projection image, the volume rendering image, and the vascular abnormality display image that is registered with any angiographic image or keyframe angiographic image. The initial maximum density projection image is a two-dimensional maximum density projection image that is projected from a three-dimensional maximum density projection image. The initial volume rendering image is a two-dimensional volume rendering image that is projected from a three-dimensional volume rendering image.

[0104] The target displacement field can be understood as a target registration center line obtained by deforming the second center line corresponding to the CTA image. Optionally, the target displacement field can be obtained by superimposing displacement fields of multiple iterations during the registration process of the angiography image and the CTA image. Optionally, the target displacement field can be a displacement field obtained by the last iteration of the displacement field during the registration process of the angiography image and the CTA image. Optionally, the target displacement field can be determined based on the second center line of the target vascular segment corresponding to the CTA image and the target registration center line corresponding to the CTA image. Specifically, the fourth displacement vector corresponding to each vascular point can be determined through the identification and position information of each vascular point in the second center line and the identification and position information of each vascular point in the target registration center line, and the target displacement field is formed through the fourth displacement vector corresponding to each vascular point.

[0105] The superimposition and display of at least one of the target registration centerline, maximum density projection, volume rendering, and vascular anomaly display image on any angiographic image or keyframe angiographic image can be achieved using at least two layers, wherein the first layer displays any angiographic image or keyframe angiographic image, and the other layers above the first layer display each of the target registration centerline, maximum density projection, volume rendering, and vascular anomaly display image. Furthermore, the transparency of each of the target registration centerline, maximum density projection, volume rendering, and vascular anomaly display image displayed in the other layers can be set, enabling the superimposition and display of vascular information in different dimensions, thereby increasing the diversity and comprehensiveness of the displayed information.

[0106] Figure 5 This is a flow chart of a method for displaying angiography images and CTA images in a linked manner provided by the embodiment of the present disclosure. Based on the above embodiment, the display of angiography images is optimized, and angiography image sequences can be played dynamically. Figure 5 As shown, the method includes:

[0107] S210 , obtaining a registration relationship between an angiography image and a CTA image; wherein the angiography image and the CTA image respectively include a target blood vessel segment, and the angiography image includes a plurality of angiography images in an angiography image sequence corresponding to a full cardiac cycle.

[0108] S220: Acquire at least one blood vessel analysis image corresponding to the CTA image.

[0109] S230: Based on the registration relationship between the angiography image and the CTA image, display the angiography image and at least one vascular analysis image corresponding to the CTA image in a linked manner, wherein the angiography image and the at least one vascular analysis image synchronously display vascular information corresponding to the same vascular point on the target vascular segment.

[0110] S240. Dynamically play multiple angiography images in the angiography image sequence corresponding to the full cardiac cycle, wherein each angiography image is superimposed with at least one of the following: a target alignment centerline corresponding to the CTA image, a maximum density projection image reconstructed based on the CTA image, a volume rendering image, and a vascular abnormality display image.

[0111] In this embodiment, by acquiring angiography image sequences corresponding to the entire cardiac cycle, comprehensive display of multiple angiography images in the entire cardiac cycle can be achieved, that is, dynamic display of the target blood vessel segment in the entire cardiac cycle can be achieved.

[0112] In some embodiments of the present disclosure, in a static display state of angiography, a key-frame angiography image is displayed, and the key-frame angiography image may be superimposed with and displayed at least one of a target registration centerline corresponding to a CTA image, a maximum density projection image reconstructed based on the CTA image, a volume rendering image, and a vascular abnormality display image.

[0113] In some embodiments of the present disclosure, a playback control is provided in the display area of the angiographic image, such as Figure 3 As shown, by triggering the playback control, multiple angiography images in the angiography image sequence corresponding to the full cardiac cycle are dynamically played. For example, multiple angiography images in the angiography image sequence corresponding to the full cardiac cycle can be played in a loop until the playback control is triggered again to stop playing. Optionally, a previous frame switching control and a next frame switching control are further provided in the display area of the angiography image. According to the triggering operation of the previous frame switching control or the next frame switching control, the angiography images in the display area are displayed and switched, thereby realizing the targeted display of multiple frames of angiography images. Among them, each angiography image in the angiography image sequence is linked to the at least one vascular analysis image corresponding to the CTA image for display.

[0114] In the case of dynamic playback of multiple angiography images in the above-mentioned angiography image sequence, or static display of any angiography image, at least one of the target alignment center line, maximum intensity projection image, volume rendering image and vascular abnormality display image corresponding to the CTA image is superimposed and displayed on each angiography image.

[0115] In the angiography image sequence, the target registration centerlines corresponding to the multiple angiography images are different, i.e., each angiography image corresponds to a target registration centerline. The method for determining the target registration centerline corresponding to any of the angiography images includes: obtaining a first centerline of a target vascular segment in the angiography image; obtaining a second centerline corresponding to the target vascular segment in the CTA image, wherein the projection angle of the second centerline is consistent with the projection angle of the angiography image; and constructing a displacement field to align the first and second centerlines to obtain a registration relationship between the angiography image and the CTA image, as well as the target registration centerline corresponding to the angiography image. This will not be further elaborated here.

[0116] Similarly, the multiple angiography images in the angiography image sequence correspond to different maximum density projection images, different volume rendering images, and different vascular abnormality display images, that is, each of the angiography images corresponds to at least one of the maximum density projection image, the volume rendering image, and the vascular abnormality display image.

[0117] The method for determining any one of the maximum density projection image, volume rendering image, and vascular abnormality display image corresponding to any of the angiography images includes: obtaining any one of the maximum density projection image, volume rendering image, and vascular abnormality display image corresponding to the CTA image; and performing deformation processing on any one of the maximum density projection image, volume rendering image, and vascular abnormality display image corresponding to the CTA image based on the displacement field corresponding to the registration processing to obtain any one of the maximum density projection image, volume rendering image, and vascular abnormality display image corresponding to the angiography image. This method will not be further described herein.

[0118] The technical solution provided in this embodiment realizes the dynamic display of the target blood vessel segment within the entire cardiac cycle by dynamically playing multiple angiography images in the angiography image sequence corresponding to the entire cardiac cycle, avoiding the limitations of the display of a single angiography image and improving the comprehensiveness of the display.

[0119] Figure 6 FIG. 1 is a schematic diagram of a structure of a linkage display device for angiography images and CTA images provided by an embodiment of the present disclosure. Figure 6 As shown, the device includes:

[0120] A registration relationship acquisition module 310 is configured to acquire a registration relationship between an angiography image and a CTA image, wherein the angiography image and the CTA image each include a target blood vessel segment;

[0121] An image acquisition module 320 is configured to acquire at least one blood vessel analysis image corresponding to the CTA image;

[0122] The image display module 330 is configured to display the angiography image and at least one vascular analysis image corresponding to the CTA image in a linked manner based on the registration relationship between the angiography image and the CTA image, wherein the angiography image and the at least one vascular analysis image simultaneously display vascular information corresponding to the same vascular point on the target vascular segment.

[0123] The technical solution of this embodiment improves the diversity and comprehensiveness of the display of target vascular segments by simultaneously displaying the angiography image and at least one vascular analysis image corresponding to the CTA image on the display page. By obtaining the registration relationship between the angiography image and the CTA image, the angiography image and the at least one vascular analysis image are displayed in conjunction, improving the correspondence and presentation quality of the vascular information displayed in the angiography image and the at least one vascular analysis image.

[0124] Based on the above embodiment, optionally, the blood vessel analysis image includes at least one of the following: a 3D reconstruction image, a curved surface reconstruction image, a multi-planar reconstruction image, a diameter image, and a probe image; wherein the 3D reconstruction image includes at least one of the following: a maximum intensity projection image and a volume rendering image.

[0125] Optionally, the registration relationship between the angiography image and the CTA image includes a registration relationship between the angiography image and a blood vessel point on the target blood vessel segment in the CTA image;

[0126] The image display module 330 is configured to: determine first vessel point information on the target vessel segment; determine corresponding second vessel point information on the angiography image and the at least one vessel analysis image based on the first vessel point information and the registration relationship; and display the corresponding second vessel point information on the angiography image and the at least one vessel analysis image, respectively.

[0127] Optionally, the image display module 330 is configured to perform at least one of the following:

[0128] determining first vessel point information on the target vessel segment by using an index line in any one of the angiography image and the at least one vessel analysis image, wherein the angiography image and the at least one vessel analysis image respectively include the index line;

[0129] Abnormal blood vessel points are obtained by performing abnormality recognition on the CTA image, and the first blood vessel point information is determined based on the abnormal blood vessel points.

[0130] Optionally, for any one of the angiography image and the at least one vascular analysis image, the vascular information includes at least one of position information of the vascular point in the image and corresponding vascular parameters in the image.

[0131] Optionally, the angiography image is a key frame angiography image in an angiography image sequence;

[0132] At least one of the following is superimposed and displayed on the key frame angiography image: a target registration centerline corresponding to the CTA image, a maximum intensity projection image reconstructed based on the CTA image, a volume rendering image, and a vascular abnormality display image.

[0133] Optionally, the angiography image includes a plurality of angiography images in an angiography image sequence corresponding to a full cardiac cycle;

[0134] The image display module 330 is further configured to dynamically play a plurality of angiographic images in the angiographic image sequence corresponding to the entire cardiac cycle, wherein each angiographic image is superimposed with and displayed at least one of the following: a target registration centerline corresponding to the CTA image, a maximum density projection image reconstructed based on the CTA image, a volume rendering image, and a vascular abnormality display image.

[0135] Based on the above embodiment, optionally, any of the angiographic images corresponds to a target registration centerline;

[0136] The device also includes a registration module for: obtaining a first centerline of a target vascular segment in an angiography image; obtaining a second centerline corresponding to the target vascular segment in a CTA image, wherein the projection angle of the second centerline is consistent with the projection angle of the angiography image; and performing registration processing on the first centerline and the second centerline by constructing a displacement field to obtain a registration relationship between the angiography image and the CTA image, as well as a target registration centerline corresponding to the angiography image.

[0137] Optionally, each of the angiographic images corresponds to at least one of a maximum intensity projection image, a volume rendering image, and a vascular abnormality display image;

[0138] The registration module is further configured to: obtain any one of a maximum density projection image, a volume rendering image, and a vascular abnormality display image corresponding to the CTA image; and perform deformation processing on any one of the maximum density projection image, the volume rendering image, and the vascular abnormality display image corresponding to the CTA image based on a displacement field corresponding to the registration processing to obtain any one of the maximum density projection image, the volume rendering image, and the vascular abnormality display image corresponding to the angiography image.

[0139] The display device for angiography images and CTA images provided in the embodiments of the present disclosure can execute the display method for angiography images and CTA images provided in any embodiment of the present disclosure, and has the corresponding functional modules and beneficial effects of the execution method.

[0140] Figure 7 1 is a schematic diagram of the structure of an electronic device provided by an embodiment of the present disclosure. The electronic device 10 is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or required herein.

[0141] like Figure 7As shown, the electronic device 10 includes at least one processor 11 and a memory, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., which is communicatively connected to the at least one processor 11. The memory stores a computer program that can be executed by the at least one processor, and the processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 into the random access memory (RAM) 13. Various programs and data required for the operation of the electronic device 10 can also be stored in the random access memory (RAM) 13. The processor 11, the read-only memory (ROM) 12, and the random access memory (RAM) 13 are connected to each other via a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0142] Multiple components in the electronic device 10 are connected to the I / O interface 15, including an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a magnetic disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices via a computer network such as the Internet and / or various telecommunication networks.

[0143] The processor 11 can be any general-purpose and / or specialized processing component with processing and computing capabilities. Examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various specialized artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any other suitable processor, controller, or microcontroller. The processor 11 executes the various methods and processes described above, such as the method for displaying angiographic and CTA images in a linked manner.

[0144] In some embodiments, the method for displaying angiographic and CTA images in a linked manner can be implemented as a computer program tangibly embodied in a computer-readable storage medium, such as storage unit 18. In some embodiments, part or all of the computer program can be loaded and / or installed on electronic device 10 via read-only memory (ROM) 12 and / or communication unit 19. When the computer program is loaded into random access memory (RAM) 13 and executed by processor 11, one or more steps of the method for displaying angiographic and CTA images in a linked manner described above can be performed. Alternatively, in other embodiments, processor 11 can be configured to perform the method for displaying angiographic and CTA images in a linked manner in any other appropriate manner (e.g., via firmware).

[0145] Various embodiments of the systems and techniques described herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), system-on-chip systems (SOCs), programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include being implemented in one or more computer programs that are executable and / or interpreted on a programmable system that includes at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0146] Computer programs for implementing the disclosed method for linked display of angiographic and CTA images can be written in any combination of one or more programming languages. These computer programs can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that, when executed by the processor, the functions / operations specified in the flowcharts and / or block diagrams are implemented. The computer programs can be executed entirely on the machine, partially on the machine, as a stand-alone software package, partially on the machine and partially on a remote machine, or entirely on a remote machine or server.

[0147] The present disclosure also provides a computer-readable storage medium storing computer instructions for causing a processor to execute a method for displaying angiographic images and CTA images in a linked manner, the method comprising:

[0148] Acquiring a registration relationship between an angiography image and a CTA image; wherein the angiography image and the CTA image each include a target vascular segment; acquiring at least one vascular analysis image corresponding to the CTA image; and based on the registration relationship between the angiography image and the CTA image, linkingly displaying the angiography image and the at least one vascular analysis image corresponding to the CTA image, wherein the angiography image and the at least one vascular analysis image simultaneously display vascular information corresponding to the same vascular point on the target vascular segment.

[0149] In the context of the present disclosure, a computer-readable storage medium can be a tangible medium that can contain or store a computer program for use by an instruction execution system, device or equipment or used in combination with an instruction execution system, device or equipment. A computer-readable storage medium can include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium can be a machine-readable signal medium. A more specific example of a machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0150] To provide interaction with a user, the systems and techniques described herein can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0151] The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0152] A computing system may include clients and servers. The clients and servers are typically remote from each other and typically interact via a communication network. This client-server relationship arises through computer programs running on the respective computers, creating a client-server relationship. The server may be a cloud server, also known as a cloud computing server or cloud host. This server is a hosting product within the cloud computing service ecosystem that addresses the management difficulties and limited scalability of traditional physical hosting and VPS services.

[0153] It should be understood that the various forms of processes shown above can be used to reorder, add, or delete steps. For example, the steps described in this disclosure can be performed in parallel, sequentially, or in a different order, as long as the desired results of the technical solutions of this disclosure can be achieved, and this document is not limited here.

[0154] The above specific embodiments do not constitute a limitation on the scope of protection of this disclosure. Those skilled in the art will appreciate that various modifications, combinations, sub-combinations, and substitutions may be made based on design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this disclosure shall be included within the scope of protection of this disclosure.

Claims

1. A method for displaying angiography images and CTA images in a linked manner, characterized in that: include: Acquiring a registration relationship between an angiography image and a CTA image; wherein the angiography image and the CTA image each include a target blood vessel segment; acquiring at least one blood vessel analysis image corresponding to the CTA image; Based on the registration relationship between the angiography image and the CTA image, the angiography image and at least one vascular analysis image corresponding to the CTA image are linked and displayed, wherein the angiography image and the at least one vascular analysis image synchronously display vascular information corresponding to the same vascular point on the target vascular segment.

2. The method according to claim 1, characterized in that The blood vessel analysis image includes at least one of the following: a 3D reconstruction image, a curved surface reconstruction image, a diameter image, a multi-planar reconstruction image, and a probe image; wherein the 3D reconstruction image includes at least one of the following: a maximum intensity projection image and a volume rendering image.

3. The method according to claim 1, characterized in that The registration relationship between the angiography image and the CTA image includes a registration relationship between the angiography image and the blood vessel point on the target blood vessel segment in the CTA image; Linking and displaying the angiography image and at least one vascular analysis image corresponding to the CTA image includes: determining first blood vessel point information on the target blood vessel segment; determining corresponding second blood vessel point information on the angiography image and the at least one blood vessel analysis image based on the first blood vessel point information and the registration relationship; The corresponding second blood vessel point information is respectively displayed through the angiography image and the at least one blood vessel analysis image.

4. The method according to claim 3, characterized in that Determining the first vessel point information on the target vessel segment includes at least one of the following: determining first vessel point information on the target vessel segment by using an index line in any one of the angiography image and the at least one vessel analysis image, wherein the angiography image and the at least one vessel analysis image respectively include the index line; Abnormal blood vessel points are obtained by performing abnormality recognition on the CTA image, and the first blood vessel point information is determined based on the abnormal blood vessel points.

5. The method according to claim 1, wherein For any one of the angiography image and the at least one vascular analysis image, the vascular information includes at least one of position information of the vascular point in the image and corresponding vascular parameters in the image.

6. The method according to claim 1, characterized in that The angiographic image is a key frame angiographic image in an angiographic image sequence; At least one of the following is superimposed and displayed on the key frame angiography image: a target registration centerline corresponding to the CTA image, a maximum intensity projection image reconstructed based on the CTA image, a volume rendering image, and a vascular abnormality display image.

7. The method according to claim 1, characterized in that The angiography image includes a plurality of angiography images in an angiography image sequence corresponding to a full cardiac cycle; The method further includes: dynamically playing a plurality of angiography images in the angiography image sequence corresponding to the full cardiac cycle, wherein each angiography image is superimposed and displayed with at least one of the following: a target registration centerline corresponding to the CTA image, a maximum density projection image reconstructed based on the CTA image, a volume rendering image, and a vascular abnormality display image.

8. The method according to claim 6 or 7, characterized in that Each of the angiographic images corresponds to a target registration center line; Methods for determining the target registration centerline corresponding to any of the angiographic images include: Acquiring a first centerline of a target blood vessel segment in an angiographic image; Acquiring a second centerline corresponding to the target blood vessel segment in the CTA image, wherein a projection angle of the second centerline is consistent with a projection angle of the angiography image; By constructing a displacement field, the first center line and the second center line are registered to obtain a registration relationship between the angiography image and the CTA image, as well as a target registration center line corresponding to the angiography image.

9. The method according to claim 8, characterized in that Each of the angiographic images corresponds to at least one of a maximum density projection image, a volume rendering image, and a vascular abnormality display image; A method for determining any one of the maximum intensity projection image, volume rendering image, and vascular abnormality display image corresponding to any of the angiographic images includes: Obtaining any one of a maximum density projection image, a volume rendering image, and a vascular abnormality display image corresponding to the CTA image; Based on the displacement field corresponding to the registration processing, any one of the maximum density projection image, volume rendering image and vascular abnormality display image corresponding to the CTA image is deformed to obtain any one of the maximum density projection image, volume rendering image and vascular abnormality display image corresponding to the angiography image.

10. A device for displaying angiographic images and CTA images in a linked manner, characterized in that: include: a registration relationship acquisition module, configured to acquire a registration relationship between an angiography image and a CTA image, wherein the angiography image and the CTA image each include a target blood vessel segment; an image acquisition module, configured to acquire at least one blood vessel analysis image corresponding to the CTA image; an image display module configured to display, based on a registration relationship between the angiography image and the CTA image, the angiography image and at least one vascular analysis image corresponding to the CTA image in a linked manner, wherein the angiography image and the at least one vascular analysis image synchronously display vascular information corresponding to the same vascular point on the target vascular segment.

11. An electronic device, characterized in that: The electronic device comprises: at least one processor; and a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor to enable the at least one processor to perform the method for displaying angiography images and CTA images according to any one of claims 1 to 7.

12. A computer-readable storage medium, characterized in that The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the method for displaying angiography images and CTA images according to any one of claims 1 to 7 when executed.

Images