Blood vessel plaque display method and device, storage medium and electronic equipment

Abstract

The invention provides a blood vessel plaque display method and device, a storage medium and electronic equipment. The method comprises the following steps: acquiring a registration relationship between a contrast image and a CTA image; wherein the angiography image and the CTA image respectively comprise a target blood vessel segment; plaque data corresponding to the target blood vessel segment in the CTA image is acquired; and displaying the plaque data on the angiography image in an overlapping manner based on the registration relationship between the angiography image and the CTA image. According to the embodiment of the invention, the registration relation obtained by pre-registration of the angiography image and the CTA image is obtained, the plaque data corresponding to the target blood vessel segment in the CTA image is superposed and displayed in the angiography image based on the registration relation, and the effect of the plaque is displayed on the angiography image, so that visual display of the position, the form and the like of the plaque can be realized; the limitation that the plaque structure is inconvenient to observe in the angiography image is solved, and the display effect of the target blood vessel segment and the plaque image is improved.

Description

Technical Field

[0001] The present disclosure relates to the field of image processing technology, and in particular to a method, device, storage medium, and electronic device for displaying vascular plaques. Background Art

[0002] Cardiovascular disease is the disease with the highest morbidity and mortality in my country. Currently, percutaneous coronary intervention (PCI) is a very important means of treating coronary heart disease.

[0003] In the process of realizing the present disclosure, it was found that there are at least the following technical problems in the prior art: During PCI surgery, coronary angiography (CAG) is routinely used in clinical practice to observe vascular structure, but coronary angiography has limitations and is not convenient for observing plaque structure. Summary of the Invention

[0004] The present disclosure provides a method, device, storage medium and electronic device for displaying vascular plaques, which combine angiography images with CTA images to display plaque images in angiography images, thereby achieving visual display of plaques.

[0005] According to one aspect of the present disclosure, a method for displaying vascular plaque is provided, comprising:

[0006] Acquiring a registration relationship between an angiography image and a CTA image; wherein the angiography image and the CTA image each include a target blood vessel segment;

[0007] Acquiring plaque data corresponding to the target blood vessel segment in the CTA image;

[0008] Based on the registration relationship between the angiography image and the CTA image, the plaque data is superimposed and displayed on the angiography image.

[0009] Optionally, the angiography image is a key frame angiography image in an angiography image sequence.

[0010] Optionally, the plaque data includes a first plaque map, and the first plaque map is obtained by performing plaque segmentation on the CTA image;

[0011] The plaque data is superimposed and displayed on the angiography image, including: obtaining a target displacement field, wherein the target displacement field is used to achieve registration between the angiography image and the CTA image; deforming the first plaque map based on the target displacement field to obtain a second plaque map, and superimposing and displaying the second plaque map on the angiography image.

[0012] Optionally, the projection angle of the first plaque image is consistent with the projection angle of the angiography image;

[0013] The first plaque map is obtained by projecting the three-dimensional plaque map obtained by segmentation in the CTA image based on the projection angle of the angiography image.

[0014] Optionally, the target blood vessel segment corresponds to at least one plaque type, and the plaque data includes a plaque map of at least one plaque type; plaque maps of different plaque types have different corresponding rendering attributes in the angiography image.

[0015] Optionally, the plaque data is superimposed and displayed on the angiography image, including: when plaque images corresponding to at least two plaque types are located at the same position, determining the plaque image to be displayed at the position based on the priority of the plaque type; or, adjusting the transparency of the plaque image of each plaque type, and displaying the plaque images of the at least two plaque types at the position.

[0016] Optionally, the method further includes: acquiring an endothelial image and a medial image of the target blood vessel segment in the CTA image; registering the endothelial image and medial image with the angiography image respectively; and superimposing the second plaque image, the endothelial image and the medial image on the angiography image.

[0017] Optionally, the plaque data includes first position information of the plaque in the CTA image;

[0018] Based on the registration relationship between the angiography image and the CTA image, the plaque data is superimposed and displayed on the angiography image, including: determining second position information of the plaque in the angiography image based on the registration relationship and the first position information; and displaying the plaque in the angiography image based on the second position information.

[0019] Optionally, displaying the plaque in the angiography image based on the second position information includes one or more of the following:

[0020] determining a local blood vessel segment corresponding to the plaque based on the second position information, and rendering a blood vessel contour and / or a centerline corresponding to the local blood vessel segment based on set rendering attributes, wherein different plaque types correspond to different rendering attributes;

[0021] In the angiography image, a plaque mark is displayed at a position corresponding to the second position information, wherein plaque marks of different plaque types have different corresponding rendering attributes.

[0022] Optionally, the method further includes: displaying plaque parameters corresponding to each plaque type in the angiography image, wherein rendering attributes of the plaque parameters are consistent with rendering attributes corresponding to the plaque type.

[0023] Optionally, the method further includes: displaying a plaque diameter map and / or a probe map corresponding to different vascular points on the target vascular segment based on the registration relationship between the angiography image and the CTA image.

[0024] Optionally, the different vascular points include at least one of the following: a vascular point corresponding to the plaque data; a vascular point corresponding to an index line in the angiography image and / or the CTA image, the index line being located on the target vascular segment, and the index line being in a draggable state.

[0025] According to another aspect of the present disclosure, a device for displaying vascular plaque is provided, comprising:

[0026] a registration relationship acquisition module, configured to acquire a registration relationship between an angiography image and a CTA image, wherein the angiography image and the CTA image each include a target blood vessel segment;

[0027] a plaque data acquisition module, configured to acquire plaque data corresponding to the target blood vessel segment in the CTA image, and to register the plaque data with the angiography image;

[0028] A display module is used to overlay and display the plaque data on the angiography image based on the registration relationship between the angiography image and the CTA image.

[0029] According to another aspect of the present disclosure, an electronic device is provided, comprising:

[0030] at least one processor; and

[0031] a memory communicatively connected to the at least one processor; wherein,

[0032] The memory stores a computer program that can be executed by the at least one processor. The computer program is executed by the at least one processor to enable the at least one processor to perform the method for displaying vascular plaques according to any embodiment of the present disclosure.

[0033] According to another aspect of the present disclosure, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the method for displaying vascular plaques according to any embodiment of the present disclosure when executed.

[0034] The technical solution of the embodiment of the present disclosure obtains a registration relationship obtained by pre-registering the angiography image and the CTA image, and based on the registration relationship, superimposes the plaque data corresponding to the target vascular segment in the CTA image on the angiography image, thereby achieving the effect of displaying the plaque map on the angiography image, solving the limitation of the angiography image that is not convenient for observing the plaque structure, and improving the display effect of the target vascular segment and the plaque map.

[0035] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become readily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0037] Figure 1 This is a flow chart of a method for displaying vascular plaques provided by an embodiment of the present disclosure;

[0038] Figure 2 is a flow chart of a registration process of angiography images and CTA images provided by an embodiment of the present disclosure;

[0039] Figure 3 This is a schematic diagram of a plaque display provided by an embodiment of the present disclosure;

[0040] Figure 4 This is a flow chart of a method for displaying vascular plaques provided by an embodiment of the present disclosure;

[0041] Figure 5 This is a schematic diagram of a plaque display provided by an embodiment of the present disclosure;

[0042] Figure 6 This is a flow chart of a method for displaying vascular plaques provided by an embodiment of the present disclosure;

[0043] Figure 7 This is a schematic diagram of a plaque display provided by an embodiment of the present disclosure;

[0044] Figure 8 This is a schematic diagram of a plaque display provided by an embodiment of the present disclosure;

[0045] Figure 9 This is a schematic diagram of a plaque display provided by an embodiment of the present disclosure;

[0046] Figure 10This is a flow chart of a method for displaying vascular plaques provided by an embodiment of the present disclosure;

[0047] Figure 11 is an example diagram of a plaque diameter diagram provided by an embodiment of the present disclosure;

[0048] Figure 12 is an example diagram of a probe diagram provided by an embodiment of the present disclosure;

[0049] Figure 13 This is a partial schematic diagram of an image display provided by an embodiment of the present disclosure;

[0050] Figure 14 This is a schematic structural diagram of a vascular plaque display device provided by an embodiment of the present disclosure;

[0051] Figure 15 This is a schematic structural diagram of an electronic device provided by this embodiment. DETAILED DESCRIPTION

[0052] In order to enable those skilled in the art to better understand the solutions of the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the embodiments described are only part of the embodiments of the present disclosure, not all of the embodiments. Based on the embodiments of the present disclosure, all other embodiments obtained by ordinary technicians in this field without making creative efforts should fall within the scope of protection of the present disclosure.

[0053] It should be noted that the terms "first", "second", etc. in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that the numbers used in this way can be interchanged where appropriate, so that the embodiments of the present disclosure described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0054] Figure 1This is a flow chart of a method for displaying vascular plaques provided by an embodiment of the present disclosure. This embodiment is applicable to extracting plaque maps from CTA images and displaying the plaque maps superimposed on angiography images to optimize the display effect of the plaque maps. This method can be performed by a vascular plaque display device, which can be implemented in the form of hardware and / or software. The vascular plaque display device can be configured in terminal devices and computer devices, and the terminal devices may include but are not limited to mobile phones, tablet computers, and PCs. Figure 1 As shown, the method includes:

[0055] S110 , obtaining a registration relationship between an angiography image and a CTA image; wherein the angiography image and the CTA image respectively include a target blood vessel segment.

[0056] S120: Acquire plaque data corresponding to the target blood vessel segment in the CTA image.

[0057] S130 , based on the registration relationship between the angiography image and the CTA image, overlaying and displaying the plaque data on the angiography image.

[0058] In the disclosed embodiments, the angiography image and the CTA (CT Angiography) image are acquired from the same object, which may be a human or an animal, without limitation herein. The angiography image and the CTA image may include the same target vascular segment, which may be a coronary artery, or a localized vascular segment within a coronary artery. The angiography image and the CTA image may be acquired separately using corresponding acquisition devices, may be read from a database based on an object identifier, or may be imported from an external storage device, without limitation herein on the acquisition method of the angiography image and the CTA image.

[0059] In some embodiments of the present disclosure, the angiographic image is any angiographic image in an angiographic image sequence. The angiographic image sequence includes angiographic images of the coronary arteries acquired at a set projection schedule and time phase when the subject is injected with a contrast agent, and the angiographic image sequence includes multiple frames of angiographic images corresponding to different time points at a set projection angle.

[0060] In some embodiments of the present disclosure, the angiography image is a keyframe angiography image in an angiography image sequence. Optionally, the keyframe angiography image may be the angiography image frame with the highest vascular clarity in the angiography image sequence. The vascular clarity of the angiography image may be identified based on an image quality assessment model; optionally, the keyframe angiography image may be the angiography image frame with the highest similarity to the CTA image in the angiography image sequence. Specifically, the first centerline of the target vascular segment in each angiography image frame in the angiography image sequence is extracted, and the second centerline of the target vascular segment in the CTA image is extracted. A similarity metric is determined between the first centerline and the second centerline of the target vascular segment in each angiography image frame, and the angiography image frame corresponding to the maximum similarity metric is determined as the keyframe angiography image. The projection angle of the second centerline is consistent with the projection angle of the angiography image. The second centerline of the target vascular segment in the CTA image may be obtained by projecting the three-dimensional centerline of the target vascular segment in the CTA image at the projection angle of the angiography image sequence.

[0061] By identifying key frame angiography images in angiography image sequences, high-quality angiography features are provided for the display of target vascular segments and plaques, thereby improving the display effects of target vascular segments and plaques.

[0062] In some embodiments of the present disclosure, the registration relationship between the angiography image and the CTA image can be obtained by pre-registering the angiography image and the CTA image. A registration file is generated based on the registration results of the angiography image and the CTA image. The registration file can represent the registration relationship between the angiography image and the CTA image. Optionally, the registration relationship between the angiography image and the CTA image includes the registration relationship between vascular points on the target vascular segment in the angiography image and the CTA image. Accordingly, the configuration file can include pairs of vascular points in the angiography image and the CTA image that have a registration relationship, which can be labeled as {(A1, B1), (A2, B2)…(An, Bn)}. Each vascular point pair includes a first vascular point on the target vascular segment in the angiography image and a second vascular point on the target vascular segment in the CTA image. Each vascular point pair can include the position information and / or identifiers of the vascular points in the registration relationship. For example, A1 can be the identifier of the first vascular point on the target vascular segment in the angiography image, and B1 can be the identifier of the second vascular point on the target vascular segment in the CTA image.

[0063] The registration process of angiographic and CTA images can include the following steps, see Figure 2 , Figure 2 4 is a flowchart of the registration process of angiography images and CTA images provided by the embodiment of the present disclosure.

[0064] S111 . Acquire a first centerline of a target blood vessel segment in an angiography image.

[0065] S112 , obtaining a second center line corresponding to the target blood vessel segment in the CTA image, wherein a projection angle of the second center line is consistent with a projection angle of the angiography image.

[0066] S113 , performing registration processing on the first center line and the second center line by constructing a displacement field to obtain a registration result of the angiography image and the CTA image.

[0067] The first centerline can be extracted from the angiography image using the centerline extraction model, and the three-dimensional centerline can be extracted from the CTA image using the centerline extraction model. The process of obtaining the second centerline by three-dimensional centerline projection is not described in detail here.

[0068] Optionally, by identifying key points in the angiography image and the CTA image, the matching relationship between the key points in the angiography image and the CTA image is determined, and a first displacement field is constructed based on the matching relationship between the key points in the angiography image and the CTA image; the second center line is deformed based on the first displacement field to obtain a first registration center line; a second displacement field is generated based on the first registration center line and the first center line, and the first registration center line is deformed based on the second displacement field to obtain a second registration center line, until the registration end condition is met and the registration process is completed.

[0069] The key points in the angiography image and the CTA image include but are not limited to branch points and stenosis points. Specifically, the first key point in the angiography image is identified, and the second key point in the CTA image is identified; wherein, there is at least one first key point and at least one second key point, and the number of the first key points and the number of the second key points may be the same or different. The point features of the first key point and the point features of the second key point are extracted. The point features of any key point include at least one of a position feature and an image feature, and the position feature represents the position information of the key point in space, for example, it may be coordinate information in the image. The image feature may be a feature vector, which is used to represent the global semantic features of the key point in the image. The point features of the first key point and the point features of the second key point may be respectively implemented based on feature extraction models. A matching relationship between the first key point and the second key point is established based on the point features of the first key point and the point features of the second key point.

[0070] Optionally, the matching relationship between the first key point and the second key point can be determined by the similarity between the point feature of the first key point and the point feature of the second key point. Optionally, the interaction features corresponding to the first key point and the second key point can be extracted respectively by the attention mechanism. The first key point is clustered by the interaction feature of the first key point to obtain a first key point group, and the second key point is clustered by the interaction feature of the second key point to obtain a second key point group. The first key point group and the second key point group with a matching relationship can be determined by the similarity between the center point features of each first key point group and the center point features of the second key point group. The center point features of any key point group can be determined based on the mean of the interaction features of multiple key points in the key point group. In the first key point group and the second key point group with a matching relationship, the first key point and the second key point with a matching relationship are determined. In the first key point group and the second key point group having a matching relationship, the first key points and the second key points therein are traversed, and for any first key point in the first key point group, key point matching is performed based on the interaction feature of the first key point and the interaction features with each second key point in the second key point group, and a second key point having a matching relationship with the first key point is determined. The first key point and the second key point having a matching relationship are determined based on the above method.

[0071] By extracting interactive features of key points in angiography and CTA images, feature enhancement and cross-modal feature alignment are achieved. The different vascular information provided by different cross-modal medical images is fused together through feature interaction, enriching the features and enabling more accurate image registration. Furthermore, feature interaction can better overcome the impact of modality differences, accurately matching and aligning vascular segments in images of different modalities, and improving image registration accuracy. Furthermore, by first determining a first and second key point group with a matching relationship, the matching range of key points is narrowed, and the first and second key points with a matching relationship are determined within the first and second key point groups. This reduces the computational complexity involved in determining the key point matching relationship and improves processing efficiency.

[0072] Based on the first key point and the second key point with a matching relationship, prior information is provided for constructing the displacement field, the accuracy of the displacement field is improved, and an effective displacement field is provided for the registration process. Optionally, constructing the first displacement field includes: determining a first displacement vector between the key points with a matching relationship in the angiography image and the CTA image; and, based on the positional relationship between other vascular points in the second centerline and the key points, determining a second displacement vector of the other vascular points; and forming the first displacement field based on the first displacement vector and the second displacement vector. Specifically, for the first key point and the second key point with a matching relationship, the position information of the first key point and the position information of the second key point are obtained, and the first displacement vector between the position information of the second key point and the position information of the first key point is determined. The first displacement vector can be used to move the second key point to the position of the first key point. The first displacement vector can be determined based on the horizontal position difference and the vertical position difference corresponding to the position information of the second key point and the position information of the first key point, respectively. For other vessel points other than the keypoints with a matching relationship, second displacement vectors are determined for the other vessel points based on the positional relationship between the other vessel points and the second keypoint. Optionally, the second displacement vectors for each other vessel point are determined based on the first displacement of at least one second keypoint using interpolation. On the second centerline, the first displacement vector of the second keypoint and the second displacement vectors of the other vessel points form a first displacement field.

[0073] The second center line is deformed based on the first displacement field, and the displacement vector corresponding to each blood vessel point in the second center line in the first displacement field is obtained. The corresponding blood vessel point is deformed to obtain the deformed position information of the blood vessel point. The deformed position information of multiple blood vessel points forms the first alignment center line.

[0074] To improve registration accuracy, the first registration centerline is optimized through multiple iterations of the registration process. Specifically, a second registration process is performed by optimizing the displacement field based on the first registration centerline and the first centerline to obtain a second displacement field. The second displacement field is generated by using the matching relationship between key points in the angiography and CTA images as a regularization condition and / or using the similarity function between the first registration centerline and the first centerline as an objective function to determine a third displacement vector for each vessel point in the first registration centerline, and then forming a second displacement field based on the third displacement vector.

[0075] The similarity function between the first registration centerline and the first centerline is used as the objective function to optimize the displacement field, determine the third displacement vector of each blood vessel point in the first registration centerline, and obtain the second displacement field. The displacement field can be updated based on the gradient descent method, and the displacement field is updated along the negative gradient direction of the objective function. Specifically, where θk is the displacement field parameter in the k-th iteration displacement field, α is the learning rate, is the objective function J in θ k The gradient at .

[0076] The first registration centerline is deformed based on the second displacement field to obtain a second registration centerline. Iterative optimization continues based on the second registration centerline, and a third displacement field is determined based on the second registration centerline and the first centerline. Registration processing is then continued on the second registration centerline based on the third displacement field, and so on until the registration termination conditions are met, thereby obtaining the registration relationship between the angiographic image and the CTA image and the target registration centerline. The registration termination conditions include at least one of the following: the number of registrations reaches a preset number; or the registration metric values of the registration centerlines obtained from each registration converge with those of the first centerline.

[0077] On the basis of the above embodiment, when the registration process is completed, a correspondence is established between the first center line and the blood vessel points whose positions are consistent or within the error range in the target registration center line to obtain a registration relationship, and the above registration relationship is stored in the form of a configuration file for subsequent call.

[0078] Compared with the regular topological registration method, which has the problem of difficulty in handling missing / variant vascular branches, this embodiment realizes the registration of angiography images and CTA images by constructing a displacement field and optimizing the displacement field in multiple iterative registration processes. The above registration process is applicable to non-rigidly changing blood vessels and can achieve high-precision registration in the presence of missing / variant vascular branches.

[0079] In some embodiments of the present disclosure, plaque identification is performed from a CTA image to obtain plaque data. Optionally, the plaque data includes a first plaque map, which can be obtained by performing plaque segmentation on the CTA image. The first plaque map includes at least one plaque in the target blood vessel segment.

[0080] Optionally, the plaque data may be obtained through processing by a plaque segmentation model. Specifically, the CTA image is input into the plaque segmentation model to obtain the plaque data output by the plaque segmentation model.

[0081] It is understood that CTA images are three-dimensional medical images, and a three-dimensional plaque map is obtained by performing plaque segmentation on the CTA image. The specific algorithm for implementing plaque segmentation is not limited here; for example, it can be implemented through a machine learning model or a threshold segmentation algorithm. The first plaque map is a two-dimensional plaque map obtained by projecting the above-mentioned three-dimensional plaque map. To achieve registration of the plaque map with the angiography image, the projection angle of the first plaque map is consistent with the projection angle of the angiography image. Specifically, the projection angle of the angiography image is obtained, and the three-dimensional plaque map obtained by segmentation from the CTA image is projected based on the projection angle of the angiography image to obtain the first plaque map.

[0082] Based on the registration relationship between CTA images and angiography images, the plaque data corresponding to the CTA image is converted into the plaque data corresponding to the angiography image. The plaque is visualized in the angiography image through the plaque data, avoiding the confusion of the position of the plaque and the target blood vessel segment, and improving the display effect of the plaque and the target blood vessel segment.

[0083] In some embodiments of the present disclosure, the plaque data is superimposed and displayed on the angiography image, including: obtaining a target displacement field, wherein the target displacement field is used to achieve alignment between the angiography image and the CTA image; deforming the first plaque map based on the target displacement field to obtain a second plaque map, and superimposing and displaying the second plaque map on the angiography image.

[0084] The first plaque image is deformed to obtain a second plaque image that is registered with the angiography image. Specifically, a target displacement field is obtained during the registration process between the angiography image and the CTA image, and the first plaque image is deformed based on the target displacement field. This target displacement field may be a displacement field corresponding to the registration relationship between the CTA image and the angiography image, enabling registration between the CTA image and the angiography image. The target displacement field is essentially a nonlinear transformation matrix between the image coordinate systems of the angiography image and the CTA image.

[0085] The target displacement field can be understood as a target registration center line obtained by deforming the second center line corresponding to the CTA image. Optionally, the target displacement field can be obtained by superimposing displacement fields of multiple iterations in the registration process of the angiography image and the CTA image. Specifically, for N iterations in the configuration process, the displacement field corresponding to each iteration is obtained, that is, the first displacement field, the second displacement field...the Nth displacement field, etc., and the displacement vectors corresponding to each vascular point in the above N displacement fields are obtained. The displacement vectors corresponding to the same vascular point in the N displacement fields are superimposed to obtain the target displacement vector of the vascular point, and the target displacement vectors of each vascular point form a target displacement field. Optionally, the target displacement field can be the displacement field obtained in the last iteration of the registration process of the angiography image and the CTA image. It can be understood that the above-mentioned vascular points can be understood as each pixel point on the second center line of the target vascular segment, or the pixel points obtained by interval sampling of the second center line of the target vascular segment.

[0086] Optionally, the target displacement field can be determined based on the second center line of the target vascular segment corresponding to the CTA image and the target registration center line corresponding to the CTA image. Specifically, the displacement vector corresponding to each vascular point can be determined through the identification and position information of each vascular point in the second center line and the identification and position information of each vascular point in the target registration center line, and the target displacement field can be formed through the displacement vector corresponding to each vascular point.

[0087] The first plaque map is deformed based on the target displacement field to generate a second plaque map that is registered with the angiographic image. The target displacement vector corresponding to each vascular point in the target displacement field is read, and the first plaque map is deformed based on the read target displacement vector to generate a second plaque map. The second plaque map obtained through deformation is registered with the angiographic image and can be displayed overlaid on the angiographic image.

[0088] For example, Figure 3 This is a schematic diagram of a plaque display provided by an embodiment of the present disclosure. Figure 3 The green and gray lines are the center lines of the target blood vessels in the angiography images, and the orange and green blocks are the plaque images. Figure 3 The displayed plaque display image displays the plaque image in the angiography image, which can realize the visualization of the vascular centerline and plaque image of the target vascular segment, and can intuitively display the location, shape, size and other properties of the plaque in the target vascular segment.

[0089] The technical solution of this embodiment obtains a registration relationship obtained by pre-registering the angiography image and the CTA image, and based on the registration relationship, superimposes and displays the plaque map corresponding to the target vascular segment in the CTA image on the angiography image, thereby achieving the effect of displaying the plaque map on the angiography image, solving the limitation of the angiography image that is not convenient for observing the plaque structure, and improving the display effect of the target vascular segment and the plaque map.

[0090] Figure 4 This is a flow chart of a method for displaying vascular plaques provided by an embodiment of the present disclosure. Based on the above embodiment, the identification and display of plaques are optimized. Figure 4 As shown, the method includes:

[0091] S210 , obtaining a registration relationship between an angiography image and a CTA image; wherein the angiography image and the CTA image respectively include a target blood vessel segment.

[0092] S220: Acquire plaque data corresponding to the target blood vessel segment in the CTA image. The target blood vessel segment includes at least one type of plaque. The plaque data includes a plaque map of at least one plaque type.

[0093] S230 , based on the registration relationship between the angiography image and the CTA image, overlaying and displaying the plaque data on the angiography image, wherein plaque images corresponding to different plaque types have different rendering properties in the angiography image.

[0094] The plaque type corresponding to the target vessel segment includes, but is not limited to, at least one of the following: calcified plaque, lipid plaque, and fibrous plaque. It is understood that the types and classification methods of plaque types are not limited, and different plaque types can be set based on the requirements for plaque classification. When a plaque image is obtained by segmentation using a plaque segmentation model, the plaque segmentation model can identify and segment plaques of each of the aforementioned plaque types.

[0095] Plaque data includes plaque images corresponding to at least one plaque type. In order to distinguish plaque images of different plaque types, plaque images corresponding to different plaque types can be displayed in the angiographic image using different rendering attributes. The rendering attributes may include at least one of color attributes, brightness attributes, and texture attributes. For example, plaque images of different plaque types are displayed using different colors, see Figure 3 , Figure 3 The yellow block and the green block correspond to patch images of different patch types. For example, patch images of different patch types are displayed by different brightness; for example, patch images of different patch types are displayed by different textures, etc.

[0096] The technical solution provided in this embodiment identifies plaque maps of different plaque types on the target blood vessel segment in the CTA image, and distinguishes and displays the plaque maps of different plaque types on the angiography image through different rendering attributes, thereby facilitating the intuitive display of the plaque types in the plaque map and improving the display effect of the plaque map.

[0097] When the plaque data includes multiple plaque maps, a determination is made based on the second vessel point information of different plaque maps whether different plaque maps are located at the same location. If different plaque maps are located at the same location, at least one plaque display strategy is set to avoid interference between different plaque maps at the same location, so as to cope with the situation where plaque maps of at least two plaque types correspond to the same location.

[0098] In some embodiments of the present disclosure, when plaque images corresponding to at least two plaque types are located at the same location, the plaque image displayed at that location is determined based on the priority of the plaque types. The priority of the plaque types is pre-set, for example, with calcified plaque, lipid plaque, and fibrous plaque prioritized in descending order. It is understood that the priority of the plaque types can be pre-set based on demand, determined based on the degree of damage to the target vessel segment by different plaque types, or determined based on the user's priority setting operation.

[0099] For example, there are calcified plaques and lipid plaques at the vascular point A1, where the priority of the calcified plaque is higher than that of the lipid plaque. Therefore, the calcified plaque is displayed at the vascular point A1 of the target vascular segment in the angiography image; or, it is displayed at the vascular point A1 in the form of a plaque map of a high-priority plaque type covering a plaque map of a low-priority plaque type, specifically, it is displayed in the form of a calcified plaque covering a lipid plaque.

[0100] In some embodiments of the present disclosure, when the same position corresponds to plaque images of at least two plaque types, the transparency of the plaque image of each plaque type is adjusted to display the plaque images of the at least two plaque types at the position.

[0101] Specifically, the patch image of each patch type may be adjusted to a set transparency, such as 50%. By adjusting the transparency of the patch images corresponding to at least two patch types at the same location, the patch images of at least two patch types can be displayed simultaneously at the same location, thereby improving the comprehensiveness of the patch image display and minimizing mutual interference.

[0102] In some embodiments of the present disclosure, the method further includes: acquiring an endothelial image and a medial image of the target blood vessel segment in the CTA image; registering the endothelial image and medial image with the angiography image respectively; and superimposing the second plaque image, the endothelial image, and the medial image on the angiography image.

[0103] The blood vessel wall is composed of three layers: the intima, the media, and the adventitia. The intima is the innermost layer of the blood vessel wall and is composed of endothelial cells, the subendothelial layer, and the internal elastic lamina. The media is located between the intima and the adventitia and is mainly composed of smooth muscle cells, elastic fibers, and collagen fibers. Plaque formation generally begins with damage to the blood vessel intima. During plaque formation and development, as the plaque continues to grow, it may develop deeper into the blood vessel wall and involve the media. In addition, the expansion of the plaque may compress the media, affecting the blood supply and normal structure of the media, causing the media to become thinner and its elasticity to decrease, and even destroying components such as the elastic fibers and collagen fibers in the media, further affecting the elasticity and function of the blood vessels.

[0104] In the disclosed embodiment, by acquiring the endothelium image and media image of the target blood vessel segment, the endothelium image, media image and second plaque image of the target blood vessel segment are synchronously displayed on the angiography image, so as to intuitively display the location, size and other properties of the plaque in the target blood vessel segment, and to display the impact of the plaque on the endothelium and media.

[0105] The method for acquiring the endothelium image and the media image of the target vascular segment includes: identifying a three-dimensional endothelium image and a three-dimensional media image from a CTA image; projecting the three-dimensional endothelium image and the three-dimensional media image based on the projection angle of the angiography image to obtain a two-dimensional endothelium image and a two-dimensional media image, wherein the two-dimensional endothelium image and the two-dimensional media image respectively have the same projection angle as the angiography image; deforming the two-dimensional endothelium image and the two-dimensional media image respectively based on the target displacement field to obtain an endothelium image and a two-dimensional media image that are fully registered with the angiography image. The method for identifying the three-dimensional endothelium image and the three-dimensional media image is not limited and can be obtained according to a pre-set endothelium recognition algorithm and a pre-set media recognition algorithm, or can be obtained by processing the CTA image using a pre-set image generation model.

[0106] Optionally, the second plaque image, the endothelium image, and the medial membrane image respectively correspond to different rendering attributes. For example, the rendering attribute may include at least one of rendering color, texture, brightness, and transparency.

[0107] For example, see Figure 5 , Figure 5 is a schematic diagram of a plaque display diagram provided by an embodiment of the present disclosure, Figure 5 The intima image, the media image, and the second plaque image of the target blood vessel segment are superimposed on the angiography image. The intima image and the media image are rendered in different colors to distinguish the intima from the media of the target blood vessel segment. Figure 5 The white block in the target blood vessel segment represents the second plaque image. In other embodiments, different plaque types in the second plaque image can be represented by different rendering colors.

[0108] Optionally, multiple layers can be set to display the second plaque image, the endothelium image, and the medial image within the angiographic image. For example, the angiographic image can be displayed on the first layer, the medial image on the second layer, the endothelium image on the third layer, and the second plaque image on the fourth layer. The first layer is the bottom layer, and the second, third, and fourth layers are positioned above the first layer in that order.

[0109] Optionally, when the second plaque map includes plaques of multiple plaque types, plaques of different plaque types may be displayed through different layers, for example, calcified plaques, lipid plaques and fibrous plaques may be displayed through the fourth layer, the fifth layer and the sixth layer respectively.

[0110] Optionally, the transparency of other layers except the first layer can be set, so that the image contents in multiple layers can be superimposed and displayed in the contrast image, avoiding occlusion between the image contents in different layers.

[0111] The technical solution provided by the embodiments of the present disclosure can intuitively display the location, size and other attributes of the plaque in the target blood vessel segment, as well as the impact of the plaque on the endothelium and media, by simultaneously displaying the plaque, endothelium and adventitia in the target blood vessel segment in the angiography image, thereby improving the display effect of the plaque in the target blood vessel segment.

[0112] Figure 6 This is a flow chart of a method for displaying vascular plaques provided by an embodiment of the present disclosure. Based on the above embodiment, the plaque data may also include the location information of the plaques. Accordingly, other display methods for the plaques are provided.

[0113] like Figure 6 As shown, the method includes:

[0114] S310 , obtaining a registration relationship between an angiography image and a CTA image; wherein the angiography image and the CTA image respectively include a target blood vessel segment.

[0115] S320: Acquire plaque data corresponding to the target blood vessel segment in the CTA image, where the plaque data includes first position information of the plaque in the CTA image.

[0116] S330: Determine second position information of the plaque in the angiography image based on the registration relationship and the first position information, and display the plaque in the angiography image based on the second position information.

[0117] In some embodiments of the present disclosure, the registration relationship between the angiography image and the CTA image includes the registration relationship between the vascular points on the target vascular segment in the angiography image and the CTA image; for example, the registration relationship can be marked as {(A1, B1), (A2, B2)…(An, Bn)}, which will not be repeated here.

[0118] Plaque identification is performed on a target vessel segment in a CTA image to obtain first position information of the plaque in the CTA image. When the target vessel segment includes multiple plaques, the plaque data includes the first position information of each plaque. It will be appreciated that plaques have a certain volume, and accordingly, the first position information of each plaque can be a set including the position of at least one vessel point.

[0119] The first position information of each plaque is matched with the registration relationship to determine the second position information of each plaque in the angiography image. Similarly, each plaque corresponds to the second position information, and the second position information of each plaque can be a set including at least one blood vessel point position.

[0120] For example, the first position information corresponding to a plaque in a CTA image includes B1 and B2. Taking the registration relationship {(A1, B1), (A2, B2) ... (An, Bn)} as an example, the second position information corresponding to the plaque in the angiography image in the plaque data is A1 and A2.

[0121] In some embodiments of the present disclosure, second position information of plaques in angiographic images can be determined based on a target displacement field. Based on the first position information of each plaque in the CTA image, a displacement vector corresponding to the first position information is read from the target displacement field. The first position information is then transformed based on the displacement vector to obtain the second position information of each plaque in the angiographic image.

[0122] Displaying the plaque in the angiography image can be understood as adjusting rendering attributes so that the rendering attributes at the location of the plaque are different from the rendering attributes at other locations of the target blood vessel segment in the angiography image, thereby highlighting the plaque.

[0123] In some embodiments of the present disclosure, a method for displaying a plaque may include: determining the local vascular segment corresponding to the plaque based on the second position information, and rendering the centerline corresponding to the local vascular segment based on set rendering attributes. For the centerline corresponding to the target vascular segment (for example, the first centerline or the target registration centerline), the rendering attributes of the centerline corresponding to the local vascular segment corresponding to the plaque are different from the rendering attributes of the centerlines corresponding to other vascular segments outside the local vascular segment, so as to highlight the centerline corresponding to the local vascular segment corresponding to the plaque. The local vascular segment corresponding to the plaque is determined based on the second position information. The above-mentioned rendering attributes include at least one of color, brightness, and texture.

[0124] Optionally, for different plaque types, the rendering attributes of the centerline of the local blood vessel segment corresponding to the different plaque types are different. For example, see Figure 7 , Figure 7 is a schematic diagram of a plaque display diagram provided by an embodiment of the present disclosure, Figure 7 The centerline of the target vessel segment is yellow, and the centerline of the target vessel segment includes the centerline of the first local vessel segment in orange and the centerline of the second local vessel segment in green, which respectively represent different plaques, and the plaques have different types.

[0125] In some embodiments of the present disclosure, displaying a plaque may further include: determining, based on the second location information, a local vascular segment corresponding to the plaque, and rendering the vascular contour corresponding to the local vascular segment based on predefined rendering attributes. These rendering attributes include at least one of color, brightness, and texture. Different plaque types correspond to different rendering attributes, which differ from the rendering attributes of non-plaque portions of the target vascular segment.

[0126] For example, see Figure 8 , Figure 8 It is a schematic diagram of a plaque display diagram provided by an embodiment of the present disclosure. Figure 8 The color of the vascular contour of the target vascular segment without any abnormality is gray, the vascular contour of the target vascular segment including the first local vascular segment is orange, and the vascular contour of the second local vascular segment is green, respectively representing different plaques, and the plaques are of different types.

[0127] In some embodiments of the present disclosure, the display method for plaques may further include: displaying a plaque marker at a location corresponding to the second position information in the angiographic image, wherein plaque markers of different plaque types have different rendering attributes. Plaque markers may include, but are not limited to, text markers, character markers, and image markers. Plaque markers of different plaque types may be the same or different. The rendering attributes of plaque markers include at least one of color, brightness, and texture.

[0128] The corresponding position of the second position information can be understood as a blank position located lateral to the second position information on the target blood vessel segment. If the second position information can be a set including at least one blood vessel point position, the corresponding position of the second position information can be understood as a blank position lateral to the blood vessel segment central to the at least one blood vessel point position on the target blood vessel segment.

[0129] For example, see Figure 9 , Figure 9 It is a schematic diagram of a plaque display diagram provided by an embodiment of the present disclosure. Figure 9 Green and orange plaque markers are displayed in the blank area on the side of the target vessel segment. The plaque marker "***" is only an example and can be any other plaque marker. For example, the plaque marker can be a text marker containing the plaque type. The plaque marker indicates that plaque is present at the target vessel segment at the corresponding location, and the plaque type is different.

[0130] The embodiments of the present disclosure provide different ways of displaying plaques in angiography images, thereby improving the flexibility and diversity of plaque display.

[0131] In some embodiments of the present disclosure, plaque parameters corresponding to each plaque map are displayed in the angiography image, and rendering properties of the plaque parameters are consistent with rendering properties of the plaque map.

[0132] It should be noted that CTA images are three-dimensional, and accordingly, plaques in the target vessel segment are also three-dimensional structures. However, since angiography images are two-dimensional, superimposing plaques on them only displays two-dimensional information about the plaques, resulting in an incomplete presentation. To address this issue, plaque parameters are displayed within angiography images. These plaque parameters can include attribute parameters specific to each plaque type or plaque. For example, plaque parameters may include, but are not limited to, maximum plaque angle and maximum plaque thickness, thereby displaying three-dimensional information about each plaque. Plaque information can be extracted from the three-dimensional plaque map corresponding to the CTA image.

[0133] See also Figure 3 as well as Figure 7-Figure 9 ,The plaque parameters are respectively displayed in the plaque display diagram. Figure 3 The plaque parameters corresponding to the green block are shown in the figure. These parameters include a maximum angle of 200° and a maximum thickness of 2 mm. The font color of these plaque parameters is green, consistent with the color of the green plaque, indicating that they are the plaque parameters corresponding to the green block.

[0134] In the disclosed embodiments, by displaying a plaque map and its parameters on an angiographic image, the plaque display effect can be improved. By displaying the plaque map and the plaque information with consistent rendering attributes, the correspondence between the plaque parameters and the plaque map is improved, making the display more intuitive.

[0135] Figure 10 This is a flow chart of a method for displaying vascular plaques, provided in an embodiment of the present disclosure. Based on the above embodiment, the dimensions of the plaque display are optimized, and plaques in a target vascular segment are displayed in different dimensions using different images. The method specifically includes the following steps.

[0136] S410 , obtaining a registration relationship between an angiography image and a CTA image; wherein the angiography image and the CTA image respectively include a target blood vessel segment.

[0137] S420: Obtain plaque data corresponding to the target blood vessel segment in the CTA image.

[0138] S430 : Based on the registration relationship between the angiography image and the CTA image, the plaque data is superimposed and displayed on the angiography image.

[0139] S440: Based on the registration relationship between the angiography image and the CTA image, display the plaque diameter map and / or probe map corresponding to different vascular points on the target vascular segment.

[0140] In the embodiment of the present disclosure, in addition to displaying the angiographic image superimposed with plaque data, a plaque diameter map and / or a probe map is also displayed, wherein the plaque diameter map can display the diameter of the plaque at each blood vessel point on the target blood vessel segment. For example, see Figure 11 , Figure 11 This is an example of a plaque diameter map provided by an embodiment of the present disclosure. The probe map can represent a cross-sectional view of a certain blood vessel point on the target blood vessel segment, and the cross-sectional view can be used to display the cross-sectional view of the plaque at the blood vessel point. For example, see Figure 12 , Figure 12 is an example of a probe map provided by an embodiment of the present disclosure. Different plaque types are represented by different rendering attributes in the plaque diameter map and / or probe map. Figure 11 and Figure 12 In the image processing, different color attributes are used to represent different types of patches, thereby improving the display effect of the patches.

[0141] In some embodiments of the present disclosure, angiography images, plaque diameter maps, and probe maps are displayed in conjunction with each other, and vascular information of the same vascular point can be displayed synchronously. The vascular points mentioned above may include vascular points corresponding to plaque data. When the plaque data includes multiple plaque maps, the vascular points to be displayed can be determined based on the priority of the plaque type. For example, the vascular point corresponding to the plaque map of the highest priority plaque type can be displayed. Alternatively, the vascular point to be displayed can be determined based on the plaque parameters of each plaque map. For example, the vascular point corresponding to the plaque map with the maximum plaque parameter can be displayed. Alternatively, there can be multiple vascular points, such as vascular points corresponding to each plaque map in the plaque data.

[0142] The above-mentioned vascular point can also be any vascular point on the target vascular segment, and the arbitrary vascular point can be determined by a vascular point selection operation, and the vascular point selection operation can be a dragging operation on an index line. In the angiography image and / or CTA image, an index line is provided on the target vascular segment, and an index line can also be provided on the plaque diameter map. The index line in any of the above-mentioned images is in a draggable state, and the vascular point to be displayed can be determined by dragging the index line in any of the images. The vascular point to be displayed is determined based on the release position of the dragging operation of the index line, and based on the determined vascular point, other images are updated. For example, the vascular point to be displayed is determined by dragging the index line in the angiography image, and the index line on the plaque diameter map is updated based on the determined vascular point, and the probe map corresponding to the determined vascular point is updated.

[0143] For example, see Figure 13 , Figure 13This is a partial schematic diagram of an image display provided by an embodiment of the present disclosure. It can be understood that: Figure 13 This is an example layout of the angiography image, blood vessel diameter map, and probe map, and is not limited thereto. The display position and display size of different images can be adjusted according to image display requirements.

[0144] The technical solution provided in this embodiment realizes the linked display of multiple images by superimposing plaque data on the angiography image based on the registration relationship between the angiography image and the CTA image, and simultaneously displays the plaque diameter map and / or probe map, thereby realizing the simultaneous display of multi-dimensional information of the target vascular segment and improving the display effect of the target vascular segment.

[0145] Figure 14 Schematic diagram of the structure of a vascular plaque display device provided by an embodiment of the present disclosure. Figure 14 As shown, the device includes:

[0146] A registration relationship acquisition module 510 is configured to acquire a registration relationship between an angiography image and a CTA image, wherein the angiography image and the CTA image each include a target blood vessel segment;

[0147] a plaque data acquisition module 520 for acquiring plaque data corresponding to the target blood vessel segment in the CTA image;

[0148] The display module 530 is configured to display the plaque data by overlaying it on the angiography image based on the registration relationship between the angiography image and the CTA image.

[0149] The technical solution of this embodiment obtains a registration relationship obtained by pre-registering the angiography image and the CTA image, and based on the registration relationship, superimposes the plaque data corresponding to the target vascular segment in the CTA image on the angiography image, thereby achieving the effect of displaying the plaque map on the angiography image, solving the limitation of the angiography image that is not convenient for observing the plaque structure, and improving the display effect of the target vascular segment and the plaque map.

[0150] Based on the above embodiment, optionally, the angiography image is a key frame angiography image in an angiography image sequence.

[0151] Based on the above embodiment, optionally, the plaque data includes a first plaque map, and the first plaque map is obtained by performing plaque segmentation on the CTA image;

[0152] The display module 530 is used to obtain a target displacement field, which is used to achieve registration of the angiography image and the CTA image; deform the first plaque map based on the target displacement field to obtain a second plaque map, and superimpose the second plaque map on the angiography image for display.

[0153] Optionally, the projection angle of the first plaque image is consistent with the projection angle of the angiography image;

[0154] The first plaque map is obtained by projecting the three-dimensional plaque map obtained by segmentation in the CTA image based on the projection angle of the angiography image.

[0155] Optionally, the target blood vessel segment corresponds to at least one plaque type, and the plaque data includes a plaque map of at least one plaque type; plaque maps of different plaque types have different corresponding rendering attributes in the angiography image.

[0156] Optionally, the display module 530 is also used to: when there are plaque images corresponding to at least two plaque types at the same location, determine the plaque image to be displayed at the location based on the priority of the plaque type; or, adjust the transparency of the plaque image of each plaque type and display the plaque images of the at least two plaque types at the location.

[0157] Optionally, the plaque data includes first position information of the plaque in the CTA image;

[0158] The display module 530 is further configured to: determine second position information of the plaque in the angiography image based on the registration relationship and the first position information; and display the plaque in the angiography image based on the second position information.

[0159] Optionally, the display module 530 is also used to perform at least one of the following: based on the second position information, determining the local vascular segment corresponding to the plaque, and rendering the vascular contour and / or centerline corresponding to the local vascular segment based on the set rendering attributes, wherein different plaque types correspond to different rendering attributes; in the angiography image, a plaque mark is displayed at the corresponding position of the second position information, wherein the plaque marks of different plaque types correspond to different rendering attributes.

[0160] Based on the above embodiment, optionally, the display module 530 is further configured to: display plaque parameters corresponding to each plaque type in the angiography image, wherein rendering attributes of the plaque parameters are consistent with rendering attributes corresponding to the plaque type.

[0161] Based on the above embodiment, optionally, the display module 530 is further configured to: display a plaque diameter map and / or a probe map corresponding to different vascular points on the target vascular segment based on the registration relationship between the angiography image and the CTA image.

[0162] Optionally, the different vascular points include at least one of the following: a vascular point corresponding to the plaque data; a vascular point corresponding to an index line in the angiography image and / or the CTA image, the index line being located on the target vascular segment, and the index line being in a draggable state.

[0163] The vascular plaque display device provided in the embodiments of the present disclosure can execute the vascular plaque display method provided in any embodiment of the present disclosure, and has the corresponding functional modules and beneficial effects of the execution method.

[0164] Figure 15 1 is a schematic diagram of the structure of an electronic device provided by an embodiment of the present disclosure. The electronic device 10 is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or required herein.

[0165] like Figure 15 As shown, the electronic device 10 includes at least one processor 11 and a memory, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., which is communicatively connected to the at least one processor 11. The memory stores a computer program that can be executed by the at least one processor, and the processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 into the random access memory (RAM) 13. Various programs and data required for the operation of the electronic device 10 can also be stored in the random access memory (RAM) 13. The processor 11, the read-only memory (ROM) 12, and the random access memory (RAM) 13 are connected to each other via a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0166] Multiple components in the electronic device 10 are connected to the I / O interface 15, including an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a magnetic disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices via a computer network such as the Internet and / or various telecommunication networks.

[0167] The processor 11 can be any general-purpose and / or specialized processing component with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any other suitable processor, controller, microcontroller, etc. The processor 11 executes the various methods and processes described above, such as the method for displaying vascular plaque.

[0168] In some embodiments, the vascular plaque display method can be implemented as a computer program tangibly embodied in a computer-readable storage medium, such as storage unit 18. In some embodiments, part or all of the computer program can be loaded and / or installed on electronic device 10 via read-only memory (ROM) 12 and / or communication unit 19. When the computer program is loaded into random access memory (RAM) 13 and executed by processor 11, one or more steps of the vascular plaque display method described above can be performed. Alternatively, in other embodiments, processor 11 can be configured to execute the vascular plaque display method in any other suitable manner (e.g., via firmware).

[0169] Various embodiments of the systems and techniques described herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), system-on-chip systems (SOCs), programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include being implemented in one or more computer programs that are executable and / or interpreted on a programmable system that includes at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0170] Computer programs for implementing the vascular plaque display methods of the present disclosure can be written in any combination of one or more programming languages. These computer programs can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when executed by the processor, the computer programs implement the functions / operations specified in the flowcharts and / or block diagrams. The computer programs can be executed entirely on the machine, partially on the machine, as a stand-alone software package, partially on the machine and partially on a remote machine, or entirely on a remote machine or server.

[0171] The present disclosure also provides a computer-readable storage medium storing computer instructions, wherein the computer instructions are used to cause a processor to execute a method for displaying vascular plaque, the method comprising:

[0172] Acquire a registration relationship between an angiography image and a CTA image; wherein the angiography image and the CTA image each include a target vascular segment; acquire plaque data corresponding to the target vascular segment in the CTA image, and register the plaque data with the angiography image; and based on the registration relationship between the angiography image and the CTA image, overlay and display the plaque data on the angiography image.

[0173] In the context of the present disclosure, a computer-readable storage medium can be a tangible medium that can contain or store a computer program for use by an instruction execution system, device or equipment or used in combination with an instruction execution system, device or equipment. A computer-readable storage medium can include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium can be a machine-readable signal medium. A more specific example of a machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0174] To provide interaction with a user, the systems and techniques described herein can be implemented on an electronic device that has: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0175] The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0176] A computing system may include clients and servers. The clients and servers are typically remote from each other and typically interact via a communication network. This client-server relationship arises through computer programs running on the respective computers, creating a client-server relationship. The server may be a cloud server, also known as a cloud computing server or cloud host. This server is a hosting product within the cloud computing service ecosystem that addresses the management difficulties and limited scalability of traditional physical hosting and VPS services.

[0177] It should be understood that the various forms of processes shown above can be used to reorder, add, or delete steps. For example, the steps described in this disclosure can be performed in parallel, sequentially, or in a different order, as long as the desired results of the technical solutions of this disclosure can be achieved, and this document is not limited here.

[0178] The above specific embodiments do not constitute a limitation on the scope of protection of this disclosure. Those skilled in the art will appreciate that various modifications, combinations, sub-combinations, and substitutions may be made based on design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this disclosure shall be included within the scope of protection of this disclosure.

Claims

1. A method for displaying vascular plaque, characterized in that: include: Acquiring a registration relationship between an angiography image and a CTA image; wherein the angiography image and the CTA image each include a target blood vessel segment; Acquiring plaque data corresponding to the target blood vessel segment in the CTA image; Based on the registration relationship between the angiography image and the CTA image, the plaque data is superimposed and displayed on the angiography image.

2. The method according to claim 1, characterized in that The angiography image is a key frame angiography image in an angiography image sequence.

3. The method according to claim 1, characterized in that The plaque data includes a first plaque map, which is obtained by performing plaque segmentation on the CTA image; Overlaying and displaying the plaque data on the angiographic image includes: Acquiring a target displacement field, wherein the target displacement field is used to achieve registration between the angiography image and the CTA image; The first plaque map is deformed based on the target displacement field to obtain a second plaque map, and the second plaque map is superimposed and displayed on the angiography image.

4. The method according to claim 3, characterized in that The projection angle of the first plaque image is consistent with the projection angle of the angiography image; The first plaque map is obtained by projecting the three-dimensional plaque map obtained by segmentation in the CTA image based on the projection angle of the angiography image.

5. The method according to any one of claim 3, characterized in that The target blood vessel segment corresponds to at least one plaque type, and the plaque data includes a plaque map of at least one plaque type; plaque maps of different plaque types have different corresponding rendering attributes in the angiography image.

6. The method according to claim 5, characterized in that Overlaying and displaying the plaque data on the angiographic image includes: When the same location corresponds to plaque images of at least two plaque types, the plaque image displayed at the location is determined based on the priority of the plaque types; or, the transparency of the plaque image of each plaque type is adjusted to display the plaque images of the at least two plaque types at the location.

7. The method according to claim 3, characterized in that The method further comprises: Acquire an intima image and a media image of the target blood vessel segment in the CTA image; and register the intima image and the media image with the angiography image respectively; The second plaque image, the endothelium image and the medial image are superimposed and displayed on the angiography image.

8. The method according to claim 1, characterized in that The plaque data includes first position information of the plaque in the CTA image; Based on the registration relationship between the angiography image and the CTA image, the plaque data is superimposed and displayed on the angiography image, comprising: determining second position information of the plaque in the angiography image based on the registration relationship and the first position information; Based on the second position information, the plaque is displayed in the angiography image.

9. The method according to claim 8, characterized in that Displaying the plaque in the angiographic image based on the second position information includes one or more of the following: determining a local blood vessel segment corresponding to the plaque based on the second position information, and rendering a blood vessel contour and / or a centerline corresponding to the local blood vessel segment based on set rendering attributes, wherein different plaque types correspond to different rendering attributes; In the angiography image, a plaque mark is displayed at a position corresponding to the second position information, wherein plaque marks of different plaque types have different corresponding rendering attributes.

10. The method according to claim 3 or 6, characterized in that The method further comprises: Plaque parameters corresponding to each plaque type are displayed in the angiography image, and rendering attributes of the plaque parameters are consistent with rendering attributes corresponding to the plaque type.

11. The method according to claim 1, wherein The method further comprises: Based on the registration relationship between the angiography image and the CTA image, a plaque diameter map and / or a probe map corresponding to different vascular points on the target vascular segment is displayed.

12. The method according to claim 11, characterized in that The different blood vessel points include at least one of the following: A blood vessel point corresponding to the plaque data; The blood vessel point corresponding to the index line in the angiography image and / or the CTA image, the index line is located on the target blood vessel segment, and the index line is in a draggable state.

13. A device for displaying vascular plaque, characterized in that: include: a registration relationship acquisition module, configured to acquire a registration relationship between an angiography image and a CTA image, wherein the angiography image and the CTA image each include a target blood vessel segment; a plaque data acquisition module, configured to acquire plaque data corresponding to the target blood vessel segment in the CTA image; A display module is used to overlay and display the plaque data on the angiography image based on the registration relationship between the angiography image and the CTA image.

14. An electronic device, characterized in that: The electronic device comprises: at least one processor; and a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor to enable the at least one processor to perform the method for displaying plaque in a blood vessel according to any one of claims 1 to 12.

15. A computer-readable storage medium, characterized in that The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the method for displaying blood vessel plaque according to any one of claims 1 to 12 when executed.

Images