Marking system for intravascular ultrasound images

Abstract

The invention relates to the field of image processing, and discloses an intravascular ultrasound image marking system which comprises an image receiving module used for receiving an intravascular ultrasound image of a target blood vessel and a radiography image of the target blood vessel; the image processing module is used for extracting lumen area data and external elastic membrane area data of the intravascular ultrasonic image; the display module is used for displaying a user interface; the user interface comprises a first display area and a second display area; the marking module is used for correspondingly marking the contrast image when a first marking operation on the longitudinal section view is received; or when a second marking operation on the contrast image is received, corresponding marking is carried out on the longitudinal section view. According to the method, corresponding marking display can be performed on the intravascular mapping of the target blood vessel based on the IVUS image and the coronary artery angiography image of the target blood vessel, and medical staff can conveniently check the target blood vessel.

Description

Technical Field

[0001] The present application relates to the field of image processing technology, and in particular to a marking system for intravascular ultrasound images. Background Art

[0002] Coronary artery stenosis is the primary pathophysiological basis of coronary artery disease (CAD). Percutaneous coronary intervention (PCI) has become an important treatment for CAD. Coronary angiography and intravascular ultrasound (IVUS) are currently the mainstays of clinical diagnosis and PCI. Coronary angiography primarily uses X-ray imaging technology and contrast agents to project the three-dimensional coronary artery tree onto a two-dimensional plane. This provides a more comprehensive view of the distribution and pathology of the coronary arteries, facilitating the observation of conditions such as patency, stenosis, obstruction, and abnormal dilatation of arteries, veins, and other blood vessels. However, detailed information on vessel wall structure, microlesions, or tissue characteristics is limited in some cases. IVUS, a technique that obtains high-resolution intravascular images by inserting an ultrasound probe into the coronary arteries, can provide information on lesions such as the vessel wall, plaques, stenosis, and thrombus. It also provides more detailed vascular anatomy by measuring parameters such as vessel diameter, area, and length. However, as a local imaging technique, it cannot provide a complete image of the coronary artery system, only providing information on the inserted vessel segment.

[0003] The existing coronary angiography and IVUS image fusion technology only provides corresponding displays of the pullback position in coronary angiography and the IVUS image frame number. However, in guiding coronary intervention surgery, relevant calculations are often required on the IVUS image. The marked lesion segment cannot be intuitively displayed on the coronary angiography. The surgeon needs to adjust the IVUS image back and forth to find the corresponding lesion segment through image correspondence. This reduces the efficiency of stent placement in guiding coronary intervention surgery. Summary of the Invention

[0004] In order to solve or partially solve the problems existing in the related art, the present application provides a marking system for intravascular ultrasound images, which can mark corresponding marks on angiography images and intravascular ultrasound images, making it easier for users to determine the location of abnormal blood vessels.

[0005] In a first aspect, the present application provides a marking system for intravascular ultrasound images, comprising:

[0006] an image receiving module, configured to receive an intravascular ultrasound image of a target blood vessel and an angiography image of the target blood vessel;

[0007] an image processing module, configured to extract lumen area data and external elastic membrane area data from the intravascular ultrasound image;

[0008] A display module for displaying a user interface; the user interface includes a first display area and a second display area; the first display area is used to display the angiography image, and the second display area is used to display a longitudinal cross-sectional view corresponding to the intravascular ultrasound image;

[0009] The marking module is used to mark the corresponding image when a first marking operation is received on the longitudinal section view; or mark the corresponding image when a second marking operation is received on the angiography image.

[0010] Furthermore, the first marking operation includes: marking a target area in the longitudinal cross-sectional view according to a preset threshold;

[0011] The preset threshold includes at least one of a lumen area threshold, an external elastic membrane area threshold, and a plaque load threshold; wherein the plaque load data is calculated based on the corresponding lumen area data and external elastic membrane area data.

[0012] Furthermore, marking the target area in the longitudinal section view according to the preset threshold includes: using corresponding color identification on the longitudinal section view according to the preset threshold, respectively marking the target area that meets the corresponding preset threshold; each preset threshold has a unique color identification.

[0013] Furthermore, the method includes: marking a starting point and an ending point of a target area that meets a preset threshold value on the longitudinal cross-sectional view according to the preset threshold value.

[0014] Further, the method includes: marking the length of the target blood vessel corresponding to the target area in the longitudinal cross-sectional view according to the target area in the longitudinal cross-sectional view.

[0015] Furthermore, the user interface further comprises a positioning button, for receiving a positioning point marked by a user on the target blood vessel in the angiography image when the positioning button is activated, and marking a corresponding point on the longitudinal cross-sectional view based on the positioning point;

[0016] The second marking operation includes: the positioning button is in an activated state, receiving a positioning point marked by the user on the target blood vessel in the angiography image, and marking the longitudinal cross-sectional view based on the positioning point.

[0017] Furthermore, the marking module further includes: marking the position of the minimum lumen area of ​​the target blood vessel on the longitudinal cross-sectional view and the angiography image respectively according to the lumen area data of the intravascular ultrasound image.

[0018] Furthermore, the plaque load threshold includes a first plaque threshold and a second plaque threshold; the first plaque threshold is greater than the second plaque threshold.

[0019] Furthermore, the user interface also includes a third display area for displaying a cross-sectional image of the intravascular ultrasound image.

[0020] Furthermore, the user interface also includes a fourth display area for displaying an area view of the target blood vessel; the area view includes a lumen area curve and an external elastic force area curve; the lumen area curve is obtained based on the lumen area data of the intravascular ultrasound image; the external elastic force area curve is obtained based on the external elastic membrane area data of the intravascular ultrasound image.

[0021] The technical solution provided by this application may have the following beneficial effects:

[0022] Based on the fusion analysis of coronary angiography images and intravascular ultrasound images, this application calculates vascular parameters, maps specific locations that reach a specified threshold to the coronary angiography image, and marks the lesion area on the coronary angiography image. This combined display can provide more comprehensive and detailed information, enable intuitive functional evaluation of coronary artery stenosis, guide stent selection, placement position and expansion degree in coronary intervention surgery, and help evaluate the treatment effect.

[0023] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] The above and other objects, features and advantages of the present application will become more apparent by describing in more detail exemplary embodiments of the present application in conjunction with the accompanying drawings, wherein the same reference numerals generally represent the same components in the exemplary embodiments of the present application.

[0025] Figure 1 Schematic diagram of a marking system for intravascular ultrasound images shown in an embodiment of the present application.

[0026] Figure 2 This is a schematic diagram of the display area of ​​the user interface shown in an embodiment of the present application.

[0027] Figure 3 This is a schematic diagram of the effect of the user interface shown in an embodiment of the present application.

[0028] Figure 4 yes Figure 3 Magnified view of area a.

[0029] Figure 5It is a structural diagram of an electronic device shown in an embodiment of the present application.

[0030] The reference numerals indicate: 1 - third display area, 2 - first display area, 3 - second display area, 4 - fourth display area, 5 - fifth display area. DETAILED DESCRIPTION

[0031] The following describes embodiments of the present application in more detail with reference to the accompanying drawings. Although the accompanying drawings illustrate embodiments of the present application, it should be understood that the present application can be implemented in various forms and should not be limited by the embodiments described herein. Rather, these embodiments are provided to make the present application more thorough and complete, and to fully convey the scope of the present application to those skilled in the art.

[0032] The terms used in this application are for the purpose of describing specific embodiments only and are not intended to limit this application. As used in this application and the appended claims, the singular forms "a," "an," "the," and "the" are intended to include the plural forms, unless the context clearly indicates otherwise. It should also be understood that the term "and / or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.

[0033] It should be understood that although the terms "first", "second", "third", etc. may be used in this application to describe various information, this information should not be limited to these terms. These terms are only used to distinguish information of the same type from each other. For example, without departing from the scope of this application, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of this application, the meaning of "plurality" is two or more, unless otherwise clearly and specifically defined.

[0034] In related technologies, coronary angiography images and IVUS images can be fused and analyzed through specific software to achieve position matching between IVUS images and coronary angiography images. However, when analyzing lesions, information such as lesion measurements in IVUS images lacks a corresponding relationship with coronary angiography images, which has certain limitations in the analysis of some vascular segments in coronary angiography.

[0035] Therefore, to address this problem, a labeling system that fuses intravascular ultrasound images and angiography images was proposed. Based on the fusion analysis of coronary angiography images and IVUS images, IVUS images are used to calculate vascular parameters such as MLA (Minimum Lumen Area), EEMA (Ectatic or Enlarged External Elastic Membrane Area), LA (Lumen Area), and Plaque. Specific locations that reach the specified threshold are mapped to the coronary angiography image, and the lesion area is annotated on the coronary angiography image. This combined display can provide more comprehensive and detailed information, enable intuitive functional evaluation of coronary artery stenosis, guide stent selection, placement, and expansion degree during coronary intervention, and help evaluate treatment efficacy.

[0036] To solve the above problems, the present invention provides a marking system for fusion of intravascular ultrasound images and angiography images. Figure 1 As shown, it includes: an image receiving module 101, an image processing module 102, a display module 103 and a marking module 104.

[0037] The image receiving module 101 is configured to receive an intravascular ultrasound image of a target blood vessel and an angiography image of the target blood vessel.

[0038] In this embodiment, the intravascular ultrasound image marking system is a software system applicable to operating systems such as Windows, Hongmeng, Linux, and OS. The system can be installed on a computer for use, with the system's user interface displayed on a computer monitor, the computer processor executing code instructions for some or all of the system's modules, and the computer memory storing data and instructions required by the processor. The target vessel is the vessel captured by medical personnel using the probe of the relevant intravascular ultrasound equipment. Angiographic images refer to coronary angiographic images. Intravascular ultrasound images refer to IVUS images.

[0039] In this embodiment, an IVUS image of the target vessel can be obtained using existing intravascular ultrasound equipment and technology. Specifically, the IVUS image in the prior art includes multiple cross-sectional images of the target vessel. Using intravascular ultrasound technology, multiple cross-sectional images of the target vessel can be directly acquired. The corresponding longitudinal cross-sectional view of the target vessel in the IVUS image is constructed using relevant technology based on each cross-sectional image in the multiple cross-sectional images of the target vessel. Each cross-sectional image has a corresponding point on the longitudinal cross-sectional view. A coronary angiogram, also known as a coronary angiography image, is an image that projects a coronary artery tree with a three-dimensional spatial structure onto a two-dimensional plane using angiography technology. A two-dimensional or three-dimensional coordinate system can be established for the target vessel in the coronary angiography image.

[0040] The system in this embodiment can directly receive the fused IVUS image and coronary angiography image of the target vessel. Alternatively, the system can receive the IVUS image and coronary angiography image of the target vessel and fuse them. The fusion of the IVUS image and the coronary angiography image refers to the use of angiography fusion technology to obtain a correspondence between each frame of the cross-sectional image in the IVUS image of the target vessel and the coordinate point of the target vessel in the coronary angiography image after acquiring the coronary angiography image and IVUS image of the target vessel. Based on this, each frame of the cross-sectional image can be corresponded to a coordinate point of the target vessel in the coronary angiography image. Accordingly, the points on the longitudinal section view of the IVUS image of the target vessel correspond to the coronary angiography image based on the cross-sectional image.

[0041] The image processing module 102 is configured to extract lumen area data and external elastic membrane area data from the intravascular ultrasound image.

[0042] In this embodiment, the system performs image segmentation based on each cross-sectional image frame of the IVUS image corresponding to the target vessel, obtaining vascular data corresponding to each cross-sectional image frame. The vascular data includes external elastic membrane area data (EEMA), lumen area data (LA), and plaque burden data (Plaque). The external elastic membrane area data (EEMA) and lumen area data (LA) are obtained through image segmentation, while each plaque burden data (Plaque) is calculated based on the external elastic membrane area data (EEMA) and lumen area data (LA) for each cross-sectional image frame using the formula: Plaque = (EEMA - LA) / EEMA. The image segmentation technology used in this embodiment is based on existing artificial intelligence image segmentation techniques such as threshold segmentation, region segmentation, edge segmentation, or histogram methods, as well as computational models such as neural networks and machine learning, and is not specifically limited in this application.

[0043] Display module 103, used to display the user interface; Figure 2 As shown, the user interface includes a first display area 2 and a second display area 3; the first display area 2 is used to display the angiography image, and the second display area 3 is used to display the longitudinal cross-sectional view corresponding to the intravascular ultrasound image.

[0044] In this embodiment, the user interface includes a first display area 2 and a second display area 3. The display area refers to different display positions on the user interface. The positions of each display area on the user interface are different. For example, the first display area 2 can represent the area on the left part of the user interface, and the second display area 3 can represent the area on the right part of the user interface. Each display area can be adaptively adjusted according to needs.

[0045] The marking module 104 is configured to mark the longitudinal section view when a first marking operation is received on the longitudinal section view, or mark the longitudinal section view when a second marking operation is received on the longitudinal section view.

[0046] In one embodiment, the first marking operation includes: marking a target area in the longitudinal cross-sectional view according to a preset threshold;

[0047] The preset threshold includes at least one of a lumen area threshold, an external elastic membrane area threshold, and a plaque load threshold; wherein the plaque load data is calculated based on the corresponding lumen area data and external elastic membrane area data.

[0048] In this embodiment, the user can select and use the above thresholds as needed. Based on the preset threshold, the system determines a set of corresponding cross-sectional images whose vascular data meets the preset threshold, or a set of corresponding cross-sectional image frame numbers whose vascular data meets the preset threshold. Based on this set, the corresponding target area on the longitudinal cross-sectional view is determined and displayed in the second display area 3. This embodiment provides users with multiple statistical analysis thresholds for easy selection. The target area refers to the area marked on the longitudinal cross-sectional view based on the preset threshold. By setting multiple thresholds, users can easily locate lesions / abnormal blood vessels and determine whether the lesions / abnormal blood vessels are suitable for surgery or stent placement.

[0049] The following is an example of the lumen area threshold. The system is based on the lumen area threshold, for example, the threshold is less than or equal to 5mm 2 , less than 4mm 2 etc., determine the first set consisting of the first IVUS images that meet the lumen area threshold in the cross-sectional image; determine the target area on the longitudinal cross-sectional view based on the frame number corresponding to the first IVUS image in the first set, and display the target area corresponding to the first set in the second display area 3. The first IVUS image represents the cross-sectional image that meets the lumen area threshold in the multi-frame cross-sectional image of the IVUS image corresponding to the target blood vessel. This embodiment facilitates the user to view the stenosis of the target blood vessel on the display interface by displaying the longitudinal cross-sectional view and the mark corresponding to the lumen area threshold. According to the frame number in the first set, when marking the area of ​​the set in the longitudinal cross-sectional view of the second display area 3, the corresponding mark can be respectively made in the longitudinal cross-sectional view based on the boundary of the first area, and the corresponding area of ​​the first area can also be marked on the target blood vessel of the angiography image in the first display area 2. Here, the first area refers to the target area corresponding to the lumen area threshold in the longitudinal cross-sectional view.

[0050] In one embodiment, marking the target area in the longitudinal cross-sectional view according to the preset threshold includes: using corresponding color identification on the longitudinal cross-sectional view according to the preset threshold, respectively marking the target areas that meet the corresponding preset threshold; each of the preset thresholds has a unique color identification.

[0051] In this embodiment, different target areas can be marked with different color markers. Each location to be marked has a different meaning and uses a different color marker. In this embodiment, different target areas or points to be marked can also be marked with different shapes. For example, different densities of grids or lines can be used to mark different target areas. Different styles of dotted lines can also be used to mark the starting and ending points of different target areas. A combination of shapes and colors can also be used. In addition, points to be marked can be marked with colored dots or dots of different shapes, such as a combination of yellow dots, blue triangles, and multiple dots. For example, the point to be marked can be the minimum lumen area point of the target blood vessel.

[0052] In one embodiment, the method includes: marking a start point and an end point of a target area meeting a preset threshold value on the longitudinal cross-sectional view according to the preset threshold value.

[0053] In this embodiment, since the longitudinal section view includes the longitudinal section effect of the target blood vessel, in order not to block the shape in the longitudinal section view, in this embodiment, dotted lines of different colors are used to mark the starting and ending points of the target area to reduce the blockage of the longitudinal section view.

[0054] In one embodiment, the method includes: marking, according to the target area in the longitudinal cross-sectional view, a length of the target blood vessel corresponding to the target area in the longitudinal cross-sectional view.

[0055] In this embodiment, in order to understand the data of the target vascular lesion or abnormal position in more detail and intuitively, this embodiment can display a mark for the target blood vessel length corresponding to the target area. The user can set whether to display the target area length according to needs. The target area length can be displayed in a blank or non-functional area of ​​the second display area 3 by using a color mark corresponding to the corresponding preset threshold, or in combination with the starting and ending segments of the target area.

[0056] In one embodiment, the user interface further comprises a positioning button, for receiving a positioning point marked by a user on the target blood vessel in the angiography image when the positioning button is activated, and marking the longitudinal cross-sectional view based on the positioning point;

[0057] The second marking operation includes: the positioning button is in an activated state, receiving a positioning point marked by the user on the target blood vessel in the angiography image, and marking the longitudinal cross-sectional view based on the positioning point.

[0058] In this embodiment, the first display area 2 also includes a positioning button. The positioning point represents the point marked by the user on the target vessel in the coronary angiography image using the positioning button. When the user marks the positioning point, the system can obtain a frame of cross-sectional image of the target vessel corresponding to the positioning point. Based on this frame of cross-sectional image, the positioning point is marked in the longitudinal section view. In conjunction with the user being able to click any point in the longitudinal section view, the system will display the vascular data corresponding to that point, facilitating the user's later surgical location of the lesion. The positioning button can be used in such a way that each click of the positioning button by the user marks a positioning point on the angiography image, or a single click of the positioning button by the user can mark multiple positioning points on the angiography image. When the user clicks a blank space or a location outside the second display area 3, the activated positioning button is deactivated.

[0059] In one embodiment, the marking module further comprises: marking the position of the minimum lumen area of ​​the target blood vessel on the longitudinal cross-sectional view and the angiography image respectively according to the lumen area data of the intravascular ultrasound image.

[0060] In this embodiment, the corresponding position of the minimum lumen area of ​​the target blood vessel in the longitudinal cross-sectional view is automatically marked in the second display area 3 at the initial moment of the system, and can also be marked on the coronary angiography image to facilitate the user to understand the stenosis of the target blood vessel.

[0061] In one embodiment, the plaque load threshold includes a first plaque threshold and a second plaque threshold; the first plaque threshold is greater than the second plaque threshold.

[0062] In this embodiment, to facilitate user locating of lesions, the plaque burden threshold can be configured to receive at least one plaque threshold input by the user. For example, one, two, three, or other plaque thresholds can be directly received, each representing a different numerical value, and the specific number is set based on user needs. At least one second set of corresponding second IVUS images in the cross-sectional image of the IVUS image that meet at least one plaque threshold is determined. Based on the frame number corresponding to the first IVUS image in the at least one second set, at least one threshold target position on the longitudinal cross-sectional view is determined. At least one second region corresponding to the threshold target position in the at least one second set is displayed in the longitudinal cross-sectional view in the second display area 3. In this case, the second region refers to the target region of the plaque burden threshold on the longitudinal cross-sectional view. A second IVUS image represents an IVUS image in the cross-sectional image of the target vessel that meets a corresponding plaque threshold.

[0063] In this embodiment, the plaque load threshold can be a system default value or a threshold input by the user based on their needs, for example, a first plaque threshold greater than or equal to 50%, a second plaque threshold greater than 90%, etc. Based on a plaque threshold, the plaque load data corresponding to each frame in the IVUS cross-sectional image is compared, and the frame number of the corresponding IVUS image frame that meets the threshold is saved in a second set; based on the frame number in the second set, the second region is displayed in the longitudinal cross-sectional view of the second display area 3. If there are at least two plaque thresholds, the at least two plaque thresholds are compared and calculated separately to obtain different second sets and corresponding different second regions in the second display area 3. Similarly, the thresholds in this embodiment can also be marked on the longitudinal cross-sectional view. In this embodiment, by adding a plaque load threshold, the user can more easily locate the lesion by setting the threshold. Simultaneously, combined with the extensible external elastic membrane area curve and the lumen area curve, it is convenient to understand the vascular stenosis and abnormal dilatation in the lesion area.

[0064] In one embodiment, the user interface further includes a third display area 1 for displaying a cross-sectional image of the intravascular ultrasound image.

[0065] In this embodiment, when the user clicks on any point of the target blood vessel in the longitudinal cross-sectional view in the second display area 3, the system will display a cross-sectional image corresponding to the coordinates of the point in the third display area 1. In this embodiment, the user can also choose to play the IVUS image. During playback, the corresponding cross-sectional image frame being played will be displayed in the third display area 1, and the sequence number of the currently playing frame will be marked in the longitudinal cross-sectional view. In addition, when any cross-sectional image frame is displayed in the second display area 3, the user can zoom in, zoom out, translate, and / or rotate the IVUS image based on a point in the image. For example, after the user selects a point in the image for zooming in, the user can translate the reference point to view other locations in the zoomed image, etc., to facilitate viewing of details in the IVUS image.

[0066] In this embodiment, at the initialization moment of the system, the third display area 1 displays the cross-sectional image of the minimum lumen area by default, so as to facilitate the user to understand the stenosis of the target blood vessel.

[0067] In one embodiment, the user interface also includes a fourth display area 4 for displaying an area view of the target blood vessel; the area view includes a lumen area curve and an external elastic force area curve; the lumen area curve is obtained based on the lumen area data of the intravascular ultrasound image; the external elastic force area curve is obtained based on the external elastic membrane area data of the intravascular ultrasound image.

[0068] In this embodiment, the lumen area curve is generated based on the lumen area data, and the corresponding external elastic membrane area curve is generated based on the external elastic membrane area data. The horizontal axis of the longitudinal cross-sectional view represents the frame number of the corresponding cross-sectional image. Similarly, the points on the lumen area curve and the external elastic membrane area curve in the fourth display area 4 correspond to the frame numbers of the longitudinal cross-sectional view.

[0069] Correspondingly, the point or target area displayed in the longitudinal section view may also be displayed in the fourth display area 4. In this embodiment, according to the preset threshold value selected by the user, for example, the threshold value may be set to a lumen area threshold value of less than 4 mm. 2 The target area of ​​the longitudinal section view corresponds to the 4mm that is less than the lumen area curve mark in the area view. 2 The principles of other thresholds are the same, which makes it easier for users to understand the abnormal data of the target blood vessels. For example, the display effect in the fourth display area 4 is that the area involving the lumen area threshold is displayed below the lumen area curve; the area involving the external elastic membrane area threshold is displayed above the external elastic membrane area curve; and the area involving the plaque load threshold is displayed in the area enclosed by the lumen area curve and the elastic membrane area curve, which makes it easier for users to view the area of ​​interest.

[0070] In one embodiment, the user interface further includes a fifth display area 5; the fifth display area 5 includes a tool module; the tool module is used to provide the user with buttons for performing relevant auxiliary marking and display in the user interface.

[0071] In this embodiment, the fifth display area 5 displays the system's tool module. Users can use the user interface's tool module to select tools to help mark and analyze target vessels. These tools include function buttons such as point tracing, tracing, measuring the length of a vessel of interest, labeling, boundary identification, and annotation. The user can use the Measure Vessel of Interest button to select a segment of a vessel on a coronary angiography image using relevant technologies to measure its length. The user can also use the Boundary Identification button to automatically identify the boundaries of the lumen area and external elastic area on the IVUS image in the third display area 1 using relevant technologies. The user can also use the Annotation button to add annotations to the current cross-sectional image. Furthermore, when using the system, the system can connect to other devices or systems via a network, such as angiography equipment, ultrasound equipment, and blood data collection systems. Users can create tasks for different patients and enter patient information, such as their name and ID number, in the tasks. After creating a task, the user can use the system's tasks to set corresponding data collection node projects for the patient, such as blood data analysis projects and ultrasound projects. Once the patient completes the node collection task, the system receives data uploaded by the corresponding collection node, such as IVUS image data. Users can also directly upload required data through the system. After creating a task, the system can also display the patient information to which the current task belongs in the fifth display area 5 .

[0072] In one embodiment, the user interface further includes a fifth display area 5; the fifth display area 5 includes a point drawing button; and the image processing module 102 is further configured to, when the point drawing button is activated, receive a user point drawing operation on the cross-sectional image. The point drawing operation is used to display the contour of interest of any region within the blood vessel in the cross-sectional image in the cross-sectional image of the third display area 1. For example, when a user needs to manually extract external elastic membrane area data and lumen area data from the cross-sectional image, the point drawing button can be used to manually mark multiple points.

[0073] In one embodiment, the fifth display area 5 includes a tracing button. The image processing module 102 is further configured to, when the tracing button is activated, receive a user tracing operation on the cross-sectional image. The tracing operation is used to display the outline of a region of interest (ROI) within any region of the blood vessel within the cross-sectional image of the third display area 1. For example, if a user needs to manually extract external elastic membrane area data and lumen area data from a cross-sectional image, the tracing button can be used to manually mark the selected movement trajectory. Both tracing and tracing operations can be implemented using relevant technologies; the difference between the two lies in the user operation and calculation methods.

[0074] In one embodiment, the fifth display area 5 includes a bookmark button;

[0075] Accordingly, the image processing module 102 is further configured to receive a marking operation from the user in the longitudinal cross-sectional view when the bookmark button is activated. The marking operation is used to mark a bookmark of interest at any point on the target blood vessel in the longitudinal cross-sectional view of the first display area 2. After the user marks the bookmark, the system may mark the bookmark in the first display area 2 and simultaneously display the blood vessel data corresponding to the bookmarked point.

[0076] In this embodiment, different marks need to use different colors or shapes for distinction.

[0077] The following combination Figure 2 and Figure 3 The present application is described in the following embodiments. Figure 3 This is a schematic diagram showing the rendering effect of a user interface of an intravascular ultrasound image marking system. Figure 2 and Figure 3 The content in the figure corresponds to the third display area 1 in the upper left corner, the first display area 2 in the upper middle, the second display area 3 in the bottom, and the fourth display area 4 in the middle, which represents the area view composed of the blood vessel data curve. Figure 3 The second curve in the fourth display area 4 below the coronary angiography and IVUS image represents the lumen area curve Lumen, which is a curve relatively close to the second display area 3; the first curve represents the extensible external elastic membrane area curve EEMA, which is a curve relatively close to the third display area 1 and the first display area 2; the block areas between the two curves are the vascular areas involved in two plaque thresholds greater than 50% and greater than 70%, respectively, where the dark color represents the second plaque threshold and the light color represents the first plaque threshold. At the same time, the view also marks that the total length of the vascular area involved in the first plaque threshold is 14.0 mm, and the total length of the vascular area involved in the second plaque threshold is 8.0 mm. The color block below the second curve is used to mark the vascular segment area involved in the lumen area threshold, such as when the lumen area threshold is less than 4 mm 2The length of the blood vessel is 6.0mm. This embodiment also chooses to synchronously mark the blood vessel area with the plaque load threshold (greater than 50%) in the coronary angiography image. The color of the mark in the image is the same as the color displayed in the third display area 1. In the entire display interface, color is combined with shape to distinguish each mark. Each mark has only one distinguishing point. For example, the mark involving the threshold is only different in color. In this embodiment, the two curves and the longitudinal section view are arranged in correspondence based on the serial number of the IVUS image sequence. On the basis of marking the above threshold and minimum lumen area through the curve display, the corresponding longitudinal section view of the target blood vessel is set below the curve. At the same time, the frames involved in the above threshold and minimum lumen area are marked accordingly in the longitudinal section view. In addition, in the longitudinal section view, the B1 and B2 positioning points set by the user through the positioning button are marked accordingly, and the vascular data of the minimum lumen area point of the target blood vessel in the figure is also marked, as shown in the figure. Figure 4 MLA2.03mm shown 2 , EEMA8.03mm 3 , Plaque80%, Figure 4 for Figure 3 The enlarged image of the area marked a, Figure 3 Below the IVUS cross-sectional image, the blood vessel data for the corresponding cross-sectional image for the point currently clicked by the user on the longitudinal section view is marked as LA5.03mm. 2 , EEMA8.03mm 3 , Plaque 30%.

[0078] Compared with the prior art, the method provided in the embodiments of the present application calculates vascular parameters based on the fusion analysis of coronary angiography images and intravascular ultrasound images, maps the specific position that reaches the specified threshold to the coronary angiography image for display, and marks the lesion area and the narrowest part of the coronary artery on the coronary angiography image. This combined display can provide more comprehensive and detailed information, can intuitively perform functional evaluation of coronary artery stenosis, guide stent selection, placement position and expansion degree in coronary intervention surgery, and help evaluate the treatment effect.

[0079] Figure 5 It is a structural diagram of an electronic device shown in an embodiment of the present application.

[0080] See also Figure 5 , an embodiment of the present application provides an electronic device 300 including a memory 301 and a processor 302.

[0081] The processor 302 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor.

[0082] The memory 301 may include various types of storage units, such as system memory, read-only memory (ROM), and permanent storage devices. Among them, ROM can store static data or instructions required by the processor 302 or other modules of the computer. The permanent storage device can be a readable and writable storage device. The permanent storage device can be a non-volatile storage device that does not lose the stored instructions and data even after the computer is powered off. In some embodiments, the permanent storage device uses a large-capacity storage device (such as a magnetic or optical disk, flash memory) as the permanent storage device. In other embodiments, the permanent storage device can be a removable storage device (such as a floppy disk, optical drive). The system memory can be a readable and writable storage device or a volatile readable and writable storage device, such as dynamic random access memory. The system memory can store some or all instructions and data required by the processor at runtime.

[0083] In addition, the memory 301 may include any combination of computer-readable storage media, including various types of semiconductor memory chips (e.g., DRAM, SRAM, SDRAM, flash memory, programmable read-only memory), and magnetic disks and / or optical disks may also be used. In some embodiments, the memory 301 may include a removable storage device that is readable and / or writable, such as a compact disc (CD), a read-only digital versatile disc (e.g., DVD-ROM, double-layer DVD-ROM), a read-only Blu-ray disc, an ultra-high-density optical disc, a flash memory card (e.g., SD card, mini SD card, Micro-SD card, etc.), a magnetic floppy disk, etc. Computer-readable storage media do not include carrier waves and transient electronic signals transmitted wirelessly or wired.

[0084] The memory 301 stores executable codes. When the executable codes are processed by the processor 302 , the processor 302 can execute part or all of the modules mentioned above.

[0085] In addition, the method according to the present application may also be implemented as a computer program or a computer program product, which includes computer program code instructions for executing some or all of the steps in the above method of the present application.

[0086] Alternatively, the present application can also be implemented as a computer-readable storage medium (or non-transitory machine-readable storage medium or machine-readable storage medium) on which executable code (or computer program or computer instruction code) is stored. When the executable code (or computer program or computer instruction code) is executed by a processor of an electronic device (or server, etc.), the processor executes part or all of the steps of the above-mentioned method according to the present application.

[0087] The embodiments of the present application have been described above. The above description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is selected to best explain the principles of the embodiments, their practical applications, or improvements to the technology in the market, or to enable other persons skilled in the art to understand the embodiments disclosed herein.

Claims

1. A marking system for intravascular ultrasound images, characterized in that: include: an image receiving module, configured to receive an intravascular ultrasound image of a target blood vessel and an angiography image of the target blood vessel; an image processing module, configured to extract lumen area data and external elastic membrane area data from the intravascular ultrasound image; A display module for displaying a user interface; the user interface includes a first display area and a second display area; the first display area is used to display the angiography image, and the second display area is used to display a longitudinal cross-sectional view corresponding to the intravascular ultrasound image; a marking module, configured to mark the angiographic image accordingly when a first marking operation on the longitudinal cross-sectional view is received; Or when a second marking operation on the angiography image is received, a corresponding mark is made on the longitudinal cross-sectional view.

2. The marking system according to claim 1, characterized in that The first marking operation includes: marking a target area on the longitudinal cross-sectional view according to a preset threshold; The preset threshold includes at least one of a lumen area threshold, an external elastic membrane area threshold, and a plaque load threshold; wherein the plaque load data is calculated based on the corresponding lumen area data and external elastic membrane area data.

3. The marking system according to claim 2, characterized in that Marking the target area in the longitudinal section view according to the preset threshold includes: using corresponding color identification on the longitudinal section view according to the preset threshold, respectively marking the target area that meets the corresponding preset threshold; each preset threshold has a unique color identification.

4. The marking system according to claim 3, characterized in that include: According to the preset threshold, a starting point and an ending point of a target area meeting the preset threshold are marked on the longitudinal cross-sectional view.

5. The marking system according to claim 3, characterized in that include: According to the target area in the longitudinal cross-sectional view, the length of the target blood vessel corresponding to the target area is marked in the longitudinal cross-sectional view.

6. The marking system according to claim 1, wherein: The user interface further includes a positioning button, which is used to receive a positioning point marked by a user on the target blood vessel in the angiography image when the positioning button is in an activated state, and mark the longitudinal cross-sectional view based on the positioning point; The second marking operation includes: the positioning button is in an activated state, receiving a positioning point marked by the user on the target blood vessel in the angiography image, and marking the longitudinal cross-sectional view based on the positioning point.

7. The marking system according to claim 1, characterized in that The marking module further includes: marking the position of the minimum lumen area of ​​the target blood vessel on the longitudinal cross-sectional view and the angiography image respectively according to the lumen area data of the intravascular ultrasound image.

8. The marking system according to claim 2, characterized in that The plaque load threshold includes a first plaque threshold and a second plaque threshold; the first plaque threshold is greater than the second plaque threshold.

9. The marking system according to claim 1, wherein: The user interface further includes a third display area for displaying a cross-sectional image of the intravascular ultrasound image.

10. The marking system according to claim 1, wherein: The user interface also includes a fourth display area for displaying an area view of the target blood vessel; the area view includes a lumen area curve and an external elastic force area curve; the lumen area curve is obtained based on the lumen area data of the intravascular ultrasound image; the external elastic force area curve is obtained based on the external elastic membrane area data of the intravascular ultrasound image.

Images