Image display method, computer device and storage medium
By acquiring and registering 2D and 3D medical images of the same patient, the problem of low efficiency in plaque analysis in existing technologies has been solved, and 2D and 3D images can be displayed simultaneously on the display interface, thereby improving the efficiency and accuracy of plaque analysis.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- SHANGHAI UNITED IMAGING HEALTHCARE
- Filing Date
- 2020-12-30
- Publication Date
- 2026-07-21
Smart Images
Figure CN114693688B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of medical image processing technology, and in particular to an image display method, computer device, and storage medium. Background Technology
[0002] High-resolution magnetic resonance imaging (HR-MRI) is a commonly used technique for the clinical diagnosis of carotid artery plaques, offering high spatial resolution and tissue contrast for displaying and evaluating carotid vascular plaques. In recent years, an increasing number of studies have applied HR-MRI to diagnose and analyze the characteristics of carotid artery plaques, such as intraplaque hemorrhage, fibrous cap, and lipid core. High-resolution "black blood" and "bright blood" 3D-TOF (3D time-of-flight) techniques not only increase the contrast between the vessel wall and lumen but also obtain information on the morphology and composition of carotid artery plaques, including measuring the total plaque volume, identifying plaque components (such as intraplaque hemorrhage, fibrous cap, and lipid core), and evaluating the lesion nature of the plaque (such as plaque rupture and fibrous cap rupture).
[0003] Different sequences under HR-MRI vessel wall examination are of great significance for plaque analysis. Routine examinations provide 2D or 3D sequences. 3D sequences can provide global information on the carotid or intracranial arteries, while 2D sequences are used for local imaging of the lesion-related layers, which can achieve higher intra-layer resolution and present local lesions more clearly.
[0004] However, for plaque analysis, the common clinical approach is to perform overall vascular morphology analysis and assessment on 3D sequences or plaque detail analysis on 2D sequences, which is extremely inefficient. Summary of the Invention
[0005] Therefore, it is necessary to provide an image display method, computer device, and storage medium capable of simultaneously displaying 2D and 3D sequence images to address the aforementioned technical problems.
[0006] In a first aspect, an image display method, the method comprising:
[0007] Acquire 2D and 3D medical images; the 2D and 3D medical images include the same vascular structure from the same patient;
[0008] The 2D sequence of medical images is segmented to obtain a first blood vessel cross-section;
[0009] The first blood vessel cross-section and the blood vessel structure in the 3D sequence medical image are registered to obtain the registered medical image;
[0010] The registered medical images are displayed.
[0011] In one embodiment, acquiring medical images of 2D and 3D sequences includes:
[0012] Medical images of the 3D sequence are obtained through scanning;
[0013] Vascular plaques are identified in the medical images of the 3D sequence to obtain localization information of the plaque layer;
[0014] The 2D sequence of medical images is obtained by scanning based on the positioning information.
[0015] In one embodiment, segmenting the medical image of the 2D sequence to obtain a first blood vessel cross-section includes:
[0016] The 2D sequence of medical images is segmented into blood vessels to obtain the segmentation results;
[0017] Based on the segmentation results, a first vascular cross-section perpendicular to the vascular centerline in the vascular structure is reconstructed.
[0018] In one embodiment, registering the first blood vessel cross-section with the vascular structure in the 3D sequence medical image to obtain a registered medical image includes:
[0019] The first blood vessel cross section is registered to the corresponding layer position on the blood vessel structure in the 3D sequence medical image to obtain the registered medical image.
[0020] In one embodiment, before displaying the registered medical image, the method further includes:
[0021] The first blood vessel cross-section in the registered medical image and the blood vessel structure in the 3D sequence medical image are fused to obtain a fused image;
[0022] The process of displaying the registered medical images also includes:
[0023] The fused image is displayed.
[0024] In one embodiment, registering the first blood vessel cross-section with the vascular structure in the 3D sequence medical image to obtain a registered medical image includes:
[0025] Based on the layer position corresponding to the first blood vessel cross-section, obtain the second blood vessel cross-section at the layer position corresponding to the blood vessel centerline of the blood vessel structure in the medical image of the 3D sequence.
[0026] The first and second blood vessel cross sections are registered, and the registered first and second blood vessel cross sections are registered to the corresponding layer positions on the blood vessel structure in the 3D sequence medical image to obtain the registered medical image.
[0027] In one embodiment, displaying the registered medical image includes:
[0028] The display interface shows the first blood vessel cross-section and the vascular structure in the 3D sequence medical image; a sliding flap is set on the center line of the blood vessel structure; the position of the first blood vessel cross-section is the same as the position of the sliding flap.
[0029] In one embodiment, the method further includes:
[0030] The display interface also shows the cross-section of the second blood vessel; the layer where the first blood vessel cross-section is located, the layer where the second blood vessel cross-section is located, and the layer where the slide is located are the same.
[0031] In a second aspect, an image display device, the device comprising:
[0032] An acquisition module is used to acquire 2D and 3D medical images; the 2D and 3D medical images include the same vascular structure of the same patient;
[0033] The segmentation module is used to segment blood vessels in the 2D sequence of medical images to obtain a first blood vessel cross-section;
[0034] The registration module is used to register the first blood vessel cross-section with the blood vessel structure in the 3D sequence medical image to obtain the registered medical image.
[0035] The display module is used to display the registered medical images.
[0036] Thirdly, a computer device includes a memory and a processor, the memory storing a computer program, and the processor executing the computer program to implement the above-described image display method.
[0037] Fourthly, a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the above-described image display method.
[0038] The aforementioned image display method, computer equipment, and storage medium acquire 2D and 3D medical images of the same vascular structure from the same patient. The 2D sequence image is segmented to obtain a first vascular cross-section. The first vascular cross-section and the vascular structure in the 3D sequence image are then registered to obtain a registered medical image. This method simultaneously displays the 2D sequence of the first vascular cross-section and the 3D sequence of the vascular structure on the same display interface. It shows the entire vascular structure in 3D and the vascular cross-section in 2D, including both the overall morphology and local information of the vascular structure. This provides doctors with sufficient and reliable reference data for subsequent plaque analysis based on the 3D and 2D images displayed on the interface, thereby improving the efficiency and accuracy of plaque analysis. Attached Figure Description
[0039] Figure 1 This is an internal structural diagram of a computer device in one embodiment;
[0040] Figure 2 This is a flowchart illustrating an image display method in one embodiment;
[0041] Figure 3 for Figure 2 A flowchart illustrating one implementation of S101 in the embodiment;
[0042] Figure 3A This is a schematic diagram showing the image of a 3D sequence in one embodiment;
[0043] Figure 3B This is a schematic diagram showing a 2D sequence of images in one embodiment;
[0044] Figure 4 for Figure 2 A flowchart illustrating one implementation of S102 in the embodiment;
[0045] Figure 5 This is a flowchart illustrating the image display method in one embodiment;
[0046] Figure 6 This is a schematic diagram showing the fused image in one embodiment;
[0047] Figure 7 for Figure 2 A flowchart illustrating one implementation of S103 in the embodiment;
[0048] Figure 8 This is a schematic diagram of the display interface in one embodiment;
[0049] Figure 9 This is a schematic diagram of the display interface in one embodiment;
[0050] Figure 10 This is a flowchart illustrating an image display method in one embodiment;
[0051] Figure 11 This is a schematic flowchart of an image display device in one embodiment;
[0052] Figure 12 This is a schematic flowchart of an image display device in one embodiment;
[0053] Figure 13 This is a schematic flowchart of an image display device in one embodiment;
[0054] Figure 14 This is a schematic flowchart of an image display device in one embodiment;
[0055] Figure 15 This is a schematic diagram of the image display device in one embodiment. Detailed Implementation
[0056] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.
[0057] The image display method provided in this application can be applied to, for example... Figure 1 The computer device shown can be a server or a terminal, and its internal structure diagram can be as follows. Figure 1 As shown, the computer device includes a processor, memory, network interface, display screen, and input devices connected via a system bus. The processor provides computing and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs stored in the non-volatile storage media. The network interface is used to communicate with external terminals via a network connection. When the computer program is executed by the processor, it implements an image display method. The display screen can be a liquid crystal display (LCD) or an e-ink display. The input devices can be a touch layer covering the display screen, buttons, a trackball, or a touchpad mounted on the computer device casing, or an external keyboard, touchpad, or mouse.
[0058] Those skilled in the art will understand that Figure 1The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the computer device to which the present application is applied. Specific computer devices may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.
[0059] In one embodiment, such as Figure 2 As shown, an image display method is provided, which is applied to... Figure 1 Taking a computer device as an example, the explanation includes the following steps:
[0060] S101, acquire 2D and 3D medical images; the 2D and 3D medical images include the same vascular structures of the same patient.
[0061] 2D medical images are two-dimensional medical images, including but not limited to T1, T2, and PD sequences. 3D medical images are three-dimensional medical images, including but not limited to TOF, CEMRA, T1, T2, and TICE sequences. Both 2D and 3D medical images can be MRI images acquired by magnetic resonance imaging (MRI) equipment. Vascular structures can include different types of blood vessels such as cerebral blood vessels, arteries, and veins.
[0062] In this embodiment, the MRI imaging device can perform 2D and 3D sequence scanning imaging of the patient's vascular lesion site. Optionally, the MRI imaging device can also perform 3D sequence scanning imaging of the patient's vascular lesion site first, followed by 2D sequence scanning imaging. Afterwards, the computer device reads the 2D and 3D sequence scan images from the MRI imaging device, i.e., medical images containing the same vascular structure of the same patient in 2D and 3D sequences. It should be noted that other types of imaging devices can also be used to scan the patient's vascular lesion site to obtain 2D and 3D sequence images; this is not limited here.
[0063] S102, Perform blood vessel segmentation on the 2D sequence of medical images to obtain the first blood vessel cross-section.
[0064] The first blood vessel cross-section can be a cross-section corresponding to a point on the blood vessel centerline in a 2D medical image sequence, or a cross-section corresponding to a plaque location in a 2D medical image sequence. The first blood vessel cross-section is perpendicular to the location of each point on the blood vessel centerline.
[0065] In this embodiment, when the computer device acquires a 2D sequence of medical images, it can extract a blood vessel cross-section perpendicular to the blood vessel centerline, i.e., the first blood vessel cross-section, from the 2D sequence of medical images. Optionally, the computer device can also input the 2D sequence of medical images into a pre-trained recognition network to obtain a blood vessel cross-section perpendicular to the blood vessel centerline, i.e., the first blood vessel cross-section.
[0066] Optionally, in the process of obtaining the first blood vessel cross-section through blood vessel segmentation, the computer device can first use a preset blood vessel segmentation network to segment the blood vessels in the 2D sequence medical image to obtain the segmented blood vessel structure. Then, the segmented blood vessel structure is further processed into a skeleton, and the blood vessel centerline can be obtained by using the endpoint logic of the blood vessel. Finally, a blood vessel cross-section of a specified size is cut along the blood vessel centerline on the 2D sequence medical image or on a cross-section perpendicular to the blood vessel centerline to obtain the first blood vessel cross-section. In one application, when using the above-mentioned blood vessel segmentation network to segment the blood vessels in the 2D sequence medical image, a global threshold and seed points can be calculated based on the input 2D sequence medical image, and then a region growing algorithm is used to obtain the segmented blood vessel structure. S103, the first blood vessel cross-section and the blood vessel structure in the 3D sequence medical image are registered to obtain a registered medical image.
[0067] In this embodiment, when the computer device acquires a first blood vessel cross-section, it can register the first blood vessel cross-section to the corresponding layer position of the blood vessel structure in the 3D sequence medical image; optionally, when the computer device acquires multiple first blood vessel cross-sections, each first blood vessel cross-section can be registered to the corresponding layer position of the blood vessel structure in the 3D sequence medical image. The registered medical image then includes: at least one first blood vessel cross-section and the blood vessel structure in the 3D sequence medical image.
[0068] Optionally, the above registration process may specifically include: first obtaining the patient coordinate system of the 2D sequence, and then obtaining the patient coordinate system of the 3D sequence. The patient coordinate system of the 3D sequence is used as the reference coordinate system, and the patient coordinate system of the 2D sequence is used as the calibration image coordinate system. A rigid registration matrix is obtained through these two coordinate systems. Based on the relationship of the rigid registration matrix, the corresponding 3D sequence slices of the 2D sequence are found. Vascular key points are identified in the corresponding slice region of the 3D sequence using a thresholding method to obtain uniformly distributed registration control points (RCPs). Then, the relationship between the obtained registration control points is used to determine the distortion model parameters. Approximation is performed using geometric distortion between images, and registration correction is performed to align the corresponding slices of the 2D sequence to the 3D sequence, completing the registration of the corresponding slice regions of the 2D and 3D sequences. Since the corresponding slices of the 2D sequence correspond to the first vascular cross-section, and the corresponding slice regions of the 3D sequence correspond to the medical image of the 3D sequence, the above registration method completes the registration of the vascular structure in the first vascular cross-section and the medical image of the 3D sequence.
[0069] S104 displays the registered medical image.
[0070] In this embodiment, when the computer device obtains the registered medical images based on the aforementioned steps, it can display all the registered medical images on the display interface according to a preset layout. The layout can be determined in advance by the computer device based on actual application requirements. Optionally, the computer device can also first extract the region of interest (ROI) image from the registered medical images, i.e., the lesion area that the doctor is interested in, and then directly display the ROI image on the display interface.
[0071] The image display method provided in the above embodiments acquires 2D and 3D medical images of the same vascular structure from the same patient. The 2D medical image is segmented to obtain a first vascular cross-section. The first vascular cross-section and the vascular structure in the 3D medical image are then registered to obtain a registered medical image. This method enables the simultaneous display of the first vascular cross-section in 2D and the vascular structure in 3D on the same display interface. It shows the entire vascular structure in 3D and the vascular cross-section in 2D, including the overall morphology and local information of the vascular structure. This provides doctors with sufficient and reliable reference data for subsequent plaque analysis based on the 3D and 2D images displayed on the interface, thereby improving the efficiency and accuracy of plaque analysis.
[0072] In one embodiment, this application provides an implementation of the above-described S101, such as... Figure 3 As shown, the above-mentioned S101 "acquiring medical images of 2D and 3D sequences" includes:
[0073] S201, Scan to acquire 3D sequence medical images.
[0074] In this embodiment, an MRI imaging device is used to perform 3D sequence scanning imaging of the patient's vascular lesion site (plaque area) according to 3D sequence scanning parameters, obtaining the overall structure of the vascular tissue and surrounding tissues at the vascular lesion site, such as... Figure 3A The 3D image shown contains the entire vascular structure.
[0075] S202, perform vascular plaque identification on 3D sequence medical images to obtain localization information of the plaque layer.
[0076] In this embodiment, after the computer device scans and obtains the 3D sequence of medical images, a preset recognition network can be used to identify vascular plaques in the vascular structures within the 3D sequence of medical images, identifying the location of the vascular plaque layer, i.e., the localization information of the plaque layer. Since the localization information of the plaque layer is the location information of the patient's vascular lesion, it is necessary to identify the location of the plaque layer so that doctors can perform disease analysis and diagnosis based on the vascular image at the location of the plaque layer. Optionally, the computer device can also identify stenosis regions in the vascular structures within the 3D sequence of medical images, identifying the location of the stenosis region, i.e., the localization information of the plaque layer. Since the stenosis region of a blood vessel can represent a plaque region, identifying the stenosis region of the blood vessel yields the location of the plaque region. It should be noted that the above-mentioned recognition network is a pre-trained network for identifying vascular plaque regions or stenosis regions. The specific structure of the recognition network can use a convolutional neural network or other machine learning networks, which are not limited here.
[0077] S203, scan and obtain 2D sequence medical images based on positioning information.
[0078] In this embodiment, when the computer device obtains the localization information of the plaque layer, it can further perform 2D sequence scanning imaging according to the scanning parameters of the 2D sequence and the localization information of the plaque layer to obtain the 2D layer structure of the plaque tissue and surrounding tissue at the vascular lesion site, such as... Figure 3B The 2D image shown includes the layered structure of blood vessels. The above embodiment enables one-click scanning and imaging of both 3D and 2D sequences, improving the efficiency of scanning and imaging.
[0079] In one embodiment, this application provides an implementation of the above-described S102, such as... Figure 4 As shown, the above-mentioned S102 "segmenting blood vessels in a 2D sequence of medical images to obtain a first blood vessel cross-section" includes:
[0080] S301, perform blood vessel segmentation on 2D sequence medical images to obtain segmentation results.
[0081] In this embodiment, after the computer device scans and obtains a 2D sequence of medical images, it can further use a preset segmentation network to segment the vascular centerline of the vascular structure in the 2D sequence of medical images, obtaining a segmentation result. The segmentation result includes the location of the vascular centerline. Optionally, during the vascular segmentation process, the computer device can first use a preset vascular segmentation network to segment the blood vessels in the 2D sequence of medical images, obtaining the segmented vascular structure, and then further perform skeletonization processing on the segmented vascular structure. Finally, the vascular centerline of the vascular structure can be obtained by using the endpoint logic of the blood vessel.
[0082] S302, Reconstruct the first blood vessel cross section perpendicular to the blood vessel centerline in the blood vessel structure based on the segmentation results.
[0083] Once the computer device obtains the segmentation results corresponding to the 2D sequence of medical images, it can further obtain the first cross-section of the blood vessel perpendicular to each point on the blood vessel centerline based on the location of the blood vessel centerline contained in the segmentation results. Specifically, in the acquisition process, a reconstruction algorithm can be used to reconstruct the first cross-section of the blood vessel based on the 2D layer image data corresponding to each point on the blood vessel centerline.
[0084] In one embodiment, this application provides an implementation of the above-mentioned S103, which "registers the first blood vessel cross section with the vascular structure of the 3D sequence medical image to obtain the registered medical image", specifically includes: registering the first blood vessel cross section to the corresponding layer position on the vascular structure in the 3D sequence medical image to obtain the registered medical image.
[0085] In this embodiment, when the computer device acquires the first blood vessel cross-section, since the first blood vessel cross-section is located in the plaque region of the entire blood vessel structure, it can be registered to the corresponding layer position of the blood vessel structure in the 3D sequence medical image. That is, the blood vessel structure in the 3D sequence medical image is positionally associated with the 2D first blood vessel cross-section, resulting in the registered 3D sequence blood vessel structure and the 2D first blood vessel cross-section at the corresponding layer position of the plaque region. The method described in this embodiment achieves the association between the 3D blood vessel structure and the 2D blood vessel cross-section, enabling the presentation of blood vessels based on the registered image to show the user both the overall morphology of the blood vessel structure and local information on the blood vessel cross-section.
[0086] Optionally, before executing S104 above, the computer device may, as follows: Figure 5 As shown, step S105 can also be performed:
[0087] S105, the first blood vessel cross section in the registered medical image and the blood vessel structure in the 3D sequence medical image are fused to obtain a fused image.
[0088] When the computer device obtains the entire vascular structure in the first vascular cross-section and the 3D sequence medical images based on the aforementioned embodiments, it can further employ a preset fusion algorithm to fuse the image data corresponding to the first vascular cross-section and the entire vascular structure to obtain a fused image. Optionally, when the computer device obtains the entire vascular structure in the first vascular cross-section and the 3D sequence medical images based on the aforementioned embodiments, it can further extract a first region of interest image from the first vascular cross-section image and a second region of interest image from the 3D sequence medical images, and then fuse the first region of interest image and the second region of interest image to obtain a fused image.
[0089] After obtaining the fused image based on step S105 Figure 2 In the embodiment, step S104, "displaying the registered medical image," includes displaying the fused image. That is, the image display method provided in this application can also display fused images.
[0090] In this embodiment, when the computer device obtains the fused image based on the aforementioned steps, it can display the fused image on the display interface according to a preset layout. The layout can be pre-determined by the computer device based on actual application requirements. Optionally, the computer device can also first extract the region of interest (ROI) fused image from the fused image and then directly display the ROI fused image on the display interface. After displaying the fused image, the computer device can support switching the first blood vessel cross-section in the fused image. Specifically, the computer device can receive user input switching operations (e.g., the user clicks on the desired switching position in the blood vessel structure of the fused image) and then display the first blood vessel cross-section of the sequence to be switched based on the switching operation. Figure 6 The fused image shown indicates that the intersection of the three-dimensional blood vessel and the two-dimensional cross-section is the location of the plaque. Based on this fused image, doctors can not only intuitively observe the location of the vascular plaque, but also analyze and observe it from different dimensions based on the location of the plaque, resulting in more accurate analysis results.
[0091] In one embodiment, this application provides another implementation of S103 above, such as... Figure 7 As shown, the above-mentioned S103 "registering the vascular structure in the first blood vessel cross-section and the 3D sequence medical image to obtain the registered medical image" includes:
[0092] S401, based on the layer position corresponding to the first blood vessel cross-section, obtain the second blood vessel cross-section at the layer position corresponding to the blood vessel centerline of the blood vessel structure in the 3D sequence medical image.
[0093] When the computer device obtains the first blood vessel cross-section, it can determine the corresponding layer position. Then, at that layer position, image data is extracted from the 3D sequence of medical images, and a second blood vessel cross-section is reconstructed based on this image data. It should be noted that when the first blood vessel cross-section is a single cross-section, one second blood vessel cross-section is generated; when the first blood vessel cross-section consists of multiple cross-sections, multiple second blood vessel cross-sections are generated.
[0094] S402, the first blood vessel cross section and the second blood vessel cross section are registered, and the registered first blood vessel cross section and the second blood vessel cross section are registered to the corresponding layer position on the blood vessel structure in the 3D sequence medical image to obtain the registered medical image.
[0095] Regardless of whether the first and second vessel cross-sections represent a single vessel or multiple vessel cross-sections, their layer positions must be consistent. Therefore, the first and second vessel cross-sections are registered, and then these registered cross-sections are aligned to their corresponding layer positions on the vascular structure in the 3D medical image sequence. This allows the vascular structure in the 3D medical image sequence to reflect the plaque region from its overall morphology, and also allows the first and second vessel cross-sections to reflect the plaque region from their local cross-sectional perspectives. This simultaneous reflection of the plaque region from both overall and local morphology facilitates the analysis and diagnosis of plaque lesions by physicians. Furthermore, since the first vessel cross-section reflects the detailed information of the 2D sequence's layered cross-section, while the second vessel cross-section reflects the information of the cross-section within the overall vascular structure in the 3D sequence, simultaneously displaying both the 2D and 3D vessel cross-sections on the display interface allows physicians to easily compare the overall and detailed structures later. This provides ample comparative data for the analysis and diagnosis of vascular diseases, improving the accuracy of physicians' analysis and diagnosis of vascular diseases.
[0096] In one embodiment, an implementation of the above-mentioned S104 is also provided, wherein the above-mentioned S104 "displays the registered medical image" specifically includes: displaying the vascular structure in the first blood vessel cross-section and the 3D sequence medical image on the display interface; setting a sliding sheet on the vascular centerline of the vascular structure; and the position of the first blood vessel cross-section and the position of the sliding sheet are consistent.
[0097] The slider can be a control, and its position can be preset by a computer device. The slider is displayed on the vascular structure in a 3D sequence of medical images, and its position corresponds to the layer containing the first vascular cross-section. For example... Figure 8 The diagram shows a display interface where the right column of images presents the vascular structure in a 3D medical image sequence, with a sliding plate A positioned on it; the left column of images presents the first cross-section of the blood vessel corresponding to the location of sliding plate A. Based on this display method, the computer device can also slide sliding plate A up and down along the blood vessel direction according to the doctor's operation instructions to display the corresponding blood vessel cross-sections at different positions of sliding plate A. This display method simultaneously presents both the 3D vascular structure sequence and the 2D blood vessel cross-sections, and also achieves the coordinated presentation of both.
[0098] Optionally, based on the above display method, there is another display method, which includes: displaying a second blood vessel cross-section on the display interface; the layer position where the first blood vessel cross-section is located, the layer position where the second blood vessel cross-section is located, and the layer position where the sliding plate is located are the same.
[0099] The display interface can show not only the vascular structure in the first cross-section and 3D sequence medical images of the blood vessel, but also the second cross-section of the blood vessel. For example... Figure 9 The schematic diagram of the display interface shown illustrates a 3D sequence of vascular structures in the right column, with a sliding plate A positioned on it. The first column from the left displays the second cross-section of the blood vessel at the location of sliding plate A, and the second column from the left displays the first cross-section of the blood vessel at the location of sliding plate A. Based on this display method, the computer device can also slide sliding plate A up and down along the blood vessel direction according to the doctor's operation instructions, thereby displaying the first and second cross-sections of the blood vessel at different positions of sliding plate A. This display method also presents the first and second cross-sections of the blood vessel at the corresponding layer of the sliding plate, as well as the linked display of the first and second cross-sections; that is, when the computer device slides the sliding plate according to the user's operation, the first and second cross-sections of the blood vessel are displayed in a corresponding manner at the layer corresponding to the sliding plate.
[0100] In summary, based on all the above embodiments, this application also provides an image display method, such as... Figure 10 As shown, the method includes:
[0101] S501, scan to acquire 3D sequence medical images.
[0102] S502 performs vascular plaque identification on 3D sequence medical images to obtain localization information at the plaque level.
[0103] S503, scan and acquire 2D sequence medical images based on positioning information.
[0104] S504 performs vascular segmentation on 2D medical images to obtain segmentation results.
[0105] S505, reconstruct the first blood vessel cross section perpendicular to the blood vessel centerline in the vascular structure based on the segmentation results.
[0106] S506, Register the first blood vessel cross section to the corresponding layer position on the blood vessel structure in the 3D sequence medical image to obtain the registered medical image.
[0107] S507, the first blood vessel cross section in the registered medical image and the blood vessel structure in the 3D sequence medical image are fused to obtain a fused image.
[0108] S508 displays the merged image on the display interface.
[0109] S509, the display interface shows the vascular structure in the first blood vessel cross-section and 3D sequence medical images; a sliding plate is set on the center line of the blood vessel structure; the position of the first blood vessel cross-section is consistent with the position of the sliding plate.
[0110] S510, based on the layer position corresponding to the first blood vessel cross-section, obtain the second blood vessel cross-section at the layer position corresponding to the blood vessel centerline of the blood vessel structure in the 3D sequence medical image.
[0111] S511, the first blood vessel cross section and the second blood vessel cross section are registered in position, and the registered first blood vessel cross section and the second blood vessel cross section are registered to the corresponding layer position on the blood vessel structure in the 3D sequence medical image to obtain the registered medical image.
[0112] S512, displays the vascular structure in the first vascular cross-section, the second vascular cross-section, and the 3D sequence medical images on the display interface; a sliding plate is set on the vascular centerline of the vascular structure; the layer positions of the first vascular cross-section, the second vascular cross-section, and the sliding plate are consistent.
[0113] The methods described in each of the above steps have been explained in the foregoing; please refer to the foregoing descriptions for details, which will not be repeated here. It should be noted that the layout of the vascular structure images in the fused image, the image of the first blood vessel cross-section, and the 3D sequence medical images on the display interface can be pre-determined by the computer equipment according to the actual application requirements.
[0114] It should be understood that, although Figure 2-10The steps in the flowchart are shown sequentially as indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order in which these steps are executed, and they can be performed in other orders. Figure 2-10 At least some of the steps in the process may include multiple steps or multiple stages. These steps or stages are not necessarily completed at the same time, but may be executed at different times. The execution order of these steps or stages is not necessarily sequential, but may be executed in turn or alternately with other steps or at least some of the steps or stages in other steps.
[0115] In one embodiment, such as Figure 11 As shown, an image display device is provided, comprising:
[0116] The acquisition module 11 is used to acquire 2D and 3D medical images; the 2D and 3D medical images include the same vascular structure of the same patient;
[0117] The segmentation module 12 is used to segment blood vessels in the 2D sequence of medical images to obtain a first blood vessel cross-section;
[0118] The registration module 13 is used to register the first blood vessel cross-section and the blood vessel structure in the 3D sequence medical image to obtain the registered medical image.
[0119] Display module 14 is used to display the registered medical images.
[0120] In one embodiment, such as Figure 12 As shown, the acquisition module 11 includes:
[0121] The first acquisition unit 111 is used to scan and acquire medical images of the 3D sequence;
[0122] The identification unit 112 is used to identify vascular plaques in the medical images of the 3D sequence to obtain the localization information of the plaque layer;
[0123] The second acquisition unit 113 is used to scan and acquire the medical image of the 2D sequence based on the positioning information.
[0124] In one embodiment, such as Figure 13 As shown, the above-mentioned segmentation module 12 includes:
[0125] The segmentation unit 121 is used to segment blood vessels in the 2D sequence of medical images to obtain segmentation results;
[0126] Reconstruction unit 122 is used to reconstruct a first blood vessel cross section perpendicular to the blood vessel centerline in the blood vessel structure based on the segmentation result.
[0127] In one embodiment, the registration module 13 is specifically used to register the first blood vessel cross section to the corresponding layer position on the blood vessel structure in the medical image of the 3D sequence, so as to obtain the registered medical image.
[0128] In one embodiment, such as Figure 14 As shown, the above-mentioned image display device further includes:
[0129] The fusion module 15 is used to fuse the first blood vessel cross section in the registered medical image and the blood vessel structure in the 3D sequence medical image to obtain a fused image;
[0130] The aforementioned display module 14 is specifically used to display the fused image.
[0131] In one embodiment, such as Figure 15 As shown, the registration module 13 includes:
[0132] The third acquisition unit 131 is used to acquire, based on the layer position corresponding to the blood vessel centerline of the blood vessel structure in the medical image of the 3D sequence, the second blood vessel cross-section at the layer position corresponding to the first blood vessel cross-section.
[0133] The registration unit 132 is used to register the first blood vessel cross section and the second blood vessel cross section in terms of position, and to register the registered first blood vessel cross section and the second blood vessel cross section to the corresponding layer position on the blood vessel structure in the medical image of the 3D sequence, so as to obtain the registered medical image.
[0134] In one embodiment, the display module 14 is specifically used to display the vascular structure in the first blood vessel cross-section and the medical image of the 3D sequence on the display interface; a sliding plate is provided on the center line of the blood vessel structure; the position of the first blood vessel cross-section is consistent with the position of the sliding plate.
[0135] In one embodiment, the above-mentioned display module 14 further displays the second blood vessel cross-section on the display interface; the layer position where the first blood vessel cross-section is located, the layer position where the second blood vessel cross-section is located, and the layer position where the sliding plate is located are the same.
[0136] For specific limitations regarding the image display device, please refer to the limitations on the image display method above, which will not be repeated here. Each module in the aforementioned image display device can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in hardware or independently of the processor in the computer device, or stored in software in the memory of the computer device, so that the processor can call and execute the operations corresponding to each module.
[0137] In one embodiment, a computer device is provided, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to perform the following steps:
[0138] Acquire 2D and 3D medical images; the 2D and 3D medical images include the same vascular structure from the same patient;
[0139] The 2D sequence of medical images is segmented to obtain a first blood vessel cross-section;
[0140] The first blood vessel cross-section and the blood vessel structure in the 3D sequence medical image are registered to obtain the registered medical image;
[0141] The registered medical images are displayed.
[0142] The computer device provided in the above embodiments has a similar implementation principle and technical effect to the above method embodiments, and will not be described again here.
[0143] In one embodiment, a computer-readable storage medium is provided having a computer program stored thereon, the computer program performing the following steps when executed by a processor:
[0144] Acquire 2D and 3D medical images; the 2D and 3D medical images include the same vascular structure from the same patient;
[0145] The 2D sequence of medical images is segmented to obtain a first blood vessel cross-section;
[0146] The first blood vessel cross-section and the blood vessel structure in the 3D sequence medical image are registered to obtain the registered medical image;
[0147] The registered medical images are displayed.
[0148] The computer-readable storage medium provided in the above embodiments has a similar implementation principle and technical effect to the above method embodiments, and will not be described again here.
[0149] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the methods described above. Any references to memory, storage, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, or optical storage, etc. Volatile memory can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM), etc.
[0150] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0151] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the invention patent. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this patent application should be determined by the appended claims.
Claims
1. An image display method, characterized in that, The method includes: Acquire 2D and 3D medical images; the 2D and 3D medical images include the same vascular structure of the same patient; the 3D medical images are used to display the overall structure of the blood vessel from a 3D dimension, and the 2D medical images are used to display the vascular cross-section of the vascular structure from a 2D level; The medical images of the 2D sequence are segmented to obtain segmentation results, and a first blood vessel cross-section perpendicular to the center line of the blood vessel structure is reconstructed based on the segmentation results; the first blood vessel cross-section is used to reflect the detailed information of the layer cross-section of the 2D sequence. The first blood vessel cross-section and the blood vessel structure in the 3D sequence medical image are registered to obtain a registered medical image; the registered medical image consists of a three-dimensional blood vessel structure and a two-dimensional cross-section, and the position of the plaque in the three-dimensional blood vessel structure in the registered medical image is associated with the position of the plaque at the corresponding layer position in the two-dimensional cross-section. The registered medical images are displayed.
2. The method according to claim 1, characterized in that, The acquisition of 2D and 3D sequence medical images includes: Medical images of the 3D sequence are obtained through scanning; Vascular plaques are identified in the medical images of the 3D sequence to obtain localization information of the plaque layer; The 2D sequence of medical images is obtained by scanning based on the positioning information.
3. The method according to claim 1 or 2, characterized in that, The first blood vessel is transverse The cross-section and the vascular structures in the medical image of the 3D sequence are registered to obtain the registered medical image, including: The first blood vessel cross section is registered to the corresponding layer position on the blood vessel structure in the 3D sequence medical image to obtain the registered medical image.
4. The method according to claim 3, characterized in that, Before displaying the registered medical image, the method further includes: The first blood vessel cross-section in the registered medical image and the blood vessel structure in the 3D sequence medical image are fused to obtain a fused image; The process of displaying the registered medical images also includes: The fused image is displayed.
5. The method according to claim 1 or 2, characterized in that, The first blood vessel is transverse The cross-section and the vascular structures in the medical image of the 3D sequence are registered to obtain the registered medical image, including: Based on the layer position corresponding to the first blood vessel cross-section, obtain the second blood vessel cross-section at the layer position corresponding to the blood vessel centerline of the blood vessel structure in the medical image of the 3D sequence. The first and second blood vessel cross sections are registered, and the registered first and second blood vessel cross sections are registered to the corresponding layer positions on the blood vessel structure in the 3D sequence medical image to obtain the registered medical image.
6. The method according to claim 3, characterized in that, The display of the registered medical images includes: The display interface shows the first blood vessel cross-section and the vascular structure in the 3D sequence medical image; a sliding flap is set on the center line of the blood vessel structure; the position of the first blood vessel cross-section is the same as the position of the sliding flap.
7. The method according to claim 5, characterized in that, The method further includes: The display interface shows the first blood vessel cross-section, the blood vessel structure in the 3D sequence medical image, and the second blood vessel cross-section; a sliding flap is provided on the center line of the blood vessel structure; the layer positions of the first blood vessel cross-section, the second blood vessel cross-section, and the sliding flap are the same.
8. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that, When the processor executes the computer program, it implements the steps of the method according to any one of claims 1 to 7.
9. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 7.