Heart function evaluation method, device, equipment and medium

Through the annotation and model correction of two-dimensional cardiac cavity ultrasound images, the problem of high cost of expensive equipment in cardiac function evaluation is solved, high-precision and convenient cardiac function evaluation is achieved, and the need to use expensive equipment is reduced.

CN119027372AActive Publication Date: 2024-11-26BINGJING INTELLIGENT MEDICAL TECHNOLOGY (BEIJING) CO LTD

Patent Information

Application Number
CN202410991833.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-23
Publication Date
2024-11-26
Estimated Expiration
2044-07-23

AI Technical Summary

Technical Problem

Prior art central function evaluation requires the use of expensive three-dimensional reconstruction equipment, resulting in high costs.

Method used

By obtaining the ultrasound image in the two-dimensional heart cavity, marking the three-dimensional spatial position of the ultrasound fan in the two-dimensional heart cavity, segmenting the heart anatomy, and correcting the size of the three-dimensional heart model based on multiple images to obtain a three-dimensional heart that matches the heart to be evaluated. model to facilitate and accurate assessment of cardiac function.

Benefits of technology

The use of expensive 3D reconstruction equipment is avoided, and high-precision 3D cardiac models are obtained, reducing costs, while achieving accurate assessment of cardiac function.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119027372A_ABST
    Figure CN119027372A_ABST
Patent Text Reader

Abstract

The embodiment of the invention provides a heart function evaluation method, device, equipment and medium, and relates to the technical field of image processing.The method comprises the steps that multiple two-dimensional intracardiac ultrasound images of a heart to be evaluated are obtained, and the three-dimensional space position of a two-dimensional intracardiac ultrasound sector is marked for each two-dimensional intracardiac ultrasound image; segmenting a heart anatomical structure in each two-dimensional intracardiac ultrasound image according to the marked three-dimensional space position of the two-dimensional intracardiac ultrasound sector; correcting the size of a corresponding heart tissue structure in the three-dimensional heart model according to a heart anatomical structure corresponding to the plurality of two-dimensional intracardiac ultrasound images to obtain a corrected three-dimensional heart model; and according to the related data of the corrected three-dimensional heart model, evaluating the function of the heart to be evaluated. According to the scheme, the high-precision three-dimensional heart model is obtained through image annotation and model correction, so that the cost can be reduced while the three-dimensional heart model of the heart to be evaluated can be accurately and conveniently obtained.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of image processing technology, and in particular to a cardiac function evaluation method, device, equipment and medium. Background Art

[0002] Cardiovascular disease is one of the major health threats worldwide, and early diagnosis and precise treatment are crucial to improving patient prognosis. Traditional cardiac clinical assessment methods include electrocardiogram, echocardiogram, and MRI. Although these methods provide rich information, they still have the limitation of not being able to fully display the complex three-dimensional structure and functional dynamics of the heart. In order to solve these problems, the application of three-dimensional heart models came into being. By integrating multiple data sources, it constructs a detailed three-dimensional cardiac structure and function model, providing a new perspective for clinical evaluation.

[0003] Currently, the main methods for three-dimensional reconstruction of the human heart include computed tomography (CT), magnetic resonance imaging (MRI), intracardiac (extracardiac) ultrasound based on magnetic positioning, etc. Although the three-dimensional modeling accuracy of these methods meets the needs of evaluating the heart model, they require the use of expensive three-dimensional modeling equipment, which makes the cost too high. Summary of the invention

[0004] In view of this, an embodiment of the present invention provides a method for evaluating cardiac function to solve the technical problem that the cardiac function evaluation scheme in the prior art requires the use of expensive three-dimensional reconstruction equipment, resulting in high costs. The method comprises:

[0005] Acquire multiple two-dimensional intracardiac ultrasound images of the heart to be evaluated, and mark the three-dimensional spatial position of the two-dimensional intracardiac ultrasound sector on each of the two-dimensional intracardiac ultrasound images;

[0006] Segmenting the cardiac anatomical structure in each of the two-dimensional intracardiac ultrasound images according to the three-dimensional spatial position of the marked two-dimensional intracardiac ultrasound sectors;

[0007] According to the cardiac anatomical structures corresponding to the plurality of two-dimensional intracardiac ultrasound images, correcting the size of the corresponding cardiac tissue structure in the three-dimensional cardiac model to obtain a corrected three-dimensional cardiac model;

[0008] The function of the heart to be evaluated is evaluated based on the relevant data of the modified three-dimensional heart model.

[0009] The embodiment of the present invention also provides a cardiac function assessment device to solve the technical problem that the cardiac function assessment scheme in the prior art requires the use of expensive three-dimensional reconstruction equipment, resulting in high costs. The device includes:

[0010] a labeling module, used for acquiring a plurality of two-dimensional intracardiac ultrasound images of the heart to be evaluated, and labeling the three-dimensional spatial position of the two-dimensional intracardiac ultrasound sector on each of the two-dimensional intracardiac ultrasound images;

[0011] An image processing module, configured to segment the cardiac anatomical structure in each of the two-dimensional intracardiac ultrasound images according to the three-dimensional spatial position of the annotated two-dimensional intracardiac ultrasound sectors;

[0012] A model correction module, used to correct the structural dimensions of the three-dimensional heart model according to the cardiac anatomical structures corresponding to the plurality of two-dimensional intracardiac ultrasound images, so as to obtain a corrected three-dimensional heart model;

[0013] An evaluation module is used to evaluate the function of the heart to be evaluated based on the relevant data of the modified three-dimensional heart model.

[0014] An embodiment of the present invention also provides a computer device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements any of the above-mentioned cardiac function evaluation methods when executing the computer program, so as to solve the technical problem that the cardiac function evaluation scheme in the prior art requires the use of expensive three-dimensional reconstruction equipment, resulting in high costs.

[0015] An embodiment of the present invention also provides a computer-readable storage medium storing a computer program for executing any of the above-mentioned cardiac function evaluation methods, so as to solve the technical problem that the cardiac function evaluation scheme in the prior art requires the use of expensive three-dimensional reconstruction equipment, resulting in high costs.

[0016] Compared with the prior art, the beneficial effects achieved by at least one of the above technical solutions adopted in the embodiments of this specification include at least: proposing to annotate the three-dimensional spatial position of the two-dimensional intracardiac ultrasound sector on the two-dimensional intracardiac ultrasound image, and then segmenting the cardiac anatomical structure in each of the two-dimensional intracardiac ultrasound images based on the three-dimensional spatial position of the annotated two-dimensional intracardiac ultrasound sector, and correcting the size of the corresponding cardiac structure in the three-dimensional heart model according to the cardiac anatomical structure corresponding to the plurality of the two-dimensional intracardiac ultrasound images, to obtain a corrected three-dimensional heart model, so as to obtain a three-dimensional heart model with the same tissue structure and size as the heart to be evaluated, and based on the relevant data of the corrected three-dimensional heart model, the cardiac function can be conveniently and accurately evaluated. By means of image annotation and model correction, a high-precision three-dimensional heart model with the same (or matching) tissue structure and size as the heart to be evaluated is obtained, avoiding the use of expensive three-dimensional reconstruction equipment such as computed tomography (CT), magnetic resonance imaging (MRI), and intracardiac (extracardiac) ultrasound based on magnetic positioning, so that the three-dimensional heart model of the heart to be evaluated can be accurately and conveniently obtained while reducing costs. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0018] Figure 1 is a flow chart of a cardiac function assessment method provided by an embodiment of the present invention;

[0019] Figure 2 is a schematic flow chart of a method for evaluating cardiac function provided by an embodiment of the present invention;

[0020] Figure 3 is a schematic diagram of a 3D Octree-like space of a heart model provided by an embodiment of the present invention;

[0021] Figure 4 It is a schematic diagram of a fan range in a 3D Octree-like space provided by an embodiment of the present invention;

[0022] Figure 5 is a schematic diagram of matching an intracardiac ultrasound two-dimensional image with a template contour provided by an embodiment of the present invention;

[0023] Figure 6 is a schematic diagram of segmenting a cardiac anatomical structure provided by an embodiment of the present invention;

[0024] Figure 7 It is a schematic diagram of a flow chart of performing function assessment of a heart during systole and diastole provided by an embodiment of the present invention;

[0025] Figure 8 is a structural block diagram of a computer device provided by an embodiment of the present invention;

[0026] Fig. 9 It is a structural block diagram of a cardiac function evaluation device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0027] The embodiments of the present application are described in detail below with reference to the accompanying drawings.

[0028] The following describes the implementation methods of the present application through specific examples, and those skilled in the art can easily understand other advantages and effects of the present application from the contents disclosed in this specification. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. The present application can also be implemented or applied through other different specific implementation methods, and the details in this specification can also be modified or changed in various ways based on different viewpoints and applications without departing from the spirit of the present application. It should be noted that, in the absence of conflict, the following embodiments and the features in the embodiments can be combined with each other. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without making creative work belong to the scope of protection of the present application.

[0029] In an embodiment of the present invention, a method for evaluating cardiac function is provided, such as Figure 1 As shown, the method includes:

[0030] Step S101: acquiring a plurality of two-dimensional intracardiac ultrasound images of the heart to be evaluated, and marking the three-dimensional spatial position of the two-dimensional intracardiac ultrasound sector on each of the two-dimensional intracardiac ultrasound images;

[0031] Step S102: segmenting the cardiac anatomical structure in each of the two-dimensional intracardiac ultrasound images according to the three-dimensional spatial position of the marked two-dimensional intracardiac ultrasound sectors;

[0032] Step S103: correcting the size of the corresponding cardiac tissue structure in the three-dimensional cardiac model according to the cardiac anatomical structures corresponding to the plurality of two-dimensional intracardiac ultrasound images to obtain a corrected three-dimensional cardiac model;

[0033] Step S104: evaluating the function of the heart to be evaluated based on the relevant data of the modified three-dimensional heart model.

[0034] Depend on Figure 1As can be seen from the process shown, in the embodiment of the present invention, it is proposed to annotate the three-dimensional spatial position of the two-dimensional intracardiac ultrasound sector on the two-dimensional intracardiac ultrasound image, and then segment the cardiac anatomical structure in each of the two-dimensional intracardiac ultrasound images based on the three-dimensional spatial position of the annotated two-dimensional intracardiac ultrasound sector, and correct the size of the corresponding cardiac structure in the three-dimensional heart model according to the cardiac anatomical structure corresponding to the plurality of the two-dimensional intracardiac ultrasound images, so as to obtain a three-dimensional heart model with the same (or matching) tissue structure and size as the heart to be evaluated, and the heart function can be conveniently and accurately evaluated based on the relevant data of the corrected three-dimensional heart model. By obtaining a high-precision three-dimensional heart model with the same tissue structure and size as the heart to be evaluated by image annotation and model correction, the use of expensive three-dimensional reconstruction equipment such as computed tomography (CT), magnetic resonance imaging (MRI), and intracardiac (extracardiac) ultrasound based on magnetic positioning is avoided, so that the three-dimensional heart model of the heart to be evaluated can be accurately and conveniently obtained while reducing costs.

[0035] When implementing it, Figure 2 As shown, it is necessary to obtain multiple two-dimensional intracardiac ultrasound images of the heart to be evaluated. In this process, multiple two-dimensional intracardiac ultrasound images of the heart to be evaluated can be read from an ultrasound device.

[0036] In specific implementation, the process of annotating the three-dimensional spatial position of the two-dimensional intracardiac ultrasound sector of each of the two-dimensional intracardiac ultrasound images can be achieved by any method that can achieve annotation. In order to improve the accuracy of annotation, a specific method for annotation based on the same three-dimensional heart model is also proposed. For example, a three-dimensional heart model that is compatible with the heart-related information of the heart to be evaluated is determined; a three-dimensional space is constructed for the determined three-dimensional heart model; each of the two-dimensional intracardiac ultrasound images is processed to obtain a contour image of the heart tissue; a preset sector is determined in the three-dimensional space, and the three-dimensional data of the preset sector is converted into two-dimensional data and matched with the contour image to obtain a matching area, wherein the preset sector includes the heart tissue structure in the contour image; according to the relevant position of the sector of the matching area in the three-dimensional space, the position of the two-dimensional intracardiac ultrasound sector in the two-dimensional intracardiac ultrasound image in the three-dimensional space is calibrated.

[0037] In specific implementation, the above-mentioned heart-related information can be any information related to the cardiac tissue structure, such as the size and shape of the heart. Specifically, the process of determining a heart model that matches the heart-related information can be a process of matching and selecting an existing 3D heart model in a database through the heart-related information.

[0038] In specific implementation, the process of processing each intracardiac ultrasound two-dimensional image to obtain the contour image of the heart tissue can be implemented by any method that can obtain a 2D contour image, and the entire image needs to be fully labeled, that is, the myocardial tissue and chambers on all ultrasound sectors are distinguished to display the information of the two-dimensional ultrasound heart tissue contour. For example, the traditional threshold segmentation algorithm can be used to process the image.

[0039] In a specific implementation, after obtaining the 2D contour image of the intracardiac ultrasound 2D image, in order to ensure the accuracy of the positioning calibration result, it is proposed that the 2D contour image can also be corrected before matching the 2D contour image with the data in the three-dimensional space to ensure the accuracy of the 2D contour image. For example, before the three-dimensional data of the preset sector is converted into two-dimensional data and matched with the contour image, the contour lines in the contour image are converted into polygons, and the vertices in the polygons are corrected to correct the contour image.

[0040] Specifically, it is possible to determine whether the 2D contour image is correct manually or by related software algorithms. If not, the 2D contour image can be corrected. During the correction process, the vertices in the polygon can be deleted, modified, and other correction operations can be performed to achieve the purpose of correcting and modifying the contour image.

[0041] In the specific implementation, after the three-dimensional heart model is determined, in order to accurately and conveniently obtain the position of the contour image in the 3D heart structure, a 3D class Octree space for constructing the heart model is proposed, such as Figure 3 As shown, the relevant sectors of the 3D Octree-like space of the heart model are then matched with the contour image to locate and calibrate the position of the contour image in the 3D Octree-like space of the heart model. Specifically, in the process of constructing the 3D Octree-like space of the heart model, the 3D Octree-like space can be directly constructed based on the heart model without distinguishing the depth. However, in order to improve the accuracy of matching, positioning and calibration, it is proposed to construct 3D Octree-like spaces of different depths for a determined heart model, wherein different levels of tissue structures of the heart model in the 3D Octree-like space have different depth values.

[0042] Specifically, the principle process of constructing 3D Octree-like spaces of different depths is to supplement the positions of other non-model voxels on the basis of the 3D structure constructed by the heart model voxels, and tissue structures of different depths correspond to different depth values, so that the positions of catheters and fans can be matched and located more finely and accurately based on different depth values.

[0043] Specifically, in the process of constructing 3D Octree-like spaces of different depths, the size and number of depth values ​​can be determined based on factors such as the tissue structure characteristics and size of the heart model and the accuracy requirements of positioning calibration. For example, the deeper the position of the tissue structure in the heart model, the larger the corresponding depth value; the more depth values ​​there are, the finer the 3D space of the tissue structure is divided and constructed, and thus the matching and positioning calibration positions are also finer and more accurate.

[0044] In the specific implementation, in order to improve the efficiency and accuracy of the matching process, it is proposed to first determine the preset sector in the 3D Octree space, such as Figure 4 As shown, the preset sector includes the cardiac tissue structure in the contour image, that is, the approximate target matching sector is first determined, and then the data of the preset sector is precisely matched with the contour image in a targeted manner to reduce the amount of matching calculations, increase the matching speed, and improve the matching accuracy.

[0045] In specific implementation, in order to further improve the accuracy of positioning and calibration, it is proposed to determine multiple preset sectors, take each preset sector as a template contour, convert the three-dimensional data of each template contour into two-dimensional data, match the two-dimensional data of each template contour with the contour image in the progressive order of depth information, and determine the template contour with the highest matching degree as the matching area. Figure 5 As shown, based on the relevant cardiac tissue structure in the intracardiac ultrasound two-dimensional image of Figure (a), the fan region including the corresponding cardiac tissue structure can be pre- and roughly determined in the 3D Octree-like space of the heart model, such as Figure 5 The dark sector area shown in Figure (b) has a central angle corresponding to the position of the catheter. Such a sector area can be used as a template contour to be finely matched with the contour image, and the template contour with the highest matching degree (such as similarity, etc.) is determined among multiple template contours.

[0046] In a specific implementation, in order to improve the accuracy of positioning and marking, after the three-dimensional data of each template contour is converted into two-dimensional data, the two-dimensional data of each template contour is matched with the contour image in a progressive order of depth information, that is, the two-dimensional data with the same depth value are matched with the contour image in sequence in a progressive order of depth information. For example, the depth values ​​of the 3D Octree space of the heart model include 1, 2, 3, etc. The deeper the tissue structure, the greater the depth value corresponding to the depth value. The two-dimensional data with a depth value of 1 is first matched with the contour image, and then the two-dimensional data with a depth value of 2 is matched with the contour image, and then the two-dimensional data with a depth value of 3 is matched with the contour image, and so on.

[0047] Specifically, in the process of locating and calibrating the two-dimensional intracardiac ultrasound sector by matching the contour image with the data of the 3D Octree-like space of the heart model, the vertex position of the sector of the matching area in the three-dimensional space (such as the 3D Octree-like space) is calibrated as the position of the sector corresponding to the two-dimensional intracardiac ultrasound image in the three-dimensional space, and the center position of the sector of the matching area in the three-dimensional space is calibrated as the position of the two-dimensional ultrasound catheter in the three-dimensional space.

[0048] In specific implementation, after obtaining the positioning calibration result, the positioning calibration result can also be corrected, for example, Figure 2 As shown, if the positions of the three points in the positioning and calibration results (the center of the sector and the points on the arc of the two radius sides) are judged to be inaccurate, the position of the moving catheter can be re-matched and repositioned to make slight adjustments to these three points to reach the ideal position.

[0049] In a specific implementation, when a certain number of two-dimensional intracardiac ultrasound images with annotated three-dimensional spatial positions are reached (for example, the number of annotated images of a heart is usually not less than 30), the size of the corresponding cardiac tissue structure in the three-dimensional heart model can be corrected according to the cardiac anatomical structure corresponding to the plurality of two-dimensional intracardiac ultrasound images to obtain a corrected three-dimensional heart model, so as to obtain a three-dimensional heart model that matches the structure and size of the heart to be evaluated. For example,

[0050] The pre-trained semantic segmentation model can be used to segment the various cardiac anatomical structures in the two-dimensional intracardiac ultrasound images with marked spatial positions, such as Figure 6 ( Figure 6 Figure (a) is a two-dimensional intracardiac ultrasound image with the spatial position marked. Figure 6 Figure (b) in the figure is the segmented cardiac anatomical structure), and then according to the size of the cardiac anatomical structure corresponding to each of the two-dimensional intracardiac ultrasound images, the size of the cardiac tissue structure matching the cardiac anatomical structure corresponding to each of the two-dimensional intracardiac ultrasound images in the three-dimensional cardiac model is adjusted in sequence by non-rigid registration (the structural size of the corresponding cardiac tissue structure in the three-dimensional cardiac model is adjusted to be consistent with the size of the cardiac anatomical structure in the ultrasound image, and the number of corrections to the three-dimensional cardiac model is the same as the number of annotated ultrasound images), to obtain the corrected three-dimensional cardiac model, wherein the latter correction is performed on the basis of the result of the previous correction of the three-dimensional cardiac model.

[0051] In a specific implementation, in order to further improve the accuracy of the revised three-dimensional heart model, it is proposed that for the model area in the three-dimensional heart model that does not match the cardiac anatomical structure corresponding to all the two-dimensional intracardiac ultrasound images, bilinear interpolation is performed on the model area according to the cardiac anatomical structure that matches the adjacent area of ​​the model area to obtain the revised three-dimensional heart model.

[0052] In specific implementation, after obtaining the revised three-dimensional heart model, the function of the heart to be evaluated can be evaluated based on the obtained revised three-dimensional heart model. For example, the relevant parameters of the heart function in the revised three-dimensional heart model are calculated, and the functional status of the heart to be evaluated is evaluated according to the relevant parameters of the heart function; the valve function of the heart to be evaluated is evaluated according to the valve structure in the revised three-dimensional heart model.

[0053] Specifically, algorithms and models can be used to identify and calculate the long axis length and short axis length of the left and right atria and ventricles, ejection fraction, mass index, volume, stress and other parameters related to cardiac function in the modified three-dimensional heart model, and the obtained index values ​​can be used to further evaluate the cardiac function. Algorithms and models can also be used to identify and check the valve structures such as whether there are defects in the mitral valve, tricuspid valve, atrial septum and ventricular septum in the modified three-dimensional heart model, and then evaluate the valve function of the heart.

[0054] In specific implementation, in order to facilitate the review and application of the above-mentioned cardiac function evaluation results, the evaluation results can be generated in the form of a report to provide a data basis for clinical intelligent auxiliary diagnosis; the evaluation results can also be used as the input of the neural network (i.e., sample data), and the real clinical diagnosis as the output (i.e., the label of the sample data), and these data can be trained to obtain more accurate cardiac function evaluation results.

[0055] In specific implementation, the following introduces the above cardiac function evaluation method by taking the cardiac function evaluation during systole and diastole as an example. Figure 7As shown, firstly, several frames of images in the systolic period and several frames of images in the diastolic period are selected from the ultrasound image (for example, images including the left atrial structure, images including the right atrial structure, images including the left ventricular structure, and images including the right ventricular structure), and the several frames of images in the systolic period and the several frames of images in the diastolic period are annotated in 3D space through a 3D annotation process, and the anatomical structures of the atria and ventricles of the heart are segmented in the image according to the annotation results, and then the sizes of the atria and ventricles in the existing 3D heart model are corrected based on the sizes of the anatomical structures of the atria and ventricles, so as to respectively create the atria and ventricles models in the systolic period and the diastolic period (according to the ultrasound images of the heart at different stages or periods). By modifying the existing three-dimensional heart model, a three-dimensional heart model that matches the heart at different stages or periods can be obtained, so that functional evaluation of the heart at different stages or periods can be realized), the systolic volume, systolic surface area, and circumference of a specific cross-section and other index data are measured in the atrial or ventricular systolic model, and the diastolic volume, diastolic surface area, and circumference of a specific cross-section and other index data are measured in the atrial or ventricular diastolic model. Then, functional indexes such as the ejection fraction, stress, volume index, and mass index of the atrial or ventricular heart can be calculated based on the measured index data. Finally, the function of each chamber in the heart can be evaluated through the functional indexes.

[0056] In this embodiment, a computer device is provided, such as Figure 8 As shown, it includes a memory 801, a processor 802, and a computer program stored in the memory and executable on the processor, and when the processor executes the computer program, any of the above-mentioned cardiac function assessment methods is implemented.

[0057] Specifically, the computer device may be a computer terminal, a server or a similar computing device.

[0058] In this embodiment, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores a computer program for executing any of the above-mentioned cardiac function assessment methods.

[0059] Specifically, computer-readable storage media include permanent and non-permanent, removable and non-removable media that can be used to store information by any method or technology. Information can be computer-readable instructions, data structures, program modules or other data. Examples of computer-readable storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, tape disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable storage media does not include temporary computer-readable media (transitory media), such as modulated data signals and carrier waves.

[0060] Based on the same inventive concept, an evaluation device for cardiac function is also provided in an embodiment of the present invention, as described in the following embodiments. Since the principle of solving the problem by the evaluation device for cardiac function is similar to that of the evaluation method for cardiac function, the implementation of the evaluation device for cardiac function can refer to the implementation of the evaluation method for cardiac function, and the repeated parts will not be repeated. As used below, the term "unit" or "module" can be a combination of software and / or hardware that implements a predetermined function. Although the device described in the following embodiments is preferably implemented in software, the implementation of hardware, or a combination of software and hardware, is also possible and conceived.

[0061] Fig. 9 is a structural block diagram of a cardiac function evaluation device according to an embodiment of the present invention. Fig. 9 As shown, the device comprises:

[0062] A labeling module 901 is used to obtain a plurality of two-dimensional intracardiac ultrasound images of the heart to be evaluated, and label the three-dimensional spatial position of the two-dimensional intracardiac ultrasound sector on each of the two-dimensional intracardiac ultrasound images;

[0063] An image processing module 902 is used to segment the cardiac anatomical structure in each of the two-dimensional intracardiac ultrasound images according to the three-dimensional spatial position of the annotated two-dimensional intracardiac ultrasound sectors;

[0064] A model correction module 903, configured to correct the structural dimensions of the three-dimensional heart model according to the cardiac anatomical structures corresponding to the plurality of two-dimensional intracardiac ultrasound images, to obtain a corrected three-dimensional heart model;

[0065] The evaluation module 904 is used to evaluate the function of the heart to be evaluated based on the relevant data of the modified three-dimensional heart model.

[0066] In one embodiment, a labeling module is used to determine a three-dimensional heart model that is compatible with the heart-related information of the heart to be evaluated; construct a three-dimensional space for the determined three-dimensional heart model; process each of the two-dimensional intracardiac ultrasound images to obtain a contour image of the heart tissue; determine a preset fan in the three-dimensional space, convert the three-dimensional data of the preset fan into two-dimensional data, and then match it with the contour image to obtain a matching area, wherein the preset fan includes the heart tissue structure in the contour image; and calibrate the position of the two-dimensional intracardiac ultrasound fan in the two-dimensional intracardiac ultrasound image in the three-dimensional space according to the relative position of the fan in the matching area in the three-dimensional space.

[0067] In one embodiment, the annotation module is used to construct 3D Octree-like spaces of different depths for the determined three-dimensional heart model, wherein different levels of organizational structures of the heart model in the 3D Octree-like space have different depth values.

[0068] In one embodiment, a labeling module is used to determine a plurality of preset sectors, take each of the preset sectors as a template contour, convert the three-dimensional data of each of the template contours into two-dimensional data, and then match the two-dimensional data of each of the template contours with the contour image in a progressive order of depth information, and determine the template contour with the highest matching degree as the matching area.

[0069] In one embodiment, the model correction module is used to adjust the sizes of the cardiac tissue structures in the three-dimensional heart model that match the cardiac anatomical structures corresponding to each of the two-dimensional intracardiac ultrasound images in sequence through a non-rigid registration method according to the sizes of the cardiac anatomical structures corresponding to each of the two-dimensional intracardiac ultrasound images, so as to obtain the corrected three-dimensional heart model, wherein the latter correction is performed on the basis of the results of the previously corrected three-dimensional heart model.

[0070] In one embodiment, the model correction module is also used to perform bilinear interpolation on the model area in the three-dimensional heart model that does not match the cardiac anatomical structure corresponding to all the two-dimensional intracardiac ultrasound images, based on the cardiac anatomical structure that matches the adjacent area of ​​the model area, to obtain the corrected three-dimensional heart model.

[0071] In one embodiment, the evaluation module is used to calculate the relevant parameters of the cardiac function in the revised three-dimensional heart model, and evaluate the functional condition of the heart to be evaluated based on the relevant parameters of the cardiac function; and evaluate the valve function of the heart to be evaluated based on the valve structure in the revised three-dimensional heart model.

[0072] The embodiment of the present invention achieves the following technical effects: it proposes to annotate the three-dimensional spatial position of the two-dimensional intracardiac ultrasound sector on the two-dimensional intracardiac ultrasound image, and then segment the cardiac anatomical structure in each of the two-dimensional intracardiac ultrasound images based on the three-dimensional spatial position of the annotated two-dimensional intracardiac ultrasound sector, and correct the size of the corresponding cardiac structure in the three-dimensional heart model according to the cardiac anatomical structure corresponding to the plurality of the two-dimensional intracardiac ultrasound images to obtain a corrected three-dimensional heart model, so as to obtain a three-dimensional heart model with the same tissue structure and size as the heart to be evaluated, and the heart function can be conveniently and accurately evaluated based on the relevant data of the corrected three-dimensional heart model. By means of image annotation and model correction, a high-precision three-dimensional heart model with the same (or matching) tissue structure and size as the heart to be evaluated is obtained, avoiding the use of expensive three-dimensional reconstruction equipment such as computed tomography (CT), magnetic resonance imaging (MRI), and intracardiac (extracardiac) ultrasound based on magnetic positioning, so that the three-dimensional heart model of the heart to be evaluated can be accurately and conveniently obtained while reducing costs.

[0073] Obviously, those skilled in the art should understand that the modules or steps of the above-mentioned embodiments of the present invention can be implemented by a general computing device, they can be concentrated on a single computing device, or distributed on a network composed of multiple computing devices, and optionally, they can be implemented by a program code executable by a computing device, so that they can be stored in a storage device and executed by the computing device, and in some cases, the steps shown or described can be executed in a different order from that here, or they can be made into individual integrated circuit modules, or multiple modules or steps therein can be made into a single integrated circuit module for implementation. In this way, the embodiments of the present invention are not limited to any specific combination of hardware and software.

[0074] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the embodiments of the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A method for evaluating cardiac function, characterized in that: include: Acquire multiple two-dimensional intracardiac ultrasound images of the heart to be evaluated, and mark the three-dimensional spatial position of the two-dimensional intracardiac ultrasound sector on each of the two-dimensional intracardiac ultrasound images; Segmenting the cardiac anatomical structure in each of the two-dimensional intracardiac ultrasound images according to the three-dimensional spatial position of the marked two-dimensional intracardiac ultrasound sectors; According to the cardiac anatomical structures corresponding to the plurality of two-dimensional intracardiac ultrasound images, correcting the size of the corresponding cardiac tissue structure in the three-dimensional cardiac model to obtain a corrected three-dimensional cardiac model; The function of the heart to be evaluated is evaluated based on the relevant data of the modified three-dimensional heart model.

2. The cardiac function evaluation method according to claim 1, characterized in that: Using the same three-dimensional heart model to mark the three-dimensional spatial position of the two-dimensional intracardiac ultrasound sector on each of the two-dimensional intracardiac ultrasound images includes: Determine a three-dimensional heart model that matches the heart-related information of the heart to be evaluated; constructing a three-dimensional space for the determined three-dimensional heart model; Processing each of the two-dimensional intracardiac ultrasound images to obtain a contour image of the heart tissue; Determine a preset sector in the three-dimensional space, convert the three-dimensional data of the preset sector into two-dimensional data, and then match it with the contour image to obtain a matching area, wherein the preset sector includes the cardiac tissue structure in the contour image; The position of the two-dimensional intracardiac ultrasound sector in the two-dimensional intracardiac ultrasound image in the three-dimensional space is calibrated according to the relative position of the sector of the matching area in the three-dimensional space.

3. The cardiac function evaluation method according to claim 1, characterized in that: Constructing a three-dimensional space for the determined three-dimensional heart model, including: A 3D Octree-like space of different depths is constructed for the determined three-dimensional heart model, wherein different levels of tissue structures of the heart model in the 3D Octree-like space have different depth values.

4. The method for evaluating cardiac function according to claim 3, wherein: Converting the three-dimensional data of the preset sector into two-dimensional data and matching it with the contour image comprises: Determine a plurality of preset sectors, take each of the preset sectors as a template contour, convert the three-dimensional data of each template contour into two-dimensional data, match the two-dimensional data of each template contour with the contour image in a progressive order of depth information, and determine the template contour with the highest matching degree as the matching area.

5. The method for evaluating cardiac function according to any one of claims 1 to 4, characterized in that: According to the cardiac anatomical structures corresponding to the plurality of two-dimensional intracardiac ultrasound images, the size of the corresponding cardiac tissue structure in the three-dimensional cardiac model is corrected to obtain a corrected three-dimensional cardiac model, including: According to the size of the cardiac anatomical structure corresponding to each of the two-dimensional intracardiac ultrasound images, the sizes of the cardiac tissue structures in the three-dimensional heart model that match the cardiac anatomical structure corresponding to each of the two-dimensional intracardiac ultrasound images are adjusted in sequence through a non-rigid registration method to obtain the corrected three-dimensional heart model, wherein the latter correction is performed on the basis of the result of the previous corrected three-dimensional heart model.

6. The cardiac function evaluation method according to claim 5, characterized in that: Also includes: For a model area in the three-dimensional heart model that does not match the cardiac anatomical structure corresponding to all the two-dimensional intracardiac ultrasound images, bilinear interpolation is performed on the model area based on the cardiac anatomical structure matched by adjacent areas of the model area to obtain the corrected three-dimensional heart model.

7. The method for evaluating cardiac function according to any one of claims 1 to 4, characterized in that: Evaluating the function of the heart to be evaluated according to the relevant data of the modified three-dimensional heart model, including: Calculating relevant parameters of cardiac function in the modified three-dimensional cardiac model, and evaluating the functional condition of the heart to be evaluated according to the relevant parameters of cardiac function; The valve function of the heart to be evaluated is evaluated according to the valve structure in the corrected three-dimensional heart model.

8. A cardiac function assessment device, characterized in that: include: a labeling module, used for acquiring a plurality of two-dimensional intracardiac ultrasound images of the heart to be evaluated, and labeling the three-dimensional spatial position of the two-dimensional intracardiac ultrasound sector on each of the two-dimensional intracardiac ultrasound images; An image processing module, configured to segment the cardiac anatomical structure in each of the two-dimensional intracardiac ultrasound images according to the three-dimensional spatial position of the annotated two-dimensional intracardiac ultrasound sectors; A model correction module, used to correct the structural dimensions of the three-dimensional heart model according to the cardiac anatomical structures corresponding to the plurality of two-dimensional intracardiac ultrasound images, so as to obtain a corrected three-dimensional heart model; An evaluation module is used to evaluate the function of the heart to be evaluated based on the relevant data of the modified three-dimensional heart model.

9. A computer device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the cardiac function evaluation method according to any one of claims 1 to 7 is implemented.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program for executing the cardiac function evaluation method according to any one of claims 1 to 7.

Citation Information

Patent Citations

  • Method for constructing three-dimensional heart model based on ultrasonic imaging

    CN110807829A

  • Heart segmentation quality assessment method, device, and equipment, and storage medium

    CN113222996A

  • Intracardiac ultrasonic imaging system with real-time three-dimensional reconstruction function and imaging method

    CN114983476A

  • Method and apparatus for overlaying medical images included the region of the heart

    KR1020150115438A

  • Automatic Cardiac Functional Assessment Using Ultrasonic Cardiac Images

    US20110262018A1

Cited By

  • Method, system and device for evaluating right ventricular function, medium and product

    CN121904043A

  • A method, system, device, medium, and product for assessing right ventricular function

    CN121904043B