Generation method of actual form model of target part and ultrasonic imaging system
By generating a three-dimensional actual morphological model of the aortic root and using the B-spline interpolation algorithm to set control points on the ultrasound image and the three-dimensional template model, the problem of obscure and difficult-to-understand ultrasound reports is solved, improving the efficiency of communication between doctors and patients and the accuracy of multidisciplinary consultations.
Patent Information
- Application Number
- CN202411110526.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-06-20
- Publication Date
- 2025-12-23
AI Technical Summary
In existing technologies, the textual descriptions in ultrasound reports are often obscure and difficult to understand, leading to low communication efficiency between doctors and patients. Hand-drawn diagrams are time-consuming and laborious, making it difficult to accurately describe the aortic root lesions of complex diseases, which affects multidisciplinary consultations and patient understanding.
By acquiring a three-dimensional template model and ultrasound image of the aortic root, control points are set on the ultrasound image and three-dimensional template model using the B-spline interpolation algorithm, deformation is calculated, and an actual morphological model of the patient's aortic root is generated and displayed with ultrasound image.
It improves the efficiency of communication between doctors and patients, provides intuitive lesion information, simplifies the description of complex diseases, reduces the time and skill requirements for hand-drawn diagrams, and supports the accuracy of multidisciplinary consultations.
Smart Images

Figure CN121176955A_ABST
Abstract
Description
[0001] This application is a divisional application of the invention patent application filed on June 20, 2024, with application number 202410795980.2 and invention title "A method and apparatus for generating an actual morphological model of the aortic root". Technical Field
[0002] This invention relates to the field of medical engineering technology, specifically to a method and apparatus for generating an actual morphological model of the aortic root. Background Technology
[0003] In real clinical practice, many patients suffer from extremely complex diseases, unlike the single diseases presented in textbooks. These diseases are often a combination of multiple lesions with diverse variations.
[0004] Multidisciplinary team (MDT) consultation is the most effective way to treat complex diseases. However, since examination reports are mostly textual descriptions, the textual descriptions of complex diseases are often obscure and difficult to understand. They do not easily describe the specific situation of the lesions or deformities caused by complex diseases, making it difficult for doctors to establish a clear relationship with clinical anatomy. In addition, patients generally lack clinical knowledge and proper consultation, and are prone to fear of some complex diseases. This often leads to inadequate communication in MDT and may cause misdiagnosis.
[0005] Taking the aortic root as an example, it is a common site for cardiovascular diseases and a frequently examined area in echocardiography. Currently, after a patient undergoes relevant ultrasound examinations, the sonographer generates an ultrasound report for the clinician. The clinician then uses the report for multidisciplinary consultations or to explain the condition to the patient and their family. In this process, the ultrasound report plays a crucial role as a medium of communication between the sonographer, clinician, and patient. However, ultrasound reports often contain only obscure text and ultrasound images, and understanding the images requires ultrasound experience. When explaining a condition to patients or less experienced doctors, it is difficult for them to obtain comprehensive information from the ultrasound report. Therefore, doctors often draw a schematic diagram of the aortic root structure by hand, referencing the ultrasound images, to facilitate more efficient multidisciplinary consultations or to provide patients with a more intuitive understanding of their condition. However, manual drawing requires a high level of drawing skill from the doctor and is time-consuming and labor-intensive, reducing communication efficiency between doctors and between doctors and patients. Summary of the Invention
[0006] To address the aforementioned problems, this invention proposes a method and apparatus for generating an actual morphological model of the aortic root, which will be described in detail below.
[0007] According to the first aspect, one embodiment provides a method for generating an actual morphological model of the aortic root, comprising:
[0008] Obtain a three-dimensional template model of the aortic root;
[0009] Acquire ultrasound images of the patient about the aortic root in at least one long-axis section;
[0010] For each major axis section of the ultrasound image:
[0011] The structural contour of the aortic root in the corresponding long axis section is obtained from the ultrasound image;
[0012] According to a first rule, multiple first control points are set on the structural contour of the ultrasound image based on B-spline interpolation. The first rule includes: dividing the aortic root into multiple sub-anatomical structures on the ultrasound image, and generating multiple control points for each sub-anatomical structure based on the control point generation rule associated with the sub-anatomical structure to obtain multiple first control points.
[0013] Obtain the cross-sectional shape on the long axis section corresponding to the ultrasound image on the three-dimensional template model, and determine the structural contour of the cross-sectional shape;
[0014] According to a second rule, multiple second control points are set on the structural contour of the cross-sectional shape based on B-spline interpolation. The second rule includes: dividing the aortic root into multiple sub-anatomical structures on the cross-sectional shape, and generating multiple control points for each sub-anatomical structure based on the control point generation rule associated with that sub-anatomical structure to obtain multiple second control points; wherein, the multiple sub-anatomical structures of the second rule correspond one-to-one with the multiple sub-anatomical structures of the first rule, and the control point generation rules associated with the corresponding two sub-anatomical structures are the same in the first rule and the second rule, so that the multiple first control points and the multiple second control points form a one-to-one correspondence about the aortic root at the anatomical structural position points;
[0015] Based on a plurality of first control points on the structural contour of the ultrasound image, the deformation of each second control point corresponding to the structural contour of the cross-sectional shape is calculated to obtain the deformation calculated based on the ultrasound image.
[0016] Based on the deformation calculated from each ultrasound image, the three-dimensional template model is deformed to generate the actual morphological model of the patient's aortic root.
[0017] In one embodiment, acquiring the structural contour of the aortic root on the corresponding long axis section of the ultrasound image includes:
[0018] Identify multiple structural feature measurement items;
[0019] Determine the location of each structural feature measurement item on the ultrasound image;
[0020] The structural outline is generated based on the points mentioned above using an interpolation algorithm.
[0021] In one embodiment, dividing the aortic root into multiple sub-anatomical structures on the ultrasound image includes:
[0022] Identify multiple structural feature measurement items;
[0023] Determine the location of each structural feature measurement item on the ultrasound image;
[0024] The aortic root is divided on the ultrasound image by the points mentioned above, resulting in multiple sub-anatomical structures.
[0025] In one embodiment, the plurality of the structural feature measurements include: valve annulus diameter, sinus maximum diameter, sinus duct junction diameter, and aortic duct diameter.
[0026] In one embodiment, the plurality of said subanatomical structures include: a subanatomical structure defined by the line of the valve annulus diameter, the line of the sinus maximum diameter, and the structural contour between the two; a subanatomical structure defined by the line of the sinus maximum diameter, the line of the sinus duct junction diameter, and the structural contour between the two; and a subanatomical structure defined by the line of the sinus duct junction diameter, the line of the aortic diameter, and the structural contour between the two.
[0027] In one embodiment, the control point generation rule includes: each sub-anatomical structure includes a relative first contour and a second contour, the first contour and the second contour being partial contours on the structural contour, and generating a number of control points associated with the sub-anatomical structure at equal intervals on the first contour and the second contour of each sub-anatomical structure, such that the control points on the first contour and the second contour of the same sub-anatomical structure correspond one-to-one.
[0028] In one embodiment, acquiring ultrasound images of the patient with respect to the aortic root in at least one long-axis section includes: acquiring corresponding ultrasound images of the patient with respect to the aortic root in two different long-axis sections, wherein the angle between the two different long-axis sections is 90 degrees.
[0029] In one embodiment, the generation method further includes:
[0030] At least one of the ultrasound images is placed on the long axis section corresponding to the actual morphological model to synthesize the actual morphological model with ultrasound images, and the actual morphological model with ultrasound images is displayed.
[0031] In response to a display operation on the actual morphological model with ultrasound images, the actual morphological model with ultrasound images is subjected to display processing; wherein the display operation includes one or more of zooming in, zooming out, and rotating.
[0032] According to a second aspect, one embodiment provides a method for generating an actual morphological model of the aortic root, comprising:
[0033] Obtain a three-dimensional template model of the aortic root;
[0034] Acquire ultrasound images of the patient about the aortic root in at least one long-axis section;
[0035] For each major axis section of the ultrasound image:
[0036] The structural contour of the aortic root in the corresponding long axis section is obtained from the ultrasound image;
[0037] Multiple first control points are obtained on the structural contour of the ultrasound image using a B-spline interpolation algorithm. The aortic root is divided into multiple first sub-anatomical structures on the ultrasound image. Each first sub-anatomical structure includes a relative first contour and a second contour. The first contour and the second contour are partial contours on the structural contour. Multiple control points are equidistantly set on the first contour and the second contour of each first sub-anatomical structure, and the control points on the first contour and the second contour of the same first sub-anatomical structure correspond one-to-one to form multiple first control points.
[0038] The B-spline interpolation algorithm is used to obtain the cross-sectional shape on the major axis of the ultrasound image on the three-dimensional template model, and the structural contour of the cross-sectional shape is determined.
[0039] Multiple second control points are obtained on the structural contour of the cross-sectional shape, wherein the aortic root is divided into multiple second sub-anatomical structures on the cross-sectional shape. Each second sub-anatomical structure includes a first contour and a second contour, the first contour and the second contour of the second sub-anatomical structure being partial contours on the structural contour of the cross-sectional shape. Multiple control points are equidistantly arranged on the first contour and the second contour of each second sub-anatomical structure, and the control points on the first contour and the second contour of the same second sub-anatomical structure correspond one-to-one to form multiple second control points. The multiple second sub-anatomical structures correspond one-to-one with the multiple first sub-anatomical structures, so that the multiple first control points and the multiple second control points form a one-to-one correspondence with the aortic root at the anatomical structural position points.
[0040] Based on a plurality of first control points on the structural contour of the ultrasound image, the deformation of each second control point corresponding to the structural contour of the cross-sectional shape is calculated to obtain the deformation calculated based on the ultrasound image.
[0041] Based on the deformation calculated from each ultrasound image, the three-dimensional template model is deformed to generate the actual morphological model of the patient's aortic root.
[0042] According to a third aspect, one embodiment provides an apparatus for generating an actual morphological model of the aortic root, comprising:
[0043] Memory, used to store programs;
[0044] A processor is configured to implement a method for generating an actual morphological model of the aortic root as described in any embodiment herein by executing a program stored in the memory.
[0045] According to the above-described method and apparatus for generating an actual morphological model of the aortic root, multiple first control points are set on the structural contour of the ultrasound image based on B-spline interpolation according to a first rule, and multiple second control points are set on the structural contour of the cross-sectional shape according to a second rule. Multiple sub-anatomical structures of the second rule correspond one-to-one with multiple sub-anatomical structures of the first rule, and the control point generation rules associated with the corresponding two sub-anatomical structures are the same in both the first and second rules. This ensures that multiple first control points and multiple second control points form a one-to-one correspondence regarding the anatomical location of the aortic root. This limits the need for the corresponding points of the same sub-anatomical structures to overlap one-to-one on the ultrasound image and on the cross-sectional shape corresponding to the three-dimensional template model, constraining the deformation of the three-dimensional template model. Under this constraint, the three-dimensional template model, after deformation, can more closely approximate the actual model shape of the current patient regarding the target area. Attached Figure Description
[0046] Figure 1 A flowchart illustrating a method for generating an actual morphological model of a target region according to one embodiment;
[0047] Figure 2 This is a flowchart illustrating how to obtain the structural contour of a target region on a corresponding long axis section of an ultrasound image in one embodiment.
[0048] Figure 3(a) is an example of obtaining the structural contour of the aortic root on the corresponding long axis section of an ultrasound image in one embodiment; Figure 3(b) is an example of determining the location of each structural feature measurement item on an ultrasound image and generating the structural contour in one embodiment.
[0049] Figure 4This is a flowchart illustrating how a target region is divided into multiple sub-anatomical structures on an ultrasound image in one embodiment.
[0050] Figure 5 This is a schematic diagram illustrating the uniform grouping and segmentation of mesh control points on a three-dimensional template model in one embodiment.
[0051] Figure 6 A flowchart illustrating a method for generating an actual morphological model of a target region according to one embodiment;
[0052] Figure 7 This is a schematic diagram showing an actual morphological model with ultrasound images in one embodiment;
[0053] Figure 8 This is a schematic diagram showing the actual morphological model with ultrasound image displayed after rotation in one embodiment.
[0054] Figure 9 This is a schematic diagram of the structure of an ultrasound imaging system according to one embodiment;
[0055] Figure 10 This is a schematic diagram of the structure of a device for generating an actual morphological model of the aortic root according to one embodiment. Detailed Implementation
[0056] The present invention will now be described in further detail with reference to specific embodiments and accompanying drawings. Similar elements in different embodiments are referred to by associated similar element reference numerals. In the following embodiments, many details are described to facilitate a better understanding of this application. However, those skilled in the art will readily recognize that some features may be omitted in different situations, or may be replaced by other elements, materials, or methods. In some cases, certain operations related to this application are not shown or described in the specification. This is to avoid obscuring the core parts of this application with excessive description. For those skilled in the art, detailed description of these related operations is not necessary; they can fully understand the related operations based on the description in the specification and general technical knowledge in the art.
[0057] Furthermore, the features, operations, or characteristics described in the specification can be combined in any suitable manner to form various embodiments. At the same time, the steps or actions in the method description can be rearranged or adjusted in a manner obvious to those skilled in the art. Therefore, the various orders in the specification and drawings are only for the clear description of a particular embodiment and do not imply a necessary order, unless otherwise stated that a particular order must be followed.
[0058] The serial numbers assigned to components in this document, such as "first" and "second," are used only to distinguish the described objects and have no sequential or technical meaning. The terms "connection" and "linkage" used in this application, unless otherwise specified, include both direct and indirect connections (linkages).
[0059] Including the aortic root, many lesions in patients involve complex structures. Diagnosing lesions using ultrasound images requires doctors to have considerable experience to clearly establish the relationship between ultrasound images and parameters and clinical anatomy. Furthermore, some complex diseases, due to their intricate physiological and anatomical relationships, make it difficult to describe the specific location of lesions or malformations, leading to inadequate communication within the multidisciplinary team (MDT) and potentially causing misdiagnosis. In addition, medical reports (such as ultrasound reports) are mostly textual descriptions, which can be difficult to understand for complex diseases, hindering doctors' ability to educate patients about the disease.
[0060] In some cases, doctors describe the disease by hand-drawing the anatomical structure of the lesion in the target area. However, hand-drawing requires a high level of drawing skills and knowledge of different diseases, and the process is also very time-consuming. Very few doctors can draw descriptions of complex diseases.
[0061] To address the aforementioned issues, this application proposes a method for generating an actual morphological model of the target region, which is described in detail below.
[0062] Please refer to Figure 1 Some embodiments provide a method for generating an actual shape model of a target region, including the following steps:
[0063] Step 110: Obtain the 3D template model of the target area.
[0064] There are several ways to obtain a 3D template model of a target area. For example, one can collect 3D ultrasound data of the target area from any normal person and convert it into a 3D mesh model using relevant algorithms; another example is collecting CT data (Computed Tomography) of the target area from any normal person and converting it into a 3D mesh model using relevant algorithms; yet another example is creating a 3D template model of the target area through 3D modeling. These 3D template models can be 3D mesh models with uniformly distributed mesh points; each mesh in the 3D mesh model is filled with a facet, and texture information can be filled into the facet.
[0065] Step 120: Acquire ultrasound images of the patient about the target site in at least one long axis section.
[0066] In some embodiments, step 120 acquires corresponding ultrasound images of the patient about the target site on two different long-axis sections, wherein the angle between the two different long-axis sections is 90 degrees.
[0067] In some embodiments, the target site includes the aortic root.
[0068] In some embodiments, at least one long-axis section of the aortic root may include one or more of the parasternal long-axis section of the great artery, the apical five-chamber section, and the apical three-chamber section.
[0069] In some embodiments, when step 120 acquires an ultrasound image of the patient about the aortic root in at least one long-axis section, the ultrasound image may be an ultrasound image obtained by a physician using a two-dimensional transthoracic probe or a transesophageal probe.
[0070] Step 130: For each major axis section ultrasound image, use the B-spline interpolation algorithm to obtain multiple first control points of the structural contour of the target region on the corresponding major axis section. This will be explained in detail below.
[0071] In some embodiments, for each long-axis section of the ultrasound image, step 130 obtains the structural contour of the target part on the corresponding long-axis section of the ultrasound image, and further obtains a plurality of first control points on the structural contour of the ultrasound image.
[0072] In some examples, in response to a user’s drawing operation on an ultrasound image, step 130 obtains the structural contour of the target region on the corresponding long axis section of the ultrasound image.
[0073] The drawing operation can be performed by the user drawing the outline of the target area on the ultrasound image. Alternatively, the user can select multiple points on the ultrasound image, and step 130 uses a B-spline interpolation algorithm to generate the structural outline based on these multiple points.
[0074] Please refer to Figure 2 In some examples, step 130, acquiring the structural contour of the target region on the corresponding long axis section of the ultrasound image, may also include:
[0075] Step 131: Determine multiple structural feature measurement items.
[0076] Step 132: Determine the location of each structural feature measurement item on the ultrasound image.
[0077] Step 133: Generate the above structural contour based on the above points using the B-spline interpolation algorithm.
[0078] Multiple pre-defined structural feature measurement items can be determined based on the target part itself; different target parts correspond to different multiple structural feature measurement items; or the user can select multiple structural feature measurement items for the target part.
[0079] Taking the aortic root as an example, the structural features of the aortic root can be measured in one or more of the following: valve annulus diameter, sinus maximum diameter, sinus-duct junction diameter, and aortic canal diameter. Furthermore, the points on the ultrasound image where the valve annulus diameter is located refer to the two endpoints of the valve annulus diameter; the points where the sinus maximum diameter is located refer to the two endpoints of the sinus maximum diameter; the points where the sinus-duct junction diameter is located refer to the two endpoints of the sinus-duct junction diameter; and the points where the aortic canal diameter is located refer to the two endpoints of the aortic canal diameter. After obtaining these points, algorithms such as B-strip interpolation can be used to generate curve profiles between adjacent points, thereby obtaining the overall structural profile.
[0080] Figure 3(a) shows an example of obtaining the structural contour of the aortic root on the corresponding long axis section in an ultrasound image; Figure 3(b) shows an example of determining the location of each structural feature measurement item and generating the structural contour in an ultrasound image. In the figure, 01 represents the valve annulus diameter, 02 represents the maximum sinus diameter, 03 represents the diameter of the sinus-canal junction, 04 represents the diameter of the aortic canal, and the black solid dots represent the above-mentioned locations.
[0081] Step 130: After obtaining the structural contour of the target site on the corresponding long axis section of the ultrasound image, further obtain multiple first control points on the structural contour of the ultrasound image.
[0082] In some embodiments, the target area is divided into multiple sub-anatomical structures (referred to as first sub-anatomical structures) on the ultrasound image. Each first sub-anatomical structure includes a first contour and a second contour, which are partial contours on the structural contour. Multiple control points are equidistantly arranged on the first contour and the second contour of each first sub-anatomical structure, and the control points on the first contour and the second contour of the same first sub-anatomical structure correspond one-to-one to form multiple first control points.
[0083] In some embodiments, step 130 sets multiple first control points on the structural contour of the ultrasound image according to a first rule, wherein the first rule includes: dividing the target area into multiple sub-anatomical structures (e.g., multiple first sub-anatomical structures) on the ultrasound image, and generating multiple control points for each sub-anatomical structure based on the control point generation rule associated with the sub-anatomical structure to obtain multiple first control points.
[0084] Please refer to Figure 4In some examples, step 130 divides the target site into multiple sub-anatomical structures on the ultrasound image, including:
[0085] Step 135: Determine multiple structural feature measurement items.
[0086] Step 136: Determine the location of each structural feature measurement item on the ultrasound image.
[0087] Step 137: Divide the target area on the ultrasound image using the above points to obtain multiple sub-anatomical structures.
[0088] Multiple pre-defined structural feature measurement items can be determined based on the target part itself; different target parts correspond to different multiple structural feature measurement items; or the user can select multiple structural feature measurement items for the target part.
[0089] Taking the aortic root as an example, the target area can include one or more of the following structural features: valve annulus diameter, sinus maximum diameter, sinus-duct junction diameter, and aortic canal diameter. Furthermore, the points on the ultrasound image where the valve annulus diameter is located refer to the two endpoints of the valve annulus diameter; the points where the sinus maximum diameter is located refer to the two endpoints of the sinus maximum diameter; the points where the sinus-duct junction diameter is located refer to the two endpoints of the sinus-duct junction diameter; and the points where the aortic canal diameter is located refer to the two endpoints of the aortic canal diameter. After obtaining these points, the target area is divided using these points to obtain multiple sub-anatomical structures. For example, sub-anatomical structures defined by the lines of the valve annulus diameter, the sinus maximum diameter, and the structural contours between them; sub-anatomical structures defined by the lines of the sinus maximum diameter, the sinus-duct junction diameter, and the structural contours between them; and sub-anatomical structures defined by the lines of the sinus-duct junction diameter, the aortic canal diameter, and the structural contours between them.
[0090] In some examples, the above control point generation rules include: each sub-anatomical structure (e.g., the first sub-anatomical structure) includes a relative first contour and a second contour, the first contour and the second contour being partial contours on the structural contour, and generating a number of control points equidistant from the first contour and the second contour on each sub-anatomical structure such that the control points on the first contour and the second contour on the same sub-anatomical structure correspond one-to-one.
[0091] Taking Figure 3(b) as an example, the contour of the aortic root is grouped using the locations of multiple structural feature measurements. This results in three parts: the contour between the valve annulus diameter and the maximum sinus diameter, the contour between the maximum sinus diameter and the sinus-duct junction, and the contour from the sinus-duct junction to the aortic canal. The grouped contours can be distinguished as upper and lower contours. In other words, the first contour of each first sub-anatomical structure is a portion of the upper contour in Figure 3(b), and the second contour is a portion of the lower contour in Figure 3(b). Thus, the first contours of all first sub-anatomical structures constitute the overall upper contour of the figure, and the second contours of all first sub-anatomical structures constitute the overall lower contour of the figure (there are two dashed lines in the figure; the upper dashed line is the upper contour, and the lower dashed line is the lower contour). Then, on the first and second contours of each sub-anatomical structure, a number of control points associated with that sub-anatomical structure are generated at equal intervals, ensuring a one-to-one correspondence between the control points on the first and second contours of the same sub-anatomical structure.
[0092] Step 140: Using the B-spline interpolation algorithm on the 3D template model, obtain the cross-sectional shape on the major axis section corresponding to the ultrasound image, and obtain multiple second control points on the structural contour of the cross-sectional shape. This will be explained in detail below.
[0093] In some embodiments, step 140 uses a B-spline interpolation algorithm on the three-dimensional template model to obtain the cross-sectional shape on the long axis section corresponding to the ultrasound image, determines the structural contour of the cross-sectional shape, and obtains multiple second control points on the structural contour of the cross-sectional shape.
[0094] In some embodiments, the target region is divided into multiple sub-anatomical structures (let's call them second sub-anatomical structures) in terms of cross-sectional shape. Each second sub-anatomical structure includes a corresponding first contour and a second contour. The first and second contours of the second sub-anatomical structure are partial contours on the structural contours of the cross-sectional shape. Multiple control points are equidistantly arranged on the first and second contours of each second sub-anatomical structure, and the control points on the first and second contours of the same second sub-anatomical structure correspond one-to-one, thus forming multiple second control points. The multiple second sub-anatomical structures correspond one-to-one with the multiple first sub-anatomical structures, so that the multiple first control points and the multiple second control points form a one-to-one correspondence regarding the target region's position points in the anatomical structure. It can be understood that the corresponding first and second sub-anatomical structures essentially refer to the same sub-anatomical structure of the target region. In this case, the first contours of the corresponding first and second sub-anatomical structures are also corresponding, and the second contours of the corresponding first and second sub-anatomical structures are also corresponding.
[0095] In some embodiments, step 140 sets multiple second control points on the structural contour of the cross-section shape according to a second rule. The second rule includes: dividing the target part into multiple sub-anatomical structures (e.g., multiple second sub-anatomical structures) on the cross-section shape, and generating multiple control points for each sub-anatomical structure based on the control point generation rule associated with that sub-anatomical structure to obtain multiple second control points. The multiple sub-anatomical structures of the second rule correspond one-to-one with the multiple sub-anatomical structures of the first rule, and the control point generation rules associated with the two corresponding sub-anatomical structures are the same in the first rule and the second rule, so that the multiple first control points and the multiple second control points form a one-to-one correspondence regarding the target part's position on the anatomical structure.
[0096] In some examples, the above control point generation rules include: each sub-anatomical structure (e.g., the second sub-anatomical structure) includes a relative first contour and a second contour, the first contour and the second contour being partial contours on the structural contour, and generating a number of control points associated with the sub-anatomical structure at equal intervals on the first contour and the second contour of each sub-anatomical structure, such that the control points on the first contour and the second contour of the same sub-anatomical structure correspond one-to-one.
[0097] Step 150: Calculate the deformation points based on the first control point and the second control point.
[0098] In some embodiments, step 150 calculates the deformation of each second control point on the structural contour of the cross-section shape based on multiple first control points on the structural contour of the ultrasound image, thereby obtaining the deformation calculated based on the ultrasound image.
[0099] Step 160: Deform the 3D template model based on deformation.
[0100] In some embodiments, step 160 deforms the three-dimensional template model based on the deformation calculated from each ultrasound image to generate an actual morphological model of the patient's target area.
[0101] Taking the target area, including the aortic root, as an example, in the example shown in Figure 3(b), several points are selected at equal intervals on the upper and lower contours of each grouped sub-anatomical structure (for example, 16 points are selected at equal intervals on the upper contour between the valve annulus diameter and the maximum sinus diameter, and 16 points are selected at equal intervals on the lower contour; other parts are selected according to the same rule), and they are sorted from left to right and numbered 1-16, so that the point numbered 1 on the upper contour corresponds to the point numbered 1 on the lower contour, the point numbered 2 on the upper contour corresponds to the point numbered 2 on the lower contour, and so on. The deformation of the three-dimensional template model is to deform the long axis section contour of the three-dimensional template model to be consistent with the structural contour of the aortic root on the long axis section of the ultrasound, so that the three-dimensional model obtained after deformation is more realistic, which can be called the actual morphological model. This requires uniformly grouping control points on a 3D template model. Then, the long axis section is used to section the 3D template model, obtaining the intersection points of the 3D template model and the long axis section of the aortic root. These are the contour points of the aortic root model on the long axis section (i.e., the structural contour of the cross-sectional shape on the 3D template model corresponding to the ultrasound image on the long axis section). The number of these contour points is consistent with and corresponds one-to-one with the number of the first control points determined on the ultrasound image. Next, the 3D template model is deformed so that the second control points on the model on the long axis section coincide with the first control points on the ultrasound long axis section. In some examples, uniformly grouping control points on the 3D template model only needs to be done once; this process does not need to be repeated for different patients.
[0102] In some examples, mesh control points are uniformly grouped and set on the 3D template model. The specific steps may be as follows: Figure 5 As shown, based on clinical experience, the three-dimensional basic model is divided into leaflets, sinus, and aortic canal. The grid points on the leaflets are evenly distributed at equal intervals along the model surface. The figure shows the long axis direction, 05 represents the valve annulus, which defines the leaflets, 06 represents the sinus, 07 represents the sinus-canal junction, and 08 represents the ascending aorta. The sinus can be divided into two parts: from the valve annulus to the maximum diameter of the sinus and from the maximum diameter of the sinus to the sinus-canal junction. These two parts are further divided into several layers at equal intervals along the long axis direction (the number of layers is consistent with the number of upper and lower contour control points of the sinus in the ultrasound image), with 60 points in each layer, evenly distributed along the model surface. Similarly, the aortic canal is also divided into 16 layers along the long axis direction (the number of layers is consistent with the number of upper and lower contour control points of the aortic canal in the ultrasound image), with 60 points in each layer, evenly distributed along the model surface.
[0103] To obtain the intersection points between the aortic root model and the long axis section, the specific steps are as follows: The ultrasound technician selects a section on the 3D model as the long axis section based on experience. Using the previously uniformly set grid control points of the sinus and aortic canal, the intersection points are layer by layer with the long axis section. The contour formed by the intersection points is similar to and coplanar with the aortic root contour in the ultrasound section, and the number of intersection points is consistent with the first control point on the ultrasound section contour. Therefore, it is not necessary to calculate the intersection points between the valve leaflets and the long axis section. Each layer of intersection points is then mapped one-to-one with the first control point on the ultrasound section contour. For example, the two intersection points on the first layer of the sinus in the 3D model correspond to the two control points numbered 1 on the upper and lower contours of the sinus on the ultrasound section, and so on for other areas.
[0104] The specific steps for deforming a 3D template model can be as follows:
[0105] (1) Align the long axis section (section shape) of the three-dimensional template model with the ultrasound image of the corresponding long axis section. This can be achieved by translating and rotating the entire model so that the long axis section of the model and the long axis section of the ultrasound coincide.
[0106] (2) Leaflet deformation: First, calculate the ratio of the annulus diameter on the ultrasound image to the annulus diameter on the three-dimensional template model, and scale the leaflet according to the calculated ratio; then translate the leaflet so that one of the two annulus control points on the long axis section of the model is aligned with the lower (upper) contour control point of the annulus on the ultrasound section; finally, rotate the leaflet with the straight line passing through the alignment point and perpendicular to the long axis section as the axis of rotation so that the other annulus control point on the long axis section of the model is aligned with the upper (lower) contour control point of the annulus on the ultrasound section.
[0107] (3) Deformation of the sinus and aortic tube: Using the correspondence between the control points of each layer on the sinus and aortic tube constructed above and the contour points of the ultrasound section, calculate the ratio of the distance between the two intersection points of the first layer on the sinus of the three-dimensional template model to the distance between the two control points of the sinus number 1 on the upper and lower contours of the ultrasound section. Scale the coordinates of all control points on the first layer of the sinus model according to this ratio so that the distance between the two intersection points of the first layer on the sinus of the three-dimensional template model is equal to the distance between the two control points of the sinus number 1 on the upper and lower contours of the ultrasound section. Then translate all control points of the first layer so that a certain control point of the first layer on the long axis section is aligned with the lower (upper) contour control point of number 1 on the ultrasound section. Finally, rotate all control points of the first layer with the straight line passing through the alignment point and perpendicular to the long axis section as the rotation axis so that another control point of the first layer on the long axis section is aligned with the upper (lower) contour control point of number 1 on the ultrasound section. Deformation of each layer on the sinus and aortic tube is performed according to the above operation.
[0108] This completes the deformation of the three-dimensional template model, resulting in a more realistic model of the aortic root, which is the actual morphological model of the patient's aortic root.
[0109] In this application, when deforming the three-dimensional template model, the target area in the ultrasound image is divided into multiple sub-anatomical structures. Multiple first control points are generated for the first and second contours of each sub-anatomical structure. This makes the deformation of the three-dimensional template model constrained by multiple sub-anatomical structures, such as control points at both ends of the valve annulus diameter, control points at both ends of the sinus maximum diameter, control points at both ends of the sinus duct junction diameter, and control points at both ends of the aortic duct diameter. That is, the control points at both ends of the valve annulus diameter need to coincide one-to-one with the corresponding cross-sectional shape in the ultrasound image and the three-dimensional template model. Similarly, the control points at both ends of the sinus maximum diameter need to coincide one-to-one with the corresponding cross-sectional shape in the ultrasound image and the corresponding cross-sectional shape in the three-dimensional template model. The cross-sectional shapes corresponding to the three-dimensional template model need to coincide one by one. The control points at both ends of the diameter of the sinus junction need to coincide one by one in the ultrasound image and in the cross-sectional shape corresponding to the three-dimensional template model. The control points of the aortic diameter need to coincide one by one in the ultrasound image and in the cross-sectional shape corresponding to the three-dimensional template model. In other words, the corresponding points of the same sub-anatomical structures on the ultrasound image and in the cross-sectional shape corresponding to the three-dimensional template model need to coincide one by one to constrain the deformation of the three-dimensional template model. Under this constraint, the three-dimensional template model can be made closer to the actual model shape of the current patient for the target site after deformation.
[0110] Please refer to Figure 6 In some embodiments, the method for generating the actual morphological model of the aortic root further includes step 170 displaying the actual morphological model.
[0111] In some embodiments, step 170 may include placing at least one ultrasound image on the long axis section corresponding to the actual morphological model to synthesize an actual morphological model with ultrasound images, and displaying the actual morphological model with ultrasound images. Figure 7 Here is an example.
[0112] Furthermore, the actual morphological model with ultrasound images can be displayed in response to a display operation on the actual morphological model with ultrasound images; wherein the display operation includes one or more of zooming in, zooming out, and rotating. Figure 8 As an example, users can rotate and zoom in on the model to observe the actual shape from different angles.
[0113] It should be noted that the ultrasound images discussed in this article are obtained using ultrasound imaging technology, which uses ultrasound waves to scan human tissues and organs and obtains images of the corresponding areas by receiving and processing the reflected signals.
[0114] For example Figure 9As an example of an ultrasound imaging system 100, the ultrasound imaging system 100 may include an ultrasound probe 10, a transmit and receive control circuit 20, and a processor 30; in some embodiments, the ultrasound imaging system 100 may also include a display 40, and the components are described below.
[0115] In some embodiments, the ultrasound probe 10 is used to emit ultrasonic waves and receive echo signals from the ultrasonic waves. In some specific embodiments, the ultrasound probe 10 includes multiple array elements for converting electrical pulse signals and ultrasonic waves into each other, thereby emitting ultrasonic waves towards a target area and receiving ultrasonic echoes reflected back from the tissue to obtain ultrasonic echo signals. In some embodiments, the multiple array elements included in the ultrasound probe 10 can be arranged in a row to form a linear array. In some embodiments, the multiple array elements included in the ultrasound probe 10 are arranged in a two-dimensional matrix to form a planar array. The array elements, for example, use piezoelectric crystals to convert electrical signals into ultrasonic signals according to the emission sequence transmitted by the transmit and receive control circuit 20. Depending on the application, the emitted ultrasonic waves (ultrasonic signals) may include one or more scanning pulses, one or more reference pulses, one or more driving pulses, and / or one or more Doppler pulses. Depending on the wave morphology, ultrasonic signals include focused waves, plane waves, and divergent waves. The array elements are used to emit ultrasonic waves according to excitation electrical signals or to convert received ultrasonic waves into electrical signals. Therefore, each array element can be used to convert between electrical pulse signals and ultrasound waves, thereby transmitting ultrasound waves to the target area and receiving echo signals of ultrasound waves reflected back from the tissue. During ultrasound detection, the transmitting and receiving control circuit 20 can control which array elements are used to transmit ultrasound beams (transmitting array elements), which array elements are used to receive ultrasound beams (receiving array elements), or control the array elements to transmit ultrasound waves or receive ultrasound echoes in time slots. Array elements participating in ultrasound transmission can be excited by electrical signals simultaneously, thereby transmitting ultrasound waves simultaneously; or array elements participating in ultrasound transmission can be excited by several electrical signals with a certain time interval, thereby continuously transmitting ultrasound waves with a certain time interval. If the smallest processing area for receiving and reflecting ultrasound waves in the target area is called the location point within the tissue, then after the ultrasound waves reach each location point in the target area, different reflections will occur due to the different acoustic impedances of the tissue at different location points. The reflected ultrasound waves are picked up by the receiving array elements, and each receiving array element may receive echoes of ultrasound waves from multiple location points (ultrasound echoes). The ultrasound echoes from different location points received by each receiving array element form different channel echo data. For a given receiving array element, the distance from it to different locations in the target area is different. Therefore, the time it takes for the ultrasonic echo reflected from each location to reach the array element is also different. The correspondence between the ultrasonic echo and the location point can be identified based on the time it takes for the ultrasonic echo to reach the array element.
[0116] The transmitting and receiving control circuit 20 is used to control the ultrasound probe 10 to transmit ultrasound waves and receive ultrasound echo signals. For example, the transmitting and receiving control circuit 20 is used to control the ultrasound probe 10 to transmit ultrasound waves toward the target area, and to control the ultrasound probe 10 to receive ultrasound echoes reflected from tissue. In some specific embodiments, the transmitting and receiving control circuit 20 is used to generate a transmission sequence and a reception sequence, and output them to the ultrasound probe 10. The transmission sequence is used to control some or all of the multiple array elements in the ultrasound probe 10 to transmit ultrasound waves toward the target area. The parameters of the transmission sequence include the number of array elements for transmission and ultrasound transmission parameters (e.g., pulse amplitude, transmission voltage, transmission frequency, number of waves, transmission interval, transmission angle, transmission waveform, transmission aperture, linear density, dot density, and / or focal position, etc.). The reception sequence is used to control some or all of the multiple array elements to receive the echoes of ultrasound waves after passing through tissue. The parameters of the reception sequence include the number of array elements for reception and the reception parameters of the echoes (e.g., reception angle, depth, etc.). Depending on the intended use of the ultrasound echo or the image generated by it, the ultrasound parameters in the transmission sequence and the echo parameters in the reception sequence will differ.
[0117] The processor 30 is used to process the ultrasonic echo signal (i.e., the echo signal of ultrasound) received by the ultrasonic probe 10. This processing may include one or more steps on the ultrasonic echo signal / channel echo data, such as analog-to-digital conversion, signal demodulation, amplification, filtering, downsampling, beamforming, modulus extraction, logarithmic compression, and / or grayscale conversion. By processing the ultrasonic echo signal, the processor 30 can ultimately obtain an ultrasonic image for display on the display 40.
[0118] In some embodiments, the processor 30 includes, but is not limited to, devices for interpreting computer instructions and processing data in computer software, such as a central processing unit (CPU), a micro controller unit (MCU), a field-programmable gate array (FPGA), and a digital signal processing unit (DSP).
[0119] In some embodiments, the ultrasound imaging system 100 of this invention may also be used to perform and implement the methods described in any embodiment of this invention; for example, the processor 30 is used to perform the methods described in any embodiment of this invention; in some examples, the processor 30 acquires a three-dimensional template model of the target site, acquires an ultrasound image of the patient about the target site on at least one long axis section, acquires multiple first control points of the structural contour of the target site on the corresponding long axis section for each long axis section ultrasound image, acquires a section shape on the three-dimensional template model corresponding to the ultrasound image on the long axis section, and acquires multiple second control points on the structural contour of the section shape, calculates deformation points based on the first control points and the second control points, and deforms the three-dimensional template model based on the deformation.
[0120] The above are some descriptions of the ultrasound imaging system 100.
[0121] Please refer to Figure 10 Some embodiments also disclose a device 101 for generating an actual morphological model of the aortic root, which includes a memory 31 and a processor 32; the memory 31 is used to store a program; the processor 32 is used to execute the program stored in the memory 31 to implement the method described in any embodiment of the present invention. For example, the processor 32 acquires a three-dimensional template model of the target site, acquires an ultrasound image of the patient about the target site on at least one long axis section, acquires multiple first control points of the structural contour of the target site on the corresponding long axis section for each long axis section ultrasound image, acquires the cross-sectional shape on the long axis section corresponding to the ultrasound image on the three-dimensional template model, and acquires multiple second control points on the structural contour of the cross-sectional shape, calculates deformation points based on the first control points and second control points, and deforms the three-dimensional template model based on the deformation.
[0122] In some embodiments, processor 32 includes, but is not limited to, means for interpreting computer instructions and processing data in computer software, such as a central processing unit (CPU), a micro controller unit (MCU), a field-programmable gate array (FPGA), and a digital signal processing unit (DSP).
[0123] This document describes various exemplary embodiments with reference to them. However, those skilled in the art will recognize that changes and modifications can be made to the exemplary embodiments without departing from the scope of this document. For example, various operational steps and components for performing operational steps can be implemented in different ways depending on the specific application or considering any number of cost functions associated with the operation of the system (e.g., one or more steps can be deleted, modified, or combined with other steps).
[0124] In the above embodiments, implementation can be achieved, in whole or in part, by software, hardware, firmware, or any combination thereof. Furthermore, as those skilled in the art will understand, the principles herein can be reflected in a computer program product on a computer-readable storage medium pre-loaded with computer-readable program code. Any tangible, non-transitory computer-readable storage medium may be used, including magnetic storage devices (hard disks, floppy disks, etc.), optical storage devices (CD-ROMs, DVDs, Blu-ray discs, etc.), flash memory, and / or the like. These computer program instructions may be loaded onto a general-purpose computer, special-purpose computer, or other programmable data processing apparatus to form a machine, such that instructions executing on the computer or other programmable data processing apparatus can generate means for implementing a specified function. These computer program instructions may also be stored in a computer-readable storage medium that can instruct the computer or other programmable data processing apparatus to operate in a particular manner, such that instructions stored in the computer-readable storage medium can form an article of manufacture including means for implementing the specified function. The computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to perform a series of operational steps on the computer or other programmable apparatus to produce a computer-implemented process, such that instructions executing on the computer or other programmable apparatus can provide steps for implementing the specified function.
[0125] While the principles herein have been illustrated in various embodiments, numerous modifications to the structure, arrangement, proportions, elements, materials, and components, particularly suited to specific environmental and operational requirements, may be used without departing from the principles and scope of this disclosure. These modifications and other alterations or alterations will be included within the scope of this document.
[0126] The foregoing specific descriptions have been described with reference to various embodiments. However, those skilled in the art will recognize that various modifications and changes can be made without departing from the scope of this disclosure. Therefore, considerations for this disclosure are to be illustrative rather than restrictive, and all such modifications are to be included within its scope. Similarly, advantages, other advantages, and solutions to problems with respect to various embodiments have been described above. However, benefits, advantages, solutions to problems, and any elements that produce these, or make them more explicit, should not be construed as critical, essential, or necessary. The term “comprising” and any other variations thereof as used herein are non-exclusive inclusion, meaning that a process, method, article, or apparatus that includes a list of elements includes not only those elements but also other elements not expressly listed or not part of the process, method, system, article, or apparatus. Furthermore, the term “coupled” and any other variations thereof as used herein refer to physical connections, electrical connections, magnetic connections, optical connections, communication connections, functional connections, and / or any other connections.
[0127] Those skilled in the art will recognize that many changes can be made to the details of the above embodiments without departing from the basic principles of the invention. Therefore, the scope of the invention should be determined only by the claims.
Claims
1. A method for generating an actual shape model of a target part, characterized in that, include: Obtain a 3D template model of the target area; Acquire an ultrasound image of the target region on the corresponding long axis section; Multiple first control points are obtained on the ultrasound image to determine the structural contour of the target part on the corresponding long axis section. The cross-sectional shape on the long axis section corresponding to the ultrasound image is obtained on the three-dimensional template model. Multiple second control points are obtained on the structural contour of the cross-sectional shape. The deformation is calculated based on the first control point and the second control point, and the three-dimensional template model is deformed based on the deformation to generate the actual shape model of the target part.
2. The generation method as described in claim 1, characterized in that, The target location includes the root of the aorta, and the long axis section includes one or more of the parasternal aortic long axis section, the apical five-chamber section, and the apical three-chamber section.
3. The generation method as described in claim 1, characterized in that, The method further includes: The ultrasound image is placed on the long axis section corresponding to the actual morphological model to synthesize the actual morphological model with the ultrasound image, and the actual morphological model with the ultrasound image is displayed. In response to a display operation on the actual morphological model with ultrasound images, the actual morphological model with ultrasound images is subjected to display processing; wherein the display operation includes one or more of zooming in, zooming out, and rotating.
4. The generation method as described in claim 1, characterized in that, The process of obtaining the three-dimensional template model of the target area includes: Three-dimensional ultrasound data of the target area are collected, and the three-dimensional ultrasound data of the target area is converted into a three-dimensional mesh model using relevant algorithms to serve as a three-dimensional template model; or, Acquire computed tomography (CT) scan data of the target area, and convert the CT scan data of the target area into a three-dimensional mesh model using relevant algorithms to serve as a three-dimensional template model; or, A three-dimensional template model of the target area is created using three-dimensional modeling.
5. The generation method as described in claim 1, characterized in that, The plurality of first control points and the plurality of second control points form a one-to-one correspondence with respect to the target part at the anatomical structural location points; The deformation of the 3D template model based on the deformation includes: Based on the deformation, the three-dimensional template model is deformed so that multiple second control points of the target part on the structural contour of the cross-section shape on the three-dimensional template model coincide with multiple first control points of the structural contour of the target part on the corresponding long axis section of the ultrasound image.
6. The generation method according to any one of claims 1 to 5, characterized in that, The step of acquiring multiple first control points of the structural contour of the target region on the corresponding long axis section of the ultrasound image includes: According to a first rule, multiple first control points are set on the structural contour of the ultrasound image based on B-spline interpolation. The first rule includes: dividing the target area into multiple sub-anatomical structures on the ultrasound image, and generating multiple control points for each sub-anatomical structure based on the control point generation rule associated with the sub-anatomical structure to obtain multiple first control points. The process of obtaining multiple second control points on the structural contour of the cross-section shape includes: According to the second rule, multiple second control points are set on the structural contour of the cross-sectional shape based on B-spline interpolation. The second rule includes: dividing the target part into multiple sub-anatomical structures on the cross-sectional shape, and generating multiple control points for each sub-anatomical structure based on the control point generation rule associated with the sub-anatomical structure to obtain multiple second control points. In this rule, multiple sub-anatomical structures of the second rule correspond one-to-one with multiple sub-anatomical structures of the first rule, and the control point generation rules associated with the two corresponding sub-anatomical structures are the same in the first rule and the second rule, so that multiple first control points and multiple second control points form a one-to-one correspondence about the target part in the anatomical structure position point.
7. The generation method according to any one of claims 1 to 5, characterized in that, The step of acquiring multiple first control points of the structural contour of the target region on the corresponding long axis section of the ultrasound image includes: The target area is divided into multiple first sub-anatomical structures on the ultrasound image: each sub-anatomical structure includes a relative first contour and a second contour, the first contour and the second contour are partial contours on the structural contour, and multiple control points are equally spaced on the first contour and the second contour of each sub-anatomical structure, and the control points on the first contour and the second contour of the same first sub-anatomical structure correspond one-to-one to form multiple first control points. The process of obtaining multiple second control points on the structural contour of the cross-section shape includes: The structural contour of the target region on the cross-sectional shape is divided into multiple second sub-anatomical structures. Each second sub-anatomical structure includes a corresponding first contour and a second contour. The first contour and the second contour of the second sub-anatomical structure are partial contours on the structural contour of the cross-sectional shape. Multiple control points are equidistantly arranged on the first contour and the second contour of each second sub-anatomical structure, and the control points on the first contour and the second contour of the same second sub-anatomical structure correspond one-to-one to form multiple second control points. The multiple second sub-anatomical structures correspond one-to-one with the multiple first sub-anatomical structures, so that the multiple first control points and the multiple second control points form a one-to-one correspondence with the target region at the anatomical structural position points.
8. The generation method according to any one of claims 1 to 5, characterized in that, The step of acquiring the structural contour of the target region on the corresponding long axis section of the ultrasound image includes: Identify multiple structural feature measurement items; Determine the location of each structural feature measurement item on the ultrasound image; The structural outline is generated based on the points using an interpolation algorithm.
9. The generation method as described in claim 8, characterized in that, The structural feature measurements include at least two of the following: valve annulus diameter, sinus maximum diameter, sinus duct junction diameter, and aortic duct diameter.
10. An ultrasound imaging system, characterized in that, include: Ultrasonic probe, transmitting and receiving control circuitry, and processor; The ultrasonic probe is used to emit ultrasonic waves and receive the echo signals of the ultrasonic waves. The transmitting and receiving control circuit is used to control the ultrasonic probe to transmit ultrasonic waves and receive ultrasonic echoes in order to obtain ultrasonic echo signals. The processor is used to process the ultrasonic echo signal to obtain an ultrasonic image; The processor is further configured to execute a method for generating an actual morphological model of the target region as described in any one of claims 1 to 9.
Citation Information
Patent Citations
Combined display method of multimode image of coronary artery
CN102411795A
Ultrasonic imaging equipment and pelvic floor section image generation method
CN112294361A
Three-dimensional cardiac imaging using ultrasound contour reconstruction
CN1853576A
Three-dimensional cardial imaging using ultrasound contour reconstruction
US20060241445A1
Automated three dimensional aortic root measurement and modeling
US20130231564A1
