Three-dimensional image determination method and device and ultrasonic imaging system
By combining two-dimensional ultrasonic sections and general three-dimensional models to determine the target three-dimensional image, the problem of inaccurate identification in traditional ultrasonic scanning technology is solved, and the accuracy of recognition and clarity of understanding is improved.
Patent Information
- Application Number
- CN202411804470.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-09
- Publication Date
- 2025-04-11
AI Technical Summary
Traditional ultrasound scanning technology mainly relies on two-dimensional sections for identification and measurement, resulting in inaccurate identification, especially when the structure of the scanning object is complex.
By obtaining the two-dimensional ultrasonic section of the object to be imaged, the measurement size of the target area in the two-dimensional ultrasonic section is determined, and combined with a general three-dimensional model, the target three-dimensional image is determined so that the characteristics of its target section are consistent with the characteristics of the two-dimensional ultrasonic section.
Improve the accuracy of recognition and visualize abstract two-dimensional ultrasound faces, allowing users to clearly understand the three-dimensional structure of the object to be imaged and discover hidden problems or lesion areas.
Smart Images

Figure CN119791723A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of imaging technology, and in particular to a three-dimensional image determination method, device and ultrasonic imaging system. Background Art
[0002] As a non-invasive examination method, ultrasound scanning is widely used in clinical scenarios due to its advantages such as non-invasiveness, wide application range and safety. For example, ultrasound scanning of the heart can evaluate the structure and function of the heart based on the ultrasound images obtained by the scan, which can assist doctors in treating various heart diseases; it can also dynamically detect changes in the heart in motion, which is very helpful for evaluating the function of the heart under load.
[0003] In traditional technology, the two-dimensional sections obtained by ultrasound scanning are mainly manually identified and the size of the identified area is manually measured to help doctors make a diagnosis. However, the structure of the scanned object is relatively complex, and the identification and measurement through two-dimensional sections may cause inaccurate identification. Summary of the invention
[0004] Based on this, it is necessary to provide a three-dimensional image determination method, device and ultrasonic imaging system that can improve the accuracy of recognition in order to solve the above technical problems.
[0005] In a first aspect, the present application provides a three-dimensional image determination method, the method comprising:
[0006] Acquiring a two-dimensional ultrasonic section of an object to be imaged;
[0007] According to the two-dimensional ultrasound section, determining the measurement size of the target area in the two-dimensional ultrasound section;
[0008] A target three-dimensional image of the object to be imaged is determined according to the measured size of the target area, the two-dimensional ultrasonic section and the general three-dimensional model; the characteristics of the target section of the target three-dimensional image are consistent with the characteristics of the two-dimensional ultrasonic section.
[0009] In one embodiment, obtaining a target three-dimensional image of the object to be imaged according to the measured size of the target area, the two-dimensional ultrasound section and the general three-dimensional model includes:
[0010] Determine an initial three-dimensional image of the object to be imaged according to the two-dimensional ultrasound section and the general three-dimensional model;
[0011] The size of the corresponding area in the initial three-dimensional image is updated according to the measured size of the target area to obtain a target three-dimensional image.
[0012] In one embodiment, determining an initial three-dimensional image of an object to be imaged according to a two-dimensional ultrasound section and a general three-dimensional model includes:
[0013] Registering the two-dimensional ultrasound section with the universal three-dimensional model to determine an initial section in the universal three-dimensional model;
[0014] An initial three-dimensional image is determined according to the initial section and the general three-dimensional model.
[0015] In one embodiment, the universal three-dimensional model includes a plurality of standard sections, and determining an initial three-dimensional image of the object to be imaged according to the two-dimensional ultrasound section and the universal three-dimensional model includes:
[0016] Determine whether the two-dimensional ultrasound section is a standard section;
[0017] When the two-dimensional ultrasound section is a standard section, an initial section is determined from a plurality of standard sections according to the two-dimensional ultrasound section;
[0018] In the case where the two-dimensional ultrasound section is not a standard section, the two-dimensional ultrasound section is registered with the universal three-dimensional model to determine the initial section;
[0019] An initial three-dimensional image is determined according to the initial section and the general three-dimensional model.
[0020] In one embodiment, the method further comprises:
[0021] The size of the corresponding area in the general three-dimensional model is updated according to the measured size of the target area to obtain a target three-dimensional model of the object to be imaged.
[0022] In one embodiment, the method further comprises:
[0023] Determining the two-dimensional deformation of the target area according to the measured dimensions of the target area in the multiple two-dimensional ultrasonic slices obtained; the multiple two-dimensional ultrasonic slices are images at the same position of the object to be imaged;
[0024] The target 3D image and / or the general 3D model is adjusted based on the 2D deformation.
[0025] In one embodiment, the method further comprises:
[0026] According to the two-dimensional ultrasonic section and the first position information of the ultrasonic probe on the two-dimensional ultrasonic section, second position information of the ultrasonic probe in the target three-dimensional image or the universal three-dimensional model is determined.
[0027] In one embodiment, the universal three-dimensional model includes a plurality of standard probe positions; determining second position information of the ultrasound probe in the target three-dimensional image and / or the universal three-dimensional model according to the two-dimensional ultrasound section and the first position information of the ultrasound probe on the two-dimensional ultrasound section includes:
[0028] Determine whether the two-dimensional ultrasound section is a standard section;
[0029] When the two-dimensional ultrasound section is a standard section, determining second position information from a plurality of standard probe positions according to the two-dimensional ultrasound section;
[0030] In the case that the two-dimensional ultrasound section is not a standard section, the two-dimensional ultrasound section is registered with the target three-dimensional image and / or the universal three-dimensional model to determine the second position information.
[0031] In one embodiment, the method further comprises:
[0032] The two-dimensional ultrasound section and the target three-dimensional image are displayed on the display interface.
[0033] In a second aspect, an embodiment of the present application provides a three-dimensional image determination device, the device comprising:
[0034] An acquisition module, used for acquiring a two-dimensional ultrasonic section of an object to be imaged;
[0035] A determination module, used to determine the measurement size of the target area in the two-dimensional ultrasonic section according to the two-dimensional ultrasonic section;
[0036] The determination module is also used to determine the target three-dimensional image of the object to be imaged according to the measured size of the target area, the two-dimensional ultrasonic section and the general three-dimensional model; the characteristics of the target section of the target three-dimensional image are consistent with the characteristics of the two-dimensional ultrasonic section.
[0037] In a third aspect, an embodiment of the present application provides an ultrasound imaging system, including an ultrasound probe and a computer device, wherein the computer device is used to implement the steps of the method provided in the first aspect.
[0038] In a fourth aspect, an embodiment of the present application provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of the method provided in the first aspect when executing the computer program.
[0039] In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the steps of the method provided in the first aspect are implemented.
[0040] In a sixth aspect, an embodiment of the present application further provides a computer program product, including a computer program, which implements the steps of the method provided in the first aspect when the computer program is executed by a processor.
[0041] The above-mentioned three-dimensional image determination method, device and ultrasonic imaging system, the method obtains a two-dimensional ultrasonic section of the object to be imaged; determines the measured size of the target area in the two-dimensional ultrasonic section according to the two-dimensional ultrasonic section; determines the target three-dimensional image of the object to be imaged according to the measured size of the target area, the two-dimensional ultrasonic section and the general three-dimensional model; the characteristics of the target section of the target three-dimensional image are consistent with the characteristics of the two-dimensional ultrasonic section. In this embodiment, the target three-dimensional image of the object to be imaged is determined based on the acquired two-dimensional ultrasonic section of the object to be imaged, the measured size of the target area in the two-dimensional ultrasonic section and the general three-dimensional model, so that the obtained target three-dimensional image can be closer to the actual image of the object to be imaged, thereby improving the accuracy of recognition, and can visualize the abstract two-dimensional ultrasonic section, so that the user can more clearly understand the three-dimensional structure of the object to be imaged and find hidden problems or lesion areas of the object to be imaged. BRIEF DESCRIPTION OF THE DRAWINGS
[0042] Figure 1 A diagram of an application environment of a three-dimensional image determination method in an embodiment;
[0043] Figure 2 A schematic diagram of a process flow of a three-dimensional image determination method in one embodiment;
[0044] Figure 3 A schematic diagram of a two-dimensional ultrasound section and a three-dimensional image of a target in one embodiment;
[0045] Figure 4 A schematic flow chart of the steps of a method for determining a three-dimensional image in another embodiment;
[0046] Figure 5 A schematic flow chart of the steps of a method for determining a three-dimensional image in another embodiment;
[0047] Figure 6 A schematic flow chart of the steps of a method for determining a three-dimensional image in another embodiment;
[0048] Figure 7 A schematic flow chart of the steps of a method for determining a three-dimensional image in another embodiment;
[0049] Figure 8 A schematic flow chart of the steps of a method for determining a three-dimensional image in another embodiment;
[0050] Fig. 9 A schematic flow chart of the steps of a method for determining a three-dimensional image in another embodiment;
[0051] Fig.10 A schematic diagram of a target three-dimensional image in one embodiment;
[0052] Fig.11A schematic diagram of a target three-dimensional model in an embodiment;
[0053] Fig.12 FIG. 4 is a schematic diagram of the structure of a three-dimensional image determination device in an embodiment. DETAILED DESCRIPTION
[0054] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.
[0055] First of all, before specifically introducing the technical solutions of the embodiments disclosed in the present application, the background technology or technical evolution context on which the embodiments of the present application are based is introduced. Ultrasound scanning, as a non-invasive examination method, is widely used in clinical scenarios due to its advantages such as non-invasiveness, wide application range, and safety. For example, an ultrasound scan of the heart can be used to evaluate the structure and function of the heart, such as the size of the heart, wall thickness, ventricular septum movement, movement and function of the heart valves, etc.; it can assist doctors in treating various heart diseases, such as cardiac muscle hypertrophy, cardiac valve substrate, cardiac valve prolapse, cardiac valve regurgitation, pericardial effusion, cardiac myositis, etc.; it can also dynamically detect changes in the heart in motion, which is very helpful for evaluating the function of the heart under load, such as exercise tolerance testing or load testing.
[0056] In traditional technology, two-dimensional sections obtained by ultrasound scanning are mainly identified manually, and the size of the identified area is manually measured to help doctors make a diagnosis. For example, a heart section obtained by ultrasound scanning is manually identified, and cardiac parameters are manually measured to determine cardiac abnormalities during the cardiac cycle.
[0057] However, the traditional method relies on the doctor's clinical experience, and the diagnosis is difficult. In addition, the structure of the scanned object (heart) is relatively complex, and it is difficult for doctors to match the two-dimensional image with the actual anatomical relationship during clinical scanning. Especially for primary care doctors, young doctors or doctors in certain clinical departments, it is difficult to match the two-dimensional cardiac ultrasound image to a more realistic three-dimensional heart. There is a problem of inaccurate recognition when only identifying through two-dimensional sections. In this regard, the present application provides a method for determining a corresponding three-dimensional image by using a two-dimensional image obtained by ultrasonic scanning.
[0058] The three-dimensional image determination method provided in the present application can be applied to an ultrasound imaging system, which includes an ultrasound probe and a computer device. The computer device can be a terminal device integrated with the ultrasound probe, or an industrial computer, a laptop computer, or a tablet computer connected to the ultrasound probe. The internal structure of the computer device can be as follows: Figure 1 As shown. The computer device includes a processor, a memory, a communication interface, a display screen and an input device connected through a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be achieved through WIFI, a mobile cellular network, NFC (near field communication) or other technologies. When the computer program is executed by the processor, a three-dimensional image determination method is implemented. The display screen of the computer device can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device can be a touch layer covered on the display screen, or a key, trackball or touchpad set on the computer device shell, or an external keyboard, touchpad or mouse, etc.
[0059] Those skilled in the art will understand that Figure 1 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.
[0060] The technical solution of the present application and how the technical solution of the present application solves the technical problem are described in detail below with specific embodiments.
[0061] In one embodiment, Figure 2 As shown, a method for determining a three-dimensional image is provided. This embodiment uses the method applied to a computer device as an example. In this embodiment, the method includes the following steps:
[0062] Step 200: Acquire a two-dimensional ultrasonic section of the object to be imaged.
[0063] The object to be imaged may be an animal body, a human body, or a water model, etc. The two-dimensional ultrasonic section of the object to be imaged refers to a two-dimensional ultrasonic image obtained by scanning the object to be imaged using an ultrasonic imaging system. The two-dimensional ultrasonic section of the object to be imaged is an image of the heart region of the object to be imaged, or an image of the abdomen region of the object to be imaged, or an image of the liver region of the object to be imaged, etc.
[0064] In an optional embodiment, if the ultrasound probe in the ultrasound imaging system is a handheld probe, the user moves the handheld ultrasound probe to the target position, scans the object to be imaged, and obtains a two-dimensional ultrasound section. If the ultrasound probe in the ultrasound imaging system is an automatic probe, the computer device sends control information to the mechanical arm in the ultrasound imaging system to control the mechanical arm to drive the ultrasound probe disposed at the end of the mechanical arm to move to the target position, scan the object to be imaged, and obtain a two-dimensional ultrasound section.
[0065] The computer device can obtain the two-dimensional ultrasonic section of the object to be imaged from the imaging device post-processing workstation, or from a server such as PACS (Picture Archiving and Communication Systems). Alternatively, the two-dimensional ultrasonic section of the object to be imaged can be pre-stored in the memory of the computer device, and the computer device can directly obtain it from the memory when needed. This embodiment does not limit the specific method of obtaining the two-dimensional ultrasonic section of the object to be imaged, as long as its function can be achieved.
[0066] Step 210: Determine the measurement size of the target area in the two-dimensional ultrasonic section according to the two-dimensional ultrasonic section.
[0067] After acquiring the two-dimensional ultrasonic section, the computer device analyzes the two-dimensional ultrasonic section to determine the target area in the two-dimensional ultrasonic section. The target area may refer to the area corresponding to each target tissue in the two-dimensional ultrasonic section.
[0068] In an optional embodiment, the computer device may perform segmentation processing on the two-dimensional ultrasonic section to determine the target area in the two-dimensional ultrasonic section.
[0069] In another optional embodiment, the computer device may input the two-dimensional ultrasound section into a pre-trained segmentation model, and perform segmentation processing on the two-dimensional ultrasound section through the segmentation model to obtain a target area in the two-dimensional ultrasound section.
[0070] After determining the target area in the two-dimensional ultrasonic section, the computer device measures the size of the target area to obtain the measured size of the target area.
[0071] Assuming that the two-dimensional ultrasound section is a heart section, the target area may be the atrioventricular valve, ventricular septum, left ventricle, right ventricle, each chamber, etc. The measurement dimensions of the target area may be the morphological composition of the atrioventricular valve, the opening and closing state and meridian of the atrioventricular valve, the thickness of the ventricular septum, the wall thickness of the left ventricle, the wall thickness of the right ventricle, the inner diameter of each chamber, etc.
[0072] In an optional embodiment, the computer device inputs the two-dimensional ultrasound section into a pre-trained measurement model, and the measurement size of the target area in the two-dimensional ultrasound section can be determined by processing the two-dimensional ultrasound section by the measurement model.
[0073] This embodiment does not limit the specific method of determining the measurement size of the target area in the two-dimensional ultrasonic section according to the two-dimensional ultrasonic section, as long as its function can be achieved.
[0074] Step 220: determine a target three-dimensional image of the object to be imaged according to the measured size of the target area, the two-dimensional ultrasonic section and the general three-dimensional model; the target section of the target three-dimensional image is consistent with the characteristics of the two-dimensional ultrasonic section.
[0075] The general three-dimensional model may be pre-stored in a computer device. The general three-dimensional model may be determined based on the acquired historical data of the object to be imaged. The historical data of the object to be imaged may be an ultrasound image, a computed tomography (CT) image, a magnetic resonance image, or data constructed based on prior knowledge of the structure or function of each region in the ultrasound section of the object to be imaged. Assuming that the two-dimensional ultrasound section of the object to be imaged is a cardiac section, the pre-stored general three-dimensional model is a general cardiac three-dimensional model.
[0076] After the computer device determines the measured size of the target area in the two-dimensional ultrasonic section, the target three-dimensional image of the object to be imaged is determined based on the measured size of the target area, the two-dimensional ultrasonic section and the general three-dimensional model. The target three-dimensional image includes a target section, and the characteristics of the target section are consistent with the characteristics of the two-dimensional ultrasonic section. The consistency of the characteristics of the target section with the characteristics of the two-dimensional ultrasonic section can be understood as: the target area included in the target section is the same as the area included in the two-dimensional ultrasonic section, and the structure, size and position of the target area in the target section are consistent with the structure, size and position of the corresponding area of the two-dimensional ultrasonic section. This embodiment does not limit the specific method of determining the target three-dimensional image of the object to be imaged based on the measured size of the target area, the two-dimensional ultrasonic section and the general three-dimensional model, as long as its function can be achieved.
[0077] In one embodiment, after the computer device determines the target three-dimensional image of the object to be imaged, the method further includes:
[0078] The two-dimensional ultrasound section and the target three-dimensional image are displayed on the display interface.
[0079] The computer includes a display interface. After acquiring the two-dimensional ultrasonic section of the object to be imaged and the target three-dimensional image, the computer device can automatically display the two-dimensional ultrasonic section and the target three-dimensional image on the display interface. Optionally, Figure 3 As shown, Figure 3The left image is the acquired 2D ultrasound section, and the right image is the determined target 3D image. The displayed 2D ultrasound section and target 3D image can be rendered by changing color and annotating according to actual needs.
[0080] In this embodiment, by displaying the two-dimensional ultrasonic section and the target three-dimensional image on the display interface, the user can more clearly observe the two-dimensional ultrasonic section of the object to be imaged and the three-dimensional structure of the object to be imaged.
[0081] In an optional embodiment, the computer device can also automatically display the general three-dimensional model on the display interface. The displayed general three-dimensional model can be rendered by changing color and annotation according to actual needs. The user can zoom in, zoom out, rotate, etc. on the displayed target three-dimensional image and / or the general three-dimensional model, so that the user can more clearly observe the three-dimensional structure of the object to be imaged and find hidden problems or lesion areas of the object to be imaged.
[0082] The three-dimensional image determination method provided in the embodiment of the present application is carried out by obtaining a two-dimensional ultrasonic section of the object to be imaged; determining the measured size of the target area in the two-dimensional ultrasonic section according to the two-dimensional ultrasonic section; determining the target three-dimensional image of the object to be imaged according to the measured size of the target area, the two-dimensional ultrasonic section and the general three-dimensional model; the characteristics of the target section of the target three-dimensional image are consistent with the characteristics of the two-dimensional ultrasonic section. In this embodiment, the target three-dimensional image of the object to be imaged is determined based on the obtained two-dimensional ultrasonic section of the object to be imaged, the measured size of the target area in the two-dimensional ultrasonic section and the general three-dimensional model, so that the obtained target three-dimensional image can be closer to the actual image of the object to be imaged, thereby improving the recognition accuracy, and can visualize the abstract two-dimensional ultrasonic section, so that the user can more clearly understand the three-dimensional structure of the object to be imaged and find hidden problems or lesion areas of the object to be imaged.
[0083] In one embodiment, Figure 4 As shown, it is related to an implementation method of determining a target three-dimensional image of an object to be imaged according to the measured size of the target area, the two-dimensional ultrasonic section and the general three-dimensional model, and the steps of the implementation method include:
[0084] Step 400: Determine an initial three-dimensional image of the object to be imaged according to the two-dimensional ultrasound section and the general three-dimensional model.
[0085] The computer device determines an initial three-dimensional image of the object to be imaged according to the two-dimensional ultrasound section and the general three-dimensional model. The initial three-dimensional image includes an initial section, and the features of the initial section are consistent with the features of the two-dimensional ultrasound section.
[0086] In an optional embodiment, the computer device can input the two-dimensional ultrasound section and the general three-dimensional model into a pre-trained neural network model to obtain an initial three-dimensional image of the object to be imaged.
[0087] Step 410: Update the size of the corresponding area in the initial three-dimensional image according to the measured size of the target area to obtain a target three-dimensional image.
[0088] After obtaining the initial three-dimensional image, the computer device updates the size of the corresponding area in the initial three-dimensional image according to the measured size of the target area in the two-dimensional ultrasound section, that is, adjusts the size of the corresponding area in the initial three-dimensional image to be the same as the measured size of the target area, and obtains the target three-dimensional image. The corresponding area in the initial three-dimensional image is of the same type as the target area.
[0089] In this embodiment, the initial three-dimensional image of the object to be imaged is first determined based on the two-dimensional ultrasound section and the general three-dimensional model; then the size of the corresponding area in the initial three-dimensional image is updated according to the measured size of the target area to obtain the target three-dimensional image. This method of determining the target three-dimensional image is quick and easy to implement. In addition, by updating the size of the corresponding area in the initial three-dimensional image according to the measured size of the target area, the obtained target three-dimensional image is closer to the actual image of the object to be imaged, thereby improving the accuracy of recognition and measurement, so that the user can more clearly understand the three-dimensional structure of the object to be imaged and discover hidden problems or lesion areas of the object to be imaged.
[0090] In an optional embodiment, if Figure 5 As shown, another implementation method of determining a target three-dimensional image of an object to be imaged according to the measured size of the target area, the two-dimensional ultrasonic section and the general three-dimensional model, the steps of the implementation method include:
[0091] Step 500: Update the size of the corresponding area in the general three-dimensional model according to the measured size of the target area to obtain a target three-dimensional model.
[0092] After the computer device determines the measured size of the target area, the target area in the two-dimensional ultrasound section has a corresponding area in the universal three-dimensional model. The computer device can update the measured size of the target area and the corresponding area in the universal three-dimensional model, that is, adjust the size of the corresponding area in the universal three-dimensional model to make it the same as the measured size of the target area, and obtain the target three-dimensional model of the object to be imaged.
[0093] Step 510: Determine a target three-dimensional image according to the two-dimensional ultrasound section and the target three-dimensional model.
[0094] After obtaining the target three-dimensional model, the computer device aligns the two-dimensional ultrasonic section with the target three-dimensional model, and can determine the target section from the target three-dimensional model.
[0095] In an optional embodiment, the computer device may traverse each section in the target three-dimensional model, determine the similarity between each section and the two-dimensional ultrasound section, and determine the section corresponding to the highest similarity as the target section.
[0096] After determining the target section, the computer device divides the target three-dimensional model according to the target section to obtain the target three-dimensional image of the object to be imaged. The target three-dimensional image is a part of the target three-dimensional model. It can be understood that by dividing the target three-dimensional model according to the target section, the target three-dimensional model can be divided into two parts, and the target three-dimensional image of the object to be imaged can be any one of the two parts. Optionally, the user can select one part from the two parts of the target three-dimensional model to determine as the target three-dimensional image of the object to be imaged.
[0097] In this embodiment, the size of the corresponding area in the general three-dimensional model is first updated according to the size of the target area to obtain the target three-dimensional model; then the target three-dimensional image is determined according to the two-dimensional ultrasonic section and the target three-dimensional model. This method of determining the target three-dimensional image is quick and easy to implement. In addition, by updating the size of the corresponding area in the general three-dimensional model according to the measured size of the target area, the obtained target three-dimensional image is closer to the actual image of the object to be imaged, thereby improving the accuracy of recognition and measurement, so that the user can more clearly understand the three-dimensional structure of the object to be imaged and discover hidden problems or lesion areas of the object to be imaged.
[0098] The above embodiment provides two implementation methods for obtaining a target three-dimensional image of the object to be imaged based on the measured size of the target area, the two-dimensional ultrasonic section and the general three-dimensional model. The user can choose according to the actual application, which can improve the applicability of the three-dimensional image determination method.
[0099] In one embodiment, Figure 6 As shown, it is related to an implementation method of determining an initial three-dimensional image of an object to be imaged based on a two-dimensional ultrasound section and a general three-dimensional model, and the steps of the implementation method include:
[0100] Step 600: align the two-dimensional ultrasound section with the universal three-dimensional model to determine an initial section in the universal three-dimensional model.
[0101] The computer device registers the acquired two-dimensional ultrasonic section with the universal three-dimensional model to determine an initial section consistent with the features of the two-dimensional ultrasonic section from the universal three-dimensional model. The description of registering the two-dimensional ultrasonic section with the universal three-dimensional model to determine the initial section in the universal three-dimensional model can refer to the specific description of registering the two-dimensional ultrasonic section with the target three-dimensional model to determine the target section in the target three-dimensional model in the above embodiment, which will not be repeated here.
[0102] Step 610: Determine an initial three-dimensional image according to the initial section and the general three-dimensional model.
[0103] After determining the initial section in the general three-dimensional model, the computer device divides the general three-dimensional model according to the initial section to obtain an initial three-dimensional image. The initial three-dimensional image includes the initial section.
[0104] In this embodiment, the initial section in the universal three-dimensional model is determined by aligning the two-dimensional ultrasound section with the universal three-dimensional model; the initial three-dimensional image is determined based on the initial section and the universal three-dimensional model. This method of determining the initial three-dimensional image is quick and easy to implement.
[0105] In one embodiment, the general three-dimensional model includes a plurality of standard sections, that is, the position information of a plurality of marked sections is marked in the general three-dimensional model. Figure 7 As shown, another implementation method of determining an initial three-dimensional image of an object to be imaged according to a two-dimensional ultrasound section and a general three-dimensional model includes the following steps:
[0106] Step 700: Determine whether the two-dimensional ultrasound section is a standard section.
[0107] The computer device determines whether the acquired two-dimensional ultrasound section of the object to be imaged is a standard section.
[0108] In an optional embodiment, the computer device can input the two-dimensional ultrasound section into the recognition model, and use the recognition model to identify whether the two-dimensional ultrasound section is a standard section to obtain a recognition result. The recognition result includes whether the two-dimensional ultrasound section is a standard section or the two-dimensional ultrasound section is not a standard section.
[0109] In another optional embodiment, a plurality of standard sections are stored in the computer device, and the computer device determines whether the two-dimensional ultrasound section is a standard section by comparing the two-dimensional ultrasound section with the plurality of standard sections, i.e., calculating the similarity between the two-dimensional ultrasound section and each standard section.
[0110] Step 710: When the two-dimensional ultrasound section is a standard section, determine an initial section from a plurality of standard sections according to the two-dimensional ultrasound section.
[0111] If the computer device determines that the two-dimensional ultrasound section is a standard section, the initial section can be directly determined from multiple standard sections marked in the general three-dimensional model according to the two-dimensional ultrasound section.
[0112] In an optional embodiment, each standard section is of a different type. After determining that the two-dimensional ultrasound section is a standard section, the computer device can identify the two-dimensional ultrasound section, determine its type, and determine a standard section consistent with the type as the initial section.
[0113] In another optional embodiment, the computer device may determine the similarity between the two-dimensional ultrasound section and each standard section, and determine the standard section with the highest similarity as the initial section.
[0114] Step 720: When the two-dimensional ultrasound section is not a standard section, the two-dimensional ultrasound section is registered with the universal three-dimensional model to determine an initial section.
[0115] When the computer device determines that the two-dimensional ultrasound section is not a standard section, the two-dimensional ultrasound section is registered with the universal three-dimensional model to determine the initial section. The description of registering the two-dimensional ultrasound section with the universal three-dimensional model to determine the initial section can refer to the specific description in the above embodiment, which will not be repeated here.
[0116] In an optional embodiment, when it is determined that the two-dimensional ultrasound section is not a standard section, a prompt message may be sent to the user, the prompt message being used to prompt the user that the acquired two-dimensional ultrasound section is not a standard section. The prompt message sent to the user may be a pop-up prompt box on the display interface, or may be a prompt bell or a prompt voice.
[0117] Step 730: Determine an initial three-dimensional image according to the initial section and the general three-dimensional model.
[0118] After determining the initial section, the computer device determines the initial 3D image according to the initial section and the general 3D model. The description of determining the initial 3D image according to the initial section and the general 3D model can refer to the specific description of the above embodiment, which will not be repeated here.
[0119] In this embodiment, it is first determined whether the two-dimensional ultrasound section is a standard section. When it is determined that the two-dimensional ultrasound section is a standard section, an initial section is determined from multiple standard sections according to the standard section; when the two-dimensional ultrasound section is not a standard section, the two-dimensional ultrasound section is registered with the universal three-dimensional model to determine the initial section; and an initial three-dimensional image is determined according to the initial section and the universal three-dimensional model. In this method of first determining whether the two-dimensional ultrasound section is a standard section and then determining the initial section, when the two-dimensional ultrasound section is a standard section, the initial section is directly determined from multiple standard sections according to the standard section without performing a registration operation, which can improve the efficiency of determining the initial section, thereby improving the efficiency of determining the initial three-dimensional image.
[0120] In one embodiment, the method further comprises:
[0121] The size of the corresponding area in the general three-dimensional model is updated according to the measured size of the target area to obtain a target three-dimensional model of the object to be imaged.
[0122] After determining the measured size of the target area in the two-dimensional ultrasonic section, the computer device can update the size of the corresponding area in the universal three-dimensional model according to the measured size of the target area, that is, adjust the size of the corresponding area in the universal three-dimensional model to make it the same as the measured size of the target area, and obtain the target three-dimensional model of the object to be imaged.
[0123] In an optional embodiment, when the general 3D model is updated to obtain the target 3D model of the object to be imaged, the target 3D model can be used to replace the displayed general 3D model on the display interface of the computer device. The displayed target 3D model can be rendered by changing color and annotating according to actual needs.
[0124] In this embodiment, the target 3D model of the object to be imaged is obtained by updating the size of the corresponding area in the general 3D model according to the measured size of the target area. In this way, not only the target 3D image of the object to be imaged can be obtained, but also the target 3D model of the object to be imaged can be obtained, which is convenient for users to identify and measure based on the target 3D image and the target 3D model, thereby improving the accuracy of identification and measurement, allowing users to more clearly understand the 3D structure of the object to be imaged and discover hidden problems or lesion areas of the object to be imaged.
[0125] In one embodiment, Figure 8 As shown, the method further comprises the steps of:
[0126] Step 800: determining the two-dimensional deformation of the object to be imaged according to the measured sizes of the target area in the acquired multiple two-dimensional ultrasonic slices; the multiple two-dimensional ultrasonic slices are images at the same position of the object to be imaged;
[0127] The computer device may acquire multiple two-dimensional ultrasonic sections of the object to be imaged. Specifically, the ultrasonic probe in the ultrasonic imaging system may scan and obtain multiple two-dimensional ultrasonic sections of the object to be imaged at the same position of the object to be imaged. For the description of acquiring multiple two-dimensional ultrasonic sections, reference may be made to the specific description of acquiring the two-dimensional ultrasonic section of the object to be imaged in the above embodiment, which will not be repeated here.
[0128] After acquiring multiple two-dimensional ultrasonic slices, the computer device determines the measured size of the target area in each two-dimensional ultrasonic slice, and by comparing the measured size of the target area in each two-dimensional ultrasonic slice, the change in the measured size of the target area, that is, the two-dimensional deformation of the target area, can be determined. The description of determining the measured size of the target area in each two-dimensional ultrasonic slice can refer to the specific description of determining the measured size of the target area in the two-dimensional ultrasonic slice in the above embodiment, which will not be repeated here.
[0129] Step 810: Adjust the target 3D image and / or the general 3D model based on the 2D deformation.
[0130] After determining the two-dimensional deformation of the target area, the computer device can adjust the corresponding target area in the target three-dimensional image according to the two-dimensional deformation of the target area in the two-dimensional ultrasonic section. That is, according to the change of the measured size of the target area, the change of the measured size of the corresponding area in the target three-dimensional image is adjusted, so that the corresponding area in the target three-dimensional image can change with the change of the target area in the two-dimensional ultrasonic section. At the same time, after determining the two-dimensional deformation of the target area, the computer device can also adjust the corresponding target area in the universal three-dimensional model according to the two-dimensional deformation of the target area. That is, according to the change of the measured size of the target area, the change of the measured size of the corresponding area in the universal three-dimensional model is adjusted, so that the corresponding area in the universal three-dimensional model can change with the change of the target area in the two-dimensional ultrasonic section. Optionally, the computer device can achieve the adjustment of the target three-dimensional image and / or the universal three-dimensional model by mapping the two-dimensional deformation of the target area to the target three-dimensional image and / or the universal three-dimensional model.
[0131] Assuming that the two-dimensional ultrasonic section of the object to be imaged is a cardiac section, the two-dimensional deformation (heart contraction and diastole) of each target area in the cardiac section is mapped to the target three-dimensional image and / or the universal heart three-dimensional model, so that the corresponding area of the target three-dimensional image and / or the universal heart three-dimensional model also deforms, that is, the corresponding area of the target three-dimensional image and / or the universal heart three-dimensional model contracts and diastole accordingly, and the cardiac cycle of the object to be imaged can be determined based on the contraction and diastole of the corresponding area of the target three-dimensional image and / or the universal heart three-dimensional model. In addition, by displaying the target three-dimensional image and / or the communication heart three-dimensional model in real time, the cardiac cycle of the object to be imaged can be dynamically displayed.
[0132] In an optional embodiment, when the computer device updates the size of the corresponding area in the universal three-dimensional model according to the measured size of the target area to obtain the target three-dimensional model of the object to be imaged, the two-dimensional deformation of the target area can be mapped to the target three-dimensional model. For the description of mapping the two-dimensional deformation of the target area to the target three-dimensional model, reference can be made to the specific description of mapping the two-dimensional deformation to the universal three-dimensional model in the above embodiment, which will not be repeated here.
[0133] In an optional embodiment, in the display interface of the computer device, the second position information of the ultrasound probe is marked in the displayed target three-dimensional image, and the second position information of the ultrasound probe may also be marked in the displayed general three-dimensional model.
[0134] In this embodiment, the two-dimensional deformation of the target area determined by the measured dimensions of the target area in the multiple two-dimensional ultrasonic sections is mapped to the target three-dimensional image and / or the general three-dimensional model, so that the corresponding area of the target three-dimensional image and / or the general three-dimensional model will change with the change of the target area in the two-dimensional ultrasonic section, so that the obtained target three-dimensional image and / or the general three-dimensional model is closer to the actual image of the object to be imaged, thereby improving the accuracy of recognition and measurement, allowing the user to more clearly understand the three-dimensional structure of the object to be imaged and discover hidden problems or lesion areas of the object to be imaged.
[0135] In one embodiment, the method further comprises:
[0136] According to the two-dimensional ultrasonic section and the first position information of the ultrasonic probe on the two-dimensional ultrasonic section, second position information of the ultrasonic probe in the target three-dimensional image and / or the universal three-dimensional model is determined.
[0137] The two-dimensional ultrasonic section of the object to be imaged obtained by the computer device includes not only the structure of each area of the object to be imaged, but also includes the first position information of the ultrasonic probe obtained by scanning the two-dimensional ultrasonic section through the ultrasonic probe. In this regard, after obtaining the two-dimensional ultrasonic section, the computer device can determine the second position information of the ultrasonic probe in the target three-dimensional image and / or the general three-dimensional model based on the two-dimensional ultrasonic section and the first position information of the ultrasonic probe on the two-dimensional ultrasonic section. Specifically, the computer device can obtain a registration matrix by aligning the two-dimensional ultrasonic section with the target three-dimensional image and / or the general three-dimensional model, and determine the second position information of the ultrasonic probe in the target three-dimensional image and / or the general three-dimensional model based on the registration matrix and the first position information.
[0138] In an optional embodiment, when the computer device updates the size of the corresponding area in the general three-dimensional model according to the measured size of the target area to obtain the target three-dimensional model of the object to be imaged, the computer device can determine the third position information of the ultrasound probe in the target three-dimensional model based on the two-dimensional ultrasound section and the first position information of the ultrasound probe on the two-dimensional ultrasound section.
[0139] In this embodiment, the acquired two-dimensional ultrasonic section of the object to be imaged contains the first position information of the ultrasonic probe during scanning, and the second position information of the ultrasonic probe in the target three-dimensional image or the general three-dimensional model is determined based on the two-dimensional ultrasonic section and the first position information of the ultrasonic probe on the two-dimensional ultrasonic section. This makes it easier for users to understand the position of the ultrasonic probe during scanning. In addition, the second position information of the ultrasonic probe in the target three-dimensional image or the general three-dimensional model can guide users to adjust the position information of the ultrasonic probe so as to obtain a more accurate two-dimensional ultrasonic section (standard section), which can improve the accuracy of recognition and measurement and discover hidden problems or lesion areas of the object to be imaged.
[0140] In one embodiment, the universal three-dimensional model includes multiple standard probe positions. That is, the universal three-dimensional model includes position information of multiple standard probes. The standard probe position refers to the position of the ultrasound probe when obtaining the standard section. In this case, Fig. 9 As shown, it is related to an implementation method of determining the three-dimensional position of the ultrasound probe in the target three-dimensional image and / or the general three-dimensional model according to the two-dimensional ultrasound section and the two-dimensional position of the ultrasound probe on the two-dimensional ultrasound section. The steps of the implementation method include:
[0141] Step 900: Determine whether the two-dimensional ultrasound section is a standard section.
[0142] After acquiring the two-dimensional ultrasonic section of the object to be imaged, the computer device determines whether the two-dimensional ultrasonic section is a standard section. The description of determining whether the two-dimensional ultrasonic section is a standard section can refer to the specific description in the above embodiment, which will not be repeated here.
[0143] Step 910: When the two-dimensional ultrasound section is a standard section, determine second position information from a plurality of standard probe positions according to the two-dimensional ultrasound section.
[0144] Each standard probe corresponds to a standard section. If the computer device determines that the acquired two-dimensional ultrasonic section of the object to be imaged is a standard section, the second position information can be directly determined from multiple standard probe positions based on the two-dimensional ultrasonic section.
[0145] In an optional embodiment, the computer device may store a correspondence between the type of standard section and the standard probe position. The computer device may first determine that the two-dimensional ultrasound section belongs to the type of standard section, and determine the second position information according to the correspondence and the type of the standard section. The type of the standard section may be directly determined when determining whether the two-dimensional ultrasound section is a standard section, or may be determined by identifying the two-dimensional ultrasound section after determining that the two-dimensional ultrasound section is a standard section. This embodiment does not limit this, as long as its function can be achieved.
[0146] Step 920: When the two-dimensional ultrasound section is not a standard section, the two-dimensional ultrasound section is registered with the target three-dimensional image and / or the universal three-dimensional model to determine the second position information.
[0147] If the computer device determines that the two-dimensional ultrasonic section of the object to be imaged is not a standard section, the two-dimensional ultrasonic section can be registered with the target three-dimensional image to determine the second position information of the ultrasonic probe in the target three-dimensional image; the two-dimensional ultrasonic section can also be registered with the universal three-dimensional model to determine the second position information of the ultrasonic probe in the target three-dimensional image. For the description of registering the two-dimensional ultrasonic section with the target three-dimensional image and / or the universal three-dimensional model, reference can be made to the specific description in the above embodiments, which will not be repeated here.
[0148] In this embodiment, it is first determined whether the acquired two-dimensional ultrasonic section is a standard section; if the two-dimensional ultrasonic section is a standard section, the second position information is determined from multiple standard probe positions according to the two-dimensional ultrasonic section; if the two-dimensional ultrasonic section is not a standard section, the two-dimensional ultrasonic section is aligned with the target three-dimensional image and / or the universal three-dimensional model to determine the second position information. In this method, it is first determined whether the two-dimensional ultrasonic section is a standard section, and then the second position information of the ultrasonic probe in the target three-dimensional image and / or the universal three-dimensional model is determined. When the two-dimensional ultrasonic section is a standard section, the second position information is directly determined from multiple standard probes according to the standard section without alignment, which can improve the efficiency of determining the second position information of the ultrasonic probe.
[0149] An embodiment of the present application provides a three-dimensional image determination method, which is applied to an ultrasonic scanning system. The method comprises the following steps:
[0150] S1, obtaining a two-dimensional cardiac section of an object to be imaged;
[0151] S2, determining whether the two-dimensional cardiac section is a standard section;
[0152] S3. When the two-dimensional cardiac section is a standard section, an initial section is determined from a plurality of standard sections included in the universal three-dimensional cardiac model according to the two-dimensional cardiac section; the features of the initial section are consistent with the features of the two-dimensional cardiac section;
[0153] S4, when the two-dimensional heart section is not a standard section, registering the two-dimensional heart section with the universal three-dimensional heart model to determine an initial section;
[0154] S5, determining an initial three-dimensional image of the object to be imaged according to the initial section and the general three-dimensional model;
[0155] S6. determining a measurement size of a target area in the two-dimensional cardiac section according to the two-dimensional cardiac section;
[0156] S7, updating the size of the corresponding area in the initial three-dimensional image and / or the universal three-dimensional heart model according to the measured size of the target area, obtaining a target three-dimensional image and / or a target three-dimensional model; the target three-dimensional image is as follows: Fig.10 As shown, Fig.10 In the figure, the section indicated by the arrow is the target section. The target 3D model is as follows: Fig.11 shown.
[0157] S8. When the two-dimensional cardiac section is a standard section, determine second position information of the ultrasound probe in the target three-dimensional image and / or the universal three-dimensional model from a plurality of standard probe positions according to the two-dimensional cardiac section;
[0158] S9. When the two-dimensional cardiac section is not a standard section, register the two-dimensional cardiac section with the target three-dimensional image and / or the universal three-dimensional model to determine second position information;
[0159] S10, determining a two-dimensional deformation of the target area according to the measured sizes of the target area in the multiple two-dimensional cardiac sections obtained; the multiple two-dimensional cardiac sections are images at the same position of the object to be imaged;
[0160] S11, mapping the two-dimensional deformation to at least one of a target three-dimensional image, a general three-dimensional model, and a target three-dimensional model.
[0161] The three-dimensional image determination method provided in this embodiment can display the target three-dimensional image corresponding to the scanned two-dimensional heart section in real time, as well as the target three-dimensional model, can provide a structural schematic diagram of the target section, determine the position of the ultrasound probe, and facilitate the user to understand the current heart section structure information and the adjacent structure of the current heart section, and can assist the user in preoperative diagnosis, surgical planning, interventional intraoperative operation and postoperative evaluation, etc. In addition, it is convenient for ordinary users to understand the displayed target three-dimensional image and target three-dimensional model.
[0162] An embodiment of the present application provides an ultrasound imaging system, including an ultrasound probe and a computer device, wherein the computer device is used to execute the steps of the method shown in the above embodiment.
[0163] For the description of the ultrasonic imaging system, reference may be made to the specific description in the above embodiments, which will not be repeated here.
[0164] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.
[0165] Based on the same inventive concept, the embodiment of the present application also provides a 3D image determination device for implementing the 3D image determination method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in one or more 3D image determination device embodiments provided below can refer to the limitations of the 3D image determination method above, and will not be repeated here.
[0166] In one embodiment, Fig.12 As shown, a three-dimensional image determination device 10 is provided, comprising: an acquisition module 11 and a determination module 12, wherein:
[0167] The acquisition module 11 is used to acquire a two-dimensional ultrasonic section of the object to be imaged.
[0168] The determination module 12 is used to determine the measurement size of the target area in the two-dimensional ultrasonic section according to the two-dimensional ultrasonic section.
[0169] The determination module 12 is further used to determine a target three-dimensional image of the object to be imaged according to the measured size of the target area, the two-dimensional ultrasonic section and the general three-dimensional model; the characteristics of the target section of the target three-dimensional image are consistent with the characteristics of the two-dimensional ultrasonic section.
[0170] In one embodiment, the determination module 12 includes a first determination unit and an updating unit. The first determination unit is used to determine an initial three-dimensional image of the object to be imaged based on the two-dimensional ultrasound section and the general three-dimensional model; the updating unit is used to update the size of the corresponding area in the initial three-dimensional image according to the measured size of the target area to obtain a target three-dimensional image.
[0171] In one embodiment, the first determination unit is specifically used to register the two-dimensional ultrasound section with the universal three-dimensional model to determine an initial section in the universal three-dimensional model; and determine an initial three-dimensional image according to the initial section and the universal three-dimensional model.
[0172] In one embodiment, the first determination unit is specifically used to determine whether the two-dimensional ultrasound section is a standard section; when the two-dimensional ultrasound section is a standard section, an initial section is determined from multiple standard sections based on the two-dimensional ultrasound section; when the two-dimensional ultrasound section is not a standard section, the two-dimensional ultrasound section is aligned with the universal three-dimensional model to determine the initial section; and an initial three-dimensional image is determined based on the initial section and the universal three-dimensional model.
[0173] In one embodiment, the updating unit is further configured to update the size of the corresponding area in the general three-dimensional model according to the measured size of the target area, so as to obtain the target three-dimensional model of the object to be imaged.
[0174] In one embodiment, the three-dimensional image determination device 10 further includes an adjustment module. The determination module 12 is further used to determine the two-dimensional deformation of the target area according to the measured dimensions of the target area in the multiple two-dimensional ultrasonic slices obtained; the multiple two-dimensional ultrasonic slices are images at the same position of the object to be imaged; the adjustment module is used to adjust the target three-dimensional image and / or the general three-dimensional model based on the two-dimensional deformation.
[0175] In one embodiment, the determination module 12 is further configured to determine second position information of the ultrasound probe in the target three-dimensional image or the general three-dimensional model according to the two-dimensional ultrasound section and the first position information of the ultrasound probe on the two-dimensional ultrasound section.
[0176] In one embodiment, the determination module 12 includes a judgment unit, a second determination unit and a registration unit. The judgment unit is used to determine whether the two-dimensional ultrasound section is a standard section; the second determination unit is used to determine the second position information from a plurality of standard probe positions according to the two-dimensional ultrasound section when the two-dimensional ultrasound section is a standard section; the registration unit is used to register the two-dimensional ultrasound section with the target three-dimensional image and / or the universal three-dimensional model to determine the second position information when the two-dimensional ultrasound section is not a standard section.
[0177] In one embodiment, the three-dimensional image determination device 10 further includes a display module. The display module is used to display the two-dimensional ultrasound section and the target three-dimensional image on a display interface.
[0178] Each module in the above three-dimensional image determination device can be implemented in whole or in part by software, hardware, or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute operations corresponding to each module.
[0179] In one embodiment, a computer device is provided, whose internal structure diagram can be as follows: Figure 1 shown.
[0180] In one embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, the following steps are implemented:
[0181] Acquiring a two-dimensional ultrasonic section of an object to be imaged;
[0182] According to the two-dimensional ultrasound section, determining the measurement size of the target area in the two-dimensional ultrasound section;
[0183] A target three-dimensional image of the object to be imaged is determined according to the measured size of the target area, the two-dimensional ultrasonic section and the general three-dimensional model; the characteristics of the target section of the target three-dimensional image are consistent with the characteristics of the two-dimensional ultrasonic section.
[0184] In one embodiment, when the processor executes the computer program, the following steps are also implemented: determining an initial three-dimensional image of the object to be imaged based on the two-dimensional ultrasonic section and the general three-dimensional model; updating the size of the corresponding area in the initial three-dimensional image based on the measured size of the target area to obtain the target three-dimensional image.
[0185] In one embodiment, when the processor executes the computer program, the following steps are also implemented: aligning the two-dimensional ultrasound section with the universal three-dimensional model to determine the initial section in the universal three-dimensional model; and determining the initial three-dimensional image based on the initial section and the universal three-dimensional model.
[0186] In one embodiment, when the processor executes the computer program, the following steps are also implemented: determining whether the two-dimensional ultrasound section is a standard section; if the two-dimensional ultrasound section is a standard section, determining an initial section from multiple standard sections based on the two-dimensional ultrasound section; if the two-dimensional ultrasound section is not a standard section, aligning the two-dimensional ultrasound section with a universal three-dimensional model to determine the initial section; and determining an initial three-dimensional image based on the initial section and the universal three-dimensional model.
[0187] In one embodiment, when the processor executes the computer program, the following steps are further implemented: the size of the corresponding area in the general three-dimensional model is updated according to the measured size of the target area, so as to obtain a target three-dimensional model of the object to be imaged.
[0188] In one embodiment, when the processor executes the computer program, the following steps are also implemented: determining the two-dimensional deformation of the target area based on the measured dimensions of the target area in the multiple two-dimensional ultrasonic sections obtained; the multiple two-dimensional ultrasonic sections are images at the same position of the object to be imaged; and adjusting the target three-dimensional image and / or the general three-dimensional model based on the two-dimensional deformation.
[0189] In one embodiment, when the processor executes the computer program, the following steps are also implemented: determining the second position information of the ultrasound probe in the target three-dimensional image or the general three-dimensional model based on the two-dimensional ultrasound section and the first position information of the ultrasound probe on the two-dimensional ultrasound section.
[0190] In one embodiment, when the processor executes the computer program, the following steps are also implemented: determining whether the two-dimensional ultrasound section is a standard section; when the two-dimensional ultrasound section is a standard section, determining second position information from multiple standard probe positions based on the two-dimensional ultrasound section; when the two-dimensional ultrasound section is not a standard section, aligning the two-dimensional ultrasound section with the target three-dimensional image and / or the general three-dimensional model to determine the second position information.
[0191] In one embodiment, when the processor executes the computer program, the following steps are further implemented: displaying the two-dimensional ultrasound section and the target three-dimensional image on the display interface.
[0192] In one embodiment, a computer readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:
[0193] Acquiring a two-dimensional ultrasonic section of an object to be imaged;
[0194] According to the two-dimensional ultrasound section, determining the measurement size of the target area in the two-dimensional ultrasound section;
[0195] A target three-dimensional image of the object to be imaged is determined according to the measured size of the target area, the two-dimensional ultrasonic section and the general three-dimensional model; the characteristics of the target section of the target three-dimensional image are consistent with the characteristics of the two-dimensional ultrasonic section.
[0196] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: determining an initial three-dimensional image of the object to be imaged based on the two-dimensional ultrasound section and the general three-dimensional model; updating the size of the corresponding area in the initial three-dimensional image based on the measured size of the target area to obtain the target three-dimensional image.
[0197] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: aligning the two-dimensional ultrasound section with the universal three-dimensional model to determine the initial section in the universal three-dimensional model; and determining the initial three-dimensional image based on the initial section and the universal three-dimensional model.
[0198] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: determining whether the two-dimensional ultrasound section is a standard section; if the two-dimensional ultrasound section is a standard section, determining an initial section from multiple standard sections based on the two-dimensional ultrasound section; if the two-dimensional ultrasound section is not a standard section, aligning the two-dimensional ultrasound section with a universal three-dimensional model to determine the initial section; and determining an initial three-dimensional image based on the initial section and the universal three-dimensional model.
[0199] In one embodiment, when the computer program is executed by the processor, the following steps are further implemented: the size of the corresponding area in the general three-dimensional model is updated according to the measured size of the target area, so as to obtain a target three-dimensional model of the object to be imaged.
[0200] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented: determining the two-dimensional deformation of the target area based on the measured dimensions of the target area in the multiple two-dimensional ultrasonic sections obtained; the multiple two-dimensional ultrasonic sections are images at the same position of the object to be imaged; and adjusting the target three-dimensional image and / or the general three-dimensional model based on the two-dimensional deformation.
[0201] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: determining the second position information of the ultrasound probe in the target three-dimensional image or the general three-dimensional model based on the two-dimensional ultrasound section and the first position information of the ultrasound probe on the two-dimensional ultrasound section.
[0202] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: determining whether the two-dimensional ultrasound section is a standard section; when the two-dimensional ultrasound section is a standard section, determining second position information from multiple standard probe positions based on the two-dimensional ultrasound section; when the two-dimensional ultrasound section is not a standard section, aligning the two-dimensional ultrasound section with the target three-dimensional image and / or the general three-dimensional model to determine the second position information.
[0203] In one embodiment, when the computer program is executed by the processor, the following steps are further implemented: displaying the two-dimensional ultrasound section and the target three-dimensional image on the display interface.
[0204] In one embodiment, a computer program product is provided, comprising a computer program, which, when executed by a processor, implements the following steps:
[0205] Acquiring a two-dimensional ultrasonic section of an object to be imaged;
[0206] According to the two-dimensional ultrasound section, determining the measurement size of the target area in the two-dimensional ultrasound section;
[0207] A target three-dimensional image of the object to be imaged is determined according to the measured size of the target area, the two-dimensional ultrasonic section and the general three-dimensional model; the characteristics of the target section of the target three-dimensional image are consistent with the characteristics of the two-dimensional ultrasonic section.
[0208] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: determining an initial three-dimensional image of the object to be imaged based on the two-dimensional ultrasound section and the general three-dimensional model; updating the size of the corresponding area in the initial three-dimensional image based on the measured size of the target area to obtain the target three-dimensional image.
[0209] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: aligning the two-dimensional ultrasound section with the universal three-dimensional model to determine the initial section in the universal three-dimensional model; and determining the initial three-dimensional image based on the initial section and the universal three-dimensional model.
[0210] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: determining whether the two-dimensional ultrasound section is a standard section; if the two-dimensional ultrasound section is a standard section, determining an initial section from multiple standard sections based on the two-dimensional ultrasound section; if the two-dimensional ultrasound section is not a standard section, aligning the two-dimensional ultrasound section with a universal three-dimensional model to determine the initial section; and determining an initial three-dimensional image based on the initial section and the universal three-dimensional model.
[0211] In one embodiment, when the computer program is executed by the processor, the following steps are further implemented: the size of the corresponding area in the general three-dimensional model is updated according to the measured size of the target area, so as to obtain a target three-dimensional model of the object to be imaged.
[0212] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented: determining the two-dimensional deformation of the target area based on the measured dimensions of the target area in the multiple two-dimensional ultrasonic sections obtained; the multiple two-dimensional ultrasonic sections are images at the same position of the object to be imaged; and adjusting the target three-dimensional image and / or the general three-dimensional model based on the two-dimensional deformation.
[0213] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: determining the second position information of the ultrasound probe in the target three-dimensional image or the general three-dimensional model based on the two-dimensional ultrasound section and the first position information of the ultrasound probe on the two-dimensional ultrasound section.
[0214] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: determining whether the two-dimensional ultrasound section is a standard section; when the two-dimensional ultrasound section is a standard section, determining second position information from multiple standard probe positions based on the two-dimensional ultrasound section; when the two-dimensional ultrasound section is not a standard section, aligning the two-dimensional ultrasound section with the target three-dimensional image and / or the general three-dimensional model to determine the second position information.
[0215] In one embodiment, when the computer program is executed by the processor, the following steps are further implemented: displaying the two-dimensional ultrasound section and the target three-dimensional image on the display interface.
[0216] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., but are not limited to this.
[0217] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0218] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.
Claims
1. A three-dimensional image determination method, characterized in that: The method comprises: Acquiring a two-dimensional ultrasonic section of an object to be imaged; Determining a measurement size of a target area in the two-dimensional ultrasonic section according to the two-dimensional ultrasonic section; A target three-dimensional image of the object to be imaged is determined according to the measured size of the target area, the two-dimensional ultrasonic section and the universal three-dimensional model; the characteristics of the target section of the target three-dimensional image are consistent with the characteristics of the two-dimensional ultrasonic section.
2. The method according to claim 1, characterized in that Determining a target three-dimensional image of the object to be imaged according to the measured size of the target area, the two-dimensional ultrasonic section and the general three-dimensional model includes: Determining an initial three-dimensional image of the object to be imaged according to the two-dimensional ultrasound section and the general three-dimensional model; The size of the corresponding area in the initial three-dimensional image is updated according to the measured size of the target area to obtain the target three-dimensional image.
3. The method according to claim 2, characterized in that Determining the initial three-dimensional image of the object to be imaged according to the two-dimensional ultrasound section and the general three-dimensional model includes: Registering the two-dimensional ultrasonic section with the universal three-dimensional model to determine an initial section in the universal three-dimensional model; The initial three-dimensional image is determined according to the initial section and the general three-dimensional model.
4. The method according to claim 2, characterized in that: The universal three-dimensional model includes a plurality of standard sections, and determining the initial three-dimensional image of the object to be imaged according to the two-dimensional ultrasound section and the universal three-dimensional model includes: Determining whether the two-dimensional ultrasound section is a standard section; In the case where the two-dimensional ultrasonic section is the standard section, determining an initial section from a plurality of the standard sections according to the two-dimensional ultrasonic section; In the case where the two-dimensional ultrasound section is not the standard section, registering the two-dimensional ultrasound section with the universal three-dimensional model to determine the initial section; The initial three-dimensional image is determined according to the initial section and the general three-dimensional model.
5. The method according to claim 1, characterized in that The method further comprises: The size of the corresponding area in the general three-dimensional model is updated according to the measured size of the target area to obtain the target three-dimensional model of the object to be imaged.
6. The method according to any one of claims 1 to 5, characterized in that The method further comprises: Determining the two-dimensional deformation of the target area according to the measured sizes of the target area in the plurality of two-dimensional ultrasonic sections obtained; the plurality of two-dimensional ultrasonic sections are images at the same position of the object to be imaged; The target three-dimensional image and / or the general three-dimensional model is adjusted based on the two-dimensional deformation.
7. The method according to any one of claims 1 to 5, characterized in that The method further comprises: According to the two-dimensional ultrasonic section and the first position information of the ultrasonic probe on the two-dimensional ultrasonic section, the second position information of the ultrasonic probe in the target three-dimensional image or the universal three-dimensional model is determined.
8. The method according to claim 7, characterized in that The universal three-dimensional model includes a plurality of standard probe positions; determining the second position information of the ultrasound probe in the target three-dimensional image and / or the universal three-dimensional model according to the two-dimensional ultrasound section and the first position information of the ultrasound probe on the two-dimensional ultrasound section, comprises: Determining whether the two-dimensional ultrasound section is a standard section; In a case where the two-dimensional ultrasound section is the standard section, determining the second position information from a plurality of standard probe positions according to the two-dimensional ultrasound section; In the case that the two-dimensional ultrasound section plane is not the standard section plane, the two-dimensional ultrasound section plane is registered with the target three-dimensional image and / or the universal three-dimensional model to determine the second position information.
9. The method according to any one of claims 1 to 5, characterized in that The method further comprises: The two-dimensional ultrasonic section and the target three-dimensional image are displayed on a display interface.
10. A three-dimensional image determination device, characterized in that: The device comprises: An acquisition module, used for acquiring a two-dimensional ultrasonic section of an object to be imaged; A determination module, configured to determine a measurement size of a target area in the two-dimensional ultrasonic section according to the two-dimensional ultrasonic section; The determination module is also used to determine the target three-dimensional image of the object to be imaged based on the measured size of the target area, the two-dimensional ultrasonic section and the general three-dimensional model; the characteristics of the target section of the target three-dimensional image are consistent with the characteristics of the two-dimensional ultrasonic section.
11. An ultrasonic imaging system, characterized in that: The method comprises an ultrasound probe and a computer device, wherein the computer device is used to execute the steps of the method according to any one of claims 1 to 9.
Citation Information
Cited By
Systems and methods for generating three-dimensional ultrasound images based on two-dimensional ultrasound images
EP4756491A1