Method, device, computer equipment, and storage medium for determining the position of an ablation needle
By utilizing the elastic fusion processing and spatial mapping of medical imaging models in cryoablation, the problem of inconsistent ablation needle placement was solved, enabling precise placement of ablation needles and accurate repair of abnormal areas.
Patent Information
- Application Number
- CN202210461103.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-04-28
- Publication Date
- 2024-11-01
- Estimated Expiration
- 2042-04-28
AI Technical Summary
In cryoablation, the placement of the ablation needle is difficult to standardize, which makes it impossible to accurately repair abnormal areas and affects the accuracy of the treatment.
By acquiring medical image models before and after the biopsy procedure, elastic fusion processing is performed to determine the sampling point location. Then, the ablation needle is placed based on the spatial mapping relationship during the cryoablation procedure to achieve uniformity in the position of the ablation needle.
This improves the precision of cryoablation treatment, ensuring accurate repair of abnormal areas.
Smart Images

Figure CN114948176B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of image processing technology, and in particular to a method, apparatus, computer equipment, storage medium and computer program product for determining the position of an ablation needle. Background Art
[0002] With the development of image processing technology, after the operator performs a biopsy on a target site containing an abnormal area, it is necessary to perform cryoablation on the target site.
[0003] In traditional technology, when performing cryoablation, it is often necessary to re-determine the placement of the ablation needle, that is, the placement of the ablation needle needs to be re-planned. However, different operators will plan different treatment plans after performing a biopsy operation, that is, there may be multiple plans for the placement of ablation needles for the same sampling point. Therefore, it is impossible to unify the position of the ablation needle, and thus it is difficult to accurately repair the abnormal area, resulting in the problem of low accuracy of cryoablation treatment. Summary of the invention
[0004] Based on this, it is necessary to provide a method, apparatus, computer device, computer-readable storage medium and computer program product for determining the position of an ablation needle in order to solve the above-mentioned technical problems.
[0005] In a first aspect, the present application provides a method for determining the position of an ablation needle. The method comprises:
[0006] Acquire a first model constructed according to a first medical image, wherein the first medical image is acquired by capturing the target part before a biopsy operation;
[0007] Acquire a second model constructed based on a second medical image, wherein the second medical image is acquired by capturing the target site before a sampling step in a biopsy operation;
[0008] Performing a first elastic fusion process on the first model and the second model to determine a target part model corresponding to the target part, and determining position information of a sampling point based on the target part model;
[0009] Acquiring a third model constructed according to a third medical image, wherein the third medical image is acquired by capturing the target site before the ablation needle placement step in the cryoablation operation;
[0010] Performing a second elastic fusion process on the third model and the target part model to obtain a spatial mapping relationship between the third model and the target part model;
[0011] Based on the position information of the sampling points and the spatial mapping relationship, a target position point is determined, and the target position point is used for placement of an ablation needle in a cryoablation operation.
[0012] In a second aspect, the present application also provides a device for determining the position of an ablation needle. The device comprises:
[0013] Acquire a first model constructed according to a first medical image, wherein the first medical image is acquired by capturing the target part before a biopsy operation;
[0014] Acquire a second model constructed based on a second medical image, wherein the second medical image is acquired by capturing the target site before a sampling step in a biopsy operation;
[0015] Performing a first elastic fusion process on the first model and the second model to determine a target part model corresponding to the target part, and determining position information of a sampling point based on the target part model;
[0016] Acquiring a third model constructed according to a third medical image, wherein the third medical image is acquired by capturing the target site before the ablation needle placement step in the cryoablation operation;
[0017] Performing a second elastic fusion process on the third model and the target part model to obtain a spatial mapping relationship between the third model and the target part model;
[0018] Based on the position information of the sampling points and the spatial mapping relationship, a target position point is determined, and the target position point is used for placement of an ablation needle in a cryoablation operation.
[0019] In a third aspect, the present application further provides a computer device. The computer device includes a memory and a processor, the memory stores a computer program, and the processor implements the following steps when executing the computer program:
[0020] Acquire a first model constructed according to a first medical image, wherein the first medical image is acquired by capturing the target part before a biopsy operation;
[0021] Acquire a second model constructed based on a second medical image, wherein the second medical image is acquired by capturing the target site before a sampling step in a biopsy operation;
[0022] Performing a first elastic fusion process on the first model and the second model to determine a target part model corresponding to the target part, and determining position information of a sampling point based on the target part model;
[0023] Acquiring a third model constructed according to a third medical image, wherein the third medical image is acquired by capturing the target site before the ablation needle placement step in the cryoablation operation;
[0024] Performing a second elastic fusion process on the third model and the target part model to obtain a spatial mapping relationship between the third model and the target part model;
[0025] Based on the position information of the sampling points and the spatial mapping relationship, a target position point is determined, and the target position point is used for placement of an ablation needle in a cryoablation operation.
[0026] In a fourth aspect, the present application further provides a computer-readable storage medium. The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the following steps are implemented:
[0027] Acquire a first model constructed according to a first medical image, wherein the first medical image is acquired by capturing the target part before a biopsy operation;
[0028] Acquire a second model constructed based on a second medical image, wherein the second medical image is acquired by capturing the target site before a sampling step in a biopsy operation;
[0029] Performing a first elastic fusion process on the first model and the second model to determine a target part model corresponding to the target part, and determining position information of a sampling point based on the target part model;
[0030] Acquiring a third model constructed according to a third medical image, wherein the third medical image is acquired by capturing the target site before the ablation needle placement step in the cryoablation operation;
[0031] Performing a second elastic fusion process on the third model and the target part model to obtain a spatial mapping relationship between the third model and the target part model;
[0032] Based on the position information of the sampling points and the spatial mapping relationship, a target position point is determined, and the target position point is used for placement of an ablation needle in a cryoablation operation.
[0033] In a fifth aspect, the present application further provides a computer program product. The computer program product includes a computer program, and when the computer program is executed by a processor, the following steps are implemented:
[0034] Acquire a first model constructed according to a first medical image, wherein the first medical image is acquired by capturing the target part before a biopsy operation;
[0035] Acquire a second model constructed based on a second medical image, wherein the second medical image is acquired by capturing the target site before a sampling step in a biopsy operation;
[0036] Performing a first elastic fusion process on the first model and the second model to determine a target part model corresponding to the target part, and determining position information of a sampling point based on the target part model;
[0037] Acquiring a third model constructed according to a third medical image, wherein the third medical image is acquired by capturing the target site before the ablation needle placement step in the cryoablation operation;
[0038] Performing a second elastic fusion process on the third model and the target part model to obtain a spatial mapping relationship between the third model and the target part model;
[0039] Based on the position information of the sampling points and the spatial mapping relationship, a target position point is determined, and the target position point is used for placement of an ablation needle in a cryoablation operation.
[0040] The above-mentioned method, device, computer equipment, storage medium and computer program product for determining the position of the ablation needle are obtained by acquiring a first model constructed based on a first medical image, which is obtained by collecting the target part before the biopsy operation. In this way, based on the first model, the abnormal information of the target part before the biopsy operation is not performed can be reflected in real time. A second model constructed based on a second medical image is obtained by collecting the target part before the sampling step in the biopsy operation. In this way, the actual position of the target part during the biopsy operation can be accurately represented by the second model. The first elastic fusion processing is performed on the first model and the second model, and the target part model containing the abnormal information of the target part can be determined in the space where the biopsy operation is located. In this way, based on the target part model, the position information of the sampling point can be determined in real time and accurately, ensuring the authenticity of the position information of the sampling point. A third model constructed based on a third medical image is obtained, which is obtained by collecting the target part before the ablation needle placement step in the cryoablation operation. In this way, based on the third model, the position of the target part during the cryoablation operation can be accurately represented. The third model and the target part model are subjected to a second elastic fusion process to obtain a spatial mapping relationship between the third model and the target part model. In this way, based on the spatial mapping relationship, the target position point uniquely corresponding to each sampling point is reflected in real time, that is, the uniformity of the ablation needle position is achieved, thereby ensuring the consistency of the cryoablation treatment, and assisting professionals or equipment to achieve accurate repair treatment of the abnormal area of the target part, thereby greatly improving the accuracy of the cryoablation treatment. BRIEF DESCRIPTION OF THE DRAWINGS
[0041] Figure 1 It is a schematic diagram of a flow chart of a method for determining the position of an ablation needle in one embodiment;
[0042] Figure 2 is a schematic diagram of a biopsy operation in one embodiment;
[0043] Figure 3 A schematic diagram of example information of abnormal biopsy operation in one embodiment;
[0044] Figure 4 is a schematic diagram of a cryoablation operation in one embodiment;
[0045] Figure 5 A schematic diagram of a process for obtaining a first model step in an embodiment;
[0046] Figure 6 A schematic diagram of a flow chart of a step of determining a target part model in one embodiment;
[0047] Figure 7 is a schematic diagram of a biopsy operation in another embodiment;
[0048] Figure 8 A schematic diagram of a flow chart of steps for obtaining a spatial mapping relationship in one embodiment;
[0049] Fig. 9 is a schematic diagram of two spatial coordinate systems in one embodiment;
[0050] Fig.10 is a schematic diagram of a cryoablation operation in another embodiment;
[0051] Fig.11 A schematic diagram of determining a treatment point in one embodiment;
[0052] Fig.12 is a schematic diagram of a cryoablation operation in another embodiment;
[0053] Fig.13 A schematic diagram of determining a path plan in one embodiment;
[0054] Fig.14 A schematic diagram of a cryoablation process of a treatment point in one embodiment;
[0055] Fig.15 A schematic diagram of real-time monitoring of treatment points in one embodiment;
[0056] Fig.16 A schematic diagram of an operation scenario in an embodiment;
[0057] Fig.17A schematic diagram of a process for performing a biopsy operation and a cryoablation operation in one embodiment;
[0058] Fig.18 is a structural block diagram of a device for determining the position of an ablation needle in one embodiment;
[0059] Fig.19 FIG. 4 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION
[0060] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.
[0061] In one embodiment, Figure 1 As shown, a method for determining the position of an ablation needle is provided. This embodiment uses the method applied to a terminal as an example for illustration. It can be understood that the method can also be applied to a server, and can also be applied to a system including a terminal and a server, and is implemented through the interaction between the terminal and the server. In this embodiment, the method includes the following steps:
[0062] Step S102: acquiring a first model constructed according to a first medical image, where the first medical image is acquired by capturing the target part before a biopsy operation.
[0063] The medical image is an image of the internal tissue obtained by non-invasively examining the target object or a part of the target object. It should be noted that the first medical image is a medical image that can characterize an abnormal area in the target part. The abnormal area may be a lesion area. The biopsy operation is a live puncture operation on the target object or a part of the target object. The first model representation form is a 3D (3-Dimension) model.
[0064] Specifically, before the biopsy operation, the target part is collected by a first medical imaging device to obtain a first medical image, and the first medical imaging device sends the first medical image to the terminal. The terminal obtains a first model constructed according to the first medical image. The first medical imaging device is capable of collecting contour information and detail information of the target part and the abnormal area in the target part, that is, the first medical image contains the contour information and detail information of the target part and the abnormal area in the target part, that is, the first model can reflect the contour information and detail information of the target part and the abnormal area summarized in the target part before the biopsy operation.
[0065] For example, before the biopsy operation, the prostate is collected by a nuclear magnetic resonance device to obtain a first nuclear magnetic resonance image, and the nuclear magnetic resonance device sends the first nuclear magnetic resonance image to the terminal. The terminal obtains a first nuclear magnetic resonance model constructed according to the first nuclear magnetic resonance image. It should be noted that the target part can be a part of the human body, which is not specifically limited.
[0066] In the above example, the nuclear magnetic resonance device is the first medical imaging device, the first nuclear magnetic resonance image is the first medical image, and the first nuclear magnetic resonance model is the first model.
[0067] Step S104: acquiring a second model constructed according to a second medical image, wherein the second medical image is acquired by collecting data from the target site before the sampling step in the biopsy operation.
[0068] The second medical image is a medical image that can characterize the contour of the target part. The sampling step is one of the steps in the biopsy operation, and the sampling step is a step of taking a sample from the target part. In order to avoid misdiagnosis, the sampling step performs a large amount of sampling in the abnormal area and a small amount of sampling in the normal area of the target part. The second model representation form is a 3D (3-Dimension) model.
[0069] Specifically, before the sampling step is performed during the biopsy operation, the second medical image is acquired by a second medical imaging device from the target part, and the second medical imaging device sends the second medical image to the terminal. The terminal obtains a second model constructed based on the second medical image. The second medical image acquired during the biopsy operation can only acquire the contour information of the target part. That is, the second model can reflect the contour information of the target part in the biopsy operation.
[0070] For example, during a biopsy operation, before a sampling step is performed, a first ultrasound image is acquired by collecting the prostate through a first ultrasound device, and the first ultrasound device sends the first ultrasound image to a terminal. The terminal acquires a first ultrasound model constructed according to the first ultrasound image.
[0071] In the above example, the first ultrasound device is the second medical imaging device, the first ultrasound image is the second medical image, and the first ultrasound model is the second model.
[0072] Step S106 , performing a first elastic fusion process on the first model and the second model to determine a target part model corresponding to the target part, and determining position information of the sampling point based on the target part model.
[0073] Among them, the elastic fusion processing is to fuse the models of two different coordinate systems.
[0074] Specifically, the terminal performs a first elastic fusion process on the first model and the second model, and determines a target part model corresponding to the target part in the biopsy operation, which takes the coordinate system of the second model as the reference coordinate system. The target part model includes contour information and detail information of the target part and the abnormal area in the target part. Based on the target part model, the position information of the sampling point is determined. The terminal uses the target part model and the position information of the sampling point as abnormal instance information, and saves the abnormal instance information.
[0075] In one embodiment, if Figure 2 As shown, before the biopsy operation, the nuclear magnetic resonance image is input into the terminal, and the terminal performs three-dimensional image modeling based on the first nuclear magnetic resonance image to obtain a first nuclear magnetic resonance model. During the biopsy operation, the first ultrasound and other real-time images are input into the terminal, and the terminal performs three-dimensional image modeling based on the first ultrasound and other real-time images to obtain a first ultrasound model. The terminal performs a first elastic fusion processing on the first nuclear magnetic resonance model and the first ultrasound model to obtain a first prostate fusion model. Based on the first prostate fusion model, the plan for biopsy puncture sampling is determined, and the sampling points to be sampled are determined. The operator uses the machine to assist in locating the sampling points to be sampled, and performs biopsy puncture sampling to complete the biopsy operation. At the same time, the terminal uses the target site model and the location information of the sampling points as abnormal instance information, that is, Figure 2 Biopsy procedure cases.
[0076] Among them, in the above embodiment, the first prostate fusion model is the target site model.
[0077] Among them, Figure 3 Schematic diagram of example information of abnormal biopsy operation shown, wherein: Figure 3 The data format of the abnormal example information is given as an example, wherein the abnormal example information includes target part, sampling point information, depth coordinate information, plane coordinate information, etc. The abnormal example information is saved and output as an XML file.
[0078] Step S108, obtaining a third model constructed according to a third medical image, wherein the third medical image is acquired by capturing the target site before the ablation needle placement step in the cryoablation operation.
[0079] The third medical image is a medical image representing the contour of the target site during the cryoablation operation. The cryoablation operation is an operation in which the temperature of the ablation site is reduced and abnormal electrophysiological cell tissue is destroyed by evaporating the liquid refrigerant and taking away the heat of the tissue. The ablation needle placement step is one of the steps in the cryoablation operation, and the ablation needle placement step is a step of placing the ablation needle at the location where ablation is required. The third model representation form is a 3D (3-Dimension) model.
[0080] Specifically, before the ablation needle placement step is performed in the cryoablation operation, a third medical image is acquired by collecting the target part through a third medical imaging device. The third medical image sends the third medical imaging device to the terminal. The terminal obtains a third model constructed according to the third medical image. The third medical image collected in the cryoablation operation can characterize the contour information of the target part during the cryoablation operation.
[0081] For example, during the cryoablation operation, before the ablation needle placement step is performed, a second ultrasound image is acquired by a second ultrasound device on the prostate. The second ultrasound device sends the second ultrasound image to the terminal. The terminal obtains a second ultrasound model constructed according to the second ultrasound image.
[0082] In the above example, the second ultrasound device is the third medical imaging device, the second ultrasound image is the third medical image, and the second ultrasound model is the third model.
[0083] Step S110: performing a second elastic fusion process on the third model and the target part model to obtain a spatial mapping relationship between the third model and the target part model.
[0084] Specifically, the terminal performs a second elastic fusion process on the third model and the target part model to obtain a model to be processed corresponding to the target part with the coordinate system of the third model as the basic coordinate system in the cryoablation operation, and a spatial mapping relationship between the third model and the target part model. The spatial mapping relationship can reflect the mapping of all points of the third model to all points of the target part model.
[0085] It should be noted that the third model is the model in the cryoablation operation, and the target part model is the model in the biopsy operation. Obviously, the coordinate systems of the third model and the target part model are different. The coordinate system of the target part model can be matched with the third model through the second elastic fusion process.
[0086] It should be noted that, since the target site model includes the contour information and detail information of the target site and the abnormal area in the target site, after the second elastic fusion processing, the model to be processed in the cryoablation operation also includes the contour information and detail information of the target site and the abnormal area in the target site.
[0087] Step S112, determining a target position point based on the position information of the sampling point and the spatial mapping relationship, wherein the target position point is used for placement of an ablation needle in a cryoablation operation.
[0088] The target position point is the treatment point in the cryoablation operation, that is, the point where the ablation needle is placed.
[0089] Specifically, the terminal determines the target position point corresponding to the sampling point in the cryoablation operation based on the position information of the sampling point and the spatial mapping relationship. For example, in the biopsy operation, the sampling point is determined to be the position information (x1, y1, z1) of point A, and the position information is obtained in the biopsy operation with the coordinate system of the second model as the reference coordinate system. Based on the spatial mapping relationship, the coordinates of the target position point in the cryoablation operation can be determined.
[0090] In one embodiment, if Figure 4 As shown, the terminal obtains the abnormal example information of the terminal operation, that is, the corresponding Figure 4 The case input in the abnormal example information includes the first prostate fusion model. The terminal obtains the second ultrasound and other real-time images during the cryoablation operation, and performs three-dimensional image modeling based on the second ultrasound and other real-time images to obtain a second ultrasound model. The terminal performs a second elastic fusion process on the first prostate fusion model and the second ultrasound model to obtain a coordinate system automatic conversion algorithm and a model to be processed, that is, Figure 4 The terminal determines the spatial mapping relationship based on the coordinate system automatic conversion algorithm, and determines the target position point in the cryoablation operation based on the position information of the sampling point and the spatial mapping relationship. Based on the target position point, the target position point (i.e., the corresponding Figure 4 The operator uses the machine to assist in positioning at the target location and performs cryoablation treatment to complete the cryoablation operation.
[0091] In the above-mentioned method for determining the position of the ablation needle, a first model constructed according to a first medical image is obtained, and the first medical image is obtained by collecting the target part before the biopsy operation. In this way, based on the first model, the abnormal information of the target part before the biopsy operation is not performed can be reflected in real time. A second model constructed according to a second medical image is obtained, and the second medical image is obtained by collecting the target part before the sampling step in the biopsy operation. In this way, the actual position of the target part during the biopsy operation can be accurately represented by the second model. The first elastic fusion processing is performed on the first model and the second model, and the target part model containing the abnormal information of the target part can be determined in the space where the biopsy operation is located. In this way, based on the target part model, the position information of the sampling point can be determined in real time and accurately, ensuring the authenticity of the position information of the sampling point. A third model constructed according to a third medical image is obtained, and the third medical image is obtained by collecting the target part before the ablation needle placement step in the cryoablation operation. In this way, based on the third model, the position of the target part during the cryoablation operation can be accurately represented. The third model and the target part model are subjected to a second elastic fusion process to obtain a spatial mapping relationship between the third model and the target part model. In this way, based on the spatial mapping relationship, the target position point uniquely corresponding to each sampling point is reflected in real time, that is, the uniformity of the ablation needle position is achieved, thereby ensuring the consistency of the cryoablation treatment, and assisting professionals or equipment to achieve accurate repair treatment of the abnormal area of the target part, thereby greatly improving the accuracy of the cryoablation treatment.
[0092] In one embodiment, Figure 5 As shown, the step of acquiring a first model constructed according to a first medical image includes:
[0093] Step S502: Before the biopsy operation, a multi-dimensional medical scan process is performed on the target part to obtain a plurality of first medical images.
[0094] The medical scan is an operation of scanning a target part, and the medical scan may be a nuclear magnetic resonance sampling, or a CT (Computed Tomography) scan, etc., without specific limitation.
[0095] Specifically, before the biopsy operation, a multi-dimensional medical scan is performed on the target part by a first medical imaging device to obtain a plurality of first medical images of different dimensions. The first medical mapping device sends the plurality of first medical images to the terminal. The multi-dimensional medical scan starts from the top of the target part and ends at the bottom of the target part, and plane interception is performed from the starting point to the end point in sequence, that is, the multi-dimensional medical scan can be seen to collect different depths of the target part.
[0096] For example, before the biopsy operation, the prostate is collected in multiple dimensions by a nuclear magnetic resonance device to obtain first nuclear magnetic resonance images of different dimensions. The nuclear magnetic resonance device sends the multiple first nuclear magnetic resonance images to the terminal.
[0097] Step S504: based on each first medical image, outlining the target part and the abnormal area in the target part to obtain a first model.
[0098] Specifically, for each first medical image, the target part in the corresponding first medical image and the abnormal area in the target part are outlined to obtain a first outline result corresponding to the corresponding first medical image. Modeling is performed based on each first outline result to obtain a first model.
[0099] For example, for each first nuclear magnetic resonance image, the prostate and abnormal area of the corresponding first nuclear magnetic resonance image are outlined to obtain a first outlined image corresponding to the corresponding first nuclear magnetic resonance image. The terminal performs modeling processing based on each first outlined image to obtain a first nuclear magnetic resonance model.
[0100] In this embodiment, by performing medical scanning processing on the target part in multiple dimensions, a first model with rich information before the biopsy operation can be obtained, thereby improving the credibility of the first model.
[0101] In one embodiment, the second model constructed based on the second medical image is obtained, including: before the sampling step in the biopsy operation, performing ultrasonic sampling processing on the target part in multiple dimensions to obtain multiple second medical images. Based on each second medical image, the target part is outlined to obtain the second model.
[0102] Specifically, before the sampling step is performed during the biopsy operation, a second medical imaging device performs multi-dimensional ultrasonic sampling on the target part to obtain a plurality of second medical images of different dimensions. The second medical mapping device sends the plurality of second medical images to the terminal. For each second medical image, the target part in the corresponding second medical image is outlined to obtain a second outline result corresponding to the corresponding second medical image. Modeling is performed based on each second outline result to obtain a second model.
[0103] Among them, the multi-dimensional ultrasonic sampling starts from the top of the target part and ends at the bottom of the target part. Plane interception is performed from the starting point to the end point in sequence. That is, the multi-dimensional ultrasonic sampling can be seen as ultrasonic sampling of different depths of the target part.
[0104] For example, before the biopsy operation, a first ultrasound device performs multi-dimensional ultrasound sampling on the prostate to obtain first ultrasound images of different dimensions. The ultrasound device sends multiple first ultrasound images to the terminal. For each first ultrasound image, the prostate of the corresponding first ultrasound image is outlined to obtain a second outlined image corresponding to the corresponding first ultrasound image. The terminal performs modeling processing based on each second outlined image to obtain a first ultrasound model.
[0105] In this embodiment, before the sampling step in the biopsy operation, by performing multi-dimensional ultrasonic sampling on the target part, a model with rich detail information in each dimension can be obtained, thereby improving the credibility of the second model, thereby facilitating obtaining a more accurate target part model corresponding to the target part.
[0106] In one embodiment, Figure 6 As shown, the first model and the second model are subjected to a first elastic fusion process to determine a target part model corresponding to the target part, including:
[0107] Step S602: The coordinate system where the second model is located is used as a first reference coordinate system, and a first coordinate system to be processed where the first model is located is determined.
[0108] It should be noted that the first model and the second model are obtained before and during the biopsy operation, respectively. The two models are in different coordinate systems, that is, the two coordinate systems do not match.
[0109] Step S604: Based on the first reference coordinate system and the first coordinate system to be processed, coordinate transformation is performed on the first model to obtain a processed first model; wherein the coordinate system of the processed first model matches the first reference coordinate system.
[0110] The coordinate conversion is an operation of converting coordinates in one coordinate system to another coordinate system, and the coordinate conversion mainly involves translation processing, rotation processing, and scaling processing.
[0111] Specifically, the terminal performs translation, rotation, scaling, translation and rotation, translation and scaling, rotation and scaling, or one of the coordinate transformations in translation and rotation and scaling on the first model based on the first reference coordinate system to obtain the processed first model and first processed data.
[0112] Among them, translation and rotation processing involves translation processing and rotation processing; translation and scaling processing involves translation processing and scaling processing; rotation and scaling processing involves rotation processing and scaling processing; translation and rotation and scaling processing involves translation processing, rotation processing and scaling processing. Coordinate transformation includes translation processing, rotation processing, scaling processing, translation and rotation processing, translation and scaling processing, rotation and scaling processing, and translation and rotation and scaling processing.
[0113] Step S606: performing first contour fitting on the processed first model based on the contour information of the first model to determine a target part model corresponding to the target part.
[0114] Specifically, the terminal obtains the contour information of the first model, which is the contour information of the target part and the contour information of the abnormal area in the first model. The terminal uses the contour information of the first model as the first standard contour information, performs a first contour fitting on the processed contour information of the first model according to the first standard contour information, and obtains a target part model corresponding to the target part.
[0115] The first standard contour information may be physical information representing shape, length, depth, etc., and is not specifically limited. For example, the contour information of the target part in the first model may be information such as the prostate's concavity and convexity, length, etc. The contour information of the abnormal area in the first model may be information such as the prostate's concavity and convexity, length, etc.
[0116] In this embodiment, the first model is subjected to a coarse-grained processing of coordinate transformation so that the processed first model is matched in the first reference system. The processed first model is subjected to a first contour fitting and further subjected to a fine-grained processing to obtain a target part model with rich and accurate detail information. In this way, under the premise of ensuring the accuracy of the physical position of the target part model, the target part detail information and the abnormal area detail information are greatly enriched, thereby ensuring the validity and accuracy of the target part model.
[0117] In one embodiment, based on the first reference coordinate system and the first coordinate system to be processed, the first model is subjected to coordinate transformation to obtain a processed first model, including: based on the first reference coordinate system and the first coordinate system to be processed, the first model is subjected to translation and rotation processing to obtain a processed first model.
[0118] Specifically, the terminal translates and rotates the first model based on the first reference coordinate system to obtain a processed first model and first processed data.
[0119] The first processed data includes an intermediate translation amount and an intermediate rotation matrix corresponding to the translation and rotation processing performed on the first model, wherein the translation and rotation processing is characterized as translation and rotation processing.
[0120] In this embodiment, the coordinate system of the second model is used as the first coordinate system to be processed, and based on the first coordinate system to be processed, the first model containing complete information is coarse-grainedly processed by translation and rotation to ensure that the coordinate system of the processed first model matches the first reference coordinate system.
[0121] In one embodiment, if Figure 7 As shown, this embodiment is performed in the environment of a biopsy operation performed during a biopsy operation. Specifically, the nuclear magnetic resonance module in the terminal outlines the prostate and abnormal areas in each first nuclear magnetic resonance image to obtain a first nuclear magnetic resonance model. The operation control module in the terminal scans and models multiple first ultrasound images to obtain a first ultrasound model. Among them, the scanning modeling process corresponds to the outline process. The operation control module in the terminal performs a first elastic fusion process and a first contour fitting process on the first nuclear magnetic resonance model and the first ultrasound model to obtain a first prostate fusion model. The operation control module in the terminal performs biopsy puncture sampling point planning based on the first prostate fusion model to obtain the location information of the sampling point. Based on the sampling point planning, the operator performs biopsy puncture sampling through machine-assisted positioning to complete the biopsy operation. The operation control module in the terminal sends the first prostate fusion model and the location information of the sampling point (i.e., the location coordinates of the biopsy puncture in the corresponding figure) to the biopsy operation case module of the terminal. The biopsy operation case module of the terminal uses the first prostate fusion model and the location information of the sampling point as case data, and presents it in the form of a case document, and saves the case temperature data.
[0122] In this embodiment, the first nuclear magnetic resonance model obtained by performing nuclear magnetic resonance acquisition on the prostate before the biopsy operation can intuitively and truly restore the detailed information of the prostate and the abnormal area in the prostate before the biopsy operation. By performing ultrasound acquisition on the prostate before the sampling step in the biopsy operation, the first ultrasound model in the coordinate system where the biopsy operation is located is obtained. By performing elastic fusion processing on the first nuclear magnetic resonance model and the first ultrasound model, a first prostate fusion model containing prostate information and abnormal area information of the prostate is obtained. In this way, the coordinate systems of the two models are unified, and at the same time, the information of the abnormal area of the prostate in the first prostate fusion model is enriched, which greatly ensures the effectiveness and accuracy of the first prostate fusion model.
[0123] In one embodiment, Figure 8 As shown, the third model and the target part model are subjected to a second elastic fusion process to obtain a spatial mapping relationship between the third model and the target part model, including:
[0124] Step S802: The coordinate system where the third model is located is used as a second reference coordinate system, and a second coordinate system to be processed where the target part model is located is determined.
[0125] It should be noted that the third model and the target site model are obtained in the cryoablation operation and the biopsy operation respectively, that is, the two models are in different coordinate systems, that is, the two coordinate systems do not match. Fig. 9 As shown, the coordinate system of the third model is the cryoablation space coordinate system, and the coordinate system of the target part model is the biopsy operation space coordinate system. It should be noted that the second to-be-processed coordinate system where the target part model is located is the first reference coordinate system in the biopsy operation space.
[0126] Step S804, based on the second reference coordinate system and the second coordinate system to be processed, coordinate transformation is performed on the target part model to obtain a processed target part model; wherein the coordinate system of the processed target part model matches the second reference coordinate system.
[0127] The coordinate conversion is an operation of converting coordinates in one coordinate system to another coordinate system, and the coordinate conversion mainly involves translation processing, rotation processing, and scaling processing.
[0128] Specifically, the terminal performs translation processing, and / or rotation processing, or scaling processing, or translation and rotation processing, or translation and scaling processing, or rotation and scaling processing, or one of the coordinate transformations in translation and rotation and scaling processing on the target part model based on the second reference coordinate system to obtain a processed target part model and second processing data.
[0129] Among them, translation and rotation processing involves translation processing and rotation processing; translation and scaling processing involves translation processing and scaling processing; rotation and scaling processing involves rotation processing and scaling processing; translation and rotation and scaling processing involves translation processing, rotation processing and scaling processing. Coordinate transformation includes translation processing, rotation processing, scaling processing, translation and rotation processing, translation and scaling processing, rotation and scaling processing, and translation and rotation and scaling processing.
[0130] Step S806: Based on the processed contour information of the target part model, a second contour fitting is performed on the contour information of the third model to obtain a spatial mapping relationship between the third model and the target part model.
[0131] The spatial mapping relationship is represented by a fusion formula in which the independent variable is the coordinates of each point in the target part model and the dependent variable is the coordinates of each point in the third model.
[0132] Specifically, based on the contour information of the processed target part model, the contour information of the third model is subjected to second contour fitting to obtain a model to be processed and fitting parameters, and a spatial mapping relationship between the third model and the target part model is constructed based on the fitting parameters.
[0133] The fitting parameter may be a rotation matrix, a translation parameter, or a scaling parameter, etc., which is not specifically limited.
[0134] In this embodiment, the target part model is subjected to coarse-grained processing of coordinate transformation so that the processed target part model is matched in the second reference coordinate system. By performing second contour fitting on the third model, the mapping between the points in the biopsy operation space and the points in the cryoablation space can be accurately and effectively achieved, greatly improving the accuracy of subsequent cryoablation operations.
[0135] In one embodiment, based on the second reference coordinate system and the second coordinate system to be processed, the target part model is subjected to coordinate transformation to obtain a processed target part model, including: based on the second reference coordinate system and the second coordinate system to be processed, the target part model is subjected to translation and rotation processing to obtain a processed target part model.
[0136] Specifically, the terminal performs translation and rotation processing on the target part based on the second reference coordinate system and the second coordinate system to be processed to obtain a processed target part model and second processing data. The second processing data includes translation parameters to be optimized and rotation parameters to be optimized. The translation and rotation processing is characterized as translation and rotation processing.
[0137] In this embodiment, the coordinate system of the third model of the space where the freezing operation is performed is used as the second reference coordinate system, and the target part model containing complete information is coarse-grainedly processed by translation and rotation to ensure that the coordinate system of the processed target part model matches the second reference coordinate system. At the same time, the translation parameters to be optimized and the rotation parameters to be optimized are obtained.
[0138] In one embodiment, based on the contour information of the processed target part model, the contour information of the third model is subjected to a second contour fitting to obtain a spatial mapping relationship between the third model and the target part model, including: based on the contour information of the processed target part model, the contour information of the third model is subjected to a second contour fitting to obtain a rotation matrix and a translation parameter. Based on the rotation matrix and the translation parameter, a spatial mapping relationship between the third model and the target part model is constructed.
[0139] The spatial mapping relationship is represented by a fusion formula in which the independent variable is the coordinates of each point in the target part model and the dependent variable is the coordinates of each point in the third model.
[0140] Specifically, the terminal obtains the contour information of the processed target part model, and the contour information of the processed target part model is the contour information of the target part. The terminal uses the contour information of the processed target part model as the second standard contour information, and performs contour fitting on the contour information of the third model according to the second standard contour information to obtain the model to be processed, the translation parameters, and the rotation matrix. It should be noted that in the process of contour fitting, the translation parameters to be optimized and the rotation parameters to be optimized will be optimized to obtain the rotation matrix and the translation parameters. The terminal constructs a fusion formula between the third model and the target model based on the translation parameters and the rotation matrix. Among them, the fusion formula is as follows:
[0141]
[0142] Among them, (x 0 ,y 0 , z 0 ) is the sampling point of the biopsy operation space coordinate system, that is, each point in the target site model. (x, y, z) is the treatment point of the cryoablation space coordinate system, that is, each point in the third model. M is the rotation matrix from the biopsy operation space coordinate system to the cryoablation operation space coordinate system, (x t0 ,y t0 , z t0 ) is the translation parameter from the biopsy operation space coordinate system to the cryoablation operation space coordinate system.
[0143] In this embodiment, by performing a second contour fitting on the third model, the translation parameters to be optimized and the rotation parameters to be optimized can be optimized, thereby obtaining accurate rotation matrix and translation parameters. Furthermore, the mapping between points in the biopsy operation space and points in the cryoablation space can be accurately and effectively achieved, greatly improving the accuracy of subsequent cryoablation operations.
[0144] In one embodiment, if Fig.10As shown, the terminal obtains an encrypted biopsy operation case and obtains the second ultrasound and other implementation images in the cryoablation operation. Based on the encrypted biopsy operation case, the terminal determines the patient that matches the encrypted biopsy operation case, and decrypts the data of the encrypted biopsy operation case to obtain the decrypted case, which contains the first prostate fusion model. The terminal performs three-dimensional image modeling on the second ultrasound and other real-time images to obtain a second ultrasound model. The terminal performs a second elastic fusion processing on the first prostate fusion model and the second ultrasound model to obtain a fusion formula and a second prostate fusion model (corresponding to the model to be processed), and outputs the fusion formula and the second prostate fusion model. Based on the position of the sampling point in the target site model, the position of the treatment point in the third model is determined by the fusion formula. As shown Fig.11 As shown in the figure, (a) shows the sampling point after the puncture needle enters the prostate. (b) of the figure is a schematic diagram of the prostate without any operation, and (c) of the figure is based on the fusion formula and the sampling point position of the biopsy operation space, and the treatment point after the ablation needle enters the prostate in the cryoablation space is determined.
[0145] In this embodiment, the coordinate system of the third model in the space where the freezing operation is located is used as the second reference coordinate system, and the target part model containing the complete information is subjected to coarse-grained processing of translation and rotation, so as to ensure that the coordinate system of the processed target part model matches the second reference coordinate system, and at the same time, the translation parameters to be optimized and the rotation parameters to be optimized are obtained. By performing the second contour fitting on the third model, the translation parameters to be optimized and the rotation parameters to be optimized can be optimized, thereby obtaining accurate rotation matrix and translation parameters, and further, the mapping between the points in the biopsy operation space and the points in the cryoablation space can be accurately and effectively realized, which greatly improves the accuracy of subsequent cryoablation operations.
[0146] In one embodiment, if Fig.12As shown, this embodiment is performed in the environment of a cryoablation operation. Specifically, the operation control module in the terminal scans and models each second ultrasound image to obtain a second ultrasound model. The operation control module in the terminal performs a second elastic fusion process and a second contour fitting process on the second ultrasound model and the first prostate fusion model to obtain a second prostate fusion model and a rotation matrix and translation parameters. The coordinate system algorithm module of the terminal constructs a spatial mapping relationship between the first prostate fusion model and the second ultrasound model based on the rotation matrix and translation parameters. Based on the spatial mapping relationship, the coordinate system algorithm module of the terminal automatically converts the sampling points in the biopsy operation into the treatment points of the cryoablation operation, and automatically plans the treatment point path. The operation control module of the terminal receives the treatment point path sent by the coordinate system algorithm module, and based on the treatment point path, implements the planning of each treatment point. Combined with the positioning and control of the robotic arm (i.e., the corresponding machine positioning and treatment control in the figure), the terminal's cryoablation module automatically inserts the ablation needle to the treatment point and controls the equipment to perform freezing and rewarming operations until the cryoablation operation at the current treatment point is completed. Then, the terminal's cryoablation module instructs the ablation needle at the current treatment point to automatically withdraw.
[0147] In this embodiment, ultrasound acquisition is performed on the prostate during cryoablation to obtain a second ultrasound model that truly reflects the position of the prostate during the cryoablation process. The spatial mapping relationship is determined by elastic fusion of the first prostate fusion model containing detailed information of the prostate and abnormal areas and the second ultrasound model, thereby achieving the unification of the treatment points of the cryoablation operation. In this way, based on the unified position of the ablation needle, accurate treatment of the abnormal area of the target site can be achieved, that is, the accuracy of cryoablation treatment is greatly improved.
[0148] In one embodiment, after the target position point is determined based on the position information of the sampling point and the spatial mapping relationship, the method further includes: determining the position information of each target position point through position calculation based on the position information of the target position point. Determine the length of the ablation needle, and determine the needle insertion depth information of each target position point based on the length of the ablation needle. Based on the position information of each target position point, simulate the movement of the ablation needle during the cryoablation operation, determine multiple total motion paths corresponding to the movement of the ablation needle to each target position point, and use the smallest total motion path as the target total motion path. Determine the path planning based on the target total motion path, the position information of each target position point, and the needle insertion depth information; the path planning is used to instruct the robotic arm to place the ablation needle at each target position point according to the path planning.
[0149] Specifically, the terminal determines the posture information of each target position point through posture calculation based on the position information of the target position point, and the posture information is used to indicate the direction of the ablation needle at the target position point. The terminal determines the model of the ablation needle based on the volume of the abnormal area of the target part, and determines the length of the ablation needle based on the model of the ablation needle. The terminal determines the needle insertion depth information of each target position point based on the length of the ablation needle. The needle insertion depth information is the required needle insertion depth of the ablation needle at the target position point. The terminal automatically plans the longitudinal path of the ablation needle at the target position point based on the posture information and needle insertion depth information of each target position point. Based on the position information of each target position point, the terminal simulates the movement of the ablation needle in the cryoablation operation, and determines multiple total motion paths corresponding to the movement of the ablation needle to each target position point. The terminal optimizes the motion path based on each total motion path, and takes the smallest total motion path as the target total motion path.
[0150] For example, there are three treatment points B, C, and D. Based on the position information of the three treatment points, it is determined that point C is between point B and point C. Then, the distance between any two points is determined, where BC and CB are the distances between point B and point C; CD and DC are the distances between point C and point D; BD and DB are the distances between point B and point D. The terminal determines two total motion paths, total motion path 1 is BC+CD; total motion path 2 is BD+DC. If total motion path 1 is less than path 2 in motion, total motion path 1 is used as the target total motion path, and the target total motion path is used to determine the next treatment point through the previous treatment point.
[0151] In this embodiment, the position information of the target position point can be used to determine the position information of the ablation needle at each target position point and the needle insertion depth information during the ablation needle placement step, thereby realizing longitudinal control of each target position point during the ablation needle insertion step. Based on the position information of the target position point, the minimum total movement path of the ablation needle to each target position point is determined, thereby realizing lateral control of each target position point during the ablation needle placement step. In this way, while ensuring the precise treatment of the ablation needle, the time cost of the cryoablation operation is greatly reduced.
[0152] In one embodiment, after determining the path planning based on the total target motion path, the position information of each target position point, and the needle insertion depth information, the method further includes: determining the ablation effect corresponding to the path planning, and making an effective judgment on the path planning based on the ablation effect. If the effective judgment result is characterized as passed, the path planning is determined to be an effective path planning.
[0153] Specifically, the terminal simulates the insertion operation of the ablation needle by the robotic arm at each treatment point according to the longitudinal path of the ablation needle at the treatment point and the total target motion path. After simulating the placement of the ablation needle at all treatment points, the terminal determines whether the cryoablation range covers all target position points. If the cryoablation range does not cover all target position points, the effective judgment is determined to be failed, and the terminal selects another target position point in the target part model, and returns to the step of determining the posture information of the target position point through posture calculation based on the position information of the target position point to continue execution. If the cryoablation range covers all target position points, the effective judgment is determined to be passed, and the path planning is determined to be completed, that is, the path planning is effective. Among them, the treatment point is the target position point.
[0154] In one embodiment, if Fig.13 As shown, based on the sampling points and spatial mapping relationship of the biopsy operation space, the terminal automatically generates the treatment points of the cryoablation operation space, and based on the determined position information of the treatment points, the terminal marks all the treatment points in the coordinate system of the cryoablation space. The terminal determines the position information of the treatment points through posture calculation according to the position information of the treatment points, and the posture information is used to indicate the direction of the ablation needle at the treatment point. The terminal determines the model of the ablation needle according to the volume of the abnormal area of the target site, and determines the length of the ablation needle based on the model of the ablation needle. The terminal determines the needle insertion depth information of each treatment point according to the length of the ablation needle. The needle insertion depth information is the required needle insertion depth of the ablation needle at the target position point. Based on the posture information and needle insertion depth information of each treatment point, the terminal automatically plans the longitudinal path of the ablation needle at the treatment point. Based on the position information of each treatment point, the terminal simulates the movement of the ablation needle in the cryoablation operation, and determines the multiple total movement paths corresponding to the movement of the ablation needle to each target position point. The terminal globally optimizes all treatment points based on each total motion path, and takes the minimum total motion path as the target total motion path. Among them, the target total motion path can determine the next treatment point based on the current treatment point. The robotic arm inserts the ablation needle into each treatment point according to the longitudinal path of the ablation needle at the treatment point and the target total motion path. After the ablation needle is placed at all treatment points, it is determined whether the cryoablation range covers all treatment points after the ablation needle placement operation is completed. If not, another treatment point is selected in the target site model, and the process returns to the step of determining the posture information of the treatment point through posture calculation based on the position information of the treatment point to continue execution. If so, it is determined that the path planning is completed, that is, the path planning is a valid path planning.
[0155] In the process of inserting the ablation needle at each treatment point, a robotic arm is required to achieve positioning and automatic control, as well as time control of the guide device. Fig.14As shown, for the current treatment point, the robotic arm clamps the ablation needle for positioning, and inserts it into the corresponding treatment point, turns on the freezing mode, and freezes the needle tip. When the freezing is completed, the rewarming mode is turned on, the needle tip is rewarmed, and the ablation needle is controlled to be withdrawn, and the next treatment point is determined, and the next iteration is entered. The next treatment point is used as the current treatment point, and the step of positioning by the robotic arm clamping the ablation needle is returned to continue until all treatment points are ablated, that is, the cryoablation operation is completed. Among them, the robotic arm positions and automatically controls: the robotic arm clamps the cryoablation needle to complete the needle insertion and withdrawal functions of the treatment point. Time control of the guide device: after the needle is inserted to the treatment point, the freezing function is automatically triggered, and the rewarming function is automatically triggered after the freezing is completed, and the time is controlled throughout the treatment. Among them, the treatment point is the target position point.
[0156] In this embodiment, by making an effective judgment on the path planning, it is possible to make a timely judgment on the ablation effect of the path planning, thereby avoiding the situation where the ablation range of the path planning cannot cover all target position points. Therefore, while ensuring the effectiveness of the path planning, the precise treatment of the ablation needle is ensured based on the effective path planning. In one embodiment, after the path planning is determined to be an effective path planning when the effective judgment result characterizes passing, the method further includes: for each target position point, when the robotic arm places the ablation needle at the corresponding target position point according to the effective path planning, a target medical image containing the needle tip position information and needle insertion trajectory information of the ablation needle is obtained. For each target position point, based on the target medical image, the needle tip position of the ablation needle in the corresponding target position point is determined, and based on the needle tip position and the position of the corresponding target position point, the error of the needle insertion position is determined; wherein, the needle insertion position is the needle tip position of the ablation needle. For each target location point, the needle insertion trajectory of the ablation needle in the corresponding target location point is determined based on the target medical image, and the needle insertion trajectory is determined based on the needle insertion trajectory, the posture information of the corresponding target location point, and the needle insertion depth information. For each target location point, if the error of the corresponding target location point is determined to be unsatisfactory or the needle insertion trajectory is determined to be unsatisfactory, an error message is generated and displayed.
[0157] Wherein, the target medical image is an ultrasound image.
[0158] Specifically, for each target position point, when the robotic arm places the ablation needle at the corresponding target position point according to the effective path planning, the terminal obtains a target ultrasound image containing the needle tip position information and needle insertion trajectory information of the ablation needle. The terminal determines the needle tip position based on the target ultrasound image, and compares the difference between the needle tip position and the corresponding target position point, and makes an error judgment on the needle insertion position based on the comparison result. If the comparison result indicates that the difference is greater than or equal to the difference threshold, the terminal determines that the error judgment fails, generates an error message, and displays the error message. For each target position point, the terminal determines the needle insertion trajectory of the ablation needle in the corresponding target position point based on the target ultrasound image. The terminal determines the standard trajectory corresponding to the corresponding target position point based on the posture information and needle insertion depth information corresponding to the corresponding target position point. If the needle insertion trajectory does not match the standard trajectory, it is determined that the needle insertion trajectory judgment result is failed, then an error message is generated, and an error message is displayed.
[0159] In one embodiment, if Fig.15 As shown, the terminal acquires the target ultrasound image in real time and displays the target ultrasound image in real time. The terminal determines the needle insertion trajectory based on the target ultrasound image and the standard trajectory corresponding to the current treatment point. If the needle insertion trajectory determination representation fails, an error message is directly generated and displayed. If the needle insertion trajectory determination representation passes, an error determination is performed based on the needle tip position in the target ultrasound image (i.e., real-time monitoring of the treatment point in the figure). If the error determination fails (i.e., the monitoring display of the treatment point in the figure fails), an error message is directly generated and displayed. If the error determination passes, it is determined that the ablation needle of the current treatment point is correctly placed, and the ablation needle of the next treatment point is placed, and the ablation needle placement is monitored to see if it is correct.
[0160] Among them, the error information can be displayed through sound, light, interactive interface pop-up display and other modes.
[0161] In this real-time example, the error determination and needle insertion trajectory determination of the target position point are performed to determine whether the ablation needle placement step at the target position point is correct. In this way, it is possible to timely determine whether there is an error in the ablation needle insertion position, and effectively avoid the impact of the precise treatment due to excessive error in the ablation needle insertion position.
[0162] In order to facilitate a clearer understanding of the technical solution of the present application, a more detailed embodiment is provided for description. This embodiment involves a biopsy operation and a cryoablation operation. Among them, the operation scenarios involved in this embodiment are as follows: Fig.16As shown. Among them, the patient completes tissue sampling during the biopsy puncture operation, the operation console exports the case, the cryoablation operation imports the biopsy puncture operation case, determines the sampling point as the treatment point, and completes the cryoablation operation. It should be noted that the operation console in this embodiment can be regarded as a terminal or a server. The operation console is described as a terminal below.
[0163] The process in this embodiment is as follows Fig.17 As shown, specifically:
[0164] A first aspect: Before the biopsy operation, the prostate is collected in multiple dimensions by a nuclear magnetic resonance device to obtain first nuclear magnetic resonance images of different dimensions. The nuclear magnetic resonance device sends multiple first nuclear magnetic resonance images to the terminal. For each first nuclear magnetic resonance image, the prostate and abnormal area of the corresponding first nuclear magnetic resonance image are outlined to obtain a first outlined image corresponding to the corresponding first nuclear magnetic resonance image. The terminal performs modeling based on each first outlined image to obtain a first nuclear magnetic resonance model. Before the biopsy operation, the prostate is collected in multiple dimensions by a first ultrasound device to obtain first ultrasound images of different dimensions. The first ultrasound device sends multiple first ultrasound images to the terminal. For each first ultrasound image, the prostate of the corresponding first ultrasound image is outlined to obtain a second outlined image corresponding to the corresponding first ultrasound image. The terminal performs modeling based on each second outlined image to obtain a first ultrasound model. The coordinate system where the first ultrasound model is located is used as the first reference coordinate system, and the first coordinate system to be processed where the first nuclear magnetic resonance model is located is determined. Based on the first reference coordinate system and the first coordinate system to be processed, the terminal obtains the first prostate fusion model through translation, rotation, and first contour fitting processing. Among them, the point corresponding to each cross section in the first prostate fusion model is the first prostate fusion model data. Based on the first prostate fusion model, the operator performs a sampling step in the prostate to determine the position information of the sampling point, and records the position information of the sampling point (i.e., the recorded sampling point coordinates in the corresponding figure). The terminal uses the first prostate fusion model and the position information of the sampling point as abnormal example information (i.e., case), and saves the abnormal example information. Before performing a cryoablation operation, the terminal determines the abnormal example information corresponding to the current target object from a plurality of abnormal example information stored, and performs the following cryoablation operation.
[0165] The second aspect: During the cryoablation operation, before the ablation needle placement step is performed, the second ultrasound image is acquired by collecting the prostate through a second ultrasound device. The second ultrasound device sends the second ultrasound image to the terminal. The terminal obtains the second ultrasound model through modeling based on the second ultrasound image. The terminal imports the abnormal example information obtained in the biopsy puncture operation, determines the first prostate fusion model from the abnormal example information, and uses the coordinate system where the second ultrasound model is located as the second reference coordinate system, and uses the coordinate system of the first prostate fusion model as the second coordinate system to be processed. The second coordinate system to be processed where the first prostate fusion model is located is the first reference coordinate system in the biopsy operation space. Based on the second reference coordinate system and the second coordinate system to be processed, the terminal determines the translation parameter and the rotation matrix through translation, rotation, and second contour fitting processing. Based on the translation parameter and the rotation matrix, the terminal converts the coordinates of the sampling point into the coordinates of the treatment point through the coordinate system algorithm. Among them, after determining the coordinates of the treatment point, the terminal performs treatment point path planning, as shown below:
[0166] Based on the position information of the treatment point, the terminal marks all treatment points in the coordinate system of the cryoablation space. Based on the position information of the treatment point, the terminal determines the position information of the treatment point through posture calculation, and the position information is used to indicate the direction of the ablation needle at the treatment point. The terminal determines the model of the ablation needle according to the volume of the abnormal area of the target site, and determines the length of the ablation needle based on the model of the ablation needle. The terminal determines the needle insertion depth information of each treatment point according to the length of the ablation needle. The needle insertion depth information is the required needle insertion depth of the ablation needle at the target position point. Based on the position information and needle insertion depth information of each treatment point, the terminal automatically plans the longitudinal path of the ablation needle at the treatment point. Based on the position information of each treatment point, the terminal simulates the movement of the ablation needle in the cryoablation operation, and determines multiple total motion paths corresponding to the movement of the ablation needle to each target position point. Based on each total motion path, the terminal globally optimizes all treatment points and takes the smallest total motion path as the target total motion path. Among them, the target total motion path can determine the next treatment point based on the current treatment point. The robot arm inserts the ablation needle into each treatment point according to the longitudinal path of the ablation needle at the treatment point and the total target motion path. After the ablation needle is placed at all treatment points, it is determined whether the cryoablation range covers all treatment points after the ablation needle placement operation is completed. If not, another treatment point is selected in the target part model, and the robot returns to the step of determining the position information of the treatment point through position calculation according to the position information of the treatment point to continue the execution. If so, it is determined that the path planning is completed, that is, the path planning is valid.
[0167] According to the effective path planning, the terminal implements the cryoablation operation through the robotic arm, wherein, for the current treatment point, the terminal obtains the target ultrasound image corresponding to the current treatment point in real time, and displays the target ultrasound image in real time. The terminal determines the needle trajectory based on the target ultrasound image and the standard trajectory corresponding to the current treatment point. If the needle trajectory determination representation fails, an error message is directly generated and displayed. If the needle trajectory determination representation passes, an error determination is performed based on the needle tip position in the target ultrasound image (i.e., real-time monitoring of the treatment point in the figure). If the error determination fails (i.e., the monitoring display of the treatment point in the figure fails), an error message is directly generated and displayed. If the error determination passes, it is determined that the ablation needle of the current treatment point is correctly placed, and the ablation needle of the next treatment point is placed, and the ablation needle placement is monitored to see if it is correct, until the cryoablation operation is completed in all treatment points, i.e., the cryoablation operation is completed.
[0168] In this embodiment, a first model constructed according to a first medical image is obtained by collecting the target part before the biopsy operation. In this way, based on the first model, the abnormal information of the target part before the biopsy operation is performed can be reflected in real time. A second model constructed according to a second medical image is obtained by collecting the target part before the sampling step in the biopsy operation. In this way, the actual position of the target part during the biopsy operation can be represented truthfully by the second model. The first elastic fusion process is performed on the first model and the second model, and the target part model containing the abnormal information of the target part can be determined in the space where the biopsy operation is performed. In this way, based on the target part model, the actual sampling step can determine the position information of the sampling point in real time and accurately, ensuring the authenticity of the position information of the sampling point. A third model constructed according to a third medical image is obtained by collecting the target part before the ablation needle placement step in the cryoablation operation. In this way, based on the third model, the position of the target part during the cryoablation operation can be represented truthfully. The third model and the target part model are subjected to a second elastic fusion process to obtain a spatial mapping relationship between the third model and the target part model. In this way, based on the spatial mapping relationship, the target position point uniquely corresponding to each sampling point is reflected in real time, that is, the uniformity of the ablation needle position is achieved, thereby ensuring the consistency of cryoablation treatment, achieving accurate treatment of the abnormal area of the target part, and thus greatly improving the accuracy of cryoablation treatment.
[0169] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.
[0170] Based on the same inventive concept, the embodiment of the present application also provides an ablation needle position determination device for implementing the ablation needle position determination method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations of the one or more ablation needle position determination device embodiments provided below can refer to the limitations of the ablation needle position determination method above, and will not be repeated here.
[0171] In one embodiment, Fig.18 As shown, a device for determining the position of an ablation needle is provided, comprising: a first acquisition module 1802, a second acquisition module 1804, a first processing module 1806, a third acquisition module 1808, a second processing module 1810 and a determination module 1812, wherein:
[0172] The first acquisition module 1802 is used to acquire a first model constructed according to a first medical image, where the first medical image is acquired by capturing the target part before the biopsy operation.
[0173] The second acquisition module 1804 is used to acquire a second model constructed according to a second medical image, where the second medical image is acquired by capturing the target part before the sampling step in the biopsy operation.
[0174] The first processing module 1806 is used to perform a first elastic fusion process on the first model and the second model, determine a target part model corresponding to the target part, and determine position information of a sampling point based on the target part model.
[0175] The third acquisition module 1808 is used to acquire a third model constructed according to a third medical image, where the third medical image is acquired by capturing the target site before the ablation needle placement step in the cryoablation operation.
[0176] The second processing module 1810 is used to perform a second elastic fusion process on the third model and the target part model to obtain a spatial mapping relationship between the third model and the target part model.
[0177] The determination module 1812 is used to determine a target location point based on the location information of the sampling point and the spatial mapping relationship, and the target location point is used for placement of the ablation needle in the cryoablation operation.
[0178] In one implementation, the first acquisition module 1802 is used to perform a multi-dimensional medical scan on the target part before the biopsy operation to obtain a plurality of first medical images, and to delineate the target part and the abnormal area in the target part based on each of the first medical images to obtain a first model.
[0179] In one embodiment, the second acquisition module 1804 is used to perform ultrasonic sampling processing on the target part in multiple dimensions before the sampling step in the biopsy operation to obtain multiple second medical images. Based on each second medical image, the target part is outlined to obtain a second model.
[0180] In one embodiment, the first processing module 1806 is used to use the coordinate system where the second model is located as the first reference coordinate system, and determine the first coordinate system to be processed where the first model is located. Based on the first reference coordinate system and the first coordinate system to be processed, the first model is subjected to coordinate transformation processing to obtain a processed first model; wherein the coordinate system of the processed first model matches the first reference coordinate system. Based on the contour information of the first model, the processed first model is subjected to first contour fitting to determine a target part model corresponding to the target part.
[0181] In one embodiment, the first processing module 1806 is used to perform translation and rotation processing on the first model based on the first reference coordinate system and the first pending coordinate system to obtain a processed first model.
[0182] In one embodiment, the second processing module 1810 is used to use the coordinate system where the third model is located as the second reference coordinate system, and determine the second coordinate system to be processed where the target part model is located. Based on the second reference coordinate system and the second coordinate system to be processed, the target part model is subjected to coordinate transformation processing to obtain a processed target part model; wherein the coordinate system where the processed target part model is located matches the second reference coordinate system. Based on the contour information of the processed target part model, the third model is subjected to second contour fitting to obtain a spatial mapping relationship between the third model and the target part model.
[0183] In one embodiment, the second processing module 1810 is used to translate and rotate the target part model based on the second reference coordinate system and the second coordinate system to be processed to obtain a processed target part model. In one embodiment, the determination module 1812 is also used to determine the posture information of each target position point through posture calculation based on the position information of the target position point. Determine the length of the ablation needle, and determine the needle insertion depth information of each target position point based on the length of the ablation needle. Based on the position information of each target position point, simulate the movement of the ablation needle during the cryoablation operation, determine multiple total movement paths corresponding to the movement of the ablation needle to each target position point, and use the smallest total movement path as the target total movement path. Based on the target total movement path, the posture information and needle insertion depth information of each target position point, determine the path planning; the path planning is used to instruct the robot arm to place the ablation needle at each target position point according to the path planning.
[0184] In one embodiment, the determination module 1812 is further configured to determine an ablation effect corresponding to the path planning, and to perform a validity determination on the path planning based on the ablation effect. If the validity determination result indicates passing, the path planning is determined to be a valid path planning.
[0185] In one embodiment, the determination module 1812 is also used for obtaining a target medical image containing needle tip position information and needle insertion trajectory information of the ablation needle for each target position point, when the robot arm places the ablation needle at the corresponding target position point according to the effective path planning. For each target position point, the needle tip position of the ablation needle in the corresponding target position point is determined based on the target medical image, and the error of the needle insertion position is determined based on the needle tip position and the position of the corresponding target position point; wherein the needle insertion position is the needle tip position of the ablation needle. For each target position point, the needle insertion trajectory of the ablation needle in the corresponding target position point is determined based on the target medical image, and the needle insertion trajectory is determined based on the needle insertion trajectory, the posture information of the corresponding target position point and the needle insertion depth information. For each target position point, if the error of the corresponding target position point is determined to be unsatisfactory or the needle insertion trajectory is determined to be unsatisfactory, an error message is generated and displayed.
[0186] Each module in the above-mentioned ablation needle position determination device can be implemented in whole or in part by software, hardware, or a combination thereof. Each of the above-mentioned modules can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute the operations corresponding to each of the above modules.
[0187] In one embodiment, a computer device is provided. The computer device may be a server, and its internal structure diagram may be as follows: Fig.19 As shown. The computer device includes a processor, a memory, an input / output interface (Input / Output, referred to as I / O) and a communication interface. The processor, the memory and the input / output interface are connected through a system bus, and the communication interface is connected to the system bus through the input / output interface. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store data for determining the location of the ablation needle. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a method for determining the location of an ablation needle is implemented.
[0188] Those skilled in the art will understand that Fig.19 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.
[0189] In one embodiment, a computer device is further provided, including a memory and a processor, wherein a computer program is stored in the memory, and the processor implements the steps in the above method embodiments when executing the computer program.
[0190] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps in the above-mentioned method embodiments are implemented.
[0191] In one embodiment, a computer program product is provided, including a computer program, which implements the steps in the above method embodiments when executed by a processor.
[0192] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards of relevant countries and regions.
[0193] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., but are not limited to this.
[0194] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0195] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.
Claims
1. A method for determining the position of an ablation needle, characterized in that: The method comprises: Before the biopsy operation, the target part is subjected to medical scanning processing in multiple dimensions to obtain multiple first medical images; Based on each first medical image, outlining the target part and the abnormal area in the target part to obtain a first model; Before the sampling step in the biopsy operation, the target part is subjected to ultrasonic sampling processing in multiple dimensions to obtain multiple second medical images; Based on each second medical image, outlining the target part to obtain a second model; Performing a first elastic fusion process on the first model and the second model to determine a target part model corresponding to the target part in the biopsy operation, which takes the coordinate system of the second model as a reference coordinate system; wherein the first elastic fusion process is to perform a fusion process on the first model and the second model of different coordinate systems, and determine the position information of the sampling point based on the target part model; Acquiring a third model constructed according to a third medical image, wherein the third medical image is acquired by capturing the target site before the ablation needle placement step in the cryoablation operation; Performing a second elastic fusion process on the third model and the target part model to obtain a spatial mapping relationship between the third model and the target part model, wherein the second elastic fusion process is used to match the coordinate system of the target part model with the coordinate system of the third model; Based on the position information of the sampling points and the spatial mapping relationship, a target position point is determined, and the target position point is used for placement of an ablation needle in a cryoablation operation.
2. The method according to claim 1, characterized in that The target part model determination step comprises: Taking the coordinate system where the second model is located as a first reference coordinate system, and determining a first coordinate system to be processed where the first model is located; Based on the first reference coordinate system and the first coordinate system to be processed, coordinate transformation is performed on the first model to obtain a processed first model; wherein the coordinate system of the processed first model matches the first reference coordinate system; Based on the contour information of the first model, a first contour fitting is performed on the processed first model to determine a target part model corresponding to the target part.
3. The method according to claim 2, characterized in that The step of performing coordinate transformation on the first model based on the first reference coordinate system and the first coordinate system to be processed to obtain a processed first model includes: Based on the first reference coordinate system and the first pending coordinate system, the first model is translated and rotated to obtain a processed first model.
4. The method according to claim 1, characterized in that: The performing a second elastic fusion process on the third model and the target part model to obtain a spatial mapping relationship between the third model and the target part model includes: The coordinate system where the third model is located is used as a second reference coordinate system, and a second coordinate system to be processed where the target part model is located is determined; Based on the second reference coordinate system and the second coordinate system to be processed, coordinate transformation is performed on the target part model to obtain a processed target part model; wherein the coordinate system of the processed target part model matches the second reference coordinate system; Based on the processed contour information of the target part model, a second contour fitting is performed on the third model to obtain a spatial mapping relationship between the third model and the target part model.
5. The method according to claim 4, characterized in that The step of performing coordinate transformation on the target part model based on the second reference coordinate system and the second coordinate system to be processed to obtain a processed target part model includes: Based on the second reference coordinate system and the second coordinate system to be processed, the target part model is translated and rotated to obtain a processed target part model.
6. The method according to claim 1, characterized in that After determining the target location point based on the location information of the sampling point and the spatial mapping relationship, the method further includes: Based on the position information of the target position point, the position and posture information of each target position point is determined through position and posture calculation; Determining the length of the ablation needle, and based on the length of the ablation needle, determining the needle insertion depth information of each target position point; Based on the position information of each target position point, the movement of the ablation needle during the cryoablation operation is simulated to determine multiple total movement paths corresponding to the movement of the ablation needle to each target position point, and the smallest total movement path is used as the target total movement path; Based on the total target motion path, the position information of each target position point and the needle insertion depth information, the path planning is determined; the path planning is used to instruct the robot arm to place the ablation needle at each target position point according to the path planning.
7. The method according to claim 6, characterized in that After determining the path planning based on the target motion total path, the position information of each target position point and the needle insertion depth information, the method further includes: Determining an ablation effect corresponding to the path planning, and making an effective judgment on the path planning based on the ablation effect; If the validity determination result indicates passing, the path planning is determined to be a valid path planning.
8. The method according to claim 7, characterized in that In the case where the effective determination result characterization is passed, after determining that the path planning is a valid path planning, the method further includes: For each target position point, when the robot arm places the ablation needle at the corresponding target position point according to the effective path planning, a target medical image including needle tip position information and needle insertion trajectory information of the ablation needle is obtained; For each target position point, based on the target medical image, determine the needle tip position of the ablation needle in the corresponding target position point, and based on the needle tip position and the position of the corresponding target position point, perform error determination of the needle insertion position; wherein the needle insertion position is the needle tip position of the ablation needle; For each target position point, based on the target medical image, determine the needle insertion trajectory of the ablation needle in the corresponding target position point, and determine the needle insertion trajectory based on the needle insertion trajectory, the posture information of the corresponding target position point and the needle insertion depth information; For each target position point, when the error of the corresponding target position point is determined to be not passed, or the needle insertion trajectory is determined to be not passed, error information is generated and displayed.
9. A device for determining the position of an ablation needle, characterized in that: The device comprises: A first acquisition module is used to perform a multi-dimensional medical scan process on the target part before the biopsy operation to obtain a plurality of first medical images; The first acquisition module is further used to delineate the target part and the abnormal area in the target part based on each first medical image to obtain a first model; A second acquisition module is used to perform ultrasonic sampling processing on the target part in multiple dimensions before the sampling step in the biopsy operation to obtain multiple second medical images; The second acquisition module is further used to outline the target part based on each second medical image to obtain a second model; a first processing module, configured to perform a first elastic fusion process on the first model and the second model, and determine a target part model corresponding to the target part in the biopsy operation, which takes the coordinate system of the second model as a reference coordinate system; wherein the first elastic fusion process is to perform a fusion process on the first model and the second model of different coordinate systems, and determine the position information of the sampling point based on the target part model; A third acquisition module, configured to acquire a third model constructed according to a third medical image, wherein the third medical image is acquired by acquiring the target part before the ablation needle placement step in the cryoablation operation; a second processing module, configured to perform a second elastic fusion process on the third model and the target part model to obtain a spatial mapping relationship between the third model and the target part model, wherein the second elastic fusion process is configured to match a coordinate system of the target part model with a coordinate system of the third model; The determination module is used to determine a target position point based on the position information of the sampling point and the spatial mapping relationship, and the target position point is used for placing an ablation needle in a cryoablation operation.
10. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 8 are implemented.
11. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 8 are implemented.
12. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 8 are implemented.
