Image generation method, system, readable storage medium and electronic device

Abstract

The application provides an image generation method, system, readable storage medium and electronic equipment. The image generation method comprises the following steps: identifying a lesion area of a preoperative medical image to obtain a preoperative lesion area image; reconstructing a biopsy lesion area according to the position information of each biopsy needle and the corresponding biopsy pathological result information to obtain a biopsy lesion area image; and fusing the preoperative lesion area image and the biopsy lesion area image to obtain a fused lesion area image. The application can more accurately determine the position of the lesion area by combining the interpretation result of the preoperative medical image with the biopsy result, thereby effectively improving the effect of a lesion elimination operation (for example, an ablation operation).

Description

Technical Field

[0001] This invention relates to the field of image processing technology, and in particular to an image generation method, system, readable storage medium, and electronic device. Background Technology

[0002] The usual approach to treating cancer is to remove or kill the cancerous lesions. However, surgical resection causes significant damage to other healthy tissues, and many patients are not suitable candidates for this procedure. Therefore, thanks to advancements in imaging technology and the rapid development of minimally invasive interventional devices, interventional ablation surgery for tumors and other lesions has become one of the most important clinical treatments for cancer.

[0003] Cryoablation primarily uses cryo-instruments to controllably subject lesion tissue to a process of cooling, freezing, and rewarming, thereby causing irreversible cell damage or even necrosis. For example, the tumor-killing mechanisms of cryoablation include: cell dehydration and shrinkage; intracellular ice crystal formation and mechanical damage from ice crystals; cellular electrolyte toxicity and pH changes; denaturation of cell membrane lipoprotein components; blood stasis and microthrombus formation; and immune effects. Cryoablation surgery is not only minimally invasive but also offers advantages such as anesthesia and pain relief, fewer postoperative complications, and prevention of tumor spread, making it highly praised by doctors and patients alike.

[0004] Currently, lesion identification in cryotherapy or puncture surgery mainly relies on preoperative MRI images, CT images, or biopsy results to determine the location and volume of the lesion. However, preoperative MRI, CT images, or biopsy results alone cannot accurately determine the lesion area, which may lead to overtreatment or incomplete ablation of the tumor.

[0005] It should be noted that the information disclosed in the background section of this invention is intended only to enhance the understanding of the general background of this invention, and should not be construed as an admission or in any way implying that the information constitutes prior art known to those skilled in the art. Summary of the Invention

[0006] The purpose of this invention is to provide an image generation method, system, readable storage medium, and electronic device that can accurately determine the location of lesion areas, thereby improving the effectiveness of lesion removal surgery.

[0007] To achieve the above objectives, the present invention provides an image generation method, which includes the following steps:

[0008] The acquired preoperative medical images are used to identify the lesion areas in order to obtain preoperative lesion area images;

[0009] Based on the needle insertion position information of each puncture needle and the corresponding biopsy pathology results, the biopsy lesion area is reconstructed to obtain an image of the biopsy lesion area.

[0010] The preoperative lesion area image and the biopsy lesion area image are fused to obtain a fused lesion area image.

[0011] Optionally, the step of identifying the lesion region in the acquired preoperative medical images to obtain a preoperative lesion region image includes:

[0012] The acquired preoperative medical images are segmented to obtain preoperative images of the target organ.

[0013] The lesion region is identified from the preoperative target organ image to obtain a preoperative lesion region image.

[0014] Optionally, the insertion position information of each puncture needle can be obtained by acquiring the puncture needle insertion plan diagram;

[0015] The puncture needle insertion plan is obtained through the following steps:

[0016] The acquired intraoperative medical images are segmented to obtain intraoperative images of the target organ.

[0017] Based on the intraoperative target organ image, determine the insertion position information of each puncture needle in the coordinate system of the intraoperative target organ image to obtain the puncture needle insertion plan.

[0018] Optionally, the step of reconstructing the biopsy lesion area based on the obtained needle insertion position information of each puncture needle and the corresponding biopsy pathology results to obtain an image of the biopsy lesion area includes:

[0019] Based on the needle insertion position information of each puncture needle in the coordinate system of the intraoperative target organ image and the corresponding biopsy pathology results, the position information of the biopsy lesion area in the coordinate system of the intraoperative target organ image is obtained.

[0020] The biopsy lesion area is reconstructed based on its position information in the coordinate system of the intraoperative target organ image to obtain an image of the biopsy lesion area.

[0021] Optionally, the step of obtaining the position information of the biopsy lesion area in the coordinate system of the intraoperative target organ image based on the needle insertion position information of each puncture needle in the coordinate system of the intraoperative target organ image and the corresponding biopsy pathology result information includes:

[0022] For each puncture needle, based on the biopsy pathology results corresponding to the puncture needle, it is determined whether there is a lesion in the biopsy area corresponding to the puncture needle. If so, the puncture needle is used as the target puncture needle.

[0023] For each target puncture needle, based on the biopsy pathology results of the puncture needle, the depth information of the lesion in the biopsy area corresponding to the puncture needle is determined, and the needle insertion position information of the puncture needle in the coordinate system of the target organ image during the operation is used as the axial position information of the corresponding lesion.

[0024] For each lesion site, the position information of the lesion site in the coordinate system of the target organ image during the operation is obtained based on the axial position information and depth information of the lesion site.

[0025] Based on the position information of all lesion sites in the coordinate system of the intraoperative target organ image, the position information of the biopsy lesion area in the coordinate system of the intraoperative target organ image is obtained.

[0026] Optionally, the step of reconstructing the biopsy lesion region based on its position information in the coordinate system of the intraoperative target organ image to obtain an image of the biopsy lesion region includes:

[0027] Based on the depth information of the biopsy lesion area in the coordinate system of the intraoperative target organ image, all axial intraoperative target organ images with lesion areas are determined in the intraoperative target organ image, and are used as target axial intraoperative target organ images.

[0028] For each target axial intraoperative target organ image, based on the position information of the biopsy lesion area in the coordinate system of the target intraoperative target organ image, each positive point is determined on the target axial intraoperative target organ image, and based on all the determined positive points, the biopsy lesion area is reconstructed on the target axial intraoperative target organ image to obtain the axial biopsy lesion area image corresponding to the target axial intraoperative target organ image;

[0029] All axial biopsy lesion area images are combined to obtain biopsy lesion area images.

[0030] Optionally, the step of reconstructing the biopsy lesion region on the target axial intraoperative target organ image based on all identified positive points to obtain the axial biopsy lesion region image corresponding to the target axial intraoperative target organ image includes:

[0031] Based on all the identified positive points, a closed curve is reconstructed on the target organ image during the axial surgery, which does not extend beyond the target organ region and encloses all the positive points, in order to obtain the axial biopsy lesion region image corresponding to the target organ image during the axial surgery.

[0032] Optionally, the image generation method further includes the following steps:

[0033] For each puncture needle, based on the biopsy pathology results corresponding to the puncture needle, the depth information of the non-lesion site of the biopsy area corresponding to the puncture needle is determined, and the needle insertion position information of the puncture needle in the coordinate system of the target organ image during the operation is used as the axial position information of the corresponding non-lesion site.

[0034] For each target axial intraoperative target organ image, based on the depth information and axial position information of the non-lesion site corresponding to each puncture needle, each negative point is determined on the target axial intraoperative target organ image;

[0035] The step of reconstructing a closed curve on the target organ image in the target axial view, based on all identified positive points, that does not extend beyond the target organ region and encloses all the positive points, includes:

[0036] For each positive point, determine whether there is a negative point on the target organ image of the target axis that is closest to the positive point and has not yet been identified as a target negative point. If so, identify the negative point as a target negative point. If not, identify the second closest negative point as a target negative point.

[0037] For each negative point on the target organ image in the target axial view, find the positive point closest to the negative point on the target organ image in the target axial view, and obtain the position information of the center point of the line connecting the negative point and the positive point;

[0038] Connect all the center points in sequence to form a curve;

[0039] The curve is extended along the boundary of the target organ region on the intraoperative target organ image of the target axis to surround all the positive points, thereby forming a closed curve that does not exceed the target organ region and surrounds all the positive points.

[0040] Optionally, fusing the preoperative lesion region image and the biopsy lesion region image to obtain a fused lesion region image includes:

[0041] The preoperative target organ image and the intraoperative target organ image are registered to obtain a registration matrix;

[0042] Based on the registration matrix, the preoperative lesion area image and the biopsy lesion area image are transformed to the same coordinate system;

[0043] The preoperative lesion region image and the biopsy lesion region image, transformed to the same coordinate system, are fused to obtain a fused lesion region image.

[0044] To achieve the above objectives, the present invention also provides an image generation system, comprising:

[0045] The preoperative image processing module is configured to identify the lesion area in the acquired preoperative medical images in order to obtain preoperative lesion area images.

[0046] The intraoperative image processing module is configured to reconstruct the biopsy lesion area based on the acquired needle insertion position information and corresponding biopsy pathology results, thereby obtaining an image of the biopsy lesion area; and

[0047] The fusion module is configured to fuse the preoperative lesion area image and the biopsy lesion area image to obtain a fused lesion area image.

[0048] To achieve the above objectives, the present invention also provides a readable storage medium storing a computer program, which, when executed by a processor, implements the image generation method described above.

[0049] To achieve the above objectives, the present invention also provides an electronic device, which includes the readable storage medium described above or the image generation system described above.

[0050] Compared with existing technologies, the image generation method, system, readable storage medium, and electronic device provided by this invention have the following advantages:

[0051] This invention identifies the lesion region from preoperative medical images to obtain a preoperative lesion region image; then, based on the needle insertion positions of each puncture needle and the corresponding biopsy pathology results, reconstructs the biopsy lesion region to obtain a biopsy lesion region image; finally, the preoperative lesion region image and the biopsy lesion region image are fused to obtain a fused lesion region image. Therefore, by combining the interpretation results of preoperative medical images with the puncture biopsy results, this invention can more accurately determine the location of the lesion region, thus ensuring that in subsequent lesion removal surgery, neither overtreatment nor incomplete lesion removal is caused, effectively improving the effect of lesion removal surgery (e.g., ablation surgery). Attached Figure Description

[0052] Figure 1This is a schematic flowchart of an image generation method provided in one embodiment of the present invention;

[0053] Figure 2 This is a schematic diagram of the process for obtaining preoperative lesion area images, provided as a specific example of the present invention.

[0054] Figure 3 This is a schematic diagram of a puncture needle insertion plan provided as a specific example of the present invention;

[0055] Figure 4 A schematic diagram of the distribution of puncture points on an axial intraoperative target organ image provided as a specific example of the present invention;

[0056] Figure 5 This is a schematic diagram illustrating the process of reading biopsy pathology results information for each puncture needle from a biopsy report, as a specific example of the present invention.

[0057] Figure 6 An expanded image of a single-needle sample from a biopsy report provided as a specific example of the present invention;

[0058] Figure 7 This is a schematic diagram showing the distribution of positive and negative points on a target organ image during surgery, provided as a specific example of the present invention.

[0059] Figure 8 A schematic diagram of a reconstructed closed curve provided as a specific example of the present invention;

[0060] Figure 9 This is a block diagram of an image generation system provided in one embodiment of the present invention;

[0061] Figure 10 This is a schematic diagram of the display interface of a display module provided in a specific example of the present invention;

[0062] Figure 11 This is a block diagram of an electronic device provided according to an embodiment of the present invention. Detailed Implementation

[0063] The image generation method, system, readable storage medium, and electronic device proposed in this invention will be further described in detail below with reference to the accompanying drawings and specific embodiments. The advantages and features of this invention will become clearer from the following description. It should be noted that the drawings are in a very simplified form and use non-precise proportions, used only to facilitate and clearly illustrate the embodiments of this invention. Please refer to the accompanying drawings to make the objectives, features, and advantages of this invention more apparent and understandable. It should be understood that the structures, proportions, sizes, etc., depicted in the accompanying drawings are only for illustrative purposes to aid those skilled in the art and are not intended to limit the implementation conditions of this invention. Any modifications to the structure, changes in proportions, or adjustments to the size, provided they produce the same or similar effects and achieve the same objectives as this invention, should still fall within the scope of the technical content disclosed in this invention.

[0064] It should be noted that, in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0065] Furthermore, in the description of this specification, the reference to terms such as "one embodiment," "some embodiments," "example," "specific example," or "some examples," etc., means that a specific feature, structure, material, or characteristic described in connection with that embodiment or example is included in at least one embodiment or example of the present invention. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics described may be combined in a suitable manner in any one or more embodiments or examples. Furthermore, without contradiction, those skilled in the art can combine and integrate the different embodiments or examples described in this specification, as well as the features of different embodiments or examples.

[0066] The core idea of ​​this invention lies in providing an image generation method, system, readable storage medium, and electronic device that can accurately determine the location of the lesion area, thereby improving the effectiveness of lesion removal surgery. It should be noted that the electronic device provided by this invention can be a personal computer, mobile terminal, etc., and the mobile terminal can be a mobile phone, tablet computer, or other hardware device with various operating systems. Furthermore, it should be noted that, as those skilled in the art will understand, the needle insertion position information referred to herein refers to the two-dimensional position information (i.e., the position information on the axial direction) of the puncture point where the puncture needle enters the target organ region. During the puncture process, the two-dimensional position information on the axial direction does not change; only the position information in the depth direction changes. It should also be noted that, as those skilled in the art will understand, the coordinate system of the preoperative medical image, the coordinate system of the preoperative target organ image, and the coordinate system of the preoperative lesion area image are the same coordinate system; the coordinate system of the intraoperative medical image, the coordinate system of the intraoperative target organ image, and the coordinate system of the biopsy lesion area image are also the same coordinate system.

[0067] Example 1

[0068] To achieve the above-mentioned goals, this embodiment provides an image generation method, please refer to... Figure 1 The diagram illustrates a flowchart of an image generation method provided by an embodiment of the present invention. Figure 1 As shown, the image generation method includes the following steps:

[0069] Step S100: Identify the lesion area in the acquired preoperative medical images to obtain preoperative lesion area images.

[0070] Step S200: Reconstruct the biopsy lesion area based on the obtained needle insertion position information of each puncture needle and the corresponding biopsy pathology results to obtain an image of the biopsy lesion area.

[0071] Step S300: The preoperative lesion area image and the biopsy lesion area image are fused to obtain a fused lesion area image.

[0072] Therefore, the image generation method provided in this embodiment can more accurately determine the location of the lesion area by combining the interpretation results of preoperative medical images with the results of puncture biopsy. This ensures that in the subsequent lesion removal surgery, neither overtreatment nor incomplete lesion removal will occur, effectively improving the effect of lesion removal surgery (such as ablation surgery).

[0073] In one exemplary embodiment, the step of identifying the lesion region from the acquired preoperative medical images to obtain a preoperative lesion region image includes:

[0074] The acquired preoperative medical images are segmented to obtain preoperative images of the target organ.

[0075] The lesion region is identified from the preoperative target organ image to obtain a preoperative lesion region image.

[0076] Specifically, in some embodiments, a pre-trained segmentation network model based on deep learning algorithms can be used to segment the target organ region of the preoperative medical image to obtain a preoperative target organ image. In other embodiments, threshold segmentation or region growing methods can be used to segment the target organ region of the preoperative medical image to obtain a preoperative target organ image. In other embodiments, the target organ region can be segmented manually on the acquired preoperative medical image (i.e., the doctor can interactively draw the target organ region on the acquired preoperative medical image) to obtain a preoperative target organ image. Similarly, in some embodiments, a pre-trained classification model based on deep learning algorithms can be used to identify the lesion region of the preoperative target organ image to obtain a preoperative lesion region image; in other embodiments, the lesion region can be identified manually on the preoperative target organ image to obtain a preoperative lesion region image. It should be noted that, as those skilled in the art will understand, if the preoperative target organ image is obtained using automatic segmentation methods such as deep learning algorithms, threshold segmentation, or region growing, the doctor can modify the segmentation results obtained by the automatic segmentation method through interactive drawing to obtain the final preoperative target organ region segmentation image. Similarly, if the preoperative lesion region image is also obtained using automatic recognition methods such as deep learning algorithms, the doctor can modify the recognition results obtained by the automatic recognition method through interactive drawing to obtain the final preoperative lesion region image.

[0077] Furthermore, the preoperative medical images are preferably three-dimensional preoperative medical images, which are composed of a series of two-dimensional axial preoperative medical images. The preoperative medical images can be a sequence of magnetic resonance images (three-dimensional magnetic resonance images) acquired by a magnetic resonance imaging device, a sequence of CT images (three-dimensional CT images) acquired by a CT imaging device, or three-dimensional medical images acquired by other medical imaging devices. This embodiment does not limit the scope of the embodiments.

[0078] Please continue to refer to this. Figure 2 This schematically illustrates the process of acquiring preoperative lesion area images provided in a specific example of Embodiment 1. For example... Figure 2As shown, three-dimensional preoperative medical images can be obtained from the hospital's PACS (Picture Archiving and Communication System). By segmenting the three-dimensional preoperative medical images, three-dimensional preoperative target organ images can be obtained. By identifying the lesion region in the three-dimensional preoperative target organ images, the lesion region can be identified. Figure 2 The image is used to obtain a three-dimensional preoperative image of the lesion area (the black area in the image), which can be stored in an image storage module. It should be noted that, as those skilled in the art will understand, the coordinate system of the three-dimensional preoperative lesion area image and the three-dimensional preoperative target organ image is the same coordinate system.

[0079] In one exemplary implementation, needle insertion position information for each puncture needle is obtained by acquiring a puncture needle insertion plan.

[0080] The puncture needle insertion plan is obtained through the following steps:

[0081] The acquired intraoperative medical images are segmented to obtain intraoperative images of the target organ.

[0082] Based on the intraoperative target organ image, determine the insertion position information of each puncture needle in the coordinate system of the intraoperative target organ image to obtain the puncture needle insertion plan.

[0083] Specifically, before the biopsy, the area of ​​the patient's target organ is scanned using ultrasound or other medical imaging equipment. Based on the intraoperative images, a puncture needle placement plan is developed, determining the insertion position and angle of each needle. Then, according to the plan, each needle is inserted into the target organ area at its designated position and angle to collect tissue samples. The collected tissue samples are placed in a culture dish and stained to determine which areas are diseased (positive) and which are non-diseased (negative) tissues.

[0084] Furthermore, the intraoperative medical images are preferably three-dimensional medical images, and the intraoperative medical images are also composed of a series of two-dimensional axial intraoperative medical images (two-dimensional images). Please refer to [reference needed]. Figure 3 It schematically illustrates a puncture needle insertion plan diagram provided in a specific example of this embodiment. For example... Figure 3As shown, by segmenting the target organ region in a three-dimensional intraoperative medical image, a three-dimensional intraoperative target organ image can be obtained. Based on this image, the insertion position and angle information of each puncture needle (i.e., the puncture needle insertion plan) can be determined, thus obtaining a puncture needle insertion plan diagram. During subsequent reconstruction of the biopsy lesion area, the insertion position information of each puncture needle in the coordinate system of the intraoperative target organ image can be obtained by reading the puncture needle insertion plan diagram. Furthermore, based on this insertion position information, the puncture point corresponding to each puncture needle can be marked on each axis of the intraoperative target organ image. For specific marking results, please refer to [reference needed]. Figure 4 It schematically illustrates the distribution of puncture points on the axial intraoperative target organ image provided in a specific example of this embodiment. Figure 4 Each small circle in the diagram represents a puncture point.

[0085] In one exemplary embodiment, the step of reconstructing the biopsy lesion area based on the acquired needle insertion position information of each puncture needle and the corresponding biopsy pathology results to obtain an image of the biopsy lesion area includes:

[0086] Based on the needle insertion position information of each puncture needle in the coordinate system of the intraoperative target organ image and the corresponding biopsy pathology results, the position information of the biopsy lesion area in the coordinate system of the intraoperative target organ image is obtained.

[0087] The biopsy lesion area is reconstructed based on its position information in the coordinate system of the intraoperative target organ image to obtain an image of the biopsy lesion area.

[0088] Therefore, based on the needle insertion position information (i.e., two-dimensional position information in the axial direction) of each puncture needle in the coordinate system of the intraoperative target organ image and the corresponding biopsy pathology results, the three-dimensional position information (including axial position information and depth direction position information) of the biopsy lesion area in the coordinate system of the intraoperative target organ image is obtained. Then, the biopsy lesion area is reconstructed to obtain the biopsy lesion area image. This ensures that the coordinate system of the biopsy lesion area image and the coordinate system of the intraoperative target organ image are the same coordinate system, which makes it easier to fuse the preoperative lesion area image and the biopsy lesion area image to obtain a fused lesion area image.

[0089] Further, the step of obtaining the position information of the biopsy lesion area in the coordinate system of the intraoperative target organ image based on the needle insertion position information of each puncture needle in the coordinate system of the intraoperative target organ image and the corresponding biopsy pathology result information includes:

[0090] For each puncture needle, based on the biopsy pathology results corresponding to the puncture needle, it is determined whether there is a lesion in the biopsy area corresponding to the puncture needle. If so, the puncture needle is used as the target puncture needle.

[0091] For each target puncture needle, based on the biopsy pathology results of the puncture needle, the depth information of the lesion in the biopsy area corresponding to the puncture needle is determined, and the needle insertion position information of the puncture needle in the coordinate system of the target organ image during the operation is used as the axial position information of the corresponding lesion.

[0092] For each lesion site, the position information of the lesion site in the coordinate system of the target organ image during the operation is obtained based on the axial position information and depth information of the lesion site.

[0093] Based on the position information of all lesion sites in the coordinate system of the intraoperative target organ image, the position information of the biopsy lesion area in the coordinate system of the intraoperative target organ image is obtained.

[0094] For details, please refer to Figure 5 This illustration shows a diagram illustrating the process of reading biopsy pathology results from a biopsy report for each puncture needle, as provided in a specific example of this embodiment. For example... Figure 5 As shown, the biopsy pathology results for each puncture needle can be read from the biopsy report. Therefore, based on the biopsy pathology results for each puncture needle, the needle with a positive biopsy pathology result (i.e., a lesion exists in the biopsy area) can be selected as the target puncture needle. Please continue to refer to... Figure 6 The illustration schematically shows an expanded image of a single-needle sampling sample in a biopsy report provided by a specific example of the present invention, where the tip refers to the end furthest from the operator, i.e., the end that first penetrates the target organ, and the end refers to the end closest to the operator. For example... Figure 6 As shown, by reading the expanded image of the sample taken by each target puncture needle in the biopsy report, the distribution information of lesion sites (positive sites) and non-lesion sites (negative sites) in the depth direction of the tissue sample collected by each target puncture needle can be identified, that is, the depth information of the lesion site in the biopsy area corresponding to each target puncture needle can be obtained. For each lesion site, the axial position information of the lesion site can be obtained based on the needle insertion position information of the puncture needle in the coordinate system of the target organ image during the operation. Then, based on the axial position information and depth information of the lesion site, the three-dimensional position information of the lesion site in the coordinate system of the target organ image during the operation can be obtained. It should be noted that, as those skilled in the art will understand, the structured biopsy report can be read from the hospital's HIS system (Hospital Information Management System).

[0095] In one exemplary embodiment, the step of reconstructing the biopsy lesion region based on its position information in the coordinate system of the intraoperative target organ image to obtain an image of the biopsy lesion region includes:

[0096] Based on the depth information of the biopsy lesion area in the coordinate system of the intraoperative target organ image, all axial intraoperative target organ images with lesion areas are determined in the intraoperative target organ image, and are used as target axial intraoperative target organ images.

[0097] For each target axial intraoperative target organ image, based on the position information of the biopsy lesion area in the coordinate system of the target intraoperative target organ image, each positive point is determined on the target axial intraoperative target organ image, and based on all the determined positive points, the biopsy lesion area is reconstructed on the target axial intraoperative target organ image to obtain the axial biopsy lesion area image corresponding to the target axial intraoperative target organ image;

[0098] All axial biopsy lesion area images are combined to obtain biopsy lesion area images.

[0099] Specifically, based on the depth information of the biopsy lesion area in the coordinate system of the intraoperative target organ image, all axial intraoperative target organ images containing lesions (i.e., target axial intraoperative target organ images) can be found from the three-dimensional intraoperative target organ image. For each target axial intraoperative target organ image, based on the position information of the biopsy lesion area in the coordinate system of the intraoperative target organ image, the axial position information of the biopsy lesion area on that target axial intraoperative image can be determined. Therefore, all positive points can be marked on that target axial intraoperative target organ image. Please refer to [reference needed]. Figure 7 This schematically illustrates the distribution of positive and negative points on the target organ image during surgery, provided in a specific example of this embodiment. For example... Figure 7 As shown in the figure, asterisks represent positive points, and small circles represent negative points. Based on all identified positive points, the biopsy lesion area is reconstructed on the target organ image during the procedure, thus obtaining an axial biopsy lesion area image. Combining all the axial biopsy lesion area images yields a three-dimensional biopsy lesion area image.

[0100] Further, the step of reconstructing the biopsy lesion region on the target axial intraoperative target organ image based on all identified positive points, to obtain the axial biopsy lesion region image corresponding to the target axial intraoperative target organ image, includes:

[0101] Based on all the identified positive points, a closed curve is reconstructed on the target organ image during the axial surgery, which does not extend beyond the target organ region and encloses all the positive points, in order to obtain the axial biopsy lesion region image corresponding to the target organ image during the axial surgery.

[0102] Therefore, for each target axial intraoperative target organ image, based on all positive points on the target axial intraoperative target organ image, a closed curve is reconstructed on the target axial intraoperative target organ image that does not exceed the target organ region (i.e., does not exceed the boundary of the target organ region) and encloses all the positive points. The area defined by the closed curve is the reconstructed axial biopsy lesion region, thereby obtaining the axial biopsy lesion region image corresponding to the target axial intraoperative target organ image.

[0103] In one exemplary embodiment, the image generation method further includes the following steps:

[0104] For each puncture needle, based on the biopsy pathology results corresponding to the puncture needle, the depth information of the non-lesion site of the biopsy area corresponding to the puncture needle is determined, and the needle insertion position information of the puncture needle in the coordinate system of the target organ image during the operation is used as the axial position information of the corresponding non-lesion site.

[0105] For each target organ image in the intraoperative axial view, based on the depth information and axial position information of the non-lesion site corresponding to each puncture needle, each negative point is determined on the target organ image in the intraoperative axial view.

[0106] Correspondingly, the step of reconstructing a closed curve on the target organ image in the target axial view, based on all the identified positive points, that does not exceed the target organ region and encloses all the positive points, includes:

[0107] For each positive point, determine whether there is a negative point on the target organ image of the target axis that is closest to the positive point and has not yet been identified as a target negative point. If so, identify the negative point as a target negative point. If not, identify the second closest negative point as a target negative point.

[0108] For each negative point on the target organ image in the target axial view, find the positive point closest to the negative point on the target organ image in the target axial view, and obtain the position information of the center point of the line connecting the negative point and the positive point;

[0109] Connect all the center points in sequence to form a curve;

[0110] The curve is extended along the boundary of the target organ region on the intraoperative target organ image of the target axis to surround all the positive points, thereby forming a closed curve that does not exceed the target organ region and surrounds all the positive points.

[0111] For details, please refer to Figure 8 It schematically illustrates a reconstructed closed curve provided in a specific example of this embodiment. Figure 8 The shaded area in the image represents the reconstructed axial biopsy lesion area. For example... Figure 8 As shown, for each target axial intraoperative target organ image, after determining each positive point and each negative point on the target axial intraoperative target organ image, for each positive point on the target axial intraoperative target organ image, first find the negative point closest to the positive point. If the closest negative point has not been previously identified as a target negative point, then the closest negative point is taken as the target negative point. If the closest negative point has been previously identified as a target negative point, then continue to find the second closest negative point to the positive point and take the second closest negative point as the target negative point. After identifying the target negative point corresponding to each positive point on the target organ image in the axial view, for each target negative point on the target organ image in the axial view, the nearest positive point on the target organ image in the axial view is found and connected to obtain the position information of the center point of the line connecting the target negative point and the nearest positive point. Then, all the center points are connected in sequence to form a curve. If the curve is not smooth enough, it can be smoothed. Finally, the curve is extended along the boundary of the target organ region on the target organ image in the axial view, thereby forming a closed curve that does not exceed the target organ region and surrounds all the positive points. The area defined by the closed curve is the axial biopsy lesion region reconstructed on the target organ image in the axial view, thereby obtaining the axial biopsy lesion region image.

[0112] In one exemplary embodiment, fusing the preoperative lesion region image and the biopsy lesion region image to obtain a fused lesion region image includes:

[0113] The preoperative target organ image and the intraoperative target organ image are registered to obtain a registration matrix;

[0114] Based on the registration matrix, the preoperative lesion area image and the biopsy lesion area image are transformed to the same coordinate system;

[0115] The preoperative lesion region image and the biopsy lesion region image, transformed to the same coordinate system, are fused to obtain a fused lesion region image.

[0116] Specifically, by registering the preoperative target organ image and the intraoperative target organ image, the spatial mapping relationship (i.e., the registration matrix) between the coordinate systems of the preoperative target organ image and the intraoperative target organ image can be obtained. This allows for the acquisition of the spatial mapping relationship (i.e., the registration matrix) between the coordinate systems of the preoperative lesion region image and the biopsy lesion region image. Furthermore, based on the registration matrix, the preoperative lesion region image can be transformed to the coordinate system of the biopsy lesion region image, or vice versa. Finally, by fusing the preoperative lesion region image and the biopsy lesion region image, which have been transformed to the same coordinate system, a fused lesion region image including the interpretation results of the preoperative medical image and the puncture biopsy results can be obtained.

[0117] It should be noted that the relevant content regarding how to register the preoperative target organ image and the intraoperative target organ image can be found in existing technologies and will not be elaborated here. Furthermore, it should be noted that, as those skilled in the art will understand, the preoperative lesion region image and the biopsy lesion region image, transformed to the same coordinate system, can be fused using a logical OR operation to obtain a fused lesion region image.

[0118] In one exemplary embodiment, the image generation method further includes the following steps:

[0119] In the coordinate system of the preoperative medical images, the preoperative target organ image, the preoperative lesion region image, the biopsy lesion region image, and the fused lesion region image are displayed respectively; or

[0120] In the coordinate system of the intraoperative medical images, the preoperative target organ image, the preoperative lesion area image, the biopsy lesion area image, and the fused lesion area image are displayed respectively.

[0121] Therefore, this setup makes it easier for doctors to observe. It should be noted that, as those skilled in the art will understand, when displaying the preoperative target organ image, the preoperative lesion region image, the biopsy lesion region image, and the fused lesion region image in the coordinate system of the preoperative medical image, the biopsy lesion region image reconstructed based on the coordinate system of the intraoperative medical image (the coordinate system of the intraoperative target organ image) needs to be transformed to the coordinate system of the preoperative medical image (the coordinate system of the preoperative target organ image) using the registration matrix mentioned above. Then, the biopsy lesion region image transformed to the coordinate system of the preoperative medical image is fused with the preoperative lesion region image to obtain the fused lesion region image in the coordinate system of the preoperative medical image. Similarly, when displaying the preoperative target organ image, the preoperative lesion region image, the biopsy lesion region image, and the fused lesion region image in the coordinate system of the intraoperative medical image, the preoperative lesion region image in the coordinate system of the preoperative medical image needs to be transformed to the coordinate system of the intraoperative medical image (the coordinate system of the intraoperative target organ image) using the registration matrix mentioned above. Then, the preoperative lesion region image transformed to the coordinate system of the intraoperative medical image is fused with the biopsy lesion region image in the coordinate system of the intraoperative medical image to obtain the fused lesion region image in the coordinate system of the intraoperative medical image. It should be noted that, as those skilled in the art will understand, the preoperative lesion region image can be superimposed on the preoperative target organ image, and similarly, the biopsy lesion region image can be superimposed on the intraoperative target organ image.

[0122] Example 2

[0123] Based on the same inventive concept, this embodiment provides an image generation system, please refer to... Figure 9 The diagram illustrates the block structure of the image generation system provided in the first embodiment of this work. Figure 9As shown, the image generation system includes a preoperative image processing module 100, an intraoperative image processing module 200, and a fusion module 300. The preoperative image processing module 100 is configured to identify the lesion region in the acquired preoperative medical images to obtain a preoperative lesion region image. The intraoperative image processing module 200 is configured to reconstruct the biopsy lesion region based on the needle insertion position information of each puncture needle and the corresponding biopsy pathology results to obtain a biopsy lesion region image. The fusion module 300 is configured to fuse the preoperative lesion region image and the biopsy lesion region image to obtain a fused lesion region image. Therefore, the image generation system provided in this embodiment, by combining the interpretation results of the preoperative medical images with the puncture biopsy results, can more accurately determine the location of the lesion region, thereby ensuring that in subsequent lesion removal surgery, neither overtreatment nor incomplete lesion removal is caused, effectively improving the effect of lesion removal surgery (e.g., ablation surgery).

[0124] Please continue to refer to this. Figure 9 ,like Figure 9 As shown, in an exemplary embodiment, the preoperative image processing module 100 includes a first image segmentation unit 110 and a lesion region identification unit 120; the first image segmentation unit 110 is configured to segment the target organ region of the acquired preoperative medical image to obtain a preoperative target organ image; the lesion region identification unit 120 is configured to identify the lesion region of the preoperative target organ image to obtain a preoperative lesion region image.

[0125] It should be noted that the specific details of how the first image segmentation unit 110 acquires the preoperative target organ image and how the lesion area identification unit 120 acquires the preoperative lesion area image can be found in the relevant description in Embodiment 1, and will not be repeated here.

[0126] Please continue to refer to this. Figure 9 ,like Figure 9 As shown, in an exemplary embodiment, the intraoperative image processing module 200 includes a second image segmentation unit 210, a text recognition unit 220, and a lesion region reconstruction unit 230; the second image segmentation unit 210 is configured to segment the target organ region of the acquired intraoperative medical image to obtain an intraoperative target organ image; the text recognition unit 220 is configured to acquire the needle insertion position information of each puncture needle and the corresponding biopsy pathology result information; the lesion region reconstruction unit 230 is configured to reconstruct the biopsy lesion region based on the acquired needle insertion position information of each puncture needle and the corresponding biopsy pathology result information to obtain a biopsy lesion region image.

[0127] It should be noted that the specific details regarding how the second image segmentation unit 210 acquires intraoperative target organ images, how the text recognition unit 220 acquires the needle insertion position information and corresponding biopsy pathology results information of each puncture needle, and how the lesion area reconstruction unit 230 acquires biopsy lesion area images can be found in the relevant descriptions in Embodiment 1, and will not be repeated here.

[0128] Please continue to refer to this. Figure 9 ,like Figure 9 As shown, in an exemplary embodiment, the fusion module 300 includes a registration unit 310 and a fusion unit 320; the registration unit 310 is configured to register the preoperative target organ image and the intraoperative target organ image to obtain a registration matrix; the fusion unit 320 is configured to transform the preoperative lesion region image and the biopsy lesion region image to the same coordinate system according to the registration matrix, and to fuse the preoperative lesion region image and the biopsy lesion region image transformed to the same coordinate system to obtain a fused lesion region image.

[0129] It should be noted that the specific details of how the registration unit 310 registers the preoperative target organ image and the intraoperative target organ image to obtain the registration matrix can be found in existing technologies and will not be repeated here. The specific details of how the fusion unit 320 transforms the preoperative lesion region image and the biopsy lesion region image to the same coordinate system, and how it fuses the transformed preoperative lesion region image and the biopsy lesion region image to the same coordinate system, can be found in the relevant description in Embodiment 1 and will not be repeated here.

[0130] Please continue to refer to this. Figure 9 ,like Figure 9 As shown, in one exemplary embodiment, the image generation system further includes an interaction module 400 configured for human-computer interaction.

[0131] Thus, through the interaction module 400, doctors can manually segment preoperative target organ images, identify preoperative lesion regions, segment intraoperative target organ images, and manually match the puncture needle insertion plan with the biopsy report needle by needle. Through the interaction module 400, doctors can also correct the output results of the first image segmentation unit 110, the lesion region identification unit 120, the second image segmentation unit 210, the text recognition unit 220, the lesion region reconstruction unit 230, the registration unit 310, and the fusion unit 320.

[0132] Please continue to refer to this. Figure 9 ,like Figure 9As shown, in one exemplary embodiment, the image generation system further includes an image storage module 500 configured to store the preoperative medical image, the preoperative lesion region image, the intraoperative medical image, the intraoperative target organ image, and the biopsy lesion region image.

[0133] Please continue to refer to this. Figure 9 ,like Figure 9 As shown, in one exemplary embodiment, the image generation system further includes a display module 600; the display module 600 is configured to display the preoperative target organ image, the preoperative lesion region image, the biopsy lesion region image, and the fused lesion region image respectively in the coordinate system of the preoperative medical image; or to display the preoperative target organ image, the preoperative lesion region image, the biopsy lesion region image, and the fused lesion region image respectively in the coordinate system of the intraoperative medical image.

[0134] For details, please refer to Figure 10 This schematically illustrates the display interface of the display module 600 provided in a specific example of this embodiment. For example... Figure 10 As shown, the display module 600 can display the fused lesion area image in the center of the interface, the preoperative target organ image and the preoperative lesion area image on one side of the interface, and the intraoperative target organ image and the biopsy lesion area image on the other side of the interface. Further, as... Figure 10 As shown, the display module 600 is further configured to overlay the preoperative target organ image and the preoperative lesion area image, and to overlay the intraoperative target organ image and the biopsy lesion area image. Preferably, as shown... Figure 10 As shown, the display module 600 is further configured to display the preoperative medical image above the preoperative target organ image and the preoperative lesion area image, and to display the intraoperative medical image above the intraoperative target organ image and the biopsy lesion area image.

[0135] Example 3

[0136] Based on the same inventive concept, this embodiment provides a readable storage medium storing a computer program. When executed by a processor, the computer program implements the image generation method described above. Since the readable storage medium provided in this embodiment and the image generation method described above belong to the same inventive concept, the readable storage medium provided in this embodiment possesses all the advantages of the image generation method described above. Therefore, the beneficial effects of the image generation method provided in this embodiment will not be elaborated upon here.

[0137] It should be noted that, as those skilled in the art will understand, the readable storage medium provided in this embodiment can be any combination of one or more computer-readable media. A readable medium can be a computer-readable signal medium or a computer-readable storage medium. A computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of computer-readable storage media (a non-exhaustive list) include: an electrical connection having one or more wires, a portable computer hard disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this document, a computer-readable storage medium can be any tangible medium that contains or stores a program that can be used by or in combination with an instruction execution system, apparatus, or device.

[0138] Furthermore, it should be noted that, as those skilled in the art will understand, a computer-readable signal medium may include data signals propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to wireless, wired, optical fiber, RF, etc., or any suitable combination thereof.

[0139] Example 4

[0140] Based on the same inventive concept, this embodiment provides an electronic device, which includes the readable storage medium 730 or the image generation system described above. Since the electronic device provided in this embodiment belongs to the same inventive concept as the readable storage medium 730 or the image generation system described above, the electronic device provided in this embodiment has all the advantages of the readable storage medium 730 or the image generation system described above. Therefore, the beneficial effects of the electronic device provided in this embodiment will not be described in detail here.

[0141] Please continue to refer to this. Figure 11 The diagram illustrates the block structure of the electronic device provided in the first embodiment of this work. Figure 11 As shown, the electronic device also includes a processor 710, and when the computer program stored on the readable storage medium 730 is executed by the processor 710, it implements the image generation method described above.

[0142] Furthermore, such as Figure 11 As shown, the electronic device also includes a communication interface 720 and a communication bus 740, wherein the processor 710, the communication interface 720, and the readable storage medium 730 communicate with each other via the communication bus 740. The communication bus 740 can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. This communication bus 740 can be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is used to represent it in the figure, but this does not indicate that there is only one bus or one type of bus. The communication interface 720 is used for communication between the aforementioned electronic device and other devices.

[0143] In this embodiment, the processor 710 can be a Central Processing Unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor. The processor 710 is the control center of the electronic device, connecting various parts of the entire electronic device through various interfaces and lines.

[0144] In summary, compared with the prior art, the image generation method, system, readable storage medium, and electronic device provided by the present invention have the following advantages:

[0145] This invention identifies the lesion region from preoperative medical images to obtain a preoperative lesion region image; then, based on the needle insertion positions of each puncture needle and the corresponding biopsy pathology results, reconstructs the biopsy lesion region to obtain a biopsy lesion region image; finally, the preoperative lesion region image and the biopsy lesion region image are fused to obtain a fused lesion region image. Therefore, by combining the interpretation results of preoperative medical images with the puncture biopsy results, this invention can more accurately determine the location of the lesion region, thus ensuring that in subsequent lesion removal surgery, neither overtreatment nor incomplete lesion removal is caused, effectively improving the effect of lesion removal surgery (e.g., ablation surgery).

[0146] It should be noted that, as those skilled in the art will understand, computer program code for performing the operations of this invention can be written in one or more programming languages ​​or a combination thereof. These programming languages ​​include object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as C or similar languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0147] It should be noted that the apparatus and methods disclosed in the embodiments herein can also be implemented in other ways. The apparatus embodiments described above are merely illustrative; for example, the flowcharts and block diagrams in the accompanying drawings show the architecture, functionality, and operation of possible implementations of apparatus, methods, and computer program products according to various embodiments herein. In this regard, each block in a flowchart or block diagram may represent a module, program, or part of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order than those marked in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in a block diagram and / or flowchart, and combinations of blocks in block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system to perform the specified function or action, or can be implemented using a combination of dedicated hardware and computer instructions.

[0148] In addition, the functional modules in the various embodiments of this article can be integrated together to form an independent part, or each module can exist independently, or two or more modules can be integrated to form an independent part.

[0149] The above description is merely a description of preferred embodiments of the present invention and is not intended to limit the scope of the invention in any way. Any changes or modifications made by those skilled in the art based on the above disclosure are within the protection scope of the present invention. Obviously, those skilled in the art can make various modifications and variations to the present invention without departing from its spirit and scope. Therefore, if these modifications and variations fall within the scope of the present invention and its equivalents, the present invention also intends to include these modifications and variations.

Claims

1. An image generation method, characterized in that, The image generation method includes the following steps: The acquired preoperative medical images are used to identify the lesion areas in order to obtain preoperative lesion area images; Based on the needle insertion position information of each puncture needle and the corresponding biopsy pathology results, the biopsy lesion area is reconstructed to obtain an image of the biopsy lesion area. The preoperative lesion area image and the biopsy lesion area image are fused to obtain a fused lesion area image; The insertion position information of each puncture needle is obtained by acquiring the puncture needle insertion plan; The puncture needle insertion plan is obtained through the following steps: The acquired intraoperative medical images are segmented to obtain intraoperative images of the target organ. Based on the intraoperative target organ image, determine the insertion position information of each puncture needle in the coordinate system of the intraoperative target organ image to obtain the puncture needle insertion plan. The step of reconstructing the biopsy lesion area based on the obtained needle insertion position information of each puncture needle and the corresponding biopsy pathology results to obtain an image of the biopsy lesion area includes: Based on the needle insertion position information of each puncture needle in the coordinate system of the intraoperative target organ image and the corresponding biopsy pathology results, the position information of the biopsy lesion area in the coordinate system of the intraoperative target organ image is obtained. The position information includes axial position information and depth information. Based on the depth information of the biopsy lesion area in the coordinate system of the intraoperative target organ image, all axial intraoperative target organ images with lesion areas are determined in the intraoperative target organ image, and are used as target axial intraoperative target organ images. For each target axial intraoperative target organ image, based on the position information of the biopsy lesion area in the coordinate system of the target intraoperative target organ image, each positive point is determined on the target axial intraoperative target organ image, and based on all the determined positive points, the biopsy lesion area is reconstructed on the target axial intraoperative target organ image to obtain the axial biopsy lesion area image corresponding to the target axial intraoperative target organ image; All axial biopsy lesion area images are combined to obtain biopsy lesion area images.

2. The image generation method according to claim 1, characterized in that, The step of identifying the lesion region from the acquired preoperative medical images to obtain preoperative lesion region images includes: The acquired preoperative medical images are segmented to obtain preoperative images of the target organ. The lesion region is identified from the preoperative target organ image to obtain a preoperative lesion region image.

3. The image generation method according to claim 2, characterized in that, The step of obtaining the position information of the biopsy lesion area in the coordinate system of the intraoperative target organ image based on the needle insertion position information of each puncture needle in the coordinate system of the intraoperative target organ image and the corresponding biopsy pathology results includes: For each puncture needle, based on the biopsy pathology results corresponding to the puncture needle, it is determined whether there is a lesion in the biopsy area corresponding to the puncture needle. If so, the puncture needle is used as the target puncture needle. For each target puncture needle, based on the biopsy pathology results of the puncture needle, the depth information of the lesion in the biopsy area corresponding to the puncture needle is determined, and the needle insertion position information of the puncture needle in the coordinate system of the target organ image during the operation is used as the axial position information of the corresponding lesion. For each lesion site, the position information of the lesion site in the coordinate system of the target organ image during the operation is obtained based on the axial position information and depth information of the lesion site. Based on the position information of all lesion sites in the coordinate system of the intraoperative target organ image, the position information of the biopsy lesion area in the coordinate system of the intraoperative target organ image is obtained.

4. The image generation method according to claim 3, characterized in that, The step of reconstructing the biopsy lesion region on the target axial intraoperative target organ image based on all identified positive points, to obtain the axial biopsy lesion region image corresponding to the target axial intraoperative target organ image, includes: Based on all the identified positive points, a closed curve is reconstructed on the target organ image during the axial surgery, which does not extend beyond the target organ region and encloses all the positive points, in order to obtain the axial biopsy lesion region image corresponding to the target organ image during the axial surgery.

5. The image generation method according to claim 4, characterized in that, The image generation method further includes the following steps: For each puncture needle, based on the biopsy pathology results corresponding to the puncture needle, the depth information of the non-lesion site of the biopsy area corresponding to the puncture needle is determined, and the needle insertion position information of the puncture needle in the coordinate system of the target organ image during the operation is used as the axial position information of the corresponding non-lesion site. For each target axial intraoperative target organ image, based on the depth information and axial position information of the non-lesion site corresponding to each puncture needle, each negative point is determined on the target axial intraoperative target organ image; The step of reconstructing a closed curve on the target organ image in the target axial view, based on all identified positive points, that does not extend beyond the target organ region and encloses all the positive points, includes: For each positive point, determine whether there is a negative point on the target organ image of the target axis that is closest to the positive point and has not yet been identified as a target negative point. If so, identify the negative point as a target negative point. If not, identify the second closest negative point as a target negative point. For each negative point on the target organ image in the target axial view, find the positive point closest to the negative point on the target organ image in the target axial view, and obtain the position information of the center point of the line connecting the negative point and the positive point; Connect all the center points in sequence to form a curve; The curve is extended along the boundary of the target organ region on the intraoperative target organ image of the target axis to surround all the positive points, thereby forming a closed curve that does not exceed the target organ region and surrounds all the positive points.

6. The image generation method according to claim 2, characterized in that, The process of fusing the preoperative lesion region image and the biopsy lesion region image to obtain a fused lesion region image includes: The preoperative target organ image and the intraoperative target organ image are registered to obtain a registration matrix; Based on the registration matrix, the preoperative lesion area image and the biopsy lesion area image are transformed to the same coordinate system; The preoperative lesion region image and the biopsy lesion region image, transformed to the same coordinate system, are fused to obtain a fused lesion region image.

7. An image generation system, characterized in that, include: The preoperative image processing module is configured to identify the lesion area in the acquired preoperative medical images in order to obtain preoperative lesion area images. The intraoperative image processing module is configured to reconstruct the biopsy lesion area based on the needle insertion position information of each puncture needle and the corresponding biopsy pathology results, so as to obtain the biopsy lesion area image. as well as The fusion module is configured to fuse the preoperative lesion area image and the biopsy lesion area image to obtain a fused lesion area image; The insertion position information of each puncture needle is obtained by acquiring the puncture needle insertion plan; The puncture needle insertion plan is obtained through the following steps: The acquired intraoperative medical images are segmented to obtain intraoperative images of the target organ. Based on the intraoperative target organ image, determine the insertion position information of each puncture needle in the coordinate system of the intraoperative target organ image to obtain the puncture needle insertion plan. The step of reconstructing the biopsy lesion area based on the obtained needle insertion position information of each puncture needle and the corresponding biopsy pathology results to obtain an image of the biopsy lesion area includes: Based on the needle insertion position information of each puncture needle in the coordinate system of the intraoperative target organ image and the corresponding biopsy pathology results, the position information of the biopsy lesion area in the coordinate system of the intraoperative target organ image is obtained. The position information includes axial position information and depth information. Based on the depth information of the biopsy lesion area in the coordinate system of the intraoperative target organ image, all axial intraoperative target organ images with lesion areas are determined in the intraoperative target organ image, and are used as target axial intraoperative target organ images. For each target axial intraoperative target organ image, based on the position information of the biopsy lesion area in the coordinate system of the target intraoperative target organ image, each positive point is determined on the target axial intraoperative target organ image, and based on all the determined positive points, the biopsy lesion area is reconstructed on the target axial intraoperative target organ image to obtain the axial biopsy lesion area image corresponding to the target axial intraoperative target organ image; All axial biopsy lesion area images are combined to obtain biopsy lesion area images.

8. A readable storage medium, characterized in that, The readable storage medium stores a computer program, which, when executed by a processor, implements the image generation method according to any one of claims 1 to 6.

9. An electronic device, characterized in that, Includes the image generation system of claim 7 or the readable storage medium of claim 8.

Images