System and method for planning resection of lesions by linear cutting stapler surgery

By generating personalized anatomical 3D models and cutting anastomosis plans, the accuracy and safety issues of preoperative planning in video-assisted thoracic surgery were resolved, enabling more accurate and reliable resection of lung lesions.

CN118902608APending Publication Date: 2024-11-08YIDA TECH CO
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
CN202411291412.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2019-10-23
Filing Date
2020-10-23
Publication Date
2024-11-08

AI Technical Summary

Technical Problem

Existing computer-aided medical technologies suffer from insufficient precision and safety in preoperative planning during video-assisted thoracic surgery, especially when dealing with lung lesion resection. It is difficult to accurately map the difference between the collapsed lung and the 3D model, leading to inconsistencies and unpredictability in surgical execution.

Method used

By generating personalized anatomical 3D models of patients, machine learning and big data analysis are used to determine the resection plan for cutting the stapler, including estimating the stapler box size and staple length, and visualizing the resection results, providing realistic preoperative planning.

Benefits of technology

It improves the accuracy and safety of preoperative planning, ensures the accuracy and consistency of surgical resection, and reduces uncertainties during surgery.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118902608A_ABST
    Figure CN118902608A_ABST
Patent Text Reader

Abstract

The present disclosure relates to systems and methods for planning surgical resection of lesions by a linear cutting stapler. Methods, systems, media, and embodiments for computer-assisted preoperative procedure planning are described. The system receives input data acquired regarding a part of a patient. The site corresponds to an organ of a patient to be operated (e.g., lung) and includes one or more lesions to be removed during the operation. An anatomical 3D model of the patient site is then generated. Based on the generated anatomical 3D model, a pre-operative plan is obtained for resecting one or more lesions from the organ to be performed by a linear cutting stapler during the surgery. The stapler cartridge size and staple length are estimated based on the preoperative plan. In addition, resection is visualized based on the preoperative plan.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] This application is a divisional application of an application with an application date of October 23, 2020, application number 202080086010.5, and invention name “System and method for planned surgical removal of lesions via linear cutting stapler”.

[0002] CROSS-REFERENCE TO RELATED APPLICATIONS

[0003] This application is a U.S. national phase application under 35 U.S.C. §371 of International Patent Application No. PCT / US2020 / 057201 filed on October 23, 2020, claiming priority to U.S. Provisional Patent Application 62 / 924,972 filed on October 23, 2019, the contents of which are incorporated herein by reference in their entirety. Technical Field

[0004] The present disclosure relates to computer-assisted medical procedures. Background Art

[0005] In recent decades, the ubiquity of the Internet and access to data in electronic form has facilitated the advancement of various technologies, including big data analysis and machine learning. Artificial intelligence (AI) technologies have been applied to computer-assisted medicine, including surgical planning based on big data and machine learning. For example, machine learning techniques have been used to generate realistic 3D models of patient anatomy from CT / MRI scans and X-ray images based on historical data. In recent years, medical professionals have used such computer-generated 3D models as visual aids to plan medical procedures in order to make the actual operation more accurate and goal-driven. For example, by drawing the cutting lines and drilling paths on the model on the computer for the part of the human body to be operated on, the surgeon is able to visualize the procedure before the procedure. The typical goal of preoperative surgical planning can also be used to identify the exact 3D location where the lesion is located and determine the location of the cutting lines during the operation accordingly.

[0006] Due to its minimally invasive nature, video-assisted thoracic surgery (VATS) has been widely used in various surgeries, such as thoracic surgery. For example, with the help of a special video camera called a thoracoscope, a healthcare provider can perform a wedge resection (removal of a lesion, such as a cancerous tumor or suspicious nodule, and a wedge-shaped portion of healthy tissue surrounding the lesion), a segmentectomy (removal of one or more lung segments), a lobectomy (removal of one or more lobes of a lung), or a pneumonectomy (removal of the entire lung on either side). Both wedge resections and segmentectomies (which may also be referred to as sublobectomies) are less invasive than more extensive lung surgeries (such as lobectomies or pneumonectomies) and can preserve more lung function.

[0007] During such an operation, the lung to be operated on may collapse (partially or completely) because the air may be expelled. This can make more room in the chest cavity for surgery and make it easier to manipulate surgical instruments. However, this may bring about differences between the 3D model and reality during surgery, because the CT / MRI scans and X-ray images on which the patient's 3D model is based are obtained when the patient has respiratory activity. That is, the 3D model is based on images acquired when the patient's lungs are in their normal physiological state (i.e., filled with air). This difference may exist in the appearance and dimensions between the deflated lung during surgery and the undeflated lung rendered in the 3D model. In this case, the surgeon must overcome the obstacles caused by this difference during surgery based on a mental mapping between the two based on experience in order to decide where to cut, the width and depth of the cut, etc. This will lead to inconsistency and unpredictability in the execution of the operation.

[0008] Therefore, there is a need for methods and systems that address the deficiencies of existing methods to provide more realistic preoperative planning with improved accuracy and enhanced safety. Summary of the invention

[0009] The teachings disclosed herein relate to methods, systems, and programming for preoperative planning. More particularly, the teachings relate to methods, systems, and programming related to preoperative planning.

[0010] In one example, a method for preoperative planning is disclosed, which is implemented on a machine having at least one processor, a storage device, and a communication platform capable of connecting to a network. Input data acquired about a patient's part is received. The part corresponds to the patient's organ to be operated on and includes one or more lesions to be removed during the operation. Then, an anatomical 3D model of the patient's part is generated. Based on the generated anatomical 3D model, a preoperative plan is obtained for linearly cutting the stapler to remove one or more lesions from the organ to be performed during the operation. The stapler box size and the staple length are estimated based on the preoperative plan. In addition, the resection is visualized based on the preoperative plan.

[0011] In a different example, a system for preoperative planning is disclosed. The system includes an input data receiving unit, an anatomical 3D model generating unit, a plan obtaining unit, and a plan visualization unit. The input data receiving unit receives input data acquired about a part of a patient. The part corresponds to the patient's organ to be operated on and includes one or more lesions to be removed during the operation. The anatomical 3D model generating unit generates an anatomical 3D model of the part. The plan obtaining unit obtains a preoperative plan for linearly cutting and stapler-removing one or more lesions from the organ to be performed during the operation based on the generated anatomical 3D model. The plan visualization unit estimates the stapler box size and the staple length based on the preoperative plan. The plan visualization unit also visualizes the resection based on the obtained preoperative plan.

[0012] Other concepts relate to software for implementing the present teachings. According to this concept, a software product includes at least one machine-readable non-transitory medium and information carried by the medium. The information carried by the medium may be executable program code data, parameters associated with the executable program code, and / or information related to a user, request, content, or other additional information.

[0013] In one example, a machine-readable, non-transitory and tangible medium is disclosed on which data for preoperative planning is recorded. The medium, when read by a machine, causes the machine to perform a series of steps. Input data acquired about a part of a patient is received. The part corresponds to an organ of the patient to be operated on and includes one or more lesions to be removed during the operation. An anatomical 3D model of the patient's part is generated. Based on the generated anatomical 3D model, a preoperative plan is obtained for linearly cutting and stapled removal of one or more lesions from the organ to be performed during the operation. Stapler box size and staple length are estimated based on the preoperative plan. Resection is visualized based on the preoperative plan.

[0014] Additional advantages and novel features will be set forth in part in the following description, and in part will become apparent to those skilled in the art upon examination of the following and accompanying drawings, or may be learned through production or operation of the examples. The advantages of the present teachings may be realized and obtained by practicing or using the various aspects of the methods, tools, and combinations set forth in the detailed examples discussed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] The methods, systems and / or programming described herein will be further described according to exemplary embodiments. These exemplary embodiments are described in detail with reference to the accompanying drawings. These embodiments are non-limiting exemplary embodiments, in which the same reference numerals represent similar structures throughout the several views of the drawings, and in which:

[0016] Figure 1 Schematic illustration of the anatomy of the lung segments and a wedge resection performed on one of the lung segments;

[0017] Figure 2 depicts an exemplary high-level system diagram of an overall system for surgical resection planning according to an exemplary embodiment of the present teachings;

[0018] Figure 3 is a flow chart of an exemplary process of an overall system for surgical resection planning according to an exemplary embodiment of the present teachings;

[0019] Figure 4 An exemplary high-level system diagram of an anatomical 3D model generation unit according to an exemplary embodiment of the present teachings is depicted;

[0020] Figure 5 is a flow chart of an exemplary process of an anatomical 3D model generation unit according to an exemplary embodiment of the present teachings;

[0021] Fig. 6A A conceptual exemplary schematic diagram showing a wedge resection as an example of surgical resection;

[0022] Figure 6B A simplified conceptual exemplary schematic diagram of a wedge resection is shown;

[0023] Figure 7A-7B depicts different exemplary planning options for a wedge resection according to an embodiment of the present teachings, wherein a lesion, a safety margin, and other anatomical structure(s) of interest are projected onto a base plane of the wedge resection;

[0024] Figure 7C-7D depicts an exemplary adjustment of the orientation and length of a baseline for a wedge resection according to an embodiment of the present teachings;

[0025] Figure 8 depicts an exemplary high-level system diagram of a wedge resection planning unit according to an exemplary embodiment of the present teachings;

[0026] Fig. 9 is a flow chart of an exemplary process of a wedge resection planning unit according to an exemplary embodiment of the present teachings;

[0027] Fig. 10A -C depicts an exemplary linear cutting stapler, an exemplary stapler cartridge, and an exemplary stapler that may be used to perform a planned wedge resection procedure according to an exemplary embodiment of the present teachings;

[0028] Fig.11 depicts an exemplary high-level system diagram of a resection plan result rendering unit according to an exemplary embodiment of the present teachings;

[0029] Fig.12 is a flowchart of an exemplary process of a resection plan result rendering unit according to an exemplary embodiment of the present teachings;

[0030] Fig.13A A conceptual exemplary schematic diagram for determining staple cartridge length and mapping cut lines onto a lung surface is shown;

[0031] Fig. 13B A conceptual exemplary schematic diagram for visualizing planned staple locations on a lung surface is shown;

[0032] Fig.14 is an illustrative diagram of an exemplary mobile device architecture that can be used to implement a dedicated system for implementing the present teachings, according to various embodiments; and

[0033] Fig.15 is an illustrative diagram of an exemplary computing device architecture that can be used to implement a special purpose system for implementing the present teachings, according to various embodiments. DETAILED DESCRIPTION

[0034] In the following detailed description, numerous specific details are set forth by way of example to facilitate a thorough understanding of the relevant teachings. However, it should be understood by those skilled in the art that the present teachings may be practiced without these details. In other cases, well-known methods, processes, components, and / or software / hardware / firmware have been described at a relatively high level without detailed description to avoid unnecessarily obscuring aspects of the present teachings.

[0035] This teaching is intended to address the deficiencies of traditional methods in preoperative planning. In the solution disclosed herein, in order to plan the surgical resection of a lesion, the shape, size, orientation and / or position of the resection can be determined via image recognition and big data. In addition, the planned characteristics of the resection can be efficiently used to estimate the relevant parameters of the surgical instruments to be used in the operation. In addition, the planning results can be visually rendered to the user in a realistic and intuitive manner. Although the description provided herein is for planning wedge resection using a linear cutting stapler in video-assisted thoracic surgery, this teaching is not limited to the specific disclosed applications. This teaching is applicable to open surgery on other organs and / or using other surgical instruments.

[0036] As is known, the resection of lesions in VATS is usually based on a local approach, such as wedge resection or segmentectomy. In a wedge resection, only a portion of the lung containing the lesion is removed. Segmentectomy is a procedure to remove the segment containing the lesion without affecting other lung segments to maintain maximum lung function.

[0037] Figure 1 Schematic illustration of the anatomy of the lung segments and a wedge resection performed on one of the lung segments. Figure 1, reference numeral 101 denotes the trachea, 102 denotes the left lung, and 103 denotes the right lung. It is known that each lung (left and right) is divided into a plurality of lung segments. Each of these segments is provided with airflow by its associated bronchus. Each bronchopulmonary segment is separated from the rest of the lung by a connective tissue septum. This property allows surgical intervention on a lung segment without affecting the other segments. Region 104 inside the lungs 102-103 is an illustration of a plurality of lung segments. A lesion is indicated by 105. Two resection lines 106 and 107 represent wedge-shaped resections on one of the lung segments 104. Although the cut is shown starting from the side of the lung, this is not always necessary. Depending on the location of the lesion, the lung may be manipulated to fold in the middle for resection. For example, the cut may also be made substantially perpendicular to the side of the lung. Figure 1 Start in the direction of the paper surface.

[0038] Figure 2 An exemplary high-level system diagram of an overall system for surgical resection planning according to an exemplary embodiment of the present teachings is depicted. The overall system includes an anatomical 3D model generation unit 210, a wedge resection planning unit 220, a planning result rendering unit 230, a user interface unit 240, and a knowledge database 250. The knowledge database 250 is provided to store information that will be used to generate a 3D model. This information can be loaded from the cloud during the system initialization process. It can be dynamically updated via machine learning and big data management.

[0039] Figure 3 300 is a flow chart of an exemplary process of an overall system for surgical resection planning according to an exemplary embodiment of the present teachings. Process 300 is initialized at 301 by receiving image data of a patient via user interface unit 240. During initialization, relevant knowledge or information, such as models for identifying various anatomical structures, criteria to be met by the plan, and specifications of surgical instruments to be selected, may be loaded to facilitate subsequent processing. Input may be received via user interface unit 240 for the purpose of controlling or fine-tuning the process.

[0040] Subsequently, at 320, the anatomical 3D model generation unit 210 can construct an individualized or personalized anatomical 3D model for the patient based on the patient's image data according to the loaded knowledge. Based on the 3D anatomical model constructed by the anatomical 3D model generation unit 210, at 330, the wedge resection planning unit 220 can plan the wedge resection according to various characteristics (such as shape, size, orientation and position) based on input from the user. In addition, at 340, the planning result rendering unit 230 can calculate or estimate certain parameters of the surgical instrument (such as a linear cutting stapler) based on the relevant characteristics of the planned resection, and render the results in a vivid and intuitive manner. During this process, not only the (final) result, but optionally, certain intermediate results, such as the generated 3D model, the planned wedge shape, etc., can also be rendered to the user via the user interface unit 240.

[0041] The following will explain in more detail Figure 2-3 The specific functions and operations of the modules and processes shown in .

[0042] Figure 4 Depicted is an exemplary embodiment according to the present teachings. Figure 2 An exemplary high-level system diagram of the anatomical 3D model generation unit 201 is shown in FIG. In operation, since each individual patient's lung physiology is different, in order to obtain a personalized lung segment model, the patient's CT / MRI scan can be input. Based on the input image data, a 3D model of the bronchi can be constructed, from which the lung segments can be divided, and other anatomical structures such as lesions, pulmonary arteries, and pulmonary veins can be identified. Figure 4 As shown in , the anatomical 3D model generating unit 201 includes a data receiving unit 410 , a segment estimating unit 420 , a lesion localizing unit 430 , an anatomical structure of interest identifying unit 440 , an anatomical model constructing unit 450 and an anatomical model sending unit 460 .

[0043] Figure 5 5 is a flow chart of an exemplary process of the anatomical 3D model generation unit 201 according to an exemplary embodiment of the present teachings. First, the process 500 begins at 510, where the data receiving unit 410 receives image data of the patient and certain inputs from the user. The data receiving unit 410 can then forward the relevant data to the different units 420-440.

[0044] Based on the data received from the data receiving unit 410, at 520, the segment estimation unit 420 can estimate the segments of the lungs. The estimation of the lung segments can be performed automatically or semi-automatically based on the segmentation model retrieved from the knowledge database 250. In one embodiment, the lung segments can be divided by identifying different bronchial branches, because each bronchial branch corresponds to a lung segment. More specifically, for example, initially, the bronchial branches can be automatically or manually marked based on medical knowledge. Then, for each pixel inside the lung, if the pixel is closest to the bronchial branch representing the segment, then the pixel can be assigned to the corresponding segment. In one embodiment, it may be necessary to estimate the lung segments only with respect to the bronchial branches close to the lesion to be resected. In another embodiment, all lung segments can be estimated.

[0045] Subsequently, at 530, the lesion localization unit 430 may localize the lesion within the divided lung segment, and at 540, the anatomical structure of interest identification unit 440 may also identify other anatomical structures of interest from the patient's image data. The lesion localization may be achieved based on the lesion model retrieved from the knowledge database 250. The anatomical structures of interest may include, but are not limited to, 3D lungs, bronchi, lesions, pulmonary arteries, pulmonary veins, and the like.

[0046] Based on the results from the segment estimation unit 420, the lesion localization unit 430, and the anatomical structure of interest identification unit 440, at 550, the 3D model construction unit 450 can create a 3D anatomical model of the patient's lungs. The 3D model generated by the 3D model construction unit 450 is sent out at 560 for subsequent processing via the anatomical model sending unit 460. Optionally, the generated 3D model is also sent for rendering on a display (not shown) via the user interface unit 240.

[0047] In the following, according to the exemplary embodiments of the present teaching, reference will be made to Figures 6A-7C Explain the rationale for planning a wedge resection.

[0048] Fig. 6A A conceptual exemplary schematic diagram for performing a wedge resection on the lung surface is shown. Fig. 6A In the side view of the wedge shape 600 shown in FIG. 1 , reference numerals 108 and 110 represent surfaces formed along cutting lines 106 and 107 of a surgical instrument such as a linear cutting stapler and may be referred to as cutting surfaces. The height 109 of the wedge shape 600 represents the thickness of the lung after folding.

[0049] Figure 6B A simplified conceptual exemplary schematic diagram of a wedge resection is shown. Fig. 6A In comparison, Figure 6B In the wedge shape 610 shown in FIG. 1 , the height or thickness 109 of the wedge is ignored. This is reasonable because the top and bottom surfaces of the lung will collapse together in the local area of ​​the cut. For example, as the linear cutting stapler is operated, they will be cut and firmly pressed to a thickness between 2 mm and 4 mm, which is within the typical staple length range of linear cutting staplers on the market.

[0050] like Figure 6B As shown in FIG. 6 , two cutting lines 106 and 107 define a triangular profile together with a base line 111 of a simplified wedge shape 610. The tip-vertex of the triangular profile is indicated by reference numeral 114, and 112 indicates the center point of the base line 111. The primary goal of resection planning is to determine the profile, position, and orientation of the simplified wedge shape 610 on the lung surface relative to lung segments, lesions, and other critical anatomical structures that may need to be avoided during resection.

[0051] Fig. 7A Depicted are exemplary planning options for a wedge resection according to an embodiment of the present teachings. Fig. 7A, an example of collapsed anatomical objects is exemplarily illustrated. That is, some objects collapse onto a base plane 750 defined by a lesion center 710 and a baseline 111. Reference numeral 720 denotes a collapsed boundary of a lesion, 730 denotes a collapsed 3D safety margin boundary, and 740 denotes a vascular structure near the lesion.

[0052] Figure 7B Another exemplary planning option for baseline length and vertex-tip location according to an embodiment of the present teachings is illustrated. Fig. 7A Compared with the determination shown in Figure 7B , the length of the baseline 111 is shorter. Using the new length, a cutting line 107 can be automatically generated by avoiding nearby blood vessels 740. Another cutting line 106 can also be automatically determined by finding a line tangent to the boundary of the safety margin 730. The intersection of the cutting lines 106 and 107 can then determine the location of the tip vertex 114.

[0053] To decide Fig. 7A and 7B Different criteria can be applied to determine which of the options shown in is the better resection plan. An example of a criterion could be to find the resection plan that results in the smallest area of ​​the base plane (i.e., determine Figure 7A-7B Which of the two triangles 106-111-107 in the cut line 106-107 has the smaller area). This makes sense because resection generally removes as little healthy tissue as possible. Another exemplary criterion can be a combination of the area of ​​the base plane and other considerations, such as the degree of inflammation along the cutting line 106-107. For example, a weighted average of the area and the degree of inflammation can be calculated and used as an error measure. The goal is then to find the resection plan that produces the smallest error measure.

[0054] Figure 7C-7D Depicted is an exemplary manual adjustment of the orientation and length of the baseline 111 for wedge resection according to an embodiment of the present teachings. Figure 7C In the example shown, the adjustment can be performed by a dial-like regulator provided via the user interface unit 240. By grabbing the baseline 111 and dragging it to any desired angle, the user can rotate the baseline 111 around the center point 112 to select an orientation based on ease of operation and other medical considerations. Reference numeral 760 represents the rotation trajectory of the baseline 111 during orientation selection. Similarly, by dragging a slide bar that can be provided on the user interface unit 240, the length of the baseline 111 can be selected by adjusting the position of one or both end points of the baseline 111.

[0055] Figure 8 An exemplary high-level system diagram of a wedge resection planning unit 220 is depicted in accordance with an exemplary embodiment of the present teachings. Figure 8 As shown in FIG. 8 , the wedge resection planning unit 220 includes a data receiving unit 810, a safety margin determining unit 820, a baseline determining unit 830, a tip vertex determining unit 840, a wedge resection verification unit 850, a wedge resection standard library 860, and a wedge resection sending unit 870. Although the wedge resection standard library 860 is shown as a separate component included in the wedge resection planning unit 220, it can be incorporated into Figure 2 In the knowledge database 250 shown in .

[0056] Fig. 9 is a flow chart of an exemplary process of the wedge resection planning unit 220 according to an exemplary embodiment of the present teachings. The process 900 begins at 910, where the data receiving unit 810 can receive the personalized 3D model of the patient from the anatomical 3D model generation unit 210 and the user input from the user interface unit 240, and forward the relevant signals to the corresponding components.

[0057] Then, at 915, based on the data received from the data receiving unit 810, the safety margin determining unit 820 may determine a safety margin to be used in the planning of the wedge resection. Figure 7A-7B As can be seen in , the safety margin determines the additional tissue to be cut around the lesion. In an embodiment, the 3D safety margin can be obtained by the safety margin generation unit 820 based on the lesion model (e.g., retrieved from the knowledge database 250). In another embodiment, the 3D safety margin can be obtained according to a user-defined margin value (e.g., received from the user via the user interface unit 240). Upon receiving such a value, the safety margin generation unit 820 can generate a 3D safety margin surface by defining an equidistant surface from the lesion surface, where the distance is the margin value. In addition, the generated 3D safety margin surface can be locally redefined by the user, for example, to avoid major blood vessels.

[0058] Based on the data sent from the data receiving unit 810, at 920-930, the baseline determining unit 830 can determine various parameters related to the baseline 111 of the wedge resection, including the position of the center point 112 on the lung surface, and the length and orientation of the baseline 111. First, at 920, a point on the lung surface can be selected as the center point 112 of the baseline 111. In an embodiment, the center point 112 can be automatically determined as the point with the shortest distance from the center 710 or the lesion surface 720 (e.g., Figure 7A-7B In another embodiment, the center point 112 may be manually positioned by the user at any desired point on the lung surface of the lung segment in question.

[0059] Then, the process 900 continues with selecting the orientation and length of the baseline 111 at 920 and 925. In an embodiment, the orientation and length of the baseline 111 may be selected in the following manner: Figure 7C-7D Alternatively, the length of the baseline 111 can be determined by combining Figure 7A-7B The method described is automatically selected.

[0060] Once the baseline 111 is determined, at 935, the tip vertex determination unit 840 may project the safety margin surface determined at 915, as well as the lesion and other key anatomical structures of interest in the lung segment, onto the base plane 750 defined by the lesion center 710 and the baseline 111. Then, at 940, the tip vertex determination unit 840 may select a wedge-shaped tip vertex 114 on the base plane 750. In one embodiment, the tip vertex 114 may be manually positioned by the user at any desired point on the base plane 750. In another embodiment, the tip vertex 114 may be manually positioned by the user at any desired point on the base plane 750. Figure 7A-7B According to the principle shown in , the position of the tip apex and the length of the baseline 111 can be automatically determined based on applicable standards through the collaboration of the baseline determination unit 830 and the tip apex determination unit 840.

[0061] After determining the baseline 111 and the tip vertex 114, two cutting lines 106 and 107 can be drawn by connecting the tip vertex 114 and the two endpoints of the baseline 111. The cutting lines 106-107 together with the baseline 111 determine what to cut in the resection. The process 900 can then proceed to 950, where the wedge resection verification unit 850 can verify whether the resection meets certain predetermined criteria retrieved from the wedge resection standard library 860. If the applied criteria are not met at 955, the process 900 can loop back to 925 so that the orientation and / or length of the baseline 111 and / or the position of the tip vertex 114 can be re-determined or reselected. Alternatively, if the resection plan is verified to be acceptable based on the applied criteria, then the details regarding the shape, size, location and orientation of the resection are determined and / or finalized at 955 and then output by the wedge resection sending unit 870 at 960 for display and / or further processing. Although Fig. 9 The reselection is shown to be accomplished by looping back to 925, but in alternative examples, process 900 may return to 915, 920, 930, 935, or 940 to re-determine the corresponding parameters accordingly.

[0062] The criteria applied may include, but are not limited to, whether the resection portion 610 is confined to the associated single lung segment 104, whether it can cover the collapsed safety margin boundary (in Figure 7A-7B ), and whether a critical vascular structure can be avoided (in Figure 7A-7BIn addition, the criteria for application may be based on other different medical considerations, including but not limited to whether the area near the cutting lines 106 and 107 is free of inflammation, whether the tissue thickness on both sides of the cutting lines allows for a stable anastomosis, and the like.

[0063] In an embodiment, the inflammation state can be visually inspected. In another embodiment, the inflammation state can be automatically determined based on the density of lung tissue in image data (such as, a CT image). For example, in the case of a bowel incision created by a surgeon using a linear cutting stapler, there are typically 2 to 3 rows of staples on each side of the cutting line, approximately 1-2 cm wide for the stapler box. Within a band of this width, the average density of lung tissue in the CT image can be calculated along the cutting lines 106-107. An empirical average can be obtained from normal, non-inflamed tissue. When the average is higher than this empirical value, it can be determined that the tissue is inflamed. Instead of using the average, as an alternative, the maximum value can be used for the same purpose. Note that vascular structures may need to be subtracted during such calculations. In order to determine whether the tissue thickness on both sides of the cutting line can ensure a stable anastomosis, the tissue thickness before the stapler is clamped can be used to facilitate the estimate, for example. The following will be combined with Fig.13A Further details about this example are provided further down.

[0064] A variety of surgical tools may be used for surgical resection, including but not limited to electric scalpels, ultrasonic scalpels, and linear cutting staplers. Figures 10A-10C An exemplary linear cutting stapler, an exemplary stapler cartridge, and an exemplary stapler that can be used to perform a planned wedge resection according to an exemplary embodiment of the present teachings are depicted. In general, the linear cutting stapler can be used in abdominal surgery, thoracic surgery, gynecological and pediatric surgery to perform cutting and suturing in the same surgery. Fig. 10A In the embodiment, the linear cutting stapler 1000 can be loaded with replaceable stapler boxes 1010 of different lengths. Fig. 10B Staple cartridge 1010 is shown in greater detail, into which row 1020 of staples may be loaded. Fig. 10C A side view of staples 1030 is shown. Reference numeral 1015 denotes the length of staple cartridge 1010, and 1035 denotes the length of staples 1030.

[0065] In order to provide an enhanced experience, in the preoperative planning scheme disclosed in the present teaching, the rendering of the planning results may include not only the key anatomical structures to be avoided, the location of the lesion, the safety margin around the lesion, and the position of the cutting line, the length of the (one or more) staple boxes to be selected, and the length of the (one or more) staples to be selected, displayed in the 3D model of the patient, but also the user may be informed of the location of the cutting line, the length of the (one or more) staple boxes to be selected, and the length of the (one or more) staples to be selected. In an example, the box length is estimated based on the length of the cutting line. As another example, the staple length may be estimated based on the thickness of the tissue to be stapled.

[0066] In the following, reference Figure 11-13B , an improved rendering of planning results is explained according to an exemplary embodiment of the present teachings.

[0067] Fig.11 An exemplary high-level system diagram of the planning result rendering unit 230 according to an exemplary embodiment of the present teachings is depicted. Fig.11 As shown in FIG. 1 , the planning result rendering unit 230 includes a data receiving unit 1110, a wedge parameter calculating unit 1120, a stapler parameter estimating unit 1130, a stapler specification library 1140, a visualization signal generating unit 1150, and a visualization signal sending unit 1160. Fig.11 The stapler specification library 1140 is shown as a separate component of the planning result rendering unit 230, but it can be combined with the wedge resection standard library 860 (see Figure 8 Alternatively, one or both of the wedge resection standard library 860 and the stapler specification library 1140 may be incorporated into the knowledge database 250 .

[0068] Fig.12 1 is a flow chart of an exemplary process of the plan result rendering unit 230 according to an exemplary embodiment of the present teachings. The process 1200 begins at 1210, where the data receiving unit 1110 receives the plan result from the wedge resection planning unit 220 and the user input from the user interface unit 240, and forwards the relevant data to the corresponding components of the plan result rendering unit 230.

[0069] Subsequently, at 1220, based on the details of the wedge resection determined in the planning result rendering unit 230, the wedge parameter calculation unit 1120 calculates the relevant parameters of the planned wedge shape and sends the calculated results to the staple parameter estimation unit 1130 and the visualization signal generation unit 1150. For example, the angle between each of the cutting lines 106-107 and the baseline 111 of the wedge shape can be calculated to guide the surgical operation. In addition, the length of the cutting lines 106 and 107 and / or the thickness of the tissue to be cut can be calculated to facilitate the estimation of certain parameters of the (one or more) linear cutting staplers to be used.

[0070] The process then proceeds to 1230, where the stapler parameter estimation unit 1130 can estimate the relevant parameters 1120 of the (one or more) linear cutting staplers to be used in the operation based on the calculation results of the wedge parameter calculation unit 1120 according to the stapler specifications retrieved from the stapler specification library 1140. Such parameters may include, but are not limited to, the length of the staple box to be selected, the length of the staples to be selected, and the number of staple boxes to be used. Depending on the supplier of the stapler, the length of the staple box may be different (for example, a length of 30 cm, 45 cm, 60 cm, etc.). In one embodiment, the length of the cutting line 106-107 can first be divided by the longest length of the staple box to determine how many of them may be needed. The remainder can then be used in a similar manner to determine the number of shorter boxes. As another example, the staple length can be estimated based on the thickness of the cutting plane. The following can be combined with Fig.13A to provide a more detailed explanation of this.

[0071] Fig.13A A conceptual exemplary schematic diagram for determining staple cartridge length and mapping cut lines onto the lung surface is shown. Fig.13A In FIG. 1 , reference numeral 1302 indicates the lung surface before deflation (on which the resection plan is performed), and 1304 is the estimated cutting line after deflation. Dashed lines 1310 and 1312 illustrate the correspondence between points on the cutting line 1304 and points on the lung surface 1302. This correspondence can be considered as reversing deflation by mapping the cutting line 1304 onto the lung surface 1302. This can generate curves 1306 and 1308 on the lung surface 1302. The length of the cutting line 1304 will be the same as the length of the curves 1306 and 1308 (the length during deflation is maintained). The length of the dashed lines 1310 and 1312 can be related to the staple length. Because the tissue along the dashed line can be compressed to the thickness to be anastomosed, the compressed thickness at each dashed line position can be estimated empirically as a portion of the dashed line length. An alternative method to estimate the compressed thickness is to add pixel intensities along the dashed lines in the CT image. This total intensity can be used to correlate with the compressed thickness. The brighter the total intensity, the more tissue along the dashed line, and therefore the thicker the compressed tissue will be. The correlation coefficient between brightness and thickness can be estimated empirically or based on actual data collected during surgery.

[0072] Fig. 13B A conceptual exemplary schematic diagram for visualizing planned staple locations on the lung surface is shown. Fig. 13B , reference numeral 1314 represents the baseline of the wedge resection, and reference numerals 1316 and 1318 represent strips having the same width as the selected stapler cartridge. The shape of the strips may correspond to the cut lines mapped on the lung surface (reference Fig.13A1306 and 1308 in the same. The strips can be used to represent the staple positions obtained during the wedge resection planning disclosed in the present teachings. It should be noted that the resection planning is performed on a lung model before surgery, when the lung is not deflated. Therefore, the staple position visualization is to display the staple positions on the lung model without deflation.

[0073] Fig.14 14 is an illustrative diagram of an exemplary mobile device architecture that can be used to implement a dedicated system for implementing the present teachings according to various embodiments. In this example, the user device on which the present teachings can be implemented corresponds to mobile device 1400, including but not limited to smart phones, tablet computers, music players, handheld game consoles, global positioning system (GPS) receivers, and wearable computing devices (e.g., glasses, watches, etc.), or any other form of device. Mobile device 1400 may include one or more central processing units ("CPUs") 1440, one or more graphics processing units ("GPUs") 1430, a display 1420, a memory 1460, a communication platform 1410 (such as a wireless communication module), a storage device 1490, and one or more input / output (I / O) devices 1450. Any other suitable components, including but not limited to a system bus or controller (not shown), may also be included in mobile device 1400. As shown in FIG. Fig.14 As shown in FIG. 14 , a mobile operating system 1470 (e.g., iOS, Android, Windows Phone, etc.) and one or more applications 480 may be loaded from a storage device 1490 into a memory 1460 for execution by a CPU 1440. The application 1480 may include a browser or any other suitable mobile application for managing a preoperative surgical planning and simulation system on a mobile device 1400 in accordance with the present teachings. User interaction, if any, may be implemented via the I / O device 1440 and provided to various components connected via a network(s).

[0074] In order to implement the various modules, units and their functions described in the present disclosure, a computer hardware platform can be used as the (one or more) hardware platform of one or more elements in the elements described herein. The hardware elements, operating systems and programming languages ​​of such computers are conventional in nature, and it is assumed that those skilled in the art are fully familiar with them to adapt these technologies to the appropriate settings described herein. A computer with user interface elements can be used to implement a personal computer (PC) or other types of workstations or terminal devices, but if properly programmed, the computer can also serve as a server. It is believed that those skilled in the art are familiar with the structure, programming and general operation of such computer equipment, so the accompanying drawings should be self-explanatory.

[0075] Fig.151500 is an illustrative diagram of an exemplary computing device architecture that can be used to implement a dedicated system for implementing the present teachings according to various embodiments. This dedicated system incorporating the present teachings has a functional block diagram of a hardware platform, which includes a user interface element. The computer can be a general-purpose computer or a special-purpose computer. Both can be used to implement the dedicated system for implementing the present teachings. As described herein, the computer 1500 can be used to implement any component of a preoperative surgical resection plan and simulation scheme. For example, the planning and simulation system disclosed herein can be implemented on a computer such as computer 1500 via its hardware, software program, firmware, or a combination thereof. Although only one such computer is shown for convenience, the computer functions associated with the planning and simulation system described herein can be implemented in a distributed manner on multiple similar platforms to distribute the processing load.

[0076] For example, the computer 1500 includes a COM port 1550 that is connected to and from a network connected thereto to facilitate data communications. The computer 1500 also includes a central processing unit (CPU) 1520 in the form of one or more processors for executing program instructions. The exemplary computer platform includes an internal communication bus 1510, various forms of program storage and data storage (e.g., disk 1570, read-only memory (ROM) 1530, or random access memory (RAM) 1540), various data files for processing and / or transmission by the computer 1500, and program instructions that may be executed by the CPU 1520. The computer 800 also includes an I / O component 1560 to support input / output flows between the computer and other components therein (such as, user interface elements 1580). The computer 1500 may also receive programming and data via network communications.

[0077] Thus, aspects of the methods of preoperative planning and simulation and / or other processing as described above may be implemented in programming. The programmatic aspects of the technology may be considered a "product" or "article of manufacture," typically in the form of executable code and / or associated data carried or implemented in a machine-readable medium. Tangible, non-transitory "storage device" type media include any or all memory or other storage devices for computers, processors, etc., or their associated modules, such as various semiconductor memories, tape drives, disk drives, etc., which may provide storage at any time for software programming.

[0078] All or part of the software may sometimes be transmitted over a network such as the Internet or various other telecommunication networks. For example, such communication may enable software to be loaded from one computer or processor into another, for example, in connection with surgical resection planning and simulation. Thus, another type of medium that may carry software elements includes optical, electrical, and electromagnetic waves, such as those used across physical interfaces between local devices, through wired and optical landline networks, and through various air links. Physical elements that carry such waves (such as wired or wireless links, optical links, etc.) may also be considered as media that carry software. As used herein, unless limited to tangible "storage" media, terms such as computer or machine "readable media" refer to any medium that participates in providing instructions to a processor for execution.

[0079] Thus, machine-readable media may take a variety of forms, including but not limited to tangible storage media, carrier media, or physical transmission media. Non-volatile storage media include, for example, optical or magnetic disks, such as any storage device in (one or more) any computer, etc., which can be used to implement the system or any component thereof, as shown in the figure. Volatile storage media include dynamic memory, such as the main memory of such a computer platform. Tangible transmission media include coaxial cables; copper wires and optical fibers, including wires that form a bus within a computer system. Carrier transmission media may take the form of electrical or electromagnetic signals, or sound or light waves, such as those generated during radio frequency (RF) and infrared (IR) data communications. Thus, common forms of computer-readable media include, for example: floppy disks, flexible disks, hard disks, magnetic tapes, any other magnetic media, CD-ROMs, DVDs or DVD-ROMs, any other optical media, punched card tapes, any other physical storage media with hole patterns, RAMs, PROMs and EPROMs, FLASH-EPROMs, any other memory chips or cassettes, carriers that transport data or instructions, cables or links that transport such carriers, or any other media from which a computer can read programming code and / or data. Many of these forms of computer readable media may be involved in carrying one or more sequences of one or more instructions to a physical processor for execution.

[0080] Those skilled in the art will recognize that the present teachings may be subject to various modifications and / or enhancements. For example, while the various component embodiments described above may be implemented in a hardware device, it may also be implemented as a pure software solution—for example, installed on an existing server. Furthermore, the preoperative planning and simulation techniques disclosed herein may be implemented as firmware, a firmware / software combination, a firmware / hardware combination, or a hardware / firmware / software combination.

[0081] Although the above has described what is considered to constitute the present teaching and / or other examples, it should be understood that various modifications may be made thereto and the subject matter disclosed herein may be implemented in various forms and examples, and that the teaching may be applied to many applications, only some of which are described herein. The following claims are intended to claim any and all applications, modifications, and variations that fall within the true scope of the present teaching.

Claims

1. A method comprising: receiving patient data of a patient at a computer system, wherein the patient is in need of thoracic surgery; generating, via a processor of the computer system, a three-dimensional (3D) computer-rendered inflated thorax model of the patient using the patient data, the 3D computer-rendered inflated model corresponding to at least one lung of the patient in an inflated state; placing cutting lines on the 3D computer-rendered inflatable chest model via a processor, the cutting lines representing locations where a surgeon should cut a patient during thoracic surgery, to generate an inflatable 3D chest model with markings; modifying, via the processor, the labeled inflated 3D thorax model to account for deflation of the at least one lung of the patient, generating a labeled deflated 3D thorax model; and The deflated three-dimensional chest model is displayed via a display device. The method of claim 1 , wherein the patient data comprises an X-ray image.

3. The method of claim 1, wherein the patient data comprises at least one of a computed tomography (CT) scan and a magnetic resonance imaging (MRI) scan.

4. The method of claim 1, wherein the cut line further comprises a strip having a width equal to the selected staple cartridge.

5. The method according to claim 4, further comprising: The stapler is placed along the cutting line by the processor. The staple positions are displayed as part of the deflated 3D chest model via a display device. The method of claim 5 , wherein staple locations are identified during wedge resection planning.

7. The method of claim 1, wherein during display of the deflated 3D thorax model, tissue thickness of the patient is conveyed based on brightness, such that brighter intensities indicate thicker tissue.

8. A system comprising: monitor; at least one processor; as well as A non-transitory computer-readable storage medium storing instructions that, when executed by the at least one processor, cause the at least one processor to perform operations including: receiving patient data of a patient, wherein the patient requires thoracic surgery; generating a three-dimensional (3D) computer-rendered inflated thorax model of the patient using the patient data, the 3D computer-rendered inflated model corresponding to at least one lung of the patient in an inflated state; placing cutting lines on the 3D computer rendered inflatable chest model, the cutting lines representing where the surgeon should cut the patient during thoracic surgery, generating an inflatable 3D chest model with markings; modifying the labeled inflated 3D thorax model to account for deflation of the at least one lung of the patient to produce a labeled deflated 3D thorax model; and The deflated 3D chest model is displayed via a monitor.

9. The system of claim 8, wherein the patient data comprises an X-ray image.

10. The system of claim 8, wherein the patient data comprises at least one of a computed tomography (CT) scan and a magnetic resonance imaging (MRI) scan.

11. The system of claim 8, wherein the cut line further comprises a strip having a width equal to the selected staple cartridge.

12. The system of claim 11, wherein the non-transitory computer readable storage medium stores additional instructions that, when executed by the at least one processor, cause the at least one processor to perform operations comprising: Place the staples along the cutting line. The staple positions are displayed via a display as part of the deflated 3D chest model.

13. The system of claim 12, wherein staple locations are identified during wedge resection planning.

14. The system of claim 8, wherein during display of the deflated 3D thorax model, tissue thickness of the patient is conveyed based on brightness, such that brighter intensities indicate thicker tissue.

15. A non-transitory computer-readable storage medium storing instructions that, when executed by at least one processor, cause the at least one processor to perform operations comprising: receiving patient data of a patient, wherein the patient requires thoracic surgery; generating a three-dimensional (3D) computer-rendered inflated thorax model of the patient using the patient data, the 3D computer-rendered inflated model corresponding to at least one lung of the patient in an inflated state; placing cutting lines on the 3D computer rendered inflatable chest model, the cutting lines representing where the surgeon should cut the patient during thoracic surgery, generating an inflatable 3D chest model with markings; modifying the labeled inflated 3D thorax model to account for deflation of the at least one lung of the patient to produce a labeled deflated 3D thorax model; and The deflated 3D chest model is displayed via a monitor.

16. The non-transitory computer-readable storage medium of claim 15, wherein the patient data comprises an X-ray image.

17. The non-transitory computer-readable storage medium of claim 15, wherein the patient data comprises at least one of a computed tomography (CT) scan and a magnetic resonance imaging (MRI) scan.

18. The non-transitory computer readable storage medium of claim 15, wherein the cut line further comprises a strip having a width equal to the selected staple cartridge.

19. The non-transitory computer readable storage medium of claim 18 having additional instructions stored thereon which, when executed by the at least one processor, cause the at least one processor to perform operations comprising: Place the staples along the cutting line. The staple positions are displayed via a display as part of the deflated 3D chest model.

20. The non-transitory computer readable storage medium of claim 19, wherein staple locations are identified during wedge resection planning.

21. The non-transitory computer readable storage medium of claim 15, wherein during display of the deflated 3D thorax model, tissue thickness of the patient is conveyed according to brightness, such that brighter intensities indicate thicker tissue.

Citation Information

Patent Citations

  • Sensing adjunct for surgical staplers

    CN102596007A

  • Systems and methods for detecting pleural invasion for surgical and interventional planning

    CN107865692A

  • System and method for image guidance during medical procedures

    US20120165652A1

  • Surgical assistance planning method using lung motion analysis

    US20120288173A1

  • Method and system for estimating a deflated lung shape for video assisted thoracic surgery

    US20160128782A1