In-vivo path planning, navigation data processing method, device and navigation system

By planning navigation paths and simulating puncture locations in a virtual lung model, the problem of lack of positioning guidance for bronchoscopic puncture and sheath movement was solved, enabling accurate and safe movement of the adjustable sheath and bronchoscope.

CN114305680BActive Publication Date: 2024-11-01HANGZHOU BRONCUS MEDICAL CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202111467513.X
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-12-02
Publication Date
2024-11-01
Estimated Expiration
2041-12-02

AI Technical Summary

Technical Problem

In existing technologies, the bronchoscope lacks reliable positioning guidance for puncture outside the airway and for sheath movement, leading to inaccurate and unsafe puncture procedures.

Method used

By acquiring a virtual model of a real human lung, a navigation path is planned to avoid virtual obstacles. Combined with the constraint information of an adjustable bending sheath, the puncture position is simulated to provide positioning guidance.

Benefits of technology

This improves the accuracy and safety of the adjustable bending sheath and bronchoscope movement, ensuring the reliability and safety of the puncture procedure.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114305680B_ABST
    Figure CN114305680B_ABST
Patent Text Reader

Abstract

The present invention provides a data processing method, device and navigation system for in vivo path planning and navigation, wherein the data processing method for in vivo path planning comprises: obtaining a virtual lung model, wherein the virtual lung model comprises a virtual bronchial tree and virtual obstacles; the virtual bronchial tree simulates a real bronchial tree of a real human body; determining a target area in the virtual lung model; based on the target area and constraint information of an adjustable bend sheath, planning a first navigation path and a simulated puncture position in the virtual lung model; the simulated puncture position simulates a real puncture position in a real bronchial tree, and the simulated puncture position is adapted to the target area; the first navigation path refers to: a navigation path in the virtual lung model that reaches the target area via the simulated puncture position, and the first navigation path is the navigation path of the adjustable bend sheath, and can avoid the virtual obstacles.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the medical field, and in particular to a data processing method, device and navigation system for in-vivo path planning and navigation. Background Art

[0002] A bronchoscope can be understood as a medical device that is inserted into the patient's respiratory tract through the mouth or nose and can be used for observing lesions, biopsy sampling, bacteriological and cytological examinations, etc.

[0003] When using a bronchoscope, the path of movement of the bronchoscope in the body can be planned in advance to obtain a navigation path. However, the planned navigation path only includes the navigation path of the bronchoscope in the airway. If the medical area of ​​concern is outside the airway, the airway needs to be punctured, and the sheath passing through the working channel of the bronchoscope needs to be delivered to the medical area of ​​concern. However, in the prior art, there is a lack of sufficient basis for positioning guidance for the puncture and the movement of the sheath. Summary of the invention

[0004] The present invention provides a data processing method, device and navigation system for in vivo path planning and navigation, so as to solve the problem of lack of sufficient basis for positioning guidance during the movement process of puncture and sheath.

[0005] According to a first aspect of the present invention, there is provided a data processing method for in vivo path planning, comprising:

[0006] Acquire a virtual lung model of a real human body, wherein the virtual lung model includes a virtual bronchial tree and virtual obstacles;

[0007] Determining a target area in the virtual lung model; the position of the target area in the virtual lung model matches the position of a medical concern site in a real human body;

[0008] Based on the target area and constraint information of the adjustable curved sheath, a first navigation path and a simulated puncture position are planned in the lung virtual model;

[0009] in:

[0010] The constraint information of the adjustable bending sheath tube represents the structural characteristics of the adjustable bending sheath tube that constrain the movement process of the adjustable bending sheath tube; the simulated puncture position simulates the real puncture position in the real bronchial tree; the first navigation path refers to: the navigation path in the virtual lung model that passes through the simulated puncture position to reach the target area, and the first navigation path is the navigation path of the adjustable bending sheath tube, and the first navigation path can avoid the virtual obstacles.

[0011] Optionally, based on the target area and constraint information of the adjustable curved sheath, a first navigation path and a simulated puncture position are planned in the lung virtual model, including:

[0012] Determining a reference position point in the target area;

[0013] Based on the reference position point, a path that can avoid the virtual obstacle is planned to obtain multiple candidate paths; the starting point of the candidate path is in the virtual bronchial tree or on the airway wall thereof, and the end point of the candidate path is the reference position point;

[0014] Based on the constraint information of the adjustable bending sheath tube, the first navigation path is selected from the multiple candidate paths; the simulated puncture position is the connection point between the first navigation path and the airway wall.

[0015] Optional,

[0016] Based on the reference position point, a path that can avoid the virtual obstacle is planned to obtain multiple candidate paths, including:

[0017] Taking the reference position point as a first-level position point, starting from the first-level position point, exploring one or more next-level position points step by step until the last-level position point located in the virtual bronchial tree or on the tracheal wall is explored;

[0018] After exploring any N-th level position point, searching for a target position point near the N-th level position point; the relative position between the target position point and the N-th level position point meets the specified position requirement; the specified position requirement includes: the distance between the N-th level position point and the target position point is a specified distance or is within a specified distance range, and / or: the direction of the target position point relative to the N-th level position point is within a specified angle range, wherein N is a positive integer greater than or equal to 1;

[0019] Selecting the target position point that does not conflict with the virtual obstacle as the N+1th level position point;

[0020] Based on the connection lines between the first-level position point and any last-level position point, a candidate path corresponding to any last-level position point is formed.

[0021] Optionally, selecting a target position point that does not conflict with the virtual obstacle as an N+1th level position point includes:

[0022] If any of the first target position points searched does not fall on the virtual obstacle, it is determined that the any of the first target position points does not conflict with the virtual obstacle and the any of the first target position points is selected as the N+1th level position point;

[0023] And / or, if the distance between any second target position point searched and the virtual obstacle is less than a distance threshold, it is determined that any second target position point does not conflict with the virtual obstacle and any second target position point is selected as the N+1th level position point.

[0024] Optionally, the virtual obstacle includes at least one of the following: a virtual blood vessel, a virtual rib, and a virtual pleura.

[0025] Optionally, based on the constraint information of the adjustable bending sheath tube, selecting the first navigation path from the multiple candidate paths includes:

[0026] Determine path reference information of the candidate path, wherein the path reference information of the candidate path includes a length and a turning angle of the candidate path;

[0027] A target candidate path is selected as the first navigation path; wherein the path reference information of the target candidate path is adapted to the constraint information of the adjustable bending sheath tube.

[0028] Optionally, selecting a target candidate path as the first navigation path includes:

[0029] Acquire at least part of the constraint information of the bronchoscope and the simulated puncture position corresponding to the target candidate path; wherein at least part of the constraint information of the bronchoscope includes: the radial size of the part of the bronchoscope extending into the real bronchial tree,

[0030] In a case where the radial size of the partial bronchoscope is smaller than the radial size of the acquired tracheal portion where the simulated puncture position is located, a target candidate path is selected as the first navigation path.

[0031] Optionally, the reference position point includes a center point of the target area.

[0032] Optionally, the constraint information of the adjustable bending sheath tube includes bending ability information of the adjustable bending sheath tube and length information of the adjustable bending sheath tube.

[0033] Optionally, obtain a 3D virtual lung model, including:

[0034] Acquiring CT data of the real human body;

[0035] The lung virtual model is established according to the CT data.

[0036] Optionally, the target area is determined based on the virtual lung model and the CT data.

[0037] Optionally, the data processing method for in vivo path planning further includes:

[0038] Planning a second navigation path in the virtual lung model based on the simulated puncture position and constraint information of the bronchoscope;

[0039] Among them, the constraint information of the bronchoscope represents the structural characteristics of the bronchoscope that constrain the movement process of the bronchoscope; the second navigation path refers to: the navigation path of the bronchoscope from the first position to the second position of the virtual bronchial tree, and the second position is adapted to the simulated puncture position.

[0040] Optionally, based on the simulated puncture position and the constraint information of the bronchoscope, planning a second navigation path in the virtual lung model includes:

[0041] Taking the main carina of the airway in the virtual bronchial tree as the first position, a navigation path from the first position to the second position is planned along the central axis of the airway to obtain the second navigation path, so that the path reference information of the second navigation path is adapted to the constraint information of the bronchoscope, and the path reference information of the second navigation path includes the length of the second navigation path, the turning angle, and the diameter of the trachea passed through.

[0042] Optionally, the constraint information of the bronchoscope includes: bending ability information of the bronchoscope, the length of the bronchoscope, and the diameter of the bronchoscope.

[0043] According to a second aspect of the present invention, there is provided a method for processing data for in vivo navigation, comprising:

[0044] Acquire a first navigation path planned by the data processing method for in vivo path planning involved in the first aspect and optional solutions thereof;

[0045] The virtual lung model is displayed on a display device, and the first navigation path is displayed based on the virtual lung model.

[0046] Optionally, the data processing method for in vivo navigation further includes:

[0047] Obtaining the development result of the adjustable bending sheath tube under X-ray; the development result can characterize the position of the adjustable bending sheath tube on a real human body;

[0048] Based on the development result, the position of the adjustable bending sheath tube in the real human body is displayed in the virtual lung model.

[0049] Optionally, the data processing method for in vivo navigation further includes:

[0050] Acquire a second navigation path; the second navigation path refers to: a navigation path of the bronchoscope from a first position to a second position in the virtual bronchial tree, and the second position is adapted to the simulated puncture position;

[0051] Acquiring intraoperative images, wherein the intraoperative images are collected by the bronchoscope;

[0052] Based on the intraoperative image, determining the true position of the bronchoscope;

[0053] Based on the virtual lung model, the second navigation path and the actual position of the bronchoscope are displayed.

[0054] According to a third aspect of the present invention, there is provided a data processing device for in vivo path planning, comprising:

[0055] A model acquisition module, used to acquire a virtual lung model of a real human body, wherein the virtual lung model includes a virtual bronchial tree and virtual obstacles;

[0056] A target determination module, used to determine a target area in the virtual lung model; the position of the target area in the virtual lung model matches the position of the medical concern part in the real human body;

[0057] The extra-airway planning module is used to plan a first navigation path and a simulated puncture position in the lung virtual model based on the target area and the constraint information of the adjustable bending sheath tube.

[0058] in:

[0059] The constraint information of the adjustable bending sheath tube represents the structural characteristics of the adjustable bending sheath tube that constrain the movement process of the adjustable bending sheath tube; the simulated puncture position simulates the real puncture position in the real bronchial tree; the first navigation path refers to: the navigation path in the virtual lung model that passes through the simulated puncture position to reach the target area, and the first navigation path is the navigation path of the adjustable bending sheath tube, and the first navigation path can avoid the virtual obstacles.

[0060] According to a fourth aspect of the present invention, there is provided a data processing device for in vivo navigation, comprising:

[0061] A path acquisition module, used to acquire a first navigation path planned by the data processing method for in vivo path planning of the first aspect and optional solutions thereof;

[0062] The display guidance module is used to display the virtual lung model on a display device and to display the first navigation path based on the virtual lung model.

[0063] According to a fifth aspect of the present invention, there is provided an electronic device, comprising a processor and a memory.

[0064] The memory is used to store codes;

[0065] The processor is used to execute the code in the memory to implement the data processing method described in the first aspect or the second aspect.

[0066] According to a sixth aspect of the present invention, there is provided a storage medium on which a computer program is stored, and when the program is executed by a processor, the data processing method described in the first aspect or the second aspect is implemented.

[0067] According to the seventh aspect of the present invention, a navigation system is provided, comprising: a bronchoscope, an adjustable curved sheath tube and a data processing unit, wherein the data processing unit is used to implement the data processing method described in the first aspect or the second aspect, and the bronchoscope is provided with a working channel for the adjustable curved sheath tube to pass through.

[0068] In the data processing method, device and navigation system for in vivo path planning and navigation provided by the present invention, after obtaining the virtual lung model and determining the target area therein, a first navigation path and a simulated puncture position can be planned in the virtual lung model based on the target area and the constraint information of the adjustable curved sheath; further, the planned first navigation path and the simulated puncture position can provide a basis for positioning guidance for the movement and puncture of the adjustable curved sheath, which helps to ensure the reliability and accuracy of the movement and puncture process of the adjustable curved sheath, and can also provide a basis for further improving safety.

[0069] At the same time, since the first navigation path can avoid virtual obstacles, the safety of the movement process of the adjustable bending sheath tube can be improved when controlling with reference to the first navigation path.

[0070] In the optional solution of the present invention, since the first navigation path is adapted to the constraint information of the adjustable bending sheath, it can be ensured that the first navigation path can accurately meet the constraint conditions of the adjustable bending sheath, thereby ensuring that the planned first navigation path can be effectively executed by the adjustable bending sheath. BRIEF DESCRIPTION OF THE DRAWINGS

[0071] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0072] Figure 1 is a schematic diagram of the structure of a navigation system in an exemplary embodiment of the present invention;

[0073] Figure 2 is a schematic diagram of the structure of a navigation system in another exemplary embodiment of the present invention;

[0074] Figure 3 is a flow chart of a data processing method for in vivo path planning in an exemplary embodiment of the present invention;

[0075] Figure 4 is a schematic diagram of a process for obtaining a virtual lung model in an exemplary embodiment of the present invention;

[0076] Figure 5 is a schematic diagram of a process of planning a first navigation path and simulating a puncture position in an exemplary embodiment of the present invention;

[0077] Figure 6 is a schematic diagram of a process of planning candidate paths in an exemplary embodiment of the present invention;

[0078] Figure 7 is a schematic diagram of a process of planning a first navigation path and simulating a puncture position in another exemplary embodiment of the present invention;

[0079] Figure 8 is a flow chart of a data processing method for in vivo path planning in another exemplary embodiment of the present invention;

[0080] Fig. 9 is a flow chart of a data processing method for in vivo navigation in an exemplary embodiment of the present invention;

[0081] Fig.10 is a flow chart of a data processing method for in vivo navigation in another exemplary embodiment of the present invention;

[0082] Fig.11 is a flow chart of a data processing method for in vivo navigation in another exemplary embodiment of the present invention;

[0083] Fig.12 is a schematic diagram of program modules of a data processing device for in vivo path planning in an exemplary embodiment of the present invention;

[0084] Fig.13 is a schematic diagram of program modules of a data processing device for in vivo path planning in another exemplary embodiment of the present invention;

[0085] Fig.14 is a schematic diagram of program modules of a data processing device for in vivo navigation in an exemplary embodiment of the present invention;

[0086] Fig.15 is a schematic diagram of program modules of a data processing device for in vivo navigation in another exemplary embodiment of the present invention;

[0087] Fig.16 FIG. 1 is a schematic diagram of the structure of an electronic device in an exemplary embodiment of the present invention. DETAILED DESCRIPTION

[0088] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0089] The terms "first", "second", "third", "fourth", etc. (if any) in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0090] The technical solution of the present invention is described in detail with specific embodiments below. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described in detail in some embodiments.

[0091] Please refer to Figure 1 An embodiment of the present invention provides a navigation system, including: a bronchoscope 102 , an adjustable bending sheath tube 103 and a data processing unit 101 .

[0092] The bronchoscope 102 may include an image acquisition unit, and the bronchoscope 102 may be understood as a device or a combination of devices that can use the image acquisition unit to acquire corresponding images after entering the human trachea. The bronchoscope 102 may also include a bending tube (such as an active bending tube and / or a passive bending tube), and the image acquisition unit may be provided at one end of the bending tube. The bronchoscope 102 may have a working channel, and the working channel may be provided for one or more medical devices to pass through, one of which may be an adjustable bending sheath tube 103. In addition, no matter what kind of bronchoscope is used, it does not depart from the scope of the embodiments of the present invention.

[0093] The adjustable bending sheath 103 is any sheath that can be controlled to bend (the sheath can also be understood as a catheter). The inner cavity of the adjustable bending sheath can also be used for other instruments to pass through. Furthermore, using the adjustable bending sheath as a channel also facilitates other instruments to reach the medical area of ​​concern.

[0094] The data processing unit 101 can be understood as any device or combination of devices with data processing capabilities. In the embodiment of the present invention, the data processing unit 101 can be used to implement the data processing method involved later. Furthermore, when it is applied to implement the data processing method for in vivo path planning, it can realize path planning for an adjustable bend sheath tube.

[0095] In one implementation, the data processing unit 101 may include only one set of data processing devices, which are used to implement the data processing method for in vivo path planning and the data processing method for in vivo navigation described below.

[0096] In another embodiment, the data processing unit 101 may include two sets of data processing devices, described as a first data processing device and a second data processing device, respectively. The first data processing device can be used to implement the data processing method for in vivo path planning involved in the following text, and the second data processing device can be used for the data processing method for in vivo navigation involved in the embodiment involved in the following text.

[0097] Please refer to Figure 2 , Figure 2 The data processing unit 201, the adjustable bending sheath tube 203 and the bronchoscope 202 in the navigation system shown in FIG. Figure 1 The data processing unit 101 and the adjustable bending sheath tube 103 in the illustrated embodiment are the same as or similar to the bronchoscope 102, and the same or similar contents will not be described in detail herein.

[0098] exist Figure 2 In the illustrated embodiment, when the data processing unit 201 is used to implement the data processing method for in vivo path planning, it can realize path planning for the adjustable bending sheath 203 and also realize path planning for the bronchoscope 202 .

[0099] exist Figure 2 In the illustrated embodiment, the data processing unit 201 and the bronchoscope 202 are configured to be able to communicate with each other, for example, directly or indirectly electrically connected (specifically, they can be electrically connected to the image acquisition unit in the bronchoscope 202), and for example, they can communicate wirelessly, and thus, the data processing unit 201 can receive intraoperative images from the bronchoscope 202.

[0100] The intraoperative images mentioned herein refer to images acquired by the image acquisition unit of the bronchoscope 202 after the bronchoscope 202 enters a real human body (eg, enters a real bronchial tree of a real human body).

[0101] exist Figure 2 In the illustrated embodiment, the navigation system further includes a display device 204 .

[0102] The display device 204 may be any device capable of performing two-dimensional imaging or three-dimensional imaging. The content displayed by the display device 204 may be determined by the data processing unit 201, and further, the display device 204 and the data processing unit 201 may be configured to communicate with each other so as to display to the outside under the control of the data processing unit 201. The display device 204 may be controlled to display corresponding content (e.g., a virtual bronchial tree, a virtual obstacle, and also, for example, displaying the position of a bronchoscope and the position of an adjustable bending sheath tube) when the data processing unit 201 executes the data processing method for in vivo navigation.

[0103] The display device 204 may include at least one of the following: a display screen (eg, an LED display screen, an LCD display screen), a projection screen, an AR device, a VR device, etc.

[0104] exist Figure 2 In the illustrated embodiment, the navigation system further includes a developing device 205 .

[0105] The developing device 205 can be understood as any device that can develop the adjustable bending sheath tube. The developing device 205 can be a device that can develop the adjustable bending sheath tube through X-rays. For example, the developing device 205 can be a C-arm (also described as a C-arm machine, C-arm), a U-arm, a G-arm, etc., wherein, taking the C-arm as an example, it may include a tube that generates X-rays, and a collection device, which can collect images after X-ray irradiation and development. The collection device may include, for example, an image intensifier and a CCD unit connected to each other, wherein the CCD specifically refers to a charge coupled device, which is a common photosensitive device. In addition, the developing device 205 can be directly or indirectly electrically connected to the data processing unit 201 to transmit the collected image directly or indirectly to the data processing unit 201 for processing by the data processing unit 201 (for example, for positioning the adjustable bending sheath tube, and for example, for determining whether the adjustable bending sheath tube has reached the lesion site or the diagnosis site). Regardless of which developing device 205 is used, it does not deviate from the description scope of this embodiment.

[0106] In order to realize the development of the adjustable bending sheath tube under X-ray, the material of the adjustable bending sheath tube can be selected to be suitable for development under X-ray. Compared with some extension tubes in the prior art that cannot be developed under X-ray, the embodiments of the present invention can provide sufficient and accurate reference basis for the positioning and use of the adjustable bending sheath tube.

[0107] Figure 3In the illustrated embodiment, a data processing method for in vivo path planning is provided, which can be applied to a data processing unit, comprising:

[0108] S301: Acquire a virtual lung model;

[0109] The virtual lung model can be understood as a model that simulates the lung structure of a real human body, and the virtual lung model can at least include a virtual bronchial tree; furthermore, the virtual bronchial tree can simulate the real bronchial tree of a real human body, thereby reflecting the structure of the trachea in the lungs, thereby providing a reliable medium for planning the path (e.g., the first navigation path) and the simulated puncture position in the subsequent steps;

[0110] The virtual lung model may be specially formed for the patient currently undergoing surgery (i.e., the virtual lung models of different patients may be different), or the virtual lung model may be a virtual lung model that is generally suitable for multiple patients;

[0111] In order to improve safety, when planning the first navigation path, avoidance of various obstacles in the human body (such as blood vessels, ribs, pleura, etc.) may be further considered. Therefore, the virtual lung model also includes virtual obstacles, which simulate the structure of other parts of the human lung except the bronchial tree; for example, the virtual obstacles may include at least one of the following:

[0112] Virtual blood vessels that simulate blood vessels;

[0113] Virtual ribs to simulate rib cage;

[0114] Virtual pleura that simulates the pleura.

[0115] In addition, various structures other than the bronchial tree in the chest of a real human body can be regarded as an obstacle. Furthermore, virtual objects formed by simulating such structures in the virtual model of the lungs can be regarded as a virtual obstacle without being limited to the above examples.

[0116] S302: determining a target area in the virtual lung model;

[0117] The target region refers to the region in the virtual lung model that represents the medical focus area, that is, the position of the target region in the virtual lung model matches the position of the medical focus area in the real human body; it can be a point in the virtual space where the virtual lung model is located, or a two-dimensional or three-dimensional spatial range in the virtual space; the target region can also be represented as ROI, specifically referring to region of interest, i.e., region of interest;

[0118] The target area may be determined manually, for example, after observing the patient data (such as CT data), the doctor may manually select the target area in the virtual lung model; the target area may also be determined automatically, for example, the data processing unit may automatically determine the target area in the virtual space according to the patient data (such as CT data); the target area may also be determined semi-automatically and semi-manually, for example, the data processing unit may automatically determine the candidate range in the virtual space according to the patient data (such as CT data), and then the doctor determines the target area from the candidate range;

[0119] The site of medical concern may be, for example, a lesion site or a diagnosis site, such as a suspected peripheral cancer nodule, a central lymph node, an infiltrated or other suspicious chest mass;

[0120] S303: planning a first navigation path and a simulated puncture position in the lung virtual model based on the target area and constraint information of the adjustable curved sheath tube;

[0121] The constraint information of the adjustable bending sheath tube represents the structural characteristics of the adjustable bending sheath tube that constrain the movement process of the adjustable bending sheath tube; furthermore, the structural characteristics that will bring constraints to the movement process of the adjustable bending sheath tube may serve as constraint information of an adjustable bending sheath tube.

[0122] The constraint information of the adjustable bending sheath tube may, for example, include at least one of the following: bending ability information of the adjustable bending sheath tube, length information of the adjustable bending sheath tube; in addition to these examples, the constraint information of the adjustable bending sheath tube may also include radial dimensions, materials, etc. of the adjustable bending sheath tube.

[0123] The bending capacity information of the adjustable bending sheath tube may be any information that can describe the bending capacity of part or all of the pipe sections in the adjustable bending sheath tube. For example, it may include parameters such as the minimum bending radius and maximum bending degree of each pipe section in the adjustable bending sheath tube. At the same time, the maximum bending degrees of each pipe section in the adjustable bending sheath tube may be the same or different.

[0124] The radial dimension of the adjustable bending sheath tube may be any information that can describe the radial dimension of part or all of the tube segments in the adjustable bending sheath tube, for example, it may be the circumference, diameter, etc. of each tube segment in the adjustable bending sheath tube.

[0125] The simulated puncture position can be understood as a position on the tracheal wall of the virtual bronchial tree in the virtual lung model, which simulates: a real puncture position suitable for puncture in the real bronchial tree, and then the adjustable sheath can reach the medical concern site after passing through the real puncture position.

[0126] The simulated puncture position can also be represented as a POI point, where POI refers to: Point of Interest; PI point is the point of interest;

[0127] The simulated puncture position is adapted to the target area; the adaptation can be understood as: based on the virtual lung model (i.e., the real lung structure represented by it), if the adjustable curved sheath reaches the real puncture position simulated by the simulated puncture position, the adjustable curved sheath can reach the medical concern site simulated by the target area through further movement; the adaptation can also be simply understood as being close, for example: the distance between the simulated puncture position and the target area is less than the corresponding threshold;

[0128] The first navigation path refers to: the navigation path of the adjustable bending sheath from the simulated puncture position to the target area in the virtual lung model. The first navigation path can be planned in consideration of various planning requirements. The planning requirements of the first navigation path may include, for example, the requirement to ensure that the adjustable bending sheath can successfully implement the first navigation path. Therefore, in the above step S303, the constraint information of the adjustable bending sheath is required to plan the first navigation path; in addition, the planning requirements of the first navigation path may also include, for example, at least one of the following: the requirement to avoid other obstacles in the virtual lung model (that is, the first navigation path can avoid the virtual obstacles), the requirement to make the path as short as possible, the requirement to ensure that the bronchoscope can enter the corresponding trachea, etc.

[0129] visible, Figure 3 In the illustrated embodiment, after obtaining a virtual lung model and determining a target area therein, a first navigation path and a simulated puncture position can be planned in the virtual lung model based on the target area and constraint information of the adjustable bend sheath; furthermore, the planned first navigation path and simulated puncture position can provide a basis for positioning guidance for the movement and puncture of the adjustable bend sheath, help to ensure the reliability and accuracy of the movement and puncture process of the adjustable bend sheath, and can also provide a basis for further improving safety.

[0130] In one embodiment, if the virtual lung model is specially formed for each patient, the virtual lung model can be formed based on the patient's CT data. Figure 4 , the process of obtaining a virtual model of the lungs may include:

[0131] S401: Acquire CT data of the real human body;

[0132] The CT data may be any data obtained by scanning the patient's real body using CT technology, and the CT may be specifically Computed Tomography, i.e., electronic computer tomography. The CT data may include CT images, and the CT images may include at least one of the following: sagittal images, coronal images, and cross-sectional images;

[0133] S402: Establishing the virtual lung model according to the CT data.

[0134] The target area may be determined based on the virtual lung model and the CT data of the patient, and further, it may be determined automatically, semi-automatically or manually based on the virtual lung model and the CT data of the patient.

[0135] visible, Figure 4 In the illustrated embodiment, the virtual lung model can accurately reflect the patient's actual lung structure, thereby ensuring that the path planning results (eg, intratracheal navigation path, extratracheal navigation path) can accurately adapt to the patient's actual lung structure, thereby ensuring the accuracy of navigation.

[0136] For one example, please refer to Figure 5 The process of selecting the first navigation path from the plurality of candidate paths based on the constraint information of the adjustable bending sheath tube, and determining the simulated puncture position based on the connection point between the first navigation path and the airway may include:

[0137] S501: Determine a reference position point in the target area;

[0138] The reference position point may be understood as a position point in the target area in the virtual space where the lung virtual model is located. For example, the reference position point may include the center point of the target area. For another example, the coordinate of the reference position point may also be the average value of the coordinates of multiple positions in the target area.

[0139] S502: Planning a path that can avoid the virtual obstacle based on the reference position point to obtain multiple candidate paths;

[0140] The candidate path may be understood as a navigation path planned in the virtual space where the virtual lung model is located, with the reference position point (or other position points adjacent thereto) as the end point and capable of avoiding virtual obstacles, wherein the starting point of the candidate path is within the virtual bronchial tree or on the airway wall thereof, and the end point of the candidate path is the reference position point; the starting point of the candidate path may be, for example, a position point in the axis of the virtual bronchial tree, and the distance between the starting point of the candidate path and the reference position point may be less than a preset threshold value;

[0141] S503: Selecting the first navigation path from the plurality of candidate paths based on the constraint information of the adjustable bending sheath tube;

[0142] Correspondingly, the simulated puncture position is adapted to the connection point between the first navigation path and the airway wall;

[0143] In one example, after the first navigation path is selected in step S503, the simulated puncture position is determined based on the connection point between the first navigation path and the airway wall;

[0144] In another example, a candidate simulated puncture position may be determined first, and then in step S502, a candidate path may be planned based on the candidate simulated puncture position and the reference position point, and then the first navigation path may be selected through step S503; then, a candidate simulated puncture position may be determined again, and steps S502 and S503 may be executed to select the first navigation path. After repeating this process multiple times, multiple first navigation paths may be determined, and then a first navigation path may be selected from them as the final first navigation path.

[0145] The simulated puncture position may be the position of the connection point between the first navigation path and the airway in the virtual bronchial tree, or may be one or more positions determined based on the position of the connection point.

[0146] Figure 5 In the illustrated embodiment, candidate paths that meet the requirements of the starting point and the end point are first selected, and then the first navigation path is selected therefrom. Furthermore, the starting point and the end point of the selected first navigation path can meet the movement requirements of the adjustable bending sheath tube, and the shape of the first navigation path can be suitable for meeting the structural characteristics of the adjustable bending sheath tube, thereby ensuring the feasibility of the first navigation path and the simulated puncture position.

[0147] In one implementation, please refer to Figure 6 , based on the reference position point, planning a path that can avoid the virtual obstacle, and obtaining multiple candidate paths, including:

[0148] S601: taking the reference position point as a first-level position point, starting from the first-level position point, exploring one or more next-level position points step by step until a last-level position point located in the virtual bronchial tree or on the tracheal wall is explored;

[0149] S602: Based on the connection lines between the first-level position points and any last-level position point, a candidate path corresponding to any last-level position point is formed.

[0150] In step S601, after exploring any Nth level position point, a target position point is searched near the Nth level position point; the relative position between the target position point and the Nth level position point meets the specified position requirement;

[0151] The specified position requirement includes: the distance between the Nth level position point and the target position point is a specified distance or is within a specified distance range, and / or: the direction of the target position point relative to the Nth level position point is within a specified angle range;

[0152] The specified angle range is an angle range in three-dimensional space, which can be regarded as a conical space range enclosed by a circle of rays with the Nth level position point as the origin;

[0153] In one example, the specified angle range may be fixed.

[0154] In another example, the specified angle range may also be variable;

[0155] For example: starting from the second-level position point, the direction of the specified angle range (i.e., the direction of the cone-shaped spatial range mentioned above) can change with the change of the explored position point. For example, the cone-shaped spatial range reflected by the specified angle range of the N-th level position point can be opposite to the reference position point (or the previous level position point). For example, if the reference position point (or the previous level position point) is on the right side of the N-th level position point, the target position point can be searched within the specified angle range on the left side of the N-th level position point; for another example, if the reference position point (or the previous level position point) is on the upper right side of the N-th level position point, the target position point can be searched within the specified angle range on the lower left side of the N-th level position point; specifically, the extension line of the connecting line between the N-th level position point and the reference position point (or the previous level position point) can be used as the axis to construct a circle of rays around the extension line to form a cone-shaped spatial range, thereby reflecting the specified angle range;

[0156] Wherein, N≥1, that is, it is a positive integer greater than or equal to 1, and the Nth level position point is not the last level position point.

[0157] For the searched target position points, the target position points that do not conflict with the virtual obstacles may be selected as the N+1th level position points;

[0158] The conflict between the position point and the virtual obstacle can be understood as follows: if the position point is used as the position point in the navigation path, the adjustable bending sheath will cause damage to the structure simulated by the virtual obstacle, or bring about a risk of damage.

[0159] To achieve conflict detection, in one implementation, if any first target position point is found not to fall within the virtual obstacle, it is determined that the first position point conflicts with the virtual obstacle, and any first target position point is selected as the N+1th level position point; further, because the first position point conflicts with the virtual obstacle, the first position point cannot be used as the N+1th level position point and can be excluded when searching for the N+1th level position point.

[0160] Wherein, the first target position point falls on the virtual obstacle, which can be understood as: the first target position point is on the outer surface of the virtual obstacle or in the position range surrounded by the outer surface. Conversely, the first target position point does not fall on the virtual obstacle, which can be understood as: the first target position point does not fall on the outer surface of the virtual obstacle, nor does it fall within the position range surrounded by the outer surface.

[0161] In order to detect the conflict, in another embodiment, if the distance between any second target position point and the virtual obstacle is not less than the distance threshold, it is determined that the second position point does not conflict with the virtual obstacle, and the second target position point is selected as the N+1th level position point. Furthermore, because the second position point conflicts with the virtual obstacle, the second position point cannot be used as the N+1th level position point and can be excluded when searching for the N+1th level position point.

[0162] The distance between the second target position point and the virtual obstacle mentioned herein may refer to the minimum distance between the second target position point and the outer surface of the virtual obstacle, or may refer to the distance between the second target position point and a specified part of the virtual obstacle (eg, the center or axis of the virtual obstacle).

[0163] The design of the spacing threshold can be based on the diameter of the adjustable bending sheath, the position changes and morphological changes of the blood vessels, ribs, pleura, etc. simulated by the virtual obstacles in physiological activities, the types of virtual obstacles (for example, virtual blood vessels, virtual ribs, and virtual pleura are different types of virtual obstacles), and the need to avoid injury risks. No matter which spacing threshold is selected, it does not deviate from the scope of the embodiments of the present invention.

[0164] In addition, if a location point is determined to conflict with a virtual obstacle, it can also be marked, and when searching for the next level of location points later, it can be directly searched among the unmarked location points.

[0165] In one implementation of step S602, the connecting line can be directly used as a candidate path. In another implementation, the candidate path can be fitted based on the connecting line. In another implementation, the connecting line (or a curve fitted based on the connecting line) can be used as the axis to form a channel with a certain radial dimension as the candidate path. The radial dimension can be designed with reference to the diameter of the adjustable bending sheath tube.

[0166] In the above steps S601 and S602, the location points in the space can be searched more fully, and feasible navigation paths can be fully explored. The navigation path can also be effectively prevented from conflicting with virtual obstacles, thereby ensuring safety.

[0167] In an example of steps S601 and S602, a target position point that meets the above requirements can be searched near the reference position point (i.e., the first-level position point), and then the second-level position point can be determined among the target position points; then, for each second-level position point, a target position point that meets the above requirements can be searched near it, and a third-level position point can be determined therefrom. At this time, if the third-level position point cannot be found for a second-level position point, the second-level position point can be discarded, and only the third-level position point can be explored for other second-level position points. The process is repeated by analogy until a position point located in the virtual bronchial tree or on its tracheal wall is explored. At this time, the position point can be used as the last-level position point, and the search for the next-level position point is stopped.

[0168] It can be seen that for each last-level position point, a unique path (ie, connection line) that connects the first-level position points to the last-level position point step by step can be found, based on which a candidate path can be determined.

[0169] In addition to the methods described above, any path planning method in this field and related fields can be applied to implement the planning of the above candidate paths and avoid virtual obstacles at the same time. No matter which method is used, it does not depart from the scope of the embodiments of the present invention.

[0170] For one example, please refer to Figure 7 The process of selecting the first navigation path from the plurality of candidate paths based on the constraint information of the adjustable bending sheath tube includes:

[0171] S701: Determine the path reference information of the candidate path;

[0172] The path reference information of the candidate path includes the length and the turning angle of the candidate path; the turning angle may refer to the set of turning angles of each path segment in the candidate path, or may refer to the turning angle of the candidate path as a whole, wherein the turning angle may be, for example, the angle deviation between the tangent direction at the starting point of the corresponding path segment or the candidate path and the tangent direction at the end point; each path segment may be a path segment of a single arc;

[0173] S702: Selecting a target candidate path as the first navigation path;

[0174] The target candidate path is derived from multiple candidate paths, and the path reference information of the target candidate path is adapted to the constraint information of the adjustable bending sheath tube, for example:

[0175] The length of the first navigation path can ensure that the end of the adjustable bending sheath tube (or a designated part, or a consumable used in conjunction with the adjustable bending sheath tube) can be controlled to reach the medical concern part simulated by the target area, thereby avoiding the situation where the extendable part of the adjustable bending sheath tube is extended out of the bronchoscope but still cannot reach the medical concern part;

[0176] The steering angle of the first navigation path can ensure that the bending ability of the adjustable bending sheath tube can achieve the bending degree reflected by the steering angle of the first navigation path.

[0177] visible, Figure 7 In the illustrated embodiment, since the first navigation path is adapted to the constraint information of the adjustable bend sheath, it can be ensured that the first navigation path can accurately meet the constraints of the adjustable bend sheath, thereby ensuring that the planned first navigation path can be effectively executed by the adjustable bend sheath.

[0178] In addition, if, when planning the first navigation path, it is further considered whether the bronchoscope can reach the tracheal portion where the real puncture position simulated by the simulated puncture position is located, it is also necessary to combine at least part of the constraint information of the bronchoscope to determine the first navigation path and the simulated puncture position;

[0179] Furthermore, in one implementation manner, the specific process of step S702 may include:

[0180] Acquire at least part of the constraint information of the bronchoscope and the simulated puncture position corresponding to the target candidate path; wherein at least part of the constraint information of the bronchoscope includes the radial size of the part of the bronchoscope used to extend into the real bronchial tree;

[0181] In a case where the radial size of the partial bronchoscope is smaller than the radial size of the acquired tracheal portion where the simulated puncture position is located, a target candidate path is selected as the first navigation path.

[0182] It can be seen that the simulated puncture position satisfies: the radial size of the partial bronchoscope is smaller than the radial size of the tracheal part where the simulated puncture position is located. It can also be understood that: the radial size of the partial bronchoscope is smaller than the radial size of the real tracheal part simulated by the tracheal part where the simulated puncture position is located.

[0183] The radial dimension of a portion of the bronchoscope may be, for example, the diameter or circumference of each part in the portion of the bronchoscope; the radial dimension of the trachea at the simulated puncture position may be, for example, the inner wall diameter or inner wall circumference of the corresponding trachea.

[0184] In the above scheme, when the navigation path of the adjustable curved sheath is planned, it can be ensured that the bronchoscope can reach the vicinity of the planned position, thereby ensuring the feasibility of the first navigation path.

[0185] For one example, please refer to Figure 8 The execution process of steps S801, S802, and S803 is the same as above. Figure 3 Steps S301, S302, and S303 in the embodiment shown are the same or similar, and the same or similar contents will not be described here. On this basis, the navigation path of the bronchoscope (i.e., the second navigation path) can also be planned, and then, Figure 8 In the illustrated embodiment, the data processing method for in vivo path planning further includes:

[0186] S804: planning a second navigation path in the virtual lung model based on the simulated puncture position and the constraint information of the bronchoscope;

[0187] Among them, the constraint information of the bronchoscope represents the structural characteristics of the bronchoscope that constrain the movement process of the bronchoscope; furthermore, the structural characteristics that will bring constraints to the movement process of the bronchoscope may serve as the constraint information of a bronchoscope.

[0188] The constraint information of the bronchoscope may, for example, include at least one of the following: the bending ability information of the bronchoscope, the length of the bronchoscope, and the radial dimension of the bronchoscope; the radial dimension of the bronchoscope here may refer to the radial dimension of the part of the bronchoscope used to extend into the real bronchial tree (for example, at least one of the circumference, diameter, etc.).

[0189] The second navigation path refers to: the navigation path of the bronchoscope from the first position to the second position of the virtual bronchial tree, and the second position is adapted to the simulated puncture position, the second position may refer to a position adjacent to the simulated puncture position, for example, the distance between the second position and the simulated puncture position is less than the corresponding threshold value, wherein the first position may be any position in the virtual bronchial tree, and the first position may be understood as the starting position for navigating the bronchoscope, for example, it may be the position of the main carina of the airway in the virtual bronchial tree.

[0190] In one implementation manner, the specific process of step S804 may include:

[0191] Taking the main carina of the airway in the virtual bronchial tree as the first position, a navigation path from the first position to the second position is planned along the central axis of the airway to obtain the second navigation path, so that the path reference information of the second navigation path is adapted to the constraint information of the bronchoscope.

[0192] The path reference information of the second navigation path includes the length of the second navigation path, the turning angle, and the diameter of the trachea passed by the second navigation path. The turning angle may refer to a set of turning angles of each path segment in the second navigation path, wherein the turning angle may be, for example, an angle deviation between a tangent direction at a starting point of the corresponding path segment and a tangent direction at an end point; wherein each path segment may be a path segment of a single arc.

[0193] The adaptation of the path reference information of the second navigation path and the constraint information of the bronchoscope may be, for example:

[0194] The length of the second navigation path can ensure that the end (or designated position) of the bronchoscope can be controlled to reach the position in the real bronchial tree simulated by the second position, thereby avoiding the situation where the bronchoscope cannot reach the correct position after entering the bronchial tree;

[0195] The steering angle of the second navigation path can ensure that: the bending ability of the bronchoscope can achieve the bending degree reflected by the steering angle of the second navigation path;

[0196] The diameter of the trachea passed by the second navigation path can ensure that the bronchoscope can successfully pass through the corresponding trachea in the real bronchial tree.

[0197] visible, Figure 8 In the illustrated embodiment, since the second navigation path is adapted to the constraint information of the bronchoscope, it can be ensured that the second navigation path can accurately meet the constraints of the bronchoscope, thereby ensuring that the planned second navigation path can be effectively executed after the bronchoscope moves.

[0198] Please refer to Fig. 9 Based on the navigation path (such as the first navigation path or the second navigation path) planned by the data processing method for in vivo path planning, the embodiment of the present invention further provides a data processing method for in vivo navigation, comprising:

[0199] S901: Acquire a first navigation path planned by a data processing method for in-vivo path planning;

[0200] S902: Displaying the virtual lung model on a display device, and displaying the first navigation path based on the virtual lung model.

[0201] In the virtual lung model displayed by the display device, the first navigation path can be displayed in the virtual lung model. For example, the color, line width, and line type can be specified to draw the lines of the first navigation path in the virtual lung model. Fig. 9 In the illustrated embodiment, by displaying the first navigation path, reliable reference and guidance can be provided for the operation of the adjustable bending sheath tube.

[0202] In addition, the sagittal view, coronal view, cross-section, etc. of the CT image in the CT data can also be displayed on the display device.

[0203] For one example, please refer to Fig.10 , the data processing method for in vivo navigation further includes:

[0204] S1001: Obtaining the development result of the adjustable bending sheath tube under X-ray;

[0205] The development result can characterize the position of the adjustable bending sheath tube on the real human body; the development result can be, for example, a post-development image collected after a development device (such as a C-arm) irradiates the human body with X-rays; the development result can also be, for example, information extracted from the post-development image;

[0206] S1002: Based on the development result, displaying the position of the adjustable bending sheath tube on the real human body in the virtual lung model;

[0207] For example, the position of the adjustable bending sheath tube in the real human body can be displayed in the virtual lung model in the form of points, lines or an adjustable bending sheath tube model.

[0208] exist Fig.10 In the illustrated embodiment, by displaying the position of the adjustable bending sheath tube on the real human body, relevant personnel can be assisted in determining at least one of the following: whether the adjustable bending sheath tube has reached the medical concern site; whether the adjustable bending sheath tube has moved along the first navigation trajectory, and relevant personnel can also be assisted in accurately knowing the position of the adjustable bending sheath tube. Furthermore, it helps to ensure that the adjustable bending sheath tube can be controlled to move along the planned first navigation path, thereby ensuring that the adjustable bending sheath tube is accurately in place.

[0209] For one example, please refer to Fig.11 , the data processing method for in vivo navigation further includes:

[0210] S1101: Acquire a second navigation path;

[0211] The second navigation path refers to: a navigation path of a bronchoscope from a first position to a second position in the virtual bronchial tree, and the second position is adapted to the simulated puncture position; and the second navigation path in step S1101 can be Figure 8 The second navigation path mentioned in the embodiment shown, the planning process and function of the second navigation path can refer to Figure 8 The description of the illustrated embodiments is understood;

[0212] S1102: Acquire intraoperative images;

[0213] The intraoperative image is acquired by the bronchoscope, for example, by an image acquisition unit in the bronchoscope. Figure 2 The acquisition process and function of the intraoperative images mentioned in the embodiment shown can be referred to in Figure 2 The description of the illustrated embodiments is understood;

[0214] Steps S1102, S1103 and S1104 may be performed after the bronchoscope has entered the human body, which may also be understood as: Steps S1102, S1103 and S1104 may be performed after the relevant personnel use the bronchoscope to start performing the corresponding operation;

[0215] S1103: Determine the position of the bronchoscope on the real human body based on the intraoperative image;

[0216] The process of step S1103 may be implemented with reference to any existing or improved solution in the art; for example, a virtual slice image of a virtual bronchoscope may be obtained, and then the position of the bronchoscope on the real human body may be determined based on the matching result between the virtual slice image and the intraoperative image;

[0217] S1104: Based on the virtual lung model, the second navigation path and the actual position of the bronchoscope are displayed.

[0218] For example, the position of a bronchoscope on a real human body may be displayed in the virtual lung model in the form of points, lines or a bronchoscope model, or the color, line width and line type may be specified to draw the lines of the second navigation path in the virtual lung model.

[0219] visible, Fig.11 In the illustrated embodiment, by displaying the position of the bronchoscope on the real human body and the second navigation path, relevant personnel can be assisted in determining at least one of the following: whether the bronchoscope has reached the end position of the second navigation path (i.e., the real position simulated by the second position); whether the bronchoscope has moved along the second navigation path, and relevant personnel can also be assisted in accurately knowing which position the bronchoscope has reached. Furthermore, it helps to ensure that the bronchoscope can be controlled to move along the planned second navigation path, thereby ensuring that the bronchoscope is accurately in place.

[0220] Combination Fig. 9 , Fig.10 and Fig.11One of the embodiments shown is an exemplary scheme, in which a virtual lung model, a planned navigation path (such as a first navigation path, a second navigation path), and CT data (such as various CT images) can be presented on a display device to guide the bronchoscope to the vicinity of the puncture point (i.e., the actual puncture position) in real time, and then the adjustable curved sheath passes through the working channel of the bronchoscope out of the airway and reaches the lesion site (or diagnosis site) according to the second navigation path. Finally, with the help of a developing device (such as a C-arm), it is immediately verified whether the lesion site (or diagnosis site) is accurately reached. If there is a deviation, it can be fine-tuned.

[0221] Please refer to Fig.12 The embodiment of the present invention further provides a data processing device 1200 for in vivo path planning, comprising:

[0222] A model acquisition module 1201 is used to acquire a virtual lung model, wherein the virtual lung model includes a virtual bronchial tree and virtual obstacles;

[0223] A target determination module 1202 is used to determine a target area in the virtual lung model;

[0224] A first planning module 1203 is used to plan a first navigation path and a simulated puncture position in the lung virtual model based on the target area and constraint information of the adjustable bending sheath tube;

[0225] in:

[0226] The constraint information of the adjustable bending sheath tube represents the structural characteristics of the adjustable bending sheath tube that constrain the movement process of the adjustable bending sheath tube; the simulated puncture position is adapted to the target area; the first navigation path refers to: the navigation path of the adjustable bending sheath tube from the simulated puncture position to the target area in the virtual lung model, and the first navigation path can avoid the virtual obstacles.

[0227] Optionally, the first planning module 1203 is specifically configured to:

[0228] Determining a reference position point in the target area;

[0229] Based on the reference position point, a path that can avoid the virtual obstacle is planned to obtain multiple candidate paths; the starting point of the candidate path is in the virtual bronchial tree or on the airway wall thereof, and the end point of the candidate path is the reference position point;

[0230] Based on the constraint information of the adjustable bending sheath tube, the first navigation path is selected from the multiple candidate paths; the simulated puncture position is the connection point between the first navigation path and the airway wall, and the simulated puncture position is determined.

[0231] Optionally, the virtual obstacle includes at least one of the following: a virtual blood vessel, a virtual rib, and a virtual pleura.

[0232] Optionally, the first planning module 1203 is specifically configured to:

[0233] Taking the reference position point as a first-level position point, starting from the first-level position point, exploring one or more next-level position points step by step until the last-level position point located in the virtual bronchial tree or on the tracheal wall is explored;

[0234] After exploring any Nth level position point, search for a target position point near the Nth level position point, and use each searched target position point as a corresponding N+1th level position point; the relative position of the target position point and the Nth level position point meets the specified position requirement; the specified position requirement includes: the distance between the Nth level position point and the target position point is a specified distance or is within a specified distance range, and / or: the direction of the target position point relative to the Nth level position point is within a specified angle range, wherein N is a positive integer greater than or equal to 1;

[0235] Selecting the target position point that does not conflict with the virtual obstacle as the N+1th level position point;

[0236] Based on the connection lines between the first-level position point and any last-level position point, a candidate path corresponding to any last-level position point is formed.

[0237] Optionally, the first planning module 1203 is specifically configured to:

[0238] If any of the searched first target position points does not fall on the virtual obstacle, determining that any of the first target position points does not conflict with the virtual obstacle and selecting any of the first target position points as the N+1th level position point;

[0239] And / or, if the distance between any second target position point searched and the virtual obstacle is not less than a distance threshold, it is determined that any second target position point does not conflict with the virtual obstacle and any second target position point is selected as the N+1th level position point.

[0240] Optionally, the first planning module 1203 is specifically configured to:

[0241] Determine path reference information of the candidate path, wherein the path reference information of the candidate path includes a length and a turning angle of the candidate path;

[0242] A target candidate path is selected as the first navigation path, wherein the path reference information of the target candidate path is adapted to the constraint information of the adjustable bending sheath tube.

[0243] Optionally, the first planning module 1203 is specifically configured to:

[0244] Acquire at least part of the constraint information of the bronchoscope and the simulated puncture position corresponding to the target candidate path; wherein at least part of the constraint information of the bronchoscope includes: the radial size of the part of the bronchoscope used to extend into the real bronchial tree;

[0245] In a case where the radial size of the partial bronchoscope is smaller than the radial size of the acquired tracheal portion where the simulated puncture position is located, a target candidate path is selected as the first navigation path.

[0246] Optionally, the reference position point includes a center point of the target area.

[0247] Optionally, the constraint information of the adjustable bending sheath tube includes bending ability information of the adjustable bending sheath tube and length information of the adjustable bending sheath tube.

[0248] Optionally, the model acquisition module 1201 is specifically used for:

[0249] Obtain CT data of the patient;

[0250] The lung virtual model is established according to the CT data.

[0251] Optionally, the target area is determined based on the virtual lung model and CT data of the patient.

[0252] Optionally, the CT data includes a CT image, and the CT image includes at least one of the following: a sagittal image, a coronal image, and a cross-sectional image.

[0253] exist Fig.13 In the embodiment shown, the model acquisition module 1301 and Fig.12 The model acquisition module 1201 in the embodiment shown is the same or similar, and the target determination module 1302 therein is the same or similar to Fig.12 The target determination module 1202 in the embodiment shown is the same or similar to the first planning module 1303. Fig.12 The first planning module 1203 in the illustrated embodiment is the same or similar, so the same or similar contents will not be described in detail herein.

[0254] exist Fig.13 In the illustrated embodiment, the data processing device 1300 for in vivo path planning further includes:

[0255] A second planning module 1304 is used to plan a second navigation path in the lung virtual model based on the simulated puncture position and the constraint information of the bronchoscope;

[0256] Among them, the constraint information of the bronchoscope represents the structural characteristics of the bronchoscope that constrain the movement process of the bronchoscope; the second navigation path refers to: the navigation path of the bronchoscope from the first position to the second position of the virtual bronchial tree, and the second position is adapted to the simulated puncture position.

[0257] Optionally, the second planning module 1304 is specifically configured to:

[0258] Taking the main carina of the airway in the virtual bronchial tree as the first position, a navigation path from the first position to the second position is planned along the central axis of the airway to obtain the second navigation path, so that the path reference information of the second navigation path is adapted to the constraint information of the bronchoscope, and the path reference information of the second navigation path includes the length of the second navigation path, the turning angle, and the diameter of the trachea passed through.

[0259] Optionally, the constraint information of the bronchoscope includes: bending ability information of the bronchoscope, the length of the bronchoscope, and the radial size of the bronchoscope.

[0260] Fig.12 , Fig.13 The technical terms, technical means and technical effects in the embodiments shown in FIG. Figure 8 The embodiments shown are understood and will not be described in detail here.

[0261] Please refer to Fig.14 The embodiment of the present invention further provides a data processing device 1400 for in vivo navigation, comprising:

[0262] A first path acquisition module 1401 is used to acquire a first navigation path planned by a data processing method for in-vivo path planning;

[0263] The display guidance module 1402 is used to display the virtual lung model on a display device, and to display the first navigation path based on the virtual lung model.

[0264] exist Fig.15 In the embodiment shown, the first path acquisition module 1501 and Fig.14 The first path acquisition module 1401 in the embodiment shown is the same or similar to the first path acquisition module 1401, and some functions of the display guidance module 1502 are the same as those of the first path acquisition module 1401. Fig.14 The display guide module 1502 in the illustrated embodiment is the same or similar, so the same or similar contents will not be described again here.

[0265] exist Fig.15 In the illustrated embodiment, the data processing device 1500 for in vivo navigation further includes:

[0266] The imaging result acquisition module 1503 is used to obtain the imaging result of the adjustable bending sheath tube under X-ray; the imaging result can represent the position of the adjustable bending sheath tube on the real human body;

[0267] The display guidance module 1502 is also used to: based on the development result, display the position of the adjustable bending sheath tube on the real human body in the lung virtual model.

[0268] exist Fig.15 In the illustrated embodiment, the data processing device 1500 for in vivo navigation further includes:

[0269] A second path acquisition module 1506 is used to acquire a second navigation path; the second navigation path refers to: a navigation path of the bronchoscope from a first position to a second position in the virtual bronchial tree, and the second position is adapted to the simulated puncture position;

[0270] An intraoperative image acquisition module 1505 is used to acquire intraoperative images, where the intraoperative images are collected by the bronchoscope;

[0271] A bronchoscope positioning module 1504, configured to determine the position of the bronchoscope on a real human body based on the intraoperative image;

[0272] The display guidance module 1502 is further used to display the second navigation path and the position of the bronchoscope on the real human body based on the virtual lung model.

[0273] Fig.14 , Fig.15 The technical terms, technical means and technical effects of the embodiments shown in FIG. Fig.11 The embodiments shown are understood and will not be described in detail here.

[0274] Please refer to Fig.16 The embodiment of the present invention further provides an electronic device 1600, including:

[0275] Processor 1601; and

[0276] Memory 1602, used to store executable instructions of the processor;

[0277] The processor 1601 is configured to execute the above-mentioned method by executing the executable instructions.

[0278] The processor 1601 can communicate with the memory 1602 via the bus 1603 .

[0279] An embodiment of the present invention further provides a computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, the above-mentioned method is implemented.

[0280] Those skilled in the art can understand that all or part of the steps of implementing the above-mentioned method embodiments can be completed by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When the program is executed, the steps of the above-mentioned method embodiments are executed; and the aforementioned storage medium includes: ROM, RAM, disk or optical disk and other media that can store program codes.

[0281] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A data processing method for in vivo path planning, characterized in that: include: Acquire a virtual lung model of a real human body, wherein the virtual lung model includes a virtual bronchial tree and virtual obstacles; determining a target region in the virtual model of the lung; The position of the target area in the virtual lung model matches the position of the medical concern site in the real human body; Based on the target area and constraint information of the adjustable curved sheath, a first navigation path and a simulated puncture position are planned in the lung virtual model; in: The bronchoscope has a working channel, the working channel is for an adjustable bending sheath tube to pass through, the inner cavity of the adjustable bending sheath tube is for instruments to pass through, and the adjustable bending sheath tube can be controlled to bend; the constraint information of the adjustable bending sheath tube represents the structural characteristics of the adjustable bending sheath tube that constrain the movement process of the adjustable bending sheath tube; the constraint information of the adjustable bending sheath tube includes: bending ability information of the adjustable bending sheath tube; the simulated puncture position simulates the real puncture position in the real bronchial tree; the first navigation path refers to: the navigation path in the virtual lung model that passes through the simulated puncture position to reach the target area, and the first navigation path is the navigation path of the adjustable bending sheath tube, and the first navigation path can avoid the virtual obstacles; Planning a second navigation path in the virtual lung model based on the simulated puncture position and constraint information of the bronchoscope; Among them, the constraint information of the bronchoscope represents the structural characteristics of the bronchoscope that constrain the movement process of the bronchoscope; the second navigation path refers to: the navigation path of the bronchoscope from the first position to the second position of the virtual bronchial tree, and the second position is adapted to the simulated puncture position.

2. The data processing method for in vivo path planning according to claim 1, characterized in that: Based on the target area and the constraint information of the adjustable curved sheath tube, a first navigation path and a simulated puncture position are planned in the lung virtual model, including: Determining a reference position point in the target area; Based on the reference position point, a path that can avoid the virtual obstacle is planned to obtain multiple candidate paths; the starting point of the candidate path is in the virtual bronchial tree or on the airway wall thereof, and the end point of the candidate path is the reference position point; Based on the constraint information of the adjustable bending sheath tube, the first navigation path is selected from the multiple candidate paths; the simulated puncture position is the connection point between the first navigation path and the airway wall.

3. The data processing method for in vivo path planning according to claim 2, characterized in that: Based on the reference position point, a path that can avoid the virtual obstacle is planned to obtain multiple candidate paths, including: Taking the reference position point as a first-level position point, starting from the first-level position point, exploring one or more next-level position points step by step until the last-level position point located in the virtual bronchial tree or on the tracheal wall is explored; After exploring any N-th level position point, searching for a target position point near the N-th level position point, the relative position of the target position point to the N-th level position point meets the specified position requirement, the specified position requirement includes: the distance between the N-th level position point and the target position point is a specified distance or is within a specified distance range, and / or: the direction of the target position point relative to the N-th level position point is within a specified angle range, wherein N is a positive integer greater than or equal to 1; Selecting the target position point that does not conflict with the virtual obstacle as the N+1th level position point; Based on the connection lines between the first-level position point and any last-level position point, a candidate path corresponding to any last-level position point is formed.

4. The data processing method for in vivo path planning according to claim 3, characterized in that: Selecting the target position point that does not conflict with the virtual obstacle as the N+1th level position point includes: If any of the searched first target position points does not fall on the virtual obstacle, determining that any of the first target position points does not conflict with the virtual obstacle and selecting any of the first target position points as the N+1th level position point; And / or, if the distance between any second target position point searched and the virtual obstacle is not less than a distance threshold, it is determined that any second target position point does not conflict with the virtual obstacle and any second target position point is selected as the N+1th level position point.

5. The data processing method for in vivo path planning according to claim 2, characterized in that: Based on the constraint information of the adjustable bending sheath tube, selecting the first navigation path from the multiple candidate paths includes: Determine path reference information of the candidate path, wherein the path reference information of the candidate path includes a length and a turning angle of the candidate path; A target candidate path is selected as the first navigation path, wherein the path reference information of the target candidate path is adapted to the constraint information of the adjustable bending sheath tube.

6. The data processing method for in vivo path planning according to claim 5, characterized in that: Selecting a target candidate path as the first navigation path includes: Acquire at least part of the constraint information of the bronchoscope and the simulated puncture position corresponding to the target candidate path; wherein at least part of the constraint information of the bronchoscope includes: the radial size of the part of the bronchoscope used to extend into the real bronchial tree; In a case where the radial size of the partial bronchoscope is smaller than the radial size of the acquired tracheal portion where the simulated puncture position is located, a target candidate path is selected as the first navigation path.

7. The data processing method for in vivo path planning according to any one of claims 2 to 6, characterized in that: The reference position point includes a center point of the target area.

8. The data processing method for in vivo path planning according to any one of claims 1 to 6, characterized in that: The virtual obstacle includes at least one of the following: a virtual blood vessel, a virtual rib, and a virtual pleura.

9. The data processing method for in vivo path planning according to any one of claims 1 to 6, characterized in that: The constraint information of the adjustable bending sheath tube also includes the length information of the adjustable bending sheath tube.

10. The data processing method for in vivo path planning according to claim 1, characterized in that: Based on the simulated puncture position and the constraint information of the bronchoscope, a second navigation path is planned in the virtual lung model, including: Taking the main carina of the airway in the virtual bronchial tree as the first position, a navigation path from the first position to the second position is planned along the central axis of the airway to obtain the second navigation path, so that the path reference information of the second navigation path is adapted to the constraint information of the bronchoscope, and the path reference information of the second navigation path includes the length of the second navigation path, the turning angle, and the diameter of the trachea passed through.

11. The data processing method for in vivo path planning according to claim 1, characterized in that: The constraint information of the bronchoscope includes: bending ability information of the bronchoscope, the length of the bronchoscope, and the radial size of the bronchoscope.

12. A data processing method for in vivo navigation, characterized in that: include: Acquire a first navigation path planned by the data processing method for in vivo path planning according to any one of claims 1 to 9; The virtual lung model is displayed on a display device, and the first navigation path is displayed based on the virtual lung model.

13. A data processing device for in vivo path planning, characterized in that: include: A model acquisition module, used to acquire a virtual lung model of a real human body, wherein the virtual lung model includes a virtual bronchial tree and virtual obstacles; A target determination module, used for determining a target area in the virtual lung model; the position of the target area in the virtual lung model matches the position of the medical concern part in the real human body; A first planning module, configured to plan a first navigation path and a simulated puncture position in the lung virtual model based on the target area and constraint information of the adjustable bending sheath tube; a second planning module, configured to plan a second navigation path in the virtual lung model based on the simulated puncture position and constraint information of the bronchoscope; The constraint information of the bronchoscope represents the structural features of the bronchoscope that constrain the movement process of the bronchoscope; the second navigation path refers to: the navigation path of the bronchoscope from the first position to the second position of the virtual bronchial tree, and the second position is adapted to the simulated puncture position; in: The bronchoscope has a working channel for an adjustable bending sheath to pass through, the inner cavity of the adjustable bending sheath is for instruments to pass through, and the adjustable bending sheath can be controlled to bend; the constraint information of the adjustable bending sheath characterizes the structural characteristics of the adjustable bending sheath that constrain the movement process of the adjustable bending sheath; the constraint information of the adjustable bending sheath includes: bending ability information of the adjustable bending sheath; the simulated puncture position simulates the real puncture position in the real bronchial tree; the first navigation path refers to: the navigation path in the virtual lung model that passes through the simulated puncture position to reach the target area, and the first navigation path is the navigation path of the adjustable bending sheath, and the first navigation path can avoid the virtual obstacles.

14. A data processing device for in vivo navigation, characterized in that: include: A path acquisition module, used to acquire a first navigation path planned by the data processing method for in vivo path planning according to any one of claims 1 to 9; The display guidance module is used to display the virtual lung model on a display device and to display the first navigation path based on the virtual lung model.

15. An electronic device, characterized in that: Including processor and memory, The memory is used to store codes; The processor is used to execute the code in the memory to implement the data processing method described in any one of claims 1 to 12.

16. A storage medium having a computer program stored thereon, wherein when the program is executed by a processor, the data processing method according to any one of claims 1 to 12 is implemented.

17. A navigation system, characterized in that: include: A bronchoscope, an adjustable curved sheath tube and a data processing unit, wherein the data processing unit is used to implement the data processing method according to any one of claims 1 to 12.