Systems and methods for responsive insertion and retraction of robotic endoscopes

Through low-cost, articulated robot endoscopic control technology, the stability of traditional endoscopics in airway navigation is solved, reducing costs and simplifying the surgical process, and achieving effective access to the upper lobe of the lung.

CN118922120AActive Publication Date: 2024-11-08NOAH MEDICAL CORP

Patent Information

Application Number
CN202380030119.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2023-01-18
Filing Date
2023-03-24
Publication Date
2024-11-08
Estimated Expiration
2043-03-24

AI Technical Summary

Technical Problem

Traditional endoscopes are difficult to reach the upper lung lobe when navigating through the airway, and loss of position/shape control due to bending or kinking can lead to potential damage and surgical complications, and the handle of a single endoscope is expensive, and A complex cleaning and sterilization process is required.

Method used

Provides a low-cost, single-use articulated robot endoscope that controls the tip speed and motion of the articulated flexible endoscope by generating commands and receiving sensor data, detects buckling events, and ensures that the endoscope is stable along the anatomical path. Move and reduce costs by simplifying the structure.

Benefits of technology

It achieves stable navigation and operation of the endoscope in the airway under low-cost and efficient conditions, reducing surgical risks, reducing handle costs, and avoiding complex cleaning and sterilization processes.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118922120A_ABST
    Figure CN118922120A_ABST
Patent Text Reader

Abstract

A method for controlling a tip speed of an articulated flexible endoscope is provided. The method includes: generating a command to move a tip of an elongate member of the articulated flexible endoscope at an expected speed; receiving sensor data acquired by a sensor disposed at a distal tip portion of the elongate member to calculate a tip velocity; calculating a difference between the expected speed and the tip speed; and control the tip speed based on the difference.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] References

[0002] This application claims priority to U.S. Provisional Patent Application No. 63 / 324,746 filed on March 29, 2022 and U.S. Provisional Patent Application No. 63 / 480,502 filed on January 18, 2023, each of which is incorporated herein by reference in its entirety. Background Art

[0003] Endoscopy procedures use endoscopy to examine the inside of a hollow organ or body cavity. Unlike many other medical imaging techniques, an endoscope is inserted directly into an organ. Flexible endoscopes that rely on intuitive manipulation and control can be delivered for diagnosis and treatment of diseases accessible through any natural orifice in the body. Depending on clinical indications, endoscopes can be designated as bronchoscopes, ureteroscopes, colonoscopes, gastroscopes, otolaryngoscopes, and various other endoscopes. For example, flexible bronchoscopes can be used for lung cancer diagnosis and / or surgical treatment. However, a difficult problem with bronchoscopy is to reach the upper lobe of the lung while navigating through the airway. In another example, flexible endoscopy has been used to examine and treat gastrointestinal (GI) tract disorders without creating an opening in the patient. The endoscope is introduced into the upper GI tract or lower GI tract via the mouth or anus, respectively. A miniature camera at the distal end captures an image of the GI wall, which helps clinicians diagnose GI diseases. Simple surgical procedures (such as polypectomy and biopsy) can be performed by introducing a flexible tool via a working channel to reach the site of interest at the distal end.

[0004] Traditionally, endoscopes are reusable and may need to be thoroughly cleaned, disinfected, and / or sterilized after each procedure. In most cases, cleaning, disinfecting, and sterilizing can be aggressive processes that kill germs and / or bacteria. Such procedures may also be harsh on the endoscope itself. As a result, the design of such reusable endoscopes may often be complex, especially to ensure that the endoscope can withstand such harsh cleaning, disinfecting, and sterilization regimens. Periodic maintenance and repairs may often be required of such reusable endoscopes.

[0005] For instruments that are difficult to clean properly, low-cost disposable medical devices designated for single use have become popular. Single-use disposable devices can be packaged in sterile wrappers to avoid the risk of pathogenic cross-contamination of diseases such as HIV, hepatitis, and other pathogens. Hospitals generally welcome the convenience of single-use disposable products because they no longer have to worry about aging, overuse, breakage, malfunction, and sterilization of the product. Traditional endoscopes typically include a handle that the operator uses to manipulate the endoscope. For single-use endoscopes, the handle typically encapsulates a camera, expensive electronics, and mechanical structures at the proximal end to transmit video and allow the user to manipulate the endoscope via a user interface. This can lead to high costs for the handle of a single-use endoscope.

[0006] Continuous robots and endoscopes are typically long and flexible. The shaft of an endoscope may be restricted by bends or kinks when inserting the device into the anatomy. Passive deformation of the endoscope shaft can be a result of insertion forces as well as contact with the anatomy, which is difficult to model. Prolapse or kinking can cause potential damage as it can expose the sharp edges of the kinked, elongated device and complicate the surgical procedure. In addition, a bent or kinked elongated device can cause the system to lose control of the position / shape of the device and potentially block the passage of the instrument. Summary of the invention

[0007] It is recognized herein that a robotic endoscope is needed that allows surgical or diagnostic operations to be performed with improved performance and cost efficiency. It is also recognized herein that the device and system comprising an endoscope can be disposable and can not require a large number of cleaning procedures. The present disclosure provides a low-cost, single-use articulated endoscope for diagnosis and treatment in various applications (such as bronchoscopy, urology, gynecology, arthroscopy, orthopedics, otolaryngology, gastrointestinal endoscopy, neurosurgery, colonoscopy and various other applications). In some embodiments, the present disclosure provides a single-use, robot-controlled disposable bronchoscope for use with a robotic system to achieve diagnostic assessment of damage anywhere in the anatomical structure of the lung. It should be noted that the endoscopic system provided can be used in various minimally invasive surgical procedures, therapeutic or diagnostic surgeries involving various types of tissues including heart, bladder and lung tissue, and can be used in other anatomical regions of the patient's body (such as the digestive system including but not limited to the esophagus, liver, stomach, colon, urethra or the respiratory system including but not limited to the bronchi, lungs and various other regions).

[0008] In one aspect of the present disclosure, a method for controlling the tip speed of an articulating flexible endoscope is provided. The method includes: generating a command to move the tip of an elongated member of the articulating flexible endoscope at an expected speed; receiving sensor data acquired by a sensor arranged at a distal tip portion of the elongated member to calculate the tip speed; calculating the difference between the expected speed and the tip speed; and controlling the tip speed based on the difference.

[0009] In one aspect, a method for controlling the tip motion of an articulated flexible endoscope is provided. The method includes: generating a command to drive an elongated member of the articulated flexible endoscope along an anatomical path via an instrument drive mechanism (IDM); receiving sensor data acquired by a position sensor disposed at a distal tip portion of the elongated member; upon determining that the distal tip portion is at a preselected position within the anatomical path, setting the motion of the distal tip to zero and calculating the motion of the distal tip portion within a time window; calculating the difference between the motion of the distal tip portion and the motion of the IDM within the same time window; and detecting a buckling event by comparing the difference to a threshold.

[0010] In some embodiments, the preselected location is the main carina. In some embodiments, the method further comprises determining that the distal tip portion is located at the preselected location based at least in part on the sensor data and the 3D model of the anatomical path. In some cases, the position sensor comprises an electromagnetic sensor.

[0011] In some embodiments, the method further comprises determining that the distal tip portion is at a preselected position based at least in part on image data acquired by a camera located at the distal tip portion. In some embodiments, the threshold is dynamically determined based on the target anatomical region toward which the articulated flexible endoscope is moving. In some embodiments, the threshold is a function of the tortuosity of the anatomical path.

[0012] In some embodiments, the size of the time window is between 4 seconds and 8 seconds. In some cases, the size of the time window is determined based on empirical data. In some embodiments, the movement of the distal tip portion within the time window is the accumulation of the travel distance of each time step.

[0013] In some embodiments, the method further includes setting the insertion force applied by the IDM to zero upon determining that the distal tip portion is at a preselected position within the anatomical path and comparing the insertion force to a force threshold. In some embodiments, the method further includes generating and displaying a warning message on a user interface upon determining that the insertion force is above the force threshold.

[0014] In some embodiments, the method further comprises controlling the speed of the distal tip portion of the elongated member based on the difference between the expected speed and the measured tip speed. In some cases, the measured tip speed is calculated as a filtered time derivative of the sensor data projected in the forward direction. In some cases, the expected speed is based on the input command. In some cases, controlling the speed of the distal tip portion of the elongated member comprises closed-loop control. For example, the measured tip speed is processed through a low-pass filter to serve as a feedback signal for the closed-loop control.

[0015] In some embodiments, the distal tip portion includes a structure for housing an imaging device, a position sensor, and an illumination device. In some embodiments, the proximal end of the elongated member of the articulated flexible endoscope is connected to the IDM for applying force to one or more pull wires to articulate the distal tip portion of the elongated member to insert or retract the articulated flexible endoscope. In some embodiments, the method further includes displaying a message indicating a buckling event and a suggestion to take action in response to the buckling event on a user interface.

[0016] In a related but independent aspect, a system for controlling the motion of the tip of an articulated flexible endoscope is provided. The system includes: a memory storing computer executable instructions; one or more processors communicating with the articulated flexible endoscope and configured to execute the computer executable instructions to: generate commands to drive an elongated member of the articulated flexible endoscope along an anatomical path via an instrument drive mechanism (IDM); receive sensor data acquired by a position sensor disposed at a distal tip portion of the elongated member; upon determining that the distal tip portion is at a preselected position within the anatomical path, set the motion of the distal tip to zero and calculate the motion of the distal tip portion within a time window; calculate the difference between the motion of the distal tip portion and the motion of the IDM within the same time window; and detect a buckling event by comparing the difference to a threshold.

[0017] It should be noted that the individual components of the provided modular endoscopic assemblies and devices can be used in various minimally invasive surgical procedures, therapeutic or diagnostic procedures involving various types of tissue including heart, bladder and lung tissue, and can be used in other anatomical regions of the patient's body (such as the digestive system including but not limited to the esophagus, liver, stomach, colon, urethra or the respiratory system including but not limited to the bronchi, lungs, and various other regions).

[0018] Additional aspects and advantages of the present disclosure will become readily apparent to those skilled in the art from the following detailed description, wherein only illustrative embodiments of the present disclosure are shown and described. As will be appreciated, the present disclosure is capable of other and different embodiments, and its several details are capable of modification in various obvious respects, all without departing from the present disclosure. Therefore, the drawings and description are to be regarded as illustrative in nature, rather than restrictive.

[0019] Incorporation by reference

[0020] All publications, patents, and patent applications mentioned in this specification are incorporated herein by reference to the same extent as if each individual publication, patent, or patent application was specifically and individually indicated to be incorporated by reference. In the event that the publications and patents or patent applications incorporated by reference conflict with the disclosure contained in the specification, the specification is intended to supersede and / or take precedence over any such conflicting material. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] The novel features of the present invention are set forth in detail in the appended claims. A better understanding of the features and advantages of the present invention will be obtained by referring to the following detailed description and accompanying drawings (also referred to herein as "figures") which set forth illustrative embodiments utilizing the principles of the present invention, in which:

[0022] Figure 1 An example of a luminal network of a patient is schematically shown.

[0023] Figure 2 An example of a flexible elongate member undergoing extension and flexion in an airway / channel is shown.

[0024] Figure 3 An example of a dead zone occurring during controlled retraction of an endoscope is shown.

[0025] Figure 4 An exemplary algorithm for controlling the velocity of an endoscope tip through a safety check operation according to some embodiments of the present disclosure is shown.

[0026] Figure 5 An exemplary warning algorithm is shown.

[0027] Figure 6 Examples of IDM insertion distance and endoscope tip insertion distance at different time points are shown.

[0028] Figure 7 An example of the dynamic tracking error threshold (DTET) as a function of insertion distance is shown.

[0029] Figure 8 An example of a user interface module is shown.

[0030] Fig. 9 An example of a robotic endoscopy (eg, bronchoscopy) system according to some embodiments of the present invention is shown.

[0031] Fig.10 An example of a flexible endoscope according to some embodiments of the present disclosure is illustrated.

[0032] Fig.11 An example of a robotic bronchoscope including a handle portion and a flexible elongated member is shown.

[0033] Fig. 12A An example of an instrument drive mechanism (IDM) is shown, which provides the mechanical interface of the handle portion of a robotic bronchoscope.

[0034] Fig. 12B An example of a disposable endoscope removably coupled to an IDM is shown.

[0035] Fig.13 An example of the distal tip of an endoscope is shown.

[0036] Fig.14 An example distal portion of a catheter with integrated imaging and lighting devices is shown.

[0037] Fig.15 An example of a distal portion of a catheter with integrated imaging and lighting devices is shown.

[0038] Fig.16 An example of a "zero position" is shown.

[0039] Fig.17 An example of calculating a motion difference or motion mismatch within a predetermined time window is shown.

[0040] Fig.18 An exemplary algorithm for controlling the motion of the endoscope tip is shown.

[0041] Fig.19 Examples of thresholds that vary based on anatomical region are shown.

[0042] Fig. 20 and Fig.21 An example of a GUI displaying a warning message is shown. DETAILED DESCRIPTION

[0043] Although various embodiments of the present invention have been shown and described herein, it will be readily understood by those skilled in the art that such embodiments are provided by way of example only. Many variations, changes and substitutions may occur to those skilled in the art without departing from the present invention. It should be understood that various alternatives to the embodiments of the present invention described herein may be employed.

[0044] The embodiments disclosed herein can be combined in one or more of many ways to provide improved diagnosis and treatment for patients. The disclosed embodiments can be combined with existing methods and devices to provide improved treatment, such as with known lung diagnosis, surgical methods, and surgical methods of other tissues and organs. It should be understood that any one or more of the structures and steps described herein can be combined with any one or more additional structures and steps of the methods and devices described herein, and the accompanying drawings and supporting text provide descriptions according to the embodiments.

[0045] Although the exemplary embodiments will be primarily directed to devices or systems for bronchoscopy, those skilled in the art will appreciate that this is not intended to be limiting and that the devices described herein may be used for other therapeutic or diagnostic procedures and various anatomical regions of a patient's body. The provided devices or systems may be used for urology, gynecology, rhinology, otology, laryngoscopy, gastroenterology using an endoscope, a combination device including an endoscope and an instrument, an endoscope with a positioning function, and those skilled in the art will appreciate that this is not intended to be limiting and that the devices described herein may be used for other therapeutic or diagnostic procedures and other anatomical regions of a patient's body, such as the brain, heart, lungs, intestines, eyes, skin, kidneys, liver, pancreas, stomach, uterus, ovaries, testicles, bladder, ears, nose, mouth, soft tissues (such as bone marrow, adipose tissue, muscle, glandular and mucosal tissue, spinal cord and nerves tissue, cartilage), hard biological tissue (such as teeth, bones, etc.), as well as body cavities and ducts (such as sinuses, ureters, colon, esophagus, lungs, blood vessels and throat), and various other tissues in the form of: neuroendoscopes, encephaloscopes, ophthalmoscopes, otoscopes, rhinoscopes, laryngoscopes, gastroscopes, esophagoscopes, bronchoscopes, thoracoscopic, pleural scopes, angioscopes, mediastinoscopes, nephroscopes, gastroscopes, duodenoscopes, choledochoscopes, bile ductoscopes, laparoscopes, amnioscopic, ureteroscopes, hysteroscopes, cystoscopes, rectoscopes, colonoscopes, arthroscopes, salivary gland endoscopes, orthopedic endoscopes, etc., which are combined with various tools or instruments.

[0046] The systems and devices herein can be combined in one or more of many ways to provide improved diagnosis and treatment for patients. The systems and devices provided herein can be combined with existing methods and devices to provide improved treatment, such as with known lung diagnosis, surgical methods, and surgical methods of other tissues and organs. It should be understood that any one or more of the structures and steps described herein can be combined with any one or more additional structures and steps of the methods and devices described herein, and the accompanying drawings and supporting text provide descriptions according to embodiments.

[0047] Whenever the term "at least", "greater than", or "greater than or equal to" precedes the first value in a series of two or more values, the term "at least", "greater than", or "greater than or equal to" applies to each value in the series. For example, greater than or equal to 1, 2, or 3 is equivalent to greater than or equal to 1, greater than or equal to 2, or greater than or equal to 3.

[0048] Whenever the term "no more than," "less than," or "less than or equal to" precedes the first value in a series of two or more values, the term "no more than," "less than," or "less than or equal to" applies to every value in the series. For example, less than or equal to 3, 2, or 1 is equivalent to less than or equal to 3, less than or equal to 2, or less than or equal to 1.

[0049] As used herein, the terms distal and proximal may generally refer to a position referenced from the device and may be opposite to an anatomical reference. For example, a distal position of a main shaft or main catheter may correspond to a proximal position of a patient's elongated member, and a proximal position of a main sheath or main catheter may correspond to a distal position of a patient's elongated member.

[0050] Answer insertion and retraction control

[0051] As discussed above, one challenge with navigating endoluminal devices (eg, bronchoscopy) is navigating through the airways to reach difficult to reach areas (eg, upper lobes of the lung). Figure 1 An example of a luminal network 100 of a patient is schematically shown. In the illustrated embodiment, the luminal network 100 is a bronchial network of airways (i.e., lumens, branches) of a patient's lungs. Although the endoluminal network 100 shown is a bronchial network of airways within a patient's lungs, the present disclosure is not limited to the illustrated example. The systems and methods described herein can be used to navigate any type of endoluminal network, such as a bronchial network, a renal network, a cardiovascular network (e.g., arteries and veins), a gastrointestinal tract, a urinary tract, as described elsewhere herein.

[0052] Accessing the periphery of the right upper lobe 101 of the lung through the apical segment (Ap) has always been a challenge for conventional bronchoscopes. Figure 1In the example 110 shown, the 180 degree sharp angle between the trachea and the Ap, combined with the large space at the junction of the bronchus intermedius, the right main bronchus, and the right upper lobe bronchus, can cause the bronchoscope to kink and / or prolapse downward through the bronchus intermedius. When the segments of the elongated device bend as it moves through one or more passages, the bent segments are compressed. The compression causes the elongated device to bend along its length and contact the walls of one or more passages. In areas where there are one or more large passages around the elongated device, when the distal end of the device encounters tissue resistance, the elongated device may bend within the large airway and move toward an unintended anatomical area instead of moving in the intended direction ("prolapse"). When tissue resistance becomes high, prolapse is more likely (e.g., due to an airway that is too small, an incompletely inflated lung, tissue lesions, blind insertion, etc.). Example 110 shows that the deflection / kinking of the scope shaft can even deflect into the contralateral bronchus (e.g., when the tip cannot move forward, but the operator continues to try to drive the scope further).

[0053] Figure 2 An example of prolapse 210 and buckling 220 during insertion of a flexible device is shown. As the flexible endoscope is advanced at the proximal end, the flexible endoscope can deform 210 as it passes through turns and buckles 220 during insertion of the flexible device into the anatomy. Deformation can occur during insertion because the flexible device can assume a minimum energy shape, which can be a shaft "snapping" against tissue. Buckling can occur when the distal portion of the shaft encounters resistance.

[0054] During retraction of a flexible device, the distance “lost to buckling” of the axis can become slack when the system actuation direction is reversed. This phenomenon will result in a perceptible dead zone or system delay. For example, a user input commanding the robotic endoscope tip to move will not map directly to the robotic endoscope tip motion. Figure 3 An example of a dead zone for controlling endoscope retraction is shown. When the endoscope is flexed, retraction of the endoscope can result in robotic actuation with little translational movement of the endoscope tip.

[0055] Prolapse or kinking can cause potential damage because it can expose the sharp edges of the kinked elongated device and complicate the surgical procedure. In addition, a bent or kinked elongated device can cause the system to lose control of the position / shape of the device during insertion and retraction, and can block the passage of instruments. In addition, a prolapsed or kinked device may not provide sufficient ability to reach the target anatomical structure to perform the intended task. Current methods for solving the kink / prolapse problem can include detecting prolapse, using shape sensing, force sensing, medical imaging of device shape and position (comparing the detected position with the expected position) to detect when prolapse may occur. However, this approach requires additional imaging or sensing methods to determine shape and deformation, which may not provide real-time control of the movement of the endoscope tip, and may further complicate the device or increase cost.

[0056] In one aspect of the present disclosure, methods and systems for responsive insertion and retraction speed control of a flexible endoscope are provided. The speed control methods herein can automatically correct for motion differences between the endoscope tip and speed commands (e.g., instrument drive mechanism (IDM) commands). The methods for controlling tip motion of a flexible endoscope can have an integrated safety check for detecting buckling / deformation.

[0057] Unlike conventional methods of buckling detection based on differences in endoscopic device position (e.g., expected position and measured tip position), the methods and systems herein can automatically correct for buckling / deformation during insertion and retraction based on velocity and velocity control commands measured at the endoscope tip. This advantageously avoids shape sensing or the use of additional imaging methods to determine the shape or position of the endoscopic device. Furthermore, velocity-based insertion and retraction control allows for more responsive automatic correction of buckling with minimal delay.

[0058] Figure 4 An exemplary algorithm 400 for controlling the speed of an endoscope tip with integrated safety check according to some embodiments of the present invention is shown. During insertion of the endoscopic device 401, the endoscopic device may receive a speed command. The speed command may be provided by user input 403. For example, a user may provide a control instruction via a control interface of the endoscopic device indicating a desired / expected speed of the endoscope tip.

[0059] The control interface of the endoscopic device may be part of a user interface module for an operator or user to interact with an endoscope (eg, a bronchoscope) during a surgical procedure. Figure 8An example of a user interface module 933 is shown. The user interface module may be a handheld controller. In some cases, the user interface module may include a proprietary user input device and one or more additional elements that are detachably coupled to an existing user device to improve the user input experience. For example, a physical trackball or scroll wheel may replace or supplement the functionality of at least one of the virtual graphical elements (e.g., navigation arrows displayed on a touchpad) displayed on a graphical user interface (GUI) by giving it functionality similar to that of the replaced graphical element. Examples of user devices may include, but are not limited to, mobile devices, smart phones / cellular phones, tablet computers, personal digital assistants (PDAs), laptop computers or notebook computers, desktop computers, media content players, and the like.

[0060] The user interface may include various devices, such as a touch screen display, a joystick, a keyboard, and other interactive devices. The user may use the user input device to navigate and / or control the motion of the robotic arm 911 and the motion of the catheter 920 (e.g., tip speed). The user input device may have any type of user interaction component, such as a button, a mouse, a joystick, a trackball, a touchpad, a stylus, an image capture device, a motion capture device, a microphone, a touch screen, a handheld wrist gimbal, an exoskeleton glove, or other user interaction system, such as a virtual reality system, an augmented reality system, etc.

[0061] User input for commanding the velocity of the endoscope tip may be received via an input device. For example, pressing a joystick may be mapped to an analog value indicating the velocity / speed of the tip. For example, half-pressing the joystick may be mapped to 3 mm / sec, fully pressing may be mapped to 6 mm / sec, and not pressing may be mapped to 0 mm / sec. The input velocity may be any value (e.g., a continuous number) when the joystick is in various positions.

[0062] Speed ​​input can be provided via any suitable user input device. In some cases, the user input device can be a tactile stylus device in physical contact with a touch display screen, and the user can control the robot system by moving the tactile stylus device on the display screen. For example, one or more physical user input devices or additional elements (e.g., trackballs, joysticks, or rollers) can be coupled to a graphical user interface (GUI) provided on a user device via tactile sensing or Bluetooth. For example, a trackball, joystick, or roller can replace or supplement at least one of the virtual graphical elements (e.g., navigation arrows, speed) displayed on a graphical user interface (GUI) by giving it a function similar to the replaced graphical element. Additional elements can be coupled to the GUI via physical contact in a touch screen, via IO ports, wired or wireless communications, so that the user input received via additional elements can be mapped to the input received by the virtual graphical elements presented on the GUI. Examples of user devices may include, but are not limited to, mobile devices, smart phones / cellular phones, tablet computers, personal digital assistants (PDAs), laptop or notebook computers, desktop computers, media content players, etc.

[0063] Return to reference Figure 4 , based on the particular user input device, the user input may be processed to convert it into a desired / commanded velocity 405 for the tip of the catheter / endoscope. Next, a tip velocity error is calculated 407. The tip velocity error is the difference between the desired / commanded tip velocity and the velocity of the endoscope tip. In some embodiments, the velocity of the endoscope tip may be measured based on sensor data. In some cases, the sensor data may include position and orientation information of the distal tip of the endoscope.

[0064] In some cases, the sensor signal can be acquired by a positioning sensor. For example, the sensor signal can be acquired by an electromagnetic coil located at the distal end, which is used with an electromagnetic tracking system to detect the position and orientation of the distal end of the endoscope 417. For example, a positioning sensor (e.g., an electromagnetic (EM) sensor) can be embedded in the distal tip of a catheter, and an EM field generator can be placed next to the patient's torso during the procedure. The EM field generator can locate the EM sensor position in 3D space, or can locate the EM sensor position and orientation in 5D or 6D space. The endoscope tip position p measured by the EM sensor e =EM sensor (tip) position, which can be represented in the field generator frame.

[0065] Next, the linear velocity of the endoscope tip can be calculated based on the measured position data 419. The linear velocity can be calculated using a time derivative method (e.g., backward Euler derivative). In some cases, the endoscope tip velocity can be calculated as a filtered time derivative of the tip position projected on the forward direction 423 (e.g., measured by an EM sensor represented in the field generator frame). This projection may be required because the velocity command provided by the user is based on the integrated position change occurring in the direction of n. The EM sensor data may be obtained at a specific frequency (e.g., 10-60 Hz). In some cases, a low pass filter may be applied to generate filtered time derivative data 421.

[0066] The endoscope tip velocity can be calculated using the projection matrix v n =nn T filt(dp e = The filtered time derivative of the tip position projected in the advancing direction of n (e.g., as measured by the EM sensor, expressed in the field generator frame), where n is a unit vector indicating the advancing direction of the endoscope tip, expressed in the field generator frame. There may be a mechanical offset between the EM sensor and the endoscope tip, and the mechanical offset may be calibrated for each endoscopic device. dp e / dt represents the time derivative of the endoscope tip, nn T is the projection matrix that maps the above velocities to the direction of travel of the endoscope tip (i.e., ignoring velocities that are not in the direction of travel). n It is not affected by the joint because the endoscope tip translates due to the joint being orthogonal to n.

[0067] After calculating the endoscope tip velocity, an endoscope tip velocity error 407 can be calculated and can be further processed for safety checks 409. In some cases, the safety checks 409 can include multiple checks. For example, the multiple checks can include determining whether the endoscope tip is stationary (e.g., the tip velocity is approximately zero) while the insertion distance of the handle portion (e.g., IDM) of the endoscope exceeds a distance threshold. In another example, the multiple checks can include determining whether the endoscope tip is retracted (e.g., a negative tip velocity error) when the handle portion (e.g., IDM) of the endoscope is inserted, and if so, prolapse may have occurred. In another example, the multiple checks can include determining whether the insertion force exceeds a force threshold. The term "insertion distance" as used herein can refer to a distance along a navigation path.

[0068] The method 400 may include closed loop control of the tip speed to reduce the tip speed error 411. The tip speed of the endoscope may be controlled based on the tip speed error calculated at operation 407, which is used as a feedback signal. Figure 8The closed-loop control of the tip speed by commanding the movement of the IDM is schematically shown. The user speed input can be mapped to a command to control the movement of the IDM (e.g., the speed of moving the IDM along the insertion axis). The command can be a control signal to control the motor of the manipulator, thereby controlling the movement of the IDM (i.e., the proximal end of the endoscope). The endoscope tip speed can be calculated based on the inverse kinematics of the manipulator. The endoscope tip speed is then used to calculate the tip speed in the forward direction by projecting in the forward direction of n using the projection matrix as described above. In some cases, the feedback signal can be a projection of the tip speed processed by a low-pass filter to filter out noise data.

[0069] return Figure 4 , based on the control algorithm, motion commands are generated to activate the robotic arm 413, thereby affecting the tip velocity of the endoscope 415. Due to the tortuosity, buckling, and / or prolapse of the navigation path (as described above), the effects on the motion of the IDM (e.g., insertion speed, insertion distance) and the effects on the motion of the endoscope tip (e.g., tip velocity) may not be perfectly matched.

[0070] In some embodiments, multiple security checks may be combined, ordered, and selected according to an alert algorithm to trigger an alert or suspend operation. Figure 5 An exemplary warning algorithm 500 is shown. The warning algorithm may trigger an action such as a warning or suspending operation based on one or more of a plurality of safety checks. In the illustrated method, a warning may be triggered based on a comparison between an endoscope tip insertion distance and an IDM insertion distance.

[0071] The process can begin by acquiring EM sensor data (e.g., EM position and orientation signals) 501. The endoscope tip insertion distance can be calculated based on the acquired EM sensor data (e.g., EM position and orientation signals) 503. For example, the endoscope tip insertion distance can be calculated based on sensor orientation information, which is used to distinguish lateral movement and joint movement and movement caused by robotic insertion. Robotic joint position data 511 can also be acquired. As described later in this document, the endoscopic device can be attached to the robotic arm via an IDM. Forward kinematics 513 can be used to calculate the position and orientation of the IDM based on the joint position data. The IDM insertion distance is calculated at a series of time points 515 and compared to the tip insertion distance 505.

[0072] Figure 6 The IDM insertion distance X at time t 601 is shown. IDM (t) and the IDM insertion distance X at time t+1 IDM Example of (t+1). The tip insertion distance is also calculated as Xtip. IDM insertion distance X IDMThe difference between the tip insertion distance can be the deformation loss. The deformation loss can be caused by buckling, prolapse, kinking of the flexible catheter and / or the tortuosity of the navigation path. For example, a tortuous path can result in a greater deformation loss than navigating through a straight path.

[0073] Return to reference Figure 5 The difference / discrepancy may be compared to a threshold to determine the presence of buckling. The threshold may be dynamic based on one or more factors, such as the anatomical region and / or the tortuosity of the navigation path.

[0074] In some cases, the dynamic threshold can be referred to as a dynamic tracking error threshold (DTET), which can trigger a warning and / or system safety operation when the tracking error (TE) exceeds the DTET. The tracking error can be a deformation loss as described above. As described above, the DTET can be dynamic based at least in part on the anatomical region through which the flexible catheter passes. In some cases, the DTET can be a function of the navigation path, the insertion distance, or the tortuosity of the path. The tortuosity of the path can be calculated, for example, as the ratio of the length of a segment of the path to the distance between its two ends.

[0075] Figure 7 Examples of dynamic tracking error thresholds (DTET) as a function of insertion distance are shown. Example A shows the DTET for a path with less tortuosity, so the total value of DTET is a function of insertion distance, with a maximum value below 4 cm. The tracking error (TE) has been compared to the DTET at various insertion distances, and a warning can be triggered when the TE exceeds the DTET for a given insertion distance, for example, TE1. Example B shows the DTET for a path with more tortuosity, so the total value of DTET is a function of insertion distance, with the value being greater than 4 cm at a specific insertion distance (or specific anatomical region).

[0076] During retraction of the medical device, the previously determined deformation losses during insertion can be used as a feed-forward term to inversely compensate the retraction control. This reduces the deformation losses that occurred during insertion prior to the tip movement during retraction.

[0077] The dynamic tracking error threshold may be determined using any suitable method, such as based on historical data, computed tomography (CT) scans of the anatomy, a 3D model of the navigation path, etc. For example, the tortuosity of the path may be calculated for various anatomical regions, segments, and insertion lengths along the path, and the DTET may vary based on the anatomical region.

[0078] In some cases, in addition to anatomical regions, DTET can also consider the effects of applying insertion forces within a safety range or acceptable range of deformation. The safety range describes the range within which buckling will not damage contacting tissue or organs in the patient's body. This safety range can be determined based on historical endoscopic data and patient data about previous similar operations. Any suitable method can be used to determine this safety range. For example, a machine learning algorithm can be used to train a model to determine the safety range. Historical endoscopic data and patient data can be used to create a training data set for training the model. As new sensor data is collected, the model can be continuously updated and improved.

[0079] Return to reference Figure 5 , a dynamic tracking error threshold may be used to determine if the difference triggers a tip tracking warning 507. Next, the process may continue to determine if the tip moves backward as the IDM moves forward, i.e., inserts 509. If so, prolapse may be present and a prolapse warning 510 may be triggered.

[0080] The warning algorithm 500 is for illustrative purposes only. It should be noted that fewer or more safety checks may be performed. For example, in addition to prolapse and flexion detection, the algorithm may also include checking whether the insertion force exceeds a threshold. The insertion force may be detected by one or more force sensors coupled to the robotic arm of the surgical robot system. When the insertion force approaches an insertion force threshold or approaches an insertion force threshold within a predefined range, the surgical robot system sends visual, audio, and / or tactile feedback to the user via the system GUI. For example, a warning indicating that the insertion force is approaching an insertion force threshold or is close to an insertion force threshold may be displayed on the GUI or a suitable UI function may be used to transmit to the user.

[0081] In some embodiments, instead of or in addition to detecting speed differences, the methods herein can also track the difference / difference between the IDM insertion motion and the measured tip motion within a time window. For example, the motion of the endoscope tip and the motion of the IDM can be added within the time window to determine the difference. Fig.17 An example of calculating motion differences or motion mismatches within a predetermined time window is shown. For example, the distance traveled in each time step in the forward direction (e.g., T 0 and T 1 d1, T 1 and T 2 The d2 between d and d, etc.) are added for seven seconds and used as the total travel distance of the endoscope tip and the IDM in the time window, respectively. The movement of the endoscope tip can be measured by the EM sensor described elsewhere in this article. The EM sensor data can be obtained at a specific frequency (e.g., 10-60 Hz).

[0082] The motion mismatch tracked within the time window can be compared to a threshold to determine the presence of a buckling event. In some cases, the time window is a window of four seconds, five seconds, six seconds, seven seconds, eight seconds, a number below five seconds, a number above eight seconds, or any number between integers. The length of the time window (e.g., seven seconds) can be selected so that the motion mismatch tracked within the time window is not overly sensitive while allowing real-time detection of buckling events. In some cases, the size of the time window can be determined based on empirical data. In some cases, the length of the time window (window size) can be adjusted based on the use application (e.g., body region), the desired sensitivity level, etc. The length of the time window can remain unchanged throughout the process. Alternatively, the length of the time window can vary as the endoscope navigates to different regions in the body.

[0083] In some cases, when the endoscope is inserted using a controller command, only the forward motion of the IDM and the endoscope tip can be tracked. In some cases, if the user-commanded endoscope retraction exceeds a retraction threshold, the tracking of the motion mismatch between the IDM and the endoscope tip can be reset to zero.

[0084] As described above, the threshold force and / or threshold endoscope tip movement can be based on the tortuosity of the path or anatomical region. Fig.19 An example of a threshold that varies based on the anatomical region is shown. In some cases, the dynamic tracking error threshold, motion mismatch threshold, and / or force threshold can be determined based on the tortuosity of the path. The amount of force applied by the endoscope tip to the anatomical structure can be determined at least in part based on the force applied by the IDM in the insertion direction and the friction between the endoscope and the path to the tip. Higher tortuosity can result in greater friction and therefore less force applied by the endoscope tip to the anatomical structure, and the amount of force sensed at the IDM is fixed. Fig.19 An example of different thresholds selected depending on which part of the lung the endoscope is driven into is shown. For example, because the upper right region has high tortuosity, a higher force threshold and a higher dynamic tracking error threshold / motion mismatch threshold may be selected; because the upper left region has moderate tortuosity, a moderate force threshold and a moderate dynamic tracking error threshold may be selected; because the lower lobe region has low tortuosity, a lower force threshold and a lower dynamic tracking error threshold may be selected. In some cases, the threshold is a function of the tortuosity of the path, and the function may be determined based at least in part on an anatomical model of the subject.

[0085] Detection using thresholds (e.g., force thresholds and dynamic tracking error thresholds) can be challenging because the amount of motion mismatch and the end effector force reaching the aorta can be variables that are affected by the initial settings. Fig.16As shown, the amount of motion mismatch and end effector force to reach the main carina point 1600 can depend on variables in the setup, such as friction within the endotracheal tube, the mechanical interface with the bronchial adapter, the angle of the robotic arm after retraction, the endoscope stiffness curve, and / or different amounts of lubricant applied to the endoscope. The algorithms and methods herein can beneficially avoid noise or uncertainty introduced by initial setup conditions by setting the force and / or motion mismatch values ​​to zero as the endoscope tip moves along the endotracheal tube 1601 to the main carina 1600. It should be noted that the zero position can be selected to be other suitable positions, such as a position within a certain distance from the main carina or a position that depends on the anatomical structure.

[0086] In some cases, the main carina position 1600 can be pre-selected as the zero position. For example, when the endoscope is inserted into the trachea and reaches the main carina point 1600, the system can initiate tracking of motion mismatch, starting from zero and comparing it to the motion mismatch (or dynamic tracking error threshold) as described elsewhere herein. Similarly, when the tip of the endoscope reaches the main carina position 1600, the force can also be set to zero, and the system can begin tracking the force and comparing it to the force threshold to detect a safety event.

[0087] In some cases, upon determining that the endoscope tip is at the main carina 1600, the system may automatically set the force and / or motion mismatch between the IDM and the endoscope tip motion to zero. The systems and methods herein may use various suitable methods to detect the zero position at the main carina. In some cases, the system may utilize navigation data (e.g., EM sensor data) to determine whether the endoscope tip has reached the main carina. For example, by tracking EM sensor data of the tip position within a CT scan model of the patient's lungs, the system may automatically detect whether the endoscope tip has reached the main carina. In some cases, the system may employ an image recognition algorithm to detect the exit of the endoscope tip from the endotracheal tube 1601 into the trachea. For example, the method may process a camera image (e.g., Fig. 20 or Fig.21 ) to identify the bifurcation at the main carina. Based on the detection of the bifurcation, it can be determined that the endoscope tip is at the main carina 1600. Various other methods can also be used to automatically detect the zero position. For example, after the IDM is aligned with the bronchial adapter and automatically retracted to the starting position, it can be determined based on human factors that the endoscope tip is at the main carina position 1600 at a fixed insertion distance. The above methods for detecting the zero position can be used alone or in any combination.

[0088] Fig.18An exemplary algorithm 1800 for controlling the motion of an endoscope tip is shown. The algorithm 1800 can begin by detecting a zero position (e.g., the main carina 1801). The zero position can be detected using navigation data (e.g., EM sensor data), image recognition methods, and / or other methods as described above. After the zero position is detected, the force and / or motion mismatch of the endoscope tip can be set to zero 1803. The algorithm can also identify which lobe of the lung the endoscope is driven toward. Based on the target area, a force threshold and a motion threshold (or DTET) 1805 can be determined. In some cases, the algorithm can begin tracking the motion mismatch within a sliding window (e.g., a window size of seven seconds) and constantly compare it to the motion mismatch threshold. For example, the sliding window can have a window size of seven seconds, and the sliding size can be one second so that a comparison can be made every second. In some cases, the sliding size can be adjusted to one second, two seconds, three seconds, etc. to adjust the detection frequency.

[0089] When a motion mismatch greater than a motion mismatch threshold is detected, a warning message can be displayed on the GUI notifying the user that a kink or buckling event may occur. The user may choose to follow the advice in the message or continue driving the endoscope. In some cases, when a force greater than a force threshold is detected, a warning message can be displayed on the GUI and the robotic arm can stop moving. In some cases, the warning message can provide the user with instructions 1807 to remove the endoscope and restore the system (e.g., the system can automatically retract the IDM). In some cases, when it is detected that the endoscope is driven toward a different anatomical region (e.g., a leaf) 1809, the algorithm can repeat the operation 1803 of setting the motion mismatch and force to zero and repeat the process. In the example shown, during IDM / endoscope retraction, the algorithm can track the IDM retraction distance and use the IDM retraction distance as the endoscope tip retraction distance.

[0090] Detected buckling, prolapse, and large insertion force can trigger a warning message and / or a control signal to the system. The warning or feedback message can be delivered to the user in various forms. In some cases, the warning or feedback message can indicate the type of problem, such as buckling, prolapse, or unsafe insertion force. For example, a message or warning can be provided for display on a graphical user interface (GUI) presented on a display used by the operator to control the operation. In some cases, the system can also generate suggestions for the user to take action in response to the detected buckling event. For example, the system can generate suggestions for the user to move the endoscope backward, adjust the movement of the tip, reduce / adjust the insertion force provided by the IDM, etc. Fig. 20 An example of a GUI displaying a warning message is shown. When endoscope buckling is detected, a notification or warning message may be displayed. In the example shown, the message may also include a suggestion, such as retracting the endoscope or taking a fluoroscopic image. Fig.21An example of a warning message triggered when a high insertion force is detected is shown. In this example, a warning message can be displayed on the GUI when an insertion force exceeding a force threshold is detected. The warning message can include information that the robot motion has stopped and a suggestion to the user, such as "Remove the endoscope and press Resume." In some cases, when the user clicks the "Resume" button, the system can automatically retract the IDM.

[0091] In some cases, control signals can be generated to modify the operation of the system, the robotic arm, the IDM, and / or the endoscope. For example, control signals can be automatically generated based on the detection of buckling, prolapse, or large insertion forces to adjust the motion of the endoscope, stop the movement of the endoscope, etc. For example, the control signal can automatically command the actuator of the IDM and / or the robotic arm to move the tip of the endoscope to reduce buckling or insertion force. The speed, movement, and trajectory path of the moving endoscope tip can be automatically determined using an algorithm based on sensor data (e.g., EM sensor data).

[0092] Flexible endoscope systems and equipment

[0093] In some embodiments, the endoscope tip speed control method and system herein can be used to improve the reliability and stability of a flexible endoscope. The provided endoscope tip speed control mechanism can be used by any device or apparatus. In one aspect of the invention, a flexible endoscope with improved performance (e.g., improved reliability) is provided.

[0094] Fig. 9 Examples of robotic endoscope (e.g., bronchoscope) systems 900, 930 are shown according to some embodiments of the present invention. Fig. 9As shown, a robotic endoscope (e.g., bronchoscope) system 900 may include a steerable catheter assembly 920 and a robotic support system 910 for supporting or carrying the steerable catheter assembly. The steerable catheter assembly may be a bronchoscope. The steerable catheter assembly may be the same as the above-mentioned endoscopic device. In some embodiments, the steerable catheter assembly may be a disposable robotic bronchoscope. In some embodiments, the robotic endoscope (e.g., bronchoscope) system 900 may include an instrument drive mechanism (IDM) 913, which is attached to the arm of the robotic support system. The instrument drive mechanism may be provided by any suitable controller device (e.g., a handheld controller), which may or may not include a robotic system. The instrument drive mechanism may provide a mechanical and electrical interface for the steerable catheter assembly 920. The mechanical interface may allow the steerable catheter assembly 920 to be releasably coupled to the instrument drive mechanism. For example, the handle portion of the steerable catheter assembly may be attached to the instrument drive mechanism via a quick installation / release device (e.g., a magnet, a spring-loaded level, etc.). In some cases, the steerable catheter assembly may be manually coupled to or released from the instrument drive mechanism without the use of tools.

[0095] The manipulable catheter assembly 920 may include a handle portion 923, which may include components configured to process image data, provide power, or establish communication with other external devices. For example, the handle portion 923 may include circuits and communication elements that enable electrical communication between the manipulable catheter assembly 920 and the instrument drive mechanism 913 and any other external system or device. In another example, the handle portion 223 may include circuit elements, such as a power supply for powering the electronic equipment (e.g., camera and LED light) of the endoscope. In some cases, the handle portion may be electrically communicated with the instrument drive mechanism 913 via an electrical interface (e.g., a printed circuit board) so that image / video data and / or sensor data can be received by the communication module of the instrument drive mechanism and can be transmitted to other external devices / systems. As an alternative or in addition, the instrument drive mechanism 913 may only provide a mechanical interface. The handle portion may be electrically communicated with a modular wireless communication device or any other user device (e.g., a portable / handheld device or a controller) to transmit sensor data and / or receive control signals.

[0096] Manipulable catheter assembly 920 can include flexible elongated member 911, which is coupled to the handle portion. In some embodiments, the flexible elongated member can include an axis, a manipulable tip and a manipulable portion. Manipulable catheter assembly can be a disposable robot bronchoscope. In some cases, only the elongated member can be disposable. In some cases, at least a portion of the elongated member (e.g., an axis, a manipulable tip, etc.) can be disposable. In some cases, the entire manipulable catheter assembly 920 including the handle portion and the elongated member can be disposable. The flexible elongated member and the handle portion are designed so that the entire controllable catheter assembly can be arranged at a low cost.

[0097] In some embodiments, the provided bronchoscope system may further include a user interface. As shown in the example system 930, the bronchoscope system may include a treatment interface module 931 (user console side) and / or a treatment control module 933 (patient and robot side). The treatment interface module may allow an operator or user to interact with the bronchoscope during the surgical procedure. In some embodiments, the treatment control module 933 may be a handheld controller. The treatment control module 933 may allow the user to control the speed of the bronchoscope tip, as described elsewhere herein. In some cases, the treatment control module may include a proprietary user input device and one or more additional elements that are detachably coupled to an existing user device to improve the user input experience. For example, a physical trackball or scroll wheel may replace or supplement the functionality of at least one of the virtual graphical elements (e.g., navigation arrows displayed on a touchpad) displayed on a graphical user interface (GUI) by giving it a function similar to the replaced graphical element. Examples of user devices may include, but are not limited to, mobile devices, smart phones / cellular phones, tablet computers, personal digital assistants (PDAs), laptop computers or notebook computers, desktop computers, media content players, and the like. Details about the user interface device and the user console will be described later in this article.

[0098] Fig.10 An example of a flexible endoscope 1000 according to some embodiments of the present disclosure is shown. Fig.10As shown, the flexible endoscope 1000 may include a handle / proximal portion 1009 and a flexible elongated member to be inserted into the interior of the object. The flexible elongated member may be the same as the flexible elongated member described above. In some embodiments, the flexible elongated member may include a proximal shaft (e.g., an insertion shaft 1001), a manipulable tip (e.g., a tip 1005), and a manipulable segment (active bending segment 1003). The active bending segment and the proximal shaft segment may be the same as the active bending segment, the anti-prolapse passive segment, and the proximal shaft segment described elsewhere herein. The endoscope 100 may also be referred to as a manipulable catheter assembly, as described elsewhere herein. In some cases, the endoscope 100 may be a single-use robotic endoscope. In some cases, the entire catheter assembly may be disposable. In some cases, at least a portion of the catheter assembly may be disposable. In some cases, the entire endoscope may be released from the instrument drive mechanism and may be discarded. In some embodiments, the endoscope may include different levels of stiffness along the axis to improve functional operation.

[0099] The endoscope or steerable catheter assembly 1000 may include a handle portion 1009 that may include one or more components configured to process image data, provide power, or establish communications with other external devices. For example, the handle portion may include circuitry and communication elements that enable electrical communication between the steerable catheter assembly 1000 and an instrument drive mechanism (not shown) and any other external systems or devices. In another example, the handle portion 1009 may include circuit elements, such as a power source for powering the electronics of the endoscope (e.g., a camera, an electromagnetic sensor, and an LED light).

[0100] One or more components located at the handle can be optimized so that expensive and complex components can be assigned to a robot support system, a handheld controller, or an instrument drive mechanism, thereby reducing costs and simplifying the design of a disposable endoscope. The handle portion or the proximal portion can provide an electrical and mechanical interface to allow electrical and mechanical communication with the instrument drive mechanism. The instrument drive mechanism can include a group of motors that are actuated to drive a group of pull wires of a catheter rotationally. The handle portion of the catheter assembly can be assembled to the instrument drive mechanism so that its pulley / capstan assembly is driven by the group of motors. The number of pulleys can vary based on the pull wire configuration. In some cases, one, two, three, four or more pull wires can be used to articulate a flexible endoscope or catheter.

[0101] The handle portion can be designed to allow the robotic bronchoscope to be disposable at a reduced cost. For example, a classic manual bronchoscope and a robotic bronchoscope can have a cable at the proximal end of the bronchoscope handle. The cable typically includes an illumination fiber, a camera video cable, and other sensor fibers or cables (such as an electromagnetic (EM) sensor or a shape sensing fiber). Such complex cables can be expensive, increasing the cost of the bronchoscope. The provided robotic bronchoscope can have an optimized design so that a simplified structure and components can be employed while retaining mechanical and electrical functionality. In some cases, the handle portion of the robotic bronchoscope can be designed without a cable while providing a mechanical / electrical interface for the catheter.

[0102] An electrical interface (e.g., a printed circuit board) can allow image / video data and / or sensor data to be received by a communication module of an instrument drive mechanism and can be transmitted to other external devices / systems. In some cases, the electrical interface can establish electrical communication without cables or wires. For example, the interface can include pins soldered to an electronic board such as a printed circuit board (PCB). For example, a socket connector (e.g., a female connector) is provided on the instrument drive mechanism as a mating interface. This can beneficially allow the endoscope to be quickly inserted into an instrument drive mechanism or a robot support without the use of additional cables. This type of electrical interface can also be used as a mechanical interface so that when the handle portion is inserted into the instrument drive mechanism, both mechanical coupling and electrical coupling are established. As an alternative or in addition, the instrument drive mechanism can only provide a mechanical interface. The handle portion can be electrically communicated with a modular wireless communication device or any other user device (e.g., a portable / handheld device or a controller) for transmitting sensor data and / or receiving control signals.

[0103] In some cases, the handle portion 1009 may include one or more mechanical control modules, such as a Luer interface 1011, for connecting an irrigation system / suction system. In some cases, the handle portion may include a lever / knob for articulation control. Alternatively, the articulation control may be located at a separate controller attached to the handle portion via the instrument drive mechanism.

[0104] The endoscope can be attached to a robotic support system or a handheld controller via an instrument drive mechanism. The instrument drive mechanism can be provided by any suitable controller device (e.g., a handheld controller), which may or may not include a robotic system. The instrument drive mechanism can provide a mechanical and electrical interface to the steerable catheter assembly 1000. The mechanical interface can allow the steerable catheter assembly 1000 to be releasably coupled to the instrument drive mechanism. For example, the handle portion of the steerable catheter assembly can be attached to the instrument drive mechanism via a quick installation / release tool (such as a magnet, a spring-loaded level, etc.). In some cases, the steerable catheter assembly can be manually coupled to the instrument drive mechanism or released from the instrument drive mechanism without the use of a tool.

[0105] In the illustrated example, the distal tip of the catheter or endoscope shaft is configured to articulate / bend in two or more degrees of freedom to provide a desired camera field of view or control the direction of the endoscope. As illustrated in this example, an imaging device (e.g., a camera), a position sensor (e.g., an electromagnetic sensor) 1007 is located at the tip of the catheter or endoscope shaft 1005. For example, the line of sight of the camera can be controlled by controlling the articulation of the active bending segment 1003. In some cases, the angle of the camera can be adjustable so that the line of sight can be adjusted without articulating the distal tip of the catheter or endoscope shaft or in addition to articulating the distal tip of the catheter or endoscope shaft. For example, the camera can be oriented at a certain angle (e.g., tilted) relative to the axial direction of the endoscope tip by means of an optical assembly.

[0106] The distal tip 1005 can be a rigid component that allows sensors (such as electromagnetic (EM) sensors), imaging devices (e.g., cameras), and other electronic components (e.g., LED light sources) to be positioned embedded at the distal tip.

[0107] In real-time EM tracking, an EM sensor consisting of one or more sensor coils in one or more locations and orientations embedded in a medical device (e.g., the tip of an endoscopic tool) measures changes in the EM field generated by one or more static EM field generators positioned at locations close to the patient. The position information detected by the EM sensor is stored as EM data. An EM field generator (or transmitter) can be placed close to the patient to generate a low-intensity magnetic field that can be detected by the embedded sensor. The magnetic field induces a small current in the sensor coil of the EM sensor, which can be analyzed to determine the distance and angle between the EM sensor and the EM field generator. For example, an EM field generator can be positioned close to the patient's torso during surgery to locate the EM sensor position in 3D space or can locate the EM sensor position and orientation in 5D or 6D space. This can provide visual guidance to the operator when driving the bronchoscope toward the target site.

[0108] The endoscope can have a unique design in the elongated members. In some cases, the active bending section 1003 and the proximal shaft of the endoscope can be composed of a single tube that includes a series of cutouts (e.g., notches, slits, etc.) along its length to allow for improved flexibility, desired stiffness, and anti-prolapse features (e.g., features for defining a minimum bend radius).

[0109] As described above, the active bending segment 1003 can be designed to allow bending (e.g., articulation) in two or more degrees of freedom. Greater degrees of bending, such as 180 degrees and 270 degrees (or other articulation parameters for clinical indications) can be achieved through the unique structure of the active bending segment. In some cases, a variable minimum bending radius along the axial axis of the slender member can be provided, so that the active bending segment or the passive segment can include two or more different minimum bending radii.

[0110] The articulation of the endoscope can be controlled by applying force to the distal end of the endoscope via one or more pull wires. One or more pull wires can be attached to the distal end of the endoscope. In the case of multiple pull wires, pulling one wire at a time can change the orientation of the distal tip to tilt it upward, downward, left, right, or in any desired direction. In some cases, the pull wire can be anchored at the distal tip of the endoscope, travel through the curved segment, and enter the handle where the pull wire is coupled to a drive assembly (e.g., a pulley). The handle pulley can interact with an output shaft from a robotic system.

[0111] In some embodiments, the proximal end or proximal portion of one or more pull wires can be operably coupled to various mechanisms (e.g., gears, pulleys, capstans, etc.) in the handle portion of the catheter assembly. The pull wire can be a metal wire, cable or filament, or it can be a polymer wire, cable or filament. The pull wire can also be made of natural or organic materials or fibers. The pull wire can be any type of suitable wire, cable or filament that can support various loads without deformation, significant deformation or breakage. The distal end / distal portion of one or more pull wires can be anchored or integrated into the distal portion of the catheter so that the control unit's operation of the pull wire can apply a force or tension to the distal portion, which can manipulate or articulate (e.g., upward, downward, pitch, yaw or any direction therebetween) at least the distal portion (e.g., flexible segment) of the catheter.

[0112] The pull wire can be made of any suitable material, such as stainless steel (e.g., SS316), a metal, an alloy, a polymer, nylon, or a biocompatible material. The pull wire can be a wire, a cable, or a filament. In some embodiments, different pull wires can be made of different materials to change the load-bearing capacity of the pull wire. In some embodiments, different segments of the pull wire can be made of different materials to change the stiffness and / or load-bearing capacity along the pull wire. In some embodiments, the pull wire can be used for the transmission of electrical signals.

[0113] The proximal design can improve the reliability of the device without introducing additional costs, thereby allowing a low-cost single-use endoscope. In another aspect of the present invention, a single-use robotic endoscope is provided. The robotic endoscope can be a bronchoscope and can be the same as the steerable catheter assembly described elsewhere herein. Conventional endoscopes can be complex in design and are typically designed to be reused after surgery, which requires thorough cleaning, disinfection, or sterilization after each surgery. Existing endoscopes are typically designed with complex structures to ensure that the endoscope can withstand the cleaning, disinfection, and sterilization processes. The provided robotic bronchoscope can be a single-use endoscope, which can beneficially reduce cross-contamination between patients and infected persons. In some cases, the robotic bronchoscope can be delivered to a medical practitioner in a pre-sterilized package and is intended to be discarded after a single use.

[0114] like Fig.11 As shown, the robotic bronchoscope 1120 may include a handle portion 1113 and a flexible elongated member 1111. In some embodiments, the flexible elongated member 1111 may include a shaft, a steerable tip, and a steerable / active bending section. The robotic bronchoscope 1120 may be used with Fig.10 The robotic bronchoscope may be a single-use robotic endoscope. In some cases, only the catheter may be disposable. In some cases, at least a portion of the catheter may be disposable. In some cases, the entire robotic bronchoscope may be released from the instrument drive mechanism and may be discarded. In some cases, the bronchoscope may include different levels of stiffness along its axis to improve functional operation. In some cases, the minimum bend radius along the axis may vary.

[0115] The robotic bronchoscope can be releasably coupled to an instrument drive mechanism 1120. The instrument drive mechanism 1120 can be mounted to an arm of a robotic support system, or can be mounted to any actuated support system as described elsewhere herein. The instrument drive mechanism can provide a mechanical and electrical interface to the robotic bronchoscope 1110. The mechanical interface can allow the robotic bronchoscope 1110 to be releasably coupled to the instrument drive mechanism. For example, a handle portion of the robotic bronchoscope can be attached to the instrument drive mechanism via a quick mount / release tool (such as a magnet and a spring-loaded level). In some cases, the robotic bronchoscope can be manually coupled to or released from the instrument drive mechanism without the use of tools.

[0116] Fig. 12A An example of an instrument drive mechanism (IDM) 1220 is shown, which provides a mechanical interface to a handle portion 1213 of a robotic bronchoscope. As shown in this example, the instrument drive mechanism 1220 can include a set of motors that are actuated to rotationally drive a set of pull wires of a flexible endoscope or catheter. The handle portion 1213 of the catheter assembly can be assembled to the instrument drive mechanism so that its pulley assembly or capstan is driven by the set of motors. The number of pulleys can vary based on the pull wire configuration. In some cases, one, two, three, four or more pull wires can be used to articulate a flexible endoscope or catheter.

[0117] The handle portion can be designed to allow the robotic bronchoscope to be disposable at a reduced cost. For example, a classic manual bronchoscope and a robotic bronchoscope can have a cable at the proximal end of the bronchoscope handle. The cable typically includes an illumination fiber, a camera video cable, and other sensor fibers or cables (such as an electromagnetic (EM) sensor or a shape sensing fiber). Such complex cables can be expensive, increasing the cost of the bronchoscope. The provided robotic bronchoscope can have an optimized design so that a simplified structure and components can be employed while retaining mechanical and electrical functionality. In some cases, the handle portion of the robotic bronchoscope can be designed without a cable while providing a mechanical / electrical interface for the catheter.

[0118] Fig. 12BAnother example of a disposable endoscope 1200 detachably coupled to an IDM 1201 is shown. One or more components located at the handle 1209 can be optimized so that expensive and complex components can be allocated to the robot support system 1203, the handheld controller, or the instrument drive mechanism 1201, thereby reducing costs and simplifying the design of the disposable endoscope. The handle portion or proximal portion 1209 can provide an electrical interface and a mechanical interface to allow electrical and mechanical communication with the instrument drive mechanism 1201. The instrument drive mechanism 1201 can include a set of motors that are actuated to drive a set of pull wires of the catheter in rotation. The handle portion 1209 of the catheter assembly can be mounted on the instrument drive mechanism 1201 so that its pulley / capstan assembly is driven by the group of motors. For example, the handle pulley can interact with the output shaft 1203 of the IDM supported by the robot system. The number of pulleys can vary based on the pull wire configuration. In some cases, one, two, three, four or more pull wires can be used to articulate a flexible endoscope or catheter.

[0119] Fig.13 An example of a distal tip 1300 of an endoscope is shown. In some cases, the distal portion or tip of the catheter 1300 can be substantially flexible so that it can be manipulated in one or more directions (e.g., pitch, yaw). The catheter can include a tip portion, a curved segment, and an insertion axis. In some embodiments, the catheter can have a variable bending stiffness along the longitudinal axis. For example, the catheter can include multiple segments with different bending stiffnesses (e.g., flexible, semi-rigid, and rigid). The bending stiffness can be changed by selecting materials with different stiffness / rigidity, changing the structure in different sections (e.g., incisions, patterns), adding additional support components, or any combination of the above. In some embodiments, the catheter can have a variable minimum bending radius along the longitudinal axis. Selecting different minimum bending radii at different locations along the catheter can be beneficial to provide anti-prolapse capabilities while still allowing the catheter to reach difficult-to-reach areas. In some cases, the proximal end of the catheter does not need to be highly curved, so the proximal portion of the catheter can be reinforced with additional mechanical structures (e.g., additional material layers) to achieve greater bending stiffness. This design can provide support and stability for the catheter. In some cases, variable bending stiffness can be achieved by using different materials during extrusion of the catheter. This can advantageously allow different stiffness levels along the axis of the catheter during the extrusion manufacturing process without requiring additional fastening or assembly of the different materials.

[0120] The distal portion of the catheter can be manipulated by one or more pull wires 1305. The distal portion of the catheter can be made of any suitable material (such as a copolymer, polymer, metal or alloy) so that it can be bent by the pull wire. In some embodiments, the proximal or terminal end of the one or more pull wires 1305 can be coupled to a drive mechanism (e.g., a gear, pulley, capstan, etc.) via an anchoring mechanism as described above.

[0121] The pull wire 1305 can be a metal wire, cable or filament, or it can be a polymer wire, cable or filament. The pull wire 1305 can also be made of natural or organic materials or fibers. The pull wire 1305 can be any type of suitable wire, cable or filament that can support various loads without deformation, significant deformation or breakage. The distal end or distal portion of one or more pull wires 1305 can be anchored or integrated into the distal portion of the catheter so that the control unit's operation of the pull wire can apply a force or tension to the distal portion, which can manipulate or articulate (e.g., up, down, pitch, yaw or in any direction therebetween) at least the distal portion (e.g., the flexible segment) of the catheter.

[0122] The size of the catheter can enable one or more electronic components to be integrated into the catheter. For example, the outer diameter of the distal tip can be around 4 to 4.4 millimeters (mm), and the diameter of the working channel 1303 can be around 2 mm, so that one or more electronic components can be embedded in the wall of the catheter. However, it should be noted that based on different applications, the outer diameter can be in any range less than 4 mm or greater than 4.4 mm, and the diameter of the working channel can be in any range depending on the tool size or specific application.

[0123] One or more electronic components may include an imaging device, an illumination device, or a sensor. In some embodiments, the imaging device may be a video camera 1313. The imaging device may include an optical element and an image sensor for capturing image data. The image sensor may be configured to generate image data in response to the wavelength of light. Various image sensors such as complementary metal oxide semiconductor (CMOS) or charge coupled device (CCD) may be used to capture image data. The imaging device may be a low-cost camera. In some cases, the image sensor may be provided on a circuit board. The circuit board may be an imaging printed circuit board (PCB). The PCB may include a plurality of electronic components for processing image signals. For example, a circuit for a CCD sensor may include an A / D converter and an amplifier to amplify and convert an analog signal provided by the CCD sensor. Alternatively, the image sensor may be integrated with an amplifier and a converter to convert an analog signal into a digital signal so that a circuit board may not be required. In some cases, the output of the image sensor or circuit board may be image data (digital signal) that may be further processed by a camera circuit or a processor of the camera. In some cases, the image sensor may include an array of optical sensors.

[0124] The lighting device may include one or more light sources 1311 located at the distal tip. The light source may be a light emitting diode (LED), an organic LED (OLED), a quantum dot, or any other suitable light source. In some cases, the light source may be a small LED or dual tone flash LED lighting for compact designs.

[0125] The imaging device and the lighting device may be integrated into the catheter. For example, the distal portion of the catheter may include a suitable structure that matches at least one size of the imaging device and the lighting device. The imaging device and the lighting device may be embedded in the catheter. Fig.14 An example distal portion of a catheter with an integrated imaging device and lighting device is shown. A camera may be located at the distal portion. The distal tip may have a structure for accommodating a camera, lighting device, and / or a position sensor. For example, a camera may be embedded in a cavity 1410 at the distal tip of the catheter. Cavity 1410 may be integrally formed with the distal portion of the cavity and may have a size that matches the length / width of the camera so that the camera may not move relative to the catheter. The camera may be adjacent to the working channel 1420 of the catheter to provide a near-field view of a tissue or organ. In some cases, the attitude or orientation of the imaging device may be controlled by controlling the rotational movement (e.g., rolling) of the catheter.

[0126] The power of the camera can be provided by a wired cable. In some cases, the cable line can be in a harness, which provides power for the lighting element or other circuit at the distal tip of the camera and the catheter. The camera and / or light source can be powered by a power supply located at the handle portion via a wire, a copper wire, or any other suitable tool that travels through the length of the catheter. In some cases, the real-time image or video of the tissue or organ can be wirelessly transmitted to an external user interface or display. Wireless communication can be WiFi, Bluetooth, RF communication, or other forms of communication. In some cases, the image or video captured by the camera can be broadcast to multiple devices or systems. In some cases, the image and / or video data from the camera can be transmitted to the processor located in the handle portion via a wire, a copper wire, or any other suitable tool along the length of the catheter. The image or video data can be transmitted to an external device / system via the wireless communication component in the handle portion. In some cases, the system can be designed to make the line invisible to the operator or the line is not exposed to the operator.

[0127] In conventional endoscopy, the illumination light can be provided by a fiber optic cable that transmits the light of a light source located at the proximal end of the endoscope to the distal end of the robotic endoscope. In some embodiments of the present disclosure, a small LED lamp can be used and embedded in the distal portion of the catheter to reduce design complexity. In some cases, the distal portion may include a structure 1430 having a size that matches the size of the small LED light source. As shown in the illustrated example, two cavities 1430 can be formed integrally with the catheter to accommodate two LED light sources. For example, the outer diameter of the distal tip can be about 4 to 4.4 millimeters (mm), and the diameter of the working channel of the catheter can be about 2mm, so that two LED light sources can be embedded at the distal end. The outer diameter can be in any range less than 4mm or greater than 4.4mm, and the diameter of the working channel can be in any range according to the size of the tool or the specific application. Any number of light sources can be included. The internal structure of the distal portion can be designed to accommodate any number of light sources.

[0128] In some cases, each LED can be connected to a power cord that can extend to the proximal handle. In some embodiments, the LED can be soldered to separate power cords that are subsequently bundled together to form a single strand. In some embodiments, the LED can be soldered to a pull cord that supplies power. In other embodiments, the LED can be crimped or directly connected to a single pair of power cords. In some cases, a protective layer such as a thin layer of biocompatible glue can be applied to the front surface of the LED to provide protection while allowing light to be emitted. In some cases, an additional cover 1431 can be placed at the forward end face of the distal tip to provide precise positioning of the LED and sufficient space for glue. The cover 1431 can be composed of a transparent material that matches the refractive index of the glue so that the illumination light can be unblocked.

[0129] It should be noted that the illustrated distal end design is for illustration purposes only. There may be other suitable designs for integrating one or more components into the distal tip. Fig.15 Another example of a distal portion 1500 of a catheter with an integrated imaging device and an illumination device is shown. As shown in example 1500, the distal tip may have a structure 1501 for accommodating a camera, a structure 1503 for accommodating an illumination device and / or a position sensor. The camera may be embedded in a cavity 1501 at the distal tip of the catheter. Cavity 1501 may be integrally formed with the distal portion of the cavity, and may have a size that matches the length / width of the camera so that the camera cannot move relative to the catheter. The camera may be adjacent to the working channel 1507 of the catheter to provide a near-field view of a tissue or organ. In some cases, the attitude or direction of the imaging device may be controlled by controlling the rotational movement (e.g., rolling) of the catheter. As shown in example 1500, cavity 1503 may be integrally formed with the catheter to accommodate an LED light source.

[0130] In one aspect, a system for controlling the tip motion of an articulated flexible endoscope is provided. The system includes: a memory storing computer executable instructions; one or more processors communicating with the articulated flexible endoscope and configured to execute the computer executable instructions to: generate a command to drive an elongated member of the articulated flexible endoscope along an anatomical path via an instrument drive mechanism (IDM); receive sensor data acquired by a position sensor disposed at a distal tip portion of the elongated member; after determining that the distal tip portion is located at a preselected position within the anatomical path, set the motion of the distal tip to zero and calculate the motion of the distal tip portion within a time window; calculate the difference between the motion of the distal tip portion and the motion of the IDM within the same time window; and detect a buckling event by comparing the difference with a threshold.

[0131] As used herein, a processor includes one or more processors, such as a single processor, or multiple processors of a distributed processing system, for example. The controller or processor described herein generally includes a tangible medium for storing instructions for implementing process steps, and the processor may include, for example, one or more of a central processing unit, a programmable array logic, a gate array logic, or a field programmable gate array. In some cases, one or more processors may be a programmable processor (e.g., a central processing unit (CPU) or a microcontroller), a digital signal processor (DSP), a field programmable gate array (FPGA), and / or one or more advanced RISC machine (ARM) processors. In some cases, one or more processors may be operably coupled to a non-temporary computer-readable medium. A non-temporary computer-readable medium may store logic, code, and / or program instructions that may be executed by one or more processor units to perform one or more steps. A non-temporary computer-readable medium may include one or more memory units (e.g., a removable medium or an external memory, e.g., an SD card or a random access memory (RAM)). One or more methods or operations disclosed herein may be implemented in a hardware component or a combination of hardware and software, e.g., an ASIC, a special-purpose computer, or a general-purpose computer.

[0132] The one or more processors may be in communication with the endoscope.The one or more processors may be located remotely from the endoscope system or located on the endoscope system (eg, at a handle, at a user device used to control the endoscope).

[0133] Although preferred embodiments of the present invention have been shown and described herein, it will be readily understood to those skilled in the art that such embodiments are provided only as examples. Without departing from the present invention, those skilled in the art will now conceive of many variations, changes and substitutions. It should be understood that various alternatives to the embodiments of the present invention described herein may be adopted when implementing the present invention. The appended claims are intended to define the scope of the present invention, and thus cover methods and structures within the scope of these claims and their equivalents.

Claims

1. A method for controlling the movement of a tip of an articulated flexible endoscope, the method comprising: generating commands to drive an elongated member of the articulated flexible endoscope along an anatomical path via an instrument drive mechanism (IDM); receiving sensor data acquired by a position sensor disposed at a distal tip portion of the elongated member; upon determining that the distal tip portion is at a preselected position within the anatomical path, setting the motion of the distal tip portion to zero and calculating the motion of the distal tip portion within a time window; calculating a difference between the motion of the distal tip portion and the motion of the IDM within the same time window; as well as Buckling events are detected by comparing the difference to a threshold value.

2. The method of claim 1, wherein the preselected location is the main carina.

3. The method of claim 1 further comprising determining that the distal tip portion is located at the preselected position based at least in part on the sensor data and the 3D model of the anatomical path. The method of claim 3 , wherein the position sensor comprises an electromagnetic sensor.

5. The method of claim 1, further comprising determining that the distal tip portion is located at the preselected position based at least in part on image data acquired by a camera located at the distal tip portion.

6. The method of claim 1, wherein the threshold is dynamically determined based on a target anatomical region toward which the articulated flexible endoscope is moving.

7. The method of claim 1, wherein the threshold is a function of the tortuosity of the anatomical path. The method according to claim 1 , wherein the size of the time window is between 4 seconds and 8 seconds.

9. The method of claim 8, wherein the size of the time window is determined based on empirical data.

10. The method of claim 1, wherein the motion of the distal tip portion within the time window is an accumulation of distance traveled per time step.

11. The method of claim 1 , further comprising setting an insertion force applied by the IDM to zero upon determining that the distal tip portion is at the preselected position within the anatomical path and comparing the insertion force to a force threshold. 12 . The method of claim 11 , further comprising generating and displaying a warning message on a user interface when it is determined that the insertion force is above the force threshold.

13. The method of claim 1, further comprising controlling a velocity of the distal tip portion of the elongated member based on a difference between an expected velocity and a measured tip velocity.

14. The method of claim 13, wherein the measured tip velocity is calculated as a filtered time derivative of the sensor data projected in a forward direction. The method of claim 13 , wherein the desired speed is based on an input command.

16. The method of claim 14, wherein controlling the velocity of the distal tip portion of the elongated member comprises closed loop control.

17. The method of claim 16, wherein the measured tip velocity is processed through a low pass filter to be used as a feedback signal for the closed loop control.

18. The method of claim 1, wherein the distal tip portion includes structure for housing an imaging device, the position sensor, and an illumination device.

19. The method of claim 1, wherein the proximal end of the elongated member of the articulated flexible endoscope is connected to an IDM for applying force to one or more pull wires to articulate the distal tip portion of the elongated member to insert or retract the articulated flexible endoscope.

20. The method of claim 1, further comprising displaying a message on a user interface indicating the buckling event and a recommendation to take action in response to the buckling event.

21. A system for controlling the movement of the tip of an articulated flexible endoscope, the system comprising: a memory storing computer executable instructions; one or more processors in communication with the articulated flexible endoscope and configured to execute the computer executable instructions to: generating commands to drive an elongated member of the articulated flexible endoscope along an anatomical path via an instrument drive mechanism (IDM); receiving sensor data acquired by a position sensor disposed at a distal tip portion of the elongated member; upon determining that the distal tip portion is at a preselected position within the anatomical path, setting the motion of the distal tip portion to zero and calculating the motion of the distal tip portion within a time window; calculating a difference between the motion of the distal tip portion and the motion of the IDM within the same time window; as well as Buckling events are detected by comparing the difference to a threshold value.

22. The system of claim 21, wherein the preselected location is the main carina.

23. The system of claim 21, wherein the one or more processors are further configured to determine that the distal tip portion is located at the preselected position based at least in part on the sensor data and the 3D model of the anatomical pathway.

24. The system of claim 23, wherein the position sensor comprises an electromagnetic sensor.

25. The system of claim 21, wherein the one or more processors are further configured to determine that the distal tip portion is located at the preselected position based at least in part on image data acquired by a camera located at the distal tip portion.

26. The system of claim 21, wherein the threshold is dynamically determined based on a target anatomical region toward which the articulated flexible endoscope is moving.

27. The system of claim 21, wherein the threshold is a function of the tortuosity of the anatomical pathway.

28. The system of claim 21, wherein the time window is between 4 seconds and 8 seconds in size.

29. The system of claim 28, wherein the size of the time window is determined based on empirical data.

30. The system of claim 21, wherein the movement of the distal tip portion within the time window is an accumulation of distance traveled per time step.

31. The system of claim 21, wherein the one or more processors are further configured to set the insertion force applied by the IDM to zero upon determining that the distal tip portion is at the preselected position within the anatomical path and compare the insertion force to a force threshold.

32. The system of claim 31, wherein the one or more processors are further configured to generate and display a warning message on a user interface when it is determined that the insertion force is above the force threshold.

33. The system of claim 21, wherein the one or more processors are further configured to control a velocity of the distal tip portion of the elongated member based on a difference between an expected velocity and a measured tip velocity.

34. A system according to claim 33, wherein the measured tip velocity is calculated as a filtered time derivative of the sensor data projected in the forward direction.

35. The system of claim 33, wherein the desired speed is based on an input command.

36. The system of claim 34, wherein a closed loop control is used to control the velocity of the distal tip portion of the elongate member.

37. The system of claim 36, wherein the measured tip velocity is processed through a low pass filter to serve as a feedback signal for the closed loop control.

38. The system of claim 31 , wherein the distal tip portion includes structure for housing an imaging device, the position sensor, and an illumination device.

39. The method of claim 31, wherein the proximal end of the elongated member of the articulated flexible endoscope is connected to an IDM for applying force to one or more pull wires to articulate the distal tip portion of the elongated member to insert or retract the articulated flexible endoscope.

40. The system of claim 31 , wherein the one or more processors are further configured to display a message on a user interface indicating the buckling event and a recommendation to take action in response to the buckling event.

Citation Information

Patent Citations

  • Method and system for automatically maintaining an operator selected roll orientation at a distal tip of a robotic endoscope

    CN102711586A

  • Systems and methods for flexible computer-assisted instrument control

    CN109310287A

  • Systems and methods to correct for uncommanded instrument roll

    CN110831536A

  • Insertion / removal supporting apparatus and insertion / removal supporting method

    US20170280978A1

  • System and method for estimating instrument location

    US20190183585A1

Cited By

  • Electrode implantation force estimation method, estimation device, equipment and medium

    CN121081083A