Surgical robot system and its control method
By acquiring motion data of endoscopes and surgical instruments through a surgical robot system and generating three-dimensional model data, precise control of endoscopes and surgical instruments can be achieved, solving the problem of surgeons' difficulty in precise control and reducing labor intensity and operation time.
Patent Information
- Application Number
- CN202310096767.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-02-01
- Publication Date
- 2026-11-17
- Estimated Expiration
- 2043-02-01
AI Technical Summary
In current handheld flexible endoscopy procedures, surgeons have difficulty precisely controlling the position of the endoscope and surgical instruments, leading to prolonged operation time and increased labor intensity.
A surgical robot system was designed, including a robotic arm, a motion control unit, a data acquisition unit, and a data processing unit. By acquiring motion data of the endoscope and surgical instruments, three-dimensional model data is generated to achieve precise control of the endoscope and surgical instruments.
It reduces the operator's workload, improves the precision of endoscopic movement and the certainty of the surgery, and reduces the operation time.
Smart Images

Figure CN116158862B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of medical device technology, and in particular to a surgical robot system and its control method. Background Technology
[0002] An endoscope is a diagnostic instrument that integrates traditional optics, ergonomics, precision mechanics, modern electronics, mathematics, and software. It can enter the stomach through the mouth or other natural orifices, allowing the visualization of lesions that X-rays cannot detect. Therefore, endoscopy is extremely helpful in clinical treatment. For example, it can be used to observe ulcers or tumors in the stomach, enabling the development of treatment plans.
[0003] Handheld flexible endoscopes for the digestive tract are a type of endoscope commonly used by surgeons. When operating the endoscope, surgeons generally rely on experience and touch, and use images to judge the depth and condition of the endoscope. After the endoscope and instruments enter the natural cavity, it is impossible to obtain the precise position of the endoscope by relying solely on the surgeon's experience and visual observation, which will prolong the operation time. Summary of the Invention
[0004] This application provides a surgical robot system and its control method, which can avoid the surgeon holding the endoscope during surgery, reduce the surgeon's labor intensity, and improve the movement accuracy of the endoscope.
[0005] This application provides a surgical robot system, the surgical robot system comprising:
[0006] A robotic arm, wherein an endoscope is mounted and connected to the robotic arm, and surgical instruments are mounted and connected to the endoscope.
[0007] A motion control unit is mounted on the robotic arm and connected to the endoscope and surgical instruments. The motion control unit is used to control the movement of the endoscope and surgical instruments.
[0008] A data acquisition unit is configured to acquire first motion data of the endoscope and second motion data of the surgical instruments relative to the endoscope.
[0009] The data processing unit is used to generate three-dimensional model data based on the first motion data, the second motion data, and the cavity image data of the natural cavity of the target object. The three-dimensional model data is used to guide the robotic arm to control the movement of the endoscope and the surgical instruments.
[0010] In the aforementioned surgical robot system, the surgeon can perform surgery without holding the endoscope, reducing the surgeon's workload. Through corresponding data calculations, the system can obtain the specific positions of the endoscope and surgical instruments in the natural cavities and display them on the display unit. This allows the surgeon to obtain the positional information of the endoscope and surgical instruments more intuitively during the operation, thereby reducing the operation time and increasing the certainty of the operation.
[0011] In one embodiment, the first motion data includes first displacement data of the endoscope and first bending data of the endoscope; and / or,
[0012] The second motion data includes second displacement data of the surgical instrument relative to the endoscope and second bending data of the surgical instrument.
[0013] In the above embodiments, the first motion data and the second motion data are specifically defined as the displacement data and bending data of the endoscope and surgical instruments, which makes the surgical robot's control of the surgical instruments more precise.
[0014] In one embodiment, the data acquisition unit includes a first displacement sensor, the endoscope has a first initial spatial position as an initial movement reference, the first displacement sensor is used to acquire first initial position data of the first initial spatial position of the endoscope, and calculate first displacement data of the endoscope based on the first initial position data.
[0015] In one embodiment, the first displacement data includes the linear distance of movement of the endoscope; and / or,
[0016] The first initial spatial position of the endoscope is defined at the entrance of the natural cavity of the target object; and / or,
[0017] The first displacement sensor is used to calculate the linear displacement length of the endoscope as it passes through the first initial spatial position, and to generate the first displacement data based on the linear displacement length of the endoscope.
[0018] In one embodiment, the motion control unit includes a first drive device disposed on the robotic arm. The first drive device includes a rotary drive mechanism, which is drivenly connected to the curved section of the endoscope to drive the curved section of the endoscope to perform a bending motion. The data acquisition unit includes a first rotation sensor, which is used to acquire first rotation data of the rotary drive mechanism. The data processing unit is used to generate the first bending data based on the first rotation data.
[0019] In the above embodiments, the first driving device adopts a rotary drive mechanism, which can use the rotation angle data of the rotary wheel in the rotary drive mechanism to calculate the first bending data, and then use the first bending data to reflect the bending state formed by the bending segment of the endoscope, which is more direct and accurate.
[0020] In one embodiment, the first rotation data includes rotation angle data of at least one wheel in the wheel drive mechanism, and the data processing unit is used to calculate the first bending data based on the rotation angle data.
[0021] In one embodiment, the bending motion of the curved section of the endoscope includes left-right yaw motion and up-down pitch motion, the first rotation data includes yaw rotation data and pitch rotation data, the first rotation sensor is used to acquire at least one of the yaw rotation data and the pitch rotation data, and the data processing unit is used to generate the first bending data based on at least one of the yaw rotation data and the pitch rotation data.
[0022] In the above embodiments, the first rotation data can specifically be used to represent the yaw rotation data of the curved section of the endoscope performing left and right yaw motion, and the pitch rotation data of the curved section of the endoscope performing up and down pitch motion.
[0023] In one embodiment, the rotary drive mechanism includes a first rotary wheel group and a second rotary wheel group. The first rotary wheel group is driven to the curved section of the endoscope and is used to drive the curved section of the endoscope to perform left and right yaw motion. The second rotary wheel group is driven to the curved section of the endoscope and is used to drive the curved section of the endoscope to perform up and down pitch motion.
[0024] In one embodiment, the motion control unit further includes a second drive device, a power box, and an instrument box. The power box and the instrument box are connected, and the instrument box is connected to the surgical instrument. The second drive device includes a base and a lead screw drive mechanism. The lead screw drive mechanism is disposed on the base and is drivenly connected to the power box, synchronously driving the movement of the instrument box and the surgical instrument. The data acquisition unit includes a second rotation sensor, which is used to acquire second rotation data of the lead screw drive mechanism. The data processing unit is used to generate second displacement data based on the second initial position data and the second rotation data.
[0025] In the above embodiments, the lead screw drive mechanism can synchronously drive the instrument box and the surgical instruments to move, and the second rotation sensor can generate the second displacement data based on the second initial position data and the second rotation data.
[0026] In one embodiment, the second rotation data includes the rotation angle data of the lead screw in the lead screw drive mechanism, and the data processing unit is used to calculate the second displacement data based on the rotation angle data of the lead screw in the lead screw drive mechanism.
[0027] In one embodiment, the data acquisition unit includes a second displacement sensor, and the base has a second initial spatial position as an initial movement reference for the surgical instrument. The second displacement sensor is used to acquire second initial position data of the second initial spatial position of the surgical instrument, and to calculate second displacement data of the surgical instrument based on the second initial position data and the second rotation data.
[0028] In one embodiment, when the surgical instrument is in the second initial spatial position, the distal end of the surgical instrument coincides with the distal end of the endoscope; and / or,
[0029] A sensor detection component is provided on the base. The sensor detection component is located at the second initial spatial position. The second displacement sensor obtains the second initial position data of the second initial spatial position of the surgical instrument by detecting the sensor detection component.
[0030] In one embodiment, the instrument box includes a traction wire drive mechanism, which is drivenly connected to the surgical instrument and used to control at least one steering joint of the surgical instrument to perform bending motion; the data acquisition unit includes a third rotation sensor, which is used to acquire third rotation data of the traction wire drive mechanism, and the data processing unit is used to generate the second bending data based on the third rotation data.
[0031] In the above embodiments, since the traction wire is driven by the wire wheel and the steering joint of the surgical instrument is driven by the traction wire, the rotation angle data of the wire wheel can also be converted into second bending data representing the bending motion of the steering joint of the surgical instrument.
[0032] In one embodiment, the third rotation data includes rotation angle data of at least one thread wheel in the traction wire drive mechanism, and the data processing unit is used to calculate the second bending data based on the rotation angle data of the thread wheel in the traction wire drive mechanism.
[0033] In one embodiment, the traction wire drive mechanism includes a first wire drive group and a second wire drive group. The first wire drive group is driven to at least one steering joint of the surgical instrument and is used to drive at least one steering joint of the surgical instrument to perform left and right yaw motion. The second wire drive group is driven to at least one steering joint of the surgical instrument and is used to drive at least one steering joint of the surgical instrument to perform up and down pitch motion.
[0034] In one embodiment, the surgical robot system includes:
[0035] Input unit, the input unit being used to input marker data into the three-dimensional model data; and / or,
[0036] The display unit is used to read the three-dimensional model data.
[0037] In the above embodiments, the display unit is used to read the three-dimensional model data. The display unit is, for example, a medical screen. After reading the three-dimensional model data, the display unit can be used to display a virtual three-dimensional model in real time. Moreover, the display unit can also display 2D or 3D images observed by the endoscope in real time, which is convenient for the surgeon to observe during examination or surgery.
[0038] This application provides a control method for a surgical robot system, the control method comprising:
[0039] Acquire the first motion data of the endoscope and the second motion data of the surgical instruments relative to the endoscope;
[0040] Three-dimensional model data is generated based on the first motion data, the second motion data, and the cavity image data of the natural cavity of the target object;
[0041] The movement of the endoscope and surgical instruments is guided by the three-dimensional model data.
[0042] In one embodiment, the first motion data includes first displacement data of the endoscope and first bending data of the endoscope; and / or,
[0043] The second motion data includes second displacement data of the surgical instrument relative to the endoscope and second bending data of the surgical instrument. Attached Figure Description
[0044] Figure 1 This is a schematic diagram of the usage state of a surgical robot system provided in one embodiment of the present invention;
[0045] Figure 2 This is a partial schematic diagram of the usage state of a surgical robot system according to an embodiment of the present invention;
[0046] Figure 3 This is a schematic diagram of the structure of an endoscope provided in one embodiment of the present invention;
[0047] Figure 4 A partial structural schematic diagram of an endoscope provided in one embodiment of the present invention;
[0048] Figure 5 A schematic diagram of the first control state of an endoscope and motion control unit provided in an embodiment of the present invention;
[0049] Figure 6 A schematic diagram of the second control state of an endoscope and motion control unit provided in an embodiment of the present invention;
[0050] Figure 7 This is a schematic diagram of the structure of a surgical instrument provided in one embodiment of the present invention;
[0051] Figure 8 This is a schematic diagram illustrating the state of an endoscope and surgical instruments entering a natural cavity, according to one embodiment of the present invention.
[0052] Icon labels:
[0053] A. Natural cavities;
[0054] 1000, Robotic arm; 2000, Endoscope; 3000, Surgical instruments; 4000, Motion control unit; 5000, Data acquisition unit;
[0055] 2000a, First initial spatial position; 2100, Main body segment; 2200, Curved segment;
[0056] 3000a, Second initial spatial position; 3100, Steering joint;
[0057] 4100, First drive unit; 4200, Second drive unit; 4300, Power box;
[0058] 4210, Base; 4220, Lead screw drive mechanism; 4310, Instrument box;
[0059] 5100, First displacement sensor; 5200, Second displacement sensor. Detailed Implementation
[0060] To make the above-mentioned objects, features, and advantages of the present invention more apparent and understandable, specific embodiments of the present invention will be described in detail below with reference to the accompanying drawings. Many specific details are set forth in the following description to provide a thorough understanding of the present invention. However, the present invention can be practiced in many other ways different from those described herein, and those skilled in the art can make similar modifications without departing from the spirit of the present invention. Therefore, the present invention is not limited to the specific embodiments disclosed below.
[0061] In the description of this invention, it should be understood that the terms "center," "longitudinal," "lateral," "length," "width," "thickness," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," "clockwise," "counterclockwise," "axial," "radial," and "circumferential" indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings. They are used only for the convenience of describing this invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on this invention.
[0062] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of that feature. In the description of this invention, "a plurality of" means at least two, such as two, three, etc., unless otherwise explicitly specified.
[0063] In this invention, unless otherwise explicitly specified and limited, the terms "installation," "connection," "linking," and "fixing," etc., should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral part; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium; they can refer to the internal communication of two components or the interaction between two components, unless otherwise explicitly limited. Those skilled in the art can understand the specific meaning of the above terms in this invention according to the specific circumstances.
[0064] In this invention, unless otherwise explicitly specified and limited, "above" or "below" the second feature can mean that the first feature is in direct contact with the second feature, or that the first feature is in indirect contact with the second feature through an intermediate medium. Furthermore, "above," "over," and "on top" of the second feature can mean that the first feature is directly above or diagonally above the second feature, or simply that the first feature is at a higher horizontal level than the second feature. "Below," "below," and "under" the second feature can mean that the first feature is directly below or diagonally below the second feature, or simply that the first feature is at a lower horizontal level than the second feature.
[0065] It should be noted that when an element is referred to as being "fixed to" or "set on" another element, it can be directly on the other element or there may be an intervening element. When an element is considered to be "connected to" another element, it can be directly connected to the other element or there may be an intervening element. The terms "vertical," "horizontal," "upper," "lower," "left," "right," and similar expressions used herein are for illustrative purposes only and do not represent the only possible implementation.
[0066] See Figure 1 and Figure 3 As shown, one embodiment of the present invention provides a surgical robot system, which includes a robotic arm 1000, a motion control unit 4000, a data acquisition unit 5000, and a data processing unit. (Continue reading) Figure 3 As shown, the robotic arm 1000 is equipped with an endoscope 2000. (Continue reading...) Figure 6 and Figure 7 As shown, the endoscope 2000 is assembled and connected to a surgical instrument 3000. A motion control unit 4000 is mounted on the robotic arm 1000 and connected to both the endoscope 2000 and the surgical instrument 3000. The motion control unit 4000 controls the movement of both the endoscope 2000 and the surgical instrument 3000. A data acquisition unit 5000 acquires first motion data of the endoscope 2000, such as first displacement data and first bending data of the endoscope 2000. The data acquisition unit 5000 also acquires second motion data of the surgical instrument 3000 relative to the endoscope 2000, such as second displacement data and second bending data of the surgical instrument 3000 relative to the endoscope 2000.
[0067] Continue reading Figure 8 As shown, the data processing unit is used to generate three-dimensional model data based on the first motion data, the second motion data, and the cavity image data of the natural cavity A of the target object. The three-dimensional model data is used to guide the robotic arm 1000 to control the movement of the endoscope 2000 and the surgical instrument 3000. For example, the data processing unit is used to generate three-dimensional model data based on the first displacement data, the first bending data, the second displacement data, the second bending data, and the cavity image data of the natural cavity A of the target object. The three-dimensional model data is used to guide the robotic arm 1000 to control the movement of the endoscope 2000 and the surgical instrument 3000.
[0068] The robotic arm 1000 can adopt various structural forms. For example, the robotic arm 1000 can have a main operating arm and an execution end slave arm. The main operating arm can be configured to form a master-slave control relationship with the execution end slave arm. The surgeon can control the movement of the execution end slave arm by manipulating the main operating arm, and then control the movement of surgical instruments 3000 and endoscopes 2000 on the execution end slave arm. For example, the master-slave control relationship between the main operating arm and the execution end slave arm can be established or disconnected through a clutch adjustment component, and other execution actions of the surgical instruments 3000 and endoscopes 2000 can be controlled.
[0069] The patient will lie on the operating table. Before surgery, the surgeon can control the movement of the robotic arm 1000 to adjust the surgical instruments 3000 and endoscope 2000 to the optimal surgical position. (See also...) Figure 2 As shown, the optimal surgical position is generally determined by establishing an initial position near the target object. This allows the robotic arm 1000 to control the surgical instruments 3000 and endoscope 2000 to move to the initial position before performing the surgical operation. Determining the initial position facilitates precise control of the surgical instruments 3000 and endoscope 2000 to perform corresponding actions. In one embodiment, the data acquisition unit 5000 includes a first displacement sensor 5100. The endoscope 2000 has a first initial spatial position 2000a as an initial movement reference. The first displacement sensor 5100 is used to acquire first initial position data of the first initial spatial position 2000a of the endoscope 2000 and calculate first displacement data of the endoscope 2000 based on the first initial position data.
[0070] The first displacement sensor 5100 can select any one or more positions on the endoscope 2000 as detection points. When the robotic arm 1000 controls the endoscope 2000 to move, the first displacement sensor 5100 can use the first initial spatial position 2000a as the initial movement reference. As the endoscope 2000 moves, it compares the position of the detection point on the endoscope 2000 relative to the first initial position with the position of the first initial position. Then, by calculating the movement distance of the detection point relative to the first initial position, it can deduce the actual movement distance of the endoscope 2000. The movement distance of the endoscope 2000 is linear. For example, the first displacement sensor 5100 is used to calculate the linear displacement of the endoscope 2000 after passing through the first initial spatial position 2000a. The length is generated based on the linear displacement length of the endoscope 2000. Therefore, the first displacement data actually includes the linear movement distance of the endoscope 2000. In particular, when the first initial spatial position 2000a of the endoscope 2000 is defined at the entrance position of the natural cavity A of the target object, the linear movement distance of the endoscope 2000 detected by the first displacement sensor 5100 is the linear movement distance of the endoscope 2000 from the entrance position of the natural cavity A of the target object and along the natural cavity A. The linear movement distance is mainly manifested as the shape that conforms to the linear curved trajectory of the natural cavity A. Therefore, the first displacement data can show the actual trajectory of the endoscope 2000 moving along the natural cavity A.
[0071] Please see Figure 3 The endoscope 2000 includes a main body segment 2100 and a curved segment 2200, which are connected. The curved segment 2200 may have one or more joints, and these joints may have degrees of freedom in different directions. In addition to linear movement, the endoscope 2000 can also perform bending movements using the curved segment 2200. (Continue reading) Figure 4 In one embodiment, the motion control unit 4000 may include a first drive device 4100, which is disposed on the robotic arm 1000 and is used to drive the bending segment 2200 of the endoscope 200 to perform bending motion.
[0072] The first driving device 4100 can adopt various driving forms, such as a transmission chain drive mechanism, a transmission belt drive mechanism, a gear drive mechanism, a lead screw drive mechanism 4220, a traction wire drive mechanism, etc., without limitation. For example, the first driving device 4100 includes a rotary wheel drive mechanism, which can be a sprocket drive, a pulley drive, or a gear drive, etc. The rotary wheel drive mechanism is driven to the bending section 2200 of the endoscope 2000 and is used to drive the bending section 2200 of the endoscope 2000 to perform bending motion. The data acquisition unit 5000 may include a first rotation sensor, which is used to acquire the first rotation data of the rotary wheel drive mechanism. The data processing unit is used to generate the first bending data based on the first rotation data.
[0073] When a rotary drive mechanism has one or more rotary wheels, the rotary wheels are not limited to sprockets, pulleys, or gears, and rotation can be driven by a motor, etc. Therefore, when one or more rotary wheels in the rotary drive mechanism rotate in coordination, the rotary drive mechanism can synchronously control the curved section 2200 of the endoscope 2000 to form a corresponding degree of curvature as the rotary wheels rotate. Therefore, the first rotation data may include the rotation angle data of the rotary wheels in the rotary drive mechanism. The data processing unit is used to calculate the first curvature data based on the rotation angle data. The first curvature data reflects the curvature state formed by the curved section 2200 of the endoscope 2000.
[0074] In one embodiment, the bending motion of the curved segment 2200 of the endoscope 2000 includes left-right yaw motion and up-down pitch motion. Correspondingly, the first rotation data also includes yaw rotation data indicating that the curved segment 2200 of the endoscope 2000 performs left-right yaw motion, and pitch rotation data indicating that the curved segment 2200 of the endoscope 2000 performs up-down pitch motion. The first rotation sensor can be used to acquire the yaw rotation data and generate the first bending data based on the yaw rotation data, or the first rotation sensor can be used to acquire the pitch rotation data and generate the first bending data based on the pitch rotation data.
[0075] In one embodiment, the rotary drive mechanism may include a first rotary wheel group and a second rotary wheel group. The first rotary wheel group is driven to the curved section 2200 of the endoscope 2000 to drive the curved section 2200 of the endoscope 2000 to perform left-right yaw motion. Therefore, the first rotation data may include the rotation angle data of the rotary wheels in the first rotary wheel group. The data processing unit is used to calculate the first bending data based on the rotation angle data of the rotary wheels in the first rotary wheel group. Alternatively, the second rotary wheel group is driven to the curved section 2200 of the endoscope 2000 to drive the curved section 2200 of the endoscope 2000 to perform up-down pitch motion. The first rotation data may include the rotation angle data of the rotary wheels in the second rotary wheel group. The data processing unit is used to calculate the first bending data based on the rotation angle data of the rotary wheels in the second rotary wheel group.
[0076] For example, the data processing unit can calculate the first bending data using the following formula:
[0077] α1 = (θ1 / a)∙c;
[0078] α2 = (θ2 / b)∙d;
[0079] Wherein, α1 is the first bending data calculated based on the first wheel group, α2 is the first bending data calculated based on the second wheel group, θ1 is the rotation angle of the wheel in the first wheel group, θ2 is the rotation angle of the wheel in the second wheel group; a is the reduction ratio of the wheel in the first wheel group, b is the reduction ratio of the wheel in the second wheel group; c and d are the proportional constants of the 2200-degree rotation axis of the bending section and the rotation axis angle of the first wheel group and the second wheel group.
[0080] Continue reading Figure 5 In one embodiment, the motion control unit 4000 further includes a second drive device 4200, a power box 4300, and an instrument box 4310. The power box 4300 and the instrument box 4310 are connected, and the instrument box 4310 is connected to the surgical instrument 3000. The second drive device 4200 can adopt various drive forms, such as a transmission chain drive mechanism, a transmission belt drive mechanism, a gear drive mechanism, a lead screw drive mechanism 4220, a traction wire drive mechanism, etc., without limitation. For example, the second drive device 4200 includes a base 4210 and a lead screw drive mechanism 4220. The lead screw drive mechanism 4220 is disposed on the base 4210 and is drivenly connected to the power box 4300. Since the power box 4300 is connected to the instrument box 4310, and the instrument box 4310 is used to connect the surgical instrument 3000, therefore, see [reference needed]. Figure 6As shown, the lead screw drive mechanism 4220 can also synchronously drive the instrument box 4310 and the surgical instrument 3000 to move. The data acquisition unit 5000 may include a second rotation sensor, which is used to acquire the second rotation data of the lead screw drive mechanism 4220. The data processing unit is used to generate the second displacement data based on the second initial position data and the second rotation data.
[0081] The lead screw drive mechanism 4220 includes a motor and a lead screw. The motor can drive the lead screw to rotate. After the motor drives the lead screw to rotate, the lead screw can convert the rotational motion of the motor into linear motion, thereby driving the surgical instrument 3000 to perform a movement. Therefore, in one embodiment, the second rotation data includes the rotation angle data of the lead screw in the lead screw drive mechanism 4220. Since the lead screw can convert the rotational motion of the motor into linear motion, the rotation angle data of the lead screw in the lead screw drive mechanism 4220 can also be converted into second displacement data representing the movement of the surgical instrument 3000. Therefore, the data processing unit can be used to calculate the second displacement data based on the rotation angle data of the lead screw in the lead screw drive mechanism 4220.
[0082] The second displacement data calculated from the rotation angle data of the lead screw can represent the linear displacement length of the surgical instrument 3000. Therefore, an initial position can be defined. When the linear displacement length of the surgical instrument 3000 from the initial position is calculated, the linear displacement length of the surgical instrument 3000 relative to the endoscope 2000 can be known. For example, in one embodiment, the data acquisition unit includes a second displacement sensor 5200. The base 4210 has a second initial spatial position 3000a as the initial movement reference of the surgical instrument 3000. The second displacement sensor 5200 is used to acquire the second initial position data of the second initial spatial position 3000a of the surgical instrument 3000. After calculating the second displacement data of the surgical instrument 3000 based on the second initial position data and the second rotation data, the obtained second displacement data can represent the linear displacement length of the surgical instrument 3000 relative to the endoscope 2000.
[0083] In particular, when the surgical instrument 3000 is in the second initial spatial position 3000a, the distal position of the surgical instrument 3000 coincides with the distal position of the endoscope 2000, that is, the distal tip of the surgical instrument 3000 is flush with the distal tip of the endoscope 2000. Therefore, the movement of the surgical instrument 3000 relative to the endoscope 2000 represented by the second displacement data is the movement of the surgical instrument 3000 extending out of the endoscope 2000. The second displacement sensor 5200 can start calculating the linear displacement length of the surgical instrument 3000 when the surgical instrument 3000 extends out of the endoscope 2000. The base 4210 is provided with a sensor detection component, which can be recognized by the second displacement sensor 5200. Therefore, the sensor detection component can be set at the second initial spatial position 3000a. The second displacement sensor 5200 can obtain the second initial position data of the second initial spatial position 3000a of the surgical instrument 3000 by detecting the sensor detection component, and then calculate the second displacement data of the surgical instrument 3000 based on the second initial position data and the second rotation data.
[0084] For example, the data processing unit can calculate the second displacement data using the following formula:
[0085] L2 = (θ3 / 360)∙e;
[0086] L3 = ±L2, + when the distal end of the surgical instrument 3000 protrudes beyond the distal end of the endoscope 2000, and - otherwise;
[0087] Where L2 is the linear displacement length of the surgical instrument 3000, L3 is the linear displacement length of the surgical instrument 3000 relative to the second initial spatial position 3000a, θ3 is the rotation angle data of the lead screw, and e is the lead of the lead screw.
[0088] The instrument box 4310 can adopt various driving forms, such as a transmission chain drive mechanism, a transmission belt drive mechanism, a gear drive mechanism, a lead screw drive mechanism, a traction wire drive mechanism, etc., without limitation. For example, in one embodiment, the instrument box 4310 includes a traction wire drive mechanism, which is drivenly connected to the surgical instrument 3000 and used to control at least one steering joint 3100 of the surgical instrument 3000 to perform bending motion; the data processing unit includes a third rotation sensor, which is used to acquire third rotation data of the traction wire drive mechanism, and the data processing unit is used to generate the second bending data based on the third rotation data.
[0089] The traction wire drive mechanism includes a motor, a wire wheel, and a traction wire. The motor drives the wire wheel to rotate, and the rotation of the wire wheel pulls the traction wire to move. In turn, the traction wire drives one or more steering joints 3100 of the surgical instrument 3000 to perform bending motion. Since the wire wheel drives the traction wire, and the traction wire drives the steering joints 3100 of the surgical instrument 3000 to move synchronously, the rotation angle data of the wire wheel can also be converted into second bending data representing the bending motion of the steering joints 3100 of the surgical instrument 3000. Therefore, in one embodiment, the third rotation data includes the rotation angle data of at least one wire wheel in the traction wire drive mechanism. The data processing unit can be used to calculate the second bending data based on the rotation angle data of the wire wheel in the traction wire drive mechanism.
[0090] Please see Figure 7 The surgical instrument 3000 may have multiple steering joints 3100, and the steering joints 3100 of the surgical instrument 3000 may also have multiple degrees of freedom. For example, in one embodiment, the traction wire drive mechanism includes a first wire drive group and a second wire drive group. The first wire drive group is driven and connected to the steering joint 3100 of the surgical instrument 3000 to drive the steering joint 3100 of the surgical instrument 3000 to perform left and right yaw motion. The second wire drive group is driven and connected to the steering joint 3100 of the surgical instrument 3000 to drive the steering joint 3100 of the surgical instrument 3000 to perform up and down pitch motion. At this time, the left and right yaw motion and the up and down pitch motion of the steering joint 3100 constitute two different degrees of freedom. In addition, those skilled in the art can set other numbers of degrees of freedom according to needs, which are not limited here.
[0091] For example, the data processing unit can calculate the second bending data using the following formula:
[0092] β = θ∙f;
[0093] Where β represents the second curvature data, θ represents the rotation angle data of the steering joint 3100 of the surgical instrument 3000, and f represents the proportionality constant between the angle of the steering joint 3100 shaft and the motor shaft. When there are multiple steering joints 3100, each joint can be calculated separately using the above formula.
[0094] In one embodiment, the surgical robot system includes an input unit and a display unit. The input unit is used to input marker data into the three-dimensional model data, and the display unit is used to read the three-dimensional model data. The display unit, for example, is a medical screen. After reading the three-dimensional model data, the display unit can display a virtual three-dimensional model in real time. The display unit can also display 2D or 3D images observed by the endoscope 2000 in real time, facilitating observation by the surgeon during examination or surgery. The data processing unit analyzes and integrates the acquired first displacement data, first bending data, second displacement data, second bending data, and cavity image data of the target object's natural cavity A into the computer software. Then, the computer software builds a real-time surgical status model based on the integrated data and displays it on the display unit. When a lesion is observed, marker data can be input through the input unit, and then marked on the display unit using the marker data. The surgeon can mark the lesion location on the model on the display unit using special conspicuous marks, facilitating quick location of the lesion during a second endoscopic surgery.
[0095] The surgical robot system, which combines a handheld flexible endoscope 2000 with a robotic arm 1000, enables surgeons to perform surgery without holding the endoscope 2000, reducing their workload. Through corresponding data calculations, the system can obtain the specific positions of the endoscope 2000 and surgical instruments 3000 in the natural cavity A and display the model on the display unit. This allows the surgeon to obtain the positional information of the endoscope 2000 and surgical instruments 3000 more intuitively during surgery, thereby reducing surgical time and increasing the certainty of the surgery.
[0096] This application provides a control method for a surgical robot system. The control method includes: acquiring first motion data of an endoscope 2000 and second motion data of a surgical instrument 3000 relative to the endoscope 2000; generating three-dimensional model data based on the first motion data, the second motion data, and cavity image data of a natural cavity A of a target object; and using the three-dimensional model data to guide the movement of the endoscope 2000 and the surgical instrument 3000. For example, acquiring first displacement data of the endoscope 2000, first bending data of the endoscope 2000, second displacement data of the surgical instrument 3000 relative to the endoscope 2000, and second bending data of the surgical instrument 3000; generating three-dimensional model data based on the first displacement data, the first bending data, the second displacement data, the second bending data, and cavity image data of the natural cavity A of the target object; and using the three-dimensional model data to guide the movement of the endoscope 2000 and the surgical instrument 3000. Since the specific structure, functional principles, and technical effects of the surgical robot system have been described in detail above, they will not be repeated here. Any technical content related to the surgical robot system can be referred to the above description. Therefore, the control method of the surgical robot system can also be referred to the above description.
[0097] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0098] The embodiments described above are merely illustrative of several implementations of the present invention, and while the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the invention patent. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of the present invention, and these all fall within the protection scope of the present invention. Therefore, the protection scope of this invention patent should be determined by the appended claims.
Claims
1. A surgical robotic system, characterized by, The surgical robot system includes: A robotic arm, wherein an endoscope is mounted and connected to the robotic arm, and surgical instruments are mounted and connected to the endoscope. A motion control unit is mounted on the robotic arm and connected to the endoscope and surgical instruments. The motion control unit is used to control the movement of the endoscope and surgical instruments. The motion control unit includes a base on which sensor detection components are mounted. A data acquisition unit is configured to acquire first motion data of the endoscope and second motion data of the surgical instrument relative to the endoscope. The first motion data includes first displacement data and first bending data of the endoscope, and the second motion data includes second displacement data and second bending data of the surgical instrument relative to the endoscope. The data acquisition unit includes a displacement sensor and a rotation sensor. The displacement sensor detects the linear displacement of the endoscope and the surgical instrument, and the rotation sensor detects the rotation angle of the endoscope and the surgical instrument. The endoscope has a first initial spatial position as an initial movement reference, and the base has a second initial spatial position as an initial movement reference for the surgical instrument. When the surgical instrument is in the second initial spatial position, the distal position of the surgical instrument coincides with the distal position of the endoscope; the sensor detection component is located in the second initial spatial position. A data processing unit is configured to generate three-dimensional model data based on the first motion data, the second motion data, and cavity image data of the natural cavity of the target object. The three-dimensional model data is used to guide the robotic arm to control the movement of the endoscope and the surgical instruments. The data acquisition unit includes a first displacement sensor, which is used to acquire first initial position data of the first initial spatial position of the endoscope and calculate first displacement data of the endoscope based on the first initial position data. The motion control unit further includes a second driving device, which includes a lead screw driving mechanism. The data acquisition unit includes a second rotation sensor, which is used to acquire second rotation data of the lead screw driving mechanism. The data acquisition unit also includes a second displacement sensor, which is used to acquire second initial position data of the second initial spatial position of the surgical instrument. The second displacement data of the surgical instrument is calculated based on the second initial position data and the second rotation data.
2. The surgical robotic system of claim 1, wherein, The first displacement data includes the linear movement distance of the endoscope.
3. The surgical robotic system of claim 1, wherein, The first initial spatial position of the endoscope is defined at the entrance of the natural cavity of the target object.
4. The surgical robotic system of claim 1, wherein, The first displacement sensor is used to calculate the linear displacement length of the endoscope as it passes through the first initial spatial position, and to generate the first displacement data based on the linear displacement length of the endoscope.
5. The surgical robotic system of claim 1, wherein, The motion control unit includes a first drive device, which is mounted on the robotic arm. The first drive device includes a rotary drive mechanism, which is driven to the curved section of the endoscope. The data acquisition unit includes a first rotation sensor, which is used to acquire first rotation data of the rotary drive mechanism.
6. The surgical robotic system of claim 5, wherein, The bending motion of the curved section of the endoscope includes left-right yaw motion and up-down pitch motion. The first rotation data includes yaw rotation data and pitch rotation data. The first rotation sensor is used to acquire at least one of the yaw rotation data and the pitch rotation data.
7. The surgical robotic system of claim 1, wherein, The motion control unit further includes a power box and an instrument box, which are connected to each other, and the instrument box is connected to the surgical instruments. The lead screw drive mechanism is mounted on the base and is connected to the power box, and synchronously drives the instrument box and the surgical instruments to move.
8. The surgical robotic system of claim 7, wherein, The instrument box includes a traction wire drive mechanism, which is driven and connected to the surgical instrument to control at least one steering joint of the surgical instrument to perform bending motion; the data acquisition unit includes a third rotation sensor, which is used to acquire third rotation data of the traction wire drive mechanism, and the data processing unit is used to generate the second bending data based on the third rotation data.
9. The surgical robot system according to claim 8, characterized in that, The third rotation data includes the rotation angle data of at least one wire wheel in the traction wire drive mechanism, and the data processing unit is used to calculate the second bending data based on the rotation angle data of the wire wheel in the traction wire drive mechanism.
10. The surgical robot system according to claim 8, characterized in that, The traction wire drive mechanism includes a first wire drive group and a second wire drive group. The first wire drive group is driven to at least one steering joint of the surgical instrument and is used to drive at least one steering joint of the surgical instrument to perform left and right yaw motion. The second wire drive group is driven to at least one steering joint of the surgical instrument and is used to drive at least one steering joint of the surgical instrument to perform up and down pitch motion.
11. The surgical robotic system of claim 1, wherein, The surgical robot system includes: Input unit, the input unit being used to input marker data into the three-dimensional model data; and / or, The display unit is used to read the three-dimensional model data.
Citation Information
Patent Citations
Surgical robots and control methods thereof
CN105078576A
Double-arm robot navigation control method, device and system and storage medium
CN115153842A
